My view is that if I have no memory of the event, it does not help me at all. I am sure I have had mind-blowing dreams that would change every waking second of my reality in a positive, life-altering way, but I don't remember them! I have probably also had dreams that would crush me and make me lie in bed for the rest of my life.
Many are quick to eliminate the ego, sometimes for egotistical reasons (e.g., "I broke on through to the other side and no one else in my family/class/friend group/town has! I'm special and enlightened!" ). As much as we strive for balance and understanding, we still have to wake up the next day and go to work, school, or sitting around... Or whatever it is that you do.
The ego may try to protect us from Earth shattering realizations so we can even exist on this physical plane. If you don't remember something, it's possibly because it's in the category of "could possibly destroy or alter your life".
I view "ego loss" in a different light; honestly I do not want to lose control nor do I want to forget my experience. I like to get my doses to the perfect level where I forget about who I am (or really "was" before the experience) and what I will become. I enjoy having my time, location, and identity disappear sometimes, but I don't want to lose total control and hurt someone, whatever. But there's that perfect state of the concept of "you" not existing, as Mr. Leary called "the clear light."
For "aiming past ego loss," I think you need to determine for yourself where you are comfortable going. Do you want to exit our normal, shared reality totally? Or dip your toes in the experience and never go deeper? It's your choice, but a little exploring is always necessary to know your options. Good luck
"Think for yourself and question authority." - Leary
"To step out of ideology - it hurts. It's a painful experience. You must force yourself to do it." - Žižek