I have been able to only collect one pretty reliably but never zero.

How do you enter the portal after defeating Freya without collecting the Upgradium? Seems impossible to me.