That is not quite true. You can operate the Raspberry. But it always displays the symbol that it has too little power.
This becomes clear with the new RetroPie 4.4. The settings (WiFi, Bluetooth etc.) cannot be opened. It switches to the terminal and there is the clear error message: "Not enough power".

Yes, that is possible.