Letting the company selling the product also certify it as world-changing AGI is like letting a car dealer crown its sedan 'safest on Earth.' Massive conflict of interest — needs outside eyes.
Yeah, companies chase profits so they'd gloss over dangers. Public oversight means real people get a say in what counts as safe AGI.