Public institutions serve everyone, so they must stay secular. Religious symbols in them push one faith over others and erode neutrality.
I'd add that keeping spaces secular protects religion itself. It prevents the government from interfering with personal faith or turning it into a political tool.
