Slavery’s legacy is a major factor in today’s inequality, forging wealth gaps. Policy and prejudice still drive the rest.