Perhaps better off. Fewer modern racial issues? More early investment capital to find more efficient crops or industry (Georgia, big on slave agriculture, sat on a lot of iron, other states in coal) right at the start of the Industrial Revolution, and immigration ramping up, meaning industrialization happening earlier?
Or maybe our native tribes would have been more enslaved instead, with all the modern racial problems which that implies.