The only one entitled to fully enjoy the blessings of American liberty were white people who were born in the United States. As their wealth increased so did their power so mostly it was the wealthy elites who controlled companies and often had monopolies which is why they worked together with the government. Teddy Roosevelt was among the first who started fighting against this.
African-Americans were heavily segregated and were prevented from attaining political power due to various laws that prevented them from voting if they couldn't get educated, or if they were poor. Only a small minority of African-Americans had some sort of power and it was limited.
Women did not have voting rights at the time. They won their voting rights during the 20th century when the 19th amendment was passed. Before that they couldn't vote and often could not even have property or jobs because it all belonged to their husbands.
Labor was tough because the workers were not allowed to fight for their rights. The country fought against successful unionization of workers because they didn't want the workers to bother the wealthy elites who were working with the government.
Immigrants were disliked mostly for the same reasons as now. It was perceived that they were stealing jobs from local people because they were prepared to work for smaller wages. Also, it often wasn't about skin color since many white people were discriminated against because the Catholics who started moving to the US more and more were disliked since people believed that it was pope's way of getting power in the US.
Colonial subjects were often not treated as full citizens of the United States and it was perceived that the main reason for the colonies to exist was to exploit natural wealth. This also included having cheap work force who would produce sugar cane or similar things that would be taken to the US where a lot of money would be made off of it.
What prevented them was that there was a systematic legal way to discriminate against them. The laws were there and they were voted for by the people who had voting power so there was no legal way to oppose it except to protest and fight calmly for your rights. Eventually it got sorted out but it was a long and difficult process and many problems still persist in various forms.
