What were the reasons to not pass the proposal of the 13th amendment to congress?

This proposed Thirteenth Amendment reflected the apprehension of those who in late 1860 believed they were witnessing the dissolution of the nation. Without using the word “slavery” or “slave,” the proposed amendment would deny “to Congress the power to abolish or interfere, within any State, with the domestic institutions thereof, including that of persons held to labor or service by the laws of said State.” The amendment, officially designated Joint Resolution No. 80, passed the House of Representatives in late February by the convincing vote of more than two-thirds of the membership.

The theory is land mass basically what they said.