Where were southern plantation owners specifically going?

The settlements required a large number of laborers to sustain them, and thus laborers were imported from Africa. African slaves began arriving in Virginia in 1619. The term “plantation” arose as the southern settlements, originally linked with colonial expansion, came to revolve around the production of agriculture

Explanation:

they remained in rural areas and worked at jobs such as lumbering or farming.