Instead of losing his connection to nature, the speaker would “rather be / a pagan.” a pagan is someone who —

A pagan is a person that adores nature instead that traditional religious figures.

The poem The World Is Too Much With Us by  William Wordsworth talk about a person that worships nature and all alone its lines we can see how the speaker describes all the wonders we normally don't see.