As the movement grew, opposition to it also began to increase. Some locals who remembered Smith's treasure-digging career were offended at the idea that he now presented himself as a prophet and religious leader. Local ministers viewed the church as heretical, and as a threat to orthodox Christianity. Many were also irritated by the "Latter-day Saints'" claims to be the new chosen people of God and the rightful inheritors of the land. Growing pressure and harrassment led Smith to consider taking the movement to the frontier where they could make a fresh start.

In 1831, a Campbellite minister in Ohio by the name of Sidney Rigdon was converted by "Mormonite" or "Mormon" missionaries. He in turn converted most of his congregation to "Mormonism." At his invitation, Joseph and his by now several hundred followers in New York decided to relocate to northeastern Ohio, where they settled in Kirtland and nearby Hiram.