Joseph Jr.'s reputation as a scryer and money-digger led Josiah Stowell, a wealthy farmer from South Bainbridge, New York, to seek his services. While Joseph and his father were involved in the treasure digging project, they boarded with another well-to-do farmer named Isaac Hale in nearby Harmony, Pennsylvania. Their treasure digging came to naught, but on Hale's farm, Joseph met his future wife, Hale's daughter Emma. After his father and associates returned to Palmyra, Joseph Jr. moved in with Josiah Stowell and continued to work as a farmhand while he courted Emma.
In 1826, on account of his treasure digging activities, Joseph was tried in Bainbridge and found guilty of fraud. The trial records describe Joseph's use of a "peep stone" for scrying, and his use of various magical charms to circumvent the enchantments supposedly used to guard treasure.
Isaac Hale did not approve of Joseph, but Emma was in love with him. In 1827 they eloped, were married in South Bainbridge, and then returned to Palmyra where they lived with Joseph's parents.