They choose men, not because they are just men, men of religion and integrity, but solely for the sake of supporting a party. This is a fruitful source of public evils. But as surely as there is a God in heaven, who exercises a moral government over the affairs of this world, so certainly will the neglect of the divine command, in the choice of rulers, be followed by bad laws and as bad administration; by laws unjust or partial, by corruption, tyranny, impunity of crimes, waste of public money, and a thousand other evils. Men may desire and adopt a new form of government; they may amend old forms, repair breaches and punish violators of the constitution; but there is, there can be no effectual remedy, but obedience to the divine law.

In 1833 he published his own edition of the Bible, updating the vocabulary of the King James Version and cleansing it of any words that he thought might be considered offensive, especially for females.