Guess who else had a problem with PA's original religious test? Jewish people who didn't believe in the divine inspiration of the New Testament. You can read their complaints here.
That by the tenth section of the Frame of Government of this Commonwealth, it is ordered that each member of the general assembly of representatives of the freemen of Pennsylvania, before he takes his seat, shall make and subscribe a declaration, which ends in these words, "I do acknowledge the Scriptures of the old and new Testament to be given by divine inspiration," to which is added an assurance, that "no further or other religious test shall ever hereafter be required of any civil officer or magistrate in this state."
Your memorialists beg leave to observe, that this clause seems to limit the civil rights of your citizens to one very special article of the creed; whereas by the second paragraph of the declaration of the rights of the inhabitants, it is asserted without any other limitation than the professing the existence of God, in plain words, "that no man who acknowledges the being of a God can be justly deprived or abridged of any civil rights as a citizen on account of his religious sentiments." But certainly this religious test deprives the Jews of the most eminent rights of freemen, solemnly ascertained to all men who are not professed Atheists.