Because God gives the pastor spiritual and governmental authority in his church, this does not give him the right to dominate his flock. He is not their Lord—Jesus is. They are not his flock—they are God’s flock.
Shepherd the flock of God among you, not under compulsion, but voluntarily, according to the will of God; and not for sordid gain, but with eagerness; nor yet as lording it over those allotted to your charge, but proving to be examples for the flock. And when the Chief Shepherd appears, you will receive the unfading crown of glory (1 Pet. 5:2-4, emphasis added).
Each pastor will have to give an account for his ministry some day before the judgment seat of Christ.
Additionally, in financial matters, a single pastor/elder/overseer should not act alone. If there is money being collected regularly or sporadically for any reason, others within the body should provide accountability so that there will be no mistrust regarding the handling of funds (see 2 Cor. 8: 18-23). This could be an elected or appointed group.