If we look to the grammatical construction, this would naturally refer to the opinions of the party: but what Swift complains of is the violent zeal and faith with which the opinions of the leader are followed and maintained.