Allah (swt) is addressing the Prophet (saws) by saying (Say), as if He is addressing all the nation through him (saws).
(… قُلْ يَا أَهْلَ الْكِتَابِ ) (“O People of the Scripture, …): Meaning, The Jews.
(… هَلْ تَنقِمُونَ مِنَّا إِلَّا أَنْ آمَنَّا بِاللَّهِ وَمَا أُنزِلَ إِلَيْنَا وَمَا أُنزِلَ مِن قَبْلُ …) (…do you resent us except [for the fact] that we have believed in Allah and what was revealed to us and what was revealed before …): The Prophet (saws) said to Jews of Khaybar, Banu Qaynuqa’, Banu An-Nadir and the Jews who were present at that time: Do you resent us because we believed in the Messengers and the Books, the Torah, the Bible and the Psalms, and yet you hate this matter?
( وَأَنَّ أَكْثَرَكُمْ فَاسِقُونَ … ) (…and because most of you are defiantly disobedient?): This is the law of probability maintenance; that is, not all of them, rather most of them. Verify, we are not against Judaism because of the Jews.