الآية رقم (68) - إِنَّ أَوْلَى النَّاسِ بِإِبْرَاهِيمَ لَلَّذِينَ اتَّبَعُوهُ وَهَـذَا النَّبِيُّ وَالَّذِينَ آمَنُواْ وَاللّهُ وَلِيُّ الْمُؤْمِنِينَ

(68) - (Indeed, the most worthy of Abraham among the people are those who followed him [in submission to Allah] and this prophet, and those who believe [in his message]. And Allah is the ally of the believers.)

The most worthy of Abraham (PBUH) are not of his progeny but rather the ones who followed him. Prophet Muhammad (saws) has followed Abraham. Therefore, Abraham (PBUH) has nothing to do with those of his progeny who altered his approach and never followed the faith. Allah the Almighty, on the other hand, has decided on these issues of Abraham (PBUH):

{ وَإِذِ ابْتَلَىٰ إِبْرَاهِيمَ رَبُّهُ بِكَلِمَاتٍ فَأَتَمَّهُنَّ ۖ قَالَ إِنِّي جَاعِلُكَ لِلنَّاسِ إِمَامًا ۖ قَالَ وَمِن ذُرِّيَّتِي ۖ قَالَ لَا يَنَالُ عَهْدِي الظَّالِمِينَ}

(And [mention, O Muhammad], when Abraham was tried by his Lord with commands and he fulfilled them. [Allah] said, “Indeed, I will make you a leader for the people.” [Abraham] said, “And of my descendants?” [Allah] said, “My covenant does not include the wrongdoers.”) (Al-Baqara: 124)