His origin has nothing to do with the wealth and the children that Allah (swt) has granted him with. Allah (swt) says:

 فَذَرْهُمْ فِي غَمْرَتِهِمْ حَتَّىٰ حِينٍ (54) أَيَحْسَبُونَ أَنَّمَا نُمِدُّهُم بِهِ مِن مَّالٍ وَبَنِينَ (55) نُسَارِعُ لَهُمْ فِي الْخَيْرَاتِ ۚ بَل لَّا يَشْعُرُونَ

(So leave them in their confusion for a time. (55) Do they think that what We extend to them of wealth and children (56) Is [because] We hasten for them good things? Rather, they do not perceive.) (Al-Muminoon: 54-56)

Do they think that wealth or children is good for them? Of course not; it is a respite for them so that they may indulge more into sins. Thus, you should not obey such a person if he has wealth and sons. It is said that this refers to al-Walid ibn al-Mughira, who used to have a garden in al-Ta’f and twelve sons. Yet, his wealth and children have not separated him from his low origin. The Prophet (saws) said:

“My nation will remain well as long as illegitimate birth is not prevalent among them, should it happened, Allah will inflict a punishment upon them”[1]

Even Ikrima said: “Prevalence of illegitimate births causes drought”

In regard of explanation of this verse, Allah (swt) says:

 ذَرْنِي وَمَنْ خَلَقْتُ وَحِيدًا (11) وَجَعَلْتُ لَهُ مَالًا مَّمْدُودًا (12) وَبَنِينَ شُهُودًا (13) وَمَهَّدتُّ لَهُ تَمْهِيدًا (14) ثُمَّ يَطْمَعُ أَنْ أَزِيدَ (15) كَلَّا ۖ إِنَّهُ كَانَ لِآيَاتِنَا عَنِيدًا 

(Leave Me with the one I created alone (12) And to whom I granted extensive wealth (13) And children present [with him]

(14) And spread [everything] before him, easing [his life]. (15) Then he desires that I should add more. (16) No! Indeed, he has been toward Our verses obstinate.) (Al-Muddathther: 11-16)

Although he was given a plenty of wealth and children, yet he desired more. Allah (swt) promises him that he will not give him anymore and will destroy and deprive him of all of that. Indeed, that was exactly what happened to him.

[1] Musnad Imam Ahmad: Musnad of the Women, Hadith of Maymonah bint al-Harith, the wife of the Prophet (saws), Hadith No. 26831.