Researching the top 100 richest people in the world, all of whom are billionaires of course, we found 8 that were from absolutely humble backgrounds. In fact even worse than the average. On top of that, they never got a college degree:

Larry Ellison, Oracle founder, an orphan
Li Ka-Shing, Hong-Kong famous investor, an orphan
Leonardo del Vecchio, Luxottica founder, an orphan
Amancio Ortega, Zara founder, son of a rail-road worker father
John Fredriksen, oil magnate, son of a welder father
Sheldon Adelson, Las Vegas Sands founder, son of a cab driver
Ingvar Kamprad, IKEA founder, son of a farmer
Francois Pinault, French art collector, son of a lumber miller
(Roman Abramovich, Russian billionaire and owner of football club Chelsea would be number 9 on the list, but he got a correspondence degree in law later in life. So technically he does have a degree. But otherwise he was poor, an orphan and qualified.)