Nvidia promises up to 700% return on investment on GPU doing AI inference work as world’s most valuable company continues journey towards $4 trillion market cap

Pls share this post

Listen to this article

Nvidia temporarily became the most valuable company in the world back in June 2024 with a worth of $3.34tn, a price that’s nearly doubled since the start of this year – and although it has now dipped back below Microsoft and Apple for now, it’s only a matter of time before the company claims the top spot once again.

HPCwire reports at the Bank of America Securities 2024 Global Technology Conference, Ian Buck, Vice President and General Manager of Nvidia’s hyperscale and HPC business, discussed the financial advantages of investing in GPUs. 

“Every dollar a cloud provider spends on buying a GPU, they make it back at $5 over four years,” Buck claimed. Inferencing tasks lead to even higher profitability: “Here the economics are even better: for every dollar spent, $7 is turned over in that same time period and growing,” he said.

READ ALSO  They did it again: Tech publisher keeps on breaking Pi Calculation World Record — they almost doubled the previous one, reaching 202 trillion digits in 100 days and used 1.5PB of SSD storage

Blackwell shortages

Nvidia is optimizing its products to meet the increasing demand for AI inference, using Nvidia Inference Microservices (NIMs), which support popular AI models like Llama, Mistral, and Gemma. The company is also focusing on its new Blackwell GPU, which is specially designed for inferencing and improving energy efficiency. 

Initially supply might be tighter than Nvidia would like, but the company isn’t concerned. “With every new technology transition comes… a mix of challenges of supply and demand. We experienced that certainly with Hopper, and there’ll be similar kinds of supply-demand constraints in the ramp of Blackwell… at the end of this year and going into next year,” Buck said.

READ ALSO  Would you eat a robot? Swiss scientists want to create fully edible electronics — but I am not sure I want to have a bite at R2D2 anytime soon

Looking to the future, Nvidia has already begun sharing details about its Rubin GPU, announced at Computex and expected to ship in 2026, with cloud providers. Buck highlighted the importance of early collaboration, saying, “It’s really important for us to do that – data centers don’t drop out of the sky, they’re big construction projects.”

Nvidia’s steady progress in AI and GPU technology looks promising for investors, and the $4 trillion market cap seems within reach. The path ahead isn’t that clear, however. Due to its rapid growth, Nvidia is facing inevitable scrutiny from antitrust authorities, and this isn’t expected to go away any time soon.

READ ALSO  Samsung will use sewage water to quench surging thirst for semiconductors — 400 million liters of waste water to be purified and used daily to manufacture electronic chips

More from TechRadar Pro


Pls share this post
Previous articleGitLab warns of critical security flaw which could allow hacker takeovers
Next articleWindows 11 is getting useful widget tweaks, but not the change we really want – Microsoft should learn from macOS