The AI war will only intensify.
When people think about artificial intelligence (AI), they gravitate towards the leader in graphics processing unit (GPU) chips. Nvidia (NVDA -1.99%)–And of course it is. Nvidia currently holds a significant lead in manufacturing the chips needed for today’s most advanced AI applications.
But the benefits of AI will provide growth opportunities for many technology companies whose stock prices haven’t skyrocketed as much as NVIDIA’s.
On that note, there’s big AI news this week at three big tech companies, two of which are aiming to compete head-on with Nvidia.
Arm announces it will begin manufacturing its own AI chips
arm holdings (arm -3.43%) went public in a long-awaited initial public offering (IPO) last September, bringing to market one of the two major licensors of semiconductor architecture, the other being x86 architecture .
Today, Arm is growing as the use cases for its low-power chip architecture proliferate. Revenue increased 47% last quarter on the back of strong growth in license and royalty income. This strong growth is not surprising. Most cloud giants have begun designing their own low-cost central processing unit (CPU) chips for their own cloud products, gravitating toward the Arm architecture. Nvidia (NVDA -1.99%) Using an Arm-based CPU for Grace CPU connected to Grace-Hopper and Grace-Blackwell superchips, alphabet (GOOG 1.06%) (Google 1.08%) It just announced its own data center CPU chip called Axion.
But Arm hasn’t gotten to the heart of the AI revolution because it hasn’t licensed the GPU-accelerated architecture that’s central to AI processing.
But management is trying to change that. According to recent reports, nikkei asia, Arm is currently considering designing its own AI accelerator to be introduced in 2025. According to the report, Arm will invest heavily in initial development costs, but Arm has about $3 billion in cash for development, so it should be able to withstand this. It is a core licensing business that strengthens the balance sheet and generates high cash. According to the report, production will be outsourced to a third-party foundry. taiwan semiconductor manufacturing.
That leaves Nvidia with more competition, which may be why Nvidia tried to acquire Arm years ago.
Still, this might be a case of Arm being a little late to the game in a crowded field. Almost all cloud giants are now designing their own accelerators. Nvidia maintains a strong lead in “neutral” AI GPUs, but Advanced Micro Devices and Intel Each creates a better “neutral” competitor.
Arm is 90% owned. Softbank (SFTB.Y 0.70%)is owned by Masayoshi Son, an ambitious technology executive. SoftBank expanded at the tail end of the 2021 tech software bubble, so Arm investors hope this doesn’t become another example of “me too” thinking by entering the hot tech space too late. Must. It’s no wonder they have mixed feelings about this week’s announcement.
Google announces new Trillium chip
Speaking of Google’s parent company Alphabet, the search and cloud giant held an input/output (I/O) developer conference earlier this week. Unsurprisingly, there were a number of AI-related announcements, including the introduction of his aforementioned Axion CPU. But perhaps most notable on the AI chip manufacturing front was the announcement of the latest version of Google’s tensor processing unit (TPU) accelerator.
Google has been manufacturing TPUs since 2013, but only offers them through the Google Cloud platform. Of course, Google also has a large inventory of his Nvidia chips available for customers to use, but cloud giants are competing to find their own best low-cost alternatives for their platforms.
That’s why this week’s announcement of Google’s 6th generation TPU accelerator Trillium was important. The new chip boasts 4.7 times more performance than the previous 5th generation chip and is also 67% more energy efficient. The new chips also feature new 3rd generation SparseCore accelerators, capable of processing twice the high-bandwidth memory with twice the chip-to-chip connection bandwidth. This will allow the new he TPU to handle larger models. Alphabet also announced the ability to string together 256 Trillium GPUs to create a Google-powered supercomputer.
This week, Google, Arm, and Oracle announced big AI news. Image source: Getty Images.
The new hardware is behind a number of new AI services Google introduced at the conference, including updates to its Gemini 1.5 pro model and Large-Scale Language Models (LLM), which competes with the likes of OpenAI’s ChatGPT. But Google has also introduced new models focused on specific use cases, such as his Veo for high-resolution videos, Imagen 3 for text-to-image conversion capabilities, and AI Sandbox for music and sound generation tools. did.
Finally, Google Search is also getting an AI-powered upgrade starting this Monday. Complex Google queries now show AI-generated summaries and multi-step plans for relevant searches. The new Search Overview is a great effort by Google to avoid confusion from ambitious search alternatives like Bing with ChatGPT and startups like Perplexity.
And recent results suggest Google’s AI capabilities may be gaining momentum, with the company’s cloud platform reaccelerating to 28.4% revenue growth in the last quarter and search becoming an aspiring disruptor. Even in comparison, it recorded an astonishing 14.4% growth on its own.
Oracle grabs big shot in the cloud
When most people think of cloud infrastructure, they think of the big three cloud platforms.But investors may not want to ignore the database giant oracle (ORCL 1.10%)continues its efforts to position itself as the fourth cloud alternative. Oracle’s infrastructure revenue was just $1.8 billion last quarter, still far behind third-place Google’s $9.6 billion. But Oracle’s Infrastructure as a Service (IaaS) revenue also rose 49%, the highest growth rate among the cloud giants.
It’s easy to grow from a small base, but that desire got a big boost earlier this week. Elon Musk’s AI startup xAI is in talks with Oracle Cloud about a deal to rent its servers for AI processing for “several years” for up to $10 billion, according to The Information. This is a big deal considering Oracle’s cloud annual utilization rate is currently $7.2 billion, making xAI one of Oracle’s largest cloud customers.
While some may wonder how a mere start-up could raise such huge amounts of funding, Reuters also reports that Musk’s cash has given xAI up to $3 billion in funding at an $18 billion valuation. It is also reported that it led to procurement negotiations. xAI’s chatbot Grok aims to compete with Google’s Gemini and his OpenAI’s ChatGPT, using data collected from his X, formerly known as Twitter, and tesla vehicle.
Elon Musk has had success building businesses like Tesla and SpaceX from scratch, but his acquisition of Twitter is even more questionable. Still, it looks like Oracle stands to benefit a lot if xAI turns into a large-scale LLM.
