What an absurd amount of money - if only this was invested in energy sector scientific research and development, or healthcare or anything else practical.
I really hoped to see compact molten salt nuclear reactors in operation before 2030.
Love this for them.
- Softbank's motto
Haven’t you heard? AGI is going to solve every problem for us!!!
I don't understand how this is the top comment. LLMs have unlocked a lot of value for me personally, and arguably for the society as a whole. They are also one of the coolest technologies I've tried in years. As a technologist, I'm really glad that money is pouring in and allowing us to find its limits.
I know it's unrealistic, but imagine you took $30b and just started ploughing into a random city. Real estate, development grants, EV charging infra, renewable projects, transit. Just boring existing technology, but concentrated investment to make the other investments more valuable. You could turn that $30b into $60b in a few years while changing the lives of an entire city.
But American capital says no, and gambles it, because it's just a game to the people in charge.
Money is responsibility. While I pinch my pennies and show up to my day job, the people with the keys throw billions on an oil fire hoping it magically turns into gold.
The second part doesn't follow from the first which, in turn, is irrelevant here because we aren't talking about any value for society, we're trying to figure out if that value is greater than its opportunity cost.
The "AI" has been with us for several years now but it hasn't improved overall productivity in any meaningful way and while it's use is already plateauing it keeps sucking in capital like a giant black hole.
> As a technologist, I'm really glad that money is pouring in and allowing us to find its limits.
That's not a good thing when it happens at the expense of the rest of society.
It's only natural that workers at NVIDIA and other suppliers of AI-related products would like the gravy train to travel their way in perpetuity, but they are literally wasting capital, which isn't theirs, for their own enrichment, while creating inflation, shortages and misallocations on a grand scale.
Given their competition consists of the largest tech companies in the world, several of which are vertically-integrated, have advanced AI research programs, and own the last hardware mile to the customer...
OpenAI better hope it can maintain a performance lead, while being able to run inference cheaper than its competitors, while also launching a must-have device it controls (AR/audio glasses?).
Incidentally that’s how much SoftBank lost on WeWork.
Imagine doing what was effectively fraud, building a cult around you, everything going completely to the fan, and then the team you defrauded turns around and gives you a billion dollars.
And then, you get Marc Andreesen to write you a $350 million check not too long after.
Provided they keep cost growth slower than revenue and don't get disrupted by another model provider/commodification etc.
I hope that’s “real” revenue and not the cyclic quid pro quo that seems to be propping the whole thing up.
For average people the global competitors are putting up near identical services at 1/10th the cost. Anthropic and Google and OpenAI may have a corporate sales advantage about their security and domestic alignment, or being 5% better at some specific task but the populace at large isn't going to cough up $25 for that difference. Beyond the first month or two of the novelty phase it's not apparent the average person is willing to pay for AI services at all.
You can squeeze 25 USD/month of all US people on average, and claim the US government gives you "free AI".
And Ethiopia couldn't get US$5 billion loan for a dam to service 60 million people.
The world is sick.
xAI already brings gas turbines on-site, and i think the trend of on-site energy generation will grow, which will open opportunity (by providing well finaned demand) for compact/mobile/safer nuclear, and BigTech companies are among the best for any new tech development. I expect nuclear engineer positions get opened with Google and the likes :)
I suggest you stop viewing the actions of multi billion dollar multinational corporations as anything similar to individual action.
We should all care how resources are used, even if don't own them. That investment is going to make things more expensive for everyone. See RAM, SSD, and GPU prices.
https://www.reuters.com/business/softbanks-wework-once-most-...
https://companiesmarketcap.com/softbank/earnings/
Either way, seems like enough of their bets work out, so far.
https://blogs.wsj.com/digits/2014/09/19/softbanks-alibaba-al...
1) We are in a huge investment bubble right now and it's going to burst.
2) LLMs are extremely useful right now for certain niche tasks, especially software engineering.
3) LLMs have the potential to transform our world long-term (~10 yr horizon), on the order of the transformations wrought by the internet and mobile.
4) LLM's don't lead directly to AGI (no continuous learning), and we're not getting AGI any time soon.
This is an extremely obvious point, but bears repeating. I feel the assumption of an implicit link (in both truth or falsehood) between these fairly independent assertions can cause people to talk past each other about the really important questions in play here.
Regarding The Great Bubble, I am very very bearish about OpenAI in particular. They've had a good run for three years with consumer mindshare due to their first-mover advantage, but they have no moat, trouble monetizing most of their users, not much luck building out products that stick among consumers that aren't chatbots, and their models are no better than Anthropic's, Google's, or even the best Chinese open weight models 6 months later.
My bet would be on Google and Apple together (with Gemini powering Siri, for now) destroying OpenAI in the consumer AI market over the next 2-3 years. Google has first-rate models... but more than that, both Google and Apple have the enormous advantage of owning underlying platforms that they can use to put their own AI chat in front of consumers. Google has a mobile OS, the leading browser, and search. Apple has the premium hardware and the other, premium, mobile OS. They also have the advantage of the current regulatory climate being less antitrust than it was. And they don't have to monetize their AI offerings (no ads in gemini; ChatGPT is adding them) and can run them at a loss for as long as it takes to eat up OpenAI's market share. If they partner up, as they seem to be doing, OpenAI should very very afraid.
Don't get lost in the tech scene sauce, programming is a small sliver of what people are using LLMs for. OpenAI's report in September pegged it at ~4% of tokens being for software generation. Sure Anthropic is probably 80% or something, but only a small sliver of LLM users are using Anthropic. The reality is probably even less if you count Google's AI overviews. We hate it, but I have never seen a regular person skip over it.
The question is if regular people will pay cell phone level subscription costs ($70-$100/mo) for LLMs. If so, then we are probably not in a bubble, and the ROI will have a 5-10 yr horizon, which is totally tenable.
500,000,000 people paying $75/mo is $450B/yr. Inference is cheap too, it's training that is ludicrously expensive. Don't be fooled by the introductory pricing we have today either, that's just to get you dependent.
And yeah, chinese models, but look at what they did to tiktok. No way they are going to let the Chinese government be peoples confidants and no way is more than 0.01% of people gonna home lab.
You're playing wack-a-mole with a paper mallet against a tank brigade. It's not only China, the EU is going to compete too in the "5-10 yr horizon".
The Chinese manage to compete while deprived of top semiconductor gear, which happens to be made only in the EU.
The Chinese models don't have to stay in China, they can be fine-tuned and used by many other countries, named differently, etc. Even if you try to block them all, others won't which would put the US in a sever competitive disadvantage, inflated and isolated, the dollar will be in the sewer, who cares how much openAI would make.
None of this is to deny how remarkable the underling LLM tech is. I never expected to see something like this in my lifetime; it feels far far more strange and new than when the iPhone came along. I use a coding agent daily and it’s dramatically changed how I work. But I still think we’re in a bubble here.
The finding of that study was that people are using their personal AI accounts rather than corporate integrated accounts. Hence the pilots failing.
But LLMs are definitely being used to get work done. Hell Jerome Powell just said live on air that he uses it for it's productivity boost.
Majority of people use ChatGPT for free, that's why they are introducing ads. Normal people will not pay 70-100$ per month for LLM subscription. Your numbers are way off.
But beside that, OpenAI is pricing ads at $60/1000 views. That is 3x what Meta charges, which is around $20/1000. Meta pulls about $20/user/month in ad revenue. Triple that and we land at....$60/mo.
Data centers need power (H100s are ~700W each), and recent capacity additions were mostly pre-allocated. Chip supply is also constrained by CoWoS packaging, not fab capacity, and expansions take years.
If power, packaging, and GPUs are fixed in the near term, does $100B mostly drive inflation in AI infrastructure prices rather than materially more deployed compute? Are we seeing the real cost of a usable GPU cluster rise faster than actual capacity?
Has anyone modeled what $100B actually buys in deployable compute over the next 2–3 years given these constraints—and whether that figure is shrinking as more capital piles in?
At this stage, why not go public? Yes, they would need to manage quarterly financial reports and answer to shareholders, but they have reached a size where they are in the top 20 range on the NASDAQ. These public companies doing well, so it seems like a logical next step.
On the other hand they would probably set things up in a way where they still control all the voting power
Anthropic don't have all the free users, but they're also raising absurd amounts and have similar costs.
My gosh, this bubble can't burst soon enough. It's a form of torture to keep waiting on the pain we all know is coming…