Ha. Amazon's in-app AI agent is called Rufus. It's incredibly annoying, and they love directing you to an 'Ask Rufus' page where you watch an AI agent not-quite-finish repeating your search terms back at you before you realize you're not actually on your search results page, and then spend some additional time trying to find the link to take you to said search results page.
I assume somewhere there's a team hitting their AI query KPI's due to this, but I really wish they'd shut off a few server racks and save everyone the annoyance instead.
Of course it was. They clearly decided that the benefit to the company valuation was higher than the potential downsides when announcing to the world that they committed a criminal act via negligence.
If it wasn't a marketing stunt, they would have at most quietly settled any legal matters with huggingface behind the scenes, fixed their evaluation harness so it wouldn't happen again, and avoided the potential future liability.
It sounds like your issue is with capitalism, not with renewable energy. Luckily, we have plenty of examples of aspects of society that have been deemed too important to leave purely to market forces. In fact, electricity generation is already (mostly) one of them.
As solar and batteries become even cheaper (we're already at the point where they're cheaper than anything else) we can just choose to overbuild capacity and turn down/off whatever other generation isn't necessary at any given time. Utilities already have to predict grid usage based on weather and all sorts of other factors, so it's not like this isn't something that isn't already happening.
What? Absolutely not, I love capitalism. The problem is that it is suspended when it comes to the wind farms, they are pretty much always heavily subsidized and on a socialized loss scheme at that.
And no, I have no problem with renewables either.
If your conclusion from reading what you said is this, then you did not read because I said the exact opposite.
Not quite. Looped models do the extra "thinking" inside the model's layers. So the token gets twice the number crunching performed on it before it gets spit out. I think of it as the first loop "kickstarts" the process, and the second loop refines it.
I mean, that's cool and all, but the numbers are really going to shift when it accidentally goes off and orders that same hardware from every vendor in your local region and the top 5 online results for comparison.
It's the same problem as all other LLM solutions (that I hope OpenAI is working on!) it's non-deterministic, and there's no way for the user (or model provider) to know what the distribution of possible outcomes is. This just gets compounded when multi-call harnesses come onto play.
So much of the current bubble is predicated on the hype train continuing on its current trajectory. If anything lags behind, the bubble deflates.
For one potential path - Less datacenter construction means less GPUs, so less $$$ for Nvidia, which means less for them to spread around to prop up the LLM industrial complex, which means lower valuations, which means OpenAI and Anthropic can't get their trillion dollar valuations, which means VC's race for the exit to cash out, etc, etc.
OpenAI, Anthropic, Google selling equity for the first time since their IPO, all of the downstream consumers of the frontier labs. NVIDIA is perhaps the only one profiting from actually selling something. Who hits a liquidity event before the house of cards blows over?
The original claim was "Their debt load and infrastructure costs compared to their relatively meager earnings..." which is just obviously not applicable to Google and NVIDIA, which both crank out more than $100 billion per year in profits. They can literally take on almost a trillion dollars each in debt to finance data centers and still be in reasonably good financial shape.
OpenAI and Anthropic are not very profitable (yet!), but rely mostly on equity financing, not debt. So no debt load issue there either.
Google search only dies if AI wins, in which case there's no shortage of demand for tokens. NVIDIA's revenue just doubled year-over-year; even if token demand cools off and they slow to say 25% growth, they'll be fine.
OpenAI and Anthropic not making money would be sad for their shareholders, but that's sort of a different topic from whether the "debt load" you originally cited will be any kind of a systemic problem (it won't).
A bubble is a debt-fueled run-up in asset prices driven by over-optimistic projections of future fundamental value.
The housing bubble was people borrowing money (debt-fueled) to buy ever more expensive houses (rising asset prices) on the assumption home values would always keep going up (projection of future value).
'90s tech bubble was similar.
Where are you seeing that now? Which asset is over-valued?
Same! Still getting used to it, but the benefits of being able to host my notes on my Tailscale network are huge. Having a built-in Lua engine to customize the interface and content is a really interesting concept, though I'll admit I haven't explored it beyond adding an AI assisted voice to text button. Still, it's been fun using it!
reply