After the AI Bust
Table of Contents
The Crash
Charles Stross wrote an interesting blog post about the latest developments in the AI bubble [1]. He predicts the imminent burst of the AI bubble because of Jensen Huang’s out of control dick. The bubble was caused by out of control dicks (figuratively speaking) and now may be burst by an out of control dick (both literally and figuratively speaking).
The end result of the “AI” related financial schemes is going to involve more than a few bankruptcies.
The Rebuild
I previously blogged about the fuss about AI [2] and concluded that the bust would be like the dot-com bust which paved the way for new profitable Internet developments. I am less positive towards the AI bubble now as it has gone a lot further than the dot-com bubble. The bankruptcies won’t just affect the IT industry, a lot of money from pension funds and index tracker funds has gone into “AI” and the pain will be spread around.
But I am confident that after the crash there will be new and interesting developments in Machine Learning (ML) technology that will benefit people. The Data Centers (DCs) that have been built at great expense will continue to be run and their services will for a while be offered at slightly above the cost of maintenance and power.
A lot of home users (Free Software developers) who can’t afford a GPU with 16G of RAM will find themselves able to rent time on systems with 48G or 96G of GPU compute to experiment with LLMs. Most such experiments won’t achieve any useful output, but if someone can spend a few dollars and learn useful things about software engineering then that’s a win for society. Also I think there will be some useful products developed as a result of this. The people who came of age when Linux was first released are now in their 50s and tend to have the reduction in vision and hearing expected in that age range so we can hope for some good developments in assistive technologies based on the cheap hardware.
The current situation is that renting time on ML servers is cheap and often free while renting time on virtual servers with GPU access is expensive ($2 per hour for a not particularly high end VM) so people are learning how to use (or misuse) services like ChatGPT and not learning how to run their own LLM service and understand how it works. The future situation will involve renting VMs available for not much more than the cost of electricity at off-peak times and services like ChatGPT will need to have an operational profit so running your own LLM on rented hardware or hardware you own will be a better option.
While corporate web sites are known for having rubbish chatbots using proprietary backend systems. While most of them suck badly and the idea of using them to replace staff is a really bad one the concept could work. If we increased the knowledge of such technology in the entire industry and if management was prepared to pay for it via increased budget for service improvements instead of trying to cut staff costs then it could give a good result.
Other Computer Hardware
The market for RAM for enterprise GPUs has been strong which reduced supply for consumer grade hardware. This caused prices to become unreasonably high.
There’s a general trend of software becoming bigger. Computers get bigger screens so media sources need higher resolution content which drives the demand for more storage and RAM for buffering things. Computers get more hardware features and more devices to connect to so all the software needs to be able to communicate with them. This makes the software bigger for everyone even people who aren’t using the features. For example adapting the audio subsystem to deal with different Bluetooth devices with options for different encodings increases the memory requirements for all the computers that have audio hardware but don’t have Bluetooth hardware. Perfectly reasonable decisions that make things work better for many people can have downsides for other people. RAM is one area that seems to have been repeatedly the subject of design trade-offs that resulted in systems with 16G of RAM performing the same tasks that systems with 16M of RAM did in the mid 90s but just at a higher resolution and with more features. The ongoing increase of RAM use by software combined with high prices caused by the “AI” companies has been bad for consumers.
The PC RAM use issue isn’t going to end. When I started editing the Debian Wiki page about Mobile Apps [3] I added a field for typical RSS of apps. Phones never have an option to increase RAM and the RAM is always limited. The largest RAM in commonly available phones in English speaking countries is 16G for the Pixel 11 Pro and the largest RAM for open Linux phones is 8G. When even relatively simple apps like an eBook reader take 500M of RAM it’s obvious that 8G isn’t enough.
The phone and laptop design process is based on a cycle of about one year, so maybe 8 months after the AI crash we will see ultralight laptops with 64G of soldered RAM and phones like the Pixel 12 Pro with 32G of RAM. Looking at Officeworks (the chain store for cheap office supplies including laptops) the vast majority on sale currently have 16G or less and 16G of RAM performs really badly for Windows and has performance problems for heavy use on Linux. It would be nice if the minimum RAM for a laptop was 16G and it was a common and affordable option to have 32G or more and that is a likely result of the AI crash.
Single Board Computers (SBCs) are currently expensive with reasonable amounts of RAM, when RAM prices drop significantly it will enable more uses of them for replacing desktop PCs and for developing other products. The Humane AI Pin [4] was an interesting research project but a poorly managed product, it would be interesting to have some free software research into that space and cheap SBCs with lots of RAM will facilitate it.
Employment
I expect that a lot of IT people will be looking for work in California soon. But for most of the world I don’t think it will change much. Cheaper hardware decreases the cost of starting IT businesses but a market crash decreases confidence in investing in the sector. Maybe there will be an increase in startups and small companies, including small companies based around LLM operation. I don’t expect any sort of catastrophic decrease in IT employment.
Also a CEO sleeping with employees at his company creates a bad working environment, that sort of thing should be stopped. Sacking a CEO for such misbehaviour is a good thing even without all the financial fraud and possibly breaking laws about exports.
Conclusion
The sooner the crash happens the better things will be for everyone. As this bubble goes on the impending financial damage increases and the upsides of the crash are delayed.