memes

Funny thing, right now federal funding is hyper focused on AI because the people who bought Trump expect a return on their money. The things is, the people on the federal side more or less fall into two camps- political appointees who know nothing about anything and old guards who know that "AI" has been around for decades in various forms. This is creating fun situations where a funding opportunity might as well read "please find a way for fElon to make money using AI", but they never specify "LLMs" so submitting a neural network or machine learning proposal fits the guidelines. Time will tell how that plays out.

The AI which cures cancers is architecturally pretty similar to LLMs in that it's based on transformers and GPT in particular is also based on transformers (that's the T in GPT). It is also generative AI, you give it tokens that describe proteins and it generates folding structures. It's like an LLM except the tokens aren't words or syllables like in LLMs.

It's used very differently and the energy cost is a few orders of magnitude less (you can run it on a single H200 with 141 GB VRAM for ~9000 tokens or an A100 or H100 for ~5000 according to this university and it even has a slow CPU/IO heavy first stage preparing everything so they can minimize the GPU time in stage 2).

There is yet hope that such AI applications will eventually benefit from all the research that's been put into LLMs. Obviously not everything will carry over, but there may be architectural improvements to be made in research models too.

Yeah, and any "it will cure cancer" usually boils down to "uhmm, if we feed it enough training material, it will turn into a sentient superintelligence, which will cure cancer".