Can you spot the following pattern if you look at this grid here and see how it's been transformed into this grid and likewise how this grid on the left has been transformed into this grid. Can you spot that pattern? Could you, in other words, predict what would happen to this grid here in the test example? Well, it might shock you to learn that language models like GPT-4 can't do this. They are terrible at noticing that the little squares are being filled in with a darker shade of blue. This specific abstract reasoning challenge was not in the training data set of GPT-4, and that model cannot generalize from what it has seen to solve the challenge. It's not generally intelligent. It's not an artificial general intelligence. Now you might think that's a minor quibble, but it gets to the heart of why current generation AI is not AGI and frankly isn't even close. And no, neither will this problem be solved by a simple naive scaling up of our models. But this video isn't just about picking out one floor.

or be it a critical one in our current llms. It's more my attempt to address this swirling debate about whether AI is overhyped or underhyped. For many, AI is nothing but hype and is a giant bubble. While for others, AGI has already arrived or is just months away. But you don't need an opinion. What does the evidence show? This video will draw upon dozens of papers and reports to give you the best snapshot I can on llms and AI more broadly. I'm going to start, I'm afraid, with so much of what's wrong with the current landscape: from delayed releases, overpromises, and my biggest current concern, a tragedy of the commons from AI slop. But then I will caution those who might throw the baby out with the bathwater, giving six detailed evidence-based pathways from the llms we have today to substantially more powerful and useful models, including systems that, yes, perform decently even on that abstract reasoning challenge I showed you earlier. But let's start with the dodgy stuff in

quote AI and no, I'm not referring to the fact that the creators and funders of this Ark AGI challenge are so confident that current generation LMS cannot succeed that they've put up a prize pool of over a million dollars. If GPT-40 was a pure reasoning engine, well then why is its performance negligible in this challenge? But no, I'm actually referring to the landscape of overpromising and underdelivering. You might remember Demis Cabis referring to the original Gemini model when it was launched as being as good as human experts, but Google has had to roll back its LLM-powered AI overview feature because there were simply far too many mistakes. If Gemini was as good as human experts as some benchmarks were claiming to show, then why wouldn't it be better than a random Google search? But surely the newly announced Apple intelligence will be far better, though. Well, aside from the fact that we can't actually test it. No, Tim Cook admitted that it still hallucinates all the time. Now to some as

we'll see. that's actually the point of llms. we want them to be creative, but to others, it smells more like BS. this particular paper, aside from being quite funny, gave one clear take-home message: language models aren't actually designed to be correct. they aren't designed to transmit information. so, don't be surprised when their assertions turn out to be false. of course, people are working on that, and the paper even makes reference to the let's verify step-by-step paper. more on that later, but the point remains. so, we have the hallucinations in Ai, and then the hallucinations in the marketing about Ai. and the fact that we have ai-powered toothbrushes isn't even my primary concern, and nor is it actually that we occasionally have those wildly overhyped products like the rabbit R1 and the Humane AI pin. then there's the possible breaches in privacy that features like Microsoft recall seem to inevitably invite. I don't know about you, but it was never appealing to me to have an llm.

analyze screenshots taken of my desktop every few seconds. Imagine the poor LLM trying to sift through all of the creations that some are likely to come up with using open AI tools. You might think I've reached the end of my dodgy list, but I'm not actually even close. What about the increase in academics using LLMs to write or polish papers? You can see the recent and dramatic increase in the use of the word delve on papers on PubMed. For me, as soon as I suspect an article I'm reading is LLM-generated, I just discount it heavily. Then we get the delayed releases. Now, this one is arguably a bit more forgivable, but we were promised GPT-40 within a few weeks. I think we all would prefer a tradition where features are announced the moment they're actually available. I will come back to GPT-40 in a moment. Now, you might be different, but for me, the number one concern at the moment is just AI-generated slop. Take this tool where on LinkedIn, you can imitate the writing of

someone in your field or industry are they going viral while you get little to no engagement. Copy their tone and address the same topic, and I would call this a kind of tragedy of the commons for the individuals using this. I'm not meaning to pick on one individual tool, but for the individuals using this, it's probably pretty helpful. It probably does boost engagement and help sort out any language issues, but as we've seen of late on Facebook, it just leads to this general AI-generated miasma. Bots engaging with Bots, gullible people drawn in and fooled, a landscape where increasing L. You can't trust what you see or even hear, and that's before even getting to the topic of deep fakes, which of course can acutely affect the individuals concerned. You can of course let me know if you agree, but for me, this is at the moment the number one concern, and it's hard to see how it would be stopped at this point. You're probably thinking, Damn, this is pretty negative on AI, but as you can see, the video has.

plenty of time to go, but at this point, my rejoinder to sum is that it's all too easy to fall into diametrically opposed camps. As we saw last year with accelerationists and doomers, we're seeing this year with those who say AI is nothing but hype and those who say AGI is imminent. But I think the world is just so much more complex than that. I reckon that if I was blind, I would forgive the occasional hallucination with GPT 40 and be grateful to have a model that can tell me about the world around me. Oh, and interactively and in real time and tell me exactly what they're doing right now, please. Um, right now, the ducks are gently gliding across the water. They're moving in a fairly relaxed manner, not in a hurry. Occasionally, one of them will get its head under the water, probably looking for food, and then pop back up. I even know when a taxi is coming with its orange light on. I think I'll hail it to get.

home yes I spotted one just now. It's heading away on the left side of the road. Get ready to wave it. [Music] Down. Great job hailing that taxi. It looks like you're all set to go. That's a good dog right there leading the way into the taxi. Safe travels and remember too that as Project Astra from Google demonstrated, models are getting better at ingesting more and more tokens, more and more context. They are increasingly able to help users of any kind locate things, not just in text, but in the real world. Now we'll get back to LLMs in a moment, but of course it's worth remembering that there are far more to neural networks than just LLMs. A new study in Nature showed how you could use GANs (generative adversarial networks) to predict the effects of untested chemicals on mice. Gen AI in this case was able to simulate a virtual animal experiment to generate profiles similar to those obtained from traditional animal studies. The TL;DR is not just that the Gen predictions had less error but

they were produced much more quickly, and as the BBC reported, this is at least one tentative step toward an end to animal testing. And yes, that study was different to this one released a few days ago with Harvard and Google DeepMind where they built a virtual rodent powered by AI. Again, a highly realistic simulation, but this time down to the level of neural activity inside those real rats. Then, of course, we have the good old convolutional neural networks for image analysis. Their use in the Brainix E-stroke system is, as we speak, helping stroke victims in the NHS. Essentially, it has enabled diagnosis to be made by clinicians much more quickly, which in the case of strokes is super important, of course, and that has tripled the number of patients recovering. Now, the only tiny, tiny complaint I would make is that as ever, the title just uses the phrase AI. It took me a disturbing amount of digging to track down the actual technique used, and even then, of course, for commercial reasons, they don't say everything.

to large language models the central focus of this channel now. I have discussed in the past on this channel some of the reasoning gaps that you can find in current generation large language models. But the arc abstract reasoning Challenge and prize publicized this week by the legendary franois charet is a great opportunity to clarify what exactly are current models Miss and what is being done to rectify that Gap. Hopefully at least the following will explain in part why our models can sometimes be shockingly dumb and shockingly smart. I'm going to leave in the background for a minute an example of the kind of challenge that models like gp4 fail at consistently. So here is in 60 seconds what the current issue is if language models haven't seen a solution to something in their training data they won't be able to give you a solution when you test them. That's why models fail at this challenge they simply haven't seen these tests before. Moreover the models aren't generally intelligent you can train them on millions of these kind of examples and

people have tried and they'll still fail on a new Fresh one again. If that new fresh example isn't in the training data set, they will fail. If the mother of Gabriel Mack is in the data set, they will output the correct answer. If, however, the data son of that Suzan Victoria Pulia is not in the data set, it will not know. It doesn't reason its way to the answer based on other parts of its training data. So how can models do so well on certain benchmarks like the math benchmark? Well, they can quote recall from their training data set certain reasoning chains that they've seen before. That's enough in certain circumstances to get the answer right. So hang on a second, they can recall certain reasoning procedures. Let's call them programs, but they can't create them. Yes, it's a good news bad news kind of situation, but for the remainder of this video, indeed for the remainder of llms, it will be important to remember that distinction: recalling reasoning procedures or programs versus doing fresh reasoning itself if it's seen it.

before great if it hasn't seen it before not so great. Okay, so we're almost ready for those six ways, which might drag llms closer to that artificial general intelligence. But first, I want to quickly focus on one thought you may have had in reaction to this framework. Why not train language models on every reasoning procedure out there, feed it data on any scenario it might encounter, and wouldn't that be AGI? Well, here's François Chollet, the author of The Ark challenge. He'll explain why memorization isn't enough. Because we don't see the whole map if the world if your life were a static distribution, then sure you could just Brute Force the space of possible behaviors. You can think of intelligence as a pathfinding algorithm in future situation space. Like, I don't know if you're familiar with scam development like RTS game development, but you have a map right, and you have it's like a 2D map, and you have partial information about it. There is some fog.

of War on your map, there are areas that you haven't explored yet. You know nothing about them. And then there are areas that you've explored, but you only know how they were like in the past. And now, instead of thinking about to, I think about the space of possible future situations that you might encounter and how they're connected to each other. Intelligence is a past-finding algorithm. So, once you set a goal, it will tell you how to get there optimally. But of course, it's constrained by the information you have. It cannot pass F in an area that you know nothing about. If you had complete information about the map, then you could solve the pathfinding problem by simply memorizing every possible path, every mapping from point A to point B, solve the problem with pure memory. But where the reason you cannot do that in real life is because you don't actually know what's going to happen in the future. So if AI will be encountering novel situations, it will need to adapt.

on the Fly, what would make me change my mind about that, Al, is basically if I start seeing a critical mass of cases where you show the model with something it has not seen before, a task that's actually novel from the perspective of its training data, something that's not in the training data. If it can actually adapt on the Fly, and that might be more possible than you think as gnome Brown of open AI thinks. He's optimistic that llms will crack it, but again, it won't be just a naive scaling up of data that alone gets us there without examples or zero shot. As we've seen, models don't generalize from what they've seen to what they haven't. This paper demonstrates that in the visual domain, as we've already seen it in the text domain. No matter what neural network architecture or parameter scale they tested, models were data hungry. Unlike a human child, they didn't learn in a sample efficient manner. Remember that a child might be shown one image of a camel with the caption camel and retain that term for life. However, midway

through the paper, there was some tentative evidence that with enough scale, you can get decent results on rarely found concepts. Those were represented by the let it wag data set, referring to the long tail of a distribution. Anyway, as you can see, models that performed at over 80% on this traditional well-known ImageNet accuracy test did perform fairly well on this long-tail data set. As they note, the gap in performance does seem to be decreasing for higher capacity models. In other words, more data definitely helps, especially exponentially more data, but it definitely won't be enough. But even this paper pointed to some ways that this challenge might be overcome. They note possibilities for not only retrieval mechanisms but compositional generalization. In other words, piecing together concepts that have been found in the training data set to be able to recognize more complex ones. And if you think that's impossible, I've got news for you. In a moment, just before I do though, I want to get to one other approach that I don't think will work.

you may or may not have heard on the Twitter sphere about the situational awareness 165-page report put out by a former OpenAI researcher. I've done a full 45-minute breakdown on my Patreon, AI Insiders, but one key takeaway is this: he thinks the straight march to AGI will be achieved by scaling up the parameters and data of our current LLMs. But again, I think that's far, far too simplistic. Just throwing on more parameters and more data wouldn't resolve the kind of issues you've seen today. Leopold Ashenbrenner also made some other somewhat crazier claims, but that's for this video. So it's time to get to the first of those six methods that I mentioned that might drag LLMs closer to something we might call a general intelligence. And this paper, published late last year in Nature, is about that compositionality I mentioned just a moment ago. Perhaps models can't reason, but if they can better compose reasoning blocks into something more complex, might that be enough? Well, the authors prove that point in principle at

least on just a 1.4 million parameter Transformer-based model. Boldly, they claim our results show how a standard neural network architecture, optimized for its compositional skills, can mimic human systematic generalization in a head-to-head comparison. And as the lead author of the paper retweeted, the answer to better AI is probably not just more training data but rather diversifying training strategies. TLDR: send the robot to algebra class every so often. And the challenge, as you can see in the bottom left, was this. It might even remind you a little bit of the ARC challenge. The challenge was to work out what this made-up language fragment actually meant based on these rules. Given enough time, humans tend to do fairly well at this challenge, like the ARC challenge, but models like GPT-4, as we'll see, flop hard. Remember, GPT-4 has 1.8 trillion parameters versus the model they trained at 1.4 million. Anyway, with enough time in your case and training in the case of their Transformer model, it worked out that for example who means to whereas s

means green and re means light blue. There are other rules to work out, of course, and then those rules have to be composed together to work out the question answer. Now, remember, when they were tested, they were tested on a new configuration of words. They had to quote understand the made-up rules of a new language and apply them to phrases it hadn't been trained on. It was able to do so, in other words, show the first tentative hints at true reasoning. It's only a very small step towards AGI though because when they tested these flickers of compositional reasoning on a new task, this tiny model failed. Okay, time for the next approach. If, as we've seen, language models have these reasoning chains or programs within them to solve challenges, they're just hard to find. What about methods that improve our ability to find those programs within language models? That's what, in part, verifies our about a string of papers came out this week about using verifiers and Monte Carlo tree search to improve the mathematical reasoning of language models, of course, covering all of them.

would be a video in and of itself, but in a nutshell, it's about this: you can train a model to recognize faulty steps in a reasoning chain, to pick out the bad programs with Let's Verify step by step, which I've talked about many times before on this channel. That required human annotation, but Google DeepMind came up with an approach which was done in an automated fashion by automatically collecting results, which led to a correct answer, as well as contrasting them with outputs that led to an incorrect output. They trained a process reward model. Think of it like a supervisor analyzing each step of a language model's outputs. Or to use the analogy we've been using throughout this video, the process reward model could alert the language model the moment it's calling a faulty or inappropriate program. In theory, but at least in this paper, there is a limit to this approach. Even when analyzing and deciding amongst over a 100 solutions, the performance started to plateau. For sure, it's still a huge boost on this math benchmark from 50% to around 70%, but there's a limit.

that's because it's not using human annotation like with let's verify or is it a fundamental limitation with the approach. Perhaps if a language model doesn't have the requisite program in its training data set to solve a math problem, it can't do so no matter what supervision it's given. Nevertheless, the principle is clearly established. We don't have to rely on the language model itself locating the correct and necessary program to solve a challenge. We can at least help it along the way, and we know that there are even better verifiers out there, namely simulations and the real world. As I discussed with Jason Mah, the lead author of The Dr. Eureka paper, it's a feature because that means the LM can sample, let's say, a 100 different solutions, and your simulator in this case serves as an external verifier to see which ones are good. If your LM doesn't have the ability to hallucinate, if it's always deterministic, then the method will actually not work because you would only be able to generate one candidate per iteration, right?

becomes very slow every time the model generates any response. It's technically hallucinating. It's just a sample from the probability distribution, right? And it's only hallucination if it doesn't agree with what you think it should output, right? But in my case, is I don't care if it agrees with what I think is a good reward. I have something external to verify, so it's great. The model can output a 100 different things that makes the iterative evolutionary process much faster. So I think that's actually a blessing. That I think if you only think about applications like chatbot agents, you may underappreciate. But if you think about the use case for large language models or any foundation model for I think Discovery tasks or scientific discoveries, what you want is the model to be able to propose 10 different solutions. Is it possible that we can turn hallucinations from a weakness to a strength? Nvidia and others are of course working hard to find out. That second approach then can be summed up as using

verifiers. Another approach is to better locate the requisite programs within a large language model, and I will quickly mention another method for locating that latent knowledge: many-shot give models tons and tons of examples of the kind of task you want it to achieve, and it can better learn how to do so. It seems obvious, but it can lead to significant performance gains. But what about teaching language models new programs on the fly? This is what François Chollet calls active inference, and it's responsible for the current state-of-the-art score of 34% on the ARC AGI prize. There are many facets to this approach, but I'm going to summarize heavily. The key insight is to use test-time fine-tuning. When the model sees three examples like those on the left, that isn't enough to teach it the way to solve the fourth one. It's too minuscule a signal amongst all its many parameters. But one of the things that Jack Cole and code did is augment these three examples with many, many synthetic examples that

mimic the style. They then fine-tune the model on those augmented examples. I think of it as prioritizing, as humans do the thing right in front of its face. You can almost think of it like a language model concentrating. Its parameters are adjusted to focus on the task at hand, a bit like a human going into the Flow. By the way, they also use GPT-4 to generate many of the synthetic riddles to train their system. Here's how François Charet describes the approach: Most of the time when you're using an LLM, it's just doing static inference. The model is frozen, and you're just prompting it, and then you're getting an answer. So the model is not actually learning anything on the fly. Its state is not adapting to the task at hand. And what Jao is actually doing is that for every test problem, is on the fly, is fine-tuning a version of the LLM for that task. And that's really what's unlocking.

performance. If you don't do that, you get like 1% two %. So basically, something completely completely negligible. And if you do test time fine-tuning and you add a bunch of tricks on top, then you end up with interesting performance numbers. So I think what he's doing is trying to address one of the key limitations of LMS today, which is the lack of active inference. He's actually adding active insurance to LMS, and that's working extremely well actually. So that's fascinating to me in sure even on the Achilles heel of large language models abstract reasoning. Jack Cole says this. What is clear from our work and from others is that the upper limits of the capabilities of LLMs, even small ones, have not yet been discovered. By the way, his model is just 240 million parameters. There is clear evidence that more generally capable models are possible. Again, sticking with the program metaphor, as Francois Chalet says, this is like doing program synthesis. Another definition we can use is reasoning is the ability to when you're faced with a

with a puzzle. Given that you don't have already a program in memory to solve it, you must synthesize, on the fly, a new program based on bits and pieces of existing programs that you have. You have to do on-the-fly program synthesis, and it's actually dramatically harder than just fetching the right memorized program and replaying it. Now, at this point in the video as we get to the fourth approach, I'm going to make a confession. I have about 20 tabs left on my screen, going over other relevant papers on how they improve LLMs, but I am beginning to worry that this video might be getting a little bit too long. So, for the last few approaches, I'm going to be much more brief. I hope I'm still conveying that central message, though, that LLMs currently suck at abstract reasoning, but that need not be a death sentence. Nothing in the literature indicates that AGI is at all imminent, but neither is AI all hype. Here is a paper from the arch LLM skeptic, Professor Raal, who I interviewed almost

a year ago, it's a position paper from this week. LM's C plan but can help planning in LLM modulo Frameworks. We had a great discussion almost a year ago, which I'll hopefully get to in a different video, but the summary of this paper is this: earlier work by Professor Raal and Co had shown that even models like GP4 can't come up with coherent plans. They fail in this domain of Bloxs World. Essentially, Bloxs World is like some of the other reasoning challenges you've seen today, in that you have to come up with a coherent plan: unstacking blocks and restacking them to meet the required objective. Definitely not a memorization test as the MML U can sometimes be. Indeed, if you throw off the model and use mysterious words instead of household objects, the models perform even worse. Zero-shot GP4 gets one out of 600 challenges. However, this fourth approach says: why do we have to use LLMs alone? Why can't we use them with traditional symbolic systems? Maybe that combination of neural networks and

traditional symbolic hardcoded programmatic systems is better than either alone. Professor Raal is a friend of Yan Lun, a famed LLM skeptic, but the paper that he led said this: There is unwarranted pessimism about the roles LLMs can play in planning SL reasoning tasks. The key insight is that LLMs can act as idea generators; those grounded symbolic systems can then check those plans. LLMs as the ideas man with symbolic systems as the kind of accountants. LLMs are great at guessing candidate plans to solve Bloxs World challenges, and those ideas, or you could say retrieve programs, aren't all bad. Even after three or four rounds of feedback from the symbolic system, 50% of the final plan retains the elements of the initial large language model plan. With that feedback from the symbolic system, you back prompt the LLM, and it comes up with, hopefully, a better plan. Not even hopefully, though; the results are clear. GPT-4 can score 82% with this approach, still struggles with mysterious languages but can solve five of them.

this all reminded me of alpha geometry, which I have done a separate video on, so I won't focus on today, but it's that same combination of a neural network and symbolic system for geometry problems, specifically in the international math Olympiad. It scored almost a gold medal; those are incredibly hard reasoning challenges. Very quickly, now the fifth approach: instead of calling a separate system, how about jointly training on its knowledge? For time purposes, here is a very quick summary. They trained a separate neural network (not a language model in this case), a graph neural network. It learned specialized algorithms. Then they embedded that fixed, optimized know-how and had a language model train with access to those embeddings. In other words, a language model fluent in the language of text and algorithms, programs that you might need, for example, for sorting. And finally, for this video, there's tacit data. So much of what humans do and how humans reason is not written down. Let's hear from Terren, arguably the smartest man on the planet. He said so much knowledge

is somehow trapped in the head of individual mathematicians, and only a tiny fraction is made explicit. A lot of the intuition of mathematicians is not captured in the printed papers in journals, but in conversations among mathematicians, in lectures, and in the way we advise students. People only publish the success stories. The data that are really precious are from when someone tries something and it doesn't quite work, but they know how to fix it. But they only publish the successful thing, not the process. And all of this, he says, simultaneously points to a dramatic way to improve AI, but also why we shouldn't expect an intelligence explosion imminently. Training on that tacit data would unlock notable progress, but human mathematicians, he says, would just, in his view, move to a higher type of mathematics. As we speak, OpenAI and I'm sure many others are trying to make as explicit as possible that tacit knowledge. I'm sure hundreds of PhDs are writing down their methodologies as they solve problems. Millions, if not billions, of YouTube hours of video are being

ingested in the hopes that AI models pick up some of that implicit reasoning. While you may see this as the most promising approach of the six I've so far mentioned, it wouldn't yield immediate explosive results. It would be reliant on us and other human experts to write down with fidelity our reasoning, less a remorseless faceless Shogo solving the universe, and more a student imitating its teachers. Of course, you will have likely seen the somewhat ambiguous clip from Miramurati, the CTO of OpenAAI, saying they don't have any giant breakthrough behind the scenes. Inside the labs, we have these capable models, and you know they're not that far ahead from what the public has access to for free. And that's a completely different trajectory for bringing technology into the world than what we've seen historically. But as I've hopefully shown you today, it doesn't have to be an all or nothing AGI imminently, or all hype. As even François Chollet says, it could be a combination of

approaches that solve. For example, ARC that indeed might be the path to AGI. People are going to be winning the AR competition, and that we're going to be making the most progress towards near term are going to be S that manage to merge the Deep planning Paradigm and a discrete search Paradigm into one elegant way. So much more to get to that I couldn't get to today, but I hope this video has helped you to navigate the current AI landscape. As ever, the world is more complex than it seems. Thank you so much as ever for watching and have a wonderful day.

AI Won't Be AGI, Until It Can At Least Do This (plus 6 key ways LLMs are being upgraded)

Covering the biggest news of the century - the arrival of smarter-than-human AI.

AI Insiders Exclusive Videos and Network: https://www.patreon.com/AIExplained

Newsletter: https://signaltonoise.beehiiv.com/

Business GenAI Consulting: https://www.theinsiders.ai/

Need an GenAI app built for your business (any scale), in 4-8 weeks? My SF-based colleague Michael Lin, ex-Netflix + Amazon Senior Software Engineer - is now available for a free 30 min consultation: hello@allinengineeringconsulting.com

If you know your TPUs from your transformers and want to write an AI Explained-level script for a video (e.g. on 'The Rise of Nvidia' or 'Alex Radford and GPT-1', I would pay $1.5-$2.5k for any script I use (inc visuals). So far, everything is 100% me, from research to editing, but would be great to have a collaborator for deep dives on AI history, with a regular gig possible too. :)

Business Enquiries: aiexplained@outlook.com 


AI Won't Be AGI, Until It Can At Least Do This (plus 6 key ways LLMs are being upgraded)

AI Won't Be AGI, Until It Can At Least Do This (plus 6 key ways LLMs are being upgraded)

Scripts