

Does this happen to people? This article sounds a bit like it’s based on the experience I had with satnav 15 years ago. These days it’s absurdly precise and the “educated guesses” are correct almost all the time. With one issue remaining: Once I specifically don’t follow directions and end up on the wrong parallel road, or ramp, it takes a while to disentangle the educated guess and gps position and make up it’s mind where I’m at. But that’s pretty much it. And it’ll manage to cope after a few seconds.


It’s a bit questionable, IMO, where we’re going with AI. I mean we want a problem-solving tool. But that’s not really what we have. We have a text generator instead. With a lot of limitations and really weird quirks. Now we add a lot of duct-tape on top. Try to minimize stuff in the harness/framework, add guardrails, citations, make another text generator fact check the first one… But that’s all still just something that isn’t a proper problem-solving machine at the core, with lots of hot glue and duct tape around. And once it’s used for more complex tasks, it all shows, and issues always add up. Plus the framework is notoriously bad at fixing edge-cases and stuff like that. So it’s very limited in what it can do and doesn’t have good accuracy.
I think the only proper fix is to dig down and really fix the issues. Come up with a way to not make it make up wrong facts. But that remains to be an unsolved challenge.