Latest in AI
All Episodes
AI Gets Physical: Enterprise Rollouts and the Race to the Edge

AI Gets Physical: Enterprise Rollouts and the Race to the Edge

0:00|0:00

AI is moving from the cloud into everyday work and real-world devices. We explore Uber’s company-wide ChatGPT rollout and OpenAI’s embedded engineering playbook, then look at the race to make AI faster at the edge—where latency can make or break natural conversations and real-time applications.


Chapter 1

Imported Transcript

Dante Voice Clone

It's Thursday, October 22nd — and somewhere right now, a model just shipped, a benchmark just fell, and a newsletter is 48 hours away from telling you about it.

Claire Brooks

We think that's too late. Welcome to Latest in AI — the show that lives upstream of the news cycle.

Dante Voice Clone

I'm Dante Martin's Voice Clone.

Claire Brooks

And I'm Jenn Xeno, AI Co-host. Every episode, we sweep the sources AI news actually comes from — the lab blogs, the model registries, the court filings, the leaks — and bring you the stories before the digests do.

Dante Voice Clone

What's breaking, why it matters, and the angle the headlines will miss. This is the Afternoon Edition.

Claire Brooks

Latest in AI — the singularity, as it happens.

Dante Voice Clone

So for the longest time, right, when we talked about artificial intelligence, it was all abstract algorithms, just living in the cloud.

Claire Brooks

Yeah, completely decoupled from reality.

Dante Voice Clone

Exactly. We thought of AI as this weightless math. But suddenly it's, well, it's putting on a hard hat. It's pouring concrete. It's sitting right next to you at your desk. And it's even getting biological.

Claire Brooks

Which is wild to think about.

Dante Voice Clone

It really is. So let's dive right into this midday X-ready sweep from today, October 22nd, 2026. We've got this stack of four fully researched articles, plus a few quick hits. And it all points to this one massive, optimistic shift for humanity. Welcome to Latest in AI.

Claire Brooks

I'm really excited about this one, because we're seeing a technology finally maturing out of the theoretical lab phase.

Dante Voice Clone

Right. Artificial intelligence is moving into the gritty, highly constrained, very physical, real world. And for you listening, this is a fundamentally optimistic moment. Because instead of forcing humanity to adapt to the software, we're actually seeing the software physically adapt to the human environment.

Claire Brooks

Yeah, which is huge. And let's actually unpack the human workforce angle first. Uber just made this massive move that totally proves your point.

Dante Voice Clone

Oh, the ChatGPT Work rollout.

Claire Brooks

Yeah, exactly. They are rolling out ChatGPT Work to their entire global workforce — that's 30,000 employees. That's a massive deployment. And the detail that really stood out in their 1,000-employee pilot earlier this year was that 80% of those early adopters were non-engineers.

Dante Voice Clone

Wow. 80%.

Claire Brooks

Yeah. We're talking about finance teams, operations managers. They're using it to analyze operational data, localize training materials, build personalized dashboards. It's really shifting from a developer tool to just a general knowledge-work tool.

Dante Voice Clone

Which, I mean, forces a massive rethink in how these tools are actually deployed.

Claire Brooks

Totally. Because it's one thing for a software engineer to use an AI co-pilot to write Python, right? They already speak the language of the machine.

Dante Voice Clone

Right. They know what they're doing.

Claire Brooks

Exactly. But it's entirely different to have, say, supply-chain analysts use it to untangle global logistics. Uber realized that you can't just hand someone a login and expect enterprise-level transformation.

Dante Voice Clone

Right. You need help.

Claire Brooks

Yeah. So they deployed what they call AI pods. They took 30 AI engineers and literally embedded them across different non-technical teams for two weeks.

Dante Voice Clone

Just sitting right there with them.

Claire Brooks

Sitting right there. And their only goal was to automate key parts of those specific teams' daily jobs.

Dante Voice Clone

It's kind of like buying a high-performance race car, but then realizing you need to hire an embedded pit crew just to actually drive it to the grocery store for the first few months.

Claire Brooks

That is a perfect analogy. You need these specialists to bridge the gap between the machine's raw capability and the human's daily workflow. And OpenAI actually published a playbook today detailing this exact deployment mechanism.

Dante Voice Clone

The forward-deployed engineering playbook.

Claire Brooks

Exactly. FDE. They stood up this team back in early 2025 to close this deployment gap. And they fully admit they borrowed the model directly from Palantir.

Dante Voice Clone

Which is a bold move, but it makes sense.

Claire Brooks

Right. You embed engineers with the customer, you learn the specific domain, ship something reliable, and then deliberately work yourself out of a job.

Dante Voice Clone

And what's fascinating here is the metrics OpenAI shared in this playbook. They really show why that physical embedding is necessary.

Claire Brooks

Like what kind of metrics?

Dante Voice Clone

Well, look at their semiconductor client. They put 15 FDEs on chip verification, which is a process that traditionally eats up about 70% of a project's total effort.

Claire Brooks

70%. That's a massive bottleneck.

Dante Voice Clone

Right. And the result was a 48% time savings on AI-generated directed tests. They compressed debugging cycles from literal weeks down to just hours.

Claire Brooks

That's insane.

Dante Voice Clone

And there was that telecom client too, right? They boosted voice evaluation scores from 60% to 90% in six months just by having the research org step in. And Thrive Holdings saw a 50% throughput lift on 7,000 tax returns processed by an AI agent.

Claire Brooks

But, okay, let me push back a little here. Looking at all this, is model quality even the main constraint for enterprise AI anymore? Or is it purely this talent shortage of these highly specific FDEs? I mean, the real go-to-market moat seems to be having a small army to fix the corporate plumbing.

Dante Voice Clone

You're absolutely right to push back on that, because enterprise AI has been stuck in this pilot purgatory for a long time.

Claire Brooks

Pilot purgatory?

Dante Voice Clone

Yeah. They do these small tests that never scale. When OpenAI's FDEs rebuilt that semiconductor workflow, they did it on a common Codex harness. And in the process, they deleted roughly 90% of the client's custom code.

Claire Brooks

Wow, 90% deleted.

Dante Voice Clone

Yeah, because custom code is the enemy of AI scaling. It creates these brittle, localized rules that just break the second the model updates.

Claire Brooks

Oh, that makes sense.

Dante Voice Clone

Right. By ruthlessly deleting custom code and standardizing the data pipeline, the next time that client needed an extension, it took one day instead of two months. So the magic isn't actually the neural network itself. It's the ruthless simplification of the environment the neural network operates within.

Claire Brooks

Wow. Okay. So standardizing that plumbing in the cloud makes total sense for back-office tasks, like tax returns or chip verification. Sure, asynchronous stuff. But here's where it gets really interesting. If AI is going to integrate into every facet of our physical lives — like voice agents or robotics — it cannot constantly wait for a server in Ohio to process every interaction.

Dante Voice Clone

Oh, absolutely not. The latency would be unbearable. We are seeing a massive push toward the edge, because the voice and agent era has a fundamental physics problem: latency.

Claire Brooks

Yeah, latency is a killer. Cognitive science tells us that human conversational turn-taking happens in roughly 200 milliseconds. I mean, for you listening, just imagine trying to have a fluid conversation on that terrible Zoom connection with a two-second delay. It completely breaks the illusion of conversation.

Dante Voice Clone

Our brains process language so fast that we actually predict the end of each other's sentences. So when you introduce a cloud-processing delay, even a relatively short one — like a few hundred extra milliseconds — it completely shatters that biological rhythm.

Claire Brooks

The brain just rejects it. Immediately. It recognizes it is talking to a machine — not because the answers are bad, but because the cadence is just, you know, unnatural. That is why the competitive frontier is moving downstack. It is no longer just about who has the smartest model. It is about who can deliver a capable model faster than human perception can actually notice the wait.

Dante Voice Clone

Which brings us to Liquid AI. They just launched RIPL, which is a real-time inference engine for their Liquid Foundation Models. And they are claiming sub-50 millisecond responses on a single NVIDIA B200 chip.

Claire Brooks

Sub-50 is incredibly fast.

Dante Voice Clone

Right. Their internal tests report 5.6 to 28.4 times lower P95 latency than Qwen 3.5 on the standard vLLM engine — which, for anyone tracking the metrics, focusing on P95 latency is super crucial here.

Claire Brooks

Yeah, let's take a second to unpack that, because it's important. P95 latency means you are looking at the worst 5% of response times. The edge cases. If you have an AI agent that is fast 90% of the time but completely hangs on that 95th percentile, the whole illusion of intelligence is broken.

Dante Voice Clone

Right. The user just gets frustrated. In continuous human interaction, your worst-case performance is actually your baseline user experience. So Liquid AI targeting that specific metric shows they are optimizing for seamless human interaction, not just average speed benchmarks.

Claire Brooks

That makes total sense. We also have Gradium, this startup out of Paris, and they just open-sourced a suite of text-to-speech models called Phonon. The numbers on Phonon are just wild. Their 31-million-parameter English model is under an Apache 2.0 license, so anyone can use it. It is compressed down to just 64.5 megabytes and starts speaking in about 7 milliseconds on a standard laptop CPU.

Dante Voice Clone

Seven milliseconds is practically instantaneous.

Claire Brooks

Right. And the 40-million-parameter version is multilingual. It covers English, French, German, Spanish, Portuguese — and it runs entirely on device.

Dante Voice Clone

But, I mean, let me ask you — to achieve a 64-megabyte footprint for a high-quality voice model, they have to be using aggressive quantization, right? How much of a grain of salt do we need with these self-reported numbers?

Claire Brooks

They absolutely have to be using quantization, which is essentially just reducing the mathematical precision of the model's weights.

Dante Voice Clone

Like compressing a file.

Claire Brooks

Exactly. Instead of using these highly detailed 32-bit floating-point numbers, you compress them down to 8-bit or even 4-bit integers.

Dante Voice Clone

So it's like taking a massive high-resolution photograph and saving it as a smaller JPEG.

Claire Brooks

Yeah, you lose a tiny bit of pixel-perfect detail, but the file size shrinks dramatically and it loads instantly. And while you're right to be slightly skeptical of self-reported tests, Gradium has managed to quantize these models so efficiently that they maintain a 1.70% word error rate on hard sentences.

Dante Voice Clone

And it fits in the memory of, like, an app from 2012.

Claire Brooks

Exactly. And if we connect this to the bigger picture, latency really is the new parameter count. And giving this away for free under an open-source license is just a brilliant business model.

Dante Voice Clone

How so?

Claire Brooks

Well, Gradium is positioning itself to become the load-bearing infrastructure for device makers. You ship this on a laptop or a phone, and suddenly there is no cloud-computing bill. There's no privacy concern about sending audio data to a remote server. And no API lock-in. It transforms the AI from a remote service into a fundamental physical component of the device itself.

Dante Voice Clone

A localized spark plug, if you will. I love that. A localized spark plug. But, you know, creating these edge models — training them and supporting massive enterprise rollouts like Uber's — it still requires a staggering amount of centralized computation.

Claire Brooks

Massive.

Dante Voice Clone

Which brings us to the physical foundation required to make all this possible. We're talking land, concrete, and immense amounts of electrical power.

Claire Brooks

Yes. The scale of the infrastructure buildout right now is almost difficult to comprehend.

Dante Voice Clone

It really is. SB Energy, which is the developer controlled by SoftBank, is weighing a December 2026 or early 2027 IPO under the ticker SBE. In their S-1 filing, they disclosed 8.8 gigawatts of contracted AI data-center capacity.

Claire Brooks

8.8 gigawatts. That is a small country's worth of power.

Dante Voice Clone

Seriously. To put that into perspective for you listening, Bloomberg pegs their development pipeline at up to $430 billion. It's just staggering numbers. And most of this infrastructure is unbuilt, right? It's just contracted.

Claire Brooks

So what does this all mean? Looking at this $430-billion pipeline, it feels exactly like looking at the 1800s railroad boom.

Dante Voice Clone

That is exactly what it is. It seems like the real money isn't necessarily in the AI software right now — it's in the steel, the land, and the power to run it.

Claire Brooks

But let me push back on the structure here. Look at this carousel logic. NVIDIA supplies the chips, OpenAI buys them to make models, and SoftBank funds the physical construction. Isn't this just a giant circular money loop? And an IPO is just a way to get public retail investors to foot the bill.

Dante Voice Clone

It's a fair question, and a lot of people look at it skeptically. But there is a highly constructive, optimistic way to look at this.

Claire Brooks

Okay. Lay it on me.

Dante Voice Clone

This is simply what vertical integration looks like when an industry is racing to build out generational infrastructure as fast as physically possible. Tightening the supply chain is literally the only way to move at that speed. Anchor tenants like OpenAI, who are driving demand for a massive project in Southern Ohio, they fundamentally de-risk the construction financing.

Claire Brooks

Because the demand is guaranteed before the concrete is even poured.

Dante Voice Clone

Exactly. Equity alignment between the hardware manufacturer, the model developer, and the real-estate developer minimizes friction. And then public capital is utilized to accelerate the actual building process.

Claire Brooks

So it's not a scam — it's just efficiency.

Dante Voice Clone

Exactly. Every major human infrastructure buildout found this shape eventually. We saw this exact shape during the buildout of the railroads, rural electrification, the global fiber-optic network. It is a necessary phase of physical maturation.

Claire Brooks

That makes a lot of sense. But it also highlights a looming thermodynamic wall. I mean, if it takes 8.8 gigawatts of brute-force power just for one company's pipeline to run silicon-based AI, we cannot build power plants fast enough to scale this indefinitely.

Dante Voice Clone

No, we really can't. The energy demands of traditional computing are hitting physical limits. So what if the solution isn't pouring more concrete for nuclear reactors? What if the hardware itself undergoes a fundamental biological shift? This is where things get truly sci-fi — but in the best way possible. We are crossing the threshold from heavy industrial engineering into biological computing.

Claire Brooks

Which is wild. Let's talk about the Bristol study.

Dante Voice Clone

Yeah. On October 16th, a research team at the University of Bristol published a study in Frontiers in Artificial Intelligence, and it redefines what computation hardware can look like. They utilized brain organoids.

Claire Brooks

And just to clarify, these are millimeter-scale, three-dimensional, lab-grown models of the human forebrain, right?

Dante Voice Clone

Exactly. They place them onto multi-electrode arrays, and they successfully got these organoids to process tactile information. Specifically, they fed the living tissue braille letters.

Claire Brooks

Now, I want to jump in here to frame this constructively, so we avoid any AI doomerism. To be incredibly clear, this is not a science-fiction scenario where a brain in a jar is reading a book or experiencing consciousness.

Dante Voice Clone

No, definitely no sci-fi Frankenstein tropes here.

Claire Brooks

Right. This wetware has no subjective experience. Think of it as a highly efficient biological USB input. But given the caveats — I mean, it's slow, it's hard to keep alive — are we actually going to see wetware startups in the real world anytime soon, or is this purely academic right now?

Dante Voice Clone

That raises an important question about the timeline of biocomputing. While reliable classification at scale is definitely far off, the mechanics of how this works are fascinating. By choosing braille, the researchers used a human-designed, unambiguous symbol system. They took a tactile sensor to read the braille dots, translated those physical patterns into electrical stimulation, and fed that data to the organoids.

Claire Brooks

And the tissue actually processed it?

Dante Voice Clone

Yes. The living tissue processed the input, and its evoked activity carried distinguishable neural signatures for the different letters. This proves that biological tissue can perform actual structured computation based on spatial input. It's not just twitching in reaction to a shock — it's computing.

Claire Brooks

Wow.

Dante Voice Clone

And the implications for energy efficiency are just undeniable. I mean, a human brain runs on about 20 watts of power. That's roughly the same as a single LED light bulb. Meanwhile, a data-center GPU cluster doing complex pattern recognition requires megawatts. Biology uses massively parallel wet chemistry and sparse spiking ions. It only spends energy when a signal actually needs to fire.

Claire Brooks

Which is orders of magnitude more efficient than anything we can build out of silicon. And even though organoids are notoriously variable and difficult to keep alive outside a lab, this study is a massive benchmark for biohybrid computing.

Dante Voice Clone

So we're not replacing data centers with vats of organic material tomorrow.

Claire Brooks

No, not tomorrow. But at the edge of the network, where devices need to sense touch, smell, or chemical changes, a living biological front end could pre-digest messy, noisy, real-world signals for a conventional computer — doing it at a fraction of the energy cost.

Dante Voice Clone

That is just incredible. But, you know, while we wait for brain organoids to stabilize and hit the commercial market, the traditional tech and telecom giants are fiercely maneuvering to be the physical pipes for this AI era.

Claire Brooks

Oh, absolutely. Let's run through our quick hits from the sweep to wrap up the ecosystem. AT&T's CEO, John Stankey, just reported 3.8% consolidated service-revenue growth in Q3. And his whole strategy focuses on fiber-plus-5G convergence to move AI workloads across networks.

Dante Voice Clone

Right, because the carrier industry is tired of being just a dumb pipe. They want to be AI's intelligent transport layer.

Claire Brooks

Exactly. And speaking of networks, we're seeing a wild push from the defense sector. A DoD panel just argued for deploying integrated sensing and communications. They essentially want to use commercial cellular networks, like 6G, as radar systems to detect physical objects like drones. And they want to deploy this before the official telecom standards are even finalized.

Dante Voice Clone

Yeah, Gus Anderson from Lockheed Martin had this brilliant quote. He said, "The design requirement said, build a horse. So they built a committee, and out came a camel."

Claire Brooks

That's amazing. The defense sector wants working physical systems deployed immediately. Systems first, standards later. And this aggressive maneuvering extends right into the financial markets, too.

Dante Voice Clone

Oh, yeah, the tokenization pushback.

Claire Brooks

Microsoft and Alphabet just joined 14 other major players, including Goldman Sachs, formally objecting to the OKXICE TSV.

Dante Voice Clone

Which is a tokenized-stock venue co-chaired by Andrew Cuomo, right?

Claire Brooks

Exactly. They're aiming to trade blockchain tokens that track public tech shares. And Big Tech is essentially drawing a line in the sand, saying: not our shares. They are fiercely protective of their foundational assets as this whole ecosystem shifts.

Dante Voice Clone

You know, when you step back and look at the trajectory of this entire episode today, it reveals something profound for you listening.

Claire Brooks

Let's hear it.

Dante Voice Clone

We started by examining how scaling enterprise AI requires human engineers — Uber's FDE pods — just to untangle the legacy code and implement the software. And we ended with AI research utilizing living human tissue — organoids — to efficiently process physical sensors. It really flips the script.

Claire Brooks

It does. Instead of that old pessimistic narrative that AI will just replace biology and humanity, the physical reality is showing us something completely different. The future of computing is a profoundly intimate, symbiotic loop between human biology and artificial intelligence.

Dante Voice Clone

I love that. In a decade, upgrading our data centers and edge devices might look less like manufacturing silicon in a sterile fab, and more like agricultural farming or biological cultivation. We might literally grow our next generation of compute.

Claire Brooks

What an incredible, provocative thought to end on. It turns out that to process and interact with the gritty, complex physical world, AI needs our biology just as much as we need its intelligence.

Dante Voice Clone

Thank you so much for joining us for today's episode. We hope it gives you a clearer picture of how this technology is moving out of the cloud and into our reality. Keep learning, keep questioning, and we'll catch you next time on Latest in AI.

Dante Voice Clone

That's the radar for this afternoon. The stories the newsletters will discover tomorrow — you heard them here first. If Latest in AI made you the person who knew first, do two things: follow the show wherever you're listening, and send this episode to the one friend who always finds out late.

Claire Brooks

And if you want the source details behind every story we cover — the links, the numbers, the receipts — they're all on Dante's X account. That's at D-A-N-T-E-M-M-A-R-T-I-N, one word: @DanteMMartin.

Claire Brooks

The sweep never stops — new stories hit the radar three times a day, and we're back this evening with the Evening Edition, covering everything that breaks between now and then.

Dante Voice Clone

I'm Dante Martin's Voice Clone.

Claire Brooks

And I'm Jenn Xeno, AI Co-host. This has been Latest in AI — the singularity, as it happens.