A Transcription App That Doesn’t Send Your Voice to the Cloud: I Tried Google AI Edge Eloquent

As someone who uses voice memos a lot, this one really caught my interest. I usually use Wispr Flow, but has Google finally gotten serious? Voice transcription in Japanese doesn’t seem to be supported yet, though.

On April 6, 2026, Google quietly released an AI transcription app for iOS called “Google AI Edge Eloquent.” “Quietly” isn’t an exaggeration: there was no press release and no official announcement. It just appeared on the App Store lol

I was curious, so I downloaded it right away and tried it, and it turned out to be a little different from ordinary transcription apps.

What you’ll learn in this post: what Google AI Edge Eloquent is, what “works offline” really means, what I found when I actually used it, and how it relates to Google’s Gemma models. It might change how you choose a transcription app.

Sponsored links

What’s interesting about Eloquent: what “offline” means

There are already lots of transcription apps: Wispr Flow, Otter.ai, Apple’s built-in notes… But what makes Eloquent different is that it works completely offline.

It does mean “you can use it without Wi-Fi,” but there’s something more important.

Your voice data isn’t sent to Google’s servers.

Ordinary transcription apps send your audio to the cloud, process it and send it back. In other words, what you said may stay on a server. With Eloquent, all of that processing happens on the iPhone, so it’s designed so that neither meeting notes nor personal memos leave your phone.

Install it from the App Store and download the Gemma-based model, and you can start using it. There’s a “fully offline” mode toggle at the top right, and when you turn it on, your conversation data doesn’t leave the device.

What I found when I actually used it

I downloaded it and gave it a try.

The first thing I noticed is that it’s a standalone app, not a keyboard extension. Wispr Flow can be used directly from Gmail or a notes app as a mic button on the keyboard, but Eloquent can’t. You open the app, record in it, copy the text and paste it into another app.

It feels like one extra step, but it automatically copies the text to the clipboard when you stop, which is thoughtful. There are also text options like “Key points,” “Formal,” “Short” and “Long” that automatically tidy up what you said. It also automatically removes filler words like “um” and “uh,” which is quietly handy.

At the moment, Japanese isn’t supported. It only responded to English. Google says it plans to add more languages over the coming months, but no specific timing or list of languages has been announced. The keyboard feature is also “Coming soon,” so we’re waiting for a future update.

But English learners might benefit from this app. It measures your WPM automatically. Install it and try it and you’ll see: when I spoke English, it calculated how many words I said per minute and showed me the number. My WPM goal is 150 to 170, but it’s quite hard. On Cambly, the online English service I use, you can also see your WPM on the lesson video page after each lesson, and it’s really good motivation. If you’re curious, give it a try.

How it relates to Gemma 4

Eloquent runs on Google’s Gemma AI models. The latest generation, Gemma 4, had just been released on April 2, 2026. I’m not very familiar with it myself, but I gathered some information online.

  • Completely free, commercial use OK (Apache 2.0 license)
  • The Gemma family has been downloaded more than 400 million times since the first generation
  • The smallest model, E2B, is small enough to run on phones

So the picture is “Google quietly put its own AI models in an app it quietly released.” It felt like Google is seriously moving toward “edge AI” (AI that runs on the device itself).

Well, these days OpenAI and Apple are all talking about on-device AI too lol. My impression was, “So Google has finally put it out as a practical app.”

Gemma 4 can do a surprisingly wide range of things

Gemma 4 isn’t just for apps like Eloquent. It’s an open model, so you can make full use of it yourself. Apache 2.0 means “free to use, commercial use OK, and no extra fees even if you make money with it.”

For example, I think uses like these are realistic:

  • Chat support on a website: you can build your own “Ask our AI chat” window on your site. Instead of using OpenAI’s API, running Gemma 4 on your own server costs nothing
  • Analyzing sales data: hand it this month’s results as a CSV and get trends and advice. I think many people do this with Claude, but if you run Gemma 4 locally, there are no API costs
  • When privacy matters: when you want AI to process information that can’t leave your organization, such as internal documents, medical or legal information, it’s an option that doesn’t send anything to the cloud

Combined with the n8n I run on my Synology at home, something like a completely offline AI agent is possible in theory. It needs a decent GPU, so whether it’s realistic on a NAS is another question lol, but it’s an interesting direction.

To sum up

For now, Eloquent has limits: it’s English only and a standalone app. But I think the concept of “transcription that doesn’t send your voice data anywhere” will really appeal to some people. Once Japanese support and keyboard integration arrive, it could be a very useful app.

I think Google releasing it “quietly” may partly be a kind of demo to show how practical its Gemma models are. I’m curious to see what happens next.

📚 English expressions (B2–C1)

I’m currently learning English and aiming for Eiken Grade 1. I had AI pick out some nice B2–C1 expressions from this post. I hope they help your English studies too!

① transcribe / transcription (to write down speech as text / the written text)

Eloquent can transcribe your voice entirely on-device.

“Trans” means change and “scribe” means write. “Transcription app” is the natural way to say it. The verb “transcribe” also appears in Eiken Grade 1 vocabulary questions.

② on-device processing (processing on the device itself)

All processing happens on-device, so your audio never leaves your phone.

An expression that comes up a lot when talking about edge AI. “On-device” is used with a hyphen as an adjective. The phrase “never leaves your phone” is also a natural way to say the data doesn’t go outside the device, so it’s worth remembering.

③ quietly / discreetly (without drawing attention)

Google quietly released the app without any official announcement.

“Quietly released” is a phrase you see often in news articles. “Discreetly” has more of a nuance of deliberately avoiding attention. It’s easy to remember in the context of “released quietly, without a big announcement.”

Sources: TechCrunch: Google quietly launched an AI dictation app that works offline / 9to5Google: Google AI Edge Eloquent is an offline voice dictation app

☕ Enjoyed this post?

I'm a Japanese blogger who spent 8 years relearning English from scratch.
If this post helped you, a coffee would mean a lot — thank you for reading!

Leave a Reply

Your email address will not be published. Required fields are marked *

ABOUT US
Suitman
An office worker in Japan who has worked in three fields: education, manufacturing and sales. I started learning English at 35 and, after 8 years of keeping at it, passed Eiken Grade Pre-1. VERSANT score: 59. I write about work tips, Excel, AI, English and cameras, all based on my own experience. ▶ More about me