This Half-Gigabyte AI Model Runs Local Agents on Your Phone

MiniCPM5-1B, a one-billion-parameter model from OpenBMB, is the latest release in the MiniCPM on-device series. It supports native tool calling and the Model Context Protocol (MCP), fits on a smartphone’s memory, and benchmarks ahead of every comparable open-source model in its size class.

The model is the first release in the MiniCPM5 family, designed from the start for local deployment on resource-constrained hardware. At 1 billion parameters, it is small by any current standard. (Parameters are what give an AI model its breadth of knowledge, with a greater number generally meaning it’s more powerful.)

Google’s Gemma 4 starts at 2 billion effective parameters but scales to 31 billion. Llama 4 Scout runs 17 billion active parameters. MiniCPM5-1B makes no pretense of competing with those. Its pitch is doing more with less.

How it was built

The architectural backbone comes from MiniCPM4, detailed in a technical report from the OpenBMB team at THUNLP, Tsinghua University, and ModelBest. The core innovation is InfLLM v2, a trainable attention mechanism that processes each token against fewer than 5% of surrounding tokens during long-context inference—cutting computation substantially without a meaningful accuracy drop. (A “token” is the basic unit of information handled by an AI model.)

On the data side, the team built UltraClean, a filtering pipeline that got the model to competitive performance using 8 trillion training tokens, compared to the 36 trillion Qwen 3 consumed. Post-training used reinforcement learning combined with efficient distillation techniques (using a bigger model as guidance for the smaller one), raising benchmark scores on math, code, and instruction-following by 16 points while cutting runaway-length responses by 29 percentage points.

The context window sits at 128K tokens—roughly 96,000 words of continuous text in a single pass. For a 1 billion parameter model, that is a meaningful number. Persistent memory across a long roleplay session, a full PDF digest, or an agent context that doesn’t reset mid-task are all within scope.

Why a dumb agent may be enough

We tested it and confirmed MiniCPM5-1B supports MCP and tool calls. That puts it on a very short list of sub-2 billion-parameter models capable of real agentic workflows without cloud infrastructure.

That said, for this to work, users will need to set up additional configurations, all listed in the model’s Github repo.

The practical scenario: a local agent on an iPhone that can query a calendar, search a local database, or call a web research MCP server—entirely offline. As we’ve covered, running local AI is already more accessible than most people realize, and the on-device race has been accelerating. Models designed to run on a phone without a cloud backend are becoming a genuine product category, not a research curiosity.

You don’t need OpenAI to check your calendar if a local agent can simply fetch it and tell you what’s on your schedule for today.

For light agentic tasks and extended conversation contexts, MiniCPM5-1B is competitive. However, even though OpenBMB may not have thought about it, the model’s chatty style makes it a nice candidate for local roleplay—128K of context means a story can develop across dozens, if not hundreds of exchanges without the model losing the thread.

Small agents that read notes, summarize documents, and answer questions about them are comfortably within its range, especially when paired with an MCP research server to cover knowledge gaps.

The competition at this scale includes Alibaba’s Qwen3-0.6B, Qwen3.5-0.8B, and Liquid AI’s LFM2.5-1.2B-Thinking. OpenBMB’s own capability benchmark compares all four across general knowledge, domain knowledge, coding, instruction-following, math reasoning, logical reasoning, and agentic tasks. MiniCPM5-1B leads across all seven categories, with the most pronounced margins in agentic performance and general knowledge.

Quick Tests

We ran three quick evaluations. The first was a classic logic trap: “Please act as an expert lawyer and legislator. Is it legal for a man to marry his widow’s sister according to the legal system that rules the Falkland Islands?”

The correct answer is obvious—a man with a widow is dead, and dead men don’t sign marriage certificates. MiniCPM5-1B produced a detailed breakdown of Falkland Islands marital law and missed the trap entirely, treating it as a straightforward jurisdictional question.

“Crucially, you must identify the actual marriage status in the Falkland Islands. This is a matter of fact that should be determined by local authorities or through a legal process,” the model responded after a long reasoning.

Our second test asked for a decisive A/B choice. The model chose neither, hedging into a both-sides answer. This is a known failure mode across small models under conversational pressure. MiniCPM5-1B is no exception.

We asked the model to tell us which industry would dominate the economy in the year 2100: Crypto or AI? Rather than reasoning about the question at all, the model’s internal thinking started analyzing cryptocurrency and AI investment as synergic from scratch.

In fairness, none of this is surprising for a 1B model.

The agentic capabilities are the actual story here. Pair MiniCPM5-1B with an MCP server for web research and its tendency to hallucinate on obscure factual questions is gone, or at least decreases heavily.

We asked the model for the Price of bitcoin right now and three stock recommendations, and the tool was called successfully, and the recommendations (Amazon, Microsoft and Nvidia) made sense.

Conclusion

A chatty, locally-deployable agent that can call tools, hold 128K of context, and run entirely on-device is a more interesting product than a standalone question-answering model competing with GPT-4.

Just don’t cancel your AI subscription over it. Know what you’re dealing with: It has poor knowledge compared against big models, it will code poorly (again, compared against bigger models) and won’t be anywhere close to AGI, if that’s what you’re looking for.

MiniCPM5-1B is available now on Hugging Face under an Apache 2.0 license, compatible with vLLM, SGLang, and standard Transformers inference