Stop Being an AI Subscriber. Start Being an AI Operator.
Why I stopped letting Claude carry my everyday workload, the three-tier local routing system I run on my 16GB Mac, and how building Sideprobe forced me to rethink AI dependency.
Juarez Filho8 min read
I still pay for Claude. I just stopped letting it carry my everyday workload.
Every few weeks I used to hit the exact same wall. My Claude plan capped out mid-task, and I had to wait.
I was deep in system permission tests for Sideprobe on macOS. The code had just compiled, the tests were passing, and the session abruptly halted. An entire afternoon block evaporated while the interface dangled upgrade buttons.
I pay for that subscription specifically to access a top-tier reasoning model for hard engineering problems. Even that was not enough. Because I defaulted to Claude for every casual question, personal email draft, note summary, and routine code tweak, I kept burning through the cap. The interface repeatedly urged me toward the €100-a-month Max tier. I refused to pay that much simply to keep my basic daily momentum moving.
Building Sideprobe taught me that running models locally extends far beyond an app architecture: it is a personal operating philosophy.
Turn on usage credits to keep working past your plan limit. Your weekly limit resets Oct 13 at 2:00 PM.
What actually runs on my machine
This is not a theoretical experiment after a weekend of hacking. It has been a steady, deliberate adjustment over months of solo building.
Ollama runs on my machine whenever I sit down to build. It drafts quick replies, summarizes lengthy discussion threads, and formats rough notes. It handles that work reliably.
Bionic (LM Studio) serves as my experimentation sandbox. I use it to compare open weights directly, test multimodal prompts with diagrams or audio clips, and inspect token generation speeds. Some open releases perform remarkably well now. Some still hit bizarre edge cases, like an infinite repetition loop that fills memory with duplicated sentences until the process halts. You only discover those boundaries by running the weights yourself.
OpenCode handles the trivial end of my coding: isolated bash scripts, small data transforms, and CSS tweaks. Tasks I once threw at a frontier model without thinking now land here.
I keep handing these tools more work as confidence builds. It is not an overnight replacement. It is a steady reassignment of tasks based on what each tool can realistically carry.
I still pay €20 a month for Claude, completely on purpose. I will explain why shortly.
Subscriber or operator
You stop being an AI subscriber, capped by external rate limits and opaque pricing changes. You become an AI operator, directing your own routing system.
The core realization is simple: same work, different architecture, and you decide where each request goes.
The shift takes deliberate effort. Having your entire workflow locked inside a single cloud ecosystem like Claude or ChatGPT is convenient. If you prefer paying hundreds of dollars each month for that single-ecosystem convenience, that is your call. But you should recognize that you are paying for convenience, not necessity.
The safe choice has a bill
The major cloud providers feel like the default choice. Everyone uses them, they are well known, and nobody questions the decision.
Here is what that default habit actually costs you:
You burn scarce frontier capacity on work that never required it. Summarizing a meeting note, renaming variables, drafting a routine response to a client. None of that demands research-grade reasoning. You are using an expensive cloud model to alphabetize a list, and you run down your hourly quota every time you do it.
Then you hit the cap. The rate limit does not distinguish between hard engineering problems and trivial text cleanup. The easy work burned the budget before the hard work arrived. The lockout lands at the exact moment you need the strongest model to resolve an architectural roadblock.
The deeper cost is dependency. Your pricing, rate limits, data path, and uptime remain entirely outside your control. If your entire workflow rests on a single subscription, every product change is decided for you, without you.
Most people could install Ollama in ten minutes. They simply do not. They established a habit with a browser tab early on, it solved their immediate problem, and they stopped exploring alternatives. Familiarity is difficult to argue with.
The operator's system
I route my daily work across three distinct tiers.
Tier one is daily utility. Ollama runs on my laptop. This carries high-volume daily tasks: quick email drafts, reading notes, markdown formatting, and throwaway questions. It never touches a remote server, costs nothing per call, and runs without a counter ticking down in the background.
Tier two is the open sandbox. Bionic (LM Studio) or Jan handle model comparisons and multimodal experiments. OpenCode takes small coding tasks and site tweaks. This middle tier continues to expand. Every month, tasks I assumed required a frontier model prove to run smoothly here.
Tier three is frontier reasoning. Claude handles the demanding engineering slice: complex system architecture, multi-file refactors, and subtle edge cases. This is where I want the best available reasoning, and I gladly pay for it.
The critical difference is how I treat tier three. I keep my €20 subscription as a benchmark, not a crutch. When I evaluate whether an open model can take over a specific workflow, I run the same prompt through Claude as a measuring stick. It shows me exactly where open models have caught up, and where the gap remains.
What changed when I routed my work
The first difference was that rate limits stopped dominating my evening sessions. I can still hit the quota occasionally during heavy engineering work, but high-volume tasks moved off the metered path entirely.
Before this setup, I hit Claude's five-hour cap two to three times every week, regularly losing prime evening coding blocks. Since adopting this three-tier routing model, that number dropped to nearly zero. The counter only ticks for problems that genuinely deserve it.
The second change was that the tier boundaries kept drifting downward. Work I placed in tier three months ago now runs in tier two. Small coding tasks moved to local and open tools without a rigid plan. I simply assigned one task, observed the result, and kept delegating when it held up.
The third change surprised me most: I became far better at evaluating the complexity of my own tasks. When every prompt goes to the same frontier model, you never evaluate the difficulty of the request. When you route tasks yourself, you have to look at the work and judge what it actually demands.
My Claude subscription survived this entire process. It remains active, but it is now a specialized instrument I choose deliberately, not a default landing pad for lazy prompts.
The honest limit: hardware
Local AI is not free of trade-offs. It shifts the cost from a monthly recurring subscription to your physical hardware. For many setups, that trade-off does not work in your favor.
My MacBook Pro has 16GB of unified memory. That represents a very real ceiling. I cannot run heavy 70B open models on this machine. The 3B and 8B models I do run perform well, and they carry tier one and much of tier two. But I will not pretend that a 16GB laptop holds a frontier-class model on its desk. It does not.
A lower-spec 8GB machine makes this limitation obvious. For lightweight hardware, running local models causes memory paging and sluggish responses. For that setup, opening a browser tab is genuinely the better option, and claiming otherwise would be inaccurate.
The alternative is dedicated hardware: a Mac mini or Mac Studio with 32GB to 64GB of memory. That requires real capital upfront. For full-time builders, that investment can pay back against a stack of per-seat subscriptions. For others, the arithmetic does not make sense.
Routing by complexity works across every hardware tier. What changes is where your boundaries sit. On a 16GB laptop, tier one is compact and tier three still carries substantial weight. On a 64GB desktop, tier two expands downward and absorbs heavier tasks. The routing logic holds either way. The ceiling is personal to your machine.
Two moves from here
The next step depends on what you are building.
If you run a team or a business: recognize that another path exists. Right now, companies automatically assign premium subscriptions to every seat as an accepted operating expense. Examine what team members actually run through those windows: drafting, summarizing, light reformatting. Much of that does not require frontier reasoning. Keep the premium seats for deep engineering and strategy, and route the rest through local or cost-effective tooling.
An early tester put it plainly last week: their client conversations are strictly under NDA, and any cloud AI tool requires formal disclosure and assessment under DORA. Adding another cloud subprocessor is a regulatory headache. When software runs entirely on the local device, there are zero third-party subprocessors to audit, no remote audio streams, and no NDA violations. Compliance is built into the architecture.
“Provided I understand information security and where the transcript is stored, I'd definitely be interested in the live feature. But our comms with clients are under NDA and any subprocessors we use need to be disclosed and assessed as part of DORA, so it's not easy to add services.”
If you are a solo builder, designer, or engineer: install a local runtime this week, whether that is Ollama in your terminal, Jan on your desktop, or an autonomous agent like Goose. Take one repetitive task you run every day and hand it to a local model for seven days. Observe where it succeeds and where it stumbles.
Once you run a model on your own hardware without per-token charges or arbitrary rate gates, your design space expands. You begin experimenting with background workers, local file watchers, and workflows that were impractical against a metered API. Changing the unit economics changes what you build.
How this connects to Sideprobe
Sideprobe grew directly out of this conviction. The desktop app listens alongside live conversations on your Mac and provides real-time nudges, missing questions, and unverified claims without sending your audio or transcripts to the cloud.
Local execution is not a marketing angle for the app. It is the core engineering design. If a tool needs to be present during sensitive client calls, user research interviews, and founder strategy sessions, privacy cannot depend on a remote server's terms of service. It has to run on your device.
The app is currently in private early access on macOS. I am working closely with testers to refine its real-time assistance pacing and offline models.
Currently available on Mac. Windows coming next.
Get early access
Closing thoughts
The question was never which AI model is smartest. It is which of your daily tasks actually justifies metered capacity.
I am no longer an AI subscriber waiting on a quota reset. I operate my own routing pipeline. The hardware ceiling on my 16GB MacBook is real, and I still pay for Claude on purpose. But I decide where each request goes.
Take one recurring task off your frontier subscription this week and route it locally. Observe what works, what breaks, and what surprises you.
Got a local model setup running on your machine, or a weird failure you encountered while trying to move away from subscriptions? Share your experience below.
Responses come straight to my personal inbox. I read and reply to each one myself. Or if you'd rather share your thoughts directly with me or chat about Sideprobe, reach out on X (@juarezpaf) or LinkedIn.