Setting up a hermes agent fallback model means giving your AI assistant a second brain from a different company, so when the first one goes down or hits its limit, the work your business relies on keeps moving.
Think of it like a spare phone line for your front desk. Customers never see the switch; they just get an answer.
This guide explains it in plain English, then walks through the setup with the steps from the official Hermes Fallback Providers guide.
If you'd rather talk it through with a person before you touch any settings, get your Backlink Gameplan with my team, or try Polar Rank free for 3 days.
What A Fallback Model Means For A Small Business
Hermes Agent talks to an AI model through a provider, such as OpenRouter, Anthropic or Nous Portal.
Providers have bad moments. They get busy, they go down for a while, a login expires, or you reach a usage limit.
Without a backup, the assistant just stops and shows an error. With one, Hermes quietly hands the job to the backup model and carries on.
Picture three everyday jobs:
- A Telegram bot that answers customer questions about opening hours and bookings.
- A nightly job that writes up yesterday's sales notes before you wake up.
- An assistant your team uses all day to draft emails and quotes.
Each of those can keep running through a provider problem if a fallback is set.
Why The Main Model Stops Answering
The Hermes docs list the usual causes, and none of them are your fault:
- Too many requests. The provider says slow down. Hermes retries a few times first.
- The provider's servers struggle. Again, retries first, then the switch.
- A login or key stops working. Hermes switches at once, because waiting won't fix it.
- The model can't be found. Say it was renamed. Hermes switches at once.
- Garbled or empty answers. If they keep coming, Hermes treats that as a failure too.
Step 1: Choose A Backup From A Different Company
This is the single most useful decision you'll make.
If your main model and your backup come from the same provider, one outage can knock out both. Pick the backup from a different provider.
Hermes supports a long list, from OpenRouter and Anthropic to Google AI Studio, Nous Portal and models running on your own computer. The providers page lists what each one needs.
Also think about privacy. When the backup takes over, it sees the conversation, so choose a provider you'd be happy sending that customer chat to.
Finally, check the backup can use tools. Hermes is an agent, so it needs a model that can call tools, look things up and run steps, not one that only chats.
Step 2: Add The Backup With One Command
On the computer where Hermes runs, open a terminal and type:
hermes fallback add
Hermes shows the same menu you used when you first picked a model. Choose the provider, sign in or paste its key, and pick the model.
That's it. Hermes saves your choice in its settings file, in a list called fallback_providers.
To see what you've set, type hermes fallback list. To take one out, use hermes fallback remove.
🔥 Want your AI assistant set up properly the first time? Inside the AI Profit Boardroom you get step-by-step video trainings, the installable Agent OS, four coaching calls a week and 3,400+ members running agents in their own businesses. → Join the AI Profit Boardroom
Step 3: Check The Backup Works Before You Need It
A backup you've never tested is a guess. Hermes now has a command that tests it for you, added in the 16 November 2026 release:
hermes fallback check --live
It sends one tiny message to each backup and tells you whether it answered. It doesn't start a chat and it never prints your keys.
If it says ready, you're covered. If it says auth, the login or key needs fixing. If it says model_mismatch, the model name is wrong.
If you run more than one assistant, each with its own profile, the check can test each profile in turn, so nothing slips through.
Ask whoever looks after your setup to run this check on a schedule, say once a week, so an expired key gets spotted on a quiet Tuesday rather than during a busy Saturday.
What Your Customers Notice When It Switches
Usually nothing. The docs say the conversation, the tools the assistant was using and everything it knew so far carry straight over.
The switch only lasts for that one reply. On the next message, Hermes tries your main model again.
There's one sensible exception: if the main provider has said "come back at 3pm", Hermes stays on the backup until then instead of knocking on a closed door.
The backup model may write in a slightly different style, which is one more reason to pick a good one rather than the first name on the list.
A Worked Example: The Booking Bot On A Busy Saturday
Say a small salon runs Hermes as a Telegram bot that answers booking questions, with OpenRouter as the main provider and Anthropic as the backup.
On Saturday morning OpenRouter starts returning "too many requests". Hermes retries a few times, then hands that one reply to the Anthropic model, and the customer gets their answer about free slots.
The next customer message goes to OpenRouter again. If it has recovered, life carries on as normal. If it hasn't, the backup steps in again for that reply.
Nobody at the salon had to notice, restart anything or change a setting.
Now imagine the same salon had picked a second OpenRouter model as the backup. The same busy spell would have hit both, and the bot would have gone quiet. That's why Step 1 matters so much.
Side Jobs Have Their Own Safety Net
Hermes uses smaller helper models for behind-the-scenes jobs: reading images, shortening long conversations, naming chats and checking risky commands.
By default these helpers try your main model first and then the same backup list you just set, so most businesses need to do nothing extra.
If one of those helpers is important to you, say, reading photos of invoices, the person who manages your setup can give it its own backup under auxiliary.vision in the settings.
And if the job that shortens long chats has no model at all, Hermes trims the middle of the conversation rather than crashing.
Keep Your Overnight Jobs Covered
Scheduled jobs, the ones that run while you sleep, use your backup list too, but only if they weren't locked to one specific model.
A job told to "always use this exact model" won't switch. If that model fails, the job fails.
So for the nightly sales summary, ask for the job's model to be set through the general scheduled-job settings rather than on the job itself. Our guide to Hermes scheduled jobs explains how those jobs are set up.
Keeping Costs Predictable
A backup keeps your assistant working, but it can also change what you pay, because you're now using a second provider.
- Every switch makes the new model read the whole conversation again, since it has no memory saved from earlier turns.
- Hermes doesn't yet ask "are you sure?" before moving to a paid backup. That feature is still an open proposal on GitHub (pull request #149020).
- Some side jobs can only use providers you've actually chosen. Once you've picked a main provider, Hermes won't guess another account you happen to be logged into.
The practical answer: pick one backup you're comfortable using, and check your provider dashboards after the first busy week.
Run Your Own Model First, Cloud As The Backup
Some owners like to run a model on their own computer for everyday work and keep a cloud model only as the safety net.
Hermes supports that. Your own model becomes the main one through the custom setting, and a cloud provider such as OpenRouter goes in the backup list.
When your computer's model server is switched off or overloaded, the cloud backup picks up the conversation.
Your local model needs a big enough memory for agent work: Hermes asks for at least 64,000 tokens of context, as the providers page explains.
The Community Plugin That Picks Backups For You
There's also model-fallback-heuristic in the Hermes Marketplace. It's made by a community developer, tomkubik, not by Nous Research, and it's at version 0.2.0.
It looks at public model lists and fills in your backup list automatically, which helps people who rely on lots of free models.
For a small business with one main model and one trusted backup, it's usually more than you need. It changes your settings file on its own, so if you try it, have someone review what it writes.
📞 Not sure which backup suits your business? Get your Backlink Gameplan and my team will look at how you use your AI assistant and what should happen when it stalls, or try Polar Rank free for 3 days. Backlink Gameplan or try Polar Rank free for 3 days
Mistakes Small Teams Make
- A backup from the same company. One outage, two dead models.
- Never testing. The check takes seconds; skipping it means finding out during a rush.
- Half-filled settings. A backup needs both a provider and a model name, or Hermes ignores it.
- Locked nightly jobs. They can't switch, so they fail.
- Looking for a quick switch in system settings. There isn't one. The backup list lives only in the Hermes settings file or the
hermes fallbackcommand.
Want to see how other owners handle this? Members of the AI Profit Boardroom bring their setups to the coaching calls each week.
My Verdict For Business Owners
Every business running Hermes for customer-facing work should have at least one backup model from a different provider.
Add it with one command, test it with the live check, and have the check run weekly.
Then check two things once a month: that the backup still answers, and that your overnight jobs aren't locked to a single model. Those two habits catch most problems before a customer ever does.
Leave the advanced options, such as per-job backups and the community plugin, until you have a reason to need them. If you want help mapping that out, get your Backlink Gameplan, or try Polar Rank free for 3 days.
FAQ: Hermes Agent Fallback Model
Do I need a developer to set up a backup model?
Not for the basics. Running hermes fallback add and following the menu is enough. Testing it on a schedule is easier with someone technical.
Will my customers see an error when the main model fails?
Not if a working backup is set. Hermes switches mid-reply and keeps the conversation, so the answer still arrives.
Does the backup stay on for the rest of the day?
No. Each new message tries the main model again, unless the main provider has said when it will be available.
Can my AI assistant run on my own computer with a cloud backup?
Yes. Set your own model as the main one through the custom option and add a cloud provider such as OpenRouter as the backup.
Does the backup see my customer conversations?
Yes. When it takes over it receives the conversation, so pick a provider you trust with that data.
Is there an official plugin for choosing backups?
No. Backups are built into Hermes. The model-fallback-heuristic plugin that fills them in automatically comes from a community developer.
📺 Video notes + links to the tools 👉
🎥 Learn how I make these videos 👉
🆓 Get a FREE AI Course + Community + 1,000 AI Agents 👉
About Julian
I'm Julian Goldie, an SEO entrepreneur, author and founder of the AI Profit Boardroom, which has 3,400+ members.
I help business owners scale with AI agents, automation and SEO.
- I've built a 7-figure SEO and link building agency, Goldie Agency, with a team of 70+ SEO experts.
- I've grown a YouTube channel to 400,000+ subscribers.
- I wrote "Link Building Mastery".
- My Udemy courses have taught over 29,000 students.
→ Get my best AI training inside the AI Profit Boardroom
Pick a backup from a different provider, test it, schedule the check, and if you want support, members of the AI Profit Boardroom get coaching calls, or you can get your Backlink Gameplan to plan your hermes agent fallback model, or try Polar Rank free for 3 days.











