AI Income Desk Join AIPB

Hermes Agent Fallback Model: How To Keep Your Business AI Assistant Running When The Main Model Fails

A plain-English setup for owners: pick a backup, add it, test it, and keep your customer chats and overnight jobs alive through provider problems.

Julian Goldie — founder, AI Profit Boardroom
By Julian Goldie /8 min read
Get the AI Profit Stack Join AIPB →
  • 1,000+ done-for-you AI agent workflows
  • 5 live coaching calls / week with Julian
  • 7-day refund
  • 3,400+ AI operators inside

Setting up a hermes agent fallback model means giving your AI assistant a second brain from a different company, so when the first one goes down or hits its limit, the work your business relies on keeps moving.

Think of it like a spare phone line for your front desk. Customers never see the switch; they just get an answer.

This guide explains it in plain English, then walks through the setup with the steps from the official Hermes Fallback Providers guide.

If you'd rather talk it through with a person before you touch any settings, get your Backlink Gameplan with my team, or try Polar Rank free for 3 days.

What A Fallback Model Means For A Small Business

Hermes Agent talks to an AI model through a provider, such as OpenRouter, Anthropic or Nous Portal.

Providers have bad moments. They get busy, they go down for a while, a login expires, or you reach a usage limit.

Without a backup, the assistant just stops and shows an error. With one, Hermes quietly hands the job to the backup model and carries on.

Picture three everyday jobs:

  • A Telegram bot that answers customer questions about opening hours and bookings.
  • A nightly job that writes up yesterday's sales notes before you wake up.
  • An assistant your team uses all day to draft emails and quotes.

Each of those can keep running through a provider problem if a fallback is set.

Why The Main Model Stops Answering

The Hermes docs list the usual causes, and none of them are your fault:

  • Too many requests. The provider says slow down. Hermes retries a few times first.
  • The provider's servers struggle. Again, retries first, then the switch.
  • A login or key stops working. Hermes switches at once, because waiting won't fix it.
  • The model can't be found. Say it was renamed. Hermes switches at once.
  • Garbled or empty answers. If they keep coming, Hermes treats that as a failure too.

Step 1: Choose A Backup From A Different Company

This is the single most useful decision you'll make.

If your main model and your backup come from the same provider, one outage can knock out both. Pick the backup from a different provider.

Hermes supports a long list, from OpenRouter and Anthropic to Google AI Studio, Nous Portal and models running on your own computer. The providers page lists what each one needs.

Also think about privacy. When the backup takes over, it sees the conversation, so choose a provider you'd be happy sending that customer chat to.

Finally, check the backup can use tools. Hermes is an agent, so it needs a model that can call tools, look things up and run steps, not one that only chats.

Step 2: Add The Backup With One Command

On the computer where Hermes runs, open a terminal and type:

hermes fallback add

Hermes shows the same menu you used when you first picked a model. Choose the provider, sign in or paste its key, and pick the model.

That's it. Hermes saves your choice in its settings file, in a list called fallback_providers.

To see what you've set, type hermes fallback list. To take one out, use hermes fallback remove.

🔥 Want your AI assistant set up properly the first time? Inside the AI Profit Boardroom you get step-by-step video trainings, the installable Agent OS, four coaching calls a week and 3,400+ members running agents in their own businesses. → Join the AI Profit Boardroom

Step 3: Check The Backup Works Before You Need It

A backup you've never tested is a guess. Hermes now has a command that tests it for you, added in the 16 November 2026 release:

hermes fallback check --live

It sends one tiny message to each backup and tells you whether it answered. It doesn't start a chat and it never prints your keys.

If it says ready, you're covered. If it says auth, the login or key needs fixing. If it says model_mismatch, the model name is wrong.

If you run more than one assistant, each with its own profile, the check can test each profile in turn, so nothing slips through.

Ask whoever looks after your setup to run this check on a schedule, say once a week, so an expired key gets spotted on a quiet Tuesday rather than during a busy Saturday.

What Your Customers Notice When It Switches

Usually nothing. The docs say the conversation, the tools the assistant was using and everything it knew so far carry straight over.

The switch only lasts for that one reply. On the next message, Hermes tries your main model again.

There's one sensible exception: if the main provider has said "come back at 3pm", Hermes stays on the backup until then instead of knocking on a closed door.

The backup model may write in a slightly different style, which is one more reason to pick a good one rather than the first name on the list.

A Worked Example: The Booking Bot On A Busy Saturday

Say a small salon runs Hermes as a Telegram bot that answers booking questions, with OpenRouter as the main provider and Anthropic as the backup.

On Saturday morning OpenRouter starts returning "too many requests". Hermes retries a few times, then hands that one reply to the Anthropic model, and the customer gets their answer about free slots.

The next customer message goes to OpenRouter again. If it has recovered, life carries on as normal. If it hasn't, the backup steps in again for that reply.

Nobody at the salon had to notice, restart anything or change a setting.

Now imagine the same salon had picked a second OpenRouter model as the backup. The same busy spell would have hit both, and the bot would have gone quiet. That's why Step 1 matters so much.

Side Jobs Have Their Own Safety Net

Hermes uses smaller helper models for behind-the-scenes jobs: reading images, shortening long conversations, naming chats and checking risky commands.

By default these helpers try your main model first and then the same backup list you just set, so most businesses need to do nothing extra.

If one of those helpers is important to you, say, reading photos of invoices, the person who manages your setup can give it its own backup under auxiliary.vision in the settings.

And if the job that shortens long chats has no model at all, Hermes trims the middle of the conversation rather than crashing.

Keep Your Overnight Jobs Covered

Scheduled jobs, the ones that run while you sleep, use your backup list too, but only if they weren't locked to one specific model.

A job told to "always use this exact model" won't switch. If that model fails, the job fails.

So for the nightly sales summary, ask for the job's model to be set through the general scheduled-job settings rather than on the job itself. Our guide to Hermes scheduled jobs explains how those jobs are set up.

Keeping Costs Predictable

A backup keeps your assistant working, but it can also change what you pay, because you're now using a second provider.

  • Every switch makes the new model read the whole conversation again, since it has no memory saved from earlier turns.
  • Hermes doesn't yet ask "are you sure?" before moving to a paid backup. That feature is still an open proposal on GitHub (pull request #149020).
  • Some side jobs can only use providers you've actually chosen. Once you've picked a main provider, Hermes won't guess another account you happen to be logged into.

The practical answer: pick one backup you're comfortable using, and check your provider dashboards after the first busy week.

Run Your Own Model First, Cloud As The Backup

Some owners like to run a model on their own computer for everyday work and keep a cloud model only as the safety net.

Hermes supports that. Your own model becomes the main one through the custom setting, and a cloud provider such as OpenRouter goes in the backup list.

When your computer's model server is switched off or overloaded, the cloud backup picks up the conversation.

Your local model needs a big enough memory for agent work: Hermes asks for at least 64,000 tokens of context, as the providers page explains.

The Community Plugin That Picks Backups For You

There's also model-fallback-heuristic in the Hermes Marketplace. It's made by a community developer, tomkubik, not by Nous Research, and it's at version 0.2.0.

It looks at public model lists and fills in your backup list automatically, which helps people who rely on lots of free models.

For a small business with one main model and one trusted backup, it's usually more than you need. It changes your settings file on its own, so if you try it, have someone review what it writes.

📞 Not sure which backup suits your business? Get your Backlink Gameplan and my team will look at how you use your AI assistant and what should happen when it stalls, or try Polar Rank free for 3 days. Backlink Gameplan or try Polar Rank free for 3 days

Mistakes Small Teams Make

  • A backup from the same company. One outage, two dead models.
  • Never testing. The check takes seconds; skipping it means finding out during a rush.
  • Half-filled settings. A backup needs both a provider and a model name, or Hermes ignores it.
  • Locked nightly jobs. They can't switch, so they fail.
  • Looking for a quick switch in system settings. There isn't one. The backup list lives only in the Hermes settings file or the hermes fallback command.

Want to see how other owners handle this? Members of the AI Profit Boardroom bring their setups to the coaching calls each week.

My Verdict For Business Owners

Every business running Hermes for customer-facing work should have at least one backup model from a different provider.

Add it with one command, test it with the live check, and have the check run weekly.

Then check two things once a month: that the backup still answers, and that your overnight jobs aren't locked to a single model. Those two habits catch most problems before a customer ever does.

Leave the advanced options, such as per-job backups and the community plugin, until you have a reason to need them. If you want help mapping that out, get your Backlink Gameplan, or try Polar Rank free for 3 days.

FAQ: Hermes Agent Fallback Model

Do I need a developer to set up a backup model?

Not for the basics. Running hermes fallback add and following the menu is enough. Testing it on a schedule is easier with someone technical.

Will my customers see an error when the main model fails?

Not if a working backup is set. Hermes switches mid-reply and keeps the conversation, so the answer still arrives.

Does the backup stay on for the rest of the day?

No. Each new message tries the main model again, unless the main provider has said when it will be available.

Can my AI assistant run on my own computer with a cloud backup?

Yes. Set your own model as the main one through the custom option and add a cloud provider such as OpenRouter as the backup.

Does the backup see my customer conversations?

Yes. When it takes over it receives the conversation, so pick a provider you trust with that data.

Is there an official plugin for choosing backups?

No. Backups are built into Hermes. The model-fallback-heuristic plugin that fills them in automatically comes from a community developer.

📺 Video notes + links to the tools 👉

🎥 Learn how I make these videos 👉

🆓 Get a FREE AI Course + Community + 1,000 AI Agents 👉

About Julian

I'm Julian Goldie, an SEO entrepreneur, author and founder of the AI Profit Boardroom, which has 3,400+ members.

I help business owners scale with AI agents, automation and SEO.

  • I've built a 7-figure SEO and link building agency, Goldie Agency, with a team of 70+ SEO experts.
  • I've grown a YouTube channel to 400,000+ subscribers.
  • I wrote "Link Building Mastery".
  • My Udemy courses have taught over 29,000 students.

→ Get my best AI training inside the AI Profit Boardroom

Pick a backup from a different provider, test it, schedule the check, and if you want support, members of the AI Profit Boardroom get coaching calls, or you can get your Backlink Gameplan to plan your hermes agent fallback model, or try Polar Rank free for 3 days.

Member reviews · from Skool

What members say about the AI Profit Boardroom

Read the member reviews on Skool →
Ahmad Bukhari: Julian doesn't gatekeep. That's why I'd recommend this group. He's extremely active here, sharing what's working right now and jumping in to help anyone who's stuck. If he can give it away, he does. He keeps the vibe positive and pushes everyone to help each other. His challenges reward members for getting people unstuck, so the whole room shares knowledge, not just him. Want a generous, positive place to learn AI and actually use it? This is it. Thanks Julian!
Ahmad Bukhari
Julian doesn't gatekeep. That's why I'd recommend this group. He's extremely active here, sharing what's working right now and jumping in to help anyone who's stuck. If he can give it away, he does. He keeps the vibe positive and pushes everyone to help each other. His challenges reward members for getting people unstuck, so the whole room shares knowledge, not just him. Want a generous, positive place to learn AI and actually use it? This is it. Thanks Julian!

Still a paying member after 1 month

Jay Parsons: There are so many helpful members in this amazing community ready to help out with suggestions and solutions whenever someone asks a question. I am amazed at the progress I have made in learning AI. I came here to learn how to use AI better and apply what I learned to my business. I am learning so much more than I even dreamed of. I have built an Agentic OS and use it every day, and I have no background in coding. There are an incredible amount of useful tutorials on everything AI.
Jay Parsons
There are so many helpful members in this amazing community ready to help out with suggestions and solutions whenever someone asks a question. I am amazed at the progress I have made in learning AI. I came here to learn how to use AI better and apply what I learned to my business. I am learning so much more than I even dreamed of. I have built an Agentic OS and use it every day, and I have no background in coding. There are an incredible amount of useful tutorials on everything AI.

Still a paying member after 11 months

Brian O'Connor: At 47, with 30 years in sales and finance, embracing AI was exciting but overwhelming. While building a business to help others adopt AI, I found myself chasing tools and fearing I was falling behind. Julian and the AI Profit Boardroom helped me refocus through practical, personalized advice and a supportive community. I now feel more confident adapting to change while staying focused on my goals. Thank you, Julian, for bringing this community together!
Brian O'Connor
At 47, with 30 years in sales and finance, embracing AI was exciting but overwhelming. While building a business to help others adopt AI, I found myself chasing tools and fearing I was falling behind. Julian and the AI Profit Boardroom helped me refocus through practical, personalized advice and a supportive community. I now feel more confident adapting to change while staying focused on my goals. Thank you, Julian, for bringing this community together!

Still a paying member after 2 months

Neil Martin: This is a truly amazing community, thanks in no small part to Julian's prodigious output and tireless efforts to provide value to his subscribers. Nothing is too much trouble for him. If you ask a question it gets answered in short order usually with a custom video. I have been in quite a few groups and this level of service is unparalleled. If you are serious about getting an AI education, you need to be in this group!
Neil Martin
This is a truly amazing community, thanks in no small part to Julian's prodigious output and tireless efforts to provide value to his subscribers. Nothing is too much trouble for him. If you ask a question it gets answered in short order usually with a custom video. I have been in quite a few groups and this level of service is unparalleled. If you are serious about getting an AI education, you need to be in this group!

Still a paying member after 7 months

Crystal Hill: AIPB has inspired me to go beyond learning AI as individual tools, skills, and prompts, and start thinking in terms of larger systems. What I really appreciate is how responsive Julian is and how quickly the material evolves with the technology. You’re being exposed to the right tools and ideas as they emerge. AIPB has given me the confidence to learn, experiment, build, and think much bigger about what’s really possible with AI.
Crystal Hill
AIPB has inspired me to go beyond learning AI as individual tools, skills, and prompts, and start thinking in terms of larger systems. What I really appreciate is how responsive Julian is and how quickly the material evolves with the technology. You’re being exposed to the right tools and ideas as they emerge. AIPB has given me the confidence to learn, experiment, build, and think much bigger about what’s really possible with AI.

Still a paying member after 5 months

Maurice Morrison: AI Profit Board Room has been a game-changer. The insights are practical, timely, and focused on turning AI into real business results—not just theory or hype. The community is supportive, the guidance is clear, and I leave every session with ideas I can actually apply. If you’re serious about using AI to grow smarter and move faster, this is absolutely worth joining.
Maurice Morrison
AI Profit Board Room has been a game-changer. The insights are practical, timely, and focused on turning AI into real business results—not just theory or hype. The community is supportive, the guidance is clear, and I leave every session with ideas I can actually apply. If you’re serious about using AI to grow smarter and move faster, this is absolutely worth joining.

Still a paying member after 2 months

Jeremy Murdock: I have truly enjoyed my experience here. The group of folks on the calls is quite diverse and I find it comforting to know that I am not the only one going through the changes that are happening at a faster and faster pace. I have chosen to embrace the change and go full force into integrating AI and what I have learned form the group and Julian. I am also impressed and appreciative that he actually takes the time to help with challenges I have along the way and get involved personally!
Jeremy Murdock
I have truly enjoyed my experience here. The group of folks on the calls is quite diverse and I find it comforting to know that I am not the only one going through the changes that are happening at a faster and faster pace. I have chosen to embrace the change and go full force into integrating AI and what I have learned form the group and Julian. I am also impressed and appreciative that he actually takes the time to help with challenges I have along the way and get involved personally!

Still a paying member after 10 months

Michael Lovitch: I have been a part of a million ai groups in Skool for years now. They are all okay and have helped, but usually they get out of date and don't offer real service to help you through especially at the beginning. This group is different, Julian actually answers questions which is crazy! And although ai marketing moves at the speed of light, they stay current and actually help you keep up… Highly recommended!
Michael Lovitch
I have been a part of a million ai groups in Skool for years now. They are all okay and have helped, but usually they get out of date and don't offer real service to help you through especially at the beginning. This group is different, Julian actually answers questions which is crazy! And although ai marketing moves at the speed of light, they stay current and actually help you keep up… Highly recommended!

Still a paying member after 3 months

Hoebing Lo: I don't know of any other community that is as active and sharing. Julian is a star and he answers so many questions in lightning speed. If you want a great place to start with AI here it is. No question too simple. No workflow too complicated. The community is about action and results not education so if you are looking to win at AI then come for the ride of a lifetime!
Hoebing Lo
I don't know of any other community that is as active and sharing. Julian is a star and he answers so many questions in lightning speed. If you want a great place to start with AI here it is. No question too simple. No workflow too complicated. The community is about action and results not education so if you are looking to win at AI then come for the ride of a lifetime!

Still a paying member after 5 months

Darren Wagstaff: Very responsive... great personal support (not an ai chat bot). Very clear straight forward trainings in easy to understand actionable language. I'm in numerous Skool groups but this one has the most human and real community by far. No question gets ignored. You never fell like just another number. It's great to see so many members getting great results with Ai.
Darren Wagstaff
Very responsive... great personal support (not an ai chat bot). Very clear straight forward trainings in easy to understand actionable language. I'm in numerous Skool groups but this one has the most human and real community by far. No question gets ignored. You never fell like just another number. It's great to see so many members getting great results with Ai.

Still a paying member after 2 months

Rod Martin: Julian is brilliant, and more prolific than I can keep up with (which is a great thing). His AgentOS is remarkable, and he is THE go-to guy for what you can really do (and not do) with the ever-increasing deluge of new AI upgrades and tools. HIGHLY recommend.
Rod Martin
Julian is brilliant, and more prolific than I can keep up with (which is a great thing). His AgentOS is remarkable, and he is THE go-to guy for what you can really do (and not do) with the ever-increasing deluge of new AI upgrades and tools. HIGHLY recommend.

Still a paying member after 5 months

Yosuke Sato: The best Skool course you get for AI! I have attended a few Skool courses before, but AI Profit Boardroom is the most active community and has great support from the management team, including Julian! You can get the most up-to-date information and practical implementations in this community. I highly recommend this!
Yosuke Sato
The best Skool course you get for AI! I have attended a few Skool courses before, but AI Profit Boardroom is the most active community and has great support from the management team, including Julian! You can get the most up-to-date information and practical implementations in this community. I highly recommend this!

Still a paying member after 19 months

Your next move

Ready to build AI agents that actually make money?

Join 3,400+ entrepreneurs inside the AI Profit Boardroom. Get 1,000+ plug-and-play AI agent workflows, 5 live coaching calls a week, and a community that holds you accountable.

Join the AI Profit Boardroom →

7-day no-questions refund · Cancel anytime

Found this useful? Get more of this site in your Google.

One tap adds us as a preferred source — Google then shows you our posts more often in Search, Top Stories, and AI Overviews.

Or add us in your Google settings →

← Back to all posts