AI Income Desk Join AIPB

Hermes Agent Prompt Caching: What It Is, Why It Cuts Your AI Costs and How to Set It Up

A plain-English guide for owners who run Hermes in the business: what caching does, what quietly breaks it and how to check it in two minutes.

Julian Goldie — founder, AI Profit Boardroom
By Julian Goldie /8 min read
Get the AI Profit Stack Join AIPB →
  • 1,000+ done-for-you AI agent workflows
  • 5 live coaching calls / week with Julian
  • 7-day refund
  • 3,400+ AI operators inside

Hermes Agent prompt caching means your AI assistant does not pay to re-read the same long conversation from scratch every time you send it a new message.

Get the Backlink Gameplan →

Think of it like a receptionist who keeps the client file open on the desk instead of fetching it from the archive for every phone call.

According to the official Hermes documentation, caching trims input token costs by about 75% on chats with many turns.

Input tokens are the words the AI reads before it answers, so a long chat with your assistant gets much cheaper to keep going.

This guide covers what it is, when it works, how to set it up and what to avoid.

Why this matters for a small business

Most owners use Hermes for back-and-forth work: drafting emails, sorting leads, writing reports, checking data.

Each of those chats gets longer with every message.

Without caching, the AI provider reads the whole thing again on every reply, and you pay for that reading each time.

With caching, the old part of the chat is read from a stored copy at a much lower input cost.

If your team keeps one long working chat open all morning, this is the feature doing the saving.

For more ways owners put the assistant to work, see our guide to Hermes Agent for business.

Does it work with the AI model I use?

It switches on by itself when two things are true.

  • You are using a Claude model from Anthropic.
  • You connect to it through Anthropic directly or through OpenRouter.

If you use Nous Portal, Hermes checks the Nous model list to see which models should get caching.

Other providers can run their own caching, which Hermes keeps track of, but the setup described here is the Claude one.

There is no box to tick in Hermes to get it.

🔥 Want your AI assistant set up without surprise costs? Inside the AI Profit Boardroom business owners learn to run AI agents properly: plain video lessons, the Agent OS you can install, four coaching calls each week and 3,400+ members to ask. → Join the AI Profit Boardroom

How it works, without the jargon

Anthropic lets each request carry up to four "bookmarks" that say "you can reuse everything up to here".

Hermes puts the first bookmark on its standing instructions, the part that never changes.

It puts the other three on your three most recent messages, and moves them forward as the chat goes on.

The developers call this layout system_and_3, and you can read the code in prompt_caching.py on GitHub.

You never see the bookmarks; they are added to a copy of your chat just before it is sent.

Rank in AI Search or It's FREE →

How to set it up in three steps

  1. Update Hermes. Version 0.23.3, released on 20 November 2026, is the one with the improved cache handling.
  2. Open config.yaml. Look for a section called prompt_caching.
  3. Leave cache_ttl on auto. That is the default, so most owners change nothing.
prompt_caching:
  cache_ttl: "auto"

The full list of settings is in the configuration docs.

What the three settings mean

SettingWhat it doesGood for
autoHermes picks the time window for youAlmost every business
5mKeeps the stored copy for five minutesFast automated jobs only
1hKeeps the stored copy for one hourPeople who pause often

On auto, a chat with a person typing gets the one-hour window.

Automated work gets five minutes: scheduled cron jobs, webhooks, helper agents, kanban tasks, API calls, batch runs and similar.

That split makes sense because a script sends its next message within seconds, while a person may step away for a coffee.

If you schedule jobs, our Hermes cron job guide shows how those run.

Join the AI Profit Boardroom →

Five things that quietly break the cache

The stored copy only helps if the start of the chat is exactly the same as last time.

  1. Switching AI model mid-chat. Hermes ties the stored copy to the model, so the next reply starts from zero and re-reads everything at full input cost.
  2. A backup model taking over. If your main model fails and Hermes falls back to another one, the cache is lost the same way.
  3. Rotating to another account. When Hermes moves to a different login in its key pool, that account has no stored copy.
  4. Editing earlier messages. Changing or removing something in the middle invalidates everything after it.
  5. Walking away too long. When the time window runs out, the stored copy expires.

Simple habits that keep costs down

  • Choose the model at the start of the chat and keep it.
  • Set up instructions and skills first, then start the real work.
  • Start a fresh chat with /new for each new job.
  • Tell your team not to edit old messages in a long working chat.

Get the Backlink Gameplan →

A typical working day, with caching on

Picture an assistant that handles customer emails from 9 am.

The first message of the day is read in full, because nothing is stored yet.

Every reply after that reuses the stored start of the chat, so only the newest email is read at full input cost.

At lunch the chat sits idle; on auto it has the one-hour window, and warming keeps it alive for a while.

If someone switches the model at 2 pm to try a different one, the next reply starts cold and re-reads the whole morning.

That one habit change is the difference between a cheap afternoon and an expensive one.

Questions to ask whoever set up your Hermes

  • Which model and provider are we using, and is it Claude?
  • Is cache_ttl still on auto?
  • Do we have a backup model set, and how often does it kick in?
  • Are we rotating between several accounts or keys?
  • Do the scheduled jobs run in their own sessions?

Five yes-or-no answers tell you whether caching is doing its job.

What the 20 November update changed

The v0.23.3 release notes say Hermes now has one prompt-cache lifecycle controller.

  • It keeps the cache warm while a long tool job is running.
  • It shrinks idle chats before the one-hour window runs out.
  • Nous Portal users get the full one-hour treatment.
  • The setting now defaults to auto.

Four days earlier, v0.23.2 gave every chat a single cache timer.

A canary build on 19 November made sure a broken caching setting can no longer stop Hermes from starting.

What "warming" means

Warming is Hermes sending a tiny keep-alive so the stored copy does not expire while you are away.

It checks at five sixths of the time window and sends no more than three keep-alives for each message you send.

If the cache is missed for real twice, Hermes stops warming for the rest of that chat.

Rank in AI Search or It's FREE →

How to check it is working

  1. Type /context in a chat.
  2. Read the cache line it shows.
  3. If it says warming_off, the cache was missed twice in that chat.
  4. Type /new to start fresh, which resets warming.

Shrinking a long chat (compression) clears the cache for the shrunk part, but the instructions stay cached and normal caching returns within a turn or two.

Join the AI Profit Boardroom →

FAQ: Hermes Agent Prompt Caching for Business Owners

Do I need to switch Hermes prompt caching on?

No. If you use Claude through Anthropic or OpenRouter it is already on, and on Nous Portal the model list decides.

Why did my AI bill jump after changing models?

The stored copy belongs to one model. A switch, a fallback or a move to another account makes the next reply re-read the whole chat.

Which cache setting should a small business use?

Auto. It gives people one hour and automated jobs five minutes.

Does shrinking a long chat stop caching?

Only for the part that was shrunk. The standing instructions keep their stored copy, and savings come back after a turn or two.

How do I know if caching stopped working?

Type /context. If it shows warming_off, two real misses happened, and /new starts a fresh chat.

📺 Video notes + links to the tools 👉

🎥 Learn how I make these videos 👉

🆓 Get a FREE AI Course + Community + 1,000 AI Agents 👉

About Julian

I'm Julian Goldie, an SEO entrepreneur, author and founder of the AI Profit Boardroom, which has 3,400+ members.

I help business owners scale with AI agents, automation and SEO.

  • I've built a 7-figure SEO and link building agency, Goldie Agency, with a team of 70+ SEO experts.
  • I've grown a YouTube channel to 400,000+ subscribers.
  • I wrote "Link Building Mastery".
  • My Udemy courses have taught over 29,000 students.

→ Get my best AI training inside the AI Profit Boardroom

Update Hermes, leave the setting on auto and type /context during your next long working chat.

Get step-by-step help inside the AI Profit Boardroom, and come back here whenever you need a refresher on Hermes Agent prompt caching.

Member reviews · from Skool

What members say about the AI Profit Boardroom

Read the member reviews on Skool →
Ahmad Bukhari: Julian doesn't gatekeep. That's why I'd recommend this group. He's extremely active here, sharing what's working right now and jumping in to help anyone who's stuck. If he can give it away, he does. He keeps the vibe positive and pushes everyone to help each other. His challenges reward members for getting people unstuck, so the whole room shares knowledge, not just him. Want a generous, positive place to learn AI and actually use it? This is it. Thanks Julian!
Ahmad Bukhari
Julian doesn't gatekeep. That's why I'd recommend this group. He's extremely active here, sharing what's working right now and jumping in to help anyone who's stuck. If he can give it away, he does. He keeps the vibe positive and pushes everyone to help each other. His challenges reward members for getting people unstuck, so the whole room shares knowledge, not just him. Want a generous, positive place to learn AI and actually use it? This is it. Thanks Julian!

Still a paying member after 1 month

Jay Parsons: There are so many helpful members in this amazing community ready to help out with suggestions and solutions whenever someone asks a question. I am amazed at the progress I have made in learning AI. I came here to learn how to use AI better and apply what I learned to my business. I am learning so much more than I even dreamed of. I have built an Agentic OS and use it every day, and I have no background in coding. There are an incredible amount of useful tutorials on everything AI.
Jay Parsons
There are so many helpful members in this amazing community ready to help out with suggestions and solutions whenever someone asks a question. I am amazed at the progress I have made in learning AI. I came here to learn how to use AI better and apply what I learned to my business. I am learning so much more than I even dreamed of. I have built an Agentic OS and use it every day, and I have no background in coding. There are an incredible amount of useful tutorials on everything AI.

Still a paying member after 11 months

Brian O'Connor: At 47, with 30 years in sales and finance, embracing AI was exciting but overwhelming. While building a business to help others adopt AI, I found myself chasing tools and fearing I was falling behind. Julian and the AI Profit Boardroom helped me refocus through practical, personalized advice and a supportive community. I now feel more confident adapting to change while staying focused on my goals. Thank you, Julian, for bringing this community together!
Brian O'Connor
At 47, with 30 years in sales and finance, embracing AI was exciting but overwhelming. While building a business to help others adopt AI, I found myself chasing tools and fearing I was falling behind. Julian and the AI Profit Boardroom helped me refocus through practical, personalized advice and a supportive community. I now feel more confident adapting to change while staying focused on my goals. Thank you, Julian, for bringing this community together!

Still a paying member after 2 months

Neil Martin: This is a truly amazing community, thanks in no small part to Julian's prodigious output and tireless efforts to provide value to his subscribers. Nothing is too much trouble for him. If you ask a question it gets answered in short order usually with a custom video. I have been in quite a few groups and this level of service is unparalleled. If you are serious about getting an AI education, you need to be in this group!
Neil Martin
This is a truly amazing community, thanks in no small part to Julian's prodigious output and tireless efforts to provide value to his subscribers. Nothing is too much trouble for him. If you ask a question it gets answered in short order usually with a custom video. I have been in quite a few groups and this level of service is unparalleled. If you are serious about getting an AI education, you need to be in this group!

Still a paying member after 7 months

Crystal Hill: AIPB has inspired me to go beyond learning AI as individual tools, skills, and prompts, and start thinking in terms of larger systems. What I really appreciate is how responsive Julian is and how quickly the material evolves with the technology. You’re being exposed to the right tools and ideas as they emerge. AIPB has given me the confidence to learn, experiment, build, and think much bigger about what’s really possible with AI.
Crystal Hill
AIPB has inspired me to go beyond learning AI as individual tools, skills, and prompts, and start thinking in terms of larger systems. What I really appreciate is how responsive Julian is and how quickly the material evolves with the technology. You’re being exposed to the right tools and ideas as they emerge. AIPB has given me the confidence to learn, experiment, build, and think much bigger about what’s really possible with AI.

Still a paying member after 5 months

Maurice Morrison: AI Profit Board Room has been a game-changer. The insights are practical, timely, and focused on turning AI into real business results—not just theory or hype. The community is supportive, the guidance is clear, and I leave every session with ideas I can actually apply. If you’re serious about using AI to grow smarter and move faster, this is absolutely worth joining.
Maurice Morrison
AI Profit Board Room has been a game-changer. The insights are practical, timely, and focused on turning AI into real business results—not just theory or hype. The community is supportive, the guidance is clear, and I leave every session with ideas I can actually apply. If you’re serious about using AI to grow smarter and move faster, this is absolutely worth joining.

Still a paying member after 2 months

Jeremy Murdock: I have truly enjoyed my experience here. The group of folks on the calls is quite diverse and I find it comforting to know that I am not the only one going through the changes that are happening at a faster and faster pace. I have chosen to embrace the change and go full force into integrating AI and what I have learned form the group and Julian. I am also impressed and appreciative that he actually takes the time to help with challenges I have along the way and get involved personally!
Jeremy Murdock
I have truly enjoyed my experience here. The group of folks on the calls is quite diverse and I find it comforting to know that I am not the only one going through the changes that are happening at a faster and faster pace. I have chosen to embrace the change and go full force into integrating AI and what I have learned form the group and Julian. I am also impressed and appreciative that he actually takes the time to help with challenges I have along the way and get involved personally!

Still a paying member after 10 months

Michael Lovitch: I have been a part of a million ai groups in Skool for years now. They are all okay and have helped, but usually they get out of date and don't offer real service to help you through especially at the beginning. This group is different, Julian actually answers questions which is crazy! And although ai marketing moves at the speed of light, they stay current and actually help you keep up… Highly recommended!
Michael Lovitch
I have been a part of a million ai groups in Skool for years now. They are all okay and have helped, but usually they get out of date and don't offer real service to help you through especially at the beginning. This group is different, Julian actually answers questions which is crazy! And although ai marketing moves at the speed of light, they stay current and actually help you keep up… Highly recommended!

Still a paying member after 3 months

Hoebing Lo: I don't know of any other community that is as active and sharing. Julian is a star and he answers so many questions in lightning speed. If you want a great place to start with AI here it is. No question too simple. No workflow too complicated. The community is about action and results not education so if you are looking to win at AI then come for the ride of a lifetime!
Hoebing Lo
I don't know of any other community that is as active and sharing. Julian is a star and he answers so many questions in lightning speed. If you want a great place to start with AI here it is. No question too simple. No workflow too complicated. The community is about action and results not education so if you are looking to win at AI then come for the ride of a lifetime!

Still a paying member after 5 months

Darren Wagstaff: Very responsive... great personal support (not an ai chat bot). Very clear straight forward trainings in easy to understand actionable language. I'm in numerous Skool groups but this one has the most human and real community by far. No question gets ignored. You never fell like just another number. It's great to see so many members getting great results with Ai.
Darren Wagstaff
Very responsive... great personal support (not an ai chat bot). Very clear straight forward trainings in easy to understand actionable language. I'm in numerous Skool groups but this one has the most human and real community by far. No question gets ignored. You never fell like just another number. It's great to see so many members getting great results with Ai.

Still a paying member after 2 months

Rod Martin: Julian is brilliant, and more prolific than I can keep up with (which is a great thing). His AgentOS is remarkable, and he is THE go-to guy for what you can really do (and not do) with the ever-increasing deluge of new AI upgrades and tools. HIGHLY recommend.
Rod Martin
Julian is brilliant, and more prolific than I can keep up with (which is a great thing). His AgentOS is remarkable, and he is THE go-to guy for what you can really do (and not do) with the ever-increasing deluge of new AI upgrades and tools. HIGHLY recommend.

Still a paying member after 5 months

Yosuke Sato: The best Skool course you get for AI! I have attended a few Skool courses before, but AI Profit Boardroom is the most active community and has great support from the management team, including Julian! You can get the most up-to-date information and practical implementations in this community. I highly recommend this!
Yosuke Sato
The best Skool course you get for AI! I have attended a few Skool courses before, but AI Profit Boardroom is the most active community and has great support from the management team, including Julian! You can get the most up-to-date information and practical implementations in this community. I highly recommend this!

Still a paying member after 19 months

Your next move

Ready to build AI agents that actually make money?

Join 3,400+ entrepreneurs inside the AI Profit Boardroom. Get 1,000+ plug-and-play AI agent workflows, 5 live coaching calls a week, and a community that holds you accountable.

Join the AI Profit Boardroom →

7-day no-questions refund · Cancel anytime

Found this useful? Get more of this site in your Google.

One tap adds us as a preferred source — Google then shows you our posts more often in Search, Top Stories, and AI Overviews.

Or add us in your Google settings →

← Back to all posts