Hermes agent video analysis is set up in three plain steps for a small business: switch on the built-in video tool, use the bundled YouTube skill for videos that live on YouTube, and add the video-xray plugin when you have long recordings to break down.
Once it is running, your recordings come back as answers, transcripts and timestamped notes, instead of someone watching every minute by hand.
This page walks an owner through each step in plain English, with examples from a shop, a service firm and an agency, and the risks to check first.
If you'd like a second opinion on where video fits in your business, book a free SEO strategy session with my team.
How To Set It Up, In Plain English
Hermes Agent is the open AI agent from Nous Research, and it can read video three ways.
- Switch on the video tool. Ask whoever runs your Hermes setup to add the opt-in
videotoolset and an auxiliary AI model that can watch video. The Hermes tools reference says the tool,video_analyze, covers captions, scene breakdowns, key timestamps and visual descriptions. - Use the YouTube skill for YouTube links. Type
/youtube-content summarizefollowed by the link, and Hermes turns the video's transcript into a summary. The skill page lists summaries, threads and blog posts as outputs. - Add video-xray for long recordings. A community developer added this plugin to the official catalog in the 15 November 2026 canary release. It turns a file into a structured report, a transcript you can import into editing software and a gallery of the frames it checked.
None of the three creates video.
If making new clips is the goal, read the Hermes Agent AI video generation guide instead.
Three Businesses, Three Ways To Use It
A local shop with product videos
A gift shop films short clips for social media.
Before posting, the owner asks video_analyze whether the price label is readable, which product appears first and whether any on-screen text is misspelled.
That is a quick question about a short file, which is what the built-in tool is made for.
A service firm with recorded training
A cleaning company records how-to videos for new staff.
The manager runs each recording through video-xray, exports the subtitle file for the video player, and saves the Markdown report as a written checklist next to it.
New hires can then search the notes instead of scrubbing through the footage.
A marketing agency reviewing client ads
An agency gets a folder of competitor and client ads every month.
The team uses video-xray's report sections on camera language and opening-versus-ending contrast to compare how each ad is built.
The plugin can also write a shot-by-shot prompt from a finished ad, which a creative team can adapt as a brief.
🔥 Want ready-made agent workflows for your own videos? Inside the AI Profit Boardroom you get training videos for every workflow, an Agent OS you install with Hermes already inside, coaching four times a week and 3,400+ members sharing what they automate. → Join the AI Profit Boardroom
Which Version Fits Which Business
| Your situation | Better fit | Why |
|---|---|---|
| Videos already on YouTube | /youtube-content | Reads the transcript, no file download |
| Short clips, quick checks | video_analyze | One question, one answer, no extra install |
| Long recordings you reuse | video-xray | Time windows, transcripts, reports and exports |
| Team works on Mac or Linux | video_analyze | video-xray is verified on Windows only |
| Footage is private | video-xray with a local model | Frames go to whichever chat model you choose |
| Videos arrive in a team chat | video_analyze | The gateway can cache clips and open them on request |
What You Need Before You Start
For the built-in tool, three things.
- A working Hermes Agent install.
- The opt-in
videotoolset switched on, per the toolsets reference. - An auxiliary AI model that can watch video, because the Hermes source code sends every video to a separate video-capable model, with Gemini named as the example.
For video-xray, the plugin's catalog entry and README add a few more.
- Hermes Desktop, version 0.22.1 or newer.
- A Windows computer, since that is the only platform the catalog lists as verified.
- ffmpeg, a free video tool, installed on that machine.
- A chat model that can see images, local or cloud.
Nothing here needs a special plan from Nous Research.
The model provider you choose for the watching is where any usage charges come from, so check that provider's own terms.
When It Earns Its Place
It is worth it when a person on your team currently watches the same kinds of video over and over to pull out the same kinds of facts.
Think subtitle drafts, on-screen text checks, scene lists and meeting-style recaps of recorded training.
It is not worth it for a one-off video you will watch anyway, or for footage you are not allowed to send to an AI provider.
The built-in tool is the low-risk test: switching on a toolset and an auxiliary model is a small change you can undo.
If the answers it gives on your real clips are useful, the plugin is the next step for longer material.
A useful test is simple: if a summary or a subtitle draft from the agent means one fewer full viewing for someone on your team, the tool is doing a real job.
If your team still has to watch everything to check the answers, keep it for quick text and label checks only, and leave the long recordings to people for now.
Either result is useful, because it tells you where an AI agent belongs in your video work before you spend more setup time on it.
The Risks An Owner Should Know
Every catalog plugin must publish a security note, and video-xray's note is worth reading in full on its catalog entry.
- Videos are analysed on send by default. Each attached video starts a job unless someone turns off "Analyze attached videos on send".
- Frames leave the machine if your chat model is in the cloud. They go to whatever Hermes chat model you configured.
- Audio can leave too. If you set a cloud transcription service, the audio goes there.
- Transcription keys are not encrypted. Save a cloud key in the panel and it is kept as readable text, protected only by owner-only file permissions.
- It is a community plugin. The catalog tier is community, and the maintainer is a third party, not Nous Research.
For staff recordings or customer footage, get consent first and keep the analysis on a local model where you can.
Hermes also blocks video links on domains in your website blocklist, which helps a business keep the agent off sites it should not fetch from.
📞 Not sure your footage should go to an AI model at all? Book a free SEO strategy session and talk it through with my team before anything is uploaded. → Book your free call
Summarising YouTube Videos With The Built-In Skill
A lot of business video already sits on YouTube: your own uploads, webinars, and competitors' explainers.
For those, the bundled youtube-content skill is the lightest route, because it reads the captions instead of the pictures.
Hermes treats every installed skill as a slash command, so a staff member types one line in the chat window or in a messaging app connected to Hermes.
Ask for a summary, a chapter list with timestamps, notable quotes, an X thread or a blog post draft, and the skill formats the transcript that way.
It needs a one-time setup step: the skill's helper relies on a youtube extra that has to be prepared in the Hermes environment, so ask whoever installed Hermes to do it once.
Its limit is simple: no captions, no result, and anything only shown on screen, such as a price on a product shot, is missed.
How Much Setup Effort To Expect
The built-in tool is a settings change: add video to your toolsets and set an auxiliary vision provider in config.yaml.
Someone comfortable editing a config file can do it in one sitting, and the YouTube skill's extra is a similar one-off job.
The plugin is a longer job, with three install steps in its README and optional speech engines on top; Whisper is the suggested start.
Videos That Arrive Through Chat
Many small businesses get video from customers over messaging apps, not as files on a desktop.
Hermes can sit behind those apps through its gateway.
The Telegram setup docs say a video posted in an observed group is cached first, and the agent opens it later only when someone asks about it.
That uses video_analyze when the video toolset is on.
The canary build also fixed Telegram so a comment and the video sent right after it are handled as one turn.
What It Won't Do For You
- It won't edit or cut your videos.
- It won't post anything to social media on its own.
- The built-in tool won't take very large files; the source sets a cap of about 50 MB and warns that files over 20 MB may be slow.
- The plugin won't run on a Mac or Linux machine as a verified setup.
- Neither will make the judgment call on whether a video is good; it gives your team facts to decide with.
A Simple First-Week Rollout
Keep the first week small so you can judge it on your own material.
- Day one: switch on the video toolset and the auxiliary model, then ask one question about one short clip.
- Day two: pick five clips your team already reviews by hand and write down the questions they usually answer.
- Day three: run those same questions through
video_analyzeand compare the answers with what your team wrote. - Day four: if you work on Windows and have long recordings, install video-xray and turn auto-analysis off straight away.
- Day five: run one training video or webinar through the workbench and export the subtitle file and the report.
At the end of the week you will know which tasks the agent handles well on your footage and which still need a person.
Write that down as a short internal rule, so the team knows which clips go to the agent and which do not.
Questions To Settle Before Staff Use It
- Which videos are allowed to go to a cloud model, and which must stay on a local one?
- Who owns the Hermes Desktop machine where video-xray runs, and who can see its job list?
- Where do the exported reports and subtitle files get saved, and who checks them before they are shared?
- Who removes the cloud transcription key if a staff member leaves?
- Who keeps an eye on updates, since a community plugin changes on its maintainer's schedule?
None of these need a long policy.
A one-page note answering them keeps a helpful tool from becoming a privacy headache later.
Picking The Model Behind It
Model choice decides how well both routes see.
The Hermes vision docs list vision-capable families, including Claude with vision, Gemini and Qwen-VL, and name text-only ones such as DeepSeek V4 Pro.
A text-only model cannot be the one doing the watching in video-xray, because the plugin follows the chat model you are already using.
For the built-in tool, the auxiliary model has to accept video, which is why the Hermes error hint points at a Gemini model.
My Verdict For Small Business Owners
Switch on the built-in tool first and test it on five of your real clips.
If the answers save someone a viewing, move your long recordings to video-xray on a Windows machine, with auto-analysis off and a local model for anything private.
If the answers miss what matters, stop there: you have spent one afternoon finding out.
For the trainings and the ready-built Agent OS, join the AI Profit Boardroom.
Also On Our Network
- 🌐 The step-by-step setup for video_analyze, the YouTube skill and the video-xray workbench
- 🌐 The three ways to analyze video in Hermes, compared in one table
- 🌐 A step-by-step setup of Hermes video analysis inside an Agent OS profile
- 🌐 How to set up Hermes video analysis, with a short note on the model behind it
- 🌐 The complete Hermes Agent video analysis guide on AI Profit Boardroom
FAQ: How To Use Hermes Agent Video Analysis In A Small Business
Can a small business use Hermes Agent to review its videos?
Yes. The built-in video_analyze tool answers questions about a clip, and the video-xray plugin turns longer recordings into transcripts and written reports.
Does Hermes Agent video analysis need a paid plan from Nous Research?
No plan from Nous is named in the docs for it. Usage charges, if any, come from the AI model provider you pick to watch the video.
Is it safe to analyse customer or staff videos?
Get consent first. Frames go to your chosen chat model and audio can go to a cloud transcription service, so use a local model for private footage.
Will it work on our office Macs?
The built-in tool runs wherever Hermes runs. The video-xray plugin is verified on Windows only, per its catalog entry.
Can Hermes summarise our YouTube videos?
Yes. The bundled youtube-content skill turns a YouTube transcript into a summary, chapters, quotes, a thread or a blog post draft. Type /youtube-content and the link.
Who supports the video-xray plugin?
Its maintainer, LuuMoss. The plugin sits in the community tier of the Hermes catalog, not among Nous Research's own plugins.
📺 Video notes + links to the tools 👉
🎥 Learn how I make these videos 👉
🆓 Get a FREE AI Course + Community + 1,000 AI Agents 👉
About Julian
I'm Julian Goldie, an SEO entrepreneur, author and founder of the AI Profit Boardroom, which has 3,400+ members.
I help business owners scale with AI agents, automation and SEO.
- I've built a 7-figure SEO and link building agency, Goldie Agency, with a team of 70+ SEO experts.
- I've grown a YouTube channel to 400,000+ subscribers.
- I wrote "Link Building Mastery".
- My Udemy courses have taught over 29,000 students.
→ Get my best AI training inside the AI Profit Boardroom
Test five real clips this week, decide from what comes back, and book a free SEO strategy session or join the AI Profit Boardroom if you want help putting hermes agent video analysis to work in your business.











