AI Income Desk Join AIPB

How To Use Hermes Agent Video Analysis In A Small Business: Three Plain-English Steps, Real Examples And The Risks

Three steps turn your recordings and YouTube videos into answers, transcripts and notes. Here is how each one works for a shop, a service firm or an agency, and what to watch for.

Julian Goldie — founder, AI Profit Boardroom
By Julian Goldie /10 min read
Get the AI Profit Stack Join AIPB →
  • 1,000+ done-for-you AI agent workflows
  • 5 live coaching calls / week with Julian
  • 7-day refund
  • 3,400+ AI operators inside

Hermes agent video analysis is set up in three plain steps for a small business: switch on the built-in video tool, use the bundled YouTube skill for videos that live on YouTube, and add the video-xray plugin when you have long recordings to break down.

Once it is running, your recordings come back as answers, transcripts and timestamped notes, instead of someone watching every minute by hand.

This page walks an owner through each step in plain English, with examples from a shop, a service firm and an agency, and the risks to check first.

If you'd like a second opinion on where video fits in your business, book a free SEO strategy session with my team.

How To Set It Up, In Plain English

Hermes Agent is the open AI agent from Nous Research, and it can read video three ways.

  1. Switch on the video tool. Ask whoever runs your Hermes setup to add the opt-in video toolset and an auxiliary AI model that can watch video. The Hermes tools reference says the tool, video_analyze, covers captions, scene breakdowns, key timestamps and visual descriptions.
  2. Use the YouTube skill for YouTube links. Type /youtube-content summarize followed by the link, and Hermes turns the video's transcript into a summary. The skill page lists summaries, threads and blog posts as outputs.
  3. Add video-xray for long recordings. A community developer added this plugin to the official catalog in the 15 November 2026 canary release. It turns a file into a structured report, a transcript you can import into editing software and a gallery of the frames it checked.

None of the three creates video.

If making new clips is the goal, read the Hermes Agent AI video generation guide instead.

Three Businesses, Three Ways To Use It

A local shop with product videos

A gift shop films short clips for social media.

Before posting, the owner asks video_analyze whether the price label is readable, which product appears first and whether any on-screen text is misspelled.

That is a quick question about a short file, which is what the built-in tool is made for.

A service firm with recorded training

A cleaning company records how-to videos for new staff.

The manager runs each recording through video-xray, exports the subtitle file for the video player, and saves the Markdown report as a written checklist next to it.

New hires can then search the notes instead of scrubbing through the footage.

A marketing agency reviewing client ads

An agency gets a folder of competitor and client ads every month.

The team uses video-xray's report sections on camera language and opening-versus-ending contrast to compare how each ad is built.

The plugin can also write a shot-by-shot prompt from a finished ad, which a creative team can adapt as a brief.

🔥 Want ready-made agent workflows for your own videos? Inside the AI Profit Boardroom you get training videos for every workflow, an Agent OS you install with Hermes already inside, coaching four times a week and 3,400+ members sharing what they automate. → Join the AI Profit Boardroom

Which Version Fits Which Business

Your situationBetter fitWhy
Videos already on YouTube/youtube-contentReads the transcript, no file download
Short clips, quick checksvideo_analyzeOne question, one answer, no extra install
Long recordings you reusevideo-xrayTime windows, transcripts, reports and exports
Team works on Mac or Linuxvideo_analyzevideo-xray is verified on Windows only
Footage is privatevideo-xray with a local modelFrames go to whichever chat model you choose
Videos arrive in a team chatvideo_analyzeThe gateway can cache clips and open them on request

What You Need Before You Start

For the built-in tool, three things.

  • A working Hermes Agent install.
  • The opt-in video toolset switched on, per the toolsets reference.
  • An auxiliary AI model that can watch video, because the Hermes source code sends every video to a separate video-capable model, with Gemini named as the example.

For video-xray, the plugin's catalog entry and README add a few more.

  • Hermes Desktop, version 0.22.1 or newer.
  • A Windows computer, since that is the only platform the catalog lists as verified.
  • ffmpeg, a free video tool, installed on that machine.
  • A chat model that can see images, local or cloud.

Nothing here needs a special plan from Nous Research.

The model provider you choose for the watching is where any usage charges come from, so check that provider's own terms.

When It Earns Its Place

It is worth it when a person on your team currently watches the same kinds of video over and over to pull out the same kinds of facts.

Think subtitle drafts, on-screen text checks, scene lists and meeting-style recaps of recorded training.

It is not worth it for a one-off video you will watch anyway, or for footage you are not allowed to send to an AI provider.

The built-in tool is the low-risk test: switching on a toolset and an auxiliary model is a small change you can undo.

If the answers it gives on your real clips are useful, the plugin is the next step for longer material.

A useful test is simple: if a summary or a subtitle draft from the agent means one fewer full viewing for someone on your team, the tool is doing a real job.

If your team still has to watch everything to check the answers, keep it for quick text and label checks only, and leave the long recordings to people for now.

Either result is useful, because it tells you where an AI agent belongs in your video work before you spend more setup time on it.

The Risks An Owner Should Know

Every catalog plugin must publish a security note, and video-xray's note is worth reading in full on its catalog entry.

  • Videos are analysed on send by default. Each attached video starts a job unless someone turns off "Analyze attached videos on send".
  • Frames leave the machine if your chat model is in the cloud. They go to whatever Hermes chat model you configured.
  • Audio can leave too. If you set a cloud transcription service, the audio goes there.
  • Transcription keys are not encrypted. Save a cloud key in the panel and it is kept as readable text, protected only by owner-only file permissions.
  • It is a community plugin. The catalog tier is community, and the maintainer is a third party, not Nous Research.

For staff recordings or customer footage, get consent first and keep the analysis on a local model where you can.

Hermes also blocks video links on domains in your website blocklist, which helps a business keep the agent off sites it should not fetch from.

📞 Not sure your footage should go to an AI model at all? Book a free SEO strategy session and talk it through with my team before anything is uploaded. → Book your free call

Summarising YouTube Videos With The Built-In Skill

A lot of business video already sits on YouTube: your own uploads, webinars, and competitors' explainers.

For those, the bundled youtube-content skill is the lightest route, because it reads the captions instead of the pictures.

Hermes treats every installed skill as a slash command, so a staff member types one line in the chat window or in a messaging app connected to Hermes.

Ask for a summary, a chapter list with timestamps, notable quotes, an X thread or a blog post draft, and the skill formats the transcript that way.

It needs a one-time setup step: the skill's helper relies on a youtube extra that has to be prepared in the Hermes environment, so ask whoever installed Hermes to do it once.

Its limit is simple: no captions, no result, and anything only shown on screen, such as a price on a product shot, is missed.

How Much Setup Effort To Expect

The built-in tool is a settings change: add video to your toolsets and set an auxiliary vision provider in config.yaml.

Someone comfortable editing a config file can do it in one sitting, and the YouTube skill's extra is a similar one-off job.

The plugin is a longer job, with three install steps in its README and optional speech engines on top; Whisper is the suggested start.

Videos That Arrive Through Chat

Many small businesses get video from customers over messaging apps, not as files on a desktop.

Hermes can sit behind those apps through its gateway.

The Telegram setup docs say a video posted in an observed group is cached first, and the agent opens it later only when someone asks about it.

That uses video_analyze when the video toolset is on.

The canary build also fixed Telegram so a comment and the video sent right after it are handled as one turn.

What It Won't Do For You

  • It won't edit or cut your videos.
  • It won't post anything to social media on its own.
  • The built-in tool won't take very large files; the source sets a cap of about 50 MB and warns that files over 20 MB may be slow.
  • The plugin won't run on a Mac or Linux machine as a verified setup.
  • Neither will make the judgment call on whether a video is good; it gives your team facts to decide with.

A Simple First-Week Rollout

Keep the first week small so you can judge it on your own material.

  1. Day one: switch on the video toolset and the auxiliary model, then ask one question about one short clip.
  2. Day two: pick five clips your team already reviews by hand and write down the questions they usually answer.
  3. Day three: run those same questions through video_analyze and compare the answers with what your team wrote.
  4. Day four: if you work on Windows and have long recordings, install video-xray and turn auto-analysis off straight away.
  5. Day five: run one training video or webinar through the workbench and export the subtitle file and the report.

At the end of the week you will know which tasks the agent handles well on your footage and which still need a person.

Write that down as a short internal rule, so the team knows which clips go to the agent and which do not.

Questions To Settle Before Staff Use It

  • Which videos are allowed to go to a cloud model, and which must stay on a local one?
  • Who owns the Hermes Desktop machine where video-xray runs, and who can see its job list?
  • Where do the exported reports and subtitle files get saved, and who checks them before they are shared?
  • Who removes the cloud transcription key if a staff member leaves?
  • Who keeps an eye on updates, since a community plugin changes on its maintainer's schedule?

None of these need a long policy.

A one-page note answering them keeps a helpful tool from becoming a privacy headache later.

Picking The Model Behind It

Model choice decides how well both routes see.

The Hermes vision docs list vision-capable families, including Claude with vision, Gemini and Qwen-VL, and name text-only ones such as DeepSeek V4 Pro.

A text-only model cannot be the one doing the watching in video-xray, because the plugin follows the chat model you are already using.

For the built-in tool, the auxiliary model has to accept video, which is why the Hermes error hint points at a Gemini model.

My Verdict For Small Business Owners

Switch on the built-in tool first and test it on five of your real clips.

If the answers save someone a viewing, move your long recordings to video-xray on a Windows machine, with auto-analysis off and a local model for anything private.

If the answers miss what matters, stop there: you have spent one afternoon finding out.

For the trainings and the ready-built Agent OS, join the AI Profit Boardroom.

Also On Our Network

FAQ: How To Use Hermes Agent Video Analysis In A Small Business

Can a small business use Hermes Agent to review its videos?

Yes. The built-in video_analyze tool answers questions about a clip, and the video-xray plugin turns longer recordings into transcripts and written reports.

Does Hermes Agent video analysis need a paid plan from Nous Research?

No plan from Nous is named in the docs for it. Usage charges, if any, come from the AI model provider you pick to watch the video.

Is it safe to analyse customer or staff videos?

Get consent first. Frames go to your chosen chat model and audio can go to a cloud transcription service, so use a local model for private footage.

Will it work on our office Macs?

The built-in tool runs wherever Hermes runs. The video-xray plugin is verified on Windows only, per its catalog entry.

Can Hermes summarise our YouTube videos?

Yes. The bundled youtube-content skill turns a YouTube transcript into a summary, chapters, quotes, a thread or a blog post draft. Type /youtube-content and the link.

Who supports the video-xray plugin?

Its maintainer, LuuMoss. The plugin sits in the community tier of the Hermes catalog, not among Nous Research's own plugins.

📺 Video notes + links to the tools 👉

🎥 Learn how I make these videos 👉

🆓 Get a FREE AI Course + Community + 1,000 AI Agents 👉

About Julian

I'm Julian Goldie, an SEO entrepreneur, author and founder of the AI Profit Boardroom, which has 3,400+ members.

I help business owners scale with AI agents, automation and SEO.

  • I've built a 7-figure SEO and link building agency, Goldie Agency, with a team of 70+ SEO experts.
  • I've grown a YouTube channel to 400,000+ subscribers.
  • I wrote "Link Building Mastery".
  • My Udemy courses have taught over 29,000 students.

→ Get my best AI training inside the AI Profit Boardroom

Test five real clips this week, decide from what comes back, and book a free SEO strategy session or join the AI Profit Boardroom if you want help putting hermes agent video analysis to work in your business.

Member wins · screenshots

Real wins from inside the AI Profit Boardroom

See all 3,400+ members →
AIPB member win screenshot 1 AIPB member win screenshot 2 AIPB member win screenshot 3 AIPB member win screenshot 4 AIPB member win screenshot 5 AIPB member win screenshot 6 AIPB member win screenshot 7 AIPB member win screenshot 8 AIPB member win screenshot 9 AIPB member win screenshot 10 AIPB member win screenshot 11 AIPB member win screenshot 12

Your next move

Ready to build AI agents that actually make money?

Join 3,400+ entrepreneurs inside the AI Profit Boardroom. Get 1,000+ plug-and-play AI agent workflows, 5 live coaching calls a week, and a community that holds you accountable.

Join the AI Profit Boardroom →

7-day no-questions refund · Cancel anytime

Found this useful? Get more of this site in your Google.

One tap adds us as a preferred source — Google then shows you our posts more often in Search, Top Stories, and AI Overviews.

Or add us in your Google settings →

← Back to all posts