Check out my first LIVE CASE STUDY and watch me build a 300,000+ page site! I show everything – domain, Google analytics, SEO strategy...

The Man Who Sold the Web Blog | Category Archive | AEO


Archive | AEO RSS feed for this section

The HiBot AI Visibility Question Set Is Now Free: See Exactly What Your Customers Ask AI about You

15 Sep

In July, I wrote up the HiBot AI visibility audit here, the human-run report that shows you what ChatGPT, Perplexity, and Google actually say about your brand when a customer asks. It landed, and the most common reply was the same every time: can I see something before I pay?

Now you can. The first step of the whole process, the question set, is free. No account, no card, about 30 seconds.

Quick reminder of why this matters, then the free part.

You Are Being Judged in a Conversation You Cannot See

Ten years ago your customer opened Google, typed a query, and clicked around. You watched it in Analytics and bid on the keyword. That path is closing. In 2024, 25% of people started their purchase research on a standalone AI platform. By 2026 it is 46%, now ahead of search, in a survey of 2,650 US consumers by L.E.K. Consulting.

Here is the part that should bother you. The AI hands back one short answer. If your brand is not in it, you got skipped in a sales conversation you never saw. No impression report, no click log, nothing in Analytics.

You cannot fix what you have never looked at. So look.

The New Free Part: Your AI Visibility Question Set

Every HiBot audit starts by building the questions a real customer in your market would actually ask an AI about you and your competitors. That question set is now free to generate for any brand.

Here is the whole thing:

  1. Go to hibot.com.
  2. Type in your website. HiBot reads your homepage and works out what you sell and who you compete with.
  3. You get your first 10 questions on the spot. Drop in an email and the other 40 unlock, and the full 50 land in your inbox. The ANSWER whitepaper comes with them.

No sign-up, no credit card, no sales call. If it reads your market wrong, a competitor you never think about or a category you do not serve, fix it and regenerate once.

The questions are spread across the 6 things an AI decides about you, the ANSWER framework: whether it names you at all (Appearance), whether it recommends you for a specific job (Nomination), how you do head to head (Showdown), whether it gets your price right (Worth), whether it describes you accurately (Expertise), and whether it reflects your reputation fairly (Reputation). The full method is in the ANSWER whitepaper.

I pointed it at my own company, Flevy, and the first question it handed back did not mention Flevy at all: “Where can I find business frameworks and PowerPoint templates for strategy and transformation?” That is the whole point. That is how people shop now. They describe the need, not the brand, and whether the AI names you in that answer is the entire game. Another question set us head to head with a competitor I would not have thought to watch. You learn something in the first 30 seconds, before you have collected a single answer.

Then You Have Two Choices

Once you have your 50 questions, you get the answers one of two ways.

Do it yourself. Open a fresh, logged-out session for every question, in the right geography, on every engine you care about, and record what comes back word for word. Do not check your own logged-in ChatGPT. It knows you and flatters you, and that is not what your customer sees. Then score each answer. It is free, and it is real work: the 25-question Pulse set is about 12 hours, and the full Panorama, 50 questions across 5 engines twice each, is 500 prompts and closer to 38 hours. Then you redo it every quarter as the models change.

Or hand the set to HiBot. Human specialists run every question under those neutral conditions and score them, and you get a full report instead of a folder of screenshots. Run by people, not scraped by a bot, which is the whole reason the numbers hold up.

What the Paid Audit Gets You

Two options:

  • HiBot Pulse, $199. Your 25 questions on ChatGPT, Perplexity, and Google, one run each. Saves you around 12 hours.
  • HiBot Panorama, $499. All 50 on 5 engines, adding Claude and Grok, twice each, with Share of Voice against your competitors. Saves you around 38 hours.

Run either monthly or quarterly at 20% off to track the number over time. Every audit carries a 30-day money-back guarantee and lands within 1 to 2 business days.

The report itself includes:

  • Your HiBot Score, A to F across the 6 ANSWER dimensions, plus citation and accuracy rates.
  • Competitive Standing and Share of Voice: who AI names instead of you, and how often.
  • Claims AI States as Fact: every claim the engines assert about you, checked against your own site and sorted into flat model errors, your own words repeated back, and third-party figures.
  • An Impact-Effort matrix and a tracked 90-day roadmap with score targets, built on real engine quotes.
  • Audits in your customer’s language, 26 of them, generated natively.
  • Word, PDF, and CSV exports, plus white-label reports if you are an agency or consultant running this for clients.
  • Plenty more where that came from.

See a Real One First

HiBot publishes full audits on brands you know, which is the closest thing to seeing what you are buying before you buy it. A few worth a look:

  • Costco, 93/100. Perfect reputation, and Google still invents a warranty and loses recommendations to Sam’s Club in categories Costco should own. Full report.
  • American Express, 82/100. Perfect on expertise, last in nearly every head to head. Full report.
  • Marriott, 80/100. Loses in price and value. Full report.

FAQs

Is the question set actually free?

Yes. Ten questions with nothing at all, not even an email. The other 40 open when you drop in an email, and the whole set gets sent to you. No card, ever.

Do I have to buy an audit?

No. Plenty of people take their 50 questions, run a handful themselves, learn something uncomfortable, and stop there. That is a fine outcome. The paid audit is for when you want the whole thing done right and scored.

Then why give the questions away?

Because the questions are not the hard part. Generating them is automated. The hard part is the human-run capture: hundreds of prompts asked logged-out, in the right geo, recorded and scored by a person. Handing you the questions shows you exactly what that work is.

Is the free set the same questions the paid audit uses?

Yes. Pulse runs 25 of them, Panorama runs all 50, and you can edit, add, or swap any of them before it starts. Nothing gets regenerated behind your back.

Does it scan or score my website?

No. It reads your homepage once, only to guess your brand details so you do not have to type them. The audit measures the AI engines, not your site.

The Take

Basically every market now is one where customers ask AI to compare their options, which means a paragraph you have never read is out there deciding your deals. The question set costs nothing and takes 30 seconds. Go get yours, read it, and at a minimum you will know what you are up against.

Get your free question set at hibot.com.

Introducing the HiBot AI Visibility Audit Service: Discover what AI is (and isn’t) telling customers about you

29 Jul

If you sell anything online, most of your customer research now happens somewhere you can’t see.

Ten years ago, a shopper opened Google, typed a query, and clicked around. You could watch that behavior in Analytics. You could bid on the keyword. You could rank a page and, if you did the work, you’d get the click.

That path is closing fast. ChatGPT now reaches more than 800 million people a week, roughly 1 in 10 adults on the planet. In an early-2025 survey, 58% of consumers said they had already replaced traditional search engines with generative AI for product and service recommendations. Gartner expects traditional search volume to drop 25% by 2026, and that estimate is before Claude, Perplexity, Gemini, and Grok get counted.

When someone wants a recommendation now, they open one of those apps and ask. The AI reads what it thinks it knows about the category and gives a one-paragraph answer. Your customer reads that paragraph. Then they decide.

You have no idea what that paragraph says.

The Real Problem with Being Invisible to AI

I’ve been testing this on my own brands for months and I keep seeing the same three failure modes.

The engine skips you. A shopper asks “what’s the best CRM for a solo freelancer” and ChatGPT lists five products. You’re not one of them. You spent years ranking for that phrase. It doesn’t matter anymore because your customer never saw the SERP.

The engine picks your competitor. You appear, but the AI recommends the rival. When the shopper asks “Brand X vs Brand Y for a small agency,” the answer confidently picks the other one, sometimes for reasons that aren’t even true.

The engine invents things. This one gets me. The AI states, as fact, that your product doesn’t do a thing it actually does. Or it quotes a price that’s wrong. Or it mentions a product line you don’t sell. The customer reads it, believes it, and closes the tab.

None of it shows up in your Analytics. There’s no impression report, no click log, no bid you can raise. The conversation happens, a decision gets made, and you never see it.

Why You Want to Know What AI Is Saying

Before you can fix any of the above, you need a baseline. What does each AI engine actually say when a real customer asks about your market? Where do you appear, where do you get skipped, which of your competitors gets the win, and where is the AI just making things up?

That is what a HiBot.com AI visibility audit gives you. Trained specialists run a set of customer-language questions through the major AI engines, by hand, in clean neutral sessions, and hand you back a scored report with a prioritized fix list.  Yes, these AI audit specialists are humans, not bots or scrapers.

I’m going to walk through how it works, what you get, and what it costs. I’ve been using these on my own properties and it’s the closest thing I’ve found to Google Search Console for the AI era.

Why You Can’t Just Check ChatGPT Yourself

The obvious move is to open ChatGPT, type a question about your brand, and see what comes back. Do not trust the answer.

The engine remembers you. It knows your history, your prior chats, your account. It will hand you a flattering, personalized response no prospective customer would ever get. If you’re logged in on your own machine, you are not seeing what your market sees.

The neutral answer, the one your customer actually reads, requires a fresh logged-out session, in the right geography, with no prior context. You also need it across multiple engines, because a brand can be strong in ChatGPT and completely absent from Perplexity. And you need a lot of questions. One question is a lucky screenshot, not a baseline.

A HiBot Panorama audit runs 50 questions across 5 engines, twice each. That’s 500 separate answers, each opened in its own clean session, geo-targeted, and captured word for word. Doing it by hand runs somewhere around 20 to 40 hours of skilled work, and it has to be redone every quarter as the models change.

This is why almost no one runs a real one on themselves.

The HiBot Process

The audit runs in 4 phases. Nothing exotic. The value is in the discipline.

Phase 1: Question design. HiBot builds a tailored question set in your customer’s own language, across 6 categories that map to how customers actually decide. Questions are weighted toward whether you appear at all, and whether you win in direct comparisons, because those move outcomes the most.

Phase 2: Neutral collection. A human specialist asks every question by hand under 5 rules: logged out, fresh chat per question, in your target geography, across every engine in your tier, and captured verbatim.

Phase 3: Scoring. The captured text is scored with a framework called ANSWER, which produces a 0 to 100 HiBot Score and a plain-language band from Dominant to Invisible. Any answer with a factual error gets capped, so a brand can’t rack up points on questions where the AI is confidently wrong about it.

Phase 4: The report. You get a detailed writeup. Your score. The category-by-category and engine-by-engine breakdown. Every question with the actual answer the AI gave. And a ranked list of what to fix first.

The Two Plans

There are two tiers. The choice mostly comes down to how deep you need to look and how many engines matter for your buyer.

Pulse is the right starting point for most solo operators and small brands. It answers “am I invisible, am I being misrepresented, and who is AI picking instead of me” for under $200. If the audit surfaces something serious, or your buyer skews toward Claude or Grok, Panorama gives you the full picture.

Both plans are one-time purchases. No subscription. No seat license. No minimum term.

Real Reports on Brands You Know

HiBot publishes full sample audits on real brands, which is the closest you’ll get to seeing exactly what you’re buying before you buy it. Two worth downloading:

Costco. Scored 93/100. A dominant brand with a perfect reputation score. It also has Google confidently stating false warranty and membership pricing claims as fact, and losing recommendations to Sam’s Club in categories Costco should own. Full report here.

Oura Ring. Scored 92/100. Another “dominant” brand on the headline number. The audit found 4 products the AI invented that don’t exist, plus features and stats fabricated and stated as fact. Full report here.

Both are the exact format you receive when you order your own. If you’re on the fence, read one before you buy.

FAQs

Isn’t this just SEO with a new coat of paint?

No. Traditional SEO ranks a page in a list. AI visibility work shapes what a single generated paragraph says about you. Different mechanic, different levers, different measurement. The overlap is that both start with the same question: what does the customer actually see?

Can I just run the audit myself with a scraping tool?

You can try. The honest answer is that scrapers get flagged, the sessions aren’t neutral, the geo is wrong, and you can’t easily capture the sourced citations. You’ll end up with data that looks like an audit but doesn’t hold up to a second look. The specialist-run process is the point.

How often should I re-run it?

Every model update can shift your score. Quarterly is a reasonable cadence for most brands. If you’re actively working on your AI visibility, monthly makes sense so you can tell whether the work is moving the number.

What do I actually do with the report?

The report ships with a prioritized action list. It usually points at two or three levers: fixing content the AI is misreading, correcting a claim that shows up in multiple engines’ training data, and shoring up third-party sources the models cite. It’s not a black box, and the fixes are usually concrete.

How long does an audit take to deliver?

The site doesn’t publish a firm SLA. In practice, expect around a week for Pulse and roughly two weeks for Panorama, since Panorama is 10x the raw data collection.

Is this useful for a service business, or only for products?

Both. The audit works anywhere a customer would ask an AI “who should I hire for X” or “which platform is best for Y.” I’ve seen it used on SaaS, consulting firms, ecommerce, and local service businesses.

Do I need to be a big brand for this to be worth it?

The opposite. Big brands already have a team watching this. Small operators are the ones getting quietly skipped or misrepresented, and they’re the ones who can move the needle fastest once they see the report.

The Take

If you’re selling into a market where customers use AI to compare options, and that’s basically every market at this point, you need a baseline of what those engines are telling them. Guessing doesn’t work. Checking your own logged-in ChatGPT is worse than guessing, because it flatters you.

Two hundred bucks for a real read on where you stand is a rounding error against what it costs to keep marketing into a customer conversation you can’t see. Whether you go with HiBot or somebody else, do the audit. Then decide.

Get your HiBot audit here.


| TheManWhoSoldtheWeb.com

I'll send you an email when there's exclusive or important news. Subscribe below.

© Copyright 2011-2026.   TheManWhoSoldtheWeb.com