Ask
197
@analogy_ada ·

five second test: four of six readers said my page "does automation" and that is not what it does

Showed the homepage to six people for five seconds each, then asked what the product does. Four said some version of "automates something", one said "analytics dashboard", one said "I did not read it, I looked at the screenshot".

The product schedules and confirms appointments for small clinics. The headline currently says "Stop losing hours to admin". Which, reading it now, could be literally any software ever made.

I get about 400 visits a month so I cannot A/B my way out of this. How do you actually fix a headline when you have no traffic to test with?

8 answers Share
Report

Answering anonymously — a moderator will review it first.

  • @stipend_sam · 4mo ago · 2 replies

    On the testing question specifically: at 400 visits a month you cannot run a copy test and you should stop feeling bad about it.

    A rough rule for how many visitors per variant you need is sixteen times p times one-minus-p, divided by the square of the difference you want to detect. If you convert at 2% and you want to be confident about a move to 3%, that is somewhere around three to four thousand visitors per variant. You would need most of a year and by then you would have changed six other things.

    So do qualitative until you have volume. Six five-second tests told you something real in an afternoon. Do twelve more with different people, change one thing, do twelve more. That loop is faster and more honest than a test you cannot power.

    174
    Share
    Reply

    Answering anonymously — a moderator will review it first.

    Report
    • @trace_tilly · 4mo ago

      And when you do have volume, test things that are big enough to matter. A headline rewrite that changes who the page is for can move conversion by a multiple. Swapping two adjectives moves it by an amount you will never be able to measure at any traffic level a solo product sees.

      66
      Share
      Reply

      Answering anonymously — a moderator will review it first.

      Report
  • @tripodwobble · 4mo ago · 2 replies

    Stop writing and go read. Open your support inbox, your sales call notes, and any message where someone described their own problem before you had explained yours. Pull out the literal phrases. People with your problem do not say "admin overhead", they say things like "we spend the first hour of every day ringing people to remind them".

    The headline is almost always already sitting in a customer's own sentence. Your job is to notice it, not to invent something better. "Stop losing hours to admin" is a category of feeling. "Confirm tomorrow's appointments without phoning anyone" is a thing that happens in a clinic on a Tuesday.

    Also put the word clinic on the page. Naming who it is for does more for a five second test than any verb you choose.

    208
    Share
    Reply

    Answering anonymously — a moderator will review it first.

    Report
    • @handy_orla · 4mo ago

      Naming the customer is underrated and it feels wrong to do because it seems to shrink your market. It does not shrink your market, it shrinks your bounce rate. The clinic manager who sees "for small clinics" reads the next line. Everyone else was never going to buy anyway.

      84
      Share
      Reply

      Answering anonymously — a moderator will review it first.

      Report
  • @abd_avery · 4mo ago

    Something that helped me more than any headline formula: write the sentence a happy customer would use to describe you to a colleague, out loud, in the pub. Mine came out as "it chases the people who owe you photos so you do not have to". I put almost exactly that on the page and my five second test answers went from "file sharing?" to people repeating the sentence back to me.

    The formulas produce headlines that sound like software. The pub sentence produces headlines that sound like a person.

    88
    Share
    Reply

    Answering anonymously — a moderator will review it first.

    Report
  • @stipend_sam · 4mo ago

    Mild disagreement with the whole exercise. Five second tests measure what a stranger with no problem remembers, and your buyer is not a stranger with no problem, they are someone who has just searched for a solution at eleven at night. Those two people read a page completely differently.

    Run the test with people who actually have the problem, even five of them, and the results will be less dramatic and more useful. When I did the generic version I got "it does automation" too, and it panicked me into writing a headline so specific it turned off everyone except one job title.

    131
    Share
    Reply

    Answering anonymously — a moderator will review it first.

    Report
  • @label_reader_lo · 4mo ago

    Say who it is for, what it does, and what changes. Three lines. If the screenshot is what people look at anyway, make the screenshot show the outcome rather than a settings screen.

    97
    Share
    Reply

    Answering anonymously — a moderator will review it first.

    Report
  • @printbed_gremlin · 4mo ago

    One more mechanical note since you mentioned the screenshot. Whatever image sits next to the headline is read first and it overrides the words. If the screenshot is a dense dashboard, people will say analytics no matter what the headline says. Crop it to the single screen that shows the confirmation going out.

    62
    Share
    Reply

    Answering anonymously — a moderator will review it first.

    Report