Ask
341
@iris_tanaka ·

ga4 says 912 users, plausible says 1,430 visitors, my database says 274 signups - which number do i plan with

Same month, same site. The two analytics tools are 36% apart and I can't reconcile them. My own database is the only thing I'd swear to, but it only knows about people who signed up, so it can't give me a conversion rate.

If I use the higher number my conversion rate looks terrible. If I use the lower one it looks fine. I've been quietly picking whichever supports the decision I already wanted to make, which I've noticed about myself and am not proud of.

How do you actually run a funnel when the top of it is a guess?

9 answers Share
Report

Answering anonymously — a moderator will review it first.

  • @yaml_yuri · 6mo ago · 2 replies

    Instrument your own funnel and stop caring about the top number. Write a row when someone hits the landing page from a cheap server-side event, a row when they start signup, a row when they finish, a row on first meaningful action. Now every step is measured by the same instrument, so the ratios between steps are trustworthy even when the absolute numbers are wrong.

    Analytics tools are for 'where did they come from'. Your database is for 'what happened next'. Making one do both is where the frustration comes from.

    97
    Share
    Reply

    Answering anonymously — a moderator will review it first.

    Report
    • @parquet_pile · 6mo ago

      A single events table with timestamp, anonymous id, name and a properties blob gets you most of a product analytics tool and joins straight to your users. Took an afternoon.

      41
      Share
      Reply

      Answering anonymously — a moderator will review it first.

      Report
  • @label_reader_lo · 6mo ago

    Going to argue the conversion rate you're worrying about isn't a useful number at your size anyway. 274 signups from somewhere between 900 and 1,400 visitors is 20-30%, which for a landing page is either fantastic or means most of that traffic had already decided before arriving.

    Either way the interesting question isn't the rate, it's which sources produce signups that are still there in 30 days. Split by source, look at week four retention. That number is worth arguing about. The top-of-funnel one isn't.

    68
    Share
    Reply

    Answering anonymously — a moderator will review it first.

    Report
  • @layer_shift_lu · 6mo ago · 3 replies

    They're measuring different things and neither is wrong. One counts distinct people over a period after applying its own identity logic; the other counts visits, and a visit is not a person. Before reconciling anything, make sure you're comparing users to users and not users to sessions - that alone explains a big chunk of gaps this size.

    The rest is blockers, consent banners, and one script loading before the other. You will never close it fully. Pick one and never switch, because your decisions depend on the trend, not the level.

    132
    Share
    Reply

    Answering anonymously — a moderator will review it first.

    Report
    • @quietpackets · 6mo ago

      Also check whether one is loaded client-side and the other proxied through your own domain. That's usually where most of the difference lives.

      54
      Share
      Reply

      Answering anonymously — a moderator will review it first.

      Report
    • @chmod_confused · 6mo ago

      And if your audience is technical, expect a meaningful share to block the client-side one entirely. My server logs and my analytics disagree by a factor I'd be embarrassed to publish.

      29
      Share
      Reply

      Answering anonymously — a moderator will review it first.

      Report
  • @chain_wear_chase · 6mo ago

    Pick the pessimistic one. Plan with it. If you're wrong, you're pleasantly wrong.

    44
    Share
    Reply

    Answering anonymously — a moderator will review it first.

    Report
  • @refresh_rhea · 6mo ago

    One practical warning: whatever you pick, write down the date you switched. In six months you'll look at a chart with a step in it and spend an evening investigating a change you made yourself.

    33
    Share
    Reply

    Answering anonymously — a moderator will review it first.

    Report
  • @pentalobe_junie · 6mo ago

    The thing that finally made this click for me was writing the actual definitions in a text file next to each number. What counts as a user, over what window, whether bots are filtered, whether it deduplicates across devices. An hour of reading docs.

    Two of my three discrepancies turned out to be me comparing a 28 day window against a calendar month.

    26
    Share
    Reply

    Answering anonymously — a moderator will review it first.

    Report