GA4's built-in AI vs an agent: insights you're shown against questions you ask
GA4 will tell you that a metric moved unusually and generate narrative around it. That's useful and free. But it decides what's worth surfacing, it explains only in terms of GA4 dimensions, and it stops at the property boundary — which is exactly where the questions that change decisions begin.
Two different modes
| GA4 built-in insights | An agent reading GA4 | |
|---|---|---|
| Who picks the question? | GA4 decides what to surface | You ask what you want |
| Scope of the answer | GA4 data and dimensions | GA4 plus ads, Search Console, warehouse, store |
| When it arrives | On GA4's schedule, in the UI | On yours, wherever you want it delivered |
| Follow-up questions | Not a conversation | Ask again, narrower |
| Output | A card in the interface | A report, a dashboard, an email |
The property boundary
GA4 anomaly detection is real and worth leaving on. What it can't do is attribute a change to something outside GA4. A traffic drop that coincides with a paused campaign, a conversion dip that follows a Search Console ranking slide, a channel that looks strong in GA4 and unprofitable once ad cost is included — each needs a second dataset GA4 doesn't hold.
The dimension trap that produces wrong answers
GA4's own model is a common source of confidently wrong analysis. "First user" dimensions are user-scoped and attributed to a first touch; the unprefixed versions are session-scoped. Both are correct, they answer different questions, and mixing them in one report produces numbers that refuse to reconcile. A tool reasoning over GA4 should know that rather than faithfully returning whichever you happened to name — see GA4's CM360 dimensions explained.
What to do with each
- Keep GA4's insights on. Free anomaly detection with no configuration is worth having.
- Ask your own questions elsewhere, especially the ones spanning GA4 and something else.
- Put the recurring analysis on a schedule so it arrives rather than waiting to be opened.
- Render it where stakeholders will actually look — a link beats a login.
Frequently asked questions
- Does GA4 have built-in AI?
- Yes — it surfaces anomalies and generates narrative insights about your property automatically. It decides what's worth surfacing, explains in GA4's own dimensions, and stops at the property boundary.
- Why isn't GA4's anomaly detection enough?
- It can flag that a metric moved unusually but can't attribute the change to anything outside GA4 — a paused campaign, a ranking slide, or ad cost that makes a strong-looking channel unprofitable all live in other systems.
- What's the most common GA4 analysis mistake?
- Mixing user-scoped "First user" dimensions with session-scoped unprefixed ones in a single report. Both are correct and they answer different questions, so combining them produces numbers that never reconcile.
- Should I turn off GA4 insights if I use an agent?
- No. Free automatic anomaly detection is worth keeping. The agent covers the questions you choose to ask, especially those needing data GA4 doesn't hold.