Sign in

Blog · AI and self-service analytics

Self-service analytics and AI analytics: what changes, and what does not

A plain comparison for a commercial leader deciding what to buy: what self-service dashboards do, what an AI layer adds, the parts of the job that neither replaces, the two failure modes specific to AI analytics, generated numbers and unstated definitions, and the test that tells a trustworthy AI analytics tool from a fluent one.

The short answerSelf-service analytics lets a person build a view from prepared data without a developer. AI analytics adds three things: asking in plain language, having the movements found for you, and having a first reading written. It does not change what makes the numbers right, which is stated definitions, reconciled roll-ups and a source for every figure. The test of an AI analytics tool is whether every number it gives can be traced to a computed table, and whether it declines to do arithmetic in prose.

A commercial leader is offered a self-service analytics tool and an AI analytics tool and told the second is the future. Both are useful. Neither fixes the thing that most often makes numbers wrong. This guide sets out what each does, what neither does, and the test that separates a trustworthy AI analytics tool from a fluent one.

What each does

Self-service analytics AI analytics
Asking Build a view from fields Ask in plain language
Finding You look Movements found and ranked
Reading You write the sentence A first reading, cited
Computing The tool computes Deterministic code computes; the model reads
Definitions Whatever the builder chose Whatever the tool governs

What neither does

  • Decide what the measure means. Share of wallet with which wallet, coverage with which touch, dormant after how many days. Somebody writes it down, versions it, and both tools use it.
  • Reconcile the roll-up. Region equals team equals person equals account equals ledger. A tool that does not check the identity produces totals that disagree, however it is asked.
  • Fix the export. Subtotals, mixed dates and names instead of IDs break both.
  • Make the call. The list says who to contact. A person contacts them.

Two failure modes specific to AI analytics

Generated numbers. A language model asked "what was revenue in the north" can answer from a table, or it can produce a plausible figure. The second looks identical. The tool has to compute in code, and the model has to read and cite, never calculate.

Unstated definitions. Plain-language questions hide the level, the period and the comparison. An AI that fills them in silently has answered a question you did not ask. A good one asks, or states what it assumed.

The test

Ask the tool for a number. Then ask where it came from. A trustworthy tool answers with a table, the rows, the period and the definition version. A fluent one answers with more prose.

Then ask it to add two numbers from its answer. A trustworthy tool points at the computed total. A fluent one adds them, and is sometimes wrong.

A worked comparison

The same question to both: "which reps have lost coverage this month?"

Self-service AI analytics, done well
Steps Open coverage view, sort by change, filter to this month Ask
Output A table The three reps past threshold, each citing the coverage table row
Definition Whatever the view uses The governed one, version stated
Check Compare to the ledger yourself Identity already checked; failures listed
Time Ten minutes if you know the view Under a minute

The AI layer saved nine minutes and the hunting. The definition layer and the identity check made both answers right.

Where it goes wrong

Buying AI on top of ungoverned definitions. Faster access to four disagreeing numbers.

Trusting fluency. The confident wrong sum.

Dashboards abandoned. The check still needs a place to look.

Self-service without a definition layer. Every builder a new version of the truth.

Both, on one definition layer

Covirage computes from stated definitions in deterministic code, checks the roll-up identity, and lets the assistant read and cite. The self-service analytics solution describes the setup, and the versioned definitions guide covers the layer both approaches depend on.

Questions people ask

Does AI analytics replace the dashboard?

It replaces the hunting. The dashboard shows forty numbers; the AI layer says which three moved and why. The tables behind both are the same, and the dashboard is still where a reader goes to check.

What is the biggest risk with AI analytics?

A number that was generated rather than read. A language model asked for a total will produce one, and it will look right. The tool has to compute in deterministic code and let the model read the result, and it has to show you which table each number came from.

What is the biggest risk with self-service analytics?

Four people building four versions of the same measure with four definitions. Self-service without governed definitions produces four correct-looking numbers that disagree. The definition layer is what makes either approach work.