Skip to content
Metricsjar

Article · Updated August 2026

Session replays or funnels: which explains the drop-off?

Editorial cover: a funnel locating a drop and a replay observing the same stage

Funnels and session replays answer different questions. A funnel measures how many eligible users moved between defined events and locates the largest trustworthy loss. A replay lets you observe what happened in selected recorded sessions.

Use them in sequence:

  1. funnel to measure the pattern;
  2. replay to observe affected cases;
  3. instrumentation or an experiment to test the suspected explanation.

A replay is a case. The funnel tells you whether the case is a pattern.

Diagnostic sequence showing when to use a funnel, replay and follow-up events

The core comparison

QuestionFunnelSession replay
How many eligible users reached each stage?StrongWeak; manual sample
At which defined handoff is the loss largest?StrongWeak unless filtered by events
What did a selected user see and do?Limited to captured eventsStrong when the recording is complete
Is one observed behaviour common?Can test after adding/using an eventCannot establish prevalence by itself
Can it reveal an event missing entirely?Sometimes through reconciliationSometimes by visual observation
Can it prove why users dropped?NoNo
Ongoing operating costInstrumentation and definition upkeepRecording volume, privacy controls and review time

Neither is a complete causal explanation. Together they form a practical diagnostic loop.

Start with a trustworthy funnel

Define:

For example:

StageEventEntityCompletion rule
Enteredaccount_createdAccountAccount persisted
Setup startedsource_connection_startedAccountValid flow begins
Setup completedsource_connectedAccountUsable data confirmed
First valuedashboard_renderedAccountComplete current dashboard visible
Commercialtrial_startedCustomer/accountSubscription source confirms trial

If the entity changes from device to account or customer, document the join. A 45% “drop” can be identity loss rather than behaviour.

Choose which sessions to replay

Do not open the replay list and watch random recordings. Build a diagnostic sample.

For a drop between source_connection_started and source_connected, create groups:

  1. eligible sessions that started but did not complete;
  2. sessions that completed successfully;
  3. affected sessions from the relevant release, source type and platform;
  4. sessions with a related error event;
  5. sessions with no recording, recorded as missing rather than ignored.

Sample across devices, browsers, acquisition sources and account types when those dimensions are plausible. Decide the sample before watching so the most dramatic recording does not become the explanation by default.

Use a replay observation sheet

Record behaviour using a controlled list:

FieldExample
Funnel stageSource connection
Session ID
SegmentMobile Safari, new account
Recording completenessFull / partial / unavailable
Observed behaviourRepeated credential submission
Technical signal401 error event present
Candidate explanationCredential guidance or auth failure
ConfidenceObserved in this session only
Follow-up event/testCount repeated submission + error code

Describe what happened, not the user’s intention. “Clicked submit three times after a 401” is observable. “Did not trust the form” is an inference.

Convert observations into testable hypotheses

Suppose 12 of 20 sampled failed sessions show the same error message after connection. Do not publish “60% of users fail because of the error.” The sample is filtered, small and may exclude unrecorded sessions.

Write:

Among the reviewed recordings from accounts that started but did not complete source connection, repeated authorization errors were a recurring observed pattern. We will instrument the error code across all eligible attempts and compare completion by error state.

Then add or use an event such as:

source_connection_failed { source_type, error_category, attempt_number }

The aggregate event can test whether the observed pattern explains a meaningful share of the funnel loss.

A fictional example

Acme Reports has this weekly funnel:

StageAccountsStep conversionAbsolute loss
Account created320
Connection started25078.1%70
Connection succeeded13052.0%120
First dashboard rendered11890.8%12
Trial started7664.4%42

The largest absolute loss and lowest step conversion occur at connection success. The team reviews a predetermined sample:

SampleSessions requestedComplete recordingsRecurring observations
Started, not completed30229 authorization errors; 5 repeated field edits; 8 mixed/unclear
Completed151311 single-attempt completions; 2 retries

The recordings support two hypotheses: authorization errors and unclear input requirements. They do not establish their corpus-wide frequency. The team instruments failure categories and attempt count for the next full cohort.

One week later:

Connection outcomeEligible attemptsCompletedCompletion rate
No recorded error18014278.9%
Authorization error701217.1%
Validation error351851.4%

Now authorization failure is an aggregate pattern. The next step is to separate upstream credential validity from the product’s handling and guidance.

When funnels are enough

Use the funnel without replay when:

A retryable API error does not need a recording to prove that it happened 400 times.

When replay is worth adding

Replay earns its cost when:

PostHog currently lists session replay separately from product analytics, with a free allowance and per-recording usage pricing on its public product page (PostHog). Pricing can change; the operating cost also includes review time and privacy governance.

Privacy and recording boundaries

Before enabling replay:

Do not collect a richer recording merely because the SDK allows it. Collect only what the diagnostic job warrants.

Common mistakes

Watching only failures

Successful sessions provide the comparison. Without them, a behaviour can look suspicious even when it occurs everywhere.

Watching the most dramatic recordings

Choose a sampling rule before reviewing. Anecdotal intensity is not frequency.

Using replay instead of event repair

If the funnel event is missing or fires incorrectly, repair it. Replay should not become a manual counter.

Treating missing recordings as successful sessions

Replay coverage can vary by consent, platform, duration and technical failure. Report the number requested, available and complete.

Publishing inferred intent

State the observed action and the hypothesis separately.

A repeatable weekly workflow

  1. Review the mature funnel and absolute losses.
  2. Confirm event, identity and cohort quality.
  3. Select one handoff.
  4. Define failed and successful replay cohorts.
  5. Review a fixed sample with an observation sheet.
  6. Rank candidate explanations by observed evidence and decision impact.
  7. Add an aggregate event or controlled experiment.
  8. Re-read the funnel after the change.

Stop when the first actionable explanation is strong enough to test. Do not turn replay review into a daily film festival.

Frequently asked questions

Should I install session replay or product analytics first?

For a recurring conversion question, begin with a small event plan and funnel. Add replay when the measured handoff requires visual observation.

How many recordings should I watch?

There is no universal sample size. Predefine a manageable failed/successful sample, report coverage and stop when you have testable hypotheses—not a prevalence estimate.

Can replay replace user interviews?

No. Replay shows recorded behaviour without the person’s explanation. Interviews can reveal goals and interpretation. Both have sampling limits.

Can a funnel explain why users leave?

No. It locates a measured loss. It narrows where to investigate.

What if replay and funnel disagree?

Check recording coverage, event firing, identity, cohort filters and timing. The tools may be observing different subsets or units.

Sources

Keep reading