What Is Impulse A/B Testing On Its Paywall?

Lazyweb Research detected 17 distinct experiments at Impulse (July 2026), and all 17 touch the paywall. [1] In the CTA dataset Impulse runs 14 paywall CTA experiments, but only 1 changed the CTA text — the most offer-weighted CTA profile of any app tracked. [2] These are observed before/after variations with inferred rationale, not company-confirmed A/B tests.

All 17 detected Impulse experiments are on the paywall, yet only 1 of 14 CTA tests changed the button (July 2026).

Lazyweb Research · n=17 · Published 2026-07-07

paywallpricingmonetizationexperimentsmobiletrials

The finding

Lazyweb Research detected 17 distinct experiments at Impulse, all 17 on the paywall. [1] Impulse is a pure-paywall brain-training experimenter — every detected variation targets the subscription surface.

What the CTA data shows

In the CTA dataset Impulse runs 14 paywall CTA experiments, only 1 of which changed the CTA text — the single most offer-weighted profile among the 30 companies with 8+ CTA experiments. [2] Nearly every detected paywall test here moves the offer, plan structure, or layout, not the words on the button.

How to apply it

Impulse is the corpus's extreme case of an offer-weighted paywall: of its 14 CTA experiments, only 1 changed the button text. [2] The lesson for a brain-training or habit app is that Impulse tests plan structure, pricing, and layout almost exclusively, leaving the CTA copy nearly fixed. If your team defaults to rewording buttons, Impulse is the strongest counterexample in the dataset. One experiment was detected in 2026. [1]

Caveats

All figures are observed variations with LLM-inferred rationale, not company-confirmed A/B tests — no lift is measured. [1] Surface splits are lower bounds because screen category is unlabeled on 1,425 of 4,814 corpus experiments. [cat_null] CTA claims use the 795-experiment CTA dataset. [2]

The numbers

StatComputed from
17 distinct experiments; all 17 on the paywallcompany_total:impulse (value 17; paywall 17, in-2026 1)
14 paywall CTA experiments, 1 changed CTA textpaywall_cta_by_company impulse 14/1
1,425 of 4,814 experiments have no screen categoryscreen_category_null_on_experiments (1425/4814)
Methodology. Universe: 17 distinct Impulse experiments (COUNT(DISTINCT experiment_id)) within 4,814 detected before/after UI diffs across 276 companies, July 2026. Extraction: LLM-inferred rationale on observed variations. Caveat: detected variations only, never company-confirmed A/B tests.

Sources & citations

  1. [1] Lazyweb Research analysis of 17 detected experiments (Impulse, ~800-app mobile corpus), July 2026. COUNT(DISTINCT experiment_id) on before/after diffs; surface splits from is_paywall + screen_category.
  2. [2] Lazyweb Research analysis of 795 paywall CTA experiments (146 companies), July 2026. paywall_cta_experiments; impulse 14/1.
  3. [cat_null] Lazyweb Research analysis of 4,814 detected experiments (276 companies, ~800-app mobile corpus), July 2026. screen_category is NULL on 1,425 experiments, so all surface splits are lower bounds.

Source: Lazyweb Research — proprietary analysis of real, in-market app screens. Cite as Lazyweb Research, 2026-07-07.

Related questions

Explore the underlying screens, flows, and A/B tests inside Lazyweb. More research