Step 5 of 5 on the chain

Permutation test

Also called Shuffle test.

Dealing the same deals into before and after at random, over and over, and counting how often chance alone produces a gap as large as the real one.

Why it matters

It answers the first question any analyst asks, using nothing but the advertiser's own rows. No distribution is assumed and nothing is simulated.

What goes wrong

Reported as a raw count rather than a p-value on purpose. Eighteen shuffles in a thousand matched this gap is a sentence anybody can apply their own standard to; p = 0.018 is a sentence that ends the conversation for most of the room.

What this product does about it

1,000 shuffles, seeded, so the same file always reports the same count.

How to check it on your own account

It can be done by hand in a spreadsheet, slowly. List every resolved deal's value with its before or after label, shuffle the labels with a random sort, recompute the gap between the two groups, and repeat. Twenty shuffles already tell you whether your real gap is unusual; a thousand tell you how unusual.

Next to this

How it applies in your trade

The same method, worked through for each kind of business: what a lead is worth, what is known on arrival and what to prepare.

The rest of this step

Measure this on your own data

The diagnostic reads a CRM export in your browser and reports your volume, your match rate and the spread between your leads against the thresholds in this glossary. Nothing is uploaded and no account is needed.

See what your own leads are worth

Read your closed deals and find out whether your lead values actually vary, and by how much. Nothing is stored, and your file is read in your browser.

Try it on a sample dataset