How to measure agent traffic without counting the wrong thing

Count the job the agent finished.

A crawler can fetch a thousand pages without recommending your product. An agent can read one page, answer its user, and leave. Both can appear in a traffic report. They call for different decisions.

I would start with a worksheet for one task: finding a price, comparing two plans, or completing a booking. Keep the task narrow enough that you can check the result yourself.

What each event earns you

These are proposed reporting definitions. Write down your own classifier and success rules beside the chart. A label such as “agent visit” hides too much if nobody can explain what qualifies.

Copy this worksheet

For a booking task, a tool response saying “done” is weak evidence. Check that the booking exists with the requested date and service. For a research task, check whether the returned source supports the answer. Do not borrow the booking definition for research because it produces a cleaner conversion rate.

Use denominators that match the question

For a verified-completion rate, divide completed logical operations by eligible logical operations. Keep failed and unknown outcomes in the denominator. Report the failure and unknown shares beside the result. This measures what you could verify; missing outcome evidence can make it lower than actual completion. Count invocation attempts separately when assessing retry load. Deduplicate retries only when you have a reliable operation identifier; matching text alone can merge different users asking the same question.

For content discovery, count first entries to the page separately from reads later in a journey. A new guide can collect reads from your old article without bringing another visitor to the site. Inspect both URLs and the topic total before claiming growth.

For adoption, separate your own tests from unprompted use. A successful test shows that the route works under those conditions. It does not establish that someone chose to use it.

Work one small sample by hand

Here is a fictional fixture, not customer data. There are 15 invocation records: three tagged owner tests, two retries of an already counted operation, and ten distinct eligible operations. Within the fixed observation window, six have verified results, two have known failures, and two have no outcome evidence. Report 6/10 verified completions, 2/10 failures, and 2/10 unknowns. The 12 non-test invocations are a separate attempt count. You cannot call this an 80% success rate by quietly dropping the unknowns.

For passive requests, keep identity evidence beside the count. A request with an agent-like user-agent header can be labeled declared agent, unverified. A tagged owner request belongs in tests even if the header looks genuine. An unrecognized request stays unknown. Do not upgrade either to verified identity because the page was fetched successfully. Your traffic report should expose these classes rather than hide them in one total.

I would rather leave the decision open than pick a winner from two requests. When a few operations determine the result, show their counts and failures, extend the collection window, and keep the same eligibility rules.

Three ways to fool yourself

A partial day looks like a decline. Compare complete days in one timezone. Record outages, launches, and distribution changes beside the comparison.

A better collector looks like growth. If a release starts observing previously invisible requests, preserve that boundary. Report the old and new coverage rather than drawing one continuous trend through it.

An unknown outcome disappears. Keep an unknown bucket. If you cannot connect a handoff to signup, report the handoff and the missing link. Counting it as a conversion changes the question after the fact.

Chrome describes WebMCP ↗ as a way for pages to expose structured tools. Registration and task completion are separate steps in that design. Its MCP comparison ↗ also distinguishes live-page tools from server-side access. Record those access paths separately before combining any totals.

Use Lazyweb ↗ to inspect the activity it records, then fill in the worksheet with your product's outcome evidence. Leave a cell marked unknown when the evidence is missing.