
Which AI Crawlers Reach Marketing Sites and What Do They Request? A CDM Log Study
Use CDM's preregistered log-study protocol to verify AI crawler identity, requests, response outcomes and robots behavior without equating access with citation.
Founded in New York City and now based in Shoreditch, London, CDM follows the marketing signals shaped by current realities and the economy.
Enter the journalLead story
27 October 2026 / 9 min
Use CDM's preregistered log-study protocol to verify AI crawler identity, requests, response outcomes and robots behavior without equating access with citation.
Read the article
Use CDM's preregistered log-study protocol to verify AI crawler identity, requests, response outcomes and robots behavior without equating access with citation.

A field-level product-truth reconciliation workflow for ChatGPT feeds, Google Merchant Center, Product structured data and the visible product page.

Correct one shared fact by freezing reuse, mapping every direct and derivative use, publishing visible notes, updating discovery signals and verifying closure.

Set evidence refresh dates from observed source changes, release schedules, consequence and detection coverage instead of one universal content cadence.

A code-led guide to using data-nosnippet for element-level preview boundaries around volatile claims while keeping pages indexable and useful.

Trace five apparent sources to their evidence origin, expose circular citation and distinguish independent corroboration from repetition or transformation.

A property-scope runbook for changing Google Search generative AI inclusion, documenting inheritance, preserving classic Search eligibility and validating rollback.

Use Bing Webmaster Tools grounding queries, intents, topics, cited pages and Citation Share to decide what to protect, improve, consolidate or investigate.

Interpret Google Search Console’s generative AI performance report as first-party visibility evidence without turning impressions, pages or trends into a fictional AI rank.

Use a multilingual fact grid to preserve approved meaning while governing local scope, terminology, currency, dates, URLs and retrieval tests.

Use a timed correction ledger to update canonical evidence, preserve history, request discovery and monitor dated answers without false recrawl promises.

Write retrievable evidence blocks that keep each claim beside its entity, scope, date, source and limitation, then test chunking and answer fidelity.

Test PDFs and images with a gold evidence manifest covering OCR, reading order, tables, charts, qualifiers, provenance and retrieval accuracy.

Use a purpose-based permission matrix to govern search crawling, user-requested fetches and model use separately, then test every robots rule.

Build a verified bot ledger that separates spoofed user-agents, successful requests and content delivery from indexing, retrieval and citation claims.

Run an outside-in crawler probe across robots.txt, DNS, TLS, CDN, firewall, origin and rendering, with expected results and a diagnostic tree.

Use a dual-environment test to measure public crawl and citation separately from private RAG retrieval, grounding, refusal and scope preservation.

Join Search Console demand with GA4 landing behavior using safe grains, query families, URL rules, QA checks and a decision-ready dashboard.

Build a WordPress evidence-to-refresh workflow with source fields, review roles, revision gates, schema checks, failure tests and a worked article record.

A documented response protocol for correcting brand facts, repairing source evidence and measuring whether inaccurate AI answers continue to appear.

Learn how Gong turns proprietary conversation records into research, and use a disclosure test to create evidence people can inspect and cite.

Learn how Canva links searchable task pages to editable templates and product use, plus a practical test for building a utility-led acquisition loop.

Content freshness with integrity: what to update, date and preserve. Explore user question, answer object, source-of-truth page, with practical steps, evidence checks and a worked example.

Images, video, local and shopping content in generative search. Explore user question, answer object, source-of-truth page, with practical steps, evidence checks and a worked example.

Structured data that matches visible content: a practical governance guide. Explore refresh trigger, user question, answer object, with practical steps, evidence checks and a worked example.

Technical foundations for AI discovery: crawlability, snippets, internal links and structured data. Explore refresh trigger, user question, answer object, with practical steps, evidence checks and a worked example.

Content clusters for AI discovery: designing depth without keyword cannibalisation. Explore machine eligibility, refresh trigger, user question, with practical steps, evidence checks and a worked example.

Seven GEO myths: special schema, llms.txt and other claims marketers should question. Explore machine eligibility, refresh trigger, user question, with practical steps, evidence checks and a worked example.

Original research as authority infrastructure: from question to citable asset. Explore internal path, machine eligibility, refresh trigger, with practical steps, evidence checks and a worked example.

How to measure brand visibility in AI answers without inventing certainty. Explore internal path for measure brand visibility in ai answers without inventing certainty, machine eligibility, refresh trigger, with practical steps, evidence checks and a worked example.

How to write definitions that are accurate, citable and genuinely useful. Explore evidence trace for write definitions that are accurate, citable and genuinely useful, internal path, machine eligibility, with practical steps, evidence checks and a worked example.

How to run an AI discovery audit for a brand. Explore evidence trace for run an ai discovery audit for a brand, internal path, machine eligibility, with practical steps, evidence checks and a worked example.

How to build brand authority that people and AI systems can verify. Explore user question for build brand authority that people and ai systems can verify, answer object, source-of-truth page, with practical steps, evidence checks and a worked example.

AI discovery and GEO: the complete guide for modern marketing teams. Explore user question, answer object, source-of-truth page, with practical steps, evidence checks and a worked example.

Author pages that demonstrate real expertise instead of generic bios. Explore entity clarity, evidence trace, internal path, with practical steps, evidence checks and a worked example.

Query fan-out: why one AI question creates many content opportunities. Explore entity clarity, evidence trace, internal path, with practical steps, evidence checks and a worked example.

How to create a source-of-truth page for a brand, product or creator. Explore source-of-truth page for create a source-of-truth page for a brand, product or creator, entity clarity, evidence trace, with practical steps, evidence checks and a worked example.

How AI answer systems find, evaluate and cite web content. Explore source-of-truth page, entity clarity, evidence trace, with practical steps, evidence checks and a worked example.

Entity clarity for marketers: helping search and AI systems understand who you are. Explore answer object, source-of-truth page, entity clarity, with practical steps, evidence checks and a worked example.

SEO, AEO and GEO: what changes, what overlaps and what marketers should do. Explore answer object, source-of-truth page, entity clarity, with practical steps, evidence checks and a worked example.

Learn content pruning and consolidation. Get a clear framework, practical steps, evidence checks, decision rules and the limits that matter for confident execution.

Learn ai agents and brand readiness. Get a clear framework, practical steps, evidence checks, decision rules and the limits that matter for confident execution.
CDM is an independent marketing media journal reporting on visibility, content creation, AI visibility, and relevance in the context of today’s economy.
The publication is handled by leading marketing experts who turn fast-moving signals into clear, useful guidance.
About CDMExpert-led analysis, clear frameworks, and grounded guidance for marketing decisions being made now.
42 articles

Use CDM's preregistered log-study protocol to verify AI crawler identity, requests, response outcomes and robots behavior without equating access with citation.

A field-level product-truth reconciliation workflow for ChatGPT feeds, Google Merchant Center, Product structured data and the visible product page.

Correct one shared fact by freezing reuse, mapping every direct and derivative use, publishing visible notes, updating discovery signals and verifying closure.

Set evidence refresh dates from observed source changes, release schedules, consequence and detection coverage instead of one universal content cadence.

A code-led guide to using data-nosnippet for element-level preview boundaries around volatile claims while keeping pages indexable and useful.

Trace five apparent sources to their evidence origin, expose circular citation and distinguish independent corroboration from repetition or transformation.

A property-scope runbook for changing Google Search generative AI inclusion, documenting inheritance, preserving classic Search eligibility and validating rollback.

Use Bing Webmaster Tools grounding queries, intents, topics, cited pages and Citation Share to decide what to protect, improve, consolidate or investigate.

Interpret Google Search Console’s generative AI performance report as first-party visibility evidence without turning impressions, pages or trends into a fictional AI rank.

Use a multilingual fact grid to preserve approved meaning while governing local scope, terminology, currency, dates, URLs and retrieval tests.

Use a timed correction ledger to update canonical evidence, preserve history, request discovery and monitor dated answers without false recrawl promises.

Write retrievable evidence blocks that keep each claim beside its entity, scope, date, source and limitation, then test chunking and answer fidelity.

Test PDFs and images with a gold evidence manifest covering OCR, reading order, tables, charts, qualifiers, provenance and retrieval accuracy.

Use a purpose-based permission matrix to govern search crawling, user-requested fetches and model use separately, then test every robots rule.

Build a verified bot ledger that separates spoofed user-agents, successful requests and content delivery from indexing, retrieval and citation claims.

Run an outside-in crawler probe across robots.txt, DNS, TLS, CDN, firewall, origin and rendering, with expected results and a diagnostic tree.

Use a dual-environment test to measure public crawl and citation separately from private RAG retrieval, grounding, refusal and scope preservation.

Join Search Console demand with GA4 landing behavior using safe grains, query families, URL rules, QA checks and a decision-ready dashboard.

Build a WordPress evidence-to-refresh workflow with source fields, review roles, revision gates, schema checks, failure tests and a worked article record.

A documented response protocol for correcting brand facts, repairing source evidence and measuring whether inaccurate AI answers continue to appear.

Learn how Gong turns proprietary conversation records into research, and use a disclosure test to create evidence people can inspect and cite.

Learn how Canva links searchable task pages to editable templates and product use, plus a practical test for building a utility-led acquisition loop.

Content freshness with integrity: what to update, date and preserve. Explore user question, answer object, source-of-truth page, with practical steps, evidence checks and a worked example.

Images, video, local and shopping content in generative search. Explore user question, answer object, source-of-truth page, with practical steps, evidence checks and a worked example.

Structured data that matches visible content: a practical governance guide. Explore refresh trigger, user question, answer object, with practical steps, evidence checks and a worked example.

Technical foundations for AI discovery: crawlability, snippets, internal links and structured data. Explore refresh trigger, user question, answer object, with practical steps, evidence checks and a worked example.

Content clusters for AI discovery: designing depth without keyword cannibalisation. Explore machine eligibility, refresh trigger, user question, with practical steps, evidence checks and a worked example.

Seven GEO myths: special schema, llms.txt and other claims marketers should question. Explore machine eligibility, refresh trigger, user question, with practical steps, evidence checks and a worked example.

Original research as authority infrastructure: from question to citable asset. Explore internal path, machine eligibility, refresh trigger, with practical steps, evidence checks and a worked example.

How to measure brand visibility in AI answers without inventing certainty. Explore internal path for measure brand visibility in ai answers without inventing certainty, machine eligibility, refresh trigger, with practical steps, evidence checks and a worked example.

How to write definitions that are accurate, citable and genuinely useful. Explore evidence trace for write definitions that are accurate, citable and genuinely useful, internal path, machine eligibility, with practical steps, evidence checks and a worked example.

How to run an AI discovery audit for a brand. Explore evidence trace for run an ai discovery audit for a brand, internal path, machine eligibility, with practical steps, evidence checks and a worked example.

How to build brand authority that people and AI systems can verify. Explore user question for build brand authority that people and ai systems can verify, answer object, source-of-truth page, with practical steps, evidence checks and a worked example.

AI discovery and GEO: the complete guide for modern marketing teams. Explore user question, answer object, source-of-truth page, with practical steps, evidence checks and a worked example.

Author pages that demonstrate real expertise instead of generic bios. Explore entity clarity, evidence trace, internal path, with practical steps, evidence checks and a worked example.

Query fan-out: why one AI question creates many content opportunities. Explore entity clarity, evidence trace, internal path, with practical steps, evidence checks and a worked example.

How to create a source-of-truth page for a brand, product or creator. Explore source-of-truth page for create a source-of-truth page for a brand, product or creator, entity clarity, evidence trace, with practical steps, evidence checks and a worked example.

How AI answer systems find, evaluate and cite web content. Explore source-of-truth page, entity clarity, evidence trace, with practical steps, evidence checks and a worked example.

Entity clarity for marketers: helping search and AI systems understand who you are. Explore answer object, source-of-truth page, entity clarity, with practical steps, evidence checks and a worked example.

SEO, AEO and GEO: what changes, what overlaps and what marketers should do. Explore answer object, source-of-truth page, entity clarity, with practical steps, evidence checks and a worked example.

Learn content pruning and consolidation. Get a clear framework, practical steps, evidence checks, decision rules and the limits that matter for confident execution.

Learn ai agents and brand readiness. Get a clear framework, practical steps, evidence checks, decision rules and the limits that matter for confident execution.