News & insights

Latest guides

Analytics, AI referrals, crawler access, and practical implementation notes

Watercolor search paths leading to a bookmarked publication selected as a trusted source

Google Preferred Sources: What It Changes for SEO

Google Preferred Sources lets readers prioritize a publication in Top Stories. Learn what it changes, what it does not, and how to measure it honestly.

GuideAugust 23, 20265 min read
Watercolor magnifying glass tracing crawler footprints across a web page

How to Know if ChatGPT Crawled Your Website

Check whether ChatGPT, Claude, or Perplexity crawled your website using CDN or server request evidence.

GuideAugust 4, 20266 min read
Watercolor analytics lens missing crawler tracks beneath a web page

Why ChatGPT and Claude Don't Appear in Google Analytics

Learn why ChatGPT and Claude crawler requests are missing from GA4 and where to measure them instead.

GuideAugust 4, 20265 min read
Watercolor cloud gate with separate open and blocked crawler paths

Is Cloudflare Blocking ChatGPT and Claude?

Check whether Cloudflare blocks ChatGPT or Claude, understand the default changes, and verify actual crawler outcomes.

TutorialAugust 4, 20267 min read
Watercolor trail of human footprints from an AI lantern to a website

How to Track Traffic From ChatGPT

Track human visits from ChatGPT using campaign values and referrers, then connect them to goals and revenue.

TutorialAugust 4, 20265 min read
Watercolor answer scroll linked by a thread to cited source pages

How to Know if ChatGPT Cites Your Website

Use a defined prompt sample to check ChatGPT citations without confusing citations, mentions, referrals, and crawls.

GuideAugust 4, 20266 min read
Watercolor crawler path meeting a locked gate and an hourglass barrier

Why ChatGPT and Claude Get 403 or 429 Errors

Diagnose 403 and 429 responses for ChatGPT and Claude crawlers across robots.txt, CDN, WAF, and application rules.

DeveloperAugust 4, 20267 min read
Watercolor edge observatory recording crawler paths into a web project

How to Track ChatGPT Crawlers on Vercel

Track ChatGPT, Claude, and other AI crawlers using Vercel Firewall events, AI bot rules, and request logs.

DeveloperAugust 4, 20266 min read
Watercolor printing press with crawler tracks stopping at outer gates

How to Track ChatGPT Crawlers on WordPress

Find ChatGPT and Claude crawler requests to WordPress using CDN, host, or web-server access logs.

DeveloperAugust 4, 20266 min read
Watercolor cloud watchtower recording crawler requests across a distribution

How to Track ChatGPT Crawlers in AWS CloudFront

Use CloudFront request logs to find ChatGPT and Claude crawler paths, user agents, and HTTP outcomes.

DeveloperAugust 4, 20267 min read
Watercolor server logbook recording crawler tracks beside a web gateway

How to Track ChatGPT Crawlers in nginx Logs

Configure nginx access logs to record ChatGPT and Claude crawler paths, user agents, times, and HTTP statuses.

DeveloperAugust 4, 20267 min read
Watercolor field guide with varied crawler tracks and observation notes

AI crawler user agents: a developer reference

A developer reference for AI crawler user agents, robots.txt tokens, published IP ranges, purposes, and verification methods.

DeveloperJuly 20, 20264 min read