Switch language한국어
Back to the list

How to make your Next.js site appear in ChatGPT (and any LLM)

TL;DR AI

Key summary

2 min read
  1. The article explains how to manage AI crawler access on Next.js sites.

  2. It distinguishes training crawlers, search/index crawlers, and user-initiated fetches.

  3. Using robots.txt, robots.ts, sitemaps, and crawlable HTML can keep pages visible to search-oriented AI while blocking training bots like GPTBot.

  4. Blocking the wrong bot can remove a site from citations in ChatGPT, Claude, Perplexity, and other answer engines.

Read the original