Building an SEO Crawler in TypeScript: What I Learned

The author built SEOCore, a public TypeScript CLI for crawling websites and running SEO audits.

The project grew beyond basic crawling to handle metadata, links, redirects, structured data, and JavaScript-rendered pages.

A major challenge was turning raw crawl data into clear, useful insights instead of just collecting more output.

The work focused on keeping commands simple, organizing complex SEO data, and improving terminal readability for technical audits.