← All packages

@lacspace/robots

v1.3.1SEO Kit0 deps

Build and parse robots.txt — typed per-user-agent rules, AI-crawler block presets (GPTBot, ClaudeBot, CCBot, Google-Extended), sitemap refs and Next.js robots.ts output. Zero-dependency, isomorphic.

npm i @lacspace/robots

Usage

robots.ts
import { robots } from "@lacspace/robots";

robots({
  groups: [
    { userAgent: "*", disallow: ["/admin", "/api"], allow: ["/api/public"] },
    { userAgent: "Googlebot", disallow: [] }, // allow all
  ],
  sitemap: "https://lacspace.com/sitemap.xml",
  host: "lacspace.com",
});

Exports 18

AI_BOTSAI_TRAINING_BOTSaiPolicyallowSearchBlockTrainingblockAiBotsblockAllenvRobotsisAllowedmetaRobotsnextjsRobotsparseRobotsrobotsrobotsForSiteshopifyRobotsstackRobotstoNextRobotswordpressRobotsxRobotsTag

Keywords

robots-txtrobotsseocrawlergptbotai-crawler

More in SEO Kit