Lacspace Devs
← All packages

@lacspace/robots

v1.4.1SEO Kit0 deps

Build and parse robots.txt — typed per-user-agent rules, crawl-delay & clean-param, sitemap refs, a parser + longest-match isAllowed(), and one-liners to block/allow AI crawlers per-agent from a 21-bot catalog (GPTBot, ClaudeBot, CCBot, Google-Extended, PerplexityBot…). Next.js robots.ts output. Zero-dependency, isomorphic.

npm i @lacspace/robots
View on npm ↗GitHub ↗

Usage

robots.ts
import { robots } from "@lacspace/robots";

robots({
  groups: [
    { userAgent: "*", disallow: ["/admin", "/api"], allow: ["/api/public"] },
    { userAgent: "Googlebot", disallow: [] }, // allow all
  ],
  sitemap: "https://lacspace.com/sitemap.xml",
  host: "lacspace.com",
});

Exports 18

AI_BOTSAI_TRAINING_BOTSaiPolicyallowSearchBlockTrainingblockAiBotsblockAllenvRobotsisAllowedmetaRobotsnextjsRobotsparseRobotsrobotsrobotsForSiteshopifyRobotsstackRobotstoNextRobotswordpressRobotsxRobotsTag

Keywords

robots-txtrobotsseocrawlergptbotai-crawler

More in SEO Kit

@lacspace/llms-txt

Generate, parse, and validate llms.txt / llms-full.txt (the llmstxt.org standard) — build both from your sitemap, routes, or a page list, with ## Optional blocks. A Markdown map of your site for LLMs. Zero-dependency, isomorphic.

@lacspace/og

Dynamic Open Graph images — a share-card design system you configure once and call per page. Produces a next/og element tree AND a zero-dependency SVG from the same options, with 7 templates (article, product, quote, event, split, minimal), named gradient & surface presets, image/avatar embedding and auto-fitting multi-line titles. Zero-dependency, isomorphic.

@lacspace/rss

Generate RSS 2.0, Atom 1.0 and JSON Feed 1.1 from one item set — with podcast (iTunes) tags, enclosures, media, rich channel metadata and a one-call feeds() builder. Zero-dependency, isomorphic.

@lacspace/seo

Typed metadata + JSON-LD for modern web apps — schema.org builders (Organization, Article, Product, FAQ, Breadcrumb, Event, Dataset, Book, Podcast), robots directives, richer Open Graph & Twitter cards, canonical + hreflang alternates, a Next.js App Router Metadata helper, the defineSite() SEO Autopilot engine, and an on-page SEO auditor with a CI sitemap crawler (`npx @lacspace/seo audit <url>` / `crawl <site> --min-grade A`). Zero-dependency, isomorphic.

@lacspace/site-verify

Search-engine site verification — meta tags, DNS TXT records, upload files, Next.js verification metadata, batch emit, and tag parsing for Google Search Console, Bing, Yandex, Baidu, Pinterest, Ahrefs, Facebook & more. Zero-dependency, isomorphic.

@lacspace/sitemap

Generate sitemap.xml, sitemap indexes and Next.js sitemaps — image/video/news extensions, hreflang alternates, auto-split at 50k URLs, plus priority/changefreq/lastmod validators and a URL-count guard. Zero-dependency, isomorphic.

← Browse all 197 packagesRead the handbook