# # _______________ # | ___________ | Hello, curious human (or very polite robot)! # ____| | _______ | |____ # | | | / ___ \ | | | rik.blue: data engineering by day, # | | || / \ || | | analog photography by weekend. # | | || | (o) | || | | # | | || \_____/ || | | Shot on a Canon AE-1 Program, # | | | \_____/ | | | loaded with Kodak Gold 200. # |____|_|___________|_|____| # No digital retouching, just patience. # # Say hi: https://rik.blue/humans.txt # Photos: https://rik.blue/fotografie/ (© Rik Heijmann: look, don't scrape) # Rules: https://rik.blue/copyright/ # # Search engines (incl. Google Images) and AI search/answer tools are welcome: they send # visitors. Crawlers that only collect content to TRAIN models or build datasets are not. # The same reservation is in the tdm-reservation header, /.well-known/tdmrep.json and the # IPTC metadata of every photo. # AI training and dataset crawlers (blocked) # Generated on every build: [params.robots] always_block in hugo.toml + the training/dataset # crawlers from ai.robots.txt (data/robots_ai.json, refreshed by scripts/update-robots.js), # minus never_block. Search and answer bots that link back (OAI-SearchBot, ChatGPT-User, # Claude-SearchBot, Claude-User, PerplexityBot, DuckAssistBot, Applebot ...) are welcome. User-agent: AgentDataBot User-agent: AgentTimes User-agent: AI2Bot User-agent: Ai2Bot-Dolma User-agent: aiHitBot User-agent: Amazonbot User-agent: anthropic-ai User-agent: ApifyBot User-agent: ApifyWebsiteContentCrawler User-agent: Applebot-Extended User-agent: Awario User-agent: bedrockbot User-agent: BixelBot User-agent: Brightbot User-agent: Bytespider User-agent: CCBot User-agent: ChatGLM-Spider User-agent: Claude-Web User-agent: ClaudeBot User-agent: CloudflareBrowserRenderingCrawler User-agent: CloudVertexBot User-agent: cohere-training-data-crawler User-agent: Cotoyogi User-agent: CragCrawler User-agent: Crawlspace User-agent: DeepSeekBot User-agent: Diffbot User-agent: DoubaoBot User-agent: ElevenlabsCrawler User-agent: ERNIEBot User-agent: ExaBot User-agent: FacebookBot User-agent: Factset_spyderbot User-agent: FirecrawlAgent User-agent: FriendlyCrawler User-agent: Google-CloudVertexBot User-agent: Google-Extended User-agent: GoogleOther User-agent: GoogleOther-Image User-agent: GoogleOther-Video User-agent: GPTBot User-agent: GrokBot User-agent: HenkBot User-agent: Hunyuan User-agent: ICC-Crawler User-agent: ImagesiftBot User-agent: imageSpider User-agent: img2dataset User-agent: ISSCyberRiskCrawler User-agent: KimiBot User-agent: laion-huggingface-processor User-agent: LAIONDownloader User-agent: LCC User-agent: Lightpanda User-agent: Meta-ExternalAgent User-agent: MistralAI-Training User-agent: MoonshotBot User-agent: Mozilla-Tabstack User-agent: MyCentralAIScraperBot User-agent: NagetBot User-agent: newsai User-agent: omgili User-agent: omgilibot User-agent: PanguBot User-agent: Panscient User-agent: panscient.com User-agent: Querit-SearchBot User-agent: QueritBot User-agent: QwenBot User-agent: SBIntuitionsBot User-agent: Scrapy User-agent: ShapBot User-agent: Spider User-agent: TavilyBot User-agent: TerraCotta User-agent: TikTokSpider User-agent: Timpibot User-agent: VelenPublicWebCrawler User-agent: WARDBot User-agent: Webzio-Extended User-agent: xAI-Grok User-agent: YandexAdditional User-agent: YandexAdditionalBot User-agent: YiBot Disallow: / # Everyone else: search engines (Googlebot, Googlebot-Image, Bingbot, ...) and AI search/answer bots. # Content-Signal (contentsignals.org): search yes, AI answers that link back yes, AI training no. User-agent: * Content-Signal: search=yes, ai-input=yes, ai-train=no Disallow: /search/ Disallow: /en/search/ # One sitemap for both languages (Dutch at the site root, English under /en/) Sitemap: https://rik.blue/sitemap.xml