Oernoe Search
OernoeBot
OernoeBot indexes selected public websites for Oernoe Search. It follows site robots rules, honors crawl delays, excludes pages marked noindex, and stores image links and attribution rather than copying image files.
Crawl limits
A scheduled run processes no more than 20 pages. Each site is capped at 500 pages and the total crawler index at 5,000 pages.
Website owners
To prevent crawling, publish a robots rule for the OernoeBot user agent or mark pages noindex. Site owners can also contact Oernoe Support to request removal of indexed pages.
User-agent: OernoeBot Disallow: /