Spotibo Bot

What is SpotiboBot?

SpotiboBot is the web crawler operated by Spotibo, an SEO auditing and analysis tool. It systematically crawls websites to collect data used for SEO analysis, technical audits, and link analysis. We are helping website owners and SEO professionals improve their online presence.

Bot Owner

Purpose

SpotiboBot crawls websites on behalf of Spotibo users who have initiated a site audit or analysis. The crawler is used to:

  • Perform technical SEO audits (broken links, redirects, crawlability, page speed issues)
  • Analyse on-page SEO factors (meta tags, headings, content structure)
  • Discover and map internal and external links
  • Generate detailed SEO reports for website owners and SEO professionals.

SpotiboBot only crawls websites that have been explicitly submitted for analysis by our users. It is not a general-purpose indexing bot.

User-Agent String

When crawling, SpotiboBot identifies itself with the following user-agent string:

Mozilla/5.0 (compatible; SpotiboBot/1.0; +https://spotibo.com)

Robots.txt User-Agent Token

To specifically target SpotiboBot in your robots.txt file, use:

User-agent: Spotibot

IP Addresses

SpotiboBot crawls from the following IP addresses:

IP Address
18.184.55.26
18.192.1.14

If you use IP-based firewall rules, you can use these addresses to allow or block SpotiboBot.

How to Control SpotiboBot

You can control SpotiboBot’s access to your website using the standard robots.txt protocol.

Block SpotiboBot from your entire site

User-agent: Spotibot
Disallow: /

Block SpotiboBot from a specific directory

User-agent: Spotibot
Disallow: /private/

Allow SpotiboBot to crawl everything

User-agent: Spotibot
Allow: /

Questions or Concerns?

If you have any questions about SpotiboBot or need to report an issue, please reach out to us:

Email: info@spotibo.com