Product onboarding
Read a customer-provided website to establish product context, positioning, public evidence, navigation, and brand cues.
Crawler transparency
About BloggedBot
BloggedBot is Blogged's identified crawler. It visits publicly accessible pages only when an account workflow or an authorized free-tool submission needs product context, approved source evidence, competitor context, reusable visual candidates, or a bounded internal-link plan.
Identified on every request Bounded crawl scope Public pages only
Why it visits
A crawler attached to an explicit, bounded workflow.
BloggedBot does not crawl the web to build a general-purpose search index or model training corpus. An account action, configured product workflow, or authorized public free-tool submission provides the domain, purpose, and bounded scope.
Knowledge refresh
Revisit approved public sources so product and competitor context can be checked against current evidence.
Competitor context
Review approved competitor sites and public content to support market-aware research and monitoring.
Free site analysis
Analyze a website submitted by someone who confirms they own, manage, or are authorized to inspect it, using a separate bounded free-tool crawler.
Access boundaries
Public access is still technically constrained.
The crawler validates destinations and redirects, caps response sizes, and uses page budgets. It does not bypass authentication, paywalls, private-network protections, or other technical access controls.
robots.txt policy
BloggedBot reads and records robots.txt. For account workflows, the authorized SaaS Internal Link Tool, the SaaS Feature Gap Analyzer's explicitly submitted target and competitor URLs, and the owner-authorized SaaS Blog SEO & AI Visibility Audit target, it may continue reading publicly accessible pages when robots.txt discourages crawling because robots directives are treated as crawler guidance rather than access control. Requests remain identified and technically bounded. A verified exclusion request overrides this policy.
User agents:
Information URL:
BloggedBot/0.1 and BloggedBot/1.0Information URL:
https://blogged.dev/botFAQ
Questions about BloggedBot.
What is BloggedBot?
BloggedBot is Blogged's identified crawler. It visits publicly accessible pages only when an account workflow or authorized free-tool submission needs product context, approved source evidence, competitor context, reusable visual candidates, or a bounded internal-link plan.
What can BloggedBot access?
BloggedBot can request public web pages, robots.txt, sitemaps, feeds, and linked public assets within bounded crawl scopes. It does not bypass authentication, paywalls, private-network protections, or other technical access controls.
How does BloggedBot handle robots.txt?
BloggedBot reads and records robots.txt. For account workflows, the authorized SaaS Internal Link Tool, the SaaS Feature Gap Analyzer's explicitly submitted target and competitor URLs, and the owner-authorized SaaS Blog SEO & AI Visibility Audit target, it may continue reading publicly accessible pages when robots.txt discourages crawling because robots directives are treated as crawler guidance rather than access control. Requests remain identified and technically bounded, and a verified exclusion request overrides the policy.
How can a site owner request an exclusion?
Email hi@blogged.dev with the domain and enough information to verify the request. Blogged can add the domain and its subdomains to the crawler exclusion policy.
Request a crawler exclusion.
Email the domain and enough information to verify the request. Blogged can add the domain and its subdomains to the crawler exclusion policy.
Email hi@blogged.dev