🥳 Happy New Year: 20% off all annual plans! Plans starting at $11.99/month. Use code 2025 at checkout. See pricing
Create a proper robots.txt file for your website to control search engine crawling
Leave as * for all robots or specify a user agent (e.g., Googlebot)
Enter one path per line (e.g., /admin/)
Enter one path per line (e.g., /blog/)
Optional: Add your sitemap URL
A robots.txt file is a crucial component of your website's SEO strategy. It tells search engine crawlers which pages they can or cannot access on your site. This helps optimize crawl budget, protect sensitive content, and ensure the right pages are being indexed.
Our tool simplifies the process of creating a proper robots.txt file, helping you control search engine access to your website without any technical knowledge.
Generate a robots.txt file that follows current SEO guidelines, ensuring proper crawling and indexing of your website while protecting sensitive content.
Discover our complete collection of free SEO and marketing tools
Create engaging meta descriptions that drive clicks to your website
Generate optimized SEO titles for your web pages
Group your keywords into semantically related clusters using AI
Create comprehensive SEO content strategies with AI-powered topical mapping
Create engaging Instagram captions with hashtags and emojis using AI
Small SEO tools also have big data
Keywords
Fueling your detailed Keyword Research on Clicks.
Backlinks
12B+ new backlinks added every 24 hours.
Locations
Worldwide SEO insights, so you can rank globally.
Pages
Building our live SERP results for our keyword index.
Affordable SEO Data Packages
|
Starter
|
Pro
|
Agency
|
|
|---|---|---|---|
| Price |
$14.99
/month
Billed annually at $179.99
Save $120/year
|
$29.99
/month
Billed annually at $359.99
Save $240/year
|
$44.99
/month
Billed annually at $539.99
Save $360/year
|
| Keyword Research | |||
| Reports per month |
100
|
250
|
500
|
| Related Keywords per Report |
Up to 500
|
Up to 750
|
Up to 1000
|
| Phrase Match Keywords per Report |
Up to 500
|
Up to 750
|
Up to 1000
|
| Site Stats | |||
| Reports per month |
100
|
200
|
400
|
| Top Keywords Per Site Report |
Up to 500
|
Up to 750
|
Up to 1000
|
| Top Pages Per Site Report |
Up to 200
|
Up to 500
|
Up to 1000
|
| Competitor Domains Report | |||
| Backlink Analysis | |||
| Reports per Month |
100
|
200
|
400
|
| Backlink Rows per Report |
Up to 500
|
Up to 750
|
Up to 1000
|
| Top Backlink Pages Per Report |
Up to 200
|
Up to 500
|
Up to 1000
|
| Anchor Reports | |||
| Backlink Competitor Domains | |||
| Site Audits | |||
| Audits per Month |
Up to 10
|
Up to 20
|
Up to 40
|
| Pages Crawled Per Audit |
Up to 1000
|
Up to 4000
|
Up to 6000
|
| Projects | |||
| Number of Projects |
5
|
10
|
15
|
| Rank Tracking New | |||
| Monthly Credits |
50
|
100
|
250
|