XML Sitemap Generator
Turn a list of page URLs into a valid sitemap.xml with optional dates, frequency and priority.
Robots.txt Generator
Tell crawlers where they may go. The file is built in your browser and you download it.
Your files stay with you. Your files never leave your browser. This tool runs on your device: nothing is uploaded to our servers, so there is nothing for us to store or see.
How to use it
- Choose whether to allow crawling and list any paths to block.
- Add your sitemap URL and tick any bots you want to block.
- Download robots.txt and upload it to the top level of your site.
Questions people ask
Does robots.txt hide a page from Google?
Not reliably. It asks well-behaved crawlers not to fetch a page, but a blocked page can still be listed if other sites link to it. To keep a page out of results use a noindex tag or password protection.
Where must the file go?
At the root of the site, for example https://example.com/robots.txt. A file in a sub-folder is ignored.
Will blocking AI crawlers work?
It is a request, not a lock. Bots from major AI companies say they follow it, but not every crawler does.
Why does Google ignore my crawl delay?
Google does not support the Crawl-delay line. Bing and some other crawlers do.
Want this inside your own account?
Marketiism keeps your invoice numbers, GST reports, UPI payment links and WhatsApp reminders in one place. Leave your details and we'll call to set it up for your business, or start the trial yourself.
More SEO tools
.htaccess Redirect Generator
Create Apache redirect rules for moved pages, plus force HTTPS and www or non-www.
Meta Tag Generator
Write the title, description, robots, canonical and viewport tags for a page, ready to paste.
Open Graph Generator
Create Open Graph and X (Twitter) card tags and preview how your link looks when shared.
SERP Snippet Preview
See how your title and description may look in search results, with character and pixel estimates.
Keyword Density Checker
Count the most repeated words and 2 or 3 word phrases in your text, with percentages.