Robots.txt Generator
Build a robots.txt file, including rules that block AI training crawlers, with sitemap lines.
SEO & Marketing
Turn a list of URLs into a valid sitemap.xml, with optional lastmod, changefreq and priority.
Your files and text are processed on your own device, inside this page. Nothing is uploaded to Dubinity or stored, and closing the tab discards it. How privacy works
Paste the URLs you want indexed and get a sitemap file ready to upload. Duplicates and anything that is not a full http(s) URL are reported rather than silently included, and fragments (#section) are stripped because they are not separate pages.
It does not crawl your site - it builds the file from the list you give it. For a crawl you need a crawler.
Was this tool helpful?
Build a robots.txt file, including rules that block AI training crawlers, with sitemap lines.
Format or minify XML and check that it is well formed, with the line and column of any error.
See how a page's title and description will look in Google results, measured in pixels, not characters.
Add campaign parameters to a link and keep the naming consistent across your team.
Check what status a URL returns and follow its redirect chain, hop by hop, with timings.
Build JSON-LD structured data for organisations, local businesses, articles, products, FAQs and jobs.