toolsko

Choose your language

ToolsKo is written in English. Prefer another language? Open a translated version of this public page.

Browser language suggestion: English. You can choose any language below.

Translation opens in a new tab using Google Translate. It receives this public page URL. Automatic translations may contain mistakes; use the original English page for tool inputs, downloads, and generated documents.

Your choice is remembered on this browser when storage is available. Use Language in the header to change it.

Robots.txt Generator

Generate a small crawler-rule file and optional sitemap line.

Tool inputs stay in your browser · optional AI search sends your query

Good to know: Robots rules request crawler behavior; they do not secure private pages or guarantee deindexing. Never put secrets in public robots.txt. Empty disallow list permits crawling. Review paths before publishing.

How to use it (step by step)

  1. 1Fill in the boxes: “Disallow paths (one per line)”, “Public sitemap URL”. Example numbers are already there so you can see how it works; replace them with yours.
  2. 2The result updates instantly as you type (on a phone it is below the boxes).
  3. 3The bold line is the main answer. Tap Copy next to any value to copy it.

Words to know

Sitemap
A file that lists all your pages so Google and Bing can find them.
Public vs private IP
Your router gives each device a private IP (like 192.168.1.5) at home. The internet only sees one public IP for your whole house.
Array / list
An ordered collection of items, like ["apple", "banana"]. Every programming language has one.

More in Developer

Text to BinaryConvert text to 8-bit binary and binary back to text.Morse Code TranslatorTranslate text to Morse code and Morse back to text.URL ParserInspect a URL’s host, path and query parameters without visiting it.JSON FlattenerFlatten JSON values to escaped JSON Pointer paths.JSON to TypeScript TypesGenerate a TypeScript type from a JSON example.JSON Schema GeneratorCreate a draft JSON Schema from an example object.