A robots.txt file is a text document that provides instructions to search engine crawlers. It indicates the specific pages on your website that they are allowed or not allowed to access.
To add your robots.txt to your website:
- Go to "Settings" (on the top of the builder) and select "Settings";
- Select "robots.txt";
- Press enable robots.txt;
- Insert your script and click "Apply".