You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
652 B
652 B
Managing robots.txt
{! backend/administration/CLI_tasks/general_cli_task_info.include !}
Generate a new robots.txt file and add it to the static directory
The robots.txt
that ships by default is permissive. It allows well-behaved search engines to index all of your instance's URIs.
If you want to generate a restrictive robots.txt
, you can run the following mix task. The generated robots.txt
will be written in your instance static directory.
=== "OTP"
```sh
./bin/pleroma_ctl robots_txt disallow_all
```
=== "From Source"
```sh
mix pleroma.robots_txt disallow_all
```