Deployment - Google Indexing

If you wish your website to be indexed and searchable on Google, you will need to provide a custom robots.txt , which allows your website to be crawled by search engines.

Magidoc configuration


You need to use staticAssets to provide a robots.txt .


Robots file


Once this is done, you need to create a robots.txt file inside the assets directory.


The minimal content you can put in there is the following, which allows Google to crawl everything on your website.