Magidoc

Deployment - Google Indexing

If you wish your website to be indexed and searchable on Google, you will need to provide a custom robots.txt , which allows your website to be crawled by search engines.

Magidoc configuration

#

You need to use staticAssets to provide a robots.txt .

    
  

Robots file

#

Once this is done, you need to create a robots.txt file inside the assets directory.

    
  

The minimal content you can put in there is the following, which allows Google to crawl everything on your website.