# www.robotstxt.org # https://developers.google.com/webmasters/control-crawl-index/docs/robots_txt # For all bots User-agent: * # Some irrelavant folders Disallow: /files/ Disallow: /log/ Disallow: /dev/ # Point to sitemap file Sitemap: https://www.elmec.nl/sitemap.xml # Use the domain to index (ignores all aliasses, also ignores domain without www) Host: www.elmec.nl