Robots.txt, php.ini, .htaccess, etc

by BugWhisperer   Last Updated August 05, 2019 09:04 AM

This will be my first website, so I am completely new to all of this.

I cannot seem to find an answer anywhere, as to whether or not I should disallow configuration files like /php.ini or hidden files like /.htaccess?

I have read elsewhere on ProWebmasters that we should not disallow: /*.js$ or /*.css$, but those answers were almost a decade old!

And what about stuff like /includes or /includes/connect_to_database.php?

Even Google's own document regarding robots.txt do not seem to cover this stuff. Is anybody aware of informative resources somewhere on the web relating to this stuff?


Related Questions

Updated August 09, 2019 14:04 PM

Updated September 16, 2019 20:04 PM

Updated July 06, 2017 08:04 AM

Updated September 19, 2018 07:04 AM

Updated February 03, 2018 11:04 AM