|
Feeds
- Downloads
- FAQ
- News
- Tutorials
|
|
|
More information | PHP-Nuke and robots.txt |
Tutorial published by: kguske, on 2005-11-09
|
|
|
What should be excluded in robots.txt? | The robots.txt file is used to tell search engine robots which files NOT to include when crawling a site. Since all PHP-Nuke functions are handled through the modules.php and admin.php files, all other directories should be excluded. Since the admin.php functions are for administrators only, this file should also be specifically excluded.
NOTE: excluding the modules directory will NOT harm your search engine saturation. |
|
|
|