nukeSEO.com - PHPNuke SEO Search engine optimization, professional tools including nukeSEO, nukeSPAM, nukeFEED, nukePIE, nukeWYSIWYG and more

 

. Welcome to nukeSEO.com  ! 
.
.
.


.
nukeSEO.com: Tutorials


[ Tutorials in progress | Top 10 | Tutorials ]


 More information
PHP-Nuke and robots.txt
35167 reads | Write a comment | Comment(s) posted for this tutorial.


What should be excluded in robots.txt?
The robots.txt file is used to tell search engine robots which files NOT to include when crawling a site. Since all PHP-Nuke functions are handled through the modules.php and admin.php files, all other directories should be excluded. Since the admin.php functions are for administrators only, this file should also be specifically excluded.

NOTE: excluding the modules directory will NOT harm your search engine saturation.



Page Generation: 0.05 Seconds