IT Planet | The Planet of IT & Love
Asalam-o-Alaikum Dear Guest, Welcome to IT Planet

Please Login to this website. After you Login, You can post topics of your choice in this website and replies to any existing topic you like in this website. So do a Login by clicking the "Log in" button below and start posting.....

If you are not registered, then click "Register" button below to register yourself and then Login.....

THE MISSING LINKS

Go down

THE MISSING LINKS

Post by Raja Abro on Fri Oct 30, 2009 9:03 pm

The missing links

Most of the Web Administrators use a file called robots.txt to tell
search engines which pages in the site not to index. That means, of course, you can use that same robots.txt file to find some of the cute stuff that's hiding in a particular site. You may find some of the pages are password protected or otherwise off limits, but you can nevertheless enjoy some interesting browsing.

To get a look at robots.txt, type the address [You must be registered and logged in to see this link.] (substituting the correct domain name for 'sitename'). You can then try appending the listed files to the site's main URL.

_________________
Co-Admin<br>IT PLANET Team
avatar
Raja Abro
Co-Administrator
Co-Administrator

Posts : 550
Join date : 2009-09-17
Age : 28
Location : hyderabad

http://www.iturdupk.tk

Back to top Go down

Back to top

- Similar topics

 
Permissions in this forum:
You cannot reply to topics in this forum