IT Planet | The Planet of IT & Love
Asalam-o-Alaikum Dear Guest, Welcome to IT Planet

Please Login to this website. After you Login, You can post topics of your choice in this website and replies to any existing topic you like in this website. So do a Login by clicking the "Log in" button below and start posting.....

If you are not registered, then click "Register" button below to register yourself and then Login.....


Go down


Post by Raja Abro on Fri Oct 30, 2009 9:03 pm

The missing links

Most of the Web Administrators use a file called robots.txt to tell
search engines which pages in the site not to index. That means, of course, you can use that same robots.txt file to find some of the cute stuff that's hiding in a particular site. You may find some of the pages are password protected or otherwise off limits, but you can nevertheless enjoy some interesting browsing.

To get a look at robots.txt, type the address [You must be registered and logged in to see this link.] (substituting the correct domain name for 'sitename'). You can then try appending the listed files to the site's main URL.

Co-Admin<br>IT PLANET Team
Raja Abro

Posts : 550
Join date : 2009-09-17
Age : 28
Location : hyderabad

Back to top Go down

Back to top

- Similar topics

Permissions in this forum:
You cannot reply to topics in this forum