| Why/Where
is it? |
|
|
|
|
|
|
|
|
|
|
|
| w | Pages
are ordinary, but excluded by |
|||||||||
| n | Webmaster:� Robots Exclusion Protocol, |
|||||||||
| �� which is implemented by including a file
such as |
||||||||||
| www.mysite.com/robots.txt, containing |
||||||||||
| ������ User-agent:� * |
||||||||||
| ������ Disallow:� / |
||||||||||
