Is thier a robot.txt file for google bot?

Author

Message

CodyT07
Guru
Guru

Virtual Cash: 2590

Joined: 22 Mar 2006
Posts: 3424
Location: Smyrna, Rutherford County, Tennessee
Add Karma

rated by 21 members
Add Comment
Show Comments

Posted: Fri Jul 07, 2006 7:52 am Post subject: Is thier a robot.txt file for google bot?

I was searching info on google bot and i found this link http://www.google.com/support/web...er.py?answer=40362&topic=8846 and this one http://www.google.com/support/webmasters/bin/topic.py?topic=8843 I was wondering is some of the files metioned on it are on My Free Forum. and if so can we use them. _________________ TemplateTester and Link Exchange

admin (no pm's please)
Site Admin

Virtual Cash: 46230

Joined: 22 May 2005
Posts: 19679

Add Karma

rated by 164 members
Add Comment
Show Comments

Posted: Fri Jul 07, 2006 9:17 am Post subject:

robots.txts files are used to block places you don't want the bots to go, in the case of a forum there is very little in this category. Remember the search engine bots are already blocked from private areas. _________________ Family Friendly Shareware \| \| Web Design/Services \| Free Forums forum.myfreeforum.org

CodyT07
Guru
Guru

Virtual Cash: 2590

Joined: 22 Mar 2006
Posts: 3424
Location: Smyrna, Rutherford County, Tennessee
Add Karma

rated by 21 members
Add Comment
Show Comments

Posted: Fri Jul 07, 2006 6:25 pm Post subject:

admin wrote:

robots.txts files are used to block places you don't want the bots to go, in the case of a forum there is very little in this category. Remember the search engine bots are already blocked from private areas.

What about (on some forums) spam areas. Prevent them to go into that area without blocking the rest of the members.
_________________

TemplateTester and Link Exchange

CodyT07
Guru
Guru

Virtual Cash: 2590

Joined: 22 Mar 2006
Posts: 3424
Location: Smyrna, Rutherford County, Tennessee
Add Karma

rated by 21 members
Add Comment
Show Comments

Posted: Sun Jul 16, 2006 5:15 am Post subject:

Ah i see there is one, http://linkexchange.myfastforum.org/robots.txt _________________ TemplateTester and Link Exchange