Is thier a robot.txt file for google bot?

Author

Message

CodyT07
Guru
Guru

Virtual Cash: 2530

Joined: 22 Mar 2006
Posts: 3418
Location: Smyrna, Rutherford County, Tennessee
Add Karma

rated by 21 members
Add Comment
Show Comments

Posted: Fri Jul 07, 2006 7:52 am Post subject: Is thier a robot.txt file for google bot?

I was searching info on google bot and i found this link http://www.google.com/support/web...er.py?answer=40362&topic=8846 and this one http://www.google.com/support/webmasters/bin/topic.py?topic=8843 I was wondering is some of the files metioned on it are on My Free Forum. and if so can we use them. _________________ Number 92, Right Guard Offensive Line. Smyrna Bull Dog FOOTBALL TemplateTester and Link Exchange

admin (no pm's please)
Site Admin

Virtual Cash: 42950

Joined: 22 May 2005
Posts: 19352

Add Karma

rated by 157 members
Add Comment
Show Comments

Posted: Fri Jul 07, 2006 9:17 am Post subject:

robots.txts files are used to block places you don't want the bots to go, in the case of a forum there is very little in this category. Remember the search engine bots are already blocked from private areas. _________________ Family Friendly Shareware \| \| Web Design/Services \| Free Forums forum.myfreeforum.org

CodyT07
Guru
Guru

Virtual Cash: 2530

Joined: 22 Mar 2006
Posts: 3418
Location: Smyrna, Rutherford County, Tennessee
Add Karma

rated by 21 members
Add Comment
Show Comments

Posted: Fri Jul 07, 2006 6:25 pm Post subject:

admin wrote:

robots.txts files are used to block places you don't want the bots to go, in the case of a forum there is very little in this category. Remember the search engine bots are already blocked from private areas.

What about (on some forums) spam areas. Prevent them to go into that area without blocking the rest of the members.
_________________

Number 92, Right Guard Offensive Line. Smyrna Bull Dog FOOTBALL
TemplateTester and Link Exchange

CodyT07
Guru
Guru

Virtual Cash: 2530

Joined: 22 Mar 2006
Posts: 3418
Location: Smyrna, Rutherford County, Tennessee
Add Karma

rated by 21 members
Add Comment
Show Comments

Posted: Sun Jul 16, 2006 5:15 am Post subject:

Ah i see there is one, http://linkexchange.myfastforum.org/robots.txt _________________ Number 92, Right Guard Offensive Line. Smyrna Bull Dog FOOTBALL TemplateTester and Link Exchange