SunQuest
           Suggestions & Feedback
 
Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
User Name:
Password:
Remember me
Go Back   Codewalkers ForumsForum InformationSuggestions & Feedback

Reply
Add This Thread To:
  Del.icio.us   Digg   Google   Spurl   Blink   Furl   Simpy   Y! MyWeb 
Thread Tools Search this Thread Rate Thread Display Modes
 
Unread Codewalkers Forums Sponsor:
You eat, breathe and sleep innovation. Build your mobile intelligence with BlackBerry® experts this July. Register Today!
  #1  
Old January 8th, 2004, 06:24 AM
ektoric ektoric is offline
Codewalkers Newbie (0 - 499 posts)
 
Join Date: Apr 2007
Location: Austin, TX, USA
Posts: 4 ektoric User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: < 1 sec
Reputation Power: 0
bots and crawlers (google)

Greetings! I've recently discovered that these forums are crawled by google's bots.

How do I know this? I did a search on my username (which I hope to be unique on the internet), and found a link from google into the Site Forum: Administrative.

It's no big deal, really... But I thought it was interesting that it got crawled, despite it being "password protected". I'm assuming its crawlability was not intentional, and didn't know if any of you wonderful moderators were interested in tackling this obscure issue... =D

Cheers!

Reply With Quote
  #2  
Old January 8th, 2004, 06:59 AM
tkarkkainen's Avatar
tkarkkainen tkarkkainen is offline
Moderator
Click here for more information
 
Join Date: Apr 2007
Location: Finland
Posts: 2,320 tkarkkainen User rank is Lance Corporal (50 - 100 Reputation Level)tkarkkainen User rank is Lance Corporal (50 - 100 Reputation Level)tkarkkainen User rank is Lance Corporal (50 - 100 Reputation Level)  Folding Points: 10987 Folding Title: Novice Folder
Time spent in forums: 6 Days 8 h 49 m 26 sec
Reputation Power: 4
RE: bots and crawlers (google)

Hehe, interesting. Did you have a look at google's cache on that page? Did you see the messages on the "private" forum?

Reply With Quote
  #3  
Old January 8th, 2004, 08:32 AM
zombie zombie is offline
Codewalkers Intermediate (1500 - 1999 posts)
 
Join Date: Apr 2007
Location: serbia
Posts: 1,876 zombie User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: < 1 sec
Reputation Power: 3
RE: bots and crawlers (google)

i don't understand what you are saying. can/could you read any of the messages in the admin forum?

judging to google cach, google couldn't, it just indexed the forum page asking for password..

Reply With Quote
  #4  
Old January 8th, 2004, 08:46 AM
CodeKadiya CodeKadiya is offline
Codewalkers Regular (2000 - 2499 posts)
 
Join Date: Apr 2007
Location: Colombo,Sri Lanka
Posts: 2,313 CodeKadiya User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: < 1 sec
Reputation Power: 4
Send a message via Yahoo to CodeKadiya
RE: bots and crawlers (google)

I just now did a search on google with your codename as the search criteria.

Hey! I don't think that google listing is doing any harm or you can read private messages going on at the administrative forum. Zombie was right! The link was to the password verification page which only admins can go through it. And I think you spotted your name on "Today's Birthdays" listing!

Reply With Quote
  #5  
Old January 8th, 2004, 01:05 PM
Matt Matt is offline
Moderator
Codewalkers Specialist (4000 - 4499 posts)
 
Join Date: Apr 2007
Location: Florida
Posts: 4,158 Matt User rank is Private First Class (20 - 50 Reputation Level)Matt User rank is Private First Class (20 - 50 Reputation Level) 
Time spent in forums: 4 h 10 m 20 sec
Reputation Power: 6
RE: bots and crawlers (google)

CodeKadiya is correct. Your name was just in the birthday listing. Google can't crawl the admin forums ..

Reply With Quote
  #6  
Old January 8th, 2004, 08:20 PM
ektoric ektoric is offline
Codewalkers Newbie (0 - 499 posts)
 
Join Date: Apr 2007
Location: Austin, TX, USA
Posts: 4 ektoric User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: < 1 sec
Reputation Power: 0
RE: bots and crawlers (google)

ahh.. Yes, I see the format now.

I guess that should be a comment on the long lasting effects of caching then. Cause my birthday was half a year away in July!

Thanks for entertaining my somewhat entertaining find.

Reply With Quote
  #7  
Old January 9th, 2004, 12:17 AM
CodeKadiya CodeKadiya is offline
Codewalkers Regular (2000 - 2499 posts)
 
Join Date: Apr 2007
Location: Colombo,Sri Lanka
Posts: 2,313 CodeKadiya User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: < 1 sec
Reputation Power: 4
Send a message via Yahoo to CodeKadiya
RE: bots and crawlers (google)

Quote:
ahh.. Yes, I see the format now.

Hummm, You'll find many more things than this when you spend more time! :uhoh:

Reply With Quote
Reply

Viewing: Codewalkers ForumsForum InformationSuggestions & Feedback > bots and crawlers (google)


Thread Tools  Search this Thread 
Search this Thread:

Advanced Search
Display Modes  Rate This Thread 
Rate This Thread:


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
View Your Warnings | New Posts | Latest News | Latest Threads | Shoutbox
Forum Jump


Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
  
 

IBM developerWorks




© 2003-2008 by Developer Shed. All rights reserved. DS Cluster 6 hosted by Hostway