|
|
|||||||||
|
|||||||||
| |||||||||
|
|
|
| |||||||||
![]() |
|
|
«
Previous Thread
|
Next Thread
»
|
Thread Tools | Search this Thread | Rate Thread | Display Modes |
|
|
|
You eat, breathe and sleep innovation. Build your mobile intelligence with BlackBerry® experts this July. Register Today! |
|
#1
|
|||
|
|||
|
bots and crawlers (google)
Greetings! I've recently discovered that these forums are crawled by google's bots.
How do I know this? I did a search on my username (which I hope to be unique on the internet), and found a link from google into the Site Forum: Administrative. It's no big deal, really... But I thought it was interesting that it got crawled, despite it being "password protected". I'm assuming its crawlability was not intentional, and didn't know if any of you wonderful moderators were interested in tackling this obscure issue... =D Cheers! |
|
#2
|
||||
|
||||
|
RE: bots and crawlers (google)
Hehe, interesting. Did you have a look at google's cache on that page? Did you see the messages on the "private" forum?
|
|
#3
|
|||
|
|||
|
RE: bots and crawlers (google)
i don't understand what you are saying. can/could you read any of the messages in the admin forum?
judging to google cach, google couldn't, it just indexed the forum page asking for password.. |
|
#4
|
|||
|
|||
|
RE: bots and crawlers (google)
I just now did a search on google with your codename as the search criteria.
Hey! I don't think that google listing is doing any harm or you can read private messages going on at the administrative forum. Zombie was right! The link was to the password verification page which only admins can go through it. And I think you spotted your name on "Today's Birthdays" listing! |
|
#5
|
|||
|
|||
|
RE: bots and crawlers (google)
CodeKadiya is correct. Your name was just in the birthday listing. Google can't crawl the admin forums
|
|
#6
|
|||
|
|||
|
RE: bots and crawlers (google)
ahh.. Yes, I see the format now.
I guess that should be a comment on the long lasting effects of caching then. Cause my birthday was half a year away in July! Thanks for entertaining my somewhat entertaining find. |
|
#7
|
|||
|
|||
|
RE: bots and crawlers (google)
Quote:
Hummm, You'll find many more things than this when you spend more time! :uhoh: |
![]() |
| Viewing: Codewalkers Forums > Forum Information > Suggestions & Feedback > bots and crawlers (google) |
| Thread Tools | Search this Thread |
| Display Modes | Rate This Thread |
|
|
|
|
![]() |
|