|
|
|||||||||
|
|||||||||
| |||||||||
|
|
|
| ||||||||||||||||||||||||||
![]() |
|
|
«
Previous Thread
|
Next Thread
»
|
Thread Tools | Search this Thread | Rate Thread | Display Modes |
|
#1
|
|||
|
|||
|
Building a webcrawler?
i hope this isn't difficult i just about finished my site, now i want to populate it.
I have an insert form with 4 fields(url, name, info, keywords). i want a webcrawler to go around the web collecting and inserting into these 4 fields and submitting. how would i go about this is it difficult? whats the easiest language to do this in? |
|
#2
|
|||
|
|||
|
well for starters javascript probably wouldn't work (that is the forum you posted in). you would probably be best making an actual program (like c#,c++,basic) to manually surf the web. problem with using php is mostly its timing out. you could use php and any of the fopen/file_get_* functions to get pages and regular expressions/text searches to find whatever you want on a page and submit it.
|
![]() |
| Viewing: Codewalkers Forums > Other Technologies > Client Side Things > Building a webcrawler? |
| Thread Tools | Search this Thread |
| Display Modes | Rate This Thread |
|
|
|
|
|