AppletTalk.com Java discussions newsgroups   Archives   FAQ   Search   Memberlist   Usergroups   Register   Profile   Log in to check your private messages   Log in  Open source web crawler          AppletTalk.com Forum Index -> Java Help View previous topic :: View next topic   Author Message Paul Morrison Guest Posted: Wed Oct 26, 2005 1:19 pm    Post subject: Open source web crawler Hi, I have been searching the web for an open source web crawler that takes in a keyword and crawls sites, relaying articles with that keyword. I have seen the one on the Sun website, http://java.sun.com/developer/technicalArticles/ThirdParty/WebCrawler/, but that does not work correctly, it gives no results. I have also tried a lot of crawlers from SourceForge, but to no avail. I was wondering if anyone had used or knows of a web crawler that would be suitable for my needs. Cheers, Paul Morrison Back to top Rhino Guest Posted: Wed Oct 26, 2005 2:05 pm    Post subject: Re: Open source web crawler "Paul Morrison" <crap (AT) nospam (DOT) co.uk> wrote Quote: Hi, I have been searching the web for an open source web crawler that takes in a keyword and crawls sites, relaying articles with that keyword. I have seen the one on the Sun website, http://java.sun.com/developer/technicalArticles/ThirdParty/WebCrawler/, but that does not work correctly, it gives no results. I have also tried a lot of crawlers from SourceForge, but to no avail. I was wondering if anyone had used or knows of a web crawler that would be suitable for my needs. Google? (I mean could you use Google to crawl for the information you want; I'm not suggesting that you do a Google search to find web crawlers.) Rhino Back to top Display posts from previous: All Posts1 Day7 Days2 Weeks1 Month3 Months6 Months1 Year Oldest FirstNewest First         AppletTalk.com Forum Index -> Java Help All times are GMT Page 1 of 1   Jump to: Select a forum Java Newsgroups----------------Java DiscussionsWeb-based java games comp.lang.java 3D Graphics API's for Java Java: Support and criticism Java System Announcements comp.lang.java.api JavaBeans Java and CORBA Java and Databases comp.lang.java.developer Java GUI Toolkits Java Help comp.lang.java.javascript JVM, native methods and hardware comp.lang.java.misc Java Language Programming Security and Java comp.lang.java.setup Java Software Tools comp.lang.java.tech ibm.software.java.linux  Non-English Java Newsgroups----------------Java Language (German)Language Java (Français)Java (Italian)  You cannot post new topics in this forum You cannot reply to topics in this forum You cannot edit your posts in this forum You cannot delete your posts in this forum You cannot vote in polls in this forum Powered by phpBB © 2001, 2006 phpBB Group SEO toolkit © 2004-2006 webmedic.