http://www.royans.net/arch/crawling-sucks/?utm_source=rss&utm_medium=rss&utm_campaign=crawling-sucks Building reliable, high performance, highly available clusters Sat, 13 Mar 2010 15:42:19 +0000 http://wordpress.org/?v=2.9.2 hourly 1 http://www.royans.net/arch/crawling-sucks/comment-page-1/#comment-99 Abhishek Wed, 18 Mar 2009 08:05:27 +0000 http://www.royans.net/arch/2007/10/22/crawling-sucks/#comment-99 Very interesting narrative. I'm trying something similar. You might want to try out sphinxsearch for a MUCH faster indexing service. (http://www.sphinxsearch.com/) Let me know if you're making something new... Very interesting narrative.
I’m trying something similar. You might want to try out sphinxsearch for a MUCH faster indexing service. (http://www.sphinxsearch.com/)
Let me know if you’re making something new…

]]> http://www.royans.net/arch/crawling-sucks/comment-page-1/#comment-89 Ade Tue, 27 Nov 2007 14:03:50 +0000 http://www.royans.net/arch/2007/10/22/crawling-sucks/#comment-89 Interesting post. We've been working on a crawler in Python for something similar. Mainly to see what we could do, but its a fascinating area (crawlers) and I too have a lot of respect for people who do this as their day job. Happy to share experiences Interesting post. We’ve been working on a crawler in Python for something similar. Mainly to see what we could do, but its a fascinating area (crawlers) and I too have a lot of respect for people who do this as their day job. Happy to share experiences

]]>