Network crawler LARBIN source code
This is open source, developed by the French.
There is a detailed English version of configuration instructions and methods.
Installed in All BSD Platforms (FreeBSD / NetBSD / OpenBSD / Apple Mac OS X), All Posix (Linux / BSD / Unix-like Oses), FreeBSD, Linux
Programming Language: C
download link:
http://par.2288.org/artandsoft.asp?action=content&ID=48
