FTP Search

Directory

Content Search

htdig

WWW search system for an intranet or small internet

/Main/Debian/i386/web/

The ht://Dig system is a complete world wide web indexing and searching system for a small domain or intranet. This system is not meant to replace the need for powerful internet-wide search systems like Lycos, Infoseek, Webcrawler and AltaVista. Instead it is meant to cover the search needs for a single company, campus, or even a particular sub section of a web site.

As opposed to some WAIS-based or web-server based search engines, ht://Dig can span several web servers at a site. The type of these different web servers doesn't matter as long as they understand the HTTP 1.0 protocol.

Features: * Intranet searching * It is free * Robot exclusion is supported * Boolean expression searching * Configurable search results * Fuzzy searching * Searching of HTML and text files * Keywords can be added to HTML documents * Email notification of expired documents * A Protected server can be indexed * Searches on subsections of the database * Full source code included * The depth of the search can be limited * Full support for the ISO-Latin-1 character set

Disk space requirements:

The search engine will require lots of disk space to store its databases. Unfortunately, there is no exact formula to compute the space requirements. It depends on the number of documents you are going to index but also on the various options you use. To give you an idea of the space requirements, here is what I have deduced from our own database size at San Diego State University.

If you keep around the wordlist database (for update digging instead of initial digging) I found that multiplying the number of documents covered by 12,000 will come pretty close to the space required.

We have about 13,000 documents: 150MB index size with a 'wordlist' database 93MB index size without a 'wordlist' database

The package is available in two varieties, the 'stable', well-tested version (this one) and a less tested version (as 'htdig3.2').

Info:

Homepage:	-
Package version:	1:3.1.6-11
Architecture:	i386
Distribution:	Debian
Filename:	htdig_3.1.6-11_i386.deb

Browse inside htdig_3.1.6-11_i386.deb:

Download htdig_3.1.6-11_i386.deb:

2004-02-12  ftp://ftp.3logic.net/.1/debian-archive/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2004-02-12  ftp://ftp.wustl.edu/pub/linux/distributions/debian/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2004-02-12  ftp://sapi.vlsm.org/.1/debian/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2004-11-29  ftp://ftp.uni-duesseldorf.de/pub/unix/linux/distributions/debian/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2004-02-11  ftp://ftp.csie.chu.edu.tw/pub2/Debian/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2004-02-12  ftp://ftp.linux.pt/pub/mirrors/debian/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2004-02-11  ftp://ftp.school.ioffe.ru/pub/mirrors/debian/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2004-02-12  ftp://ftp.cs.nott.ac.uk/sites/ftp.debian.org/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2004-02-12  ftp://200.17.202.16/debian-dists/debian/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2005-02-10  ftp://ftp.efrei.fr/pub/mirrors/linux/distributions/debian/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2005-02-10  ftp://cudlug.cudenver.edu/debian/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2005-02-10  ftp://ftp.cstone.net/debian/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2005-02-10  ftp://ftp.uk.debian.org/debian/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2005-02-10  ftp://200.17.202.17/debian-dists/debian/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2005-08-06  ftp://ftp.ncku.edu.tw/Linux/Debian/debian/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2005-02-10  ftp://ftp.funet.fi/.m/mirrors3/ftp.debian.org/debian/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2005-02-10  ftp://ftp.gnome.org/cdimage/snapshot/Debian/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2005-02-10  ftp://ftp.gnome.org/cdimage/.debian-mirror/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2005-02-10  ftp://ftp.gva.es/mirror/debian2/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2005-02-10  ftp://ftp.hosteurope.de/mirror/ftp.debian.org/debian-archive/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2005-08-07  ftp://ftp.nsysu.edu.tw/Linux/Debian/debian/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2005-02-10  ftp://ftp.itb.ac.id/pub/debian/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2005-02-10  ftp://core.ring.gr.jp/pub/linux/debian/debian/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2005-02-10  ftp://202.18.64.24/pub/linux/debian/debian/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2005-02-10  ftp://194.65.100.43/pub/debian/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2005-02-10  ftp://194.65.100.42/ftp2/debian/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2005-02-10  ftp://204.152.191.7/debian/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2005-02-10  ftp://ftp.blackstar.co.uk/pub/debian/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2005-02-10  ftp://ftp.fh-niederrhein.de/pub/debian/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2005-02-10  ftp://82.159.136.126/mirror/debian2/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2005-02-10  ftp://ftp.aist-nara.ac.jp/0/Linux/debian/debian/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2005-02-10  ftp://193.145.205.32/mirror/debian2/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2005-02-10  ftp://192.87.102.42/vol/4/linux-debian/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2005-02-10  ftp://192.87.102.43/vol/4/linux-debian/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2005-02-10  ftp://133.37.44.6/pub/linux/debian/debian/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2005-02-10  ftp://ftp.twaren.net/pub/Linux/Debian/debian/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2005-02-10  ftp://ftp.cpan.nl/pub/debian/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2005-02-10  ftp://ftp.task.gda.pl/vol/zfs/ftp.debian.org/pub/debian/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2005-02-10  ftp://wt t0_Series004_z005_ch01.tif/pub/mirrors/debian2/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2005-02-10  ftp://194.65.100.42/pub/debian/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2005-02-10  ftp://ftp.lip6.fr/pub/linux/distributions/debian/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2005-02-10  ftp://130.239.18.173/cdimage/snapshot/Debian/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2005-02-10  ftp://ftp.nz.kernel.org/pub/debian-archive/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2005-02-10  ftp://130.239.18.137/cdimage/snapshot/Debian/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2005-02-10  ftp://ftp.debian.de/archive/debian/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2005-02-10  ftp://194.65.100.43/ftp2/debian/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2005-02-10  ftp://ftp2.nl.freebsd.org/debian-cdimage/snapshot/Debian/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2005-02-10  ftp://ftp2.nl.freebsd.org/debian-archive/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2005-02-10  ftp://ftp.tu-chemnitz.de/.SAN0/pub/linux/debian/debian-archive/pool/main/h/htdig/htdig_3.1.6-11_i386.deb
2005-02-09  ftp://ftp.cs.rose-hulman.edu/debian/pool/main/h/htdig/htdig_3.1.6-11_i386.deb