*********************************************************** *********************************************************** **
Package: Parker-2003.8.20-by-leo.tar.gz
*********************************************************** *********************************************************** **
PARKER is a Linux FTP Search Engine Service Pack, which is written by Jiri A. Randus, and then improved by domestic masters, this version is a large number of modifications to the Chinese version of Xi'an. Because the FTP in education is still very practical, it is very necessary to collect and find each FTP.
If you want, I hope this package can bring some convenience to friends you need. Download URL: http://sourceforge.net/projects/parker
*********************************************************** *********************************************************** **
Displays
*********************************************************** *********************************************************** **
1 It is recommended to put the changed data under / VAR.
Log in with root,
Unlock the file package (if you have been unopened, you can copy the past)
[root @ Linux /] $ CD / VAR
[root @ Linux / var] $ TAR VXZF PARKER-200X-X-xx.tar.gz
#MKDIR / VAR / WWW / CGI-BIN / PARKER
#CP / VAR / PARKER / HTML / PARKER / VAR / WWW / HTML / PARKER -R
2 Set read and write permissions for each file
Chown noBody.nobody / var / parker -r
CHMOD 770 / VAR / PARKER -R
Nobody is the execution user of CGI.
3 Modify the source file path: Modify file src / makefile, bin / makestat, bin / flashdata
File SRC / Makefile: Parker_Home = / VAR / PARKER (installation directory)
CGI_HOME = / VAR / WWW / CGI-BIN / PARKER (CGI directory)
File BIN / MAKESTAT:
PARKERDIR = / var / parker (installation directory)
File BIN / FLASHDATA:
/ var / parker / bin / collect
/ var / parker / bin / makestat
4 According to the preference modification, the CGI output interface SRC / CGI * is modified as needed, mainly modify the output appearance of the page, the main output function is 370 Putheaders (void) 386 search (void) 494 Void Putend (void) also has a display definition file SRC / LANGUAGE .h 5 Recompack code #cd src #make #make install 6 Configure crontab so that you can update data crontab -u parker -e (Enter) 1 * * * / var / parker / bin / flashdata% (here is here Update every day, enter the above content save exit!) 7 Edit Site list file / var / parker / etc / collectlist
8 Execute commands to collect data: [Root @ Linux / var / parker / bin] $ ./flashdata
9 Test Search Engine HTML is the page example I have. Http://localhost/parker/index.html 10 Precautions (Guof)
10.1 Note the read and write permission and ownership of the file. All files under PARKER / LOG are set to
[root @ Linux / var / parker] # chmod 777 log -r
10.2 Pay attention to the firewall settings! IPTables will be configured to block the search for external FTP
10.3 Note Directory Information in Parker / BIN (Makestat and FlashData)! All modified
Makestat: ParkerDir = / VAR / PARKER (installation directory)
FlashData: / var / parker / bin / collect
/ var / parker / bin / makestat
*********************************************************** ************ * The following is the role and arrangement of each file and directory: *********************** *********************************************** BIN /: Collect [-l | -r | D] [FTP Site] to collect FTP site data, FTP site definition is placed in lzodata after ETC / CollectList data compression. Temporary Work Contents In TMP /, the site statistics are placed in Statist / lower parameters as follows: -l Use the list -lr command to list the directory on the service area; -D Get the directory by downloading a file similar to the LS-LR.TGZ. (Some servers will be set up on the time. -R Automatically enters the list of the entire directory. The default call order is -L, -D, -r search for FTP sites in ETC / CollectList
FlashData updates the data scheduling file. Call Collect and Makestat
Convertmask Put the Education Network from http://www.neic.edu.cn/rs/ipstat/internalip/ Update to $ PARKER / HOSTDATA / EDU.MASK Reputation The file format is as follows: Host Subnet Netmask such as 202.119 .32.00.0.31
.255 255.255.224.0 How to use: Set the copy of the file to list.txt, execute Convertmask List.txt
FlashList After a while, a large $ parker / etc / onworkHost can come out, backup files in $ PARKER / ETC / BackList
Listfilter converts the collected FTP site list to ONWORKHOST
GetDnsName
Makestat sorts a variety of files on the FTP site for Statist, you can analyze different sites for different files.
LZO_COMP uses the directory data to compress the program with the LZO algorithm. The part read is performed directly by Search.
SRC /: Makefile Make defines file config.h directory, file, directory definition, make by conf.head and conf.End Parker.h header file, definition of each program,
Collect.c Collect the c code source program of FTP site data Collect.h header file listfilter.c to compare some automatic FTP site list files to extract from IP, such as files OldList.txt as follows: --------- ------------------------------ South University FTP: 202.119.32.32 Jiaotong FTP: XXX.XXX.XXX.XX "Good" 202.119 .46.57 Tsinghua 166.111.19.56 .......... ........ -------------------------- ------------- Use the command "Listfilter Oldlist", you can get -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------- 202.119.32.101 xxx.xxx.xxx.xx 166.111.19.56 ........... --------------- --------------------
GetDnsName.c -> bin / getdnsname Get IP DNS Domain Name Convertmask.c Put the free IP definition list from http://www.neic.edu.cn/rs/ipstat/internalip/ to $ PARKER / HOSTDATA / EDU .mask common.c gets some common functions such as the domain name and other information such as the domain name and other information. CGI -
LZODATA /: Only stores the collected directory data, and stores in the compressed format with IP.
HostData /: The information of the station, IP.INFO is the corresponding domain name, $ IP.STAT's statistics of each FTP, the last collection to the original data of Stat Stat statistics Others Sort by different requirements Inn.mask is the interior of Nanjing University The IP definition of the network, nju.mask is the definition of the official IP of Nanjing University. Edu.mask is the IP definition of education network (free)
Log /: Search.log users Search for a full record search key.log Search for keyword record Submit.log users Recommended Site Record
TMP /: Work Contents
######################################################################################################################################################################################################################################################################################################## ########################################################################################################################################################################################################################################################################################################### ######################################################################################################################################################################################################################################################################################################## ####### 4.0 (
May-8-2001
) (1) Support multi keywords, exclusion and filename extention. (2) FTP site Statistic, include number of files, sepcial archives like .rm, .mp3, Linux files (tar, gz, bz2), and show the last updata time (4) sort the ureshest site. According to ip. (5) Remove Many Useless Features, Include Interface of Telnet, Gopher and dos utils. (6) Remove Btree, Less Memory Request, Less HardDisk space. Can Contain More Site, More Data. If you use btree, it is more than
100M
Original data makes it need more than
250M
Memory, there are many servers that have many servers will fail after reaching 150 sites. (7) Online recommendation FTP site, Detect The Site IP, DNS Name and Scope. And Collect Site Data Automaticly.
4.1 (
May-20-2001
(1) Save the directory data using the LZO compression algorithm, saving hard disk space, greatly improves search speed. Original
100M
Data compression
30m
Around, it can be automatically placed in the buffer, and the search will not be limited by the hard disk speed. (2) Optimize the key code of the search, greatly increase the search speed. The server uses PIII-450 and searching for 100 sites data for only 4 seconds.
4.2 (
FeB-16-2002
(1) Rewind with the Collection data written by Perl language to rewrite the C language to run on the new Linux version. Including RedHat7.x, Mandrake 8.x (2) Automatically eliminates the site for too long without updating: (3) Multi User Language Supported: English and Chinese (4) Fixed many bugs (5) made some clear code Work, make it more concise; (6) Search list recover domain support, of course, IP
######################################################################################################################################################################################################################################################################################################## ########################### # Operating platform#################### ######################################################################################################################################################################################################################################################################################################## ####### 4.0 Redhat Linux 6.2, PIII-800 4.2 Redhat Linux 7.2, Mandrake Linux 8.1, Celeron 900, PIII-900 has passed the test of Linux WS-FTPD, Windows NT Server
Steff 2002.3.10
