Website generation static page Raiders

The main steps of generating HTML methods are only two:

First, obtain the contents of the HTML file to be generated, save the content of the acquired HTML file as an HTML file.

I mainly explained here is the first step: How to get the content of the HTML file to be generated:

There are several ways to obtain the content of the HTML files, there are several ways:

1, this method is to write the HTML content to be generated in the script, less convenient to preview the content of the generated page, can be visualize the layout page, which is more complicated when changing the HTML template. There are a lot of people in this way, but I feel that this method is the most inconvenient.

Str = " Content " Str = Str & " Content Database Read Content ..... ..... "

2. Make a separate HTML template page, dynamic content as a tag with a specific character (eg, someone uses $ TITLE $ tagged as a web title), use adoDb.stream or scripting.FileSystemObject to load it, then use The replacement method replaces the original tag to dynamic content (eg Replace (loaded template content, "$ TITLE $", RS ("Title"))).

3. Get the HTML content displayed by the dynamic page with XMLHTTP or ServerXMLHTTP:

I often use an instance of generating an HTML file: 'Weburl is the dynamic page address to get' getHttppage (WebURL) is a function WebURL = "http:////////////////////////" .asp? id = "& RS (" ID ") &" "Specifies Dynamic Page Address Body = Gethttppage (WebURL) 'Use functions to get the content of dynamic page address

The biggest advantage of this method is that there is no need to write a static template page, just convert the dynamic page to an HTML static page, but the generator is not too fast. The method I often use HTML is the third type: use XMLHTTP to get the HTML content generated by the dynamic page, and then save it as an HTML file with adoDb.stream or scripting.FileSystemObject. The second step is to generate a file:

There are commonly used adodb.stream generated files and scripting.FileSystemObject generated files in ASP:

1. Scripting.FileSystemObject Generate file method: set fso = creteObject ("scripting.filesystemObject") file = server.mappath ("To generate file path and file name .htm") set txt = fso.opentextfile (File, 8, true ) DATA1 = "File content" uses WriteLine method to generate file txt.writeLine data1Data2 = "file content" "uses Write method to generate file txt.write data2txt.closetxt.fso

2, AdoDb.Stream generates file method:

Dim objAdoStreamset objAdoStream = Server.createObject ( "ADODB.Stream") objAdoStream.Type = 1objAdoStream.Open () objAdoStream.Write ( "file content") objAdoStream.SaveToFile To generate the file path and filename .htm, 2objAdoStream.Close () The principle of collecting:

The main steps of the acquisition process are as follows:

First, obtain the contents of the collected page, extract all data from the acquisition code

First, get the content of the collected page

I am currently mastering the content method of acquiring the acquired page:

1. Get data with ServerXMLHTTP components

Function GetBody (weburl) 'Create Object Dim ObjXMLHTTPSet ObjXMLHTTP = Server.CreateObject ( "MSXML2.serverXMLHTTP")' request file, in the form of an asynchronous ObjXMLHTTP.Open "GET", weburl, FalseObjXMLHTTP.sendWhile ObjXMLHTTP.readyState <> 4ObjXMLHTTP.waitForResponse 1000Wend 'Get the result getBody = Objxmlhttp.responsebody' release object set objxmlhttp = nothingend function

Call method: getBody (URLF address of the file)

2, or XMLHTTP components to get data

Function GetBody (weburl) 'create objects Set Retrieval = CreateObject ( "Microsoft.XMLHTTP") With Retrieval .Open "Get", weburl, False, "", "" .Send GetBody = .ResponseBodyEnd With' release objects Set Retrieval = Nothing END FUNCTION

Call method: getBody (URLF address of the file)

This acquisition data content needs to be encoded to be used.

Function BytesToBstr (body, Cset) dim objstreamset objstream = Server.CreateObject ( "adodb.stream") objstream.Type = 1objstream.Mode = 3objstream.Openobjstream.Write bodyobjstream.Position = 0objstream.Type = 2objstream.Charset = CsetBytesToBstr = objstream. Readtext objstream.closset objstream = Nothingend Function

Calling method: Bytestobstr (data to be converted, encoding) 'encoding is common to GB2312 and UTF-8.

Second, extract all use data from the acquisition code

1. Use the ASP built-in MID function to intercept the required data

Function Body (WSTR, START, OVER) Start = Newstring (WSTR, START) Set the unique start mark Over = NewString (WSTR, OVER) 'and START, which need to be processed, is the only thing that needs to be processed. End Tag Body = MID (WSTR, START, OVER-START) Set the range of the display page end function

Call method: Body (content, start tag, end tag) 2, get required data by regular

Function Body (WSTR, START, OVER) set xiaoqi = new regexp 'Settings configuration object xiaoqi.Ignorecase = true' ignore the case xiaoqi.global = true 'set to full-text search XIAOQI.PATTERN = "& Start &". ? "& Over & START &" "" 'Regular expression set matches = xiaoqi.execute (wstr) start execution configuration set xiaoqi = Nothing body = "" for each match in matchesbody = body & match.value "loop match Next'end Function

Calling method: body (content, start tag, end tag)

Collection procedure auspicious ideas:

1. Get the page list of the page list of the website, the patch address of most dynamic websites, such as: Dynamic Page: Index.asp? Page = 1 Page II: Index.asp? Page = 2 Page 3: Index.asp? Page = 3 .....

Static page 1: Page_1.htm Page 2: Page_2.htm Page 3: Page_3.htm .....

Take each page address of the page list page of the website, you only need to replace the change in the change of each page address, such as: page _ <% = "& page &"%>. Htm

2. Get the contents of the page list page for the acquisition site

3. Extract from the paging list code [color = blue] URL connection address of the acquired content page [/ color] There are also fixed rules, such as: Connection 1
connection 2
connection 3

Use the following code to get a URL connection collection set xiaoqi = new regexpxiaoqi.ignorecase = truexiaoqi.global = truexiaoqi.pattern = "" "" "" "" "" "" "" "" "" " URL = "" for Each Match in matchesurl = url & match.value next

4. Acquisitioned content page content, according to "Extraction Mark", from the collected content page, the data to be acquired.

Because it is a dynamically generated page, there are the same HTML tags in most content pages, we can extract the contents of the required parts based on these rule tags. Such as:

Each page has a web title