Source: e800.com.cn
With the rise of the search economy, people began to pay attention to the performance, technology and daily flow of the world's search engine. As a company, it will choose whether to put advertisements according to the reputation of the search engine and the daily traffic; as a normal netizens, it will choose the engine to find information on the performance and technology of the search engine; as a scholar, it will represent representative As a research object ... and as a website operator, it is more concerned that how to let more netizens know their own website through the network carrier, and then achieve higher traffic and popularity. Among them, search engines have become an important and free publicity approach. On the one hand, the search engine will take the initiative to find various web data on the network, and index in the background; on the other hand, the major websites can show netizens to netizens in order to make their own content more. It has begun to make major adjustments to the website structure, including flat structural design, dynamic (web) turning static (web pages), SiteMap, etc. These seemingly unrecriminal moves make us feel an important role in the search engine's change in our network usage. Also, it is a new position - exclusiveness of the rise of the search engine and the rise of the society, and it has created a new position. In fact, the rise of the search engine economy has proved the huge business opportunities that the network is contained. The network left the search will only have a messy data, as well as a large number of gold mines waiting to be exhausted. Search engines have been focusing on improving the user's experience, and its user experience is reflected in three aspects: quasi, full, fast. Use professional terms: the quotation rate, check the rate and search speed (ie, search time consuming). The most easily achieved search speed, because the visitor is difficult to distinguish if the search time consuming in 1 second, and the visitors are difficult to distinguish it, not to have the impact of network speed. Therefore, the evaluation of the search engine is concentrated in the top two: quasi, full. The "quasi" of the Chinese search engine needs to ensure that the results of the search are very relevant to the search term, which requires "word technology" and "sorting technology" to decide (reference author related articles [1] [2]) The "full" of the Chinese search engine needs to guarantee that there is no missing result, and can find the latest web pages, which requires a powerful web collector, which is generally called "network spider", also called "webpage" robot". There are a lot of articles in search engine technology, but most of the discussion is how to evaluate the importance of the webpage, and there are not many articles studied for network spiders. Network spider technology is not a very deep technology, but it is a powerful network spider, but it is not easy. When the current disk capacity is no longer a bottleneck, the search engine has been expanding its number of pages. The largest search engine Google (http://www.google.com/) increases from 2002 to now 4 billion web pages; the Yahoo Search Engine (http://search.yahoo.com/) is included 4.5 billion web pages; China's Chinese search engine Baidu (http://www.baidu.com/) has increased from 70 million pages two years ago to more than 200 million. It is estimated that the number of web pages across the Internet reached more than 10 billion, and it is still growing rapid annual. So an excellent search engine requires continuous optimization of the network spider algorithm to enhance its performance.
