Recently, network acquisition technology is very popular. Using collection technology, all data and files of other sites can be allocated directly into their database and directory.
The emergence of this technology really makes many webmasters, so the sky download station NetEase animation channel ..... or even Microsoft MSDN tutorials are not very slepe, all become collected objects.
Very unfortunately, my BLOG is actually attacked by a collection, so that IIS will directly exceed the limit of my station, and now I still can't access it. I just searched the relevant information of the anti-acquisition, and there were several ways.
1 Judge HTTP_REFERER2 web page encryption 3 URL encryption 4 Generate Picture 5 Add Copyright 6 Use Multi-Template
In addition to using multi-mode, I don't think there are many other kinds of few things, they all prevent search engines, so I also thought about these ideas.
Since most collected programs are highly collected very fast, you can collect a page for multi-threading or even every second, so we can use the method of posting time limit for forums, Access the interval between two pages, limit it, of course, some people see a batch of articles may like to open a lot of windows at the same time, so it is possible to restrict this part of this person.
So we can expand time limit, if it is determined whether the page opened in 1 minute is more than 20, if this number is exceeded, the leaves will display other content, or warned information, or other deceptive content.
This is a general idea, and there are many places to be improved such as the exception to the spider, and the implementation of the algorithm, etc., etc.
