CN105100260B - A kind of method and device to be accessed by proxy server - Google Patents
A kind of method and device to be accessed by proxy server Download PDFInfo
- Publication number
- CN105100260B CN105100260B CN201510509630.6A CN201510509630A CN105100260B CN 105100260 B CN105100260 B CN 105100260B CN 201510509630 A CN201510509630 A CN 201510509630A CN 105100260 B CN105100260 B CN 105100260B
- Authority
- CN
- China
- Prior art keywords
- server
- proxy
- preferential
- proxy server
- address
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000000034 method Methods 0.000 title claims abstract description 67
- 230000004044 response Effects 0.000 claims abstract description 54
- 230000008569 process Effects 0.000 claims description 22
- 238000007405 data analysis Methods 0.000 claims description 20
- 238000000605 extraction Methods 0.000 claims description 17
- 238000006243 chemical reaction Methods 0.000 claims description 12
- 238000013507 mapping Methods 0.000 claims description 8
- 239000000284 extract Substances 0.000 claims description 2
- 238000012790 confirmation Methods 0.000 claims 1
- 239000011800 void material Substances 0.000 claims 1
- 230000006855 networking Effects 0.000 abstract description 3
- 230000005540 biological transmission Effects 0.000 description 7
- 230000009471 action Effects 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 2
- 239000003638 chemical reducing agent Substances 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000013515 script Methods 0.000 description 2
- 230000006399 behavior Effects 0.000 description 1
- 230000003139 buffering effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000007619 statistical method Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computer And Data Communications (AREA)
- Information Transfer Between Computers (AREA)
Abstract
This application provides a kind of method and apparatus to be accessed by proxy server.The method includes：The request for receiving network resource accession is asked according to the network resource accession, determines the corresponding destination server accessed；Selection accesses the preferential proxy server of the destination server, and the preferential proxy server refers to, by being counted to correlation log, the fastest proxy server of the access destination server determined；Network resource accession request is sent to the preferential proxy server, data is obtained from destination server by the preferential proxy server and is returned.The proxy server that the application can help user's Response to selection fastest improves the networking speed of user.
Description
Technical field
This application involves computer realms, more particularly to a kind of method and one kind to be accessed by proxy server
The device to be accessed by proxy server.
Background technology
Currently, the outgoing access data speed between different network operators is very low, the speed of external website is accessed
It is especially low.Therefore, it is a kind of raising to set up proxy server (Proxy Server) over the backbone as user's outgoing access
User experience most effective way.
Under normal circumstances, when user accesses website, web browser directly goes to connect corresponding Internet websites acquirement
When the network information, data are from the network node transmissions residing for user to backbone network, then are transferred to destination server, and data
It returns and has carried out same operation again, the data constantly forwarded, hop count is more, and the intermediate delay for having routing, will result in use
The extension of user data transmission time.
Proxy server is another server between client and purpose server in station, and browser is not straight
Contact purpose server in station is connect, but request is sent out to proxy server, signal can first be sent to proxy server, be taken by agency
Device be engaged in fetch the required information of browser and send browser to.Figuratively, it is the terminal of the network information.
Just look like a big caching, it constantly will newly take since most of proxy server all has the function of buffering
It obtains data to be stored on the memory of its machine, if the requested data of browser have existed on the memory of its machine
And be newest, then it is just not again from Web server access evidence, and directly by the data transmission on memory to user
Browser, can thus significantly improve surfing and efficiency.
The complexity of Network Environment, separate unit proxy server cannot be satisfied continually changing network, then produce
Server proxy cluster, user's request can be fed back by any one proxy server.
The above problems of the prior art are when user accesses the same destination server, to use proxy server
Different proxy servers accesses in cluster, and response speed simultaneously differs, and can not know the response of which platform proxy server
Speed faster, it is thus impossible to obtain optimal response speed.
Invention content
Technical problems to be solved in this application are to provide a kind of method to access by proxy server, for helping
The proxy server for helping user's Response to selection fastest improves the networking speed of user.
Present invention also provides a kind of devices to be accessed by proxy server, to ensure the above method in reality
In application and realization.
To solve the above-mentioned problems, this application discloses a kind of methods to be accessed by proxy server, including：
The request for receiving network resource accession is asked according to the network resource accession, determines the corresponding target clothes accessed
Business device；
Selection accesses the preferential proxy server of the destination server, and the preferential proxy server refers to, by right
Correlation log is counted, the fastest proxy server of the access destination server determined；
Network resource accession request is sent to the preferential proxy server, by the preferential proxy server from target
Server obtains data and returns.
Preferably, the speed for accessing the destination server speed takes the target with more each proxy server
The response time of the access request of business device determines.
Preferably, the process of the preferential proxy server of the determination is completed by data analysis tool.
Preferably, the method further includes：
Judge whether the network resource accession request comes from target network, if so, selection accesses the target clothes
The preferential proxy server of business device, if it is not, then randomly choosing a proxy server.
Preferably, the target network refers to education network (CERNET), enterprise network or virtual LAN.
Preferably, the preferential proxy server is determined by following steps：
The proxy log in preset time period is extracted on each proxy server；
Parse the proxy information in the proxy log, the proxy information includes acting on behalf of institute's access target server each time
Rhizosphere name or IP address and corresponding response time；
Compare the response time for accessing the different proxy servers corresponding to same root domain name or IP address；
For same root domain name or IP address, Response to selection time shortest proxy server, as the access target
The preferential proxy server of server.
Preferably, the process of the preferential proxy server of the determination after determining accessed destination server immediately into
Row.
Preferably, described to confirm that the process of preferential proxy server is executed according to predeterminated frequency, and foundation is newly generated knot
Fruit is updated preferential proxy server.
Preferably, the correspondence of each destination server and its preferential proxy server is stored in domain name resolution server
On.
Preferably, the request for receiving network resource accession, is asked according to the network resource accession, determines corresponding visit
The step of destination server asked, further comprises, receives the request of network resource accession, the Internet resources that extraction request accesses
Address determines the rhizosphere name of the corresponding destination server accessed according to the network resources address.
Preferably, the request for receiving network resource accession, is asked according to the network resource accession, determines corresponding visit
The destination server step asked further comprises, receives the request of network resource accession, extraction is with asking the Internet resources accessed
Location carries out domain name mapping to the network resources address, determines the IP address of the corresponding destination server accessed.
Preferably, the process of the preferential proxy server of the determination further includes：
It is the format that data analysis tool stores data by the format conversion of the proxy log.
Preferably, the process of the preferential proxy server of the determination further includes：
By the correspondence for the proxy information that each proxy log and parsing obtain, 2-D data sequence is established.
Preferably, the proxy information further includes：IP address, access time, access address URL and/or the sound of client
Answer state.
Present invention also provides a kind of devices to be accessed by proxy server, including：
Destination server determining module, the request for receiving network resource accession are asked according to the network resource accession
It asks, determines the corresponding destination server accessed；
Server se-lection module preferentially is acted on behalf of, is used to select to access the preferential proxy server of the destination server, institute
Stating preferential proxy server refers to, by being counted to correlation log, the determining access destination server is fastest
Proxy server；
Data acquisition module, for network resource accession request to be sent to the preferential proxy server, by described excellent
First proxy server obtains data from destination server and returns.
Preferably, the speed for accessing the destination server speed takes the target with more each proxy server
The response time of the access request of business device determines.
Preferably, described preferential to act on behalf of server se-lection module and completed by data analysis tool.
Preferably, described device further includes：
Target network judgment module, for judging whether the network resource accession request comes from target network, if so,
It then executes and preferentially acts on behalf of server se-lection module, if it is not, then executing random selection module, the random selection module is for random
Select a proxy server.
Preferably, the target network refers to education network (CERNET), enterprise network or virtual LAN.
Preferably, described preferential to act on behalf of server se-lection module and further comprise：
Proxy log extracting sub-module, for extracting the proxy log in preset time period on each proxy server；
Proxy information analyzing sub-module, for parsing the proxy information in the proxy log, the proxy information includes
Each rhizosphere name for acting on behalf of institute's access target server or IP address and corresponding response time；
Response time comparison sub-module, for comparing the different agency's clothes accessed corresponding to same root domain name or IP address
The response time of business device；
Response time selects submodule, for being directed to same root domain name or IP address, Response to selection time shortest agency
Server, as the preferential proxy server for accessing the destination server.
Preferably, the preferential server se-lection module of acting on behalf of is held immediately after determining accessed destination server
Row.
Preferably, it is described it is preferential act on behalf of server se-lection module and executed according to predeterminated frequency, and according to being newly generated result
Preferential proxy server is updated.
Preferably, the correspondence of each destination server and its preferential proxy server is stored in domain name resolution server
On.
Preferably, the destination server determining module further comprises：
Rhizosphere name determination sub-module, the request for receiving network resource accession, the Internet resources that extraction request accesses
Location determines the rhizosphere name of the corresponding destination server accessed according to the network resources address.
Preferably, the destination server determining module further comprises：
IP address determination sub-module, the request for receiving network resource accession, the Internet resources that extraction request accesses
Location carries out domain name mapping to the network resources address, determines the IP address of the corresponding destination server accessed.
Preferably, described preferential to act on behalf of server se-lection module and further include：
Format conversion submodule, the lattice for the format conversion of the proxy log to be stored to data for data analysis tool
Formula.
Preferably, described preferential to act on behalf of server se-lection module and further include：
2-D data sequence setting up submodule, the corresponding of proxy information for being obtained by each proxy log and parsing are closed
System, establishes 2-D data sequence.
Preferably, the proxy information further includes：IP address, access time, access address URL and/or the sound of client
Answer state.
Compared with prior art, the application has the following advantages：
The application selects the access to the destination server when user is by proxy server access target server
The response time shortest preferential proxy server of request carries out data transmission, and improves the networking speed of user, improves use
The online experience at family, wherein preferential proxy server obtains by carrying out statistics to correlation log, can also with real-time statistic
It is counted according to predeterminated frequency, timely automated update preference strategy after statistics, ensure that preference strategy is newest in real time every time.
Description of the drawings
Fig. 1 is a kind of flow chart of embodiment of the method 1 to be accessed by proxy server of the application；
Fig. 2 is a kind of structure diagram of device embodiment 1 to be accessed by proxy server of the application.
Specific implementation mode
In order to make the above objects, features, and advantages of the present application more apparent, below in conjunction with the accompanying drawings and it is specific real
Applying mode, the present application will be further described in detail.
With reference to figure 1, a kind of flow of embodiment of the method 1 to access by proxy server of the application is shown
Figure, can specifically include following steps：
Step 101, the request for receiving network resource accession, are asked according to the network resource accession, determine corresponding access
Destination server.
In concrete implementation, the step 101 can be the network resources address that extraction request accesses, according to described
Network resources address determines the rhizosphere name of the corresponding destination server accessed, since the rhizosphere name and IP address of destination server are
Correspondingly, accordingly it is also possible to carry out domain name mapping to the network resources address that request accesses, the IP of destination server is determined
Destination server is distinguished in address with IP address.
Step 102, selection access the preferential proxy server of the destination server, and the preferential proxy server is
Refer to, by being counted to correlation log, the fastest proxy server of the access destination server determined.
In concrete implementation, the speed for accessing the destination server speed can be with more each proxy server
The response time of the access request of the destination server is determined.
For same destination server, the speed accessed with different proxy servers simultaneously differs, can be by generation
Reason Server history access speed is compared, and selection is within a preset period of time, most fast to the destination server response speed
Preferential proxy server as this access.The process of the preferential proxy server of determination can be complete by data analysis tool
At, it is preferred that the data analysis tool can be Hadoop, Mysql, Infobright or Mongodb.
In concrete implementation, the preferential proxy server can be determined by following steps：
Sub-step S11, the proxy log on each proxy server in extraction preset time period.
Proxy server is all recorded in proxy log the responsive state that each user asks, in concrete implementation,
It is possible, firstly, to which the proxy log for extracting a period of time from proxy server is analyzed.If being carried out using data analysis tool
Analysis also needs the format that the format conversion of the proxy log is stored to data for data analysis tool.Such as Hadoop, because
The format of proxy log is different with the storage format of Hadoop, and proxy log need to be decomposed into some metadata, and metadata can be with
Be combined into the daily record for meeting Hadoop cannonical formats, for example, some daily record be changed into Hadoop formats after be hostname=
prox1.ops.bjt.qihoo.net 20/Feb/2012:14:59:59+080041233-101.4.60.43TCP_MISS/
00GET http://10.67.web1.im.weibo.com/im-DIRECT/180.149.138.67.
Proxy information in sub-step S12, the parsing proxy log, the proxy information includes that each agency is accessed
The rhizosphere name or IP address of destination server and corresponding response time.
Parsing proxy log can obtain the corresponding access information when time proxy server, include the root of destination server
Domain name or IP address and corresponding response time.For example, using Hadoop scripts to the daily records of Hadoop formats in upper example into
After row dismantling, the IP address that can obtain destination server is http:// 10.67.web1.im.weibo.com, agency service
Device number is prox1, response time 41233S.
In concrete implementation, the proxy information parsed can also include IP address, access time, the access of client
Location URL and/or responsive state.
Sub-step S13, when comparing the response for accessing the different proxy servers corresponding to same root domain name or IP address
Between；
Sub-step S14, same root domain name or IP address, Response to selection time shortest proxy server, as sound are directed to
The preferential proxy server for the destination server answered.
When can obtain the same destination server of access by extracting the proxy information in each proxy log, different generations
Manage the response time of server, wherein response time shortest proxy server as priority.It preferably, can be by each mesh
Mark server and the correspondence of its preferential proxy server are stored on domain name resolution server.
For example, it is http to access IP address:The proxy log of // 10.67.web1.im.weibo.com has two, extraction
Go out proxy information such as following table：
| IP address | Proxy server | Response time/S |
| http://10.67.web1.im.weibo.com | prox1 | 41233 |
| http://10.67.web1.im.weibo.com | prox2 | 30 |
As seen from the above table, access request obviously wants short by the time that the server that number is proxy2 is handled, because
This, by proxy2 proxy servers as priority, and notifies domain name resolution server DNS, accesses http://
10.67.web1.im.weibo.com in request analytic uniform to prox2 proxy servers.
If carrying out data analysis using Hadoop, proxy log can be stored with behavior unit, is often gone by several
Data cell be attached, formed a character string；Proxy log is read line by line using Hadoop scripts mapper.php, and
Proxy information is parsed, after the proxy information in parsing the proxy log, is obtained by each proxy log and parsing
The correspondence of proxy information establishes 2-D data sequence, establishes similar tables of data the same sql, and the first dimension is several keys
The record of word, the second dimension are a plurality of record；Then the analysis result for using reducer.php merger mapper.php, uses
Filter.php is for statistical analysis to the result of reducer.php merger, extracts preferential proxy server.
In a preferred embodiment of the present application, the process for generating preferential proxy server can be visited in determination
It is carried out immediately after the destination server asked.
In another preferred embodiment of the present application, the process for generating preferential proxy server can be according to default
Frequency is executed, and is updated to preferential proxy server according to being newly generated result, by the result of this calculating with last time into
Row compares, and when finding that the server of some URL speed peaks for accessing each server is different with last time, then updates result
Record.
Network resource accession request is sent to the preferential proxy server by step 103, by the preferential agency service
Device obtains data from destination server and returns.
A kind of embodiment of the method 2 to be accessed by proxy server of the application can specifically include following steps：
Step 201, the request for receiving network resource accession, are asked according to the network resource accession, determine corresponding access
Destination server；
Step 202 judges whether the network resource accession request comes from target network user, if so, executing step
Rapid 204, if it is not, thening follow the steps 203.
One step 203, random selection proxy server.
Step 204, selection access the preferential proxy server of the destination server, and the preferential proxy server is
Refer to, by being counted to correlation log, the fastest proxy server of the access destination server determined；
Unlike last embodiment, the present embodiment according to network resource accession request determine destination server it
Afterwards, it is also necessary to judge whether the network resource accession request comes from target network, if so, selecting preferential proxy server
Data are carried out data transmission, if it is not, then randomly choosing a proxy server in server proxy cluster.
Wherein, the target network refers to education network (CERNET), enterprise network or virtual LAN, at present these three networks
The speed that interior user accesses outer net is very slow, especially educates network users, can not access external website substantially.To solve this
Problem has browser and is proposed the function of accessing by proxy server for education network users, can make education network
User accesses outer net by access proxies.According to the present embodiment, can be when education network users access, selection is gone through
The most fast preferential proxy server of history response speed carries out data transmission, can be with further such that education network users access outer net
Speed greatly improves.
Network resource accession request is sent to the preferential proxy server by step 205, by the preferential agency service
Device obtains data from destination server and returns.
In conclusion the application, when user is by proxy server access target server, selection takes the target
The response time shortest preferential proxy server of the access request of business device carries out data transmission, and improves the upper network speed of user
Degree, improves the online experience of user.Wherein, preferential proxy server is obtained by carrying out statistics to correlation log, can be
Shi Tongji can also be counted according to predeterminated frequency, and timely update after statistics preference strategy every time, ensure that preference strategy reality
When it is newest.
For embodiment of the method, for simple description, therefore it is all expressed as a series of combination of actions, but this field
Technical staff should know that the application is not limited by the described action sequence, because according to the application, certain steps can
To use other sequences or be carried out at the same time.Next, those skilled in the art should also know that, implementation described in this description
Example belongs to preferred embodiment, necessary to involved action and module not necessarily the application.
With reference to figure 2, a kind of structural frames of device embodiment 1 to access by proxy server of the application are shown
Figure, can specifically include with lower module：
Destination server determining module 301, the request for receiving network resource accession, according to the network resource accession
Request determines the corresponding destination server accessed；
Server se-lection module 302 preferentially is acted on behalf of, is used to select to access the preferential proxy server of the destination server,
The preferential proxy server refers to, by being counted to correlation log, the determining access destination server speed is most
Fast proxy server；
Data acquisition module 303, for network resource accession request to be sent to the preferential proxy server, by described
Preferential proxy server obtains data from destination server and returns.
Preferably, the speed for accessing the destination server speed can be with more each proxy server to the mesh
The response time of the access request of server is marked to determine.
Preferably, described preferential to act on behalf of server se-lection module and further comprise：
Proxy log extracting sub-module, for extracting the proxy log in preset time period on each proxy server；
Proxy information analyzing sub-module, for parsing the proxy information in the proxy log, the proxy information includes
Each rhizosphere name for acting on behalf of institute's access target server or IP address and corresponding response time；
Response time comparison sub-module, for comparing the different agency's clothes accessed corresponding to same root domain name or IP address
The response time of business device；
Response time selects submodule, for being directed to same root domain name or IP address, Response to selection time shortest agency
Server, as the preferential proxy server for accessing the destination server.
In a preferred embodiment of the present application, the preferential server se-lection module of acting on behalf of can be accessed obtaining
Destination server after immediately execute.
In another preferred embodiment of the present application, it is described it is preferential act on behalf of server se-lection module can be according to default frequency
Rate executes, and is updated to preferential proxy server according to result is newly generated.
In concrete implementation, the correspondence of each destination server and its preferential proxy server can be stored in domain
On name resolution server.
In a preferred embodiment of the present application, the destination server determining module may include：
Rhizosphere name determination sub-module, the request for receiving network resource accession, the Internet resources that extraction request accesses
Location determines the rhizosphere name of the corresponding destination server accessed according to the network resources address.
In a preferred embodiment of the present application, the destination server determining module may include：
IP address determination sub-module, the request for receiving network resource accession, the Internet resources that extraction request accesses
Location carries out domain name mapping to the network resources address, determines the IP address of the corresponding destination server accessed.
In a preferred embodiment of the present application, it is described it is preferential act on behalf of server se-lection module can be by data analysis work
Tool is completed, it is preferred that the data analysis tool can be Hadoop, Mysql, Infobright or Mongodb.
Preferably, described preferential to act on behalf of server se-lection module and include：
Format conversion submodule, the lattice for the format conversion of the proxy log to be stored to data for data analysis tool
Formula.
Preferably, described preferential to act on behalf of server se-lection module and include：
2-D data sequence setting up submodule, the corresponding of proxy information for being obtained by each proxy log and parsing are closed
System, establishes 2-D data sequence.
Preferably, the proxy information can also include：The IP address of client, access time, access address URL and/
Or responsive state.
A kind of device embodiment 2 to be accessed by proxy server of the application can specifically include with lower module：
Destination server determining module 401, the request for receiving network resource accession, according to the network resource accession
Request determines the corresponding destination server accessed；
Target network judgment module 402, for judging whether the network resource accession request comes from target network, if
It is then to execute and preferentially act on behalf of server se-lection module 404, if it is not, then executing random selection module 403；
Random selection module 403, for randomly choosing a proxy server.
Server se-lection module 404 preferentially is acted on behalf of, is used to select to access the preferential proxy server of the destination server,
The preferential proxy server refers to, by being counted to correlation log, the determining access destination server speed is most
Fast proxy server；
Data acquisition module 405, for network resource accession request to be sent to the preferential proxy server, by described
Preferential proxy server obtains data from destination server and returns.
Preferably, the target network refers to education network (CERNET), enterprise network or virtual LAN.
Since described device embodiment essentially corresponds to preceding method embodiment, thus in the description of the present embodiment it is not detailed it
Place, may refer to the related description in previous embodiment, does not just repeat herein.
The application can be used in numerous general or special purpose computing system environments or configuration.Such as：Personal computer, service
Device computer, handheld device or portable device, laptop device, multicomputer system, microprocessor-based system, top set
Box, programmable consumer-elcetronics devices, network PC, minicomputer, mainframe computer including any of the above system or equipment
Distributed computing environment etc..
The application can describe in the general context of computer-executable instructions executed by a computer, such as program
Module.Usually, program module includes routines performing specific tasks or implementing specific abstract data types, program, object, group
Part, data structure etc..The application can also be put into practice in a distributed computing environment, in these distributed computing environments, by
Task is executed by the connected remote processing devices of communication network.In a distributed computing environment, program module can be with
In the local and remote computer storage media including storage device.
Herein, the terms "include", "comprise" or any other variant thereof is intended to cover non-exclusive inclusion, from
And make include a series of elements process, method, article or equipment not only including those elements, but also include not bright
The other element really listed, or further include for elements inherent to such a process, method, article, or device.Do not having
In the case of more limitations, the element that is limited by sentence "including a ...", it is not excluded that including the element process,
There is also other identical elements in method, article or equipment.
Above to a kind of method to be accessed by proxy server provided herein, and, one kind passing through generation
The device that accesses of reason server is described in detail, used herein principle and implementation of the specific case to the application
Mode is expounded, the description of the example is only used to help understand the method for the present application and its core ideas；Meanwhile
For those of ordinary skill in the art, according to the thought of the application, has change in specific embodiments and applications
Become place, in conclusion the contents of this specification should not be construed as limiting the present application.
The invention discloses A1, a kind of methods to be accessed by proxy server, wherein including：
The request for receiving network resource accession is asked according to the network resource accession, determines the corresponding target clothes accessed
Business device；
Selection accesses the preferential proxy server of the destination server, and the preferential proxy server refers to, by right
Correlation log is counted, the fastest proxy server of the access destination server determined；
Network resource accession request is sent to the preferential proxy server, by the preferential proxy server from target
Server obtains data and returns.
A2, the method as described in A1, wherein the speed for accessing the destination server speed is with relatively more each agency's clothes
Business device determines the response time of the access request of the destination server.
A3, the method as described in A2, wherein the process of the preferential proxy server of determination is complete by data analysis tool
At.
A4, the method as described in A1, wherein further include：
Judge whether the network resource accession request comes from target network, if so, selection accesses the target clothes
The preferential proxy server of business device, if it is not, then randomly choosing a proxy server.
A5, the method as described in A4, wherein the target network refers to education network (CERNET), enterprise network or virtual office
Domain net.
A6, the method as described in A3, wherein the preferential proxy server is determined by following steps：
The proxy log in preset time period is extracted on each proxy server；
Parse the proxy information in the proxy log, the proxy information includes acting on behalf of institute's access target server each time
Rhizosphere name or IP address and corresponding response time；
Compare the response time for accessing the different proxy servers corresponding to same root domain name or IP address；
For same root domain name or IP address, Response to selection time shortest proxy server, as the access target
The preferential proxy server of server.
A7, the method as described in A1, wherein the process of the preferential proxy server of determination is determining accessed target
It is carried out immediately after server.
A8, the method as described in A1, wherein it is described to confirm that the process of preferential proxy server is executed according to predeterminated frequency,
And preferential proxy server is updated according to result is newly generated.
A9, the method as described in A7 or A8, wherein the correspondence of each destination server and its preferential proxy server
It is stored on domain name resolution server.
A10, the method as described in A6, wherein the request for receiving network resource accession is visited according to the Internet resources
The step of asking request, determining the corresponding destination server accessed further comprises that receive the request of network resource accession, extraction is asked
The network resources address for asking access determines the rhizosphere name of the corresponding destination server accessed according to the network resources address.
A11, the method as described in A6, wherein the request for receiving network resource accession is visited according to the Internet resources
It asks request, determines that the corresponding destination server step accessed further comprises, receive the request of network resource accession, extraction request
The network resources address of access carries out domain name mapping to the network resources address, determines the corresponding destination server accessed
IP address.
A12, the method as described in A6, wherein the process of the preferential proxy server of determination further includes：
It is the format that data analysis tool stores data by the format conversion of the proxy log.
A13, the method as described in A6, wherein the process of the preferential proxy server of determination further includes：
By the correspondence for the proxy information that each proxy log and parsing obtain, 2-D data sequence is established.
A14, the method as described in A6, wherein the proxy information further includes：The IP address of client, access time, visit
Ask address URL and/or responsive state.
The invention also discloses B15, a kind of devices to be accessed by proxy server, wherein including：
Destination server determining module, the request for receiving network resource accession are asked according to the network resource accession
It asks, determines the corresponding destination server accessed；
Server se-lection module preferentially is acted on behalf of, is used to select to access the preferential proxy server of the destination server, institute
Stating preferential proxy server refers to, by being counted to correlation log, the determining access destination server is fastest
Proxy server；
Data acquisition module, for network resource accession request to be sent to the preferential proxy server, by described excellent
First proxy server obtains data from destination server and returns.
B16, the device as described in B15, wherein the speed for accessing the destination server speed is with relatively more each agency
Server determines the response time of the access request of the destination server.
B17, the device as described in B16, wherein described preferential to act on behalf of server se-lection module complete by data analysis tool
At.
B18, the device as described in B15, wherein further include：
Target network judgment module, for judging whether the network resource accession request comes from target network, if so,
It then executes and preferentially acts on behalf of server se-lection module, if it is not, then executing random selection module, the random selection module is for random
Select a proxy server.
B19, the device as described in B18, wherein the target network refers to education network (CERNET), enterprise network or virtual
LAN.
B20, the device as described in B17, wherein described preferential to act on behalf of server se-lection module and further comprise：
Proxy log extracting sub-module, for extracting the proxy log in preset time period on each proxy server；
Proxy information analyzing sub-module, for parsing the proxy information in the proxy log, the proxy information includes
Each rhizosphere name for acting on behalf of institute's access target server or IP address and corresponding response time；
Response time comparison sub-module, for comparing the different agency's clothes accessed corresponding to same root domain name or IP address
The response time of business device；
Response time selects submodule, for being directed to same root domain name or IP address, Response to selection time shortest agency
Server, as the preferential proxy server for accessing the destination server.
B21, the device as described in B15, wherein the preferential server se-lection module of acting on behalf of is determining accessed target
It is executed immediately after server.
B22, the device as described in B15, wherein it is described it is preferential act on behalf of server se-lection module and executed according to predeterminated frequency,
And preferential proxy server is updated according to result is newly generated.
B23, the device as described in B21 and B22, wherein each destination server is corresponding with its preferential proxy server
Relationship is stored on domain name resolution server.
B24, the device as described in B20, wherein the destination server determining module further comprises：
Rhizosphere name determination sub-module, the request for receiving network resource accession, the Internet resources that extraction request accesses
Location determines the rhizosphere name of the corresponding destination server accessed according to the network resources address.
B25, the device as described in B20, wherein the destination server determining module further comprises：
IP address determination sub-module, the request for receiving network resource accession, the Internet resources that extraction request accesses
Location carries out domain name mapping to the network resources address, determines the IP address of the corresponding destination server accessed.
B26, the device as described in B20, wherein described preferential to act on behalf of server se-lection module and further include：
Format conversion submodule, the lattice for the format conversion of the proxy log to be stored to data for data analysis tool
Formula.
B27, the device as described in B20, wherein described preferential to act on behalf of server se-lection module and further include：
2-D data sequence setting up submodule, the corresponding of proxy information for being obtained by each proxy log and parsing are closed
System, establishes 2-D data sequence.
B28, the device as described in B20, wherein the proxy information further includes：The IP address of client, access time,
Access address URL and/or responsive state.
Claims (24)
1. a kind of method to be accessed by proxy server, wherein including：
The request for receiving network resource accession is asked according to the network resource accession, determines the corresponding destination server accessed；
Selection accesses the preferential proxy server of the destination server, and the preferential proxy server refers to, by correlation
Daily record is counted, the fastest proxy server of the access destination server determined, wherein the confirmation pressure-gradient control valve
The process of reason server is executed according to predeterminated frequency, and is updated to preferential proxy server according to result is newly generated, institute
Preferential proxy server is stated to determine by following steps：The agency day in preset time period is extracted on each proxy server
Will；The proxy information in the proxy log is parsed, the proxy information includes each root for acting on behalf of institute's access target server
Domain name or IP address and corresponding response time；Compare the different agencies accessed corresponding to same root domain name or IP address
The response time of server；For same root domain name or IP address, Response to selection time shortest proxy server, as access
The preferential proxy server of the destination server；
Network resource accession request is sent to the preferential proxy server, by the preferential proxy server from destination service
Device obtains data and returns.
2. the method for claim 1, wherein the speed for accessing the destination server speed is with relatively more each agency
Server determines the response time of the access request of the destination server.
3. method as claimed in claim 2, wherein the process of the preferential proxy server of determination is complete by data analysis tool
At.
4. the method for claim 1, wherein further including：
Judge whether the network resource accession request comes from target network, if so, selection accesses the destination server
Preferential proxy server, if it is not, then randomly choose a proxy server.
5. method as claimed in claim 4, wherein the target network refers to education network (CERNET), enterprise network or virtual
LAN.
6. the method for claim 1, wherein the process of the preferential proxy server of the determination is determining accessed mesh
Server is marked to carry out immediately later.
7. method as claimed in claim 6, wherein the correspondence of each destination server and its preferential proxy server is protected
There are on domain name resolution server.
8. the method for claim 1, wherein request for receiving network resource accession, according to the Internet resources
The step of access request, the destination server for determining corresponding access, further comprises, receives the request of network resource accession, extracts
The network resources address accessed is asked, the rhizosphere name of the corresponding destination server accessed is determined according to the network resources address.
9. the method for claim 1, wherein request for receiving network resource accession, according to the Internet resources
Access request determines that the corresponding destination server step accessed further comprises that receive the request of network resource accession, extraction is asked
The network resources address for asking access carries out domain name mapping to the network resources address, determines the corresponding destination server accessed
IP address.
10. the method for claim 1, wherein the process of the preferential proxy server of the determination further includes：
It is the format that data analysis tool stores data by the format conversion of the proxy log.
11. the method for claim 1, wherein the process of the preferential proxy server of the determination further includes：
By the correspondence for the proxy information that each proxy log and parsing obtain, 2-D data sequence is established.
12. the method for claim 1, wherein the proxy information further includes：The IP address of client, access time,
Access address URL.
13. a kind of device to be accessed by proxy server, wherein including：
Destination server determining module, the request for receiving network resource accession are asked, really according to the network resource accession
The fixed corresponding destination server accessed；
Server se-lection module preferentially is acted on behalf of, is used to select to access the preferential proxy server of the destination server, it is described excellent
First proxy server refers to, by being counted to correlation log, the access destination server determined fastest generation
Manage server, wherein it is described to confirm that the process of preferential proxy server is executed according to predeterminated frequency, and foundation is newly generated result
Preferential proxy server is updated, it is described preferential to act on behalf of server se-lection module and further comprise：Proxy log extraction
Module, for extracting the proxy log in preset time period on each proxy server；Proxy information analyzing sub-module, is used for
The proxy information in the proxy log is parsed, the proxy information includes each rhizosphere name for acting on behalf of institute's access target server
Or IP address and corresponding response time；Response time comparison sub-module accesses same root domain name or IP address for comparing
The response time of corresponding different proxy servers；Response time selects submodule, for being directed to same root domain name or IP
Address, Response to selection time shortest proxy server, as the preferential proxy server for accessing the destination server；
Data acquisition module, for network resource accession request to be sent to the preferential proxy server, by the pressure-gradient control valve
Reason server obtains data from destination server and returns.
14. device as claimed in claim 13, wherein the speed for accessing the destination server speed is with more each generation
Reason server determines the response time of the access request of the destination server.
15. device as claimed in claim 14, wherein described preferential to act on behalf of server se-lection module complete by data analysis tool
At.
16. device as claimed in claim 13, wherein further include：
Target network judgment module, for judging whether the network resource accession request comes from target network, if so, holding
Row major proxy server selecting module, if it is not, then executing random selection module, the random selection module is for randomly choosing
One proxy server.
17. device as claimed in claim 16, wherein the target network refers to education network (CERNET), enterprise network or void
Quasi- LAN.
18. device as claimed in claim 13, wherein the preferential server se-lection module of acting on behalf of is determining accessed mesh
Server is marked to execute immediately later.
19. device as claimed in claim 18, wherein the correspondence of each destination server and its preferential proxy server
It is stored on domain name resolution server.
20. device as claimed in claim 13, wherein the destination server determining module further comprises：
Rhizosphere name determination sub-module, the request for receiving network resource accession, the network resources address that extraction request accesses, root
The rhizosphere name of the corresponding destination server accessed is determined according to the network resources address.
21. device as claimed in claim 13, wherein the destination server determining module further comprises：
IP address determination sub-module, the request for receiving network resource accession, the network resources address that extraction request accesses are right
The network resources address carries out domain name mapping, determines the IP address of the corresponding destination server accessed.
22. device as claimed in claim 13, wherein described preferential to act on behalf of server se-lection module and further include：
Format conversion submodule, the format for the format conversion of the proxy log to be stored to data for data analysis tool.
23. device as claimed in claim 13, wherein described preferential to act on behalf of server se-lection module and further include：
2-D data sequence setting up submodule, the correspondence of the proxy information for being obtained by each proxy log and parsing,
Establish 2-D data sequence.
24. device as claimed in claim 13, wherein the proxy information further includes：The IP address of client, when accessing
Between, access address URL and/or responsive state.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510509630.6A CN105100260B (en) | 2012-03-31 | 2012-03-31 | A kind of method and device to be accessed by proxy server |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510509630.6A CN105100260B (en) | 2012-03-31 | 2012-03-31 | A kind of method and device to be accessed by proxy server |
| CN201210094019.8A CN102624920B (en) | 2012-03-31 | 2012-03-31 | A kind of method of being conducted interviews by proxy server and device |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210094019.8A Division CN102624920B (en) | 2012-03-31 | 2012-03-31 | A kind of method of being conducted interviews by proxy server and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105100260A CN105100260A (en) | 2015-11-25 |
| CN105100260B true CN105100260B (en) | 2018-10-09 |
Family
ID=46564602
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510509630.6A Expired - Fee Related CN105100260B (en) | 2012-03-31 | 2012-03-31 | A kind of method and device to be accessed by proxy server |
| CN201210094019.8A Active CN102624920B (en) | 2012-03-31 | 2012-03-31 | A kind of method of being conducted interviews by proxy server and device |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210094019.8A Active CN102624920B (en) | 2012-03-31 | 2012-03-31 | A kind of method of being conducted interviews by proxy server and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (2) | CN105100260B (en) |
Families Citing this family (42)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103595702B (en) * | 2012-08-17 | 2018-06-22 | 中兴通讯股份有限公司 | The choosing method and device of content providing |
| CN103634129B (en) * | 2012-08-22 | 2018-03-20 | 腾讯科技（深圳）有限公司 | A kind of method and device that proxy server is set |
| CN103678311B (en) | 2012-08-31 | 2018-11-13 | 腾讯科技（深圳）有限公司 | Web access method and system, crawl Routing Service device based on transfer mode |
| CN102932434B (en) * | 2012-10-17 | 2015-10-14 | 北京奇虎科技有限公司 | A kind of method and device for carrying out load balancing to server |
| CN103051720B (en) * | 2012-12-25 | 2016-05-25 | 华为技术有限公司 | Hadoop cluster inter-node communication method, equipment and system |
| CN103347068B (en) * | 2013-06-26 | 2016-03-09 | 江苏省未来网络创新研究院 | A kind of based on Agent cluster network-caching accelerated method |
| CN103297564B (en) * | 2013-07-03 | 2016-12-28 | 深圳市共进电子股份有限公司 | A kind of method of external proxy server address of automatically switching |
| CN104954320B (en) * | 2014-03-25 | 2019-12-06 | 北京奇虎科技有限公司 | method, device and system for establishing connection |
| CN104506549A (en) * | 2014-12-31 | 2015-04-08 | 北京奇虎科技有限公司 | Method, device and system for establishing online game connection |
| CN104580224B (en) * | 2015-01-14 | 2018-06-01 | 北京京东尚科信息技术有限公司 | A kind of method for connecting network and device and computer system |
| CN106528563A (en) * | 2015-09-11 | 2017-03-22 | 腾讯科技（深圳）有限公司 | Content access method and apparatus |
| CN105281976A (en) * | 2015-09-17 | 2016-01-27 | 国网北京市电力公司 | Method and apparatus for monitoring transmission of proxy service data |
| CN106547793A (en) * | 2015-09-22 | 2017-03-29 | 北京国双科技有限公司 | The method and apparatus for obtaining proxy server address |
| CN105245607B (en) * | 2015-10-23 | 2018-12-14 | 中国联合网络通信集团有限公司 | The dynamic auto selection method of proxy server and system |
| CN106921699A (en) * | 2015-12-25 | 2017-07-04 | 北京奇虎科技有限公司 | A kind of Network Access Method, device and system |
| CN107241371B (en) * | 2016-03-29 | 2020-04-07 | ***通信集团湖北有限公司 | Application data message processing method, mobile terminal and system |
| CN106101055A (en) * | 2016-04-29 | 2016-11-09 | 乐视控股（北京）有限公司 | The data access method of a kind of multiple database and system thereof and proxy server |
| CN110138872B (en) * | 2016-06-30 | 2022-02-25 | 上海智臻智能网络科技股份有限公司 | Computer readable medium for network proxy |
| CN106412079B (en) * | 2016-10-20 | 2019-04-16 | 福建天泉教育科技有限公司 | Request processing method and system |
| CN108063714B (en) * | 2016-11-09 | 2021-02-12 | 北京国双科技有限公司 | Network request processing method and device |
| CN106790608B (en) * | 2016-12-29 | 2020-05-22 | 北京奇艺世纪科技有限公司 | Server selection method and device |
| CN106899681B (en) * | 2017-03-10 | 2020-10-27 | 腾讯科技（深圳）有限公司 | Information pushing method and server |
| CN107483609B (en) * | 2017-08-31 | 2018-08-28 | 深圳市迅雷网文化有限公司 | A kind of Network Access Method, relevant device and system |
| CN107896241B (en) * | 2017-10-23 | 2020-12-18 | 东软集团股份有限公司 | Network access speed detection method and device, storage medium and electronic equipment |
| CN107819872A (en) * | 2017-11-22 | 2018-03-20 | 聚好看科技股份有限公司 | Ask the method and device of network data |
| CN108512897A (en) * | 2018-02-08 | 2018-09-07 | 深圳市欧乐在线技术发展有限公司 | A kind of network connection restoration methods and device |
| CN108494860B (en) * | 2018-03-28 | 2021-08-27 | 百度在线网络技术（北京）有限公司 | WEB access system, WEB access method and device for client |
| CN109981645A (en) * | 2019-03-26 | 2019-07-05 | 北京芯盾时代科技有限公司 | A kind of communication means and device |
| CN110311957B (en) * | 2019-06-14 | 2022-03-15 | 平安科技（深圳）有限公司 | Server load balancing method and related equipment |
| CN112565473B (en) * | 2019-09-10 | 2023-07-18 | 阿里巴巴集团控股有限公司 | Access control system and method, electronic device, and computer-readable storage medium |
| CN110851753B (en) * | 2019-11-07 | 2023-09-26 | 亿企赢网络科技有限公司 | Website access method, device, equipment and storage medium |
| CN113364818B (en) * | 2020-03-03 | 2022-08-30 | 北京搜狗科技发展有限公司 | Data processing method and device and electronic equipment |
| CN111756850B (en) * | 2020-06-29 | 2022-01-18 | 金电联行（北京）信息技术有限公司 | Automatic proxy IP request frequency adjustment method and system serving internet data acquisition |
| CN112073274B (en) * | 2020-09-08 | 2023-02-03 | 张立旭 | Remote access method and system for dynamically selecting reverse proxy server |
| CN112235402B (en) * | 2020-10-14 | 2023-04-07 | 杭州安恒信息技术股份有限公司 | Network source returning method, network source returning system and related device |
| CN112637339A (en) * | 2020-12-22 | 2021-04-09 | 北京东方嘉禾文化发展股份有限公司 | Network acceleration method and device, electronic equipment and storage medium |
| CN112637333A (en) * | 2020-12-22 | 2021-04-09 | 畅捷通信息技术股份有限公司 | Intelligent client agent method |
| CN113055498B (en) * | 2021-05-26 | 2021-10-01 | 天聚地合(苏州)数据股份有限公司 | Data source access method, device, storage medium and equipment |
| CN113923260B (en) * | 2021-09-28 | 2024-01-09 | 盐城天眼察微科技有限公司 | Method, device, terminal and storage medium for processing agent environment |
| CN114285899A (en) * | 2021-11-30 | 2022-04-05 | 同程网络科技股份有限公司 | Flow proxy method, system, intelligent terminal and storage medium |
| CN114979099B (en) * | 2022-04-14 | 2024-02-23 | 天津车之家软件有限公司 | Target service access method, module and system |
| CN115396509A (en) * | 2022-08-09 | 2022-11-25 | 上海宝创网络科技有限公司 | IPv6 network proxy service-based method and equipment for processing access limitation |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101510874A (en) * | 2009-03-20 | 2009-08-19 | 腾讯科技（深圳）有限公司 | Setup system and method for network connection, network communication tool and method |
| CN102355458A (en) * | 2011-09-16 | 2012-02-15 | 四川长虹电器股份有限公司 | Method for increasing success rate of network access |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6925461B2 (en) * | 2001-12-17 | 2005-08-02 | At&T Corp. | Parallel random proxy usage for large scale web access |
| US9083722B2 (en) * | 2007-10-05 | 2015-07-14 | Qualcomm Incorporated | Session initiation protocol registration with ping |
| CN101931635B (en) * | 2009-06-18 | 2014-05-28 | 北京搜狗科技发展有限公司 | Network resource access method and proxy device |
-
2012
- 2012-03-31 CN CN201510509630.6A patent/CN105100260B/en not_active Expired - Fee Related
- 2012-03-31 CN CN201210094019.8A patent/CN102624920B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101510874A (en) * | 2009-03-20 | 2009-08-19 | 腾讯科技（深圳）有限公司 | Setup system and method for network connection, network communication tool and method |
| CN102355458A (en) * | 2011-09-16 | 2012-02-15 | 四川长虹电器股份有限公司 | Method for increasing success rate of network access |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102624920B (en) | 2015-09-16 |
| CN102624920A (en) | 2012-08-01 |
| CN105100260A (en) | 2015-11-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105100260B (en) | A kind of method and device to be accessed by proxy server | |
| CN105024872B (en) | The method and device of applied in network performance test | |
| CN103685583B (en) | A kind of method and system of domain name mapping | |
| US20170255706A1 (en) | Methods and apparatus to track web browsing sessions | |
| CN103888928B (en) | Business strategy control method and system | |
| CN108156038B (en) | Request distribution method, device, access gateway and storage medium | |
| US20130198363A1 (en) | Techniques for tracking resource usage statistics per transaction across multiple layers of protocols | |
| CN104092791B (en) | The Internet content sources dispatching method and system of a kind of comprehensive quality and cost | |
| US9173097B2 (en) | Techniques for auto-authentication | |
| EP2817730A1 (en) | System and method for context specific website optimization | |
| CN101833570A (en) | Method and device for optimizing page push of mobile terminal | |
| CN107342913B (en) | Detection method and device for CDN node | |
| CN101931635A (en) | Network resource access method and proxy device | |
| CN104378389B (en) | Website security detection method and device | |
| CN104363252B (en) | Website security detection method and device | |
| CN105794175B (en) | Convey the performance metric of the system of WEB content | |
| CN106302230B (en) | A kind of data transmission method and device | |
| CN111753223A (en) | Access control method and device | |
| CN102739811A (en) | Method and device of domain name resolution | |
| CN104320488A (en) | Proxy server system and proxy service method | |
| CN107135091A (en) | A kind of application quality index mapping method, server and client side | |
| JP6199844B2 (en) | Suspicious part estimation device and suspected part estimation method | |
| CN105610991A (en) | Load balancing method of recursion and analysis DNS (Domain Name Server) under DHCP (Dynamic Host Configuration Protocol) environment | |
| CN101494654A (en) | Method and apparatus for determining server accessibility | |
| Roy et al. | LMS performance issues: a case study of D2L |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20181009 Termination date: 20210331 |