CN105897466A - Method and device for evaluating webpage resource distribution - Google Patents

Method and device for evaluating webpage resource distribution Download PDF

Info

Publication number
CN105897466A
CN105897466A CN201610193200.2A CN201610193200A CN105897466A CN 105897466 A CN105897466 A CN 105897466A CN 201610193200 A CN201610193200 A CN 201610193200A CN 105897466 A CN105897466 A CN 105897466A
Authority
CN
China
Prior art keywords
address
user
domain name
request
localization ratio
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201610193200.2A
Other languages
Chinese (zh)
Other versions
CN105897466B (en
Inventor
刘永生
王光全
夏俊杰
杨艳松
刘畅
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China United Network Communications Group Co Ltd
Original Assignee
China United Network Communications Group Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China United Network Communications Group Co Ltd filed Critical China United Network Communications Group Co Ltd
Priority to CN201610193200.2A priority Critical patent/CN105897466B/en
Publication of CN105897466A publication Critical patent/CN105897466A/en
Application granted granted Critical
Publication of CN105897466B publication Critical patent/CN105897466B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/14Network analysis or design
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L61/00Network arrangements, protocols or services for addressing or naming
    • H04L61/45Network directories; Name-to-address mapping
    • H04L61/4505Network directories; Name-to-address mapping using standardised directories; using standardised directory access protocols
    • H04L61/4511Network directories; Name-to-address mapping using standardised directories; using standardised directory access protocols using domain name system [DNS]

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Transfer Between Computers (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

The invention provides a method and device for evaluating webpage resource distribution and relates to the technical field of communication. The method and device are used for evaluating webpage resource distribution. The method comprises steps of: classifying a DNS log data sheet of a target webpage resource according to a preset rule to obtain a target classification table; acquiring a location corresponding to each first IP address in the target classification table; computing, according to the location corresponding to each first IP address and recorded quantity corresponding to each first IP address, an IP address localization rate of a webpage resource corresponding to a user location and a localization rate of recorded quantity; acquiring a localization rate of the webpage resource corresponding to the user location according to weights corresponding to the IP address localization rate and the localization rate of the recorded quantity; and if it is determined that the localization rate of the webpage resource corresponding to the user location is greater than or equal to a preset threshold value, determining that the localization rate of the webpage resource corresponding to the user location satisfies a requirement. The method and the device are applied to scenarios for evaluating the webpage resource distribution.

Description

A kind of evaluation method and device of web page resources distribution
Technical field
The present invention relates to communication technical field, particularly relate to the evaluation side of a kind of web page resources distribution Method and device.
Background technology
DNS (Domain Name System, domain name system) is core clothes in the Internet Business, accesses internet web page contents easily for user, and network address and IP address are carried out by DNS Mutually map.DNS is primarily present two kinds of query patterns, and one is resolution, i.e. user for Certain network address initiates analysis request to DNS, and DNS returns to the IP address that this network address is corresponding;Two are Reverse resolution, user initiates analysis request for certain IP address to DNS, and DNS returns this IP The domain name that address is corresponding.
The development of the Internet is perceived as center to user centered by interconnection and changes, mutually Networking service quality is increasingly paid close attention to by operator and Internet firm, and web page browsing industry Business is one of Internet service of commonly using most, and the speed that webpage is opened directly affects user's sense Know.Each webpage is by the most elementary composition, such as: word, picture, video, web page frame, Shell scripts etc., the server physical position depositing these elements is to affect web-browsing service matter One of key factor of amount.
In prior art, generally by the way of spiders or probe, obtain web page resources and divide Cloth, i.e. analog subscriber initiate the access of web-browsing service, record web page element place server IP address, then associate ownership place.
The method of the access of existing web-browsing service, is limited to number of probes and Operational Visit Number of times, some server may be missed.
Summary of the invention
Embodiments of the invention provide the evaluation method and device of a kind of web page resources distribution, in order to Web page resources distribution is evaluated.
For reaching above-mentioned purpose, embodiments of the invention adopt the following technical scheme that
First aspect, embodiments provides the evaluation methodology of a kind of web page resources distribution, Including:
According to preset rules, the DNS daily record data table of target web resource is classified, obtain Target classification table;Wherein, described target classification table at least include user request domain name, All IP addresses corresponding to domain name of each described user request and each described IP The record quantity that address is corresponding;A described IP address is DNS in described DNS daily record data table Server successfully resolves the IP coming first in the IP address corresponding to domain name that described user asks Address;
Obtain the ownership place that in described target classification table, each described IP address is corresponding;
The ownership place corresponding according to each described IP address and each described IP address Corresponding record quantity, calculates the webpage money that in described target web resource, user location is corresponding The IP address localization ratio in source and the localization ratio of record quantity;
According to the weight that IP address localization ratio is the most corresponding with the localization ratio of record quantity, obtain Take the web page resources localization ratio that described user location is corresponding;
If it is determined that web page resources localization ratio corresponding to described user location is more than or equal to presetting threshold Value, it is determined that web page resources localization ratio corresponding to described user location meets requirement.
In conjunction with first aspect, in the first possible implementation of first aspect, described meter Calculate the IP address localization of the web page resources that user location is corresponding in described target web resource Rate, including:
Obtain ownership place and the institute of an IP address corresponding to domain name of each described user request State the localization of the IP address that the domain name of each described user request is corresponding in target web resource Rate;
According to formulaCalculate user location in described target web resource corresponding The IP address localization ratio of web page resources, wherein, s is user in described target web resource The quantity of the domain name of request,For the domain name of the t user's request in the domain name of s user's request The localization ratio of corresponding IP address, RIPIP ground for web page resources corresponding to user location Location localization ratio.
In conjunction with in the first possible implementation of first aspect, at the second of first aspect In possible implementation, for the domain name of first user request, the territory of described first user request The domain name of any one user request in entitled described DNS daily record data table;
Accordingly, the domain name obtaining the request of first user described in described target web resource is corresponding The localization ratio of IP address, including:
Obtain all IP addresses corresponding to domain name of described first user request and each The ownership place that a described IP address is corresponding;
From the ownership place that described each described IP address is corresponding, filter out described user institute All IP addresses corresponding on ground;
According to formulaObtain the basis of the IP address corresponding to domain name of described first user request Ground rate, wherein, n is the number of an IP address corresponding to domain name of described first user request Amount, RDIPFor the localization ratio of the IP address corresponding to domain name of first user request, k is described use The quantity of the IP address that location, family is corresponding.
In conjunction with first aspect, in the third possible implementation of first aspect, described calculating The IP address record quantity of the web page resources that user location is corresponding in described target web resource Localization ratio, including:
Obtain the ownership place of an IP address corresponding to domain name of each described user request, and This locality of the record quantity that the domain name of each described user request is corresponding in described target web resource Rate;
According to formulaCalculate user location in described target web resource corresponding Web page resources IP address record quantity localization ratio, wherein, s is described target web The quantity of the domain name of user's request in resource,For the t use in the domain name of s user's request The localization ratio of the record quantity corresponding to domain name of family request, RcntFor in described target web resource The localization ratio of the IP address record quantity of the web page resources that user location is corresponding.
In conjunction with in the third possible implementation of first aspect, at the 4th kind of first aspect In possible implementation, for the domain name of second user's request, the territory of described second user's request The domain name of any one user request in entitled described DNS daily record data table;
Accordingly, the domain name of second user's request described in described target web resource is obtained corresponding The localization ratio of record quantity, including:
Obtain all IP addresses corresponding to domain name of described second user's request, each described Record quantity corresponding to ownership place that the oneth IP address is corresponding and each described IP address;
From the ownership place that described each described IP address is corresponding, filter out described user institute All IP addresses corresponding on ground;
According to formulaObtaining the second user described in described target web resource please The localization ratio of the record quantity that the domain name asked is corresponding, wherein, n is described second user's request Oneth IP number of addresses corresponding to domain name, miFor i-th first in a n described IP address The record quantity that IP address is corresponding, k is the IP number of addresses that described user location is corresponding, mjCorresponding for jth the oneth IP address in the IP address that the individual described user location of k is corresponding Record quantity, RDcntThis locality for the record quantity corresponding to domain name of described second user's request Rate.
Second aspect, the embodiment of the present invention provides the evaluating apparatus of a kind of web page resources distribution, bag Include:
Taxon, for according to the preset rules DNS daily record data table to target web resource Classify, obtain target classification table;Wherein, described target classification table at least includes a use At least one corresponding with the domain name that each described user ask of domain name the oneth IP of family request Record quantity corresponding to location and each described IP address;A described IP address is described In DNS daily record data table, dns server successfully resolves corresponding to the domain name of described user request IP address comes the IP address of first;
Associative cell, is used for obtaining each described IP address in described target classification table corresponding Ownership place;
Computing unit, for according to ownership place corresponding to each described IP address and each The record quantity that a described IP address is corresponding, calculates user place in described target web resource The IP address localization ratio of the web page resources that ground is corresponding and the localization ratio of record quantity;
Acquiring unit, for according to the localization ratio of IP address localization ratio and record quantity respectively Corresponding weight, obtains the web page resources localization ratio that described user location is corresponding;
Judging unit, for judging that web page resources localization ratio corresponding to described user location is No more than or equal to predetermined threshold value;
Determine unit, for determining, at described judging unit, the webpage that described user location is corresponding Resource localization rate, more than or equal to after predetermined threshold value, determines the net that described user location is corresponding Page resource localization rate meets requirement.
In conjunction with second aspect, in the first possible implementation of second aspect, for Location, family, described computing unit, including:
First acquisition module, for obtaining the IP that the domain name of each described user request is corresponding In the ownership place of address and described target web resource, the domain name of each described user request is corresponding The localization ratio of IP address;
First computing module, for according to formulaCalculate described target web resource The IP address localization ratio of the web page resources that middle user location is corresponding, wherein, s is described mesh The quantity of the domain name of user's request in mark web page resources,For t in the domain name of s user's request The localization ratio of the IP address corresponding to domain name of individual user request, RIPCorresponding for user location The IP address localization ratio of web page resources.
In conjunction with in the first possible implementation of second aspect, at the second of second aspect In possible implementation, for the domain name of first user request, the territory of described first user request The domain name of any one user request in entitled described DNS daily record data table;
Accordingly, described acquisition module, including:
First obtains submodule, for obtaining corresponding the owning of the domain name of described first user request Ownership place corresponding to the oneth IP address and each described IP address;
First screening submodule, for the ownership place corresponding from described each described IP address In, filter out all IP addresses that described user location is corresponding;
First calculating sub module, for according to formulaObtain the request of described first user The localization ratio of the IP address that domain name is corresponding, wherein, n is the domain name of described first user request The quantity of a corresponding IP address, RDIPFor the IP address that the domain name of first user request is corresponding Localization ratio, k is the quantity of an IP address corresponding to described user location.
In conjunction with second aspect, in the third possible implementation of second aspect, for user Location, described computing unit also includes:
Second acquisition module, for obtaining the IP that the domain name of each described user request is corresponding In the ownership place of address and described target web resource, the domain name of each described user request is corresponding The localization ratio of record quantity;
Second computing module, for according to formulaCalculate described target web resource The localization ratio of the IP address record quantity of the web page resources that middle user location is corresponding, wherein, s For the quantity of domain name of user's request in described target web resource,For s user's request The localization ratio of the record quantity that the domain name of the t user's request is corresponding, R in domain namecntFor described mesh The localization of the IP address record quantity of the web page resources that in mark web page resources, user location is corresponding Rate.
In conjunction with second aspect, in the 4th kind of possible implementation of second aspect, for second The domain name of user's request, the domain name of described second user's request is in described DNS daily record data table The domain name of any one user request;
Accordingly, described second acquisition module, including:
Second obtains submodule, for obtaining corresponding the owning of domain name of described second user's request Ownership place that oneth IP address, each described IP address are corresponding and each described IP The record quantity that address is corresponding;
Second screening submodule, for the ownership place corresponding from described each described IP address In, filter out all IP addresses that described user location is corresponding;
Second calculating sub module, for according to formulaObtain described target web money The localization ratio of the record quantity that the domain name of second user's request is corresponding described in source, wherein, n is The oneth IP number of addresses corresponding to domain name of described second user's request, miFor n described first The record quantity that in IP address, i-th the oneth IP address is corresponding, k is that described user location is corresponding An IP number of addresses, mjFor in the IP address that k described user location is corresponding the The record quantity that a j IP address is corresponding, RDcntDomain name pair for described second user's request The localization ratio of the record quantity answered.
The embodiment of the present invention provides the evaluation methodology of a kind of web page resources distribution, by according to presetting The DNS daily record data table of target web resource is classified by rule, obtains target classification table, Obtain the ownership place that in described target classification table, each described IP address is corresponding;According to each Record number corresponding to ownership place that a described IP address is corresponding and each described IP address Amount, calculates the IP address book of the web page resources that user location is corresponding in described target web resource Ground rate and the localization ratio of record quantity;According to IP address localization ratio and the basis of record quantity The weight that ground rate is the most corresponding, obtains the web page resources localization that described user location is corresponding Rate;If it is determined that web page resources localization ratio corresponding to described user location is more than or equal to presetting threshold Value, it is determined that web page resources localization ratio corresponding to described user location meets requirement.This Bright can use the DNS daily record data of whole users in network, cover all web page resources, and And the access times dimension of every class web page resources can be provided, due to DNS daily record data table be from The data that dns server obtains, it is not necessary to interact with user, therefore the embodiment of the present invention carries The method of confession is not take up network traffics, does not affect the Operational Visit of other users.By to DNS The big data analysis of daily record, obtains the ownership place of web page server, has found that server location The quality of service bottleneck caused.
Accompanying drawing explanation
In order to be illustrated more clearly that the technical scheme of the embodiment of the present invention, below will to embodiment or In description of the prior art, the required accompanying drawing used is briefly described, it should be apparent that below, Accompanying drawing in description is only some embodiments of the present invention, for those of ordinary skill in the art From the point of view of, on the premise of not paying creative work, it is also possible to obtain other according to these accompanying drawings Accompanying drawing.
The flow process of the evaluation methodology of a kind of web page resources distribution that Fig. 1 provides for the embodiment of the present invention Schematic diagram;
The evaluation methodology DNS day of a kind of web page resources distribution that Fig. 2 provides for the embodiment of the present invention Will tables of data;
The structure of the evaluating apparatus of a kind of web page resources distribution that Fig. 3 provides for the embodiment of the present invention Schematic diagram one;
The structure of the evaluating apparatus of a kind of web page resources distribution that Fig. 4 provides for the embodiment of the present invention Schematic diagram two.
Detailed description of the invention
Below in conjunction with the accompanying drawing in the embodiment of the present invention, to the technical side in the embodiment of the present invention Case is clearly and completely described, it is clear that described embodiment is only the present invention one Divide embodiment rather than whole embodiments.Based on the embodiment in the present invention, this area is general The every other embodiment that logical technical staff is obtained under not making creative work premise, Broadly fall into the scope of protection of the invention.
For the ease of clearly describing the technical scheme of the embodiment of the present invention, at embodiments of the invention In, have employed the printed words such as " first ", " second " essentially identical with effect identical to function Item or similar item make a distinction, and it will be appreciated by those skilled in the art that " first ", " second " Quantity and execution order are not defined Deng printed words.
As it is shown in figure 1, the embodiment of the present invention provides the evaluation methodology of a kind of web page resources distribution, Including:
S101, according to preset rules, the DNS daily record data table of target web resource is classified, Obtain target classification table;Wherein, described target classification table at least includes the territory of user's request Name, all IP addresses corresponding to domain name of each described user request and each described the The record quantity that one IP address is corresponding;A described IP address is described DNS daily record data table Middle dns server successfully resolves in the IP address corresponding to domain name of described user request and comes the The IP address of one;
S102, obtain the ownership place that in described target classification table, each described IP address is corresponding;
S103, according to ownership place and each described first corresponding to each described IP address The record quantity that IP address is corresponding, calculates user location in described target web resource corresponding The IP address localization ratio of web page resources and the localization ratio of record quantity;
S104, according to the IP address localization ratio power respectively the most corresponding with the localization ratio of record quantity Weight, obtains the web page resources localization ratio that described user location is corresponding;
S105 is if it is determined that web page resources localization ratio corresponding to described user location is more than or equal to Predetermined threshold value, it is determined that web page resources localization ratio corresponding to described user location meets requirement.
The evaluation methodology of a kind of web page resources distribution that the embodiment of the present invention provides, can be by one The evaluating apparatus planting web page resources distribution performs, web page resources distribution described in the embodiment of the present invention The installation site of evaluating apparatus be not defined, can be configured as required.
The embodiment of the present invention provides the evaluation methodology of a kind of web page resources distribution, by according to presetting The DNS daily record data table of target web resource is classified by rule, obtains target classification table, Obtain the ownership place that in described target classification table, each described IP address is corresponding;According to each Record number corresponding to ownership place that a described IP address is corresponding and each described IP address Amount, calculates the IP address book of the web page resources that user location is corresponding in described target web resource Ground rate and the localization ratio of record quantity;According to IP address localization ratio and the basis of record quantity The weight that ground rate is the most corresponding, obtains the web page resources localization that described user location is corresponding Rate;If it is determined that web page resources localization ratio corresponding to described user location is more than or equal to presetting threshold Value, it is determined that web page resources localization ratio corresponding to described user location meets requirement.This Bright can use the DNS daily record data of whole users in network, cover all web page resources, and And the access times dimension of every class web page resources can be provided, due to DNS daily record data table be from The data that dns server obtains, it is not necessary to interact with user, therefore the embodiment of the present invention carries The method of confession is not take up network traffics, does not affect the Operational Visit of other users.By to DNS The big data analysis of daily record, obtains the ownership place of web page server, has found that server location The quality of service bottleneck caused.
Wherein, the user location in the embodiment of the present invention is determined by the physical location of user.Example As, if user accesses dns server in Beijing, the most described user location is Beijing.
Wherein, the concrete numerical value of described predetermined threshold value is not defined by the embodiment of the present invention, uses Family can be configured the most as required.Exemplary, this predetermined threshold value can be 70%.General, described predetermined threshold value is the highest, when the webpage money that described user location is corresponding When source localization ratio is more than or equal to described predetermined threshold value, then show that described user location is corresponding Web page resources localization ratio is the best.
Before step S101, described method also includes:
S106, the DNS daily record data table of acquisition target web resource;Wherein, described DNS Daily record data table includes at least one dns server IP address, IP address, user please IP address list that DNS corresponding to domain name that the domain name asked is asked with each user returns and The domain name mapping time corresponding to domain name of each user request, as in figure 2 it is shown, wherein, generally The domain name that dns server is asked according to described user returns at least one IP ground to described user Location, at least one IP address described forms an IP address list.Generally, Yong Huxuan Select the IP address as this name server, the IP address in described IP address list, so This server backward initiates HTTP GET request.
Wherein, the embodiment of the present invention is to a described IP address (Internet Protocol Address) Not being defined, can be user when accessing dns server, dns server please according to user The described IP address list that the domain name asked returns is arranged in primary IP address;Due in reality In the operating process of border, it is possible to exist user use first IP address in IP address list without The server corresponding to domain name of method successful access user request, so an IP address can also Can be with the service corresponding to the domain name of successful access user request for user in described IP address list IP address corresponding to device, it is also possible to be in multiple IP addresses that dns server returns, Although this IP address can with server corresponding to this IP address of successful access, but this IP address The load of corresponding server is more, therefore an IP address is also likely to be the service of light load IP address corresponding to device.
Wherein, the embodiment of the present invention is to the DNS daily record data of described acquisition target web resource Concrete mode is not defined, and may refer to method of the prior art, and the embodiment of the present invention exists This repeats no more.
Wherein, the particular content of described target web resource is not defined by the embodiment of the present invention, Being there is a need to web page resources to be evaluated all can be as the web page resources of the embodiment of the present invention.
Wherein, the preset rules in the embodiment of the present invention refer to by user ask domain name identical and The DNS daily record data table that the oneth IP address corresponding to domain name of each described user request is identical is drawn It is divided into a class.
The embodiment of the present invention is to described target classification table and the concrete form of DNS daily record data table It is not defined, such as, exemplary, can be to use the form of form, as shown in table 1, Table 1 is exemplary, it is provided that the target classification table of form.
Table 1 DNS daily record data table
As it can be seen from table 1 the domain name of each user request at least one IP address corresponding, The corresponding record quantity in each IP address and ownership place.
Wherein, the mode obtaining ownership place corresponding to an IP address is not entered by the embodiment of the present invention Row limits, in the evaluating apparatus secondary IP address ownership place data base can being distributed by web page resources Obtain.
The mode adding up record quantity corresponding to each IP address is not entered by the embodiment of the present invention OK, such as, described record quantity comes out from DNS daily record, every in DNS daily record Domain name mapping correspondence a line of one user's request, record quantity is exactly row corresponding to identical category Number.
Further, the webpage that in described calculating described target web resource, user location is corresponding The IP address localization ratio of resource, including:
S1031A, the domain name obtaining the request of each described user in described target web resource are corresponding The localization ratio of IP address, and the IP ground that the domain name of each described user request is corresponding The ownership place of location;
S1032A, returning from an IP address corresponding to domain name of described each described user request In possession, filter out the domain name of all users request corresponding to described user location;
S1033A, according to formulaCalculate user place in described target web resource The IP address localization ratio of the web page resources that ground is corresponding, wherein, s is described target web resource The quantity of the domain name of middle user request,For the t user's request in the domain name of s user's request The localization ratio of IP address corresponding to domain name, RIPFor web page resources corresponding to user location IP address localization ratio.
Further alternative, owing to the domain name asked for each described user calculates IP address The mode of localization ratio is the most identical with principle, therefore the embodiment of the present invention is only with first user request Illustrate as a example by domain name, not there is any indicative implication, it is to be appreciated that described DNS In tables of data each described user request domain name calculate IP address localization ratio mode all with The domain name of described first user request is identical.
For the domain name of first user request, the domain name of described first user request is described DNS The domain name of any one user request in daily record data table;
Accordingly, the domain name obtaining the request of first user described in described target web resource is corresponding The localization ratio of IP address, including:
S10311A, obtain the request of described first user all IP addresses corresponding to domain name, And the ownership place that each described IP address is corresponding;
S10312A, from the ownership place that described each described IP address is corresponding, filter out All IP addresses that described user location is corresponding;
S10313A, according to formulaThe domain name obtaining the request of described first user is corresponding The localization ratio of IP address, wherein, n is an IP corresponding to domain name of described first user request The quantity of address, RDIPFor the localization ratio of the IP address corresponding to domain name of first user request, k Quantity for an IP address corresponding to described user location.
Exemplary, the embodiment of the present invention is with user location as Beijing, with user's request Domain name is to illustrate as a example by ipservice3.163.com, obtains described simultaneously, as shown in table 2, The more domain name that in reality, 163 homepages comprise, table 2 be only exemplary be given several.
The table that all domain names that table 2 163 homepage comprises are corresponding
163 homepage domain names
www.163.com
img3.cache.netease.com
ipservice.163.com
As can be seen from Table 1, the domain name of described user request is that ipservice3.163.com is corresponding The quantity of an IP address be 2, but when the only the oneth IP address is 61.135.253.204, Its ownership place is Beijing, therefore the domain name of described user request is ipservice3.163.com correspondence An IP address belonging to ownership place be the quantity of Beijing be 1, in conjunction with formulaPermissible Know, this locality that domain name is IP address corresponding for ipservice3.163.com of described user request Rate isEach user that 163 homepages comprise can be calculated based on the method The localization ratio of the IP address corresponding to domain name of request is respectively 100%, 100%.
Therefore according toIt is known that the webpage that in target web resource, Beijing is corresponding The IP address localization ratio of resource is
Further, it is also possible to calculate the IP address record of web page resources corresponding to user location The localization ratio of quantity, the embodiment of the present invention only illustrates, not as a example by user location There is any indicative implication:
For user location, it is described target data each described in described target classification table Any one ownership place in the ownership place that oneth IP address is corresponding, calculates described target web money The localization ratio of the IP address record quantity of the web page resources that in source, user location is corresponding, including:
S1031B, the domain name obtaining the request of each described user in described target web resource are corresponding The localization ratio of record quantity, and the IP that the domain name of each described user request is corresponding The ownership place of address;
S1032B, returning from an IP address corresponding to domain name of described each described user request In possession, filter out the domain name of all described user request corresponding to described user location;
S1033B, according to formulaCalculate user place in described target web resource The localization ratio of the IP address record quantity of the web page resources that ground is corresponding, wherein, s is described mesh The quantity of the domain name of user's request in mark web page resources,For in the domain name of s user request the The localization ratio of the record quantity that the domain name of t user request is corresponding, RcntProvide for described target web The localization ratio of the IP address record quantity of the web page resources that in source, user location is corresponding.
Further alternative, for the domain name of second user's request, described second user's request Domain name is the domain name of any one user request in described DNS daily record data table;
Accordingly, the domain name of second user's request described in described target web resource is obtained corresponding The localization ratio of record quantity, including:
S10311B, obtain described second user's request all IP addresses corresponding to domain name, Note corresponding to ownership place that each described IP address is corresponding and each described IP address Record quantity;
S10312B, from the ownership place that described each described IP address is corresponding, filter out All IP addresses that described user location is corresponding;
S10313B, according to formulaObtain described in described target web resource The localization ratio of the record quantity corresponding to domain name of two users' requests, wherein, n is described second use The oneth IP number of addresses corresponding to domain name of family request, miFor in a n described IP address i-th The record quantity that an individual IP address is corresponding, k is the IP ground that described user location is corresponding Location quantity, mjFor jth the oneth IP in the IP address that the individual described user location of k is corresponding The record quantity that address is corresponding, RDcntFor the record number that the domain name of described second user's request is corresponding The localization ratio of amount.
Exemplary, the embodiment of the present invention is with user location as Beijing, with user's request Domain name is to illustrate as a example by ipservice3.163.com.
As can be seen from Table 1, the domain name of described user request is that ipservice3.163.com is corresponding 2 IP addresses, i.e. 61.135.253.204 and 61.135.253.203, wherein, 61.135.253.204 the record quantity corresponding with 61.135.253.203 is respectively 1 and 2, and 61.135.253.204 with the ownership place of 61.135.253.203 is respectively Beijing and Hebei provincial stone man Village city, therefore the domain name of described user request is an IP address corresponding for ipservice3.163.com Record quantity summation is 3.Belonging to ownership place be the quantity of Beijing be 1, in conjunction with formulaIt is recognised that the domain name of described user request is ipservice3.163.com pair The localization ratio of the record quantity answered is163 can be calculated main based on the method The localization ratio of the record quantity of the IP address that the domain name of each user that the page comprises request is corresponding It is respectively 100%, 100%.
Therefore according toIt is known that the webpage that in target web resource, Beijing is corresponding The IP address localization ratio of resource is
Method based on embodiment of the present invention offer can calculate the basis of the IP address of web page resources Ground rate and the localization ratio of record quantity, by preset IP address localization ratio and record quantity Localization ratio corresponding respectively weight can to obtain the web page resources distribution of user location corresponding Comprehensive parameters, thus obtain whether the web page resources distribution of user location meets requirement, the present invention The weight that the localization ratio of IP address localization ratio and record quantity is corresponding respectively is not entered by embodiment Row limits, and user can be configured as required, can if focusing on evaluating IP address localization ratio With by high for the comparison of weight setting corresponding for described IP address localization ratio, if focusing on evaluating record The comparison that weight corresponding for the localization ratio of record quantity can be arranged by the localization ratio of quantity High.
It should be noted that the embodiment of the present invention can also only calculate a user location correspondence Comprehensive grading parameters, if comprehensive grading parameters corresponding to this user location is less than predetermined threshold value, Then the described on-site server of user etc. is adjusted correspondingly, for example, it is possible to consideration will Target web resource introduces user location, so that its comprehensive grading parameters meets requirement.
The embodiment of the present invention also provides for the evaluating apparatus of a kind of web page resources distribution, as it is shown on figure 3, Including:
Taxon 301, for according to the preset rules DNS daily record number to target web resource Classify according to table, obtain target classification table;Wherein, described target classification table at least includes one The domain name of individual user request, at least one IP corresponding to domain name of each described user request Record quantity corresponding to address and each described IP address;A described IP address is institute State dns server in DNS daily record data table successfully resolve described user request domain name institute right The IP address answered comes the IP address of first;
Associative cell 302, is used for obtaining each described IP address in described target classification table Corresponding ownership place;
Computing unit 303, for according to ownership place corresponding to each described IP address and The record quantity that each described IP address is corresponding, calculates user in described target web resource The IP address localization ratio of the web page resources that location is corresponding and the localization ratio of record quantity;
Acquiring unit 304, for according to IP address localization ratio and the localization ratio of record quantity The most corresponding weight, obtains the web page resources localization ratio that described user location is corresponding;
Judging unit 305, for judging the web page resources localization ratio that described user location is corresponding Whether more than or equal to predetermined threshold value;
Determine unit 306, for determining, at described judging unit, the net that described user location is corresponding Page resource localization rate, more than or equal to after predetermined threshold value, determines that described user location is corresponding Web page resources localization ratio meets requirement.
The embodiment of the present invention provides the evaluating apparatus of a kind of web page resources distribution, by according to presetting The DNS daily record data table of target web resource is classified by rule, obtains target classification table, Obtain the ownership place that in described target classification table, each described IP address is corresponding;According to each Record number corresponding to ownership place that a described IP address is corresponding and each described IP address Amount, calculates the IP address book of the web page resources that user location is corresponding in described target web resource Ground rate and the localization ratio of record quantity;According to IP address localization ratio and the basis of record quantity The weight that ground rate is the most corresponding, obtains the web page resources localization that described user location is corresponding Rate;If it is determined that web page resources localization ratio corresponding to described user location is more than or equal to presetting threshold Value, it is determined that web page resources localization ratio corresponding to described user location meets requirement.This Bright can use the DNS daily record data of whole users in network, cover all web page resources, and And the access times dimension of every class web page resources can be provided, due to DNS daily record data table be from The data that dns server obtains, it is not necessary to interact with user, therefore the embodiment of the present invention carries The method of confession is not take up network traffics, does not affect the Operational Visit of other users.By to DNS The big data analysis of daily record, obtains the ownership place of web page server, has found that server location The quality of service bottleneck caused.
Further alternative, as shown in Figure 4, described computing unit 303, including:
First acquisition module 3031A, is used for obtaining each described use in described target web resource The localization ratio of the IP address corresponding to domain name of family request, and the territory of each described user request The ownership place of the IP address that name is corresponding;
First computing module 3032A, for according to formulaCalculate described target network The IP address localization ratio of the web page resources that user location is corresponding in page resource, wherein, s is The quantity of the domain name of user's request in described target web resource,Territory for s user's request The localization ratio of the IP address that the domain name of the t user's request is corresponding, R in MingIPFor user place The IP address localization ratio of the web page resources that ground is corresponding.
Further alternative, for the domain name of first user request, the request of described first user Domain name is the domain name of any one user request in described DNS daily record data table;
Accordingly, described acquisition module, including:
First obtain submodule, for obtain ownership place corresponding to each described IP address, And all IP addresses that the domain name of described first user request is corresponding;
First screening submodule, for the ownership place corresponding from described each described IP address In, filter out all IP addresses that described user location is corresponding;
First calculating sub module, for according to formulaObtain the request of described first user The localization ratio of the IP address that domain name is corresponding, wherein, n is the domain name of described first user request The quantity of a corresponding IP address, RDIPFor the IP address that the domain name of first user request is corresponding Localization ratio, k is the quantity of an IP address corresponding to described user location.
Further alternative, for user location, as shown in Figure 4, described computing unit 303 Also include:
Second acquisition module 3031B, for obtain that the domain name of each described user request is corresponding the The territory of each described user request in the ownership place of one IP address, and described target web resource The localization ratio of the record quantity that name is corresponding;
Second computing module 3032B, for according to formulaCalculate described target network The localization ratio of the IP address record quantity of the web page resources that in page resource, user location is corresponding, Wherein, s is the quantity of the domain name of user's request in described target web resource,For s use The localization ratio of the record quantity that the domain name of the t user's request is corresponding, R in the domain name of family requestcnt IP address record quantity for web page resources corresponding to user location in described target web resource Localization ratio.
Further alternative, for the domain name of second user's request, described second user's request Domain name is the domain name of any one user request in described DNS daily record data table;
Accordingly, described second acquisition module, including:
Second obtains submodule, corresponding at least for obtaining the domain name of described second user's request The ownership place and each described that one IP address, each described IP address are corresponding The record quantity that one IP address is corresponding;
Second screening submodule, for the ownership place corresponding from described each described IP address In, filter out all IP addresses that described user location is corresponding;
Second calculating sub module, for according to formulaObtain described target web money The localization ratio of the record quantity that the domain name of second user's request is corresponding described in source, wherein, n is The oneth IP number of addresses corresponding to domain name of described second user's request, miFor n described first The record quantity that in IP address, i-th the oneth IP address is corresponding, k is that described user location is corresponding An IP number of addresses, mjFor in the IP address that k described user location is corresponding the The record quantity that a j IP address is corresponding, RDcntDomain name pair for described second user's request The localization ratio of the record quantity answered.
In several embodiments provided herein, it should be understood that disclosed system, dress Put and method, can realize by another way.Such as, device described above is implemented Example is only schematically, such as, the division of described unit, it is only a kind of logic function and draws Point, actual can have other dividing mode, the most multiple unit or assembly to tie when realizing Close or be desirably integrated into another system, or some features can be ignored, or not performing.Separately A bit, shown or discussed coupling each other or direct-coupling or communication connection can be By INDIRECT COUPLING or the communication connection of some interfaces, device or unit, can be electrical, machine Tool or other form.
The described unit illustrated as separating component can be or may not be physically separate , the parts shown as unit can be or may not be physical location, i.e. can position In a place, or can also be distributed on multiple NE.Can be according to actual need Select some or all of unit therein to realize the purpose of the present embodiment scheme.
It addition, each functional unit in each embodiment of the present invention can be integrated in a process In unit, it is also possible to be that the independent physics of unit includes, it is also possible to two or more are single Unit is integrated in a unit.Above-mentioned integrated unit both can realize to use the form of hardware, The form that hardware can also be used to add SFU software functional unit realizes.
The above-mentioned integrated unit realized with the form of SFU software functional unit, can be stored in one In computer read/write memory medium.Above-mentioned SFU software functional unit is stored in a storage medium, Including some instructions with so that computer equipment (can be personal computer, server, Or the network equipment etc.) perform the part steps of method described in each embodiment of the present invention.And it is front The storage medium stated includes: USB flash disk, portable hard drive, read only memory (Read-Only Memory, Be called for short ROM), random access memory (Random Access Memory, be called for short RAM), The various medium that can store program code such as magnetic disc or CD.
Last it is noted that above example is only in order to illustrate technical scheme, and Non-to its restriction;Although the present invention being described in detail with reference to previous embodiment, ability The those of ordinary skill in territory is it is understood that it still can be to the skill described in foregoing embodiments Art scheme is modified, or wherein portion of techniques feature is carried out equivalent;And these are repaiied Change or replace, not making the essence of appropriate technical solution depart from various embodiments of the present invention technical side The spirit and scope of case.

Claims (10)

1. the evaluation methodology of a web page resources distribution, it is characterised in that including:
According to preset rules, the DNS daily record data table of target web resource is classified, obtain Target classification table;Wherein, described target classification table at least include user request domain name, All IP addresses corresponding to domain name of each described user request and each described IP The record quantity that address is corresponding;A described IP address is DNS in described DNS daily record data table Server successfully resolves the IP coming first in the IP address corresponding to domain name that described user asks Address;
Obtain the ownership place that in described target classification table, each described IP address is corresponding;
The ownership place corresponding according to each described IP address and each described IP address Corresponding record quantity, calculates the webpage money that in described target web resource, user location is corresponding The IP address localization ratio in source and the localization ratio of record quantity;
According to the weight that IP address localization ratio is the most corresponding with the localization ratio of record quantity, obtain Take the web page resources localization ratio that described user location is corresponding;
If it is determined that web page resources localization ratio corresponding to described user location is more than or equal to presetting threshold Value, it is determined that web page resources localization ratio corresponding to described user location meets requirement.
Method the most according to claim 1, it is characterised in that the described target of described calculating The IP address localization ratio of the web page resources that in web page resources, user location is corresponding, including:
Obtain ownership place and the institute of an IP address corresponding to domain name of each described user request State the localization of the IP address that the domain name of each described user request is corresponding in target web resource Rate;
According to formulaCalculate user location in described target web resource corresponding The IP address localization ratio of web page resources, wherein, s is user in described target web resource The quantity of the domain name of request,For the domain name of the t user's request in the domain name of s user's request The localization ratio of corresponding IP address, RIPIP ground for web page resources corresponding to user location Location localization ratio.
Method the most according to claim 2, it is characterised in that first user is asked Domain name, described first user request domain name be any one in described DNS daily record data table The domain name of user's request;
Accordingly, the domain name obtaining the request of first user described in described target web resource is corresponding The localization ratio of IP address, including:
Obtain all IP addresses that the domain name of described first user request is corresponding, and each The ownership place that a described IP address is corresponding;
From the ownership place that described each described IP address is corresponding, filter out described user institute All IP addresses corresponding on ground;
According to formulaObtain the basis of the IP address corresponding to domain name of described first user request Ground rate, wherein, n is the number of an IP address corresponding to domain name of described first user request Amount, RDIPFor the localization ratio of the IP address corresponding to domain name of first user request, k is described use The quantity of the IP address that location, family is corresponding.
Method the most according to claim 1, it is characterised in that the described target of described calculating The localization of the IP address record quantity of the web page resources that in web page resources, user location is corresponding Rate, including:
Obtain ownership place and the institute of an IP address corresponding to domain name of each described user request State the localization of the record quantity that the domain name of each described user request is corresponding in target web resource Rate;
According to formulaCalculate user location in described target web resource corresponding Web page resources IP address record quantity localization ratio, wherein, s is described target web The quantity of the domain name of user's request in resource,For the t use in the domain name of s user's request The localization ratio of the record quantity corresponding to domain name of family request, RcntFor in described target web resource The localization ratio of the IP address record quantity of the web page resources that user location is corresponding.
Method the most according to claim 4, it is characterised in that for second user's request Domain name, described second user request domain name be any one in described DNS daily record data table The domain name of user's request;
Accordingly, the domain name of second user's request described in described target web resource is obtained corresponding The localization ratio of record quantity, including:
Obtain all IP addresses corresponding to domain name of described second user's request, each described Record quantity corresponding to ownership place that the oneth IP address is corresponding and each described IP address;
From the ownership place that described each described IP address is corresponding, filter out user location Corresponding all IP addresses;
According to formulaObtaining the second user described in described target web resource please The localization ratio of the record quantity that the domain name asked is corresponding, wherein, n is described second user's request Oneth IP number of addresses corresponding to domain name, miFor i-th first in a n described IP address The record quantity that IP address is corresponding, k is the IP number of addresses that described user location is corresponding, mjCorresponding for jth the oneth IP address in the IP address that the individual described user location of k is corresponding Record quantity, RDcntThis locality for the record quantity corresponding to domain name of described second user's request Rate.
6. the evaluating apparatus of a web page resources distribution, it is characterised in that including:
Taxon, for according to the preset rules DNS daily record data table to target web resource Classify, obtain target classification table;Wherein, described target classification table at least includes a use The domain name of family request, all IP addresses corresponding to domain name of each described user request and The record quantity that each described IP address is corresponding;A described IP address is described DNS In daily record data table, dns server successfully resolves the IP corresponding to domain name of described user request Address comes the IP address of first;
Associative cell, is used for obtaining each described IP address in described target classification table corresponding Ownership place;
Computing unit, for according to ownership place corresponding to each described IP address and each The record quantity that a described IP address is corresponding, calculates user place in described target web resource The IP address localization ratio of the web page resources that ground is corresponding and the localization ratio of record quantity;
Acquiring unit, for according to the localization ratio of IP address localization ratio and record quantity respectively Corresponding weight, obtains the web page resources localization ratio that described user location is corresponding;
Judging unit, for judging that web page resources localization ratio corresponding to described user location is No more than or equal to predetermined threshold value;
Determine unit, for determining, at described judging unit, the webpage that described user location is corresponding Resource localization rate, more than or equal to after predetermined threshold value, determines the net that described user location is corresponding Page resource localization rate meets requirement.
Device the most according to claim 6, it is characterised in that described computing unit, bag Include:
First acquisition module, for obtaining the IP that the domain name of each described user request is corresponding In the ownership place of address and described target web resource, the domain name of each described user request is corresponding The localization ratio of IP address;
First computing module, for according to formulaCalculate described target web resource The IP address localization ratio of the web page resources that middle user location is corresponding, wherein, s is described mesh The quantity of the domain name of user's request in mark web page resources,For t in the domain name of s user's request The localization ratio of the IP address corresponding to domain name of individual user request, RIPCorresponding for user location The IP address localization ratio of web page resources.
Device the most according to claim 7, it is characterised in that first user is asked Domain name, described first user request domain name be any one in described DNS daily record data table The domain name of user's request;
Accordingly, described acquisition module, including:
First obtains submodule, for obtaining corresponding the owning of the domain name of described first user request Oneth IP address, and the ownership place that each described IP address is corresponding;
First screening submodule, for the ownership place corresponding from described each described IP address In, filter out all IP addresses that described user location is corresponding;
First calculating sub module, for according to formulaObtain the request of described first user The localization ratio of the IP address that domain name is corresponding, wherein, n is the domain name of described first user request The quantity of a corresponding IP address, RDIPFor the IP address that the domain name of first user request is corresponding Localization ratio, k is the quantity of an IP address corresponding to described user location.
Device the most according to claim 6, it is characterised in that described computing unit also wraps Include:
Second acquisition module, for obtaining the IP that the domain name of each described user request is corresponding In the ownership place of address and described target web resource, the domain name of each described user request is corresponding The localization ratio of record quantity;
Second computing module, for according to formulaCalculate described target web resource The localization ratio of the IP address record quantity of the web page resources that middle user location is corresponding, wherein, s For the quantity of domain name of user's request in described target web resource,For s user's request The localization ratio of the record quantity that the domain name of the t user's request is corresponding, R in domain namecntFor described mesh The localization of the IP address record quantity of the web page resources that in mark web page resources, user location is corresponding Rate.
Device the most according to claim 9, it is characterised in that please for the second user The domain name asked, the domain name of described second user's request is any one in described DNS daily record data table The domain name of individual user request;
Accordingly, described second acquisition module, including:
Second obtains submodule, for obtaining corresponding the owning of domain name of described second user's request Ownership place that oneth IP address, each described IP address are corresponding and each described IP The record quantity that address is corresponding;
Second screening submodule, for the ownership place corresponding from described each described IP address In, filter out all IP addresses that described user location is corresponding;
Second calculating sub module, for according to formulaObtain described target web money The localization ratio of the record quantity that the domain name of second user's request is corresponding described in source, wherein, n is The oneth IP number of addresses corresponding to domain name of described second user's request, miFor n described first The record quantity that in IP address, i-th the oneth IP address is corresponding, k is that described user location is corresponding An IP number of addresses, mjFor in the IP address that k described user location is corresponding the The record quantity that a j IP address is corresponding, RDcntDomain name pair for described second user's request The localization ratio of the record quantity answered.
CN201610193200.2A 2016-03-30 2016-03-30 A kind of evaluation method and device of web page resources distribution Active CN105897466B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610193200.2A CN105897466B (en) 2016-03-30 2016-03-30 A kind of evaluation method and device of web page resources distribution

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610193200.2A CN105897466B (en) 2016-03-30 2016-03-30 A kind of evaluation method and device of web page resources distribution

Publications (2)

Publication Number Publication Date
CN105897466A true CN105897466A (en) 2016-08-24
CN105897466B CN105897466B (en) 2018-10-12

Family

ID=57014154

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610193200.2A Active CN105897466B (en) 2016-03-30 2016-03-30 A kind of evaluation method and device of web page resources distribution

Country Status (1)

Country Link
CN (1) CN105897466B (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101604317A (en) * 2009-07-13 2009-12-16 腾讯科技(深圳)有限公司 The retrieving result reordering method of search engine and system
US7962594B2 (en) * 2001-06-22 2011-06-14 Digital River, Inc. Delivering content on a network using differential caching system and method
CN103176985A (en) * 2011-12-20 2013-06-26 中国科学院计算机网络信息中心 Timely and high-efficiency crawling method for internet information
CN103235823A (en) * 2013-05-06 2013-08-07 上海河广信息科技有限公司 Method and system for determining current interest of users according to related web pages and current behaviors
CN103905266A (en) * 2012-12-27 2014-07-02 ***通信集团公司 Distributed internet behavior analysis method, device and system
CN104484405A (en) * 2014-12-15 2015-04-01 北京国双科技有限公司 Method and device for carrying out crawling task

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7962594B2 (en) * 2001-06-22 2011-06-14 Digital River, Inc. Delivering content on a network using differential caching system and method
CN101604317A (en) * 2009-07-13 2009-12-16 腾讯科技(深圳)有限公司 The retrieving result reordering method of search engine and system
CN103176985A (en) * 2011-12-20 2013-06-26 中国科学院计算机网络信息中心 Timely and high-efficiency crawling method for internet information
CN103905266A (en) * 2012-12-27 2014-07-02 ***通信集团公司 Distributed internet behavior analysis method, device and system
CN103235823A (en) * 2013-05-06 2013-08-07 上海河广信息科技有限公司 Method and system for determining current interest of users according to related web pages and current behaviors
CN104484405A (en) * 2014-12-15 2015-04-01 北京国双科技有限公司 Method and device for carrying out crawling task

Also Published As

Publication number Publication date
CN105897466B (en) 2018-10-12

Similar Documents

Publication Publication Date Title
JP5670363B2 (en) Web page ranking considering hierarchy
US10789089B2 (en) Dynamic application migration between cloud providers
Ackland Mapping the US political blogosphere: Are conservative bloggers more prominent?
Wu et al. Identifying link farm spam pages
CN107957957A (en) The acquisition methods and device of test case
Shi et al. Citing for high impact
CN102955798B (en) A kind of searching method and search server based on search engine
CN102663048B (en) Method and device for providing search result
CN107342913B (en) Detection method and device for CDN node
CN101855631A (en) Navigational ranking for focused crawling
JP2006107506A5 (en)
JP2006511884A5 (en)
DE102016125767A1 (en) Discovery of a connected entity
CN105871577A (en) Method and device for managing resource privilege
CN107249049A (en) A kind of method and apparatus screened to the domain name data that network is gathered
CN106357789A (en) Information access control method and server
CN107957938A (en) A kind of method and system for obtaining website test data
US8140444B2 (en) Method of measuring a large population of web pages for compliance to content standards that require human judgement to evaluate
CN112100185A (en) Indexing system and method for block chain data balance load
CN102214183A (en) Search engine query method for combining feedback contents of pages with fixed ranking
CN109586942A (en) Web site performance assessment method and device
CN107203623B (en) Load balancing and adjusting method of web crawler system
Quattrone et al. Modelling growth of urban crowd-sourced information
CN109960534A (en) Equipment detection method, device, storage medium and electronic equipment
CN109561162A (en) Excavate the method and device that user accesses hobby

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant