WO2023098476A1

WO2023098476A1 - Poor network quality user determination method and apparatus, electronic device, and storage medium

Info

Publication number: WO2023098476A1
Application number: PCT/CN2022/132195
Authority: WO
Inventors: 王冲
Original assignee: 中兴通讯股份有限公司
Priority date: 2021-11-30
Filing date: 2022-11-16
Publication date: 2023-06-08
Also published as: CN116208515A

Abstract

The present application provides a poor network quality user determination method and apparatus, an electronic device, and a storage medium. The method comprises: according to Internet surfing data of a user, obtaining at least one Internet service provider (ISP) website perceived by the user; obtaining an index threshold of each access index of the at least one ISP website, and an access index where the user accesses the at least one ISP website; and when a poor quality access index which does not meet the index threshold is obtained according to the index threshold of each access index and the access index of the user, determining the user as a poor quality user according to the poor quality access index, and determining the poor quality type of the user.

Description

网络质差用户的判断方法、装置、电子设备及存储介质Judgment method, device, electronic equipment and storage medium for users with poor network quality

相关申请的交叉引用Cross References to Related Applications

本申请要求2021年11月30日提交给中国专利局的第202111443628.5号专利申请的优先权，其全部内容通过引用合并于此。This application claims priority to Patent Application No. 202111443628.5 filed with the China Patent Office on November 30, 2021, the entire contents of which are hereby incorporated by reference.

技术领域technical field

本申请涉及但不限于通信技术领域。This application relates to but not limited to the field of communication technology.

背景技术Background technique

随着通讯技术的日渐完善和网络技术的高速发展，家庭网络已经遍布寻常百姓家，据统计，目前已经有高达数十亿网民。上网作为现代人生活中必不可少的活动，网络的质量就显得尤为重要了，而判断网络质量的最直接方式就是用户的切身体验，上网体验也成为了用户选择一家运营商的决定因素，因此，对于运营商而言，改善网络质量，提升用户上网满意度迫在眉睫。With the improvement of communication technology and the rapid development of network technology, home networks have spread all over the homes of ordinary people. According to statistics, there are already billions of Internet users. Surfing the Internet is an essential activity in modern life, so the quality of the network is particularly important, and the most direct way to judge the quality of the network is the user's personal experience. , for operators, it is imminent to improve network quality and enhance users' online satisfaction.

发明内容Contents of the invention

本申请提供一种网络质差用户的判断方法、装置、电子设备及存储介质。The present application provides a method, device, electronic equipment and storage medium for judging users with poor network quality.

一方面，本申请提供了一种网络质差用户的判断方法，包括：根据用户的上网数据，获取用户感知的至少一个互联网服务提供商ISP网站；获取至少一个ISP网站的各访问指标的指标阈值，以及用户访问至少一个ISP网站的访问指标；在根据各访问指标的指标阈值，以及用户的访问指标，获取到不满足指标阈值的质差访问指标的情况下，根据质差访问指标确定用户为质差用户，并确定用户的质差类型。On the one hand, the present application provides a method for judging users with poor network quality, including: obtaining at least one ISP website perceived by the user according to the user's online data; obtaining the index threshold of each access index of at least one ISP website , and the access index of the user’s access to at least one ISP website; in the case of obtaining a poor-quality access index that does not meet the index threshold according to the index thresholds of each access index and the user’s access index, determine the user according to the poor-quality access index. poor quality users, and determine the user's poor quality type.

另一方面，本申请提供了一种网络质差用户的判断装置，包括：网站获取模块：配置为根据用户的上网数据，获取用户感知的至少一个互联网服务提供商ISP网站；指标获取模块：配置为获取至少一个 ISP网站的各访问指标的指标阈值，以及用户访问至少一个ISP网站的访问指标；确定模块：配置为在根据各访问指标的指标阈值，以及用户的访问指标，获取到不满足指标阈值的质差访问指标的情况下，根据质差访问指标确定用户为质差用户，并确定用户的质差类型。On the other hand, the present application provides a device for judging users with poor network quality, including: a website acquisition module: configured to acquire at least one Internet Service Provider ISP website perceived by the user according to the user's online data; an indicator acquisition module: configured In order to obtain the index threshold of each access index of at least one ISP website, and the access index of the user's access to at least one ISP website; the determination module: configured to obtain the unsatisfied index according to the index threshold of each access index and the user's access index In the case of the poor-quality access indicator of the threshold value, the user is determined to be a poor-quality user according to the poor-quality access indicator, and the user's poor-quality type is determined.

另一方面，本申请还提供了一种电子设备，包括：至少一个处理器；以及，与所述至少一个处理器通信连接的存储器；其中，所述存储器存储有可被所述至少一个处理器执行的指令，所述指令被所述至少一个处理器执行时，使所述至少一个处理器执行本文所述的任一网络质差用户的判断方法。On the other hand, the present application also provides an electronic device, including: at least one processor; and a memory connected in communication with the at least one processor; wherein, the memory stores information that can be used by the at least one processor Executable instructions, when the instructions are executed by the at least one processor, cause the at least one processor to execute any method for judging users with poor network quality described herein.

另一方面，本申请还提供了一种计算机可读存储介质，存储有计算机程序，所述计算机程序被处理器执行时，使得所述处理器实现本文所述的任一网络质差用户的判断方法。On the other hand, the present application also provides a computer-readable storage medium, which stores a computer program, and when the computer program is executed by a processor, the processor realizes the judgment of any user with poor network quality described herein method.

附图说明Description of drawings

图1是本申请提供的实现网络质差用户的判断方法的设备示意图；FIG. 1 is a schematic diagram of equipment provided by the present application to implement a method for judging users with poor network quality;

图2是本申请提供的网络质差用户的判断方法的流程图；Fig. 2 is a flow chart of the method for judging users with poor network quality provided by the present application;

图3是本申请提供的网络质差用户的判断装置的结构示意图；FIG. 3 is a schematic structural diagram of a device for judging users with poor network quality provided by the present application;

图4是本申请提供的电子结构示意图。Fig. 4 is a schematic diagram of the electronic structure provided by the present application.

具体实施方式Detailed ways

为使本申请实施方式的目的、技术方案和优点更加清楚，下面将结合附图对本申请的各实施方式进行详细的阐述。然而，本领域的普通技术人员可以理解，在本申请各实施方式中，为了使读者更好地理解本申请而提出了许多技术细节。但是，即使没有这些技术细节和基于以下各实施方式的种种变化和修改，也可以实现本申请所要求保护的技术方案。In order to make the objectives, technical solutions and advantages of the embodiments of the present application clearer, the various embodiments of the present application will be described in detail below with reference to the accompanying drawings. However, those of ordinary skill in the art can understand that, in each implementation manner of the present application, many technical details are provided for readers to better understand the present application. However, even without these technical details and various changes and modifications based on the following implementation modes, the technical solution claimed in this application can also be realized.

除非另有指示，否则下面说明中的功能性元件和附图中示出的对应块可在被配置为执行特定功能的诸如硬件、软件或它们的组合的处理电路中实施。例如，处理电路更具体地可为和/或可包括(但不限于)中央处理单元(CPU)、算数逻辑单元(ALU)、数字信号处理器、微计算机、现场可编程门阵列(FPGA)、***芯片(SoC)、可编程逻辑单元、微处理器、专用集成电路(ASIC)、电组件(诸如晶体管、电阻器、电容器、逻辑门(包括AND门、OR门、NOR门、NAND门、NOT门、XOR门等中的至少一个)等中的至少一个)。Unless otherwise indicated, functional elements in the following description and corresponding blocks shown in the figures may be implemented in a processing circuit, such as hardware, software, or a combination thereof, configured to perform a specific function. For example, the processing circuit may more particularly and/or may include (but is not limited to) a central processing unit (CPU), an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), System-on-a-chip (SoC), programmable logic unit, microprocessor, application-specific integrated circuit (ASIC), electrical components such as transistors, resistors, capacitors, logic gates (including AND gates, OR gates, NOR gates, NAND gates, NOT gate, XOR gate, etc.) etc.).

尽管网络运营商在通讯运营、光网络部署、网络信息化一体化等方面处于领先水平，但是对于网络部署饱和的现状以及解决该现状的端到端定位技术、流程信息化水平等方面仍存在短板。家宽运维已经从传统的网管服务到面向业务、服务用户感知方面转变，这就使得设备生产商需要从客户角度出发，改变以往被动滞后的问题定位方式，主动完成用户上网质量诊断，开发基于大数据分析的智能***用以分析用户网络质量，从源头上解决用户上网体验差的问题。Although network operators are at the leading level in terms of communication operations, optical network deployment, and network informatization integration, there are still shortcomings in terms of the status quo of network deployment saturation and the end-to-end positioning technology and process informatization level to solve this situation. plate. Home broadband operation and maintenance has changed from traditional network management services to business-oriented and user-perceived services. This requires equipment manufacturers to start from the perspective of customers, change the previous passive and lagging problem location methods, and actively complete user Internet quality diagnosis. Development based on The intelligent system of big data analysis is used to analyze the user's network quality and solve the problem of users' poor online experience from the source.

然而部分运营商采用电话访问的方式，通过用户对网络打分来确认用户是否质差，该方法可操作性差、效果低下、准确率低而且成本高，而且造成网络质差的原因有多种，该方法不能够精准定位出网络质差的原因，并给出恰当的整改建议；有的质差判断方法，使用的是用户所有的上网信息，包括网站广告弹窗、国外网站和运营商营业厅网站等，这些都是用户不关心、不感知或者有心理预期可以接受的质差，而将这些上网信息与其他信息一起分析，很明显会对分析结果造成误差；还有一些方法，通过添加黑名单的方式，过滤掉一些非必要内容源网站，然而内容源网站数量过大，很难准确的过滤掉非必要内容源网站；另外，有的质差判断方法对用户使用统一的ISP样本进行分析，分析出的结果也不够准确，因此，现有质差判断方法存在、内容源网站分析量大、效率低下和分析不够贴近用户真实感受，从而导致分析准确度低的问题。However, some operators use the method of telephone interview to confirm whether the user is of poor quality by scoring the network. This method has poor operability, low effect, low accuracy and high cost, and there are many reasons for poor network quality. The method cannot accurately locate the cause of poor network quality and give appropriate rectification suggestions; some poor quality judgment methods use all the online information of users, including website advertisement pop-up windows, foreign websites and operator business hall websites etc. These are poor quality that users don’t care about, don’t perceive, or have psychological expectations. Analyzing these online information together with other information will obviously cause errors in the analysis results; there are also some methods, by adding a blacklist However, the number of content source websites is too large, and it is difficult to accurately filter out unnecessary content source websites; in addition, some poor quality judgment methods analyze users using a unified ISP sample, The analyzed results are not accurate enough. Therefore, the existing poor quality judgment methods exist, the content source website has a large amount of analysis, the efficiency is low, and the analysis is not close to the real feeling of the user, which leads to the problem of low analysis accuracy.

一方面，本申请涉及一种网络质差用户的判断方法。在一些实施方式中，所述方法包括：根据用户的上网数据，获取用户感知的至少一个互联网服务提供商ISP网站；获取至少一个ISP网站的各访问指标的指标阈值，以及用户访问所述至少一个ISP网站的访问指标；在根据各访问指标的指标阈值，以及用户的访问指标，获取到不满足指标阈值的质差访问指标的情况下，根据质差访问指标确定用户为质差用户，并确定用户的质差类型。On the one hand, the present application relates to a method for judging users with poor network quality. In some implementations, the method includes: obtaining at least one Internet service provider (ISP) website perceived by the user according to the user's surfing data; obtaining the index threshold of each access index of the at least one ISP website, and the user accessing the at least one The access index of the ISP website; in the case of obtaining the poor quality access index that does not meet the index threshold according to the index thresholds of each access index and the user's access index, determine the user as a poor quality user according to the poor quality access index, and determine The poor quality type of the user.

本申请的网络质差用户的判断方法，主要应用于用户固网家庭带宽业务，主要针对PON(Passive Optical Network，无源光纤网络)网络结构，PON是光分配网(Optical Distribution Network，ODN)中不含有任何电子器件和电子电源的网络，ODN全部由分路器等无源器件组成，不需要贵重的有源电子设备。一个无源光网络包括一个安装于中心控制站的光线路终端，以及一批配套的安装于用户场所的光网络单元。在光线路终端和光网络单元之间的ODN包含光纤和无源分光器或者耦合器。The method for judging users with poor network quality in this application is mainly applied to the fixed network home bandwidth service of users, and is mainly aimed at the network structure of PON (Passive Optical Network, Passive Optical Network). PON is an optical distribution network (Optical Distribution Network, ODN) A network that does not contain any electronic devices and electronic power sources, ODN is composed of passive devices such as splitters, and does not require expensive active electronic devices. A passive optical network includes an optical line terminal installed at a central control station, and a batch of supporting optical network units installed at user sites. The ODN between the optical line terminal and the optical network unit contains optical fibers and passive optical splitters or couplers.

下面对本申请的网络质差用户的判断方法实现细节进行示例性的说明，以下内容仅为方便理解提供的实现细节，并非实施本方案的必须。The implementation details of the method for judging users with poor network quality in the present application are exemplarily described below. The following content is only the implementation details provided for easy understanding, and is not necessary for implementing the solution.

图1是本申请提供的实现网络质差用户的判断方法的设备的示意图。如图1所示，在一些实施方式中，所述设备包括：上网数据采集装置、数据存储装置、数据查询装置和质差判断装置。FIG. 1 is a schematic diagram of a device for implementing a method for judging users with poor network quality provided by the present application. As shown in FIG. 1 , in some embodiments, the device includes: an online data collection device, a data storage device, a data query device, and a quality judgment device.

上网数据采集装置，通常在运营商的承载设备中部署，该装置会镜像经过承载设备的数据，获取用户的IP包头信息，进而计算出建链、传输等时延信息。The Internet data collection device is usually deployed in the bearer equipment of the operator. The device will mirror the data passing through the bearer equipment, obtain the user's IP header information, and then calculate the delay information such as link establishment and transmission.

数据存储装置，主要用于存储海量的网络指标信息，目前使用开源分布式文件***，如FastDFS、Ceph、HDFS等，通过自研的平台集成该文件***，完成海量数据落地持久化。另外，目前运营商承载设备的数据流量，在每秒钟就能达到上百Gb，要实现实时分析较困难，因此，可采用定时采集数据的策略，如5分钟、1小时的时间粒度。Data storage devices are mainly used to store massive amounts of network index information. Currently, open source distributed file systems are used, such as FastDFS, Ceph, HDFS, etc., and the file system is integrated through a self-developed platform to complete the persistence of massive data. In addition, at present, the data traffic of the carrier equipment of the operator can reach hundreds of Gb per second, and it is difficult to realize real-time analysis. Therefore, a strategy of timing data collection can be adopted, such as a time granularity of 5 minutes or 1 hour.

数据查询装置，主要用于海量数据的查询和计算。数据查询装置需要使用多个集群服务器的算力支持，通过自研查询模块，集成如Hadoop3.0、Spark等集群服务器构成分布式计算框架，分布式框架使用多个集群的算力，能够快速完成数据的查询和计算，同时可以将流量较多的业务切割为多个周期，使用多任务定时调度算法输出结果。The data query device is mainly used for the query and calculation of massive data. The data query device needs to use the computing power support of multiple cluster servers. Through the self-developed query module, cluster servers such as Hadoop3.0 and Spark are integrated to form a distributed computing framework. The distributed framework uses the computing power of multiple clusters and can be quickly completed. For data query and calculation, businesses with a lot of traffic can be divided into multiple cycles, and the multi-task timing scheduling algorithm can be used to output results.

质差判断装置，为本申请实施方式的核心装置，用于实现本申请实施方式的网络质差用户的判断方法，通过查询原始网络访问指标，并对访问指标数据进行分析，从而找到全网质差用户，并给出相应的质差原因和整改意见。质差判断装置得到的判断结果以报表的形式呈现给运营商，运营商根据报表完成用户整改，提高整体网络质量，提升用户的上网体验。The poor quality judging device is the core device of the embodiment of the present application, and is used to implement the method for judging users with poor network quality in the embodiment of the present application. By querying the original network access index and analyzing the access index data, it is possible to find out the quality of the entire network. Poor users, and give the corresponding reasons for poor quality and rectification suggestions. The judgment result obtained by the poor quality judging device is presented to the operator in the form of a report, and the operator completes user rectification according to the report, improves the overall network quality, and improves the user's online experience.

本申请实施方式提供的网络质差用户的判断方法，示例性流程如图2所示，可包括如下步骤201至203。The exemplary flow of the method for judging users with poor network quality provided in the embodiments of the present application is shown in FIG. 2 , which may include steps 201 to 203 as follows.

在步骤201中，根据用户的上网数据，获取所述用户感知的至少一个互联网服务提供商ISP网站。In step 201, at least one Internet service provider (ISP) website perceived by the user is obtained according to the user's surfing data.

在一个例子中，在运营商网络中部署数据采集装置DPI(Deep Packet Inspection，深度报文检测)探针，服务器定时采集家宽用户的上网数据，例如：上行建链时延、下行建链时延、上行RTT(round-trip time，往返时间)和下行RTT等数据，其中，此处提到的上行和下行是根据DPI探针的位置来区分，在通常情况下，探针会放置在BRAS(Broadband Remote Access Server，宽带接入服务器)/OLT(optical line terminal，光线路终端)，因此，上行就是BRAS/OLT以上的网络，下行就是BRAS/OLT以下的网络。另外，上述各时延指标则是通过TCP(Transmission Control Protocol，传输控制协议)协议的双向业务流量来统计，主要截获建链以及数据传输过程中的时延。In one example, a data collection device DPI (Deep Packet Inspection) probe is deployed in the operator's network, and the server regularly collects Internet access data of home broadband users, such as: uplink establishment delay, downlink establishment time, etc. Delay, uplink RTT (round-trip time, round-trip time) and downlink RTT data, among which, the uplink and downlink mentioned here are distinguished according to the position of the DPI probe. In general, the probe will be placed in the BRAS (Broadband Remote Access Server, broadband access server)/OLT (optical line terminal, optical line terminal), therefore, the uplink is the network above BRAS/OLT, and the downlink is the network below BRAS/OLT. In addition, the above-mentioned delay indicators are counted through the two-way business traffic of the TCP (Transmission Control Protocol) protocol, mainly intercepting the delay during link establishment and data transmission.

进一步地，在根据用户的上网数据，获取用户感知的至少一个ISP网站之前，服务器根据全网用户的上网数据，筛选出全网用户最感知的N个ISP网站；其中，所述N为大于0的自然数；Further, before obtaining at least one ISP website perceived by the user according to the user's Internet access data, the server screens out N ISP websites most perceived by the entire network user according to the Internet access data of the entire network user; wherein, N is greater than 0 the natural number of

其中，获取全网用户最感知的N个ISP网站的方法包括：根据全网用户的上网数据中的用户访问流量、访问次数、访问人数，筛选出全网用户最感知的N个ISP网站。Wherein, the method for obtaining the N ISP websites most perceived by the users of the entire network includes: screening out the N ISP websites most perceived by the users of the entire network according to the user access traffic, the number of visits, and the number of visitors in the Internet access data of the users of the entire network.

在一个例子中，服务器分析采集的全网用户的上网数据，通过包头解析归类出ISP(Internet Service Provider，互联网服务提供商)分类工参信息表，即根据serverIP归属地、URL等信息归类ISP网站，完成ISP分类工参信息表。其中，ISP分类工参信息表包含大部分的网站信息，数据流以及协议流等；根据全网用户的上网数据，从ISP分类工参信息表中筛选出用户最感知的N个ISP网站，其中，主要参考全网用户的上网数据中的用户访问流量、访问次数和访问人数等,即通过用户访问流量、访问次数和访问人数，对所有ISP网站从热度大到小进行排序，从ISP的排序中选出排在前N个的ISP网站，即全网用户最感知的N个ISP网站。In one example, the server analyzes and collects the Internet access data of users on the entire network, and classifies the ISP (Internet Service Provider, Internet Service Provider) classification information table through the packet header analysis, that is, according to the serverIP attribution, URL and other information classification ISP website, complete the ISP classification work parameter information form. Among them, the ISP classification work parameter information table contains most of the website information, data flow and protocol flow, etc.; according to the Internet access data of users in the whole network, the N ISP websites most perceived by users are screened out from the ISP classification work parameter information table, among which , mainly refer to the user access traffic, number of visits and number of visitors in the online data of users on the entire network, that is, sort all ISP websites from the most popular to the least popular according to the user access traffic, number of visits and number of visitors, and from the ranking of ISPs Select the top N ISP websites, that is, the N ISP websites most perceived by users on the entire network.

服务器根据全网用户上网数据，从众多内容源网站中筛选出热点内容源网站，减少了大量的内容源网站的分析过程，使得分析效率进一步提高，分析的内容也更加贴近用户的真实感受。The server screens out popular content source websites from many content source websites according to the online data of users on the whole network, which reduces the analysis process of a large number of content source websites, further improves the analysis efficiency, and the analyzed content is closer to the real feelings of users.

更进一步地，获取用户感知的至少一个ISP网站的方法包括：服务器根据用户的上网数据，从全网用户最感知的N个ISP网站中，获取用户感知的至少一个ISP网站。Further, the method for obtaining at least one ISP website perceived by the user includes: the server obtains the at least one ISP website perceived by the user from among the N ISP websites most perceived by the user on the entire network according to the user's online data.

在一个例子中，根据已有的数据模型分析用户的上网习惯，即用户上网数据，数据模型主要是通过用户访问流量、次数、时长等筛选出用户当前周期内访问的最多的多个网站，即筛选出用户感知的至少一个ISP网站。根据用户上网习惯，筛选出用于分析的ISP网站，使得分析结果更贴近用户真实感受。In one example, the user's surfing habit is analyzed according to the existing data model, that is, the user's surfing data. The data model is mainly to filter out the most visited websites by the user in the current cycle through the user's visit traffic, frequency, duration, etc., namely Filter out at least one ISP website perceived by the user. According to the user's surfing habits, the ISP website used for analysis is screened out, so that the analysis results are closer to the user's real feelings.

在步骤202中，获取至少一个ISP网站的各访问指标的指标阈值，以及用户访问至少一个ISP网站的访问指标；其中，各访问指标的指标阈值根据全网L％的用户的访问指标确定；其中，所述L预先设定且大于预设门限。In step 202, the index threshold of each access index of at least one ISP website is obtained, and the access index of users accessing at least one ISP website; wherein, the index threshold of each access index is determined according to the access index of users of L% of the whole network; wherein , the L is preset and greater than a preset threshold.

在一个例子中，服务器进一步分析全网用户最感知的N个ISP网站的访问指标信息。针对每一个ISP网站的每一个访问指标，根据现网分析得到一个95％，获取满足95％的全网用户的访问指标是正常的指标阈值，以此作为分析的基准，根据现网统计用户的网络质量是否符合正态分布，其中有少部分的用户(即5％)是质差的，那么对于该ISP的该访问指标，95％的用户访问是正常的，那么取上述指标阈值作为该ISP的该访问指标的指标阈值。In an example, the server further analyzes the access index information of the N ISP websites most perceived by users on the entire network. For each access indicator of each ISP website, a 95% is obtained according to the live network analysis. It is a normal indicator threshold to obtain access indicators that meet 95% of the entire network users, and use this as the benchmark for analysis. According to the live network statistics of users Whether the network quality conforms to the normal distribution, and a small number of users (ie 5%) are of poor quality, then for the access index of the ISP, 95% of the user access is normal, then take the above index threshold as the ISP The metric threshold for this access metric.

在步骤203中，在根据各访问指标的指标阈值，以及用户的访问指标，获取到不满足指标阈值的质差访问指标的情况下，根据质差访问指标确定用户为质差用户，并确定用户的质差类型；其中，访问指标为根据用户的上网数据，在至少一个ISP网站的所有访问指标中，筛选出的用户感知的访问指标。In step 203, if a poor-quality access index that does not meet the index threshold is obtained according to the index thresholds of each access index and the user's access index, determine that the user is a poor-quality user according to the poor-quality access index, and determine that the user The poor quality type; wherein, the access index is the access index perceived by the user selected from all the access indexes of at least one ISP website according to the user's Internet access data.

在一个例子中，通过查询装置获取用户感知的至少一个ISP网站的访问指标，访问单个感知的ISP网站的访问指标，以各访问指标的指标阈值为基准，对访问指标进行逐条分析，对访问指标的每一次访问数据进行分析，例如本次分析的访问指标为下行建链时延，若本次访问的值没有达到该ISP的下行建链时延的指标阈值，则本次访问的下行建链时延为质差访问，分析完下行建链时延的所有访问记录后，由下行建链时延的质差访问次数除以下行建链时延的所有访问次数，得到下行建链时延访问该ISP的质差占比，以此为例，逐个分析该ISP的其他访问指标以及其他ISP的访问指标，如上行建链、上行RTT、下行RTT以及重传等，通过上述操作，***将会得到用户感知的每一个ISP网站的每一个访问指标的质差占比；继续分析用户感知的ISP网站的所有访问指标的质差占比，当质差占比超过预设阈值时，则确定当前访问指标在访问当前ISP网站时为质差。In one example, the access index of at least one ISP website perceived by the user is obtained through the query device, the access index of a single perceived ISP website is accessed, and the index threshold of each access index is used as the benchmark, the access index is analyzed one by one, and the access index For example, the access index of this analysis is the downlink establishment delay. If the value of this visit does not reach the index threshold of the ISP’s downlink establishment delay, the downlink establishment delay of this visit will be The delay is poor quality access. After analyzing all the access records of the downlink link establishment delay, the downlink link establishment delay access is obtained by dividing the number of downlink link establishment delay accesses by the number of downlink link establishment delay visits. The proportion of poor quality of this ISP, taking this as an example, analyze other access indicators of this ISP and other ISP access indicators one by one, such as uplink establishment, uplink RTT, downlink RTT and retransmission, etc. Through the above operations, the system will Get the poor quality ratio of each access index of each ISP website perceived by the user; continue to analyze the poor quality ratio of all access indicators of the ISP website perceived by the user, and determine the current Access metrics are poor when accessing the current ISP website.

对用户感知的ISP网站中用户感知的访问指标进行分析，避免了对用户不感知的访问指标进行分析，减少了***分析样本量，使得搜索质差用户的过程更加迅速，准确率也更高。The analysis of the user-perceived access indicators in the ISP website that the user perceives avoids the analysis of the user-unaware access indicators, reduces the sample size of the system analysis, and makes the process of searching for users with poor quality faster and more accurate.

进一步地，对质差访问指标加权；根据不同维度对加权后的质差访问指标进行汇聚；根据不同维度的汇聚结果确定用户的质差类型。Further, the poor-quality access indicators are weighted; the weighted poor-quality access indicators are aggregated according to different dimensions; and the user's poor-quality type is determined according to the aggregation results of different dimensions.

在一个例子中，对各质差访问指标组合、加权分析，例如该ISP下行指标大部分都被标记为质差访问指标，则将访问该ISP的记录分类为下行质差；如该ISP上行指标大部分都标记为质差，则将访问该ISP的记录分类为上行质差。In one example, the combination and weighted analysis of various poor-quality access indicators, for example, most of the ISP downstream indicators are marked as poor-quality access indicators, then the records of accessing the ISP are classified as poor-quality downstream; for example, the ISP upstream indicators If most of them are marked as poor quality, then the records accessing this ISP are classified as upstream poor quality.

在一个例子中，根据ISP和时间维度进行汇聚，例如大部分质差的ISP都被标记为下行质差，则当前周期内用户的质差类型为下行质差；如多个周期内用户的大部分质差类型都为下行质差，则用户的质差类型最终被确定为下行质差。In one example, aggregation is performed according to the ISP and time dimension. For example, most ISPs with poor quality are marked as poor quality downlink, and the type of poor quality of the user in the current period is poor quality downlink; If some of the poor quality types are downlink poor quality, the user's poor quality type is finally determined to be downlink poor quality.

通过对质差访问指标进行加权和汇聚，使得质差类型确定过程更加迅速，确定结果更加准确。By weighting and converging the poor-quality access indicators, the determination process of the poor-quality type is made faster and the determination result is more accurate.

更进一步地，在确定质差类型后，根据质差用户的质差类型，获取用户的质差原因和质差建议；以报表的形式输出用户的所述质差原因和所述质差建议。Furthermore, after the poor quality type is determined, according to the poor quality user's poor quality type, the user's poor quality reasons and poor quality suggestions are obtained; and the user's poor quality reasons and the poor quality suggestions are output in the form of a report.

在一个例子中，***根据用户不同的质差类型，使用不同的分析手段给出最终的诊断结论和整改意见，在质差为下行质差的情况下，分析用户家庭组网情况，是否存在光猫、路由器老旧等问题；在质差为终端质差的情况下，分析用户终端数据，包括机顶盒、手机、PC等终端设备。In one example, the system uses different analysis methods to give final diagnosis conclusions and rectification suggestions based on different types of poor quality of users. Modem, old routers and other issues; in the case of poor quality terminals, analyze user terminal data, including set-top boxes, mobile phones, PCs and other terminal equipment.

在一个例子中，***以报表的形式向运营商输出质差用户和质差用户的质差原因与质差整改意见，由运维人员完成上门整改服务。以报表的方式向运营商提供具体信息，方便运营商查看以及后续对用户质差问题进行整改。In one example, the system outputs poor quality users and the reasons for poor quality users and poor quality rectification opinions to the operator in the form of reports, and the operation and maintenance personnel complete the door-to-door rectification service. Provide specific information to the operator in the form of a report, which is convenient for the operator to view and subsequently rectify the poor quality of users.

为了使本申请实施方式的网络质差用户的实现方法简明，接下来通过一个例子进行说明，假设用户质差的原因是家庭无线网络覆盖差，通过以下步骤对质差用户进行定位和质差原因分析。In order to make the realization method of the users with poor network quality in the embodiment of this application concise, an example will be used to illustrate next. Assuming that the cause of poor quality users is the poor coverage of the home wireless network, the users with poor quality are located and the cause of poor quality is analyzed through the following steps .

首先服务器获取当前周期内全网用户的上网数据，根据上网数据筛选出当前周期内全网用户最感知的N个ISP网站，并获取全网用户最感知的N个ISP网站的各访问指标的指标阈值；服务器再根据各用户当前周期内的上网数据和已有的数据模型分析用户的上网数据，数据模型主要通过访问流量、次数、时长等，从全网用户最感知的N个ISP网站中，筛选出各用户感知的ISP网站(网站个数大于0)和各用户感知的ISP网站中用户感知的访问指标。上述ISP网站都为热门的网站，由于网站需要主流的ISP，不包含心跳、后台流量等非感知数据作为访问指标。所以也对各ISP的访问指标进行了筛选。First, the server obtains the Internet access data of the entire network users in the current cycle, screens out the N ISP websites most perceived by the entire network users in the current cycle according to the Internet access data, and obtains the access indicators of the N ISP websites most perceived by the entire network users Threshold; the server then analyzes the user's online data according to the current period of each user's online data and the existing data model. The data model mainly uses access traffic, frequency, duration, etc., from the N ISP websites most perceived by users on the entire network. The ISP websites perceived by each user (the number of websites is greater than 0) and the access indicators perceived by users in the ISP websites perceived by each user are screened out. The above-mentioned ISP websites are all popular websites. Since the websites require mainstream ISPs, non-perceived data such as heartbeat and background traffic are not included as access indicators. Therefore, the access indicators of each ISP are also screened.

其次，根据各访问指标的指标阈值，以及用户的访问指标，对用户的访问指标进行分析，获取质差访问指标，从而找到质差用户，继续对质差的指标进行分析，对质差访问指标进行加权和汇聚，得到该用户的质差类型为下行质差。Secondly, according to the index threshold of each access index and the user's access index, analyze the user's access index to obtain the poor quality access index, so as to find the poor quality user, continue to analyze the poor quality index, and weight the poor quality access index and converged, it is obtained that the user's poor quality type is downlink poor quality.

最后，确定出质差用户和质差类型后，由于通过上述步骤分析出是下行问题，那么主要针对用户终端设备进行分析，获取该用户的各终端的网络指标，并对终端进行单独分析，接着对终端进行时间维度汇聚，判断最近一段时间是否持续质差，对于持续质差的终端达到一定比例后，进一步分析其无线网络信号强弱度，无线网络受周边干扰等情况，最终得出质差原因为家庭无线网络覆盖差的问题。Finally, after determining the poor quality user and the poor quality type, because the downlink problem is analyzed through the above steps, the analysis is mainly focused on the user terminal equipment, and the network indicators of each terminal of the user are obtained, and the terminal is analyzed separately, and then Aggregate terminals in the time dimension to determine whether the quality continues to be poor in the recent period. After a certain proportion of terminals with persistent poor quality are reached, further analyze the strength of the wireless network signal, the wireless network is interfered by the surroundings, etc., and finally conclude that the quality is poor The reason is the poor coverage of the home wireless network.

本申请实施方式提供的网络质差用户的判断方法，通过对用户上网习惯进行分析，筛选出用户感知的热点内容源网站进行分析，更贴近用户的真实感受，质差判断更加准确，且需要分析的样本量更小，减少了服务器的计算负担，加快了质差判断的速度。并且定期获取用户的上网数据，数据源更新更可靠，服务器定期分析用户的各访问指标，提供质差用户和整改意见，为运营商提高网络质量，提升用户满意度提供了保障。The method for judging users with poor network quality provided by the embodiments of the present application analyzes users’ surfing habits and screens out hot content source websites perceived by users for analysis. The sample size is smaller, which reduces the computing burden on the server and speeds up the judgment of poor quality. In addition, the user's online data is regularly obtained, and the data source is updated more reliably. The server regularly analyzes the user's access indicators, provides users with poor quality and rectification suggestions, and provides a guarantee for operators to improve network quality and user satisfaction.

上面各种方法的步骤划分，只是为了描述清楚，实现时可以合并为一个步骤或者对某些步骤进行拆分，分解为多个步骤，只要包括相同的逻辑关系，都在本专利的保护范围内；对算法中或者流程中添加无关紧要的修改或者引入无关紧要的设计，但不改变其算法和流程的核心设计都在该专利的保护范围内。The step division of the above various methods is only for the sake of clarity of description. During implementation, it can be combined into one step or some steps can be split and decomposed into multiple steps. As long as they include the same logical relationship, they are all within the scope of protection of this patent. ; Adding insignificant modifications or introducing insignificant designs to the algorithm or process, but not changing the core design of the algorithm and process are all within the scope of protection of this patent.

本申请还提供了一种网络质差用户的判断装置，如图3所示，可以包括：网站获取模块301、指标获取模块302以及确定模块302。The present application also provides a device for judging users with poor network quality, as shown in FIG. 3 , which may include: a website acquisition module 301 , an index acquisition module 302 and a determination module 302 .

示例性地，网站获取模块301：配置为根据用户的上网数据，获取用户感知的至少一个互联网服务提供商ISP网站；指标获取模块302：配置为获取至少一个ISP网站的各访问指标的指标阈值，以及所述用户访问至少一个ISP网站的访问指标；确定模块303：配置为在根据各访问指标的指标阈值，以及用户的访问指标，获取到不满足指标阈值的质差访问指标的情况下，根据质差访问指标确定用户为质差用户，并确定用户的质差类型Exemplarily, the website acquisition module 301: configured to acquire at least one Internet Service Provider ISP website perceived by the user according to the user's online data; the index acquisition module 302: configured to acquire the index threshold of each access index of at least one ISP website, And the access index of the user's access to at least one ISP website; the determination module 303: configured to obtain a poor quality access index that does not meet the index threshold according to the index threshold of each access index and the user's access index, according to The poor quality access indicator identifies the user as a poor quality user and identifies the user's poor quality type

在一个例子中，在获取用户感知的至少一个互联网服务提供商ISP网站之前，分析采集的全网用户的上网数据，通过包头解析归类出ISP(Internet Service Provider，互联网服务提供商)分类工参信息表，即根据serverIP归属地、URL等信息归类ISP网站，完成ISP分类工参信息表。其中，ISP分类工参信息表包含大部分的网站信息，数据流以及协议流等；根据全网用户的上网数据，从ISP分类工参信息表中筛选出用户最感知的N个ISP网站，其中，主要参考全网用户的上网数据中的用户访问流量、访问次数和访问人数等,即通过用户访问流量、访问次数和访问人数，对所有ISP网站从热度大到小进行排序，从ISP的排序中选出排在前N个的ISP网站，即全网用户最感知的N个ISP网站。In one example, before obtaining at least one Internet Service Provider (ISP) website perceived by the user, analyze the collected online data of users on the entire network, and classify the ISP (Internet Service Provider, Internet Service Provider) classification parameters through packet header analysis Information table, that is, classify ISP websites according to information such as serverIP attribution, URL, etc., and complete the ISP classification work parameter information table. Among them, the ISP classification work parameter information table contains most of the website information, data flow and protocol flow, etc.; according to the Internet access data of users in the whole network, the N ISP websites most perceived by users are screened out from the ISP classification work parameter information table, among which , mainly refer to the user access traffic, number of visits and number of visitors in the online data of users on the entire network, that is, sort all ISP websites from the most popular to the least popular according to the user access traffic, number of visits and number of visitors, and from the ranking of ISPs Select the top N ISP websites, that is, the N ISP websites most perceived by users on the entire network.

在一个例子中，网站获取模块301根据已有的数据模型分析用户的上网习惯，即用户上网数据，数据模型主要是通过用户访问流量、次数、时长等筛选出用户当前周期内访问的最多的多个网站，即筛选出用户感知的至少一个ISP网站。根据用户上网习惯，筛选出用于分析的ISP网站，使得分析结果更贴近用户真实感受。In one example, the website acquisition module 301 analyzes the user's surfing habits according to the existing data model, that is, the user's surfing data. websites, that is, at least one ISP website perceived by the user is screened out. According to the user's surfing habits, the ISP website used for analysis is screened out, so that the analysis results are closer to the user's real feelings.

在一个例子中，指标获取模块302进一步分析全网用户最感知的N个ISP网站的访问指标信息。针对每一个ISP网站的每一个访问指标，根据现网分析得到一个95％，获取满足95％的全网用户的访问指标是正常的指标阈值，以此作为分析的基准，根据现网统计用户的网络质量是否符合正态分布，其中有少部分的用户(即5％)是质差的，那么对于该ISP的该访问指标，95％的用户访问是正常的，那么取上述指标阈值作为该ISP的该访问指标的指标阈值。In one example, the index acquisition module 302 further analyzes the access index information of the N ISP websites most perceived by users on the entire network. For each access indicator of each ISP website, a 95% is obtained according to the live network analysis. It is a normal indicator threshold to obtain access indicators that meet 95% of the entire network users, and use this as the benchmark for analysis. According to the live network statistics of users Whether the network quality conforms to the normal distribution, and a small number of users (ie 5%) are of poor quality, then for the access index of the ISP, 95% of the user access is normal, then take the above index threshold as the ISP The metric threshold for this access metric.

在一个例子中，指标获取模块302获取用户感知的至少一个ISP网站的访问指标，访问单个感知的ISP网站的访问指标，确定模块303以各访问指标的指标阈值为基准，对访问指标进行逐条分析，对访问指标的每一次访问数据进行分析，例如本次分析的访问指标为下行建链时延，若本次访问的值没有达到该ISP的下行建链时延的指标阈值，则本次访问的下行建链时延为质差访问，分析完下行建链时延的所有访问记录后，由下行建链时延的质差访问次数除以下行建链时延的所有访问次数，得到下行建链时延访问该ISP的质差占比，以此为例，逐个分析该ISP的其他访问指标以及其他ISP的访问指标，如上行建链、上行RTT、下行RTT以及重传等，通过上述操作，***将会得到用户感知的每一个ISP网站的每一个访问指标的质差占比；继续分析用户感知的ISP网站的所有访问指标的质差占比，当质差占比超过预设阈值时，则确定当前访问指标在访问当前ISP网站时为质差。In one example, the index acquisition module 302 obtains the access index of at least one ISP website perceived by the user, accesses the access index of a single perceived ISP website, and the determination module 303 analyzes the access index one by one based on the index threshold of each access index , analyze the access data of each access index. For example, the access index analyzed this time is the downlink establishment delay. If the value of this visit does not reach the ISP’s downlink establishment delay index threshold, the visit The downlink building delay is poor quality access. After analyzing all the access records of the downlink building delay, the downlink building time is obtained by dividing the downlink building time Chain delay access to the ISP's poor quality ratio, as an example, analyze other access indicators of the ISP and other ISP access indicators one by one, such as uplink establishment, uplink RTT, downlink RTT, and retransmission, etc., through the above operations , the system will get the poor quality ratio of each access index of each ISP website perceived by the user; continue to analyze the poor quality ratio of all access indicators of the ISP website perceived by the user, when the poor quality ratio exceeds the preset threshold , it is determined that the current access indicator is of poor quality when accessing the current ISP website.

本申请实施方式提供的网络质差用户的判断装置，通过对用户上网习惯进行分析，筛选出用户感知的热点内容源网站进行分析，更贴近用户的真实感受，质差判断更加准确，且需要分析的样本量更小，减少了服务器的计算负担，加快了质差判断的速度。并且定期获取用户的上网数据，数据源更新更可靠，服务器定期分析用户的各访问指标，提供质差用户和整改意见，为运营商提高网络质量，提升用户满意度提供了保障。The device for judging users with poor network quality provided by the embodiments of the present application analyzes users’ surfing habits and screens out hot content source websites perceived by users for analysis. The sample size is smaller, which reduces the computing burden on the server and speeds up the judgment of poor quality. In addition, the user's online data is regularly obtained, and the data source is updated more reliably. The server regularly analyzes the user's access indicators, provides users with poor quality and rectification suggestions, and provides a guarantee for operators to improve network quality and user satisfaction.

不难发现，本实施方式为上述应用网络质差用户的判断方法实施方式相对应的装置实施方式，本实施方式可与上述网络质差用户的判断方法实施方式互相配合实施。上述网络质差用户的判断方法实施方式提到的相关技术细节在本实施方式中依然有效，为了减少重复，这里不再赘述。相应地，本实施方式中提到的相关技术细节也可应用在上述网络质差用户的判断方法实施方式中。It is not difficult to find that this embodiment is a device embodiment corresponding to the implementation of the method for determining a user with poor network quality, and this embodiment can be implemented in cooperation with the above implementation of the method for determining a user with poor network quality. The relevant technical details mentioned in the above embodiment of the method for judging users with poor network quality are still valid in this embodiment, and will not be repeated here in order to reduce repetition. Correspondingly, the relevant technical details mentioned in this implementation manner can also be applied to the above implementation manner of the method for judging users with poor network quality.

值得一提的是，本申请上述实施方式中所涉及到的各模块均为逻辑模块，在实际应用中，一个逻辑单元可以是一个物理单元，也可以是一个物理单元的一部分，还可以以多个物理单元的组合实现。此外，仅示出了包括部分而非全部组件的实施方式，在其它实施方式中，可以包括比所示出的组件更多或更少的组件。It is worth mentioning that all the modules involved in the above embodiments of the present application are logical modules. In practical applications, a logical unit can be a physical unit, or a part of a physical unit, and can also Combination of physical units. Furthermore, only some, but not all, of the components are shown, and in other embodiments, more or fewer components than shown may be included.

本申请还提供一种电子设备。如图4所示，在一些实施方式中，电子设备包括至少一个处理器401；以及，与所述至少一个处理器401通信连接的存储器402；其中，所述存储器402存储有可被所述至少一个处理器401执行的指令，所述指令被所述至少一个处理器401执行时，使所述至少一个处理器能够执行上述网络质差用户的判断方法The present application also provides an electronic device. As shown in FIG. 4 , in some implementations, the electronic device includes at least one processor 401; and a memory 402 communicatively connected to the at least one processor 401; An instruction executed by a processor 401, when the instruction is executed by the at least one processor 401, the at least one processor can execute the above method for judging users with poor network quality

其中，存储器和处理器采用总线方式连接，总线可以包括任意数量的互联的总线和桥，总线将一个或多个处理器和存储器的各种电路连接在一起。总线还可以将诸如***设备、稳压器和功率管理电路等之类的各种其他电路连接在一起，这些都是本领域所公知的，因此，本文不再对其进行进一步描述。总线接口在总线和收发机之间提供接口。收发机可以是一个元件，也可以是多个元件，比如多个接收器和发送器，提供用于在传输介质上与各种其他装置通信的单元。经处理器处理的数据通过天线在无线介质上进行传输，进一步，天线还接收数据并将数据传送给处理器。Wherein, the memory and the processor are connected by a bus, and the bus may include any number of interconnected buses and bridges, and the bus connects one or more processors and various circuits of the memory together. The bus may also connect together various other circuits such as peripherals, voltage regulators, and power management circuits, all of which are well known in the art and therefore will not be further described herein. The bus interface provides an interface between the bus and the transceivers. A transceiver may be a single element or multiple elements, such as multiple receivers and transmitters, providing means for communicating with various other devices over a transmission medium. The data processed by the processor is transmitted on the wireless medium through the antenna, further, the antenna also receives the data and transmits the data to the processor.

处理器负责管理总线和通常的处理，还可以提供各种功能，包括定时，***接口，电压调节、电源管理以及其他控制功能。而存储器可以被用于存储处理器在执行操作时所使用的数据。The processor is responsible for managing the bus and general processing, and can also provide various functions, including timing, peripheral interface, voltage regulation, power management, and other control functions. Instead, memory can be used to store data that the processor uses when performing operations.

上述产品可执行本申请实施方式所提供的方法，具备执行方法相应的功能模块和有益效果，未在本实施方式中详尽描述的技术细节，可参见本申请实施方式所提供的方法。The above-mentioned products can execute the methods provided in the embodiments of this application, and have the corresponding functional modules and beneficial effects for executing the methods. For technical details not described in detail in this embodiment, please refer to the methods provided in the embodiments of this application.

本申请的实施方式还提供一种计算机可读存储介质，存储有计算机程序。计算机程序被处理器执行时，使得所述处理器实现上述任一方法实施方式。Embodiments of the present application also provide a computer-readable storage medium storing a computer program. When the computer program is executed by the processor, the processor is made to implement any one of the above-mentioned method implementation manners.

在本申请实施方式中，根据用户本身的偏好和上网习惯，对不同的用户采用不同的ISP网站进行分析，即对每一位用户各自感知的热点内容网站进行分析，并在分析时为用户访问各ISP网站设置访问指标的指标阈值，从而定位出质差用户和质差类型。达到了更快速更准确地定位质差用户和质差类型的目的。In the implementation of this application, according to the user's own preferences and Internet habits, different users are analyzed using different ISP websites, that is, the hot content websites perceived by each user are analyzed, and the user accesses the website during the analysis. Each ISP website sets the index threshold of the access index, so as to locate users and types of poor quality. The purpose of locating poor quality users and poor quality types more quickly and accurately is achieved.

本领域技术人员可以理解，实现上述实施方式方法中的全部或部分步骤是可以通过程序来指令相关的硬件来完成，该程序存储在一个存储介质中，包括若干指令用以使得一个设备(可以是单片机，芯片等)或处理器(processor)执行本申请各个实施方式所述方法的全部或部分步骤。而前述的存储介质包括：U盘、移动硬盘、只读存储器(ROM，Read-Only Memory)、随机存取存储器(RAM，Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质。Those skilled in the art can understand that all or part of the steps in the method of the above-mentioned embodiments can be completed by instructing related hardware through a program, the program is stored in a storage medium, and includes several instructions to make a device (which can be A single chip microcomputer, chip, etc.) or a processor (processor) executes all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage media include: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or optical disc, etc., which can store program codes. .

本领域技术人员可以理解，上述各实施方式是实现本申请的示例性实施方式，而在实际应用中，可以在形式上和细节上对其作各种改变，而不偏离本申请的精神和范围。Those skilled in the art can understand that the above-mentioned embodiments are exemplary embodiments for realizing the present application, and in actual application, various changes can be made in form and details without departing from the spirit and scope of the present application .

Claims

一种网络质差用户的判断方法，包括：A method for judging users with poor network quality, comprising:

根据用户的上网数据，获取所述用户感知的至少一个互联网服务提供商ISP网站；Acquiring at least one ISP website perceived by the user according to the user's Internet access data;

获取所述至少一个ISP网站的各访问指标的指标阈值，以及所述用户访问所述至少一个ISP网站的访问指标；Acquiring the index threshold of each access index of the at least one ISP website, and the access index of the user's access to the at least one ISP website;

在根据所述各访问指标的指标阈值，以及所述用户的访问指标，获取到不满足所述指标阈值的质差访问指标的情况下，根据所述质差访问指标确定所述用户为质差用户，并确定所述用户的质差类型。If a poor-quality access indicator that does not meet the indicator threshold is obtained according to the indicator thresholds of the access indicators and the user's access indicator, determine that the user is of poor quality according to the poor-quality access indicator user, and determine the poor quality type of the user.
根据权利要求1所述的网络质差用户的判断方法，其中，The method for judging users with poor network quality according to claim 1, wherein,

在所述根据用户的上网数据，获取所述用户感知的至少一个ISP网站之前，所述方法还包括；Before acquiring at least one ISP website perceived by the user according to the user's surfing data, the method further includes;

根据全网用户的上网数据，筛选出全网用户最感知的N个ISP网站；其中，所述N为大于0的自然数；According to the online data of the users of the whole network, N ISP websites most perceived by the users of the whole network are screened out; wherein, said N is a natural number greater than 0;

所述根据用户的上网数据，获取所述用户感知的至少一个ISP网站，包括：The acquisition of at least one ISP website perceived by the user according to the user's Internet access data includes:

根据所述用户的上网数据，从所述全网用户最感知的N个ISP网站中，获取所述用户感知的至少一个ISP网站。Obtain at least one ISP website perceived by the user from the N ISP websites most perceived by the user in the entire network according to the user's Internet access data.
根据权利要求2所述的网络质差用户的判断方法，其中，所述根据全网用户的上网数据，筛选出全网用户最感知的N个ISP网站，包括：The method for judging users with poor network quality according to claim 2, wherein, according to the online data of users in the whole network, the N ISP websites most perceived by users in the whole network are selected, including:

根据所述全网用户的上网数据中的用户访问流量、访问次数、访问人数，筛选出所述全网用户最感知的N个ISP网站。According to the user access traffic, the number of visits, and the number of visitors in the online data of the users of the entire network, the N ISP websites most perceived by the users of the entire network are screened out.
根据权利要求1所述的网络质差用户的判断方法，其中，所述各访问指标的指标阈值根据全网L％的用户的访问指标确定；其中，所述L预先设定且大于预设门限。The method for judging users with poor network quality according to claim 1, wherein the index thresholds of the access indexes are determined according to the access indexes of L% users in the whole network; wherein, the L is preset and greater than the preset threshold .
根据权利要求1至4中任一项所述的网络质差用户的判断方法，其中，所述确定所述用户的质差类型，包括：The method for judging a user with poor network quality according to any one of claims 1 to 4, wherein said determining the type of poor quality of the user includes:

对所述质差访问指标加权；weighting the poor quality access indicator;

根据不同维度对所述加权后的所述质差访问指标进行汇聚；Aggregating the weighted poor quality access indicators according to different dimensions;

根据所述不同维度的汇聚结果确定所述用户的质差类型。The poor quality type of the user is determined according to the aggregation results of the different dimensions.
根据权利要求1至4中任一项所述的网络质差用户的判断方法，其中，在所述根据所述质差访问指标确定所述用户为质差用户，并确定所述用户的质差类型之后，所述方法还包括：The method for judging a network user with poor quality according to any one of claims 1 to 4, wherein, in the step of determining that the user is a user with poor quality according to the access index of poor quality, and determining the user’s poor quality After the type, the method also includes:

根据所述质差用户的质差类型，获取所述用户的质差原因和质差建议；According to the poor quality type of the poor quality user, obtain the user's poor quality reason and poor quality suggestion;

以报表的形式输出所述用户的所述质差原因和所述质差建议。Outputting the reasons for the poor quality and the poor quality suggestions of the user in the form of a report.
根据权利要求1至4中任一项所述的网络质差用户的判断方法，其中，所述访问指标为根据所述用户的上网数据，在所述至少一个ISP网站的所有访问指标中，筛选出的所述用户感知的访问指标。The method for judging a user with poor network quality according to any one of claims 1 to 4, wherein the access index is based on the user's online data, among all the access indexes of the at least one ISP website, filter The access index perceived by the user is obtained.
一种网络质差用户的判断装置，包括：A device for judging users with poor network quality, comprising:

网站获取模块：配置为根据用户的上网数据，获取所述用户感知的至少一个互联网服务提供商ISP网站；Website obtaining module: configured to obtain at least one ISP website of an Internet service provider perceived by the user according to the user's online data;

指标获取模块：配置为获取所述至少一个ISP网站的各访问指标的指标阈值，以及所述用户访问所述至少一个ISP网站的访问指标；An indicator acquisition module: configured to acquire the indicator threshold of each access indicator of the at least one ISP website, and the access indicator of the user's access to the at least one ISP website;

确定模块：配置为在根据所述各访问指标的指标阈值，以及所述用户的访问指标，获取到不满足所述指标阈值的质差访问指标的情况下，根据所述质差访问指标确定所述用户为质差用户，并确定所述用户的质差类型。Determining module: configured to determine the access index according to the poor quality access index when the access index of poor quality that does not meet the index threshold is obtained according to the index threshold of each access index and the access index of the user. The user is a user with poor quality, and the type of poor quality of the user is determined.
一种电子设备，包括：An electronic device comprising:

至少一个处理器；以及，at least one processor; and,

与所述至少一个处理器通信连接的存储器；其中，a memory communicatively coupled to the at least one processor; wherein,

所述存储器存储有可被所述至少一个处理器执行的指令，所述指令被所述至少一个处理器执行时，使所述至少一个处理器执行如权利要求1至7中任一项所述的网络质差用户的判断方法。The memory stores instructions executable by the at least one processor, and when the instructions are executed by the at least one processor, the at least one processor is executed as described in any one of claims 1 to 7. Judgment method for users with poor network quality.
一种计算机可读存储介质，存储有计算机程序，其中，所述计算机程序被处理器执行时，使得所述处理器实现权利要求1至7中任一项所述的网络质差用户的判断方法。A computer-readable storage medium storing a computer program, wherein, when the computer program is executed by a processor, the processor implements the method for judging users with poor network quality according to any one of claims 1 to 7 .