CN113128390A

CN113128390A - Sampling inspection method and device, electronic equipment and storage medium

Info

Publication number: CN113128390A
Application number: CN202110404201.8A
Authority: CN
Inventors: 黄真
Original assignee: Beijing QIYI Century Science and Technology Co Ltd
Current assignee: Beijing QIYI Century Science and Technology Co Ltd
Priority date: 2021-04-14
Filing date: 2021-04-14
Publication date: 2021-07-16
Anticipated expiration: 2041-04-14
Also published as: CN113128390B

Abstract

The embodiment of the invention relates to a spot check method, a spot check device, electronic equipment and a storage medium, wherein the spot check method comprises the following steps: when determining that sampling reinspection is carried out on a plurality of initially-inspected objects corresponding to at least one target initially-inspected party, determining an initial inspection effect index value of each target initially-inspected party; determining a target spot inspection rate corresponding to each target initial inspection party according to the initial inspection effect index value of each target initial inspection party, the number of the initially inspected objects corresponding to each target initial inspection party and the pre-configured total capacity of the retest; and sampling the primarily detected objects corresponding to the target primary detection parties according to the target sampling rate corresponding to the target primary detection parties, so that a reexamination party performs reexamination on sampling results. Therefore, the final false detection rate can be reduced and the accuracy of the final detection result can be improved while the resources of the reinspector are reasonably allocated.

Description

Sampling inspection method and device, electronic equipment and storage medium

Technical Field

The embodiment of the invention relates to the technical field of data processing, in particular to a spot check method, a spot check device, electronic equipment and a storage medium.

Background

The content auditing work of the video website mainly has two purposes, namely compliance and copyright, wherein the compliance problem is very wide in relation and needs to be paid with a large amount of auditing work. In order to ensure that the video content published by the video website is risk-free, after the video is initially checked by the initial checking party, the rechecking party with more experience is generally arranged to recheck the initially checked video.

Currently, when performing review on a video that has been initially inspected, a full-scale review or a sampling review at a fixed sampling rate is generally adopted. However, the full-scale review will undoubtedly occupy a large amount of review resources, and when the review resources are insufficient, a large review pressure will be faced; the mode of sampling and rechecking according to the fixed sampling rate can lead to random probability of rechecking of objects which are charged by different initial detection parties and are subjected to initial detection, unfairness exists, and the rechecking coverage of risk objects is obviously insufficient.

Disclosure of Invention

In view of this, in order to solve the technical problems that the full-scale reinspection may face insufficient reinspection resources, which causes a high reinspection pressure, and the sampling reinspection according to a fixed sampling rate causes random probability of reinspection of objects in charge of the initial inspection by different initial inspection parties, unfairness exists, and the reinspection coverage of risk objects is obviously insufficient, embodiments of the present invention provide a spot inspection method, an apparatus, an electronic device, and a storage medium.

In a first aspect, an embodiment of the present invention provides a spot check method, including:

when determining that sampling reinspection is carried out on a plurality of initially-inspected objects corresponding to at least one target initially-inspected party, determining an initial inspection effect index value of each target initially-inspected party;

determining a target spot inspection rate corresponding to each target initial inspection party according to the initial inspection effect index value of each target initial inspection party, the number of the initially inspected objects corresponding to each target initial inspection party and the pre-configured total capacity of the retest;

and sampling the primarily detected objects corresponding to the target primary detection parties according to the target sampling rate corresponding to the target primary detection parties, so that a reexamination party performs reexamination on sampling results.

In one possible embodiment, the determining to perform sampling review on a plurality of original objects corresponding to at least one target original party includes:

comparing the total number of the plurality of primary inspected objects corresponding to at least one target primary inspection party with the pre-configured total reinspection capacity;

and if the total number is larger than the total reinspection capacity through comparison, determining to perform sampling reinspection on a plurality of initially inspected objects corresponding to at least one target initially-inspected party.

In one possible embodiment, the determining the target spot inspection rate corresponding to each target preliminary examination party according to the preliminary examination effect index value of each target preliminary examination party, the number of the preliminary examination objects corresponding to each target preliminary examination party, and the preconfigured total review volume includes:

determining an initial sampling rate corresponding to each target primary party according to the initial detection effect index value of each target primary party;

determining whether the initial sampling rate corresponding to each target initial checking party meets a first set condition or not according to the number of the initially checked objects corresponding to each target initial checking party and the pre-configured total reinspection capacity;

if so, determining the initial sampling rate corresponding to each target initial detection party as the target sampling rate corresponding to each target initial detection party;

and if the target sampling rate is not met, carrying out iterative adjustment on the initial sampling rate corresponding to each target initial detection party according to a set iterative adjustment mode, stopping iteration until the first set condition is met, and after the iteration is finished, determining the target sampling rate corresponding to each target initial detection party according to the current initial sampling rate corresponding to each target initial detection party.

In one possible implementation, the determining the initial sampling rate corresponding to each target initial detector according to the initial detection effect index value of each initial detector includes:

for each target primary detector, searching a first sampling rate configuration table for a sampling rate corresponding to a first primary detection effect index value of the target primary detector, wherein the first sampling rate configuration table comprises a corresponding relation between the first primary detection effect index value and the sampling rate;

and determining the initial spot check rate corresponding to the target primary party according to the spot check rate corresponding to the first primary check effect index value of the target primary party.

In a possible implementation manner, the determining an initial sampling rate corresponding to the target primary analyzer according to the searched sampling rate corresponding to the first initial inspection effect index value of the target primary analyzer further includes:

if the second initial detection effect index value of the target initial detection party meets a second set condition, determining the searched selective detection rate corresponding to the first initial detection effect index value of the target initial detection party as the initial selective detection rate corresponding to the target initial detection party;

and if the second initial detection effect index value of the target initial detector meets a third set condition, determining the initial sampling rate corresponding to the target initial detector according to a preset sampling rate calculation formula and the searched sampling rate corresponding to the first initial detection effect index value of the target initial detector.

In a possible embodiment, the determining whether the initial spot check rate corresponding to each target initial checking party meets a first set condition according to the number of the initially checked objects corresponding to each target initial checking party and a preconfigured total review volume includes:

determining a first pre-estimated re-inspection total amount of all the target primary inspectors according to the initial spot inspection rate corresponding to each target primary inspector and the number of the corresponding primary inspected objects;

comparing the first estimated reinspection total amount with a first value and a second value, wherein the first value is a difference value between the reinspection total amount and a set value, and the second value is a sum value between the reinspection total amount and the set value;

if the first estimated reinspection total amount is larger than or equal to the first value and smaller than or equal to the second value through comparison, determining that the initial random access rate corresponding to each target primary inspection party meets a first set condition;

and if the first estimated reinspection total amount is smaller than the first value or larger than the second value through comparison, determining that the initial sampling rate corresponding to each target initial detector does not meet a first set condition.

In a possible embodiment, the iteratively adjusting the initial sampling rate corresponding to each target initial detector according to a set iterative adjustment manner until the iteration is stopped when the first set condition is met includes:

determining an adjusting coefficient in the iteration process according to the total reinspection capacity and the current first estimated reinspection total amount of all the target primary inspectors;

for each target primary detector, multiplying the current corresponding initial sampling rate of the target primary detector by the adjusting coefficient to obtain the corresponding initial sampling rate of the target primary detector in the current iteration process;

determining a first pre-estimated reinspection total amount corresponding to all the target initial detection parties in the current iteration process according to the number of the detected objects corresponding to each target initial detection party and the initial spot check rate corresponding to each target initial detection party in the current iteration process;

comparing the corresponding first estimated reinspection total amount of all the target primary testers in the current iteration process with the first value and the second value;

if the first estimated reinspection total amount corresponding to all the target initial detection parties in the iteration process is larger than or equal to the first value and smaller than or equal to the second value, determining that the current corresponding initial sampling rate of each target initial detection party meets a first set condition, and stopping iteration;

and if the first estimated reinspection total amount corresponding to all the target primary inspectors in the current iteration process is smaller than the first value or larger than the second value by comparison, returning to execute the step of determining the adjustment coefficient in the current iteration process according to the reinspection total capacity and the current first estimated reinspection total amount of all the target primary inspectors so as to enter the next iteration process.

In a possible embodiment, in a case that the comparison shows that the first estimated review total amount corresponding to all the target primary testers in the current iteration process is greater than the second value, the determining an adjustment coefficient in the current iteration process according to the review total capacity and the current first estimated review total amount of all the target primary testers includes:

and dividing the total reinspection capacity by the current first estimated reinspection total amount of all the target initial inspectors to obtain an adjustment coefficient in the iteration process.

In a possible embodiment, in a case that the comparison shows that the first estimated review total amount corresponding to all the target original testers in the current iteration process is smaller than the first value, the determining an adjustment coefficient in the current iteration process according to the review total capacity and the current first estimated review total amount of all the target original testers includes:

determining the target initial testing party with the current corresponding initial sampling rate of 1 as a first initial testing party;

determining a second pre-estimated reinspection total amount of all the first initial detection parties according to the number of the initially detected objects corresponding to each first initial detection party and the currently corresponding initial spot check rate;

subtracting the second estimated reinspection total amount from the reinspection total amount to obtain a first difference; subtracting the second estimated reinspection total amount from the first estimated reinspection total amount to obtain a second difference;

and dividing the first difference value by the second difference value to obtain an adjusting coefficient in the iteration process.

In one possible embodiment, before the method, the method further comprises:

determining a plurality of initial detection parties triggering initial detection operation in a set historical time period;

it is a plurality of among the preliminary examination party, the preliminary examination party that preliminary examination party information exists in the inspection group of pre-configuration determines for the target preliminary examination party, wherein, including a plurality of preliminary examination party information in the inspection group, the preliminary examination party in same inspection group is responsible for carrying out the preliminary examination to the object of same type, and the preliminary examination party in the different inspection groups is responsible for carrying out the preliminary examination to the object of different grade type, and different inspection groups correspond the reinspection gross capacity is different.

In a second aspect, an embodiment of the present invention provides a spot check device, including:

the index value determining module is used for determining the initial detection effect index value of each target initial detection party when determining that the sampling reinspection is carried out on a plurality of initial detection objects corresponding to at least one target initial detection party;

the sampling rate determining module is used for determining the target sampling rate corresponding to each target initial detecting party according to the initial detecting effect index value of each target initial detecting party, the number of the initial detected objects corresponding to each target initial detecting party and the pre-configured total re-detection capacity;

and the sampling module is used for sampling the primarily detected objects corresponding to the target primary detection parties according to the target sampling rate corresponding to the target primary detection parties so as to provide for the reexamination of sampling results by the reexamination parties.

In one possible embodiment, the apparatus further comprises:

the first comparison module is used for comparing the total number of the plurality of primary detected objects corresponding to at least one target primary detector with the pre-configured total reinspection capacity;

and the sampling determining module is used for determining to perform sampling reinspection on a plurality of initially-inspected objects corresponding to at least one target initially-inspected party if the total number is larger than the reinspection total capacity through comparison.

In one possible embodiment, the spot check rate determining module includes:

the first determining submodule is used for determining the initial sampling rate corresponding to each target initial detection party according to the initial detection effect index value of each target initial detection party;

the second determining submodule is used for determining whether the initial sampling rate corresponding to each target primary detector meets a first set condition according to the number of the primary detected objects corresponding to each target primary detector and the pre-configured total capacity of the reinspection;

the third determining submodule is used for determining the initial sampling rate corresponding to each target primary detection party as the target sampling rate corresponding to each target primary detection party if the initial sampling rate corresponding to each target primary detection party meets a first set condition;

the iteration submodule is used for carrying out iteration adjustment on the initial sampling rate corresponding to each target primary detector according to a set iteration adjustment mode if the initial sampling rate corresponding to each target primary detector does not meet a first set condition, and stopping iteration until the first set condition is met;

and the fourth determining submodule is used for determining the target sampling rate corresponding to each target initial detection party according to the current corresponding initial sampling rate of each target initial detection party after the iteration is finished.

In a possible implementation manner, the initial detection effect index value includes a first initial detection effect index value, and the first determining sub-module is specifically configured to:

for each target primary detector, searching a first sampling rate configuration table for a sampling rate corresponding to a first primary detection effect index value of the target primary detector, wherein the first sampling rate configuration table comprises a corresponding relation between the first primary detection effect index value and the sampling rate; and determining the initial spot check rate corresponding to the target primary party according to the spot check rate corresponding to the first primary check effect index value of the target primary party.

In a possible implementation, the first detection effect index value further includes a second first detection effect index value, and the first determining sub-module is further configured to:

In a possible implementation, the second determining submodule is specifically configured to:

determining a first pre-estimated re-inspection total amount of all the target primary inspectors according to the initial spot inspection rate corresponding to each target primary inspector and the number of the corresponding primary inspected objects; comparing the first estimated reinspection total amount with a first value and a second value, wherein the first value is a difference value between the reinspection total amount and a set value, and the second value is a sum value between the reinspection total amount and the set value; if the first estimated reinspection total amount is larger than or equal to the first value and smaller than or equal to the second value through comparison, determining that the initial random access rate corresponding to each target primary inspection party meets a first set condition; and if the first estimated reinspection total amount is smaller than the first value or larger than the second value through comparison, determining that the initial sampling rate corresponding to each target initial detector does not meet a first set condition.

In a possible embodiment, the iteration sub-module is specifically configured to:

determining an adjusting coefficient in the iteration process according to the total reinspection capacity and the current first estimated reinspection total amount of all the target primary inspectors; for each target primary detector, multiplying the current corresponding initial sampling rate of the target primary detector by the adjusting coefficient to obtain the corresponding initial sampling rate of the target primary detector in the current iteration process; determining a first pre-estimated reinspection total amount corresponding to all the target initial detection parties in the current iteration process according to the number of the detected objects corresponding to each target initial detection party and the initial spot check rate corresponding to each target initial detection party in the current iteration process; comparing the corresponding first estimated reinspection total amount of all the target primary testers in the current iteration process with the first value and the second value; if the first estimated reinspection total amount corresponding to all the target initial detection parties in the iteration process is larger than or equal to the first value and smaller than or equal to the second value, determining that the current corresponding initial sampling rate of each target initial detection party meets a first set condition, and stopping iteration; and if the first estimated reinspection total amount corresponding to all the target primary inspectors in the current iteration process is smaller than the first value or larger than the second value by comparison, returning to execute the step of determining the adjustment coefficient in the current iteration process according to the reinspection total capacity and the current first estimated reinspection total amount of all the target primary inspectors so as to enter the next iteration process.

In a possible embodiment, in the case that the comparison shows that the first estimated review total amount corresponding to all the target initial testers in the current iteration process is greater than the second value, the iteration sub-module is further configured to:

In a possible embodiment, in the case that the comparison shows that the first estimated review total amount corresponding to all the target initial testers in the current iteration process is smaller than the first value, the iteration sub-module is further configured to:

determining the target initial testing party with the current corresponding initial sampling rate of 1 as a first initial testing party; determining a second pre-estimated reinspection total amount of all the first initial detection parties according to the number of the initially detected objects corresponding to each first initial detection party and the currently corresponding initial spot check rate; subtracting the second estimated reinspection total amount from the reinspection total amount to obtain a first difference; subtracting the second estimated reinspection total amount from the first estimated reinspection total amount to obtain a second difference; and dividing the first difference value by the second difference value to obtain an adjusting coefficient in the iteration process.

In one possible embodiment, the apparatus further comprises:

the initial detection party determining module is used for determining a plurality of initial detection parties triggering initial detection operation in a set historical time period;

the target determination module is used for determining a plurality of initial detection parties, wherein the initial detection parties of the initial detection party information in the pre-configured detection group determine the target initial detection party, the detection group comprises a plurality of initial detection party information, the initial detection parties in the same detection group are responsible for performing initial detection on the same type of objects, the initial detection parties in different detection groups are responsible for performing initial detection on the different types of objects, and the different detection groups correspond to different re-detection total capacities.

In a third aspect, an embodiment of the present invention provides an electronic device, including: a processor and a memory, the processor being configured to execute a spot check program stored in the memory to implement the spot check method of any of the first aspects.

In a fourth aspect, an embodiment of the present invention provides a storage medium, where the storage medium stores one or more programs, and the one or more programs are executable by one or more processors to implement the spot check method according to any one of the first aspects.

According to the technical scheme provided by the embodiment of the invention, when the sampling rechecking of a plurality of preliminarily inspected objects corresponding to at least one target preliminarily inspecting party is determined, the preliminary inspection effect index value of each target preliminarily inspecting party is determined, the target spot-checking rate corresponding to each target preliminarily inspecting party is determined according to the preliminary inspection effect index value of each target preliminarily inspecting party, the number of the preliminarily inspected objects corresponding to each target preliminarily inspecting party and the preconfigured rechecking total capacity, the preliminarily inspected objects corresponding to each target preliminarily inspecting party are sampled according to the target spot-checking rate corresponding to each target preliminarily inspecting party so as to be used for the rechecking party to recheck the sampling result, and the purpose of intelligently determining the respective target spot-checking rate of each target preliminarily inspecting party according to the preliminary inspection effect index value of each target preliminarily inspecting party, the number of the preliminarily inspected objects corresponding to each target preliminarily inspecting party and the preconfigured rechecking total capacity is achieved. The target spot-check rate is related to the initial-check effect index value and the reinspection total capacity of the target initial-check party, so that reasonable allocation of resources of the reinspection party is realized, and meanwhile, the reinspection coverage rate of each target initial-check party is reasonably determined according to the initial-check quality of the target initial-check party.

Drawings

Fig. 1 is a flowchart illustrating an embodiment of a spot check method according to an embodiment of the present invention;

FIG. 2 is a flowchart illustrating another example of a spot check method according to an embodiment of the present invention;

FIG. 3 is a flowchart illustrating another example of a spot check method according to an embodiment of the present invention;

FIG. 4 is a flowchart illustrating another example of a spot check method according to an embodiment of the present invention;

fig. 5 is a block diagram of an embodiment of a spot check device according to the present invention;

fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

To facilitate understanding of the embodiment of the present invention, an exemplary application scenario of the spot check method provided in the embodiment of the present invention is first described below.

In an exemplary application scenario, in order to ensure that the video content published by the video website is compliant and is copyrighted, the video on the video website may be audited. Further, in order to ensure that the content of the video published by the video website is risk-free, after the video is initially checked by the initial checking party, a rechecking party with more experience is generally arranged to recheck the initially checked video. Here, the primary party may be a user or a machine learning model, and similarly, the secondary party may also be a user or a machine learning model.

In another exemplary application scenario, in order to ensure service compliance and service quality of the customer service, a service process of the customer service, such as call recording, chat recording, etc., may be audited. Similar to the above, after the first inspector performs the first inspection on the service process of the customer service, the rechecker with more experience is usually arranged to perform the rechecking on the call record, the chat record and the like of the first inspection.

Currently, in the above exemplary application scenario, when performing a review on an object that has been initially inspected (for example, a video, a call recording, a chat recording, etc.), a full-scale review or a sampling review at a fixed sampling rate is generally adopted.

However, the full-scale review will undoubtedly occupy a large amount of review resources, and when the review resources are insufficient, a large review pressure will be faced; the mode of sampling and rechecking according to the fixed sampling rate can lead to random probability of rechecking of objects which are charged by different initial detection parties and are subjected to initial detection, unfairness exists, and the rechecking coverage of risk objects is obviously insufficient.

Based on this, the embodiment of the invention provides a spot check method. The method provided by the embodiment of the present invention will be further explained by the following specific embodiments with reference to the drawings, which are not to be construed as limiting the embodiment of the present invention.

Referring to fig. 1, a flowchart of an embodiment of a spot check method according to an embodiment of the present invention is provided. As an example, the method may be applied to a review system, where the review system may include one or more electronic devices, and the invention is not limited thereto. As shown in fig. 1, the method may include the steps of:

step 101, when determining to perform sampling retest on a plurality of initially-detected objects corresponding to at least one target initially-detected party, determining an initial detection effect index value of each target initially-detected party.

In the embodiment of the invention, the initially detected object corresponding to the initial detecting party refers to an object on which the initial detecting party performs the initial detecting operation. Here, the object may be, for example, a video, a call recording, a chat recording, or the like.

In application, after the initial checking party completes the initial checking work, the primarily checked object or the related information of the primarily checked object, such as the object identifier, may be submitted to the review system, so that the review system can detect a plurality of initial checking parties triggering the initial checking operation within a set historical time period (e.g. within the previous 1 day).

In the embodiment of the invention, after detecting a plurality of initial detection parties triggering initial detection operation in a set historical time period, the reinspection system can determine at least one target initial detection party from the plurality of initial detection parties, and then performs reinspection on a plurality of initially detected objects corresponding to the at least one target initial detection party.

As an embodiment, the review system determines each of the plurality of initial providers as the target initial provider.

As another example, taking a video review scene as an example, videos can be divided into two types of long videos and short videos in a time dimension, and videos can be divided into multiple types of children animation, military videos, action videos, animal videos and the like in a content dimension. Further, in the application, in order to improve efficiency and accuracy of video review, different initial review groups and different review groups (hereinafter referred to as "review groups") are usually configured for different types of videos, and personnel in the same review group are specially responsible for reviewing the same type of videos, and personnel in different review groups are responsible for reviewing the different types of videos.

In this case, in a scenario where a retest of an object of a certain type is designated, among the plurality of initial testers, an initial tester belonging to a test group corresponding to the designated type (hereinafter referred to as a designated type) may be determined as a target initial tester, and then, retest of a plurality of pre-tested objects corresponding to the target initial tester may be performed as a retest of a pre-tested object of the designated type.

In the embodiment of the present invention, after the target primary-detecting party is determined, it may be determined whether to perform full-scale review or sampling review on the initially-detected object corresponding to the target primary-detecting party. Specifically, the review system may determine the total number of the plurality of inspected objects (denoted as C for convenience of description) corresponding to all the target initial inspectors, and then compare the total number with a preconfigured review total capacity (denoted as Q for convenience of description), where the review total capacity refers to: the total review amount that all reviewing parties can bear within the set time, for example, a total review capacity of 1000 means that all reviewing parties can review 1000 original subjects at most within the set time. The reviewer may be a user or a machine learning model.

Further, as an embodiment, in the case of configuring different test sets for different types of objects, the total retest amount that can be borne by different test sets in the same time is different because the retests in different test sets are different, for example, the total retest amount that can be borne by one test set in a given time is 800, and the total retest amount that can be borne by another test set in the same given time is 1000. That is, different test groups may correspond to different review total capacities, and therefore, the review total capacity compared to the total number of the plurality of the preliminary test objects described above means the review total capacity corresponding to the test group to which the target preliminary test party belongs.

If C is less than or equal to Q, it means that resources of the rechecker are sufficient and it is sufficient to recheck all the checked objects, so that when C is less than or equal to Q, it is determined that the full-scale rechecking is performed on a plurality of checked objects corresponding to all the target initial testers, or it can be said that the spot check rate corresponding to each target initial tester is 1.

On the contrary, if C > Q is compared, it means that resources of the rechecker are insufficient to perform recheck on all the initially-inspected objects, and therefore, in the case that C > Q is compared, it is determined that sampling rechecking is performed on a plurality of initially-inspected objects corresponding to at least one target initially-inspected object.

In the embodiment of the invention, when the sampling reinspection is determined to be performed on a plurality of initial detection objects corresponding to at least one target initial detection party, the initial detection effect index value of each target initial detection party is determined. Here, the initial examination effect index value includes, but is not limited to: false detection rate, first-level false detection rate, etc. The false detection rate is a ratio of objects mistaken for compliance (or mistaken for not containing the prohibited information) to all objects not in compliance (containing the prohibited information). The primary false detection rate is the proportion of the objects which are mistaken for compliance (or mistaken for not containing the forbidden information) to all the objects which are seriously not compliant (or contain the serious forbidden information).

As an example, the review system may determine the initial survey effectiveness index value of each target initial survey party according to the initial survey operation of each target initial survey party within a recent period of time, for example, within the last 7 days. By such processing, the initial examination effect index value determined in step 101 can truly reflect the current initial examination quality of the target initial examination party.

And 102, determining a target spot inspection rate corresponding to each target primary inspection party according to the primary inspection effect index value of each target primary inspection party, the number of the primary inspected objects corresponding to each target primary inspection party and the pre-configured total capacity of the retest.

As can be seen from the description in step 102, in the embodiment of the present invention, instead of regarding all the initial testers as a whole by using one sampling rate, the target sampling rate corresponding to each target initial tester is intelligently determined according to the initial testing effect index value of each target initial tester, the number of the initial tested objects corresponding to each target initial tester, and the pre-configured total review capacity. Through the processing, the target primary inspection party with higher primary inspection quality can be set with lower sampling rate, and the target primary inspection party with lower primary inspection quality is set with higher sampling rate, so that the resources of the secondary inspection party are reasonably allocated, the final false inspection rate is reduced, and the accuracy of the final inspection result is improved.

How to determine the target spot inspection rate corresponding to each target primary inspection party according to the primary inspection effect index value of each target primary inspection party, the number of the primary inspected objects corresponding to each target primary inspection party, and the pre-configured total review capacity is described below by the embodiment shown in fig. 2 and 3, and will not be described in detail here.

And 103, sampling the primarily detected objects corresponding to the target primary detection parties according to the target sampling rate corresponding to each target primary detection party, so that a reexamination party performs reexamination on the sampling results.

As an embodiment, the review system may extract, for each target primary party, the identifier of the primary object corresponding to the target primary party according to the target sampling rate corresponding to the target primary party, temporarily store the extracted identifier in the local memory space, and after the sampling operation for each target primary party is completed, obtain the primary object in batch according to the identifier of the primary object stored in the local memory space, so that the review party performs review on the sampling result, that is, the obtained primary object.

Referring to fig. 2, a flowchart of another embodiment of a spot check method according to an embodiment of the present invention is provided. The flow shown in fig. 2 is based on the flow shown in fig. 1, and describes how to determine the target spot inspection rate corresponding to each target primary inspector according to the initial inspection effect index value of each target primary inspector, the number of the primary inspected objects corresponding to each target primary inspector, and the pre-configured total re-inspection capacity. As shown in fig. 2, the process may include the following steps:

and step 201, determining the initial sampling rate corresponding to each target primary party according to the initial detection effect index value of each target primary party.

As an embodiment, a first sampling rate configuration table may be configured in advance by a user, and the first sampling rate configuration table includes a corresponding relationship between a first preliminary examination effect index value and a sampling rate. Here, the first initial examination effect index value may be, for example, a false positive rate, and the first initial examination effect index value has a positive correlation with the false positive rate, that is, the higher the false positive rate of the initial examination party is, the higher the corresponding false positive rate is. Through this kind of setting, can realize that the false drop rate at the primary examination side is higher, also promptly under the not good condition of primary quality, increase the retest dynamics to the object that this primary examination side is responsible for the primary examination to ensure the accuracy of final inspection result, reduce the false drop rate.

Accordingly, in this step 201, for each target primary party, the selective examination rate corresponding to the first primary examination effect index value of the initial examination effect index values of the target primary parties is searched from the preset first selective examination rate configuration table, and the searched selective examination rate corresponding to the first primary examination effect index value of the target primary party is determined as the initial selective examination rate corresponding to the target primary party.

As another embodiment, in addition to the above embodiment, the initial examination effect index value further includes a second initial examination effect index value. Here, the second initial detection effect index value may be, for example, a primary false detection rate, and it is understood that a higher primary false detection rate means that the initial detection quality is worse as the number of times of occurrence of a serious false detection event by the initial detector increases. Accordingly, in this embodiment, the initial sampling rate obtained by table lookup may be selectively adjusted according to the second initial testing effect index value of the target initial testing party.

Specifically, if the second initial inspection effect index value of the target initial inspector satisfies the second setting condition, the searched sampling rate corresponding to the first initial inspection effect index value of the target initial inspector can be determined as the initial sampling rate corresponding to the target initial inspector. Here, the second setting condition may be, for example, that the second initial examination effect index value is 0 or that the second initial examination effect index value is lower than a preset threshold value.

And if the second initial detection effect index value of the target initial detector meets a third set condition, determining the initial sampling rate corresponding to the target initial detector according to a preset sampling rate calculation formula and the searched sampling rate corresponding to the first initial detection effect index value of the target initial detector. Here, the third setting condition may be, for example, that the second initial examination effect index value is greater than 0, or that the second initial examination effect index value is higher than a preset threshold. Wherein, the above calculation formula of the spot check rate is as follows:

P₀＝P₁+N*α

in the above formula, P₀Indicates the initial spot check rate, P₁The second preliminary examination result index value is a number greater than 0, for example, 0.3.

The sampling rate calculation formula can realize that: when the second initial detection effect index value of the target initial detection party meets the third set condition, namely the target initial detection party has more times of serious false detection events and has poor initial detection quality, the initial spot inspection rate corresponding to the target initial detection party is properly increased, so that the retest strength of an object responsible for initial detection of the target initial detection party can be increased, the accuracy of a final detection result is ensured, and the false detection rate is reduced.

Note that, if the initial sampling rate calculated by the above-described sampling rate calculation formula is greater than 1, 1 is determined as the initial sampling rate.

It should be further noted that the above embodiments are only optional implementations for determining the initial sampling rate, and in practical applications, the initial sampling rate corresponding to the target initial testing party may also be determined in other manners. For example, as an embodiment, a second sampling rate configuration table (including the correspondence relationship between the information of the initial testers and the sampling rates) may be formed by the user by configuring corresponding sampling rates for each initial testers in advance according to the initial testing effect index of each initial testers. Accordingly, in this step 201, for each target primary party, the sampling rate corresponding to the target primary party is searched from the preset second sampling rate configuration table, and the searched sampling rate corresponding to the target primary party is determined as the initial sampling rate corresponding to the target primary party.

As another embodiment, in this step 201, first, for each target primary inspector, the selective inspection rate corresponding to the target primary inspector is searched from the preset second selective inspection rate configuration table, and if the selective inspection rate corresponding to the target primary inspector is found, the found selective inspection rate corresponding to the target primary inspector is determined as the initial selective inspection rate corresponding to the target primary inspector; if the selective examination rate corresponding to the target primary examination party is not found, then according to a first primary examination effect index value corresponding to the target primary examination party, the selective examination rate corresponding to the first primary examination effect index value is found from a preset first selective examination rate configuration table, and the initial selective examination rate corresponding to the target primary examination party is determined according to the search result.

Step 202, determining whether the initial sampling rate corresponding to each target primary party meets a first set condition according to the number of the primary objects corresponding to each target primary party and the pre-configured total capacity of the reinspection; if yes, go to step 203, and if not, go to step 204.

In this step 202, first, a first estimated review total amount of all target primary inspectors is determined according to the initial spot inspection rate corresponding to each target primary inspector and the number of the primary inspected objects corresponding to each target primary inspector, specifically, the first estimated review total amount of all target primary inspectors can be determined by the following formula:

in the above formula, A represents the first estimated reinspection amount, a_iIndicates the number of detected objects corresponding to the ith target detector, P_{0_i}And the initial sampling rate corresponding to the ith target initial testing party is shown.

The first estimated review total is then compared to a first value, which may be the difference between the review total capacity and a set value (denoted as T), and a second value, which may be the sum of the review total capacity and the set value, which is a number greater than 0.

If the first estimated reinspection total amount is greater than or equal to the first value and less than or equal to the second value, that is, Q-T is greater than or equal to a and less than or equal to Q + T, it means that if the original inspected objects corresponding to the target original inspectors are sampled according to the current corresponding initial sampling rate of the target original inspectors, the reinspection party resources can meet the requirement of reinspection of the sampled original inspected objects, and thus it can be determined that the current corresponding initial sampling rate of the target original inspectors meets the first set condition.

If the first estimated reinspection total amount is smaller than the first value, that is, a is not larger than Q-T, it means that if the original inspected objects corresponding to the target original inspectors are sampled according to the current initial reinspection rates corresponding to the target original inspectors, the reinspection side resources can satisfy the requirement for reinspection of the sampled original inspected objects, but the reinspection side resources cannot be fully utilized, and at this time, it can be determined that the current initial reinspection rates corresponding to the target original inspectors do not satisfy the first setting condition.

If the first estimated reinspection total amount is greater than the second value, that is, a is greater than or equal to Q + T, it means that if the inspected objects corresponding to the target initial inspectors are sampled according to the current initial reinspection rate corresponding to the target initial inspectors, the reinspection party is lack of resources, which causes the reinspection face a large pressure, and at this time, it can be determined that the current initial reinspection rate corresponding to the target initial inspectors does not satisfy the first setting condition.

And step 203, determining the initial sampling rate corresponding to each target initial checking party as the target sampling rate corresponding to each target initial checking party.

In the embodiment of the present invention, when it is determined that the current corresponding initial sampling rate of each target initial testing party satisfies the first setting condition, based on the above description, the current corresponding initial sampling rate of each target initial testing party may be directly determined as the target sampling rate of each target initial testing party.

And 204, carrying out iterative adjustment on the initial sampling rate corresponding to each target initial detection party according to a set iterative adjustment mode, and stopping iteration until a first set condition is met.

In the embodiment of the present invention, when it is determined that the current corresponding initial sampling rate of each target initial testing party does not satisfy the first setting condition, based on the above description, the current corresponding initial sampling rate of each target initial testing party may be adjusted to obtain the target sampling rate.

As an embodiment, when adjusting the current corresponding initial sampling rate of each target primary testing party, an iterative adjustment manner may be adopted, that is, each time adjustment is performed, it is determined whether the current initial sampling rate satisfies the first setting condition, if yes, iteration is stopped, if not, adjustment is performed again, and after adjustment, it is determined whether the current initial sampling rate satisfies the first setting condition, and this is repeated until the initial sampling rate satisfies the first setting condition.

When the first estimated reinspection total amount is smaller than the first value and the initial sampling rate corresponding to each target primary inspection party does not meet the first set condition, the initial sampling rate corresponding to each target primary inspection party can be increased, so that the reinspection party resources can be fully utilized. When the first estimated reinspection total amount is larger than the second value and the current corresponding initial sampling rate of each target initial inspection party is determined not to meet the first set condition, the current corresponding initial sampling rate of each target initial inspection party can be reduced, so that the reinspection pressure is reduced.

And step 205, after the iteration is finished, determining the target spot inspection rate corresponding to each target initial inspection party according to the current corresponding initial spot inspection rate of each target initial inspection party.

After iteration is finished, if the current corresponding initial sampling rate of the target initial detection party is greater than 1, determining 1 as the corresponding target sampling rate of the target initial detection party; and if the current corresponding initial sampling rate of the target initial checking party is less than or equal to 1, determining the current corresponding initial sampling rate of the target initial checking party as the corresponding target sampling rate of the target initial checking party.

Through the flow shown in fig. 2, the target spot-checking rate corresponding to each target primary-checking party is determined according to the primary-checking effect index value of each target primary-checking party, the number of the primary-checked objects corresponding to each target primary-checking party, and the pre-configured total capacity of the reinspection, so that the target spot-checking rate of each target primary-checking party is determined according to the primary-checking quality of each target primary-checking party, the reinspection coverage of the risk object is effectively ensured, and meanwhile, the resources of the reinspection party can be reasonably allocated, and the resources of the reinspection party are effectively utilized.

Referring to fig. 3, a flowchart of another embodiment of a spot check method according to an embodiment of the present invention is provided. The flow shown in fig. 3 is based on the flow shown in fig. 2, and describes how to iteratively adjust the initial sampling rate corresponding to each target initial testing party according to a set iterative adjustment mode, and the iteration is stopped until a first set condition is met. As shown in fig. 3, the process may include the following steps:

and 301, determining an adjusting coefficient in the iteration process according to the total reinspection capacity and the current first estimated reinspection total amount of all target initial inspectors.

And 302, multiplying the current corresponding initial sampling rate of the target initial checking party by an adjusting coefficient aiming at each target initial checking party to obtain the corresponding initial sampling rate of the target initial checking party in the current iteration process.

In the first iteration process, the current corresponding initial spot check rate of the target initial testers refers to the initial spot check rate obtained in the step 201, and the current first estimated reinspection total amount of all the target initial testers refers to the first estimated reinspection total amount obtained in the step 202; in the non-first iteration process, the current corresponding initial spot check rate of the target initial detector refers to the initial spot check rate obtained after the last iteration is finished, and the current corresponding first estimated reinspection total amount of the target initial detector refers to the first estimated reinspection total amount obtained by using the initial spot check rate obtained after the last iteration is finished.

As can be seen from the above description, when the first estimated review total amount is smaller than the first value, the current corresponding initial review rate of each target review party may be increased, so that the resources of the review party can be fully utilized, and therefore, when the current first estimated review total amounts of all target review parties are smaller than the first value, the adjustment coefficient (denoted as S) determined in step 301 is greater than 1, so that the current corresponding initial review rate of each target review party may be increased by executing step 302.

As an optional implementation manner, when the current first estimated review total amount of all the target initial inspectors is smaller than the first value by comparison, the adjustment coefficient in the current iteration process may be determined in the following manner: determining a target primary detection party with a current corresponding initial spot-checking rate of 1 as a first primary detection party, determining a second estimated reinspection total amount (marked as B) of all the first primary detection parties according to the number of the primary detection objects corresponding to each first primary detection party and the current corresponding initial spot-checking rate, and subtracting the second estimated reinspection total amount from the reinspection total capacity to obtain a first difference value; subtracting the second estimated reinspection total amount from the first estimated reinspection total amount to obtain a second difference, and dividing the second difference by the first difference to obtain an adjustment coefficient in the iteration process, wherein the specific formula is as follows:

in the implementation manner, the adjustment coefficient in the iteration process is obtained by subtracting the second estimated reinspection total amount from the reinspection total amount to obtain a first difference value, subtracting the second estimated reinspection total amount from the first estimated reinspection total amount to obtain a second difference value, and dividing the first difference value by the second difference value, so that the primary inspected objects in charge of the primary inspection by the target primary inspection party with the initial sampling rate of 1 are removed, namely, the influence of the number of the primary inspected objects with higher risk on the adjustment coefficient is also realized, and the initial sampling rate is adjusted more finely.

As another optional implementation manner, when the current first estimated review total amount of all the target initial inspectors is smaller than the first value by comparison, the adjustment coefficient in the current iteration process may be determined in the following manner: dividing the total reinspection capacity by the current first estimated reinspection total amount of all target primary inspectors to obtain an adjustment coefficient in the iteration process, wherein the specific formula is as follows:

as can be seen from the above description, when the first estimated reinspection total amount is greater than the second value, the currently corresponding initial sampling rate of each target primary inspector can be reduced to reduce the reinspection pressure, so that, when the first estimated reinspection total amount is greater than the second value, the adjustment coefficient determined in step 301 is less than 1, and thus, the currently corresponding initial sampling rate of each target primary inspector can be reduced by executing step 302.

As an optional implementation manner, when the current first estimated review total amount of all the target initial testers is greater than the second value, the adjustment coefficient in the current iteration process may be determined in the following manner: dividing the total reinspection capacity by the current first estimated reinspection total amount of all target primary inspectors to obtain an adjustment coefficient in the iteration process, wherein the specific formula is as follows:

and step 303, determining a first pre-estimated reinspection total amount corresponding to all the target initial testers in the current iteration process according to the number of the initially tested objects corresponding to each target initial tester and the corresponding initial spot-checking rate in the current iteration process.

Step 304, comparing the corresponding first estimated reinspection total amount of all target primary inspectors in the current iteration process with a first value and a second value; if the first estimated reinspection total amount corresponding to all the target primary inspectors in the current iteration process is greater than or equal to the first value and less than or equal to the second value, executing the step 305, and if the first estimated reinspection total amount corresponding to all the target primary inspectors in the current iteration process is less than the first value or greater than the second value, returning to execute the step 301 to enter the next iteration process.

And 305, determining that the current corresponding initial sampling rate of each target initial detector meets a first set condition, and stopping iteration.

Through the process shown in fig. 3, the iterative adjustment of the initial spot-checking rate corresponding to each target initial checking party according to the set iterative adjustment mode is realized, and the actual total reinspection amount is maximally close to the total reinspection amount while the coverage of the reinspection of the risk objects is effectively ensured, so that the resources of the reinspection party are effectively utilized.

Referring to fig. 4, a flowchart of another embodiment of a spot check method according to an embodiment of the present invention is provided. The flow shown in fig. 4 is based on the flows shown in fig. 1 to 3, and the sampling method provided by the embodiment of the present invention is generally described. As shown in fig. 4, the process may include the following steps:

step 401, determining the total number C of the plurality of primary inspected objects corresponding to all the target primary inspectors.

Step 402, comparing the total number C with a pre-configured total rechecking capacity Q, and if C is not greater than Q, executing step 403; if C > Q is compared, then step 404 is performed.

Step 403, determining to perform full-scale retest on a plurality of initially-inspected objects corresponding to all target initially-inspected parties; and ending the flow.

And step 404, determining the initial sampling rate corresponding to each target primary party according to the initial detection effect index value of each target primary party.

And 405, determining a first estimated reinspection total amount A of all the target initial testers according to the current corresponding initial spot-checking rate of each target initial tester and the number of the initially checked objects corresponding to each target initial tester.

Step 406, comparing the first estimated reinspection total amount with a first value Q-T and a second value Q + T respectively, and if Q-T is more than or equal to A and less than or equal to Q + T, executing step 407; if A is less than or equal to Q-T, executing step 408; if A is greater than or equal to Q + T, go to step 410.

Step 407, determining a target spot inspection rate corresponding to each target primary inspector according to the current corresponding initial spot inspection rate of each target primary inspector; step 412 is performed.

And step 408, determining the target initial testing party with the current corresponding initial sampling rate of 1 as a first initial testing party, and determining second estimated reinspection total amount B of all the first initial testing parties according to the number of the initial tested objects corresponding to each first initial testing party and the current corresponding initial sampling rate.

Step 409, dividing the first difference value by a second difference value to obtain an adjusting coefficient S in the iteration process, wherein the first difference value is Q-B, and the second difference value is A-B; step 411 is performed.

And step 410, dividing the reinspection total capacity Q by the current first estimated reinspection total quantity A of the target initial inspector to obtain an adjustment coefficient S in the iteration process.

Step 411, for each target primary detector, multiplying the current corresponding initial sampling rate of the target primary detector by an adjustment coefficient S to obtain the corresponding initial sampling rate of the target primary detector in the current iteration process; return to perform step 405.

And step 412, sampling the primarily detected objects corresponding to the target primary detection parties according to the target sampling rate corresponding to the target primary detection parties, so that the sampling results can be rechecked by a rechecking party.

For the detailed description of the flow shown in fig. 4, reference may be made to the description of the flows shown in fig. 1 to fig. 3, which is not described herein again.

Corresponding to the embodiment of the spot check method, the invention also provides an embodiment of a spot check device.

As shown in fig. 5, a block diagram of an embodiment of a spot check apparatus according to an embodiment of the present invention is provided, where the apparatus includes: an index value determination module 51, a spot check rate determination module 52, and a spot check module 53.

The index value determining module 51 is configured to determine an initial detection effect index value of each target initial detector when determining that sampling retest is performed on a plurality of initial detected objects corresponding to at least one target initial detector;

a selective examination rate determining module 52, configured to determine a target selective examination rate corresponding to each target preliminary examination party according to the preliminary examination effect index value of each target preliminary examination party, the number of preliminary examination objects corresponding to each target preliminary examination party, and a preconfigured total review volume;

the sampling module 53 is configured to sample the initially detected objects corresponding to each target initial detector according to the target sampling rate corresponding to each target initial detector, so that a review party performs review on a sampling result.

In a possible embodiment, the device further comprises (not shown in the figures):

In one possible embodiment, the spot check rate determining module 52 includes (not shown):

Fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present invention, where the electronic device 600 shown in fig. 6 includes: at least one processor 601, memory 602, at least one network interface 604, and other user interfaces 603. The various components in the electronic device 600 are coupled together by a bus system 605. It is understood that the bus system 605 is used to enable communications among the components. The bus system 605 includes a power bus, a control bus, and a status signal bus in addition to a data bus. For clarity of illustration, however, the various buses are labeled as bus system 605 in fig. 6.

The user interface 603 may include, among other things, a display, a keyboard, or a pointing device (e.g., a mouse, trackball, touch pad, or touch screen, among others.

It will be appreciated that the memory 602 in embodiments of the invention may be either volatile memory or nonvolatile memory, or may include both volatile and nonvolatile memory. The non-volatile memory may be a Read-only memory (ROM), a programmable Read-only memory (PROM), an erasable programmable Read-only memory (erasabprom, EPROM), an electrically erasable programmable Read-only memory (EEPROM), or a flash memory. The volatile memory may be a Random Access Memory (RAM) which functions as an external cache. By way of example, but not limitation, many forms of RAM are available, such as static random access memory (staticiram, SRAM), dynamic random access memory (dynamic RAM, DRAM), synchronous dynamic random access memory (syncronous DRAM, SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM ), Enhanced Synchronous DRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), and direct memory bus RAM (DRRAM). The memory 602 described herein is intended to comprise, without being limited to, these and any other suitable types of memory.

In some embodiments, memory 602 stores the following elements, executable units or data structures, or a subset thereof, or an expanded set thereof: an operating system 6021 and application programs 6022.

The operating system 6021 includes various system programs, such as a framework layer, a core library layer, a driver layer, and the like, and is used for implementing various basic services and processing hardware-based tasks. The application program 6022 includes various application programs such as a media player (MediaPlayer), a Browser (Browser), and the like, and is used to implement various application services. A program implementing the method of an embodiment of the invention can be included in the application program 6022.

In the embodiment of the present invention, by calling a program or an instruction stored in the memory 602, specifically, a program or an instruction stored in the application program 6022, the processor 601 is configured to execute the method steps provided by the method embodiments, for example, including:

The method disclosed by the above-mentioned embodiment of the present invention can be applied to the processor 601, or implemented by the processor 601. The processor 601 may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the above method may be performed by integrated logic circuits of hardware or instructions in the form of software in the processor 601. The processor 601 may be a general-purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic device, or discrete hardware components. The various methods, steps and logic blocks disclosed in the embodiments of the present invention may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in connection with the embodiments of the present invention may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software elements in the decoding processor. The software elements may be located in ram, flash, rom, prom, or eprom, registers, among other storage media that are well known in the art. The storage medium is located in the memory 602, and the processor 601 reads the information in the memory 602 and completes the steps of the method in combination with the hardware thereof.

It is to be understood that the embodiments described herein may be implemented in hardware, software, firmware, middleware, microcode, or any combination thereof. For a hardware implementation, the processing units may be implemented within one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), general purpose processors, controllers, micro-controllers, microprocessors, other electronic units configured to perform the functions described herein, or a combination thereof.

For a software implementation, the techniques described herein may be implemented by means of units performing the functions described herein. The software codes may be stored in a memory and executed by a processor. The memory may be implemented within the processor or external to the processor.

The electronic device provided in this embodiment may be the electronic device shown in fig. 6, and may perform all the steps of the spot check method shown in fig. 1 to 3, so as to achieve the technical effect of the spot check method shown in fig. 1 to 3, and for brevity, it is described with reference to fig. 1 to 3, which is not described herein again.

The embodiment of the invention also provides a storage medium (computer readable storage medium). The storage medium herein stores one or more programs. Among others, the storage medium may include volatile memory, such as random access memory; the memory may also include non-volatile memory, such as read-only memory, flash memory, a hard disk, or a solid state disk; the memory may also comprise a combination of memories of the kind described above.

When one or more programs in the storage medium are executable by one or more processors, the above-described spot check method performed on the electronic device side is implemented.

The processor is used for executing the spot check program stored in the memory to realize the following steps of the spot check method executed on the electronic equipment side:

Those of skill would further appreciate that the various illustrative components and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.

The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied in hardware, a software module executed by a processor, or a combination of the two. A software module may reside in Random Access Memory (RAM), memory, Read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.

The above-mentioned embodiments are intended to illustrate the objects, technical solutions and advantages of the present invention in further detail, and it should be understood that the above-mentioned embodiments are merely exemplary embodiments of the present invention, and are not intended to limit the scope of the present invention, and any modifications, equivalent substitutions, improvements and the like made within the spirit and principle of the present invention should be included in the scope of the present invention.

Claims

1. A spot check method, comprising:

2. The method of claim 1, wherein the determining a sample review of a plurality of the preliminary objects corresponding to at least one target preliminary party comprises:

3. The method according to claim 1, wherein the determining the target spot inspection rate for each of the target initial inspectors according to the initial inspection effect index value of each of the target initial inspectors, the number of the initially inspected objects corresponding to each of the target initial inspectors, and the preconfigured total review volume comprises:

4. The method of claim 3, wherein the initial survey effectiveness index value comprises a first initial survey effectiveness index value, and wherein determining the initial spot test rate for each of the target initial survey parties based on the initial survey effectiveness index value for each of the initial survey parties comprises:

5. The method according to claim 4, wherein the initial inspection effect index value further comprises a second initial inspection effect index value, and the determining the initial sampling rate corresponding to the target initial inspector according to the found sampling rate corresponding to the first initial inspection effect index value of the target initial inspector comprises:

6. The method according to claim 3, wherein the determining whether the initial sampling rate corresponding to each of the target initial testers meets a first set condition according to the number of the initially tested objects corresponding to each of the target initial testers and the preconfigured total review volume comprises:

7. The method according to claim 3, wherein the iteratively adjusting the initial sampling rate corresponding to each of the target initial testers according to a set iterative adjustment manner until the iteration is stopped when the first set condition is met, includes:

8. The method according to claim 7, wherein, in the case that the comparison shows that the corresponding first estimated review total amount of all the target original testers in the current iteration process is greater than the second value, the determining the adjustment coefficient in the current iteration process according to the review total capacity and the current first estimated review total amount of all the target original testers includes:

9. The method according to claim 7, wherein, in the case that the comparison shows that the corresponding first estimated review total amount of all the target original testers in the current iteration process is smaller than the first value, the determining the adjustment coefficient in the current iteration process according to the review total capacity and the current first estimated review total amount of all the target original testers includes:

10. The method of claim 1, further comprising, prior to the method:

11. A spot check device, comprising:

12. An electronic device, comprising: a processor and a memory, the processor being configured to execute a spot check program stored in the memory to implement the spot check method of any one of claims 1-10.

13. A storage medium storing one or more programs, the one or more programs being executable by one or more processors to implement the spot check method of any one of claims 1-10.