CN112183951B - Supervision processing method and device based on audit quality evaluation - Google Patents
Supervision processing method and device based on audit quality evaluation Download PDFInfo
- Publication number
- CN112183951B CN112183951B CN202010936401.3A CN202010936401A CN112183951B CN 112183951 B CN112183951 B CN 112183951B CN 202010936401 A CN202010936401 A CN 202010936401A CN 112183951 B CN112183951 B CN 112183951B
- Authority
- CN
- China
- Prior art keywords
- auditing
- target
- quality detection
- level
- results
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0635—Risk analysis of enterprise or organisation activities
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0639—Performance analysis of employees; Performance analysis of enterprise or organisation operations
- G06Q10/06395—Quality analysis or management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/10—Office automation; Time management
- G06Q10/103—Workflow collaboration or project management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/22—Image preprocessing by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/30—Computing systems specially adapted for manufacturing
Landscapes
- Business, Economics & Management (AREA)
- Engineering & Computer Science (AREA)
- Human Resources & Organizations (AREA)
- Strategic Management (AREA)
- Entrepreneurship & Innovation (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Economics (AREA)
- Marketing (AREA)
- Educational Administration (AREA)
- Development Economics (AREA)
- Operations Research (AREA)
- Quality & Reliability (AREA)
- Tourism & Hospitality (AREA)
- General Business, Economics & Management (AREA)
- Game Theory and Decision Science (AREA)
- Multimedia (AREA)
- Data Mining & Analysis (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- General Factory Administration (AREA)
Abstract
The embodiment of the specification discloses a supervision processing method and a supervision processing device based on audit quality evaluation, wherein the method comprises the following steps: obtaining the auditing results of a target auditing system on a plurality of auditing materials; according to a preset compliance quality detection strategy, performing compliance quality detection on the auditing results of the plurality of auditing materials by the target auditing system from three specified layers; performing quality evaluation on the auditing results of the target auditing system on the multiple auditing materials based on the compliance quality detection results of the target auditing system on the three appointed levels, and respectively obtaining auditing quality evaluation results corresponding to the target auditing system on the three appointed levels; and executing supervision processing operation matched with the auditing quality evaluation results of the target auditing system corresponding to the three specified layers. And under the condition of determining the compliance of the audit result, the quality evaluation on the audit result in multiple aspects is realized, and the accuracy and efficiency of the quality evaluation are improved.
Description
Technical Field
The present invention relates to the field of computer software technologies, and in particular, to a supervision processing method and apparatus based on quality evaluation.
Background
At present, auditing services gradually get rid of manual participation, are gradually combined with an artificial intelligence technology and evolve into intelligent auditing services, and the auditing services usually need to determine whether risk points such as yellow storm pictures, reaction characters and the like exist in auditing materials such as images, videos, audios, characters and the like through matching of an artificial intelligence model and an algorithm.
After the auditing is completed, in the prior art, a large amount of manual work is usually required to check whether the auditing results have problems, and since the business data are usually huge, the auditing results can only be sampled to check the accuracy of the auditing results. Therefore, how to improve the efficiency and accuracy of evaluating the audit results of such audit businesses still needs to provide further solutions.
Disclosure of Invention
The embodiment of the application aims to provide a supervision processing method, a device and a system based on audit quality evaluation and electronic equipment, which are used for solving the problem that the evaluation efficiency and accuracy of audit results of audit services need to be further improved in the prior art.
In order to solve the above technical problem, the embodiment of the present application is implemented as follows:
in a first aspect, a supervision processing method based on audit quality evaluation is provided, including:
obtaining the auditing results of a target auditing system on a plurality of auditing materials;
according to a preset compliance quality detection strategy, respectively carrying out compliance quality detection on the auditing results of the plurality of auditing materials by the target auditing system from three appointed layers to obtain compliance quality detection results of the target auditing system on the three appointed layers, wherein the three appointed layers comprise a service layer, a rule layer and an atomic capability layer;
performing quality evaluation on the auditing results of the target auditing system on the plurality of auditing materials based on the compliance quality detection results of the target auditing system on the three appointed levels, and respectively obtaining auditing quality evaluation results corresponding to the target auditing system on the three appointed levels;
and executing supervision processing operation matched with the auditing quality evaluation results of the target auditing system corresponding to the three specified layers.
In a second aspect, a supervision processing apparatus based on audit quality evaluation is provided, including:
the auditing result acquisition module is used for acquiring auditing results of the target auditing system on a plurality of auditing materials;
the compliance quality detection module is used for respectively carrying out compliance quality detection on the auditing results of the plurality of auditing materials from the appointed three layers to the target auditing system according to a preset compliance quality detection strategy to obtain compliance quality detection results of the target auditing system on the appointed three layers, wherein the appointed three layers comprise a service layer, a rule layer and an atomic capability layer;
the auditing quality evaluation module is used for evaluating the auditing results of the target auditing system on the plurality of auditing materials based on the compliance quality detection results of the target auditing system on the three specified levels, and respectively obtaining the auditing quality evaluation results corresponding to the target auditing system on the three specified levels;
and the supervision processing module executes supervision processing operation matched with the auditing quality evaluation results of the target auditing system corresponding to the three specified layers.
In a third aspect, an electronic device is provided, including:
a processor; and
a memory arranged to store computer executable instructions that, when executed, cause the processor to:
obtaining the auditing results of a target auditing system to a plurality of auditing materials;
according to a preset compliance quality detection strategy, respectively carrying out compliance quality detection on the auditing results of the plurality of auditing materials by the target auditing system from three appointed layers to obtain compliance quality detection results of the target auditing system on the three appointed layers, wherein the three appointed layers comprise a service layer, a rule layer and an atomic capability layer;
performing quality evaluation on the auditing results of the target auditing system on the plurality of auditing materials based on the compliance quality detection results of the target auditing system on the three appointed levels, and respectively obtaining auditing quality evaluation results corresponding to the target auditing system on the three appointed levels;
and executing supervision processing operation matched with the auditing quality evaluation results corresponding to the target auditing system on the three specified layers.
In a fourth aspect, a computer-readable storage medium is presented, storing one or more programs, which when executed by an electronic device that includes a plurality of application programs, cause the electronic device to:
obtaining the auditing results of a target auditing system on a plurality of auditing materials;
according to a preset compliance quality detection strategy, respectively carrying out compliance quality detection on the auditing results of the plurality of auditing materials by the target auditing system from three appointed layers to obtain compliance quality detection results of the target auditing system on the three appointed layers, wherein the three appointed layers comprise a service layer, a rule layer and an atomic capability layer;
performing quality evaluation on the auditing results of the target auditing system on the plurality of auditing materials based on the compliance quality detection results of the target auditing system on the three appointed levels, and respectively obtaining auditing quality evaluation results corresponding to the target auditing system on the three appointed levels;
and executing supervision processing operation matched with the auditing quality evaluation results of the target auditing system corresponding to the three specified layers.
As can be seen from the technical solutions provided in the embodiments of the present specification, the embodiments of the present specification have at least one of the following technical effects:
when the auditing quality of the target auditing system is evaluated and supervised, the auditing results of the target auditing system for a plurality of auditing materials can be obtained; according to a preset compliance quality detection strategy, respectively carrying out compliance quality detection on the auditing results of a plurality of auditing materials of the target auditing system from three appointed layers to obtain compliance quality detection results of the target auditing system at the three appointed layers, wherein the three appointed layers comprise a service layer, a rule layer and an atomic capability layer; then, based on the compliance quality detection results of the target auditing system at the three specified levels, the quality of the auditing results of the target auditing system for the multiple auditing materials is evaluated, and the corresponding auditing quality evaluation results of the target auditing system at the three specified levels are respectively obtained; and finally, executing supervision processing operation matched with the auditing quality evaluation results corresponding to the three specified levels of the target auditing system. Under the condition of determining the compliance of the auditing result, the auditing result of the auditing system is comprehensively evaluated in multiple aspects from three levels of business, rule and atomic capability, and the accuracy and efficiency of quality evaluation are improved.
Drawings
In order to more clearly illustrate the embodiments of the present specification or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, it is obvious that the drawings in the following description are only some embodiments described in the present specification, and for those skilled in the art, other drawings can be obtained according to the drawings without any creative effort.
Fig. 1 is a schematic flow chart of an implementation flow of a supervision processing method based on audit quality evaluation according to an embodiment of the present specification.
Fig. 2 is a schematic structural diagram of a supervision processing apparatus based on audit quality evaluation according to an embodiment of the present specification.
Fig. 3 is a schematic structural diagram of an electronic device provided in an embodiment of the specification.
Detailed Description
In order to make the purpose, technical solutions and advantages of this document more clear, the technical solutions of this specification will be clearly and completely described below with reference to specific embodiments of this specification and the accompanying drawings. It is to be understood that the embodiments described are only a few embodiments of the present disclosure, and not all embodiments. All other embodiments obtained by a person skilled in the art without making any inventive step based on the embodiments in this description belong to the protection scope of this document.
The technical solutions provided by the embodiments of the present application are described in detail below with reference to the accompanying drawings.
In order to solve the problem that the evaluation efficiency and accuracy of the audit result of the audit service need to be further improved in the prior art, embodiments of the present specification provide a supervision processing method based on audit quality evaluation, which can obtain the audit result of a target audit system on a plurality of audit materials when evaluating and supervising the audit quality of the target audit system; according to a preset compliance quality detection strategy, respectively carrying out compliance quality detection on the auditing results of a plurality of auditing materials of the target auditing system from three appointed layers to obtain compliance quality detection results of the target auditing system at the three appointed layers, wherein the three appointed layers comprise a service layer, a rule layer and an atomic capability layer; then, based on the compliance quality detection results of the target auditing system at the three specified levels, the quality of the auditing results of the target auditing system for the multiple auditing materials is evaluated, and the corresponding auditing quality evaluation results of the target auditing system at the three specified levels are respectively obtained; and finally, executing supervision processing operation matched with the corresponding audit quality evaluation results of the target audit system on the three specified layers. Under the condition of determining the compliance of the auditing result, the auditing result of the auditing system is comprehensively evaluated in multiple aspects from three levels of business, rule and atomic capability, and the accuracy and efficiency of quality evaluation are improved.
In the supervision processing method based on the audit quality evaluation provided in the embodiment of the present specification, an execution subject of the method, which may be but is not limited to a computer, a server, and the like, may be configured to execute at least one of the method equipment terminals provided in the embodiment of the present invention, or the execution subject of the method may also be an audit quality supervision system itself capable of executing the method.
For convenience of description, the following description will be made of an embodiment of the method by taking an execution subject of the method as an example of an audit quality supervision system capable of executing the method. It is to be understood that the subject matter of the method is an audit quality supervision system, which is exemplary only, and should not be construed as limiting the method.
Fig. 1 is a schematic flow diagram of an implementation flow of a supervision processing method based on audit quality evaluation according to one or more embodiments of the present specification, including:
and S110, acquiring the auditing results of the target auditing system on a plurality of auditing materials.
The audit material may specifically include images, audio, video, text, and text. The target auditing system can specifically find the risk points in the auditing material through a pre-designed algorithm and/or a pre-trained artificial intelligence model, namely, whether the auditing material has risks or not is determined. Taking the image-class audit material as an example, the risk points in the image may include whether the image contains risk contents such as yellow storm, terrorism, political affairs, false, and the like. The results of the target audit system's audit of the audit material may typically include pass and fail.
In practical application, obtaining the audit results of the target audit system on multiple audit materials can specifically obtain the audit results of the target audit system on multiple audit materials in a past period of time, for example, can obtain the audit results of the target audit system on multiple audit materials in a past month or a week.
And S120, according to a preset compliance quality detection strategy, respectively carrying out compliance quality detection on the auditing results of the target auditing system on the plurality of auditing materials from three appointed layers to obtain compliance quality detection results of the target auditing system on the three appointed layers, wherein the three appointed layers comprise a business layer, a rule layer and an atomic capability layer.
Optionally, in order to determine the compliance quality detection result of the target auditing system more accurately, in this embodiment of the present specification, according to a preset compliance quality detection policy, compliance quality detection is performed on the auditing results of multiple auditing materials by the target auditing system from three specified layers, respectively, so as to obtain compliance quality detection results of the target auditing system in three specified layers, where the three specified layers include a service layer, a rule layer, and an atomic capability layer, and the method includes:
according to a compliance quality detection strategy corresponding to a service level in preset compliance quality detection strategies, performing compliance quality detection on the auditing results of a plurality of auditing materials by the target auditing system to obtain the compliance quality detection results of the target auditing system on the service level;
according to a compliance quality detection strategy corresponding to a rule level in preset compliance quality detection strategies, performing compliance quality detection on the auditing results of the target auditing system on the auditing materials to obtain compliance quality detection results of the target auditing system on the rule level;
and according to a compliance quality detection strategy corresponding to the atomic capability level in preset compliance quality detection strategies, performing compliance quality detection on the auditing results of the target auditing system on the auditing materials to obtain the compliance quality detection result of the target auditing system on the atomic capability level.
Optionally, according to a compliance quality detection policy corresponding to a service level in preset compliance quality detection policies, performing compliance quality detection on the audit results of the target audit system on the multiple audit materials to obtain compliance quality detection results of the target audit system on the service level, including:
determining the number of audited passes and audited refuses of a plurality of audited materials on the service layer and the number of audited passes and audited refuses of a target auditing system on the service layer according to a compliance quality detection strategy corresponding to the service layer in preset compliance quality detection strategies;
and determining the compliance quality detection result of the target auditing system on the service level based on the number of auditions passed and the number of auditions rejected of the plurality of auditing materials on the service level and the number of auditions passed and rejected of the target auditing system on the service level.
The compliance quality detection based on the service level refers to performing compliance quality detection on an audit result of an audit material based on a service type to be matched with the audit material, for example, the service type to be matched with the audit material is an advertisement service, and only the audit material (such as pictures and texts) audited by a target audit system can be displayed on an advertisement position corresponding to the advertisement service. If the target auditing system determines that some false, exaggerated and other information is really involved in the auditing material or the auditing material contains some yellow storm pictures, the auditing result of the auditing material by the auditing system can be failed; otherwise, the auditing result of the auditing system to the auditing material is passed.
The method includes the steps of performing compliance quality detection on auditing results of a plurality of auditing materials by a target auditing system on a business level according to a preset compliance quality detection strategy, and specifically determining compliance quality detection results of the auditing results of the plurality of auditing materials by the target auditing system according to the preset compliance quality detection strategy on the business level to which the plurality of auditing materials are matched, for example, the plurality of auditing materials specifically correspond to 10 materials of an advertisement space, wherein the auditing results of 9 materials are accurate, and then determining compliance quality detection results of the auditing results of the plurality of auditing materials by the target auditing system from the business level: the accuracy was 0.9.
Optionally, performing compliance quality detection on the auditing results of the target auditing system on the multiple auditing materials according to a compliance quality detection policy corresponding to a rule level in preset compliance quality detection policies, to obtain compliance quality detection results of the target auditing system on the rule level, including:
determining the number of approved passes and approved rejections of a plurality of approved materials at the rule level and the number of approved passes and approved rejections of a target approval system for a plurality of approved materials at the rule level according to compliance quality detection strategies corresponding to the rule level in preset compliance quality detection strategies;
and determining the compliance quality detection result of the target auditing system on the rule level based on the number of auditions passed and the number of audition rejections of the target auditing system on the rule level to the plurality of audition materials and the number of audition passes and the number of audition rejections of the target auditing system on the rule level to the plurality of audition materials.
The compliance quality detection based on the rule level refers to compliance quality detection of an audit result of an audit material based on a rule, wherein the rule is based on further splitting of the service level. Taking the service type to be matched for examining the material as the advertisement service, there are many examination rules of the advertisement space corresponding to the advertisement service, for example, some rules for examining anti-riot vocabulary or rules for examining whether the picture is yellow-storm or not may be included. And the compliance quality detection based on the rule level is a rule triggered by each audit material in the audit process, and for each rule, the corresponding quantity of the audit material with accurate audit result and the corresponding quantity of the audit material with error audit are obtained. That is to say, for a certain rule a, the result of auditing the material by using the rule a is accurate and the number of errors is large, so that the compliance quality detection result corresponding to each rule is obtained.
Optionally, performing compliance quality detection on the auditing results of the target auditing system on multiple auditing materials according to a compliance quality detection policy corresponding to an atomic capability level in preset compliance quality detection policies, to obtain compliance quality detection results of the target auditing system on the atomic capability level, including:
determining the number of the auditions of the plurality of audited materials and the number of the audit rejections in the atomic energy level and the number of the auditions of the target auditing system in the atomic energy level according to the compliance quality detection strategy corresponding to the atomic energy level in the preset compliance quality detection strategies;
and determining the compliance quality detection result of the target auditing system on the atomic capability level based on the number of auditions passed and the number of auditions rejected of the plurality of auditing materials on the atomic capability level and the number of auditions passed and rejected of the target auditing system on the plurality of auditing materials on the atomic capability level.
The compliance quality detection based on the atomic capability level refers to compliance quality detection of the auditing result of the auditing material based on the atomic capability, and the atomic capability level is further split based on the rule level. Taking the service type matched with the audit material as the advertisement service as an example, the audit rules of the advertisement positions corresponding to the advertisement service are many, and one rule can be split into a plurality of atomic capabilities. For example, whether a picture contains anti-riot words or not can be checked, the picture needs to be recognized as characters through Optical Character Recognition (OCR), which is an atomic capability; and performing regular matching on the characters recognized by the OCR through a preset brute force vocabulary library, and determining whether the characters recognized by the OCR contain anti-brute force vocabulary, which is also an atomic capability, if so, indicating that the picture is at risk. Here, based on the audited material audited by each atomic capability, the number of audited correctness and the number of audited errors can be counted, and further the compliance quality detection result corresponding to each atomic capability can be obtained.
And S130, based on the compliance quality detection results of the target auditing system on the three specified levels, performing quality evaluation on the auditing results of the target auditing system on a plurality of auditing materials, and respectively obtaining auditing quality evaluation results corresponding to the target auditing system on the three specified levels.
Optionally, in this embodiment of the present specification, the audit quality evaluation results of the target audit system at the service level may be determined from the recall ratio and the precision ratio of the target audit system at the service level, and specifically, based on the compliance quality detection results of the target audit system at the specified three levels, the quality evaluation of the audit results of the target audit system on multiple audit materials is performed by the target audit system, so as to obtain corresponding audit quality evaluation results of the target audit system at the specified three levels, respectively, where the method includes:
determining the recall rate of the target auditing system on the business level based on the number of audited passes of the plurality of auditing materials on the business level and the number of audited passes of the target auditing system on the business level;
determining the precision ratio of the target auditing system on the service level based on the auditing reject number of the plurality of auditing materials on the service level and the auditing reject number of the target auditing system on the service level;
and determining the auditing quality evaluation result of the target auditing system on the service level based on the recall ratio and the precision ratio of the target auditing system on the service level.
The precision ratio refers to the ratio of the number of the audit materials judged to be risky to the number of the audit materials actually judged to be risky by the target audit system to judge that the audit materials are problematic.
Recall refers to the ratio of the number of non-risky pieces that the target audit system determines are audit material is non-problematic, i.e., the number of non-risky pieces that the target audit system determines is actually non-risky.
Optionally, in this embodiment of the present specification, the audit quality evaluation result of the target audit system at the rule level may be determined from the recall ratio and the precision ratio of the target audit system at the rule level, and specifically, the quality evaluation of the audit results of a plurality of audit materials by the target audit system may be performed based on the compliance quality detection results of the target audit system at the specified three levels, so as to obtain the corresponding audit quality evaluation results of the target audit system at the specified three levels, respectively, where the method includes:
determining the recall ratio of the target auditing system on the rule level based on the number of auditions of the plurality of auditing materials on the rule level and the number of auditions of the target auditing system on the plurality of auditing materials on the rule level;
determining the precision ratio of the target auditing system on the rule level based on the number of the auditing rejections of the multiple auditing materials on the rule level and the number of the auditing rejections of the target auditing system on the multiple auditing materials on the rule level;
and determining the auditing quality evaluation result of the target auditing system at the rule level based on the recall ratio and the precision ratio of the target auditing system at the rule level.
Optionally, in the embodiment of the present specification, the audit quality evaluation results of the target audit system at the atomic capability level may be determined from the recall ratio and the precision ratio of the target audit system at the atomic capability level, and specifically, the quality evaluation of the audit results of a plurality of audit materials by the target audit system may be performed based on compliance quality detection results of the target audit system at three designated levels, so as to obtain corresponding audit quality evaluation results of the target audit system at the three designated levels, respectively, where the method includes:
determining the recall rate of the target auditing system on the atomic capability level based on the number of auditions of the plurality of auditing materials on the atomic capability level and the number of auditions of the target auditing system on the plurality of auditing materials on the atomic capability level;
determining the precision ratio of the target auditing system on the atomic capability level based on the number of auditing rejections of the plurality of auditing materials on the atomic capability level and the number of auditing rejections of the target auditing system on the plurality of auditing materials on the atomic capability level;
and determining the auditing quality evaluation result of the target auditing system on the atomic capability level based on the recall ratio and precision ratio of the target auditing system on the atomic capability level.
Through the three specified levels, after the evaluation results of the target auditing system on the auditing quality of each level are determined, the recall ratio and precision ratio of the target auditing system on each level can be obtained, and 6 indexes can also be obtained, and the calculation logics of the 6 indexes are similar.
And S140, executing supervision processing operation matched with the auditing quality evaluation results corresponding to the three specified levels of the target auditing system.
If the corresponding auditing quality evaluation result of the target auditing system on any one of the three specified levels does not reach the preset threshold level, the quality abnormity alarm for auditing the auditing material by the target auditing system can be determined, and the level with abnormal quality is fed back.
When the auditing quality of the target auditing system is evaluated and supervised, the auditing results of the target auditing system for a plurality of auditing materials can be obtained; according to a preset compliance quality detection strategy, respectively carrying out compliance quality detection on the auditing results of a plurality of auditing materials of the target auditing system from three appointed layers to obtain compliance quality detection results of the target auditing system at the three appointed layers, wherein the three appointed layers comprise a service layer, a rule layer and an atomic capability layer; then, based on the compliance quality detection results of the target auditing system at three specified levels, performing quality evaluation on the auditing results of a plurality of auditing materials by the target auditing system to respectively obtain auditing quality evaluation results corresponding to the target auditing system at the three specified levels; and finally, executing supervision processing operation matched with the auditing quality evaluation results corresponding to the three specified levels of the target auditing system. Under the condition of determining the compliance of the audit result, the comprehensive quality evaluation of the audit result of the audit system from three levels of business, rule and atomic capability is realized, and the accuracy and efficiency of the quality evaluation are improved.
Fig. 2 is a schematic structural diagram of a supervision processing apparatus 200 based on audit quality evaluation according to one or more embodiments of the present specification, including:
the audit result obtaining module 210 is configured to obtain audit results of the target audit system on the plurality of audit materials;
the compliance quality detection module 220 is configured to perform compliance quality detection on the auditing results of the plurality of auditing materials by the target auditing system from three specified layers according to a preset compliance quality detection policy, so as to obtain compliance quality detection results of the target auditing system on the three specified layers, where the three specified layers include a service layer, a rule layer and an atomic capability layer;
the review quality evaluation module 230 is configured to perform quality evaluation on the review results of the target review system on the multiple review materials based on the compliance quality detection results of the target review system on the three designated levels, and obtain review quality evaluation results corresponding to the target review system on the three designated levels respectively;
and the supervision processing module 240 executes supervision processing operations matched with the auditing quality evaluation results of the target auditing system corresponding to the three specified levels.
Optionally, in an embodiment, the compliance quality detecting module 220 is configured to:
according to a compliance quality detection strategy corresponding to the service level in the preset compliance quality detection strategies, performing compliance quality detection on the auditing results of the target auditing system on the auditing materials to obtain compliance quality detection results of the target auditing system on the service level;
according to a compliance quality detection strategy corresponding to the rule level in the preset compliance quality detection strategies, performing compliance quality detection on the auditing results of the target auditing system on the auditing materials to obtain compliance quality detection results of the target auditing system on the rule level;
and performing compliance quality detection on the auditing results of the target auditing system on the plurality of auditing materials according to a compliance quality detection strategy corresponding to the atomic capability level in the preset compliance quality detection strategies to obtain the compliance quality detection result of the target auditing system on the atomic capability level.
Optionally, in an embodiment, the compliance quality detection module 220 is configured to:
determining the number of approved audits and the number of rejected audits of the plurality of audit materials on the business level and the number of approved audits and rejected audits of the target audit system on the business level according to the compliance quality detection strategy corresponding to the business level in the preset compliance quality detection strategies;
and determining the compliance quality detection result of the target auditing system on the service level based on the number of auditions passed and the number of auditions rejected of the plurality of auditing materials on the service level and the number of auditions passed and rejected of the target auditing system on the plurality of auditing materials on the service level.
Optionally, in an embodiment, the audit quality evaluation module 230 is configured to:
determining the recall rate of the target auditing system on the business level based on the number of audited passes of the plurality of auditing materials on the business level and the number of audited passes of the target auditing system on the plurality of auditing materials on the business level;
determining the precision ratio of the target auditing system on the service level based on the number of auditing rejects of the plurality of auditing materials on the service level and the number of auditing rejects of the target auditing system on the plurality of auditing materials on the service level;
and determining the auditing quality evaluation result of the target auditing system on the service level based on the recall ratio and the precision ratio of the target auditing system on the service level.
Optionally, in an embodiment, the compliance quality detection module 220 is configured to:
according to the compliance quality detection strategy corresponding to the rule level in the preset compliance quality detection strategies, determining the number of the auditions passed and the number of the auditions rejected of the plurality of audit materials at the rule level, and determining the number of the auditions passed and the number of the auditions rejected of the target audit system on the plurality of audit materials at the rule level;
and determining the compliance quality detection result of the target auditing system on the rule level based on the number of auditions passed and the number of auditions rejected of the plurality of auditing materials on the rule level and the number of auditions passed and rejected of the target auditing system on the plurality of auditing materials on the rule level.
Optionally, in an embodiment, the audit quality evaluation module 230 is configured to:
determining the recall rate of the target auditing system on the rule level based on the number of auditions passed by the rule level for the plurality of auditing materials and the number of auditions passed by the target auditing system on the rule level for the plurality of auditing materials;
determining the precision ratio of the target auditing system on the rule level based on the number of the auditing rejections of the rule level to the plurality of auditing materials and the number of the auditing rejections of the target auditing system on the rule level to the plurality of auditing materials;
and determining the auditing quality evaluation result of the target auditing system on the rule level based on the recall ratio and precision ratio of the target auditing system on the rule level.
Optionally, in an embodiment, the compliance quality detection module 220 is configured to:
determining the number of approved audits and the number of rejected audits of the plurality of approved materials in the atomic energy level and the number of approved audits and rejected audits of the target auditing system on the atomic energy level according to the compliance quality detection strategy corresponding to the atomic energy level in the preset compliance quality detection strategies;
and determining a compliance quality detection result of the target auditing system on the atomic capability level based on the number of audited passes and audited rejects of the plurality of auditing materials on the atomic capability level and the number of audited passes and audited rejects of the target auditing system on the atomic capability level.
Optionally, in an embodiment, the audit quality evaluation module 230 is configured to:
determining the recall rate of the target auditing system on the atomic capability level based on the number of auditions of the plurality of auditing materials on the atomic capability level and the number of auditions of the target auditing system on the plurality of auditing materials on the atomic capability level;
determining the precision ratio of the target auditing system on the atomic capability level based on the number of auditing rejections of the plurality of auditing materials on the atomic capability level and the number of auditing rejections of the target auditing system on the plurality of auditing materials on the atomic capability level;
and determining the auditing quality evaluation result of the target auditing system on the atomic capability level based on the recall ratio and the precision ratio of the target auditing system on the atomic capability level.
The supervision processing apparatus 200 based on the audit quality evaluation can implement the method in the embodiment of the method in fig. 1, and specifically refer to the method for protecting the private data in the embodiment shown in fig. 1, which is not described again.
Fig. 3 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure. Referring to fig. 3, at a hardware level, the electronic device includes a processor, and optionally further includes an internal bus, a network interface, and a memory. The Memory may include a Memory, such as a Random-Access Memory (RAM), and may further include a non-volatile Memory, such as at least 1 disk Memory. Of course, the electronic device may also include hardware required for other services.
The processor, the network interface, and the memory may be connected to each other via an internal bus, which may be an ISA (Industry Standard Architecture) bus, a PCI (Peripheral Component Interconnect) bus, an EISA (Extended Industry Standard Architecture) bus, or the like. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one double-headed arrow is shown in FIG. 3, but this does not indicate only one bus or one type of bus.
And the memory is used for storing programs. In particular, the program may include program code comprising computer operating instructions. The memory may include both memory and non-volatile storage and provides instructions and data to the processor.
And the processor reads the corresponding computer program from the nonvolatile memory into the memory and then runs the computer program to form a supervision processing device based on the audit quality evaluation on a logic level. The processor is used for executing the program stored in the memory and is specifically used for executing the following operations:
obtaining the auditing results of a target auditing system on a plurality of auditing materials;
according to a preset compliance quality detection strategy, respectively carrying out compliance quality detection on the auditing results of the plurality of auditing materials by the target auditing system from three appointed layers to obtain compliance quality detection results of the target auditing system on the three appointed layers, wherein the three appointed layers comprise a service layer, a rule layer and an atomic capability layer;
performing quality evaluation on the auditing results of the target auditing system on the plurality of auditing materials based on the compliance quality detection results of the target auditing system on the three appointed levels, and respectively obtaining auditing quality evaluation results corresponding to the target auditing system on the three appointed levels;
and executing supervision processing operation matched with the auditing quality evaluation results corresponding to the target auditing system on the three specified layers.
When the auditing quality of the target auditing system is evaluated and supervised, the auditing results of the target auditing system for a plurality of auditing materials can be obtained; according to a preset compliance quality detection strategy, respectively carrying out compliance quality detection on the auditing results of the target auditing system on a plurality of auditing materials from three appointed layers to obtain compliance quality detection results of the target auditing system on three appointed layers, wherein the three appointed layers comprise a service layer, a rule layer and an atomic capability layer; then, based on the compliance quality detection results of the target auditing system at the three specified levels, the quality of the auditing results of the target auditing system for the multiple auditing materials is evaluated, and the corresponding auditing quality evaluation results of the target auditing system at the three specified levels are respectively obtained; and finally, executing supervision processing operation matched with the corresponding audit quality evaluation results of the target audit system on the three specified layers. Under the condition of determining the compliance of the auditing result, the auditing result of the auditing system is comprehensively evaluated in multiple aspects from three levels of business, rule and atomic capability, and the accuracy and efficiency of quality evaluation are improved.
The method executed by the supervision processing device based on the audit quality evaluation as disclosed in the embodiment of fig. 1 of the present application may be applied to or implemented by a processor. The processor may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the above method may be performed by integrated logic circuits of hardware in a processor or instructions in the form of software. The Processor may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), and the like; but also Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components. The various methods, steps, and logic blocks disclosed in the embodiments of the present application may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in connection with the embodiments of the present application may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software module may be located in ram, flash memory, rom, prom, or eprom, registers, etc. storage media as is well known in the art. The storage medium is located in a memory, and a processor reads information in the memory and completes the steps of the method in combination with hardware of the processor.
The electronic device may further execute the method in fig. 1, and implement the function of the supervision processing apparatus based on the audit quality evaluation in the embodiment shown in fig. 1, which is not described herein again in this embodiment of the application.
Of course, besides the software implementation, the electronic device of the present application does not exclude other implementations, such as a logic device or a combination of software and hardware, and the like, that is, the execution subject of the following processing flow is not limited to each logic unit, and may also be hardware or a logic device.
Embodiments of the present application further propose a computer-readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a portable electronic device comprising a plurality of application programs, enable the portable electronic device to perform the method of the embodiment shown in fig. 3, and in particular to perform the following operations:
obtaining the auditing results of a target auditing system to a plurality of auditing materials;
according to a preset compliance quality detection strategy, respectively carrying out compliance quality detection on the auditing results of the plurality of auditing materials by the target auditing system from three appointed layers to obtain compliance quality detection results of the target auditing system on the three appointed layers, wherein the three appointed layers comprise a service layer, a rule layer and an atomic capability layer;
performing quality evaluation on the auditing results of the target auditing system on the multiple auditing materials based on the compliance quality detection results of the target auditing system on the three appointed levels, and respectively obtaining auditing quality evaluation results corresponding to the target auditing system on the three appointed levels;
and executing supervision processing operation matched with the auditing quality evaluation results of the target auditing system corresponding to the three specified layers.
Of course, besides the software implementation, the electronic device in this specification does not exclude other implementations, such as logic devices or a combination of software and hardware, and the like, that is, the execution subject of the following processing flow is not limited to each logic unit, and may also be hardware or logic devices.
The foregoing description has been directed to specific embodiments of this disclosure. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims may be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing may also be possible or may be advantageous.
In short, the above description is only a preferred embodiment of the present application, and is not intended to limit the scope of the present application. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application.
The systems, apparatuses, modules or units described in the above embodiments may be specifically implemented by a computer chip or an entity, or implemented by a product with certain functions. One typical implementation device is a computer. In particular, the computer may be, for example, a personal computer, a laptop computer, a cellular telephone, a camera phone, a smartphone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in the process, method, article, or apparatus that comprises the element.
The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the system embodiment, since it is substantially similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment.
Claims (11)
1. A supervision processing method based on audit quality evaluation comprises the following steps:
obtaining the auditing results of a target auditing system on a plurality of auditing materials;
according to a preset compliance quality detection strategy, respectively carrying out compliance quality detection on the auditing results of the plurality of auditing materials by the target auditing system from three appointed layers to obtain compliance quality detection results of the target auditing system on the three appointed layers, wherein the three appointed layers comprise a service layer, a rule layer and an atomic capability layer; the compliance quality detection based on the service level is based on the service type matched by the auditing material, and the auditing result of the auditing material is subjected to compliance quality detection; the compliance quality detection based on the rule level is the auditing result of the auditing material based on the rule, and the compliance quality detection is carried out, wherein the rule level is based on the further splitting of the service level; the compliance quality detection based on the atomic capability level is the auditing result of the auditing material based on the atomic capability, and the compliance quality detection is carried out, wherein the atomic capability level is further split based on the rule level;
performing quality evaluation on the auditing results of the target auditing system on the plurality of auditing materials based on the compliance quality detection results of the target auditing system on the three appointed levels, and respectively obtaining auditing quality evaluation results corresponding to the target auditing system on the three appointed levels;
and executing supervision processing operation matched with the auditing quality evaluation results of the target auditing system corresponding to the three specified layers.
2. The method of claim 1, wherein performing compliance quality detection on the auditing results of the plurality of auditing materials by the target auditing system from three specified levels according to a preset compliance quality detection policy to obtain compliance quality detection results of the target auditing system at the three specified levels comprises:
according to a compliance quality detection strategy corresponding to the service level in the preset compliance quality detection strategies, performing compliance quality detection on the auditing results of the target auditing system on the auditing materials to obtain compliance quality detection results of the target auditing system on the service level;
according to a compliance quality detection strategy corresponding to the rule level in the preset compliance quality detection strategies, performing compliance quality detection on the auditing results of the target auditing system on the auditing materials to obtain compliance quality detection results of the target auditing system on the rule level;
and according to a compliance quality detection strategy corresponding to the atomic capability level in the preset compliance quality detection strategies, performing compliance quality detection on the auditing results of the target auditing system on the auditing materials to obtain the compliance quality detection result of the target auditing system on the atomic capability level.
3. The method of claim 2, wherein performing compliance quality detection on the auditing results of the target auditing system for the multiple auditing materials according to a compliance quality detection policy corresponding to the service level in the preset compliance quality detection policies to obtain a compliance quality detection result of the target auditing system on the service level comprises:
according to the compliance quality detection strategy corresponding to the service level in the preset compliance quality detection strategies, determining the number of approved passes and the number of approved refusals of the plurality of audit materials on the service level and determining the number of approved passes and the number of approved refusals of the target audit system facing the plurality of audit materials on the service level;
and determining the compliance quality detection result of the target auditing system on the service level based on the number of auditions passed and the number of auditions rejected of the plurality of auditing materials on the service level and the number of auditions passed and rejected of the target auditing system on the plurality of auditing materials on the service level.
4. The method according to claim 1, wherein performing quality evaluation on the audit results of the target audit system on the plurality of audit materials based on the compliance quality detection results of the target audit system at the three specified levels, to respectively obtain the audit quality evaluation results corresponding to the target audit system at the three specified levels, includes:
determining the recall rate of the target auditing system on the business level based on the number of audited passes of the plurality of auditing materials on the business level and the number of audited passes of the target auditing system on the plurality of auditing materials on the business level;
determining the precision ratio of the target auditing system on the service level based on the number of auditing rejects of the plurality of auditing materials on the service level and the number of auditing rejects of the target auditing system on the plurality of auditing materials on the service level;
and determining the auditing quality evaluation result of the target auditing system on the service level based on the recall ratio and the precision ratio of the target auditing system on the service level.
5. The method of claim 2, wherein performing compliance quality detection on the audit results of the target audit system on the plurality of audit materials according to a compliance quality detection policy corresponding to the rule level in the preset compliance quality detection policies to obtain a compliance quality detection result of the target audit system on the rule level includes:
according to the compliance quality detection strategy corresponding to the rule level in the preset compliance quality detection strategies, determining the number of approved passes and approved rejections of the multiple audit materials at the rule level and the number of approved passes and approved rejections of the multiple audit materials at the rule level by the target audit system;
and determining the compliance quality detection result of the target auditing system on the rule level based on the number of auditions passed and the number of auditions rejected of the plurality of auditing materials on the rule level and the number of auditions passed and rejected of the target auditing system on the plurality of auditing materials on the rule level.
6. The method of claim 5, wherein performing quality evaluation on the audit results of the target audit system on the plurality of audit materials based on the compliance quality detection results of the target audit system at the three specified levels to obtain corresponding audit quality evaluation results of the target audit system at the three specified levels respectively comprises:
determining the recall rate of the target auditing system on the rule level based on the number of auditions passed by the rule level for the plurality of auditing materials and the number of auditions passed by the target auditing system on the rule level for the plurality of auditing materials;
determining the precision ratio of the target auditing system on the rule level based on the number of the auditing rejections of the rule level to the plurality of auditing materials and the number of the auditing rejections of the target auditing system on the rule level to the plurality of auditing materials;
and determining the auditing quality evaluation result of the target auditing system on the rule level based on the recall ratio and the precision ratio of the target auditing system on the rule level.
7. The method of claim 2, wherein performing compliance quality detection on the audit results of the target audit system on the plurality of audit materials according to a compliance quality detection policy corresponding to the atomic capability level in the preset compliance quality detection policies to obtain a compliance quality detection result of the target audit system on the atomic capability level includes:
determining the number of approved audits and the number of rejected audits of the plurality of approved materials in the atomic energy level and the number of approved audits and rejected audits of the target auditing system on the atomic energy level according to the compliance quality detection strategy corresponding to the atomic energy level in the preset compliance quality detection strategies;
and determining the compliance quality detection result of the target auditing system on the atomic capability level based on the number of auditions passed and the number of auditions rejected of the plurality of auditing materials on the atomic capability level and the number of auditions passed and rejected of the target auditing system on the plurality of auditing materials on the atomic capability level.
8. The method of claim 7, wherein performing quality evaluation on the audit results of the target audit system on the plurality of audit materials based on the compliance quality detection results of the target audit system at the three specified levels to obtain corresponding audit quality evaluation results of the target audit system at the three specified levels respectively comprises:
determining the recall rate of the target auditing system on the atomic capability level based on the number of audited materials which are audited and passed on the atomic capability level and the number of audited materials which are audited and passed on the atomic capability level by the target auditing system;
determining the precision ratio of the target auditing system on the atomic capability level based on the number of auditing rejections of the plurality of auditing materials on the atomic capability level and the number of auditing rejections of the target auditing system on the plurality of auditing materials on the atomic capability level;
and determining the auditing quality evaluation result of the target auditing system on the atomic capability level based on the recall ratio and precision ratio of the target auditing system on the atomic capability level.
9. A regulatory processing apparatus based on audit quality assessment, comprising:
the auditing result acquisition module is used for acquiring auditing results of a target auditing system on a plurality of auditing materials;
the compliance quality detection module is used for respectively carrying out compliance quality detection on the auditing results of the plurality of auditing materials from the appointed three layers to the target auditing system according to a preset compliance quality detection strategy to obtain compliance quality detection results of the target auditing system on the appointed three layers, wherein the appointed three layers comprise a service layer, a rule layer and an atomic capability layer; the compliance quality detection based on the service level is based on the service type matched by the auditing material, and the auditing result of the auditing material is subjected to compliance quality detection; the compliance quality detection based on the rule level is the auditing result of the auditing material based on the rule, and the compliance quality detection is carried out, wherein the rule level is based on the further splitting of the service level; the compliance quality detection based on the atomic capability level is the auditing result of the auditing material based on the atomic capability, and the compliance quality detection is carried out, wherein the atomic capability level is further split based on the rule level;
the auditing quality evaluation module is used for evaluating the auditing results of the target auditing system on the plurality of auditing materials based on the compliance quality detection results of the target auditing system on the three specified levels, and respectively obtaining the auditing quality evaluation results corresponding to the target auditing system on the three specified levels;
and the supervision processing module executes supervision processing operation matched with the auditing quality evaluation results of the target auditing system corresponding to the three specified layers.
10. An electronic device, comprising:
a processor; and
a memory arranged to store computer executable instructions that, when executed, cause the processor to:
obtaining the auditing results of a target auditing system on a plurality of auditing materials;
according to a preset compliance quality detection strategy, respectively carrying out compliance quality detection on the auditing results of the plurality of auditing materials by the target auditing system from three appointed layers to obtain compliance quality detection results of the target auditing system on the three appointed layers, wherein the three appointed layers comprise a service layer, a rule layer and an atomic capability layer; the compliance quality detection based on the service level is based on the service type matched by the auditing material, and the auditing result of the auditing material is subjected to compliance quality detection; the compliance quality detection based on the rule level is the auditing result of the auditing material based on the rule, and the compliance quality detection is carried out, wherein the rule level is based on the further splitting of the service level; the compliance quality detection based on the atomic capability level is the auditing result of the auditing material based on the atomic capability, and the compliance quality detection is carried out, wherein the atomic capability level is further split based on the rule level;
performing quality evaluation on the auditing results of the target auditing system on the plurality of auditing materials based on the compliance quality detection results of the target auditing system on the three appointed levels, and respectively obtaining auditing quality evaluation results corresponding to the target auditing system on the three appointed levels;
and executing supervision processing operation matched with the auditing quality evaluation results of the target auditing system corresponding to the three specified layers.
11. A computer-readable storage medium storing one or more programs that, when executed by an electronic device including a plurality of application programs, cause the electronic device to:
obtaining the auditing results of a target auditing system on a plurality of auditing materials;
according to a preset compliance quality detection strategy, respectively carrying out compliance quality detection on the auditing results of the plurality of auditing materials by the target auditing system from three appointed layers to obtain compliance quality detection results of the target auditing system on the three appointed layers, wherein the three appointed layers comprise a service layer, a rule layer and an atomic capability layer; the compliance quality detection based on the service level is based on the service type matched by the auditing material, and the auditing result of the auditing material is subjected to compliance quality detection; the compliance quality detection based on the rule level is the auditing result of the auditing material based on the rule, and the compliance quality detection is carried out, wherein the rule level is based on the further splitting of the service level; the compliance quality detection based on the atomic capability level is the auditing result of the auditing material based on the atomic capability, and the compliance quality detection is carried out, wherein the atomic capability level is further split based on the rule level;
performing quality evaluation on the auditing results of the target auditing system on the plurality of auditing materials based on the compliance quality detection results of the target auditing system on the three appointed levels, and respectively obtaining auditing quality evaluation results corresponding to the target auditing system on the three appointed levels;
and executing supervision processing operation matched with the auditing quality evaluation results of the target auditing system corresponding to the three specified layers.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010936401.3A CN112183951B (en) | 2020-09-08 | 2020-09-08 | Supervision processing method and device based on audit quality evaluation |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010936401.3A CN112183951B (en) | 2020-09-08 | 2020-09-08 | Supervision processing method and device based on audit quality evaluation |
Publications (2)
Publication Number | Publication Date |
---|---|
CN112183951A CN112183951A (en) | 2021-01-05 |
CN112183951B true CN112183951B (en) | 2022-09-02 |
Family
ID=73924469
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202010936401.3A Active CN112183951B (en) | 2020-09-08 | 2020-09-08 | Supervision processing method and device based on audit quality evaluation |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN112183951B (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116307948A (en) * | 2023-05-23 | 2023-06-23 | 飞狐信息技术(天津)有限公司 | Method, device, equipment and storage medium for detecting auditing quality |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101035281A (en) * | 2007-04-19 | 2007-09-12 | 鲍东山 | Classified content auditing system |
WO2017080168A1 (en) * | 2015-11-13 | 2017-05-18 | 乐视控股(北京)有限公司 | Video reviewing method and system |
CN110225373A (en) * | 2019-06-13 | 2019-09-10 | 腾讯科技(深圳)有限公司 | A kind of video reviewing method, device and electronic equipment |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101753350A (en) * | 2008-12-10 | 2010-06-23 | 北大方正集团有限公司 | Signal auditing method, device and system |
US9922257B2 (en) * | 2014-09-29 | 2018-03-20 | Glimpse Group Llc | Image auditing method and system |
CN109151499A (en) * | 2018-09-26 | 2019-01-04 | 央视国际网络无锡有限公司 | Video reviewing method and device |
CN109766807A (en) * | 2018-12-28 | 2019-05-17 | 广州华多网络科技有限公司 | Machine audits processing method, device, electronic equipment and storage medium |
CN110362777A (en) * | 2019-07-25 | 2019-10-22 | 焦点科技股份有限公司 | A kind of picture examination method and system of multi-information fusion |
CN110418161A (en) * | 2019-08-02 | 2019-11-05 | 广州虎牙科技有限公司 | Video reviewing method and device, electronic equipment and readable storage medium storing program for executing |
CN111382291B (en) * | 2020-03-12 | 2023-05-23 | 北京金山云网络技术有限公司 | Machine auditing method and device and machine auditing server |
-
2020
- 2020-09-08 CN CN202010936401.3A patent/CN112183951B/en active Active
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101035281A (en) * | 2007-04-19 | 2007-09-12 | 鲍东山 | Classified content auditing system |
WO2017080168A1 (en) * | 2015-11-13 | 2017-05-18 | 乐视控股(北京)有限公司 | Video reviewing method and system |
CN110225373A (en) * | 2019-06-13 | 2019-09-10 | 腾讯科技(深圳)有限公司 | A kind of video reviewing method, device and electronic equipment |
Also Published As
Publication number | Publication date |
---|---|
CN112183951A (en) | 2021-01-05 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN108763952B (en) | Data classification method and device and electronic equipment | |
CN109190539B (en) | Face recognition method and device | |
CN110956275B (en) | Risk prediction and risk prediction model training method and device and electronic equipment | |
CN109086975B (en) | Transaction risk identification method and device | |
CN108399482B (en) | Contract evaluation method and device and electronic equipment | |
CN110334013B (en) | Decision engine testing method and device and electronic equipment | |
CN109299276B (en) | Method and device for converting text into word embedding and text classification | |
CN112215230B (en) | Information auditing method and device and electronic equipment | |
WO2020108113A1 (en) | Evidence collection and recording method and apparatus, and electronic device | |
CN112184143B (en) | Model training method, device and equipment in compliance audit rule | |
CN111488289A (en) | Fault positioning method, device and equipment | |
CN112183951B (en) | Supervision processing method and device based on audit quality evaluation | |
CN109271453B (en) | Method and device for determining database capacity | |
CN115952162A (en) | Data quality checking method, device and equipment | |
CN109062793B (en) | Test method and device of roller control and electronic equipment | |
CN113743618A (en) | Time series data processing method and device, readable medium and electronic equipment | |
CN111080309B (en) | Data processing method, device and equipment for multiple objects or multiple models | |
CN110163470B (en) | Event evaluation method and device | |
CN109740336B (en) | Method and device for identifying verification information in picture and electronic equipment | |
CN108388982B (en) | Task running method and device and electronic equipment | |
CN109145821B (en) | Method and device for positioning pupil image in human eye image | |
CN111277465A (en) | Abnormal data message detection method and device and electronic equipment | |
CN113283978B (en) | Financial risk assessment method based on biological basis, behavioral characteristics and business characteristics | |
CN107369093B (en) | Service determination method and device | |
CN111143203B (en) | Machine learning method, privacy code determination method, device and electronic equipment |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |