CN104022899A - Three-dimensional assessment method for network management system and system - Google Patents

Three-dimensional assessment method for network management system and system Download PDF

Info

Publication number
CN104022899A
CN104022899A CN201410231273.7A CN201410231273A CN104022899A CN 104022899 A CN104022899 A CN 104022899A CN 201410231273 A CN201410231273 A CN 201410231273A CN 104022899 A CN104022899 A CN 104022899A
Authority
CN
China
Prior art keywords
assessment
index
management system
network
network management
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201410231273.7A
Other languages
Chinese (zh)
Inventor
徐菲
陈小军
时金桥
文新
胡兰兰
谭庆丰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Institute of Information Engineering of CAS
Original Assignee
Institute of Information Engineering of CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Institute of Information Engineering of CAS filed Critical Institute of Information Engineering of CAS
Priority to CN201410231273.7A priority Critical patent/CN104022899A/en
Publication of CN104022899A publication Critical patent/CN104022899A/en
Pending legal-status Critical Current

Links

Landscapes

  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

The invention relates to a three-dimensional assessment method for a network management system. The method comprises steps: the current network state and the management system demands are analyzed; a dynamic configurable assessment model index system is built according to the former analysis result; the assessment model is adopted for carrying out simulated assessment on the assessed management system; if the simulated assessment passes, the management system is deployed; if the simulated assessment does not pass, the assessment model is corrected again; after the management system is deployed, practice assessment is carried out on the assessed management system; if the practice assessment does not pass, the assessment model is corrected again; and if the practice assessment passes, the assessment result is obtained, influences on all entities in the network after the management system is deployed can be given, and suggestions on deployment method improvement are provided. The prior network management system is assessed comprehensively, defects are found out, a scientific and effective deployment rectification opinion is put forward, the method can handle a large amount of network equipment assessment, and the assessment method is high in flexibility and expansibility.

Description

A kind of three-dimensional assessment method and system of network management system
Technical field
The present invention relates to computer network security field, relate in particular to a kind of three-dimensional assessment method and system of network management system.
Background technology
Existing network management system, cannot tackle the new challenge that network application widely and Internet Services management bring, and the network security management of specific region is existed obviously not enough.If existing network management system is when providing normal function, often sacrifice a part of network performance; Management system may surprisingly stop normal service, or thinks that Yi Ge domestic consumer is malicious user by mistake.
How to find out the defect of network management system existence and propose scientific and effective deployment reform advice, needing assessment models to assess network management system.But because network management system need to be carried out many management roles and a large amount of network equipments of management, existing assessment models is not enough to deal with its heavy workload, and existing network management system evaluation model underaction, and autgmentability is not strong.
Summary of the invention
Technical problem to be solved by this invention is for the deficiencies in the prior art, and a kind of three-dimensional assessment method and system of network management system are provided.
The technical scheme that the present invention solves the problems of the technologies described above is as follows: a kind of three-dimensional assessment method of network management system, comprises the steps:
Step 1: the demand to current network condition and management system is analyzed;
Step 2: according to analysis result above, build the assessment models index system of capable of dynamic configuration;
Step 3: adopt assessment models to simulate assessment to the management system that will assess;
Step 4: if simulation assessment is passed through, dispose this management system, execution step 5; If simulation assessment is not passed through, assessment models is revised, return to step 3;
Step 5: after management system is disposed, it is put into practice to assessment, if practice assessment is not passed through, assessment models is revised, re-start practice assessment, until practice assessment is passed through, finish estimation flow; If practice assessment is passed through, draw assessment result, and the impact on each side's entity in network after providing this management system and disposing, the suggestion that improves dispositions method is provided.
The invention has the beneficial effects as follows: the present invention can comprehensively assess existing network management system, find out the defect wherein existing and propose scientific and effective deployment reform advice, can also deal with the evaluation quantity of a large amount of network equipments, this appraisal procedure has the autgmentability of very strong flexibility and height in addition.
On the basis of technique scheme, the present invention can also do following improvement.
Further, described in step 2, build the concrete steps of assessment models index system of capable of dynamic configuration as follows:
Step 2.1.1: from cost, impact and three preliminary index for selection of different dimensions of effect, and carry out modeling from three dimensions;
Step 2.1.2: the index of choosing is screened to structuring;
Step 2.1.3: the structurized index of screening is carried out to criterion and quantity;
Step 2.1.4: the index of criterion and quantity is carried out to weights and determine;
Step 2.1.5: the index of determining weights is carried out to the gathering of many indexs;
Step 2.1.6: the index that many indexs are assembled is carried out index comprehensive analysis, obtains assessment models index system.
Further, the specific implementation that described in described step 2.1.1, index is tentatively chosen is: the common index of research network evaluation, feature for network evaluation, for proposing index, network evaluation chooses universal model, and carry out modeling from cost, impact and three different dimensions of effect, the index of different dimensions is relatively independent.
Further, the structurized specific implementation of index screening described in described step 2.1.2 is: by theory analysis and experiment relatively, find interdepending and interactional degree between index, carry out that index is subdued, de-redundancy.
Further, described in described step 2.1.3, the specific implementation of index criterion and quantity is: for measurability demand, research index qualitative, quantitatively calculate standard, and set up corresponding quantization method.
Further, the definite specific implementation of index weight value described in described step 2.1.4 is: real-time and rational requirement for network management system, utilize Hierarchy Analysis Method, and in conjunction with qualitative analysis and quantitative analysis, index weight value is determined.
Further, the specific implementation that described in described step 2.1.5, many indexs are assembled is: for the network management system demand under different times, varying environment, the aggregation algorithms of different indexs is chosen.
Further, described in described step 2.1.6, the specific implementation of index comprehensive analysis is: each index is carried out to association analysis, and the defect of discovering network management system and the problem of existence, provide assessment result.
Another technical scheme that the present invention solves the problems of the technologies described above is as follows: a kind of three-dimensional assessment system of network management system, comprises information acquisition module, model building module, simulation evaluation module and put into practice evaluation module;
Described information acquisition module, its demand for the network condition to current and management system are analyzed;
Described model building module, it builds the assessment models index system of capable of dynamic configuration for basis analysis result above;
Described simulation evaluation module, it if simulation assessment is passed through, disposes this management system for adopting assessment models to simulate assessment to the management system that will assess; If simulation assessment is not passed through, assessment models is revised, re-start simulation assessment;
The described evaluation module of putting into practice, it,, for after disposing in management system, puts into practice assessment to the management system that will assess, if practice assessment is not passed through, assessment models is revised, and re-starts practice assessment, until practice assessment is passed through, finishes estimation flow; If practice assessment is passed through, draw assessment result, and the impact on each side's entity in network after providing this management system and disposing, the suggestion that improves dispositions method is provided.
On the basis of technique scheme, the present invention can also do following improvement.
Further, described model building module comprises that index tentatively chooses unit, index screening structuring unit, quantification of targets unit, weights determining unit, many indexs accumulation unit and index comprehensive analytic unit;
Described index is tentatively chosen unit, it for the feature of network evaluation, chooses universal model for network evaluation proposes index for studying the common index of network evaluation, and carry out modeling from cost, impact and three different dimensions of effect, the index of different dimensions is relatively independent;
Described index screening structuring unit, it,, for by theory analysis and experiment relatively, finds interdepending and interactional degree between index, carries out that index is subdued, de-redundancy;
Described quantification of targets unit, it is for for measurability demand, research index qualitative, quantitatively calculate standard, and set up corresponding quantization method;
Described weights determining unit, it,, for the real-time for network management system and rational requirement, utilizes Hierarchy Analysis Method, in conjunction with qualitative analysis and quantitative analysis, index weight value is determined;
Described many indexs accumulation unit, it,, for the network management system demand under different times, varying environment, is chosen the aggregation algorithms of different indexs;
Described index comprehensive analytic unit, it is for many indexes is carried out to association analysis, and the defect of discovering network management system and the problem of existence, provide assessment result.
Accompanying drawing explanation
Fig. 1 is the three-dimensional assessment method flow diagram of a kind of network management system of the present invention;
Fig. 2 is the three-dimensional assessment system block diagram of a kind of network management system of the present invention;
Fig. 3 is the structured flowchart of model building module of the present invention.
In accompanying drawing, the list of parts of each label representative is as follows:
1, information acquisition module, 2, model building module, 3, simulation evaluation module, 4, put into practice evaluation module, 2-1, index are tentatively chosen unit, 2-2, index screening structuring unit, 2-3, quantification of targets unit, 2-4, weights determining unit, 2-5, many indexs accumulation unit, 2-6, index comprehensive analytic unit.
Embodiment
Below in conjunction with accompanying drawing, principle of the present invention and feature are described, example, only for explaining the present invention, is not intended to limit scope of the present invention.
As shown in Figure 1, a kind of three-dimensional assessment method of network management system, comprises the steps:
Step 1: the demand to current network condition and management system is analyzed;
Step 2: according to analysis result above, build the assessment models index system of capable of dynamic configuration;
Step 3: adopt assessment models to simulate assessment to the management system that will assess;
Step 4: if simulation assessment is passed through, dispose this management system, execution step 5; If simulation assessment is not passed through, assessment models is revised, return to step 3;
Step 5: after management system is disposed, it is put into practice to assessment, if practice assessment is not passed through, assessment models is revised, re-start practice assessment, until practice assessment is passed through, finish estimation flow; If practice assessment is passed through, draw assessment result, and the impact on each side's entity in network after providing this management system and disposing, the suggestion that improves dispositions method is provided.
The concrete steps of assessment models index system that build capable of dynamic configuration described in step 2 are as follows:
Step 2.1.1: from cost, impact and three preliminary index for selection of different dimensions of effect, and carry out modeling from three dimensions;
Step 2.1.2: the index of choosing is screened to structuring;
Step 2.1.3: the structurized index of screening is carried out to criterion and quantity;
Step 2.1.4: the index of criterion and quantity is carried out to weights and determine;
Step 2.1.5: the index of determining weights is carried out to the gathering of many indexs;
Step 2.1.6: the index that many indexs are assembled is carried out index comprehensive analysis, obtains assessment models index system.
The specific implementation that described in described step 2.1.1, index is tentatively chosen is: the common index of research network evaluation, feature for network evaluation, for proposing index, network evaluation chooses universal model, and carry out modeling from cost, impact and three different dimensions of effect, the index of different dimensions is relatively independent.
The structurized specific implementation of index screening described in described step 2.1.2 is: by theory analysis and experiment relatively, find interdepending and interactional degree between index, carry out that index is subdued, de-redundancy.
Described in described step 2.1.3, the specific implementation of index criterion and quantity is: for measurability demand, research index qualitative, quantitatively calculate standard, and set up corresponding quantization method.
The definite specific implementation of index weight value described in described step 2.1.4 is: real-time and rational requirement for network management system, utilize Hierarchy Analysis Method, and in conjunction with qualitative analysis and quantitative analysis, index weight value is determined.
The specific implementation that described in described step 2.1.5, many indexs are assembled is: for the network management system demand under different times, varying environment, the aggregation algorithms of different indexs is chosen.
Described in described step 2.1.6, the specific implementation of index comprehensive analysis is: each index is carried out to association analysis, and the defect of discovering network management system and the problem of existence, provide assessment result.
As shown in Figure 2, a kind of three-dimensional assessment system of network management system, comprises information acquisition module 1, model building module 2, simulation evaluation module 3 and puts into practice evaluation module 4;
Described information acquisition module 1, its demand for the network condition to current and management system are analyzed;
Described model building module 2, it builds the assessment models index system of capable of dynamic configuration for basis analysis result above;
Described simulation evaluation module, it if simulation assessment is passed through, disposes this management system for adopting assessment models to simulate assessment to the management system that will assess; If simulation assessment is not passed through, assessment models is revised, re-start simulation assessment;
The described evaluation module of putting into practice, it,, for after disposing in management system, puts into practice assessment to the management system that will assess, if practice assessment is not passed through, assessment models is revised, and re-starts practice assessment, until practice assessment is passed through, finishes estimation flow; If practice assessment is passed through, draw assessment result, and the impact on each side's entity in network after providing this management system and disposing, the suggestion that improves dispositions method is provided.
Described model building module 2 comprises that index tentatively chooses unit 2-1, index screening structuring unit 2-2, quantification of targets unit 2-3, weights determining unit 2-4, many indexs accumulation unit 2-5 and index comprehensive analytic unit 2-6;
Described index is tentatively chosen unit 2-1, it for the feature of network evaluation, chooses universal model for network evaluation proposes index for studying the common index of network evaluation, and carry out modeling from cost, impact and three different dimensions of effect, the index of different dimensions is relatively independent;
Described index screening structuring unit 2-2, it,, for by theory analysis and experiment relatively, finds interdepending and interactional degree between index, carries out that index is subdued, de-redundancy;
Described quantification of targets unit 2-3, it is for for measurability demand, research index qualitative, quantitatively calculate standard, and set up corresponding quantization method;
Described weights determining unit 2-4, it,, for the real-time for network management system and rational requirement, utilizes Hierarchy Analysis Method, in conjunction with qualitative analysis and quantitative analysis, index weight value is determined;
Described many indexs accumulation unit 2-5, it,, for the network management system demand under different times, varying environment, is chosen the aggregation algorithms of different indexs;
Described index comprehensive analytic unit 2-6, it is for many indexes is carried out to association analysis, and the defect of discovering network management system and the problem of existence, provide assessment result.
Assessment models of the present invention is from effect, cost and affect three different dimensions management system is assessed, and each dimension is consisted of comprehensive, multi-level assessment models index system, three dimensions not only independently of one another but also connect each other, model completes the total evaluation to management system by the comprehensive assessment three dimensions, and provide assessment result and assess suggestion, the necessity that system is disposed and the deployment way of system.
Described assessment models comprises effect, impact, three dimensions of cost, utilize the index system of different levels to analyze quantification, reach various dimensions, in all directions, multi-level evaluation index system, meet the requirements such as reasonability, completeness, independence and measurability of specific region network management system evaluation index.
Assessment models index system of the present invention, the assessment of described effect dimension is correctness and the validity of management system, when there is network management requirement, it is generation strategy effectively processing in time, mainly from reliability, function and three aspects of performance, assesses.
Assessment models index system of the present invention, the described assessment that affects dimension evaluates from the angle of network in user, service and territory the impact that the deployment of network management system brings, and comprises positive influences and negative effect.
Assessment models index system of the present invention, the assessment reflection network management system of described cost dimension is to reach the required cost of paying of certain management effect, be divided into technology cost and non-technology cost two parts, technology cost refers to the network bandwidth, calculating, address resource etc., and non-technology cost refers to personnel, time etc.
The present invention illustrates the application process of this three-dimensional assessment method for network management system by an instantiation.In this example, there is a company to prepare to introduce large-scale video conferencing system, but do not know that can current network management system load introduce the demand after video conferencing system, whether network need to be upgraded and change management system, the network system of the said firm is carried out to three-dimensional assessment of the present invention, and flow process is as follows:
(1) first measure the network condition of the said firm, describe the essential characteristic that has network;
(2) again in conjunction with the regulatory requirement of introducing after video conference, clear and definite network management objective is proposed;
(3) choose appropriate indicator evaluation system, from cost, impact, three aspects of effect, carry out modeling, choose the evaluation index needing;
In this example, the evaluation index that we choose is as follows:
1. in recruitment evaluation dimension, the reliability assessment of choosing comprises availability, stability, maintainability etc.; The functional assessment of choosing comprises the rate of improving, coverage rate, accuracy rate, management capacity etc.; The Performance Evaluation of choosing comprises policy conflict, mismatch ratio, equipment delay, matching times, maximum rule etc.
2. in impact evaluation dimension, positive influences and negative effect that the evaluation index of choosing is brought from the deployment of the angle assessment network management system of network in user perspective, service angle and territory respectively.
3. in cost evaluation dimension, the technology cost evaluation of choosing is network bandwidth input, computational resource, address resource etc., and non-technology cost evaluation is human input, time input, equipment investment etc.
Then each leading indicator in assessment models has all been carried out to rational criterion and quantity, the accuracy rate of take is here briefly described as example.
Accuracy rate refers to the degree of closeness between testing result and truth, and accuracy can be weighed by rate of false alarm, and rate of false alarm can be used for weighing under certain parameter arranges, the error probability of analyzing for mass data.Rate of false alarm is higher, and accuracy is lower.Rate of false alarm percentage P errothe times N of common available predictions failure failwith altogether predict times N sumratio value representation: P erro=N fail/ N sum.Accuracy percentage can be expressed as:
P accuracy=1-P erro=1-N fail/N sum
Accuracy i.e. the order of accuarcy to invalid information and behavior detection and processing, wrong report is about to legal information and behavior is mistaken for illegal and shields and block, make validated user can not obtain normal service and information, cause proper network service disruption, affect the availability of network.Therefore the rate of false alarm for a certain class user's service can represent:
P erro'=P e_user+P e_serve+P e_process
Wherein, P e_userthe probability of miscarriage of justice of expression to user, P e_servethe probability of miscarriage of justice of expression to Service Source, P e_processrepresent the probability that mistake is processed, comprise that blocking-up user obtains the probability of normal service and the probability that shielding server provides legal Service Source.Whole rate of false alarm can be expressed as:
P e _ sum = E ( P erro ) = Σ i P ei × p i
Wherein, P eithe rate of false alarm that represents a certain class user's service, p irepresenting the probability that this class service request occurs, is long-pending the adding up that the user that may occur in network serves rate of false alarm and its probability of occurrence.The average rate of false alarm that accuracy can obtain by analysis to measure represents, that is:
P accuracy = 1 - P e _ sum ‾ = 1 - E ( P erro ) ‾ .
Other index all, according to carrying out above criterion and quantity, finally draws the Three-dimensional Evaluation Model of this management system.
According to management system assessment models, analyze theoretically the regulatory requirement that can the new network management system proposing meet large-scale video conference.
Then use the existing management system of three-dimensional assessment method simulation assessment the said firm establishing, obtain a result and meet the demand of introducing large-scale video conference, dispose this system.
After disposing new management system and video conferencing system, proceed practice assessment, the demand before the new management system of obtaining a result meets.
The foregoing is only preferred embodiment of the present invention, in order to limit the present invention, within the spirit and principles in the present invention not all, any modification of doing, be equal to replacement, improvement etc., within all should being included in protection scope of the present invention.

Claims (10)

1. a three-dimensional assessment method for network management system, is characterized in that, comprises the steps:
Step 1: the demand to current network condition and management system is analyzed;
Step 2: according to analysis result above, build the assessment models index system of capable of dynamic configuration;
Step 3: adopt assessment models to simulate assessment to the management system that will assess;
Step 4: if simulation assessment is passed through, dispose this management system, execution step 5; If simulation assessment is not passed through, assessment models is revised, return to step 3;
Step 5: after management system is disposed, it is put into practice to assessment, if practice assessment is not passed through, assessment models is revised, re-start practice assessment, until practice assessment is passed through, finish estimation flow; If practice assessment is passed through, draw assessment result, and the impact on each side's entity in network after providing this management system and disposing, the suggestion that improves dispositions method is provided.
2. a kind of three-dimensional assessment method of network management system according to claim 1, is characterized in that, the concrete steps of assessment models index system that build capable of dynamic configuration described in step 2 are as follows:
Step 2.1.1: from cost, impact and three preliminary index for selection of different dimensions of effect, and carry out modeling from three dimensions;
Step 2.1.2: the index of choosing is screened to structuring;
Step 2.1.3: the structurized index of screening is carried out to criterion and quantity;
Step 2.1.4: the index of criterion and quantity is carried out to weights and determine;
Step 2.1.5: the index of determining weights is carried out to the gathering of many indexs;
Step 2.1.6: the index that many indexs are assembled is carried out index comprehensive analysis, obtains assessment models index system.
3. a kind of three-dimensional assessment method of network management system according to claim 2, it is characterized in that, the specific implementation that described in described step 2.1.1, index is tentatively chosen is: the common index of research network evaluation, feature for network evaluation, for proposing index, network evaluation chooses universal model, and carry out modeling from cost, impact and three different dimensions of effect, the index of different dimensions is relatively independent.
4. a kind of three-dimensional assessment method of network management system according to claim 2, it is characterized in that, the structurized specific implementation of index screening described in described step 2.1.2 is: by theory analysis and experiment, compare, find interdepending and interactional degree between index, carry out that index is subdued, de-redundancy.
5. a kind of three-dimensional assessment method of network management system according to claim 2, it is characterized in that, described in described step 2.1.3, the specific implementation of index criterion and quantity is: for measurability demand, research index qualitative, quantitatively calculate standard, and set up corresponding quantization method.
6. a kind of three-dimensional assessment method of network management system according to claim 2, it is characterized in that, the definite specific implementation of index weight value described in described step 2.1.4 is: for real-time and the rational requirement of network management system, utilize Hierarchy Analysis Method, in conjunction with qualitative analysis and quantitative analysis, index weight value is determined.
7. a kind of three-dimensional assessment method of network management system according to claim 2, it is characterized in that, the specific implementation that described in described step 2.1.5, many indexs are assembled is: for the network management system demand under different times, varying environment, the aggregation algorithms of different indexs is chosen.
8. a kind of three-dimensional assessment method of network management system according to claim 2, it is characterized in that, described in described step 2.1.6, the specific implementation of index comprehensive analysis is: each index is carried out to association analysis, and the defect of discovering network management system and the problem of existence, provide assessment result.
9. realize in claim 1-8 a system for the three-dimensional assessment method of network management system described in any one, it is characterized in that, comprise information acquisition module, model building module, simulation evaluation module and put into practice evaluation module;
Described information acquisition module, its demand for the network condition to current and management system are analyzed;
Described model building module, it builds the assessment models index system of capable of dynamic configuration for basis analysis result above;
Described simulation evaluation module, it if simulation assessment is passed through, disposes this management system for adopting assessment models to simulate assessment to the management system that will assess; If simulation assessment is not passed through, assessment models is revised, re-start simulation assessment;
The described evaluation module of putting into practice, it,, for after disposing in management system, puts into practice assessment to the management system that will assess, if practice assessment is not passed through, assessment models is revised, and re-starts practice assessment, until practice assessment is passed through, finishes estimation flow; If practice assessment is passed through, draw assessment result, and the impact on each side's entity in network after providing this management system and disposing, the suggestion that improves dispositions method is provided.
10. a kind of three-dimensional assessment system of network management system according to claim 9, it is characterized in that, described model building module comprises that index tentatively chooses unit, index screening structuring unit, quantification of targets unit, weights determining unit, many indexs accumulation unit and index comprehensive analytic unit;
Described index is tentatively chosen unit, it for the feature of network evaluation, chooses universal model for network evaluation proposes index for studying the common index of network evaluation, and carry out modeling from cost, impact and three different dimensions of effect, the index of different dimensions is relatively independent;
Described index screening structuring unit, it,, for by theory analysis and experiment relatively, finds interdepending and interactional degree between index, carries out that index is subdued, de-redundancy;
Described quantification of targets unit, it is for for measurability demand, research index qualitative, quantitatively calculate standard, and set up corresponding quantization method;
Described weights determining unit, it,, for the real-time for network management system and rational requirement, utilizes Hierarchy Analysis Method, in conjunction with qualitative analysis and quantitative analysis, index weight value is determined;
Described many indexs accumulation unit, it,, for the network management system demand under different times, varying environment, is chosen the aggregation algorithms of different indexs;
Described index comprehensive analytic unit, it is for many indexes is carried out to association analysis, and the defect of discovering network management system and the problem of existence, provide assessment result.
CN201410231273.7A 2014-05-28 2014-05-28 Three-dimensional assessment method for network management system and system Pending CN104022899A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410231273.7A CN104022899A (en) 2014-05-28 2014-05-28 Three-dimensional assessment method for network management system and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410231273.7A CN104022899A (en) 2014-05-28 2014-05-28 Three-dimensional assessment method for network management system and system

Publications (1)

Publication Number Publication Date
CN104022899A true CN104022899A (en) 2014-09-03

Family

ID=51439482

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410231273.7A Pending CN104022899A (en) 2014-05-28 2014-05-28 Three-dimensional assessment method for network management system and system

Country Status (1)

Country Link
CN (1) CN104022899A (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018171177A1 (en) * 2017-03-20 2018-09-27 上海中兴软件有限责任公司 Index weight verification method and device of network quality assessment tool
CN108681820A (en) * 2018-05-21 2018-10-19 成都信息工程大学 A kind of analysis method for increasing Information Security Mechanism and system performance being influenced
CN109376980A (en) * 2018-08-29 2019-02-22 上海机电工程研究所 The Performance Evaluation index system construction method and system of three-dimensional time-varying
CN109699020A (en) * 2018-11-30 2019-04-30 东莞市巨冈机械工业有限公司 A kind of manufaturing data cognitive method optimizing sensor node deployment
CN111160727A (en) * 2019-12-13 2020-05-15 北京航天云路有限公司 Visualization method for automatically generating result based on self-defined evaluation model and algorithm
CN111813871A (en) * 2020-06-30 2020-10-23 北京九章云极科技有限公司 Real-time data processing system and method

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
XU FEI,ET AL.: ""A three-dimensional evaluation model for network management system"", 《PROCEDIA COMPUTER SCIENCE》 *
罗枫,宋梅,任志军,潘阳发,宋俊德,: ""移动网管中多指标综合评估研究"", 《北京邮电大学学报》 *
蔡正茂,: ""区域疾病预防控制绩效评估的方法学和指标体系研究"", 《中国博士学位论文全文数据库-医药卫生科技辑》 *
陈德富,: ""医院信息***的综合效益分析与评价"", 《中国优秀硕士学位论文全文数据库-医药卫生科技辑 》 *

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018171177A1 (en) * 2017-03-20 2018-09-27 上海中兴软件有限责任公司 Index weight verification method and device of network quality assessment tool
CN108632104A (en) * 2017-03-20 2018-10-09 上海中兴软件有限责任公司 A kind of the index weights verification method and device of network quality assessment tool
CN108632104B (en) * 2017-03-20 2021-04-30 上海中兴软件有限责任公司 Index weight verification method and device of network quality assessment tool
CN108681820A (en) * 2018-05-21 2018-10-19 成都信息工程大学 A kind of analysis method for increasing Information Security Mechanism and system performance being influenced
CN108681820B (en) * 2018-05-21 2021-07-30 成都信息工程大学 Analysis method for increasing influence of information security mechanism on system performance
CN109376980A (en) * 2018-08-29 2019-02-22 上海机电工程研究所 The Performance Evaluation index system construction method and system of three-dimensional time-varying
CN109376980B (en) * 2018-08-29 2021-07-30 上海机电工程研究所 Three-dimensional time-varying performance evaluation index system construction method and system
CN109699020A (en) * 2018-11-30 2019-04-30 东莞市巨冈机械工业有限公司 A kind of manufaturing data cognitive method optimizing sensor node deployment
CN111160727A (en) * 2019-12-13 2020-05-15 北京航天云路有限公司 Visualization method for automatically generating result based on self-defined evaluation model and algorithm
CN111813871A (en) * 2020-06-30 2020-10-23 北京九章云极科技有限公司 Real-time data processing system and method

Similar Documents

Publication Publication Date Title
Bussmann et al. Explainable AI in fintech risk management
US9946633B2 (en) Assessing risk of software commits to prioritize verification resources
US9710364B2 (en) Method of detecting false test alarms using test step failure analysis
CN104022899A (en) Three-dimensional assessment method for network management system and system
Yu et al. Experience in predicting fault-prone software modules using complexity metrics
Sánchez-González et al. Quality assessment of business process models based on thresholds
CN113837596B (en) Fault determination method and device, electronic equipment and storage medium
Singh et al. Object oriented software metrics threshold values at quantitative acceptable risk level
WO2017071369A1 (en) Method and device for predicting user unsubscription
Verma et al. Prediction of defect density for open source software using repository metrics
Zhao et al. Understanding the value of considering client usage context in package cohesion for fault-proneness prediction
CN104320271B (en) A kind of network equipment safety evaluation method and device
CN115174353B (en) Fault root cause determining method, device, equipment and medium
Kumar et al. A study of software reliability on big data open source software
CN111563673A (en) Computer technology digitization degree evaluation method and device
CN112686499A (en) Vehicle information safety level evaluation method and device, electronic device and medium
CN110413482B (en) Detection method and device
Rana et al. Analysing defect inflow distribution of automotive software projects
CN111967774B (en) Software quality risk prediction method and device
CN113516398A (en) Risk equipment identification method and device based on hierarchical sampling and electronic equipment
Pavasson et al. Reliability prediction based on variation mode and effect analysis
CN112668842A (en) Vehicle insurance claim settlement risk factor evaluation method and device, electronic equipment and medium
Wang et al. Diagnosis index system setup for implementation status management in large-scale construction projects
Kravchenko et al. Complex Dynamic Method of Web Applications Verification by the Criterion of Time Minimization
Dasso et al. Web applications security testing evaluation

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20140903