CN112561331A

CN112561331A - Visual experimental analysis evaluation index construction method

Info

Publication number: CN112561331A
Application number: CN202011488518.6A
Authority: CN
Inventors: 李志平; 杨凯; 徐筠; 卿杜政; 董国宝; 王赫
Original assignee: Beijing Simulation Center
Current assignee: Beijing Simulation Center
Priority date: 2020-12-16
Filing date: 2020-12-16
Publication date: 2021-03-26

Abstract

One embodiment of the invention discloses a visual test analysis evaluation index construction method, which comprises the following steps: s10: acquiring a test data format and an evaluation model; s13: obtaining an evaluation result and selecting a proper chart control according to a result display requirement; s15: according to the data format, the evaluation model, the chart control and the interface corresponding relation of the evaluation result, constructing a single evaluation index; s17: and after the evaluation index is constructed, storing the evaluation index, and then constructing other evaluation indexes.

Description

Visual experimental analysis evaluation index construction method

Technical Field

The present invention relates to the field of assay analysis and evaluation. More particularly, the invention relates to a visual experimental analysis evaluation index construction method.

Background

The test analysis and evaluation technology is an important means for quantitatively evaluating the equipment capacity, taking weaponry as an example, before the weaponry is arranged in a troop, the weaponry needs to be subjected to processes such as demonstration, establishment, development, test, identification and the like, each process needs to be subjected to a large number of internal and external field tests such as digital simulation tests, semi-physical simulation tests, flight tests and the like, and after the arming, the tactical training, combat exercises and other subjects need to be carried out. In order to evaluate the equipment capability and the effects of the test, the training and the exercise, analysis and evaluation work needs to be carried out on data obtained by simulation, the test, the training, the exercise and the like. The test analysis and evaluation comprises contents such as an evaluation model, an evaluation index system, test data, an evaluation result and the like, wherein the evaluation index system is composed of a plurality of test evaluation sub-indexes, and each evaluation index relates to an evaluation data source, and elements such as the evaluation model, the evaluation result, a display form and the like, and is the core of the test analysis and evaluation. At present, most of test analysis and evaluation work is carried out aiming at specific test task requirements, evaluation models, evaluation indexes and test data are combined tightly, integration is carried out on a code level, and dynamic adjustment of the evaluation indexes cannot be realized, so that the universality and the reusability of a test evaluation system are poor. In addition, indexes are complex to construct, and have high requirements on the capability and technical level of evaluators, so that the development period of an analysis and evaluation system is long, and the follow-up maintenance is difficult.

Disclosure of Invention

In view of this, a first embodiment of the present invention provides a method for constructing a visual test analysis evaluation index, including:

s10: acquiring a test data format and an evaluation model;

s13: obtaining an evaluation result and selecting a proper chart control according to a result display requirement;

s15: according to the data format, the evaluation model, the chart control and the interface corresponding relation of the evaluation result, constructing a single evaluation index;

s17: and after the evaluation index is constructed, storing the evaluation index, and then constructing other evaluation indexes.

In a specific embodiment, the data format description is acquired by using a data format loading module for acquiring the experimental data format, a corresponding experimental data format is selected from existing formats according to the requirement of the evaluation index on the experimental data, the data format is analyzed by a visualization module, and the data format control and corresponding interface information are displayed in a visualization area.

In a specific embodiment, acquiring the evaluation model requires acquiring an evaluation model description by using an evaluation model loading module, selecting a corresponding evaluation model according to the requirement of evaluation indexes on test data processing, analyzing an evaluation model description file by using a visualization module, and displaying an evaluation model control and corresponding interface information in a visualization area.

In a particular embodiment, the data format description includes basic information and interface information of the data format.

In a particular embodiment, the evaluation model description information includes evaluation model basic information and interface information.

In a specific embodiment, the S13 includes:

according to the requirement of the evaluation result display, the display loading module selects a corresponding chart display form to display the evaluation result value, the visualization module analyzes the description file of the display chart, and the chart control and the evaluation result value are displayed in the visualization area.

In a specific embodiment, the S15 includes: and connecting the corresponding relations among the data format control, the evaluation model control, the chart control and the evaluation result control according to the interface corresponding relations of the data format, the evaluation model, the chart display and the evaluation result in a logic sequence by adopting a visual connection mode, so as to realize the association of the interface information of each control. Firstly, connecting a data format control output interface with an evaluation model control input interface, then connecting a corresponding output interface of the evaluation model control with a chart display control input interface, and finally connecting an evaluation model control result output interface with an evaluation result control input interface to complete the construction of a single evaluation index.

In a specific embodiment, the S17 includes: and after the visual evaluation index is constructed, storing the association relation of the connection interfaces of the controls into a single evaluation index description file. The test analysis and evaluation system can complete the analysis and evaluation of the index by taking actual test data as input according to the evaluation index description file.

A second embodiment of the present invention provides a computer device, comprising a processor and a memory storing a computer program, wherein the processor executes the program to implement the method according to any one of the first embodiment.

A third embodiment of the invention provides a computer-readable storage medium, on which a computer program is stored, characterized in that the program, when executed by a processor, implements the method according to any one of the first embodiments.

The invention has the following beneficial effects:

the invention adopts a visual test analysis and evaluation index construction method, realizes the functions of separating test data from evaluation indexes, and displaying configurable evaluation results, and has the technical characteristics of flexibility, reusability, quick construction, dynamic loading, diversified display of evaluation results, convenient management and the like, and specifically comprises the following steps: (1) the evaluation indexes are independent of the test data and the evaluation system, so that the separation of the test data, the evaluation indexes and the evaluation system is realized, the evaluation indexes can flexibly configure data formats, evaluation models, display forms and the like according to different evaluation requirements, and the requirements of different evaluation projects are met; (2) the method has the advantages that the method is fast in construction, the whole process of the construction of the evaluation index is realized in a visual man-machine interaction mode, the construction difficulty and the workload of the evaluation index are reduced, the technical threshold of an evaluator is reduced, and the development efficiency of an evaluation system is improved; (3) dynamic loading, wherein in the evaluation indexes, a data format, an evaluation model and the like adopt a dynamic loading mode, and if the data format and the evaluation model are adjusted in a later stage, the modified data format and the modified evaluation model are directly fed back to the evaluation indexes without reconstructing the evaluation indexes; (4) the method has the advantages that evaluation results are displayed in a variety mode, two types of evaluation results of chart display and evaluation index values are output, the chart display can support a histogram, a pie chart, a scatter diagram, a line chart, a curve chart, a three-dimensional graph and the like, and an intuitive display form can be provided for analysis of test evaluation results; and the evaluation index value gives an evaluation conclusion of the index according to the calculation result of the evaluation model.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

FIG. 1 shows a framework diagram of a visualized experimental analysis assessment index construction system according to an embodiment of the invention.

FIG. 2 is a flow chart of a method for constructing a visual experimental analysis assessment index according to an embodiment of the present invention.

FIG. 3 illustrates a visual display diagram of a data format control according to one embodiment of the present invention.

FIG. 4 illustrates a visual display diagram of an assessment model control according to one embodiment of the present invention.

FIG. 5 illustrates a visual display diagram of a chart and assessment results control according to one embodiment of the present invention.

FIG. 6 shows a schematic diagram of interface information relationships, according to one embodiment of the invention.

Fig. 7 shows a schematic configuration diagram of a computer apparatus according to another embodiment of the present invention.

Detailed Description

In order to make the technical solutions and advantages of the present invention more apparent, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

As shown in fig. 1, a visualized experimental analysis evaluation index construction system includes: the system comprises a visual display module 1, a data format loading module 2, an evaluation model loading module 3, an evaluation result and display loading module 4, an interface information correlation module 5 and an index description module 6.

As shown in fig. 2, a visual experimental analysis evaluation index construction method includes:

s10: acquiring a test data format and an evaluation model;

the data format description is obtained by the data format loading module 2, the corresponding test data format is selected from the existing formats according to the requirement of the evaluation index on the test data, the data format is analyzed by the visual display module 1, and the data format control and the corresponding interface information are displayed in the visual area as shown in fig. 3.

The steps can be repeated to realize the loading of a plurality of data formats.

In one specific example, the data format description includes two parts of basic information and interface information of the data format.

Preferably, the data format is described in an XML language, which is schematically shown as follows:

the evaluation model loading module 3 is used for obtaining the description information of the evaluation model, the corresponding evaluation model is selected according to the requirement of evaluation indexes on test data processing, the visual display module 1 analyzes the description file of the evaluation model, and as shown in fig. 4, the evaluation model control and the corresponding interface information are displayed in the visual area.

The steps can be repeated to realize the loading of a plurality of evaluation models.

In a specific example, the evaluation model description information includes contents such as evaluation model basic information and interface information.

Preferably, the evaluation model can be described in an XML language.

the evaluation result and display loading module 4 is utilized to select a corresponding chart display form and an evaluation result value according to the requirements of evaluation and display, and in a specific example, the chart display form may be a bar chart, a pie chart, a scatter chart, a line chart, a graph, a three-dimensional chart, a table and the like, and is not limited specifically. The visualization display module 1 parses the description file showing the chart, and as shown in fig. 5, displays the chart control and the evaluation result value in the visualization area.

The steps can be repeated to realize the loading of the multiple chart controls.

In a specific example, the evaluation result value is an evaluation result numerical value output by the evaluation index, the chart provides a visual display and analysis technical means for evaluation result data, and the displayed chart description information includes information such as a chart interface and a chart type, and can be adjusted according to the displayed chart description information of the actual condition of the data.

the interface information association module 5 connects the correspondence among the data format control, the evaluation model control, the chart control, and the evaluation result control in a logical order according to the interface correspondence of the data format, the evaluation model, the chart display, and the evaluation result, as shown in fig. 6, in a visual connection manner, so as to implement association of interface information of each control.

The method comprises the following specific steps: firstly, connecting a data format control output interface with an evaluation model control input interface, then connecting a corresponding output interface of the evaluation model control with a chart display control input interface, and finally connecting an evaluation model control result output interface with an evaluation result control input interface to complete the construction of a single evaluation index.

After the evaluation indexes are constructed, the index description module 6 saves the association relation of the connection interfaces of the controls as a single evaluation index description file. The test analysis and evaluation system can complete the analysis and evaluation of the index by taking the actual test data and the corresponding evaluation model as input according to the evaluation index description file.

The index description principle is as follows: covering interfaces of all controls with established relations; in order to avoid the repetition of description information, only the connection relation of the output interfaces of the used controls is described; consider the multi-instance case of data format controls, model controls, chart controls.

And according to the test evaluation requirement, repeating the steps from the first step to the fifth step, and completing the construction of other required evaluation indexes.

In a specific example, the evaluation index description file may be described by using an XML file, and the format is shown as follows:

another embodiment of the present invention provides a computer readable storage medium having stored thereon a computer program, which when executed by a processor, implements any combination of one or more computer readable media in a practical application. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present embodiment, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.

A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.

Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).

As shown in fig. 7, another embodiment of the present invention provides a schematic structural diagram of a computer device. The computer device 12 shown in fig. 7 is only an example and should not bring any limitations to the functionality or scope of use of the embodiments of the present invention.

As shown in FIG. 7, computer device 12 is in the form of a general purpose computing device. The components of computer device 12 may include, but are not limited to: one or more processors or processing units 16, a system memory 28, and a bus 18 that couples various system components including the system memory 28 and the processing unit 16.

Bus 18 represents one or more of any of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, and a processor or local bus using any of a variety of bus architectures. By way of example, such architectures include, but are not limited to, Industry Standard Architecture (ISA) bus, micro-channel architecture (MAC) bus, enhanced ISA bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus.

Computer device 12 typically includes a variety of computer system readable media. Such media may be any available media that is accessible by computer device 12 and includes both volatile and nonvolatile media, removable and non-removable media.

The system memory 28 may include computer system readable media in the form of volatile memory, such as Random Access Memory (RAM)30 and/or cache memory 32. Computer device 12 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 34 may be used to read from and write to non-removable, nonvolatile magnetic media (not shown in FIG. 7, and commonly referred to as a "hard drive"). Although not shown in FIG. 7, a magnetic disk drive for reading from and writing to a removable, nonvolatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, nonvolatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to bus 18 by one or more data media interfaces. Memory 28 may include at least one program product having a set (e.g., at least one) of program modules that are configured to carry out the functions of embodiments of the invention.

A program/utility 40 having a set (at least one) of program modules 42 may be stored, for example, in memory 28, such program modules 42 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which examples or some combination thereof may comprise an implementation of a network environment. Program modules 42 generally carry out the functions and/or methodologies of the described embodiments of the invention.

Computer device 12 may also communicate with one or more external devices 14 (e.g., keyboard, pointing device, display 24, etc.), with one or more devices that enable a user to interact with computer device 12, and/or with any devices (e.g., network card, modem, etc.) that enable computer device 12 to communicate with one or more other computing devices. Such communication may be through an input/output (I/O) interface 22. Also, computer device 12 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network such as the Internet) via network adapter 20. As shown in FIG. 7, the network adapter 20 communicates with the other modules of the computer device 12 via the bus 18. It should be appreciated that although not shown in FIG. 7, other hardware and/or software modules may be used in conjunction with computer device 12, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.

The processor unit 16 executes various functional applications and data processing by running the program stored in the system memory 28, for example, implementing a visual test analysis evaluation index construction method provided by the embodiment of the present invention.

It should be understood that the above-mentioned embodiments of the present invention are only examples for clearly illustrating the present invention, and are not intended to limit the embodiments of the present invention, and it will be obvious to those skilled in the art that other variations or modifications may be made on the basis of the above description, and all embodiments may not be exhaustive, and all obvious variations or modifications may be included within the scope of the present invention.

Claims

1. A visual experimental analysis evaluation index construction method is characterized by comprising the following steps:

s10: acquiring a test data format and an evaluation model;

2. The method according to claim 1, wherein the experimental data format is acquired by using a data format loading module to acquire data format description, a corresponding experimental data format is selected from existing formats according to the requirement of evaluation indexes on experimental data, a visualization module analyzes the data format, and a data format control and corresponding interface information are displayed in a visualization area.

3. The method according to claim 1 or 2, wherein the obtaining of the evaluation model requires obtaining an evaluation model description by using an evaluation model loading module, selecting a corresponding evaluation model according to a requirement of an evaluation index on test data processing, analyzing the evaluation model description file by using a visualization module, and displaying an evaluation model control and corresponding interface information in a visualization area.

4. The method of claim 2, wherein the data format description comprises basic information and interface information of the data format.

5. The method of claim 3, wherein the assessment model description information comprises assessment model base information and interface information.

6. The method according to claim 3, wherein the S13 includes:

7. The method according to claim 6, wherein the S15 includes: and connecting the corresponding relations among the data format control, the evaluation model control, the chart control and the evaluation result control according to the interface corresponding relations of the data format, the evaluation model, the chart display and the evaluation result in a logic sequence by adopting a visual connection mode, so as to realize the association of the interface information of each control. Firstly, connecting a data format control output interface with an evaluation model control input interface, then connecting a corresponding output interface of the evaluation model control with a chart display control input interface, and finally connecting an evaluation model control result output interface with an evaluation result control input interface to complete the construction of a single evaluation index.

8. The method according to claim 1, wherein the S17 includes: and after the visual evaluation index is constructed, storing the association relation of the connection interfaces of the controls into a single evaluation index description file. The test analysis and evaluation system can complete the analysis and evaluation of the index by taking actual test data as input according to the evaluation index description file.

9. A computer device comprising a processor and a memory having stored thereon a computer program, characterized in that the processor, when executing the program, implements the method according to any of claims 1-8.

10. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the method according to any one of claims 1-8.