CN113703948A - Test paper splitting system and splitting method thereof - Google Patents

Test paper splitting system and splitting method thereof Download PDF

Info

Publication number
CN113703948A
CN113703948A CN202111032890.0A CN202111032890A CN113703948A CN 113703948 A CN113703948 A CN 113703948A CN 202111032890 A CN202111032890 A CN 202111032890A CN 113703948 A CN113703948 A CN 113703948A
Authority
CN
China
Prior art keywords
test paper
splitting
server
information
resource
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111032890.0A
Other languages
Chinese (zh)
Inventor
杜方治
于永斌
李美华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sichuan Yude Zhongchuang Information Technology Co ltd
Original Assignee
Sichuan Yude Zhongchuang Information Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sichuan Yude Zhongchuang Information Technology Co ltd filed Critical Sichuan Yude Zhongchuang Information Technology Co ltd
Priority to CN202111032890.0A priority Critical patent/CN113703948A/en
Publication of CN113703948A publication Critical patent/CN113703948A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/48Program initiating; Program switching, e.g. by interrupt
    • G06F9/4806Task transfer initiation or dispatching
    • G06F9/4843Task transfer initiation or dispatching by program, e.g. task dispatcher, supervisor, operating system
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/3003Monitoring arrangements specially adapted to the computing system or computing system component being monitored
    • G06F11/3024Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is a central processing unit [CPU]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/3003Monitoring arrangements specially adapted to the computing system or computing system component being monitored
    • G06F11/3034Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is a storage system, e.g. DASD based or network based
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/3003Monitoring arrangements specially adapted to the computing system or computing system component being monitored
    • G06F11/3037Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is a memory, e.g. virtual memory, cache
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5011Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5027Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
    • G06F9/505Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals considering the load

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Mathematical Physics (AREA)
  • Quality & Reliability (AREA)
  • Debugging And Monitoring (AREA)

Abstract

The invention discloses a test paper splitting system and a method, which adopt a micro-service architecture, comprise a resource management pool, and are used for information management of all servers in an integrated system and providing service for a resource allocation module; the resource allocation module is used as a resource management center to configure and execute the command for the server in the resource management pool; the resource scheduling module is used for scheduling the split test paper resources according to the execution instruction of the server; the test paper splitting module is used for splitting the test paper according to the resource scheduling command; and the service monitoring module is used for monitoring and tracking the test paper splitting process. According to the invention, through the flexible architecture design, the system has a flexible architecture, and can utilize cloud computing resources according to the user requirements, thereby providing a flexible solution for users.

Description

Test paper splitting system and splitting method thereof
Technical Field
The invention belongs to the technical field of examination systems, and particularly relates to a test paper splitting system and a splitting method thereof.
Background
Along with the development of artificial intelligence technology, the intelligent products of education gradually walk into people's life, and its intellectuality and convenience have brought higher work and study efficiency for vast teachers and students. In various teaching products, such as intelligent test paper formation, student personalized learning and the like, a massive question bank is required as a support, so that extraction of test questions in massive test paper is a part of the most basic construction.
The existing intelligent test paper splitting system analyzes and splits the structured test paper generated by the system, lacks the capability of carrying out structured analysis and test question splitting on standardized test papers from other sources, and cannot effectively support learning and teaching activities.
In addition, in the existing splitting technology, a single server is generally adopted to obtain a cluster server to split the test paper test questions, and the utilization rate of the server is low. The test paper splitting efficiency is low, and the accuracy is poor. The utilization rate of the computing resources is lower than 40% of the allocated resources, which causes serious waste of the computing resources.
The existing test paper and test question splitting algorithm adopts a tight coupling technology, the operation process of the test paper and test question splitting process is not revealed enough, the operation details such as the resource utilization rate, the operation progress, the execution efficiency and the like of the test paper and test question splitting cannot be comprehensively monitored, and meanwhile, the elasticity of resource use is lacked.
Disclosure of Invention
Aiming at the defects in the prior art, the test paper splitting system and the test paper splitting method provided by the invention solve the problems that the resource utilization rate, the operation progress execution efficiency and the lack of resource use elasticity of the test paper question splitting cannot be comprehensively monitored in the existing test paper splitting process.
The technical scheme adopted by the invention is as follows: a test paper splitting system adopts a micro-service architecture, and specifically comprises:
the resource management pool is used for managing information of all servers in the integrated system and providing service for the resource allocation module;
the resource allocation module is used as a resource management center to configure and execute the command for the server in the resource management pool;
the resource scheduling module is used for scheduling the split test paper resources according to the execution instruction of the server;
the test paper splitting module is used for splitting the test paper according to the resource scheduling command;
and the service monitoring module is used for monitoring and tracking the test paper splitting process.
Further, the information in the resource management pool includes server IP information, file storage information, and memory information.
Further, the execution instruction configured for the server by the resource allocation module includes a resource executable range, a file address of the test paper to be split, the number of split files, a server for splitting the files, and a remote interface call for splitting the files.
Further, the method for scheduling the split test paper resources by the resource scheduling module comprises: and according to the management of the thread pool in the server, allocating the test paper resources to be split, so that the test paper splitting module splits the test paper in a multithread concurrent mode.
Further, the information monitored and tracked by the service monitoring module in the test paper splitting process includes the number of threads and the execution condition of the threads. CPU, memory, hard disk IO service conditions of the server and the splitting time for executing the split test paper test questions.
A test paper splitting method is applied to the test paper splitting system and comprises the following steps:
s1, configuring resource information which can be distributed by the server;
s2, when the test paper needs to be split, carrying out server remote scheduling according to the configured resource information;
s3, initializing test paper splitting information of a corresponding server according to the scheduling command;
s4, splitting the test paper image inside the server according to the resource information configured by the server;
and S5, storing the test question image after the test paper is split in a database of the server.
Further, in step S1, the resource information assignable by the server includes server information, an address of the test paper splitting file, a number of the test paper splits, and remote interface call information for the test paper splits.
Further, the step S4 is specifically:
s41, creating a test paper splitting thread pool according to the configured test paper splitting file address and the test paper splitting number;
s42, concurrently carrying out test paper splitting on the test paper images in the test paper splitting thread pool to obtain a plurality of independent test question images;
the test paper splitting thread pool is distributed with the number of split files and the number of corresponding threads.
In step S42, the question images are named in an information structure by the study number, the test paper number, and the test question number.
Further, in the test paper splitting process, server information for monitoring and executing the test paper splitting command is also included, and the server information includes a CPU utilization rate, a memory utilization rate, a disk IO utilization rate, and a server thread pool execution condition.
The invention has the beneficial effects that:
(1) according to the invention, each server has a use command by a server resource management and distribution mode, the management platform manages the multiple servers, the multiple servers are more reasonably used, the maximum use rate of hardware of each server is exerted, and the read-write efficiency of disk IO is maximally utilized in the test paper splitting process;
(2) each server in the system adopts a multithreading mode, and the image splitting work is processed concurrently, so that the work efficiency of splitting the image is greatly improved, and the mode and the method can continue to expand the function of splitting a larger number of test paper images by the server;
(3) when a single server carries out test paper splitting work, the splitting system can automatically generate a test paper splitting thread pool according to the sub-resources and the related configuration of the server, the test paper splitting thread pool processes test paper images in a multi-thread mode, and each test question is stored in a specified folder in a structured mode, so that the test paper splitting system is convenient for automatic analysis and use;
(4) in the process of splitting each test paper, the system provides a complete monitoring process, monitors the service conditions of a server CPU, a memory, a disk IO and the like, and monitors the condition of splitting the test paper.
Drawings
Fig. 1 is a flowchart of a test paper splitting method provided by the present invention.
FIG. 2 is a design diagram of splitting a test paper question thread according to the present invention.
Detailed Description
The following description of the embodiments of the present invention is provided to facilitate the understanding of the present invention by those skilled in the art, but it should be understood that the present invention is not limited to the scope of the embodiments, and it will be apparent to those skilled in the art that various changes may be made without departing from the spirit and scope of the invention as defined and defined in the appended claims, and all matters produced by the invention using the inventive concept are protected.
Example 1:
in the embodiment, a micro-service architecture is adopted, a test paper splitting system composed of multiple servers is designed, and through flexible architecture design, the system has a flexible architecture, cloud computing resources can be utilized according to user requirements, and a flexible solution is provided for users.
The system carries out structured splitting on the test paper information stored in the image form through a multi-path test paper splitting service, and the whole system specifically comprises:
the resource management pool is used for managing information of all servers in the integrated system and providing service for the resource allocation module;
the resource allocation module is used as a resource management center to configure and execute the command for the server in the resource management pool;
the resource scheduling module is used for scheduling the split test paper resources according to the execution instruction of the server;
the test paper splitting module is used for splitting the test paper according to the resource scheduling command;
and the service monitoring module is used for monitoring and tracking the test paper splitting process.
The information in the resource management pool in this embodiment includes server IP information, file storage information, and memory information, the management pool provides services for the resource allocation function, and the resource allocation function can only use the server information in the resource management pool.
In this embodiment, the execution instruction configured by the resource allocation module for the server includes configuration information such as a resource executable range, a file address of a test paper to be split, the number of split files, a server for splitting files, and a remote interface call for splitting files, so that the resource scheduling module uses a test paper splitting function.
The method for scheduling the split test paper resources by the resource scheduling module in the embodiment comprises the following steps: after receiving the scheduling command of the resource allocation module, the test paper splitting function and related resources at the bottom layer are scheduled, and the test paper resources to be split are allocated according to the management of the thread pool in the server, so that the test paper splitting module splits the test paper in a multi-thread concurrent mode.
In the embodiment, the test paper splitting module is integrated with the thread pool center, and the thread pool can reasonably distribute resources, so that the working strength of splitting the test paper by each thread is reasonable. In order to better utilize the machine performance and achieve efficient test paper splitting, the C language closest to the bottom layer is used for splitting the test paper, and the split files are directly written into the specified file directory.
The information monitored and tracked by the service monitoring module in the test paper splitting process in this embodiment includes the number of threads and the execution condition of the threads. CPU, memory, hard disk IO service conditions of the server and the splitting time for executing the split test paper test questions.
Example 2:
the embodiment provides a test paper splitting method, which is applied to the test paper splitting system in embodiment 1, and as shown in fig. 1 to 2, includes the following steps:
s1, configuring resource information which can be distributed by the server;
the server allocable resource information comprises server information, test paper splitting file addresses, test paper splitting quantity and test paper splitting remote interface calling information, and different remote servers are called to perform test paper splitting work simultaneously according to the configured server information;
s2, when the test paper needs to be split, carrying out server remote scheduling according to the configured resource information;
the server receiving the remote scheduling command executes corresponding test paper splitting work;
s3, initializing test paper splitting information of a corresponding server according to the scheduling command;
s4, splitting the test paper image inside the server according to the resource information configured by the server;
and S5, storing the test question image after the test paper is split in a database of the server.
The step S4 is specifically:
s41, creating a test paper splitting thread pool according to the configured test paper splitting file address and the test paper splitting number;
s42, concurrently carrying out test paper splitting on the test paper images in the test paper splitting thread pool to obtain a plurality of independent test question images;
the test paper splitting thread pool is distributed with the number of split files and the number of corresponding threads; meanwhile, the split test question image is subjected to information structured naming in the modes of study numbers, test paper numbers and test question numbers.
In the test paper splitting process in this embodiment, server information for monitoring and executing the test paper splitting command is further included, where the server information includes a CPU usage rate, a memory usage rate, a disk IO usage rate, and a server thread pool execution condition.
Example 3:
the present embodiment provides a computer-readable storage medium, on which a computer program is stored, which when executed by a processor implements the steps of:
s1, configuring resource information which can be distributed by the server;
s2, when the test paper needs to be split, carrying out server remote scheduling according to the configured resource information;
s3, initializing test paper splitting information of a corresponding server according to the scheduling command;
s4, splitting the test paper image inside the server according to the resource information configured by the server;
and S5, storing the test question image after the test paper is split in a database of the server.
It will be understood by those skilled in the art that all or part of the processes of the methods of the above embodiments may be implemented by a computer program, which is stored in a non-volatile computer readable storage medium and can include the processes of the above embodiments of the methods when executed. Any reference to memory, storage, database or other medium used in embodiments provided herein may include non-volatile and/or non-volatile memory.
It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-mentioned division of the functional units and modules is illustrated, and in practical applications, the above-mentioned function distribution may be performed by different functional units and modules according to needs, that is, the content structure of the system is divided into different functional units or modules to perform all or part of the above-mentioned functions.

Claims (10)

1. A test paper splitting system is characterized in that a micro-service architecture is adopted, and the system specifically comprises:
the resource management pool is used for managing information of all servers in the integrated system and providing service for the resource allocation module;
the resource allocation module is used as a resource management center to configure and execute the command for the server in the resource management pool;
the resource scheduling module is used for scheduling the split test paper resources according to the execution instruction of the server;
the test paper splitting module is used for splitting the test paper according to the resource scheduling command;
and the service monitoring module is used for monitoring and tracking the test paper splitting process.
2. The test paper splitting system of claim 1, wherein the information in the resource management pool comprises server IP information, file storage information, and memory information.
3. The test paper splitting system of claim 1, wherein the execution instructions configured by the resource allocation module for the server include a resource executable scope, a file address of the test paper to be split, a number of split files, a server of the split files, and a remote interface call of the split files.
4. The test paper splitting system of claim 1, wherein the method for scheduling the split test paper resources by the resource scheduling module is as follows: and according to the management of the thread pool in the server, allocating the test paper resources to be split, so that the test paper splitting module splits the test paper in a multithread concurrent mode.
5. The test paper splitting system according to claim 1, wherein the information monitored and tracked by the service monitoring module in the test paper splitting process includes the number of threads and the execution condition of the threads. CPU, memory, hard disk IO service conditions of the server and the splitting time for executing the split test paper test questions.
6. A test paper splitting method is applied to the test paper splitting system and comprises the following steps:
s1, configuring resource information which can be distributed by the server;
s2, when the test paper needs to be split, carrying out server remote scheduling according to the configured resource information;
s3, initializing test paper splitting information of a corresponding server according to the scheduling command;
s4, splitting the test paper image inside the server according to the resource information configured by the server;
and S5, storing the test question image after the test paper is split in a database of the server.
7. The test paper splitting method according to claim 6, wherein in step S1, the resource information that can be allocated by the server includes server information, test paper splitting file address, test paper splitting number, and test paper splitting remote interface calling information.
8. The test paper splitting method according to claim 6, wherein the step S4 specifically comprises:
s41, creating a test paper splitting thread pool according to the configured test paper splitting file address and the test paper splitting number;
s42, concurrently carrying out test paper splitting on the test paper images in the test paper splitting thread pool to obtain a plurality of independent test question images;
the test paper splitting thread pool is distributed with the number of split files and the number of corresponding threads.
9. The test paper splitting method of claim 8, wherein in step S42, the test question images are named in an information structure manner by a school number, a test paper number and a test question number.
10. The test paper splitting method according to claim 6, wherein in the test paper splitting process, server information for monitoring and executing the test paper splitting command includes a CPU utilization rate, a memory utilization rate, a disk IO utilization rate, and a server thread pool execution condition.
CN202111032890.0A 2021-09-03 2021-09-03 Test paper splitting system and splitting method thereof Pending CN113703948A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111032890.0A CN113703948A (en) 2021-09-03 2021-09-03 Test paper splitting system and splitting method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111032890.0A CN113703948A (en) 2021-09-03 2021-09-03 Test paper splitting system and splitting method thereof

Publications (1)

Publication Number Publication Date
CN113703948A true CN113703948A (en) 2021-11-26

Family

ID=78659440

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111032890.0A Pending CN113703948A (en) 2021-09-03 2021-09-03 Test paper splitting system and splitting method thereof

Country Status (1)

Country Link
CN (1) CN113703948A (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102790783A (en) * 2011-05-18 2012-11-21 贵州师范大学 Design method of intelligent cloud computing system of test paper background processing
US9612929B1 (en) * 2016-01-13 2017-04-04 International Business Machines Corporation Efficient validation/verification of coherency and snoop filtering mechanisms in computing systems
CN107967669A (en) * 2017-11-24 2018-04-27 腾讯科技(深圳)有限公司 Method, apparatus, computer equipment and the storage medium of picture processing
CN108616722A (en) * 2018-04-18 2018-10-02 中南大学 A kind of embedded high definition video acquisition and data streaming system
CN110188607A (en) * 2019-04-23 2019-08-30 深圳大学 A kind of the traffic video object detection method and device of multithreads computing
CN110674722A (en) * 2019-09-19 2020-01-10 浙江蓝鸽科技有限公司 Test paper splitting method and system

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102790783A (en) * 2011-05-18 2012-11-21 贵州师范大学 Design method of intelligent cloud computing system of test paper background processing
US9612929B1 (en) * 2016-01-13 2017-04-04 International Business Machines Corporation Efficient validation/verification of coherency and snoop filtering mechanisms in computing systems
CN107967669A (en) * 2017-11-24 2018-04-27 腾讯科技(深圳)有限公司 Method, apparatus, computer equipment and the storage medium of picture processing
CN108616722A (en) * 2018-04-18 2018-10-02 中南大学 A kind of embedded high definition video acquisition and data streaming system
CN110188607A (en) * 2019-04-23 2019-08-30 深圳大学 A kind of the traffic video object detection method and device of multithreads computing
CN110674722A (en) * 2019-09-19 2020-01-10 浙江蓝鸽科技有限公司 Test paper splitting method and system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
汪文君: "《Java高并发编程详解》", 30 June 2020 *

Similar Documents

Publication Publication Date Title
US9542223B2 (en) Scheduling jobs in a cluster by constructing multiple subclusters based on entry and exit rules
CN105700948A (en) Method and device for scheduling calculation task in cluster
CN113110938B (en) Resource allocation method and device, computer equipment and storage medium
CN114741207B (en) GPU resource scheduling method and system based on multi-dimensional combination parallelism
Havet et al. Genpack: A generational scheduler for cloud data centers
CN112579267A (en) Decentralized big data job flow scheduling method and device
CN103761146A (en) Method for dynamically setting quantities of slots for MapReduce
CN112540841A (en) Task scheduling method and device, processor and electronic equipment
CN105450684A (en) Cloud computing resource scheduling method and system
KR101765725B1 (en) System and Method for connecting dynamic device on mass broadcasting Big Data Parallel Distributed Processing
CN112395736A (en) Parallel simulation job scheduling method of distributed interactive simulation system
CN111679911A (en) Management method, device, equipment and medium for GPU (graphics processing Unit) card in cloud environment
CN113255165A (en) Experimental scheme parallel deduction system based on dynamic task allocation
CN114138488A (en) Cloud-native implementation method and system based on elastic high-performance computing
Laxmi et al. Application Level Scheduling (AppLeS) in Grid with Quality of Service (QoS)
CN113703948A (en) Test paper splitting system and splitting method thereof
CN113515355A (en) Resource scheduling method, device, server and computer readable storage medium
Tanaka et al. Low latency and resource-aware program composition for large-scale data analysis
CN111638942B (en) Application start-stop control method, cloud platform, device and readable storage medium
Shashidharan et al. Futures-dpe: towards dynamic provisioning and execution of geosimulations in hpc environments
CN115098023B (en) Array memory and memory unit control method
Chen et al. Data prefetching for scientific workflow based on hadoop
Skrinarova et al. Model of education and training strategy for the management of HPC systems
Klimentov et al. Future Data-Intensive Experiment Computing Models: Lessons learned from the recent evolution of the ATLAS Computing Model
Huang et al. A novel fined-grained GPU sharing mechanism for artificial intelligence computing-resource automatic scheduling

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20211126

RJ01 Rejection of invention patent application after publication