CN112613276A - Parallel execution method and system for streaming document analysis - Google Patents

Parallel execution method and system for streaming document analysis Download PDF

Info

Publication number
CN112613276A
CN112613276A CN202011584607.0A CN202011584607A CN112613276A CN 112613276 A CN112613276 A CN 112613276A CN 202011584607 A CN202011584607 A CN 202011584607A CN 112613276 A CN112613276 A CN 112613276A
Authority
CN
China
Prior art keywords
coroutine
switching
document
appointed
context
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202011584607.0A
Other languages
Chinese (zh)
Other versions
CN112613276B (en
Inventor
潘飚
殷博
袁春峰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nanjing Zhongfu Information Technology Co Ltd
Original Assignee
Nanjing Zhongfu Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanjing Zhongfu Information Technology Co Ltd filed Critical Nanjing Zhongfu Information Technology Co Ltd
Priority to CN202011584607.0A priority Critical patent/CN112613276B/en
Publication of CN112613276A publication Critical patent/CN112613276A/en
Application granted granted Critical
Publication of CN112613276B publication Critical patent/CN112613276B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/10Text processing
    • G06F40/12Use of codes for handling textual entities
    • G06F40/149Adaptation of the text data for streaming purposes, e.g. Efficient XML Interchange [EXI] format
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5027Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5061Partitioning or combining of resources
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/22Parsing or analysis of headers
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2209/00Indexing scheme relating to G06F9/00
    • G06F2209/50Indexing scheme relating to G06F9/50
    • G06F2209/5018Thread allocation

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Computational Linguistics (AREA)
  • General Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Health & Medical Sciences (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computer Security & Cryptography (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)
  • Document Processing Apparatus (AREA)

Abstract

The invention discloses a parallel execution method and a system for analyzing a streaming document, wherein the method comprises the following steps: s1, receiving the document and starting the stream analysis service; s2, creating a work thread group by adopting a preset method; s3, by acquiring the data packet, searching the coroutine context, and realizing the switching from the working thread to the appointed coroutine; s4, after switching to the appointed coordination, analyzing the message; s5, completing the processing of the message, and adopting a preset rule to realize the switching from the appointed coroutine to the working thread; and S6, ending the document processing and releasing the appointed coroutine. Has the advantages that: the invention introduces coroutine technology into the stream analysis, and complex context switching is not needed because the coroutine switching can automatically recover the call stack of the function. And the coroutine switching is completed in a user mode, so that the efficiency can be very high. Meanwhile, the number of threads for executing coroutines can be determined according to needs, so that multi-core CPU resources of the system can be fully utilized.

Description

Parallel execution method and system for streaming document analysis
Technical Field
The invention relates to the technical field of document parsing, in particular to a parallel execution method and system for streaming document parsing.
Background
In network security technology, traffic restoration is a basic technical means. In order to quickly and real-timely discover behaviors such as attacks, intrusions, and divulgences in network traffic, stream analysis of files in the network traffic becomes a necessary means: i.e. the parsing of the document is started when only part of the content of the document is captured.
Although streaming document parsing can timely discover document content transmitted in a network, it also faces several difficulties, one of which is: how to solve the concurrency problem, documents transmitted simultaneously in the network may be hundreds to thousands, and which document the next incoming message belongs to is uncertain, and how to simply and efficiently process the documents becomes a problem which must be faced.
Currently, there are two main solutions:
1. multithreading: and a parsing thread is created for each document to process, and the other distribution thread is responsible for collecting the data packets and distributing the received data packets to the correct parsing thread. For a parse thread, work only in the context of one file. The scheme has the advantages of simple implementation, obvious defects, more resources and unsuitability for large-flow network environment.
2. Single-thread mode: only one thread is responsible for analyzing the documents, the thread records the context information of all the documents, when a data packet is received, the corresponding context is found, the context environment is recovered, and the subsequent processing is carried out. This approach has the advantage of saving resources, but the programming is relatively complex and the resources of the system are not fully utilized.
An effective solution to the problems in the related art has not been proposed yet.
Disclosure of Invention
The invention provides a parallel execution method and a parallel execution system for stream document parsing, aiming at the problems in the related art, so as to overcome the technical problems in the prior related art.
Therefore, the invention adopts the following specific technical scheme:
according to an aspect of the present invention, there is provided a parallel execution method of streaming document parsing, the method comprising the steps of:
s1, receiving the document and starting the stream analysis service;
s2, creating a work thread group by adopting a preset method;
s3, by acquiring the data packet, searching the coroutine context, and realizing the switching from the working thread to the appointed coroutine;
s4, after switching to the appointed coordination, analyzing the message;
s5, completing the processing of the message, and adopting a preset rule to realize the switching from the appointed coroutine to the working thread;
and S6, ending the document processing and releasing the appointed coroutine.
Further, the preset method is to configure the number of thread groups according to factors including but not limited to hardware configuration or network traffic.
Further, the step of completing the switching from the working thread to the designated coroutine by acquiring the data packet and searching the coroutine context further comprises the following steps:
s31, the main thread reads the data packet from the network equipment, and when a data packet is obtained, the data packet is distributed to the designated working thread according to a certain rule;
s32, the worker thread obtains the data packet from the queue and compares the data packet with the document content, when the document content exists, the coroutine context of the document is searched and processed according to the connection characteristic and the document characteristic, and when the document is a new document, a new coroutine is created by the system;
s33, finding the appointed coroutine through searching or creating, and switching into the appointed coroutine.
Further, the certain rules include, but are not limited to, a five-tuple rule, a source IP address, and a destination address.
Further, the creating a new coroutine by the system further comprises the following steps:
s321, distributing stack resources for the new coroutine;
and S322, creating a new coroutine context.
Further, the finding of the designated coroutine through searching or creating and switching into the designated coroutine further comprises the following steps:
s331, saving the context of the current coroutine;
s332, modifying the current protocol identification;
s333, switching a stack pointer;
s334, calling swapcontext function of the operating system to switch user context.
Further, the preset rule comprises the following steps:
s51, the current appointed protocol hands out the execution right;
s52, switching out the current protocol and returning to the state before entering the specified protocol;
and S53, waiting for the next scheduling.
Further, the step of releasing the specified coroutine after the document processing is finished further comprises the following steps:
s61, releasing resources of the appointed coroutine;
and S62, removing the appointed coroutine from the coroutine list.
Further, the resources include, but are not limited to, stacks and contexts.
According to another aspect of the present invention, there is also provided a parallel execution system for streaming document parsing, the system including:
the starting module is used for receiving the document and starting the stream type analysis service;
the working thread group module is used for establishing a working thread group by adopting a preset method;
the coroutine switching module is used for searching coroutine context by acquiring a data packet and realizing the switching from a working thread to a specified coroutine;
the message analysis module is used for analyzing the message after switching to the specified coordination process;
the working thread switching module is used for processing the message and realizing the switching from the designated coroutine to the working thread by adopting a preset rule;
and the coroutine releasing module is used for releasing the appointed coroutine after the document processing is finished.
The invention has the beneficial effects that:
1. the invention introduces coroutine technology into streaming parsing, coroutine being a lightweight, user-mode, cooperative component that allows execution, suspension, and resumption, is more generic and flexible than subroutines, and is lighter-weight than threads. And complex context switching is not needed because coroutine switching automatically restores the call stack of the function. And the coroutine switching is completed in a user mode, so that the efficiency can be very high. Meanwhile, the number of threads for executing coroutines can be determined according to needs, so that multi-core CPU resources of the system can be fully utilized. The method solves the problem of switching the context of the document in the process of analyzing the streaming document, so that the process of analyzing a plurality of documents simultaneously is similar to the process of independently analyzing one document, thereby greatly simplifying the programming complexity in the process of parallel processing of the plurality of documents.
2. The invention adopts a combination mode of multithreading and multi-coordinated program, thereby not only avoiding the problem of low resource utilization rate in a single-thread mode, but also avoiding the problems of excessive thread quantity and excessive thread switching expense in a multi-thread mode.
3. Because the creation, switching and destruction of the coroutines are all completed in a user mode and do not involve time-consuming system call, the quantity of the coroutines can reach tens of thousands or more, and no additional performance loss is brought. Meanwhile, the application layer is imperceptible due to the switching of the coroutines, so that the application layer looks like independently processing a document without complex operations such as context switching, recovery and the like, and the programming complexity is greatly reduced.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings needed in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.
FIG. 1 is a flow diagram of a method for parallel execution of streaming document parsing in accordance with an embodiment of the present invention;
FIG. 2 is a schematic diagram of a structure of co-programmed streaming document parsing in a parallel execution method of streaming document parsing according to an embodiment of the present invention;
FIG. 3 is a system block diagram of a parallel execution system for streaming document parsing in accordance with an embodiment of the present invention.
In the figure:
1. a starting module; 2. a work thread group module; 3. a coroutine switching module; 4. a message parsing module; 5. a working thread switching module; 6. and a coroutine releasing module.
Detailed Description
For further explanation of the various embodiments, the drawings which form a part of the disclosure and which are incorporated in and constitute a part of this specification, illustrate embodiments and, together with the description, serve to explain the principles of operation of the embodiments, and to enable others of ordinary skill in the art to understand the various embodiments and advantages of the invention, and, by reference to these figures, reference is made to the accompanying drawings, which are not to scale and wherein like reference numerals generally refer to like elements.
According to the embodiment of the invention, a parallel execution method and a system for streaming document parsing are provided.
The present invention will be further described with reference to the accompanying drawings and detailed description, wherein as shown in fig. 1-2, a method for parallel execution of streaming document parsing according to an embodiment of the present invention includes the following steps:
s1, receiving the document and starting the stream analysis service;
s2, creating a work thread group by adopting a preset method;
these thread groups are responsible for the real execution of the parsing function, and once created, the threads are not adjusted. The way of creating the work thread group may use a thread creation method provided by an operating system (e.g., pthread _ create method under linux, CreateThread method under windows platform). These groups of worker threads execute the same logic: circularly obtain data packets from the message queue of the user and schedule a proper coroutine to complete the analysis of the data packets,
s3, by acquiring the data packet, searching the coroutine context, and realizing the switching from the working thread to the appointed coroutine;
the work process that the worker thread obtains the data packet from the queue is similar to the traditional packet analysis process, and the difference is mainly as follows: after the data packet is acquired, the data packet is not directly analyzed, but is distributed to the message opponents of the working thread.
S4, after switching to the appointed coordination, analyzing the message;
s5, completing the processing of the message, and adopting a preset rule to realize the switching from the appointed coroutine to the working thread;
and S6, ending the document processing and releasing the appointed coroutine.
In one embodiment, the preset method is to configure the number of thread groups according to factors including but not limited to hardware configuration or network traffic
In one embodiment, the step of completing the switching from the working thread to the designated coroutine by obtaining the data packet and searching the coroutine context further comprises the following steps:
s31, the main thread reads the data packet from the network equipment, and when a data packet is obtained, the data packet is distributed to the designated working thread according to a certain rule;
s32, the worker thread obtains the data packet from the queue and compares the data packet with the document content, when the document content exists, the coroutine context of the document is searched and processed according to the connection characteristic and the document characteristic, and when the document is a new document, a new coroutine is created by the system;
s33, finding the appointed coroutine through searching or creating, and switching into the appointed coroutine.
In one embodiment, the certain rules include, but are not limited to, a five-tuple rule, a source IP address, and a destination address.
In one embodiment, the creating a new coroutine with the system further comprises the steps of:
s321, distributing stack resources for the new coroutine;
and S322, creating a new coroutine context.
In one embodiment, the finding the designated coroutine through searching or creating and switching into the designated coroutine further comprises the following steps:
s331, saving the context of the current coroutine;
s332, modifying the current protocol identification;
s333, switching a stack pointer;
s334, calling swapcontext function of the operating system to switch user context.
In one embodiment, the preset rule comprises the steps of:
s51, the current appointed protocol hands out the execution right;
s52, switching out the current protocol and returning to the state before entering the specified protocol;
and S53, waiting for the next scheduling.
In one embodiment, the document processing is finished, and the releasing the specified coroutine further comprises the following steps:
s61, releasing resources of the appointed coroutine;
and S62, removing the appointed coroutine from the coroutine list.
In one embodiment, the resources include, but are not limited to, stacks and contexts.
According to another embodiment of the present invention, as shown in the figure, there is also provided a parallel execution system for streaming document parsing, including:
the starting module 1 is used for receiving the document and starting the stream type analysis service;
a working thread group module 5, configured to create a working thread group by using a preset method;
the coroutine switching module 3 is used for searching coroutine context by acquiring a data packet and realizing the switching from a working thread to a specified coroutine;
the message analysis module 4 is used for analyzing the message after switching to the designated protocol;
the working thread switching module 5 is used for processing the message and realizing the switching from the designated coroutine to the working thread by adopting a preset rule;
and the coroutine releasing module 6 is used for releasing the appointed coroutine after the document processing is finished.
In summary, with the above technical solution of the present invention, the coroutine technology is introduced into the streaming analysis, and since the coroutine switching automatically restores the call stack of the function, no complex context switching is required. And the coroutine switching is completed in a user mode, so that the efficiency can be very high. Meanwhile, the number of threads for executing coroutines can be determined according to needs, so that multi-core CPU resources of the system can be fully utilized. The method solves the problem of switching the context of the document in the process of analyzing the streaming document, so that the process of analyzing a plurality of documents simultaneously is similar to the process of independently analyzing one document, thereby greatly simplifying the programming complexity in the process of parallel processing of the plurality of documents. The invention adopts a combination mode of multithreading and multi-coordinated program, thereby not only avoiding the problem of low resource utilization rate in a single-thread mode, but also avoiding the problems of excessive thread quantity and excessive thread switching expense in a multi-thread mode. Because the creation, switching and destruction of the coroutines are all completed in a user mode and do not involve time-consuming system call, the quantity of the coroutines can reach tens of thousands or more, and no additional performance loss is brought. Meanwhile, the application layer is imperceptible due to the switching of the coroutines, so that the application layer looks like independently processing a document without complex operations such as context switching, recovery and the like, and the programming complexity is greatly reduced.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.

Claims (10)

1. A method for parallel execution of streaming document parsing, the method comprising the steps of:
s1, receiving the document and starting the stream analysis service;
s2, creating a work thread group by adopting a preset method;
s3, by acquiring the data packet, searching the coroutine context, and realizing the switching from the working thread to the appointed coroutine;
s4, after switching to the appointed coordination, analyzing the message;
s5, completing the processing of the message, and adopting a preset rule to realize the switching from the appointed coroutine to the working thread;
and S6, ending the document processing and releasing the appointed coroutine.
2. The method of claim 1, wherein the predetermined method is to configure the number of thread groups according to factors including but not limited to hardware configuration or network traffic.
3. The method of claim 1, wherein the step of completing the switching of the working thread to the designated coroutine by obtaining the data packet, searching the coroutine context, and obtaining the coroutine context further comprises the steps of:
s31, the main thread reads the data packet from the network equipment, and when a data packet is obtained, the data packet is distributed to the designated working thread according to a certain rule;
s32, the worker thread obtains the data packet from the queue and compares the data packet with the document content, when the document content exists, the coroutine context of the document is searched and processed according to the connection characteristic and the document characteristic, and when the document is a new document, a new coroutine is created by the system;
s33, finding the appointed coroutine through searching or creating, and switching into the appointed coroutine.
4. The method of claim 3, wherein the certain rules include, but are not limited to, a quintuple rule, a source IP address, and a destination address.
5. The method of claim 3, wherein creating a new coroutine with the system further comprises:
s321, distributing stack resources for the new coroutine;
and S322, creating a new coroutine context.
6. The method of claim 3, wherein the finding the specified protocol by searching or creating and switching into the specified protocol further comprises:
s331, saving the context of the current coroutine;
s332, modifying the current protocol identification;
s333, switching a stack pointer;
and S334, calling an exchange context function of the operating system to switch the user context.
7. The method of claim 1, wherein the preset rule comprises the following steps:
s51, the current appointed protocol hands out the execution right;
s52, switching out the current protocol and returning to the state before entering the specified protocol;
and S53, waiting for the next scheduling.
8. The method of claim 1, wherein the step of releasing the specified coroutine after the document processing is finished further comprises the steps of:
s61, releasing resources of the appointed coroutine;
and S62, removing the appointed coroutine from the coroutine list.
9. The method of claim 8, wherein the resources include, but are not limited to, stack and context.
10. A parallel execution system for streaming document parsing, for performing steps of a parallel execution method for streaming document parsing as claimed in any one of claims 1-9, the system comprising:
the starting module is used for receiving the document and starting the stream type analysis service;
the working thread group module is used for establishing a working thread group by adopting a preset method;
the coroutine switching module is used for searching coroutine context by acquiring a data packet and realizing the switching from a working thread to a specified coroutine;
the message analysis module is used for analyzing the message after switching to the specified coordination process;
the working thread switching module is used for processing the message and realizing the switching from the designated coroutine to the working thread by adopting a preset rule;
and the coroutine releasing module is used for releasing the appointed coroutine after the document processing is finished.
CN202011584607.0A 2020-12-28 2020-12-28 Parallel execution method and system for stream type document analysis Active CN112613276B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011584607.0A CN112613276B (en) 2020-12-28 2020-12-28 Parallel execution method and system for stream type document analysis

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011584607.0A CN112613276B (en) 2020-12-28 2020-12-28 Parallel execution method and system for stream type document analysis

Publications (2)

Publication Number Publication Date
CN112613276A true CN112613276A (en) 2021-04-06
CN112613276B CN112613276B (en) 2024-06-18

Family

ID=75248542

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011584607.0A Active CN112613276B (en) 2020-12-28 2020-12-28 Parallel execution method and system for stream type document analysis

Country Status (1)

Country Link
CN (1) CN112613276B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113608843A (en) * 2021-07-08 2021-11-05 广东开放大学(广东理工职业学院) Coroutine implementation method and system
WO2023280097A1 (en) * 2021-07-08 2023-01-12 华为技术有限公司 Method for processing page faults and corresponding apparatus

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106209684A (en) * 2016-07-14 2016-12-07 深圳市永达电子信息股份有限公司 A kind of method forwarding detection scheduling based on Time Triggered
CN109298922A (en) * 2018-08-30 2019-02-01 百度在线网络技术(北京)有限公司 Parallel task processing method, association's journey frame, equipment, medium and unmanned vehicle
CN109995758A (en) * 2019-02-28 2019-07-09 北京创鑫旅程网络技术有限公司 Data parallel processing method and device
CN110445669A (en) * 2019-06-26 2019-11-12 苏州浪潮智能科技有限公司 A kind of monitoring method, equipment and the readable medium of the server based on association's journey
CN111078628A (en) * 2018-10-18 2020-04-28 深信服科技股份有限公司 Multi-disk concurrent data migration method, system, device and readable storage medium
CN112001164A (en) * 2020-10-27 2020-11-27 南京中孚信息技术有限公司 Document content streaming analysis method and system
CN112104679A (en) * 2019-06-17 2020-12-18 北京京东尚科信息技术有限公司 Method, apparatus, device and medium for processing hypertext transfer protocol request

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106209684A (en) * 2016-07-14 2016-12-07 深圳市永达电子信息股份有限公司 A kind of method forwarding detection scheduling based on Time Triggered
CN109298922A (en) * 2018-08-30 2019-02-01 百度在线网络技术(北京)有限公司 Parallel task processing method, association's journey frame, equipment, medium and unmanned vehicle
CN111078628A (en) * 2018-10-18 2020-04-28 深信服科技股份有限公司 Multi-disk concurrent data migration method, system, device and readable storage medium
CN109995758A (en) * 2019-02-28 2019-07-09 北京创鑫旅程网络技术有限公司 Data parallel processing method and device
CN112104679A (en) * 2019-06-17 2020-12-18 北京京东尚科信息技术有限公司 Method, apparatus, device and medium for processing hypertext transfer protocol request
CN110445669A (en) * 2019-06-26 2019-11-12 苏州浪潮智能科技有限公司 A kind of monitoring method, equipment and the readable medium of the server based on association's journey
CN112001164A (en) * 2020-10-27 2020-11-27 南京中孚信息技术有限公司 Document content streaming analysis method and system

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113608843A (en) * 2021-07-08 2021-11-05 广东开放大学(广东理工职业学院) Coroutine implementation method and system
WO2023280097A1 (en) * 2021-07-08 2023-01-12 华为技术有限公司 Method for processing page faults and corresponding apparatus
CN113608843B (en) * 2021-07-08 2023-08-25 广东开放大学(广东理工职业学院) Coroutine implementation method and system

Also Published As

Publication number Publication date
CN112613276B (en) 2024-06-18

Similar Documents

Publication Publication Date Title
CN110908788B (en) Spark Streaming based data processing method and device, computer equipment and storage medium
CN109445944B (en) DPDK-based network data acquisition and processing system and method thereof
CN106844017B (en) Method and device for processing events by website server
CN110058987B (en) Method, apparatus, and computer readable medium for tracking a computing system
CN102868635B (en) The message order-preserving method of Multi-core and system
WO2021042840A1 (en) Data processing method and apparatus, server, and computer-readable storage medium
US20090070773A1 (en) Method for efficient thread usage for hierarchically structured tasks
CN112613276A (en) Parallel execution method and system for streaming document analysis
CN108123820B (en) Network equipment information acquisition method and device
CN101282300B (en) Method for processing HTTP packet based on non-blockage mechanism
CN103092682A (en) Asynchronous network application program processing method
CN107193674B (en) Method and device for processing online push message
US10498817B1 (en) Performance tuning in distributed computing systems
CN113259415B (en) Network message processing method and device and network server
CN114880159B (en) Data processing method, device, equipment and storage medium
CN107623731A (en) A kind of method for scheduling task, client, service cluster and system
WO2023046141A1 (en) Acceleration framework and acceleration method for database network load performance, and device
CN111158876B (en) Log processing method, device, equipment and computer readable storage medium
CN115794313A (en) Virtual machine debugging method, system, electronic equipment and storage medium
CN113626173B (en) Scheduling method, scheduling device and storage medium
CN115794355A (en) Task processing method and device, terminal equipment and storage medium
CN113347430B (en) Distributed scheduling device of hardware transcoding acceleration equipment and use method thereof
CN113031569B (en) Monitoring method, system, terminal and medium of nuclear fusion control system
CN113596170A (en) Load balancing equipment-based shutdown processing method, device, medium and equipment
CN113407634A (en) Data synchronization method, device, system, server and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant