CN110427293A - Application processing method, device, equipment and medium - Google Patents
Application processing method, device, equipment and medium Download PDFInfo
- Publication number
- CN110427293A CN110427293A CN201910709067.5A CN201910709067A CN110427293A CN 110427293 A CN110427293 A CN 110427293A CN 201910709067 A CN201910709067 A CN 201910709067A CN 110427293 A CN110427293 A CN 110427293A
- Authority
- CN
- China
- Prior art keywords
- target
- congestion
- data
- calculate node
- performance
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/22—Detection or location of defective computer hardware by testing during standby operation or during idle time, e.g. start-up testing
- G06F11/26—Functional testing
- G06F11/263—Generation of test inputs, e.g. test vectors, patterns or sequences ; with adaptation of the tested hardware for testability with external testers
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5011—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals
- G06F9/5016—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals the resource being the memory
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2209/00—Indexing scheme relating to G06F9/00
- G06F2209/50—Indexing scheme relating to G06F9/50
- G06F2209/501—Performance criteria
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Debugging And Monitoring (AREA)
Abstract
The embodiment of the invention discloses a kind of application processing method, device, equipment and media, are related to technical field of data processing.This method comprises: determining the real-time stream that target application generates in target application implementation procedure；The target data for belonging to target signature is extracted from the real-time stream；The performance of the target application is determined according to the target data of extraction.A kind of application processing method, device, equipment and medium provided in an embodiment of the present invention reduce the linkage length of data processing, the consumption of third party's service end computing resource and third party system and build cost.
Description
Technical field
The present embodiments relate to technical field of data processing more particularly to a kind of application processing method, device, equipment and
Medium.
Background technique
With the development of big data technology, large-scale data processing technique has become the standard configuration of enterprise, data meter
The long-time span for calculating result is outdated, postpones lower streaming computing technology and becomes more and more important.Streaming computing
It is using limited computing resource, come the system for realizing endless data calculating.
Streaming computing method in the prior art are as follows: requested at application service end customer in response end, the mistake of performance objective application
Cheng Zhong, third party's service end obtain the execution journal of target application from application service end, target to be analyzed are extracted from log
Index carries out the data processing of setting service to the execution of target application according to target indicator, and processing result is fed back to and is answered
Use server-side.
However, the above method has following defects that the connection at third party's service end causes the link of data processing to lengthen；The
The process that tripartite's server-side extracts target indicator to be analyzed from log can consume extra storage resource, need to build third party's clothes
The data processing system at business end.
Summary of the invention
The embodiment of the present invention provides a kind of application processing method, device, equipment and medium, to reduce the link of data processing
Length, the consumption of third party's service end computing resource and third party system build cost.
In a first aspect, the embodiment of the invention provides a kind of application processing methods, this method comprises:
In target application implementation procedure, the real-time stream that target application generates is determined；
The target data for belonging to target signature is extracted from the real-time stream；
The performance of the target application is determined according to the target data of extraction.
Second aspect applies processing unit the embodiment of the invention also provides a kind of, which includes:
Data flow determining module, the real-time stream generated in target application implementation procedure, determining target application；
Target data extraction module, for extracting the target data for belonging to target signature from the real-time stream；
Performance determining module determines the performance of the target application for the target data according to extraction.
The third aspect, the embodiment of the invention also provides a kind of equipment, the equipment includes:
One or more processors；
Storage device, for storing one or more programs,
When one or more of programs are executed by one or more of processors, so that one or more of processing
Device realizes the application processing method as described in any one of embodiment of the present invention.
Fourth aspect, the embodiment of the invention also provides a kind of computer readable storage mediums, are stored thereon with computer
Program realizes the application processing method as described in any one of embodiment of the present invention when the program is executed by processor.
The embodiment of the present invention belongs to the target data of target signature by extracting from the real-time stream；According to extraction
Target data determine the performance of the target application, to realize the real-time analysis for carrying out performance to target application.On because
Data handling procedure is stated without the application to third party's service end, so reducing consumption and the third party of third party's computing resource
System building cost.
In addition, because decreasing the linkage length of data processing without sending data to third party's service end.
Detailed description of the invention
Fig. 1 is a kind of flow chart for application processing method that the embodiment of the present invention one provides；
Fig. 2 is a kind of flow chart of application processing method provided by Embodiment 2 of the present invention；
Fig. 3 is a kind of execution schematic diagram for application processing method that the embodiment of the present invention three provides；
Fig. 4 is a kind of analysis result bandwagon effect schematic diagram that the embodiment of the present invention three provides；
Fig. 5 is a kind of structural schematic diagram using processing unit that the embodiment of the present invention four provides；
Fig. 6 is a kind of structural schematic diagram for equipment that the embodiment of the present invention five provides.
Specific embodiment
The present invention is described in further detail with reference to the accompanying drawings and examples.It is understood that this place is retouched
The specific embodiment stated is used only for explaining the present invention rather than limiting the invention.It also should be noted that in order to just
Only the parts related to the present invention are shown in description, attached drawing rather than entire infrastructure.
Embodiment one
Fig. 1 is a kind of flow chart for application processing method that the embodiment of the present invention one provides.The present embodiment is applicable to base
In target application generate real-time stream, to target application carry out Analyzing Real-Time Performance the case where.This method can be by one kind
It is executed using processing unit.The device can be realized by the mode of software and/or hardware.Optionally, which can configure
In application service end or client.Referring to Fig. 1, application processing method provided in this embodiment includes:
S110, in target application implementation procedure, determine target application generate real-time stream.
Wherein, target application is the application determined to performance, which can be the application of any logic, the present embodiment pair
This and without any restrictions.
The real-time stream that target application generates is that performance objective in application, respectively produce using logic in real time in target application
Raw data flow.
Specifically, in target application implementation procedure, the real-time stream that target application generates is determined, comprising:
In target application implementation procedure, the real-time stream that the associated each calculate node of target application generates is determined, it will
The real-time stream that the associated each calculate node of target application generates, the real-time stream generated as the target application.
Wherein, target application includes at least two logic units (Processor), at least two logic units composition
The directed acyclic graph (DAG, topological diagram) of streaming computing is described.Each logic unit includes at least one concurrent example
(instance), each example is executed by an entity calculate node.Therefore, target application is associated at least one calculate node.
Optionally, in target application implementation procedure, the real-time stream that target application generates is determined, comprising:
In target application implementation procedure, each real time output data using logic of target application is obtained, will acquire
The real-time stream respectively generated using the real time output data of logic as target application.
S120, the target data for belonging to target signature is extracted from the real-time stream.
Wherein, target signature refers to that target capabilities determine required feature.
Target capabilities refer to the performance to be detected of target application.
Target data is to belong to the data of target signature in the real-time stream.
Specifically, described before extraction belongs to the target data of target signature in the real-time stream, the method
Further include:
Obtain target application target capabilities to be detected；
According to the mapping relations between candidate performance and candidate feature, the spy of target associated by the target capabilities is determined
Sign.
According to the mapping relations between candidate performance and candidate feature, the spy of target associated by the target capabilities is determined
Sign, comprising:
The target capabilities are matched with candidate performance, the candidate feature for matching consistent candidate Properties Correlation is made
For target signature.
Specifically, the target data for belonging to target signature is extracted from the real-time stream, comprising:
The data characteristics for determining real time data in the real-time stream carries out determining data characteristics and target signature
Matching；
Consistent real time data will be matched as target data.
S130, the performance that the target application is determined according to the target data of extraction.
It is alternatively possible to determine the target application using the target data of extraction based on any method for testing performance
Performance.
The technical solution of the embodiment of the present invention belongs to the number of targets of target signature by extracting from the real-time stream
According to；The performance of the target application is determined according to the target data of extraction, and the real-time of performance is carried out to target application to realize
Analysis.Because above-mentioned data handling procedure reduces third party's computing resource without the application to third party's service end
It consumes and third party system builds cost.
In addition, because decreasing the linkage length of data processing without sending data to third party's service end.
Embodiment two
Fig. 2 is a kind of flow chart of application processing method provided by Embodiment 2 of the present invention.The present embodiment is in above-mentioned reality
Apply a kind of optinal plan proposed on the basis of example.Referring to fig. 2, application processing method provided in this embodiment includes:
S210, in target application implementation procedure, determine target application generate real-time stream.
S220, the target data for belonging to target signature is extracted from the real-time stream.
If S230, the target data according to any calculate node of extraction, determine the calculate node congestion, it is determined that the meter
The affiliated logic unit congestion of operator node.
Wherein, any of the above-described calculate node is associated with target application.
Specifically, the target data of any calculate node according to extraction, determine the calculate node whether congestion, packet
It includes:
According to the target data of any calculate node of extraction, the output data of the calculate node is determined, for detecting
When downstream calculate node reads any output data of the calculate node, the output data is deleted；
According to the remaining output data quantity of the calculate node, determine the calculate node whether congestion.
Wherein, the remaining output data of the calculate node refers to, calculate node output, but does not flow to downstream node
Data.
Specifically, according to the remaining output data quantity of the calculate node, determine the calculate node whether congestion, comprising:
If the remaining output data quantity of the calculate node is greater than setting amount threshold, it is determined that the calculate node congestion；
Or
The data volume for determining the output data of the associated result output queue storage of the calculate node, exports with the result
The ratio of total storage data quantity of queue；Wherein, the associated result output queue of the calculate node is for caching the calculate node
Output data, read the output data of the calculate node from the result output queue for downstream calculate node, and will read
Output data deleted from the result output queue；
If the ratio is greater than setting fractional threshold, it is determined that the calculate node congestion.
S240, by the topological structure between the congestion logic unit with connection relationship, as congestion topological structure.
Wherein, congestion logic unit refers to the logic unit there are congestion, which belongs to what target application included
Logic unit set, the logic unit collection are combined into the directed acyclic graph (DAG, topological diagram) of description streaming computing.
S250, by congested nodes, the downstream node connected in the congestion logic unit of most downstream in congestion topological structure
As abnormal nodes.
Wherein, abnormal nodes refer in the presence of abnormal calculate node.
Because abnormal nodes can reduce calculating speed or stop calculating, the upstream meter connecting with abnormal nodes will lead to
The congestion of operator node.Therefore by being connected described in congested nodes in the congestion logic unit of most downstream in detection congestion topological structure
Downstream node, the detection of abnormal nodes may be implemented.
The technical solution that the present invention is implemented determines congestion meter by the target data according to any calculate node of extraction
Operator node and congestion logic unit；Congestion topological structure is determined according to congestion logic unit；According to congestion calculate node and congestion
Topological structure determines abnormal nodes, so that the real-time detection to calculate node abnormal in target application is realized, and if then solving to meet
Burning issue on to line, can not rapid and convenient obtain and abnormal exit reason and cause the full link back-pressure (Back of streaming computing
Pressure the problem of abnormal nodes).
For convenience of being checked to abnormal nodes information, it is described will be in the congestion logic unit of most downstream in congestion topological structure
Congested nodes, after the downstream node connected is as abnormal nodes, the method also includes:
To the abnormal nodes, the affiliated logic unit of abnormal nodes, the target of congestion topological structure and the abnormal nodes
At least one in data is shown, so that user checks.
Embodiment three
Fig. 3 is a kind of execution schematic diagram for application processing method that the embodiment of the present invention three provides.The present embodiment is upper
State a kind of optinal plan proposed on the basis of embodiment.Referring to Fig. 3, application processing method provided in this embodiment includes:
During target application executes, the associated calculate node of target application can be by the output number with target signature
According to application management unit is sent to, received data can converge and manage by application management unit；
Performance analysis unit is after detecting to target application progress target capabilities definite event, from the application management
Unit obtains the target data through overconvergence and management, wherein the target data is the output number with target signature
According to；
Performance analysis unit carries out the analysis of target capabilities using the target data obtained to the target application, and will divide
Analysis result is showed in user interface, checks for user.
Wherein, application management unit and performance analysis unit are arranged at the actuating station of target application.
Therefore, by can converge and manage to received data by application management unit, thus realize without according to
Rely the convergence and management of external module convection type calculate node output data.
Specifically, performance analysis unit is after detecting and carrying out target capabilities definite event to target application, from described
Application management unit obtains the target data through overconvergence and management, comprising:
After performance analysis unit obtains the data flow congestion threshold value of user's input, to application management unit requests target indicator
Data (namely target data), and obtain the target indicator data that application management unit responds request return.
Correspondingly, abnormal nodes positioning is carried out to the target application using the target indicator data of acquisition, comprising:
According to the target indicator data of any calculate node of acquisition, the associated result output queue of the calculate node is determined
The data volume of the output data of storage；
Wherein, the associated result output queue of the calculate node is used to cache the output data of the calculate node, for downstream
Calculate node reads the output data of the calculate node from the result output queue, and by the output data of reading from the result
It is deleted in output queue；
If the data volume of the output data of storage is greater than the data flow congestion threshold value of user's input, it is determined that the calculate node
Congestion；
By the topological structure between the congestion logic unit with connection relationship, as congestion topological structure；
By congested nodes in the congestion logic unit of most downstream in congestion topological structure, the downstream node connected is as different
Chang Jiedian；
To the abnormal nodes, the affiliated logic unit of abnormal nodes, the target of congestion topological structure and the abnormal nodes
At least one in achievement data is shown.
Specific exhibition method is described as follows referring to fig. 4:
In the topological diagram that the logic unit of target application forms, whether there is abnormal meter by the characterization of calculate node
Operator node (red indicate abnormal), by the color of directed edge between logic unit indicate the data flow whether congestion.
By there is the data subscription relationship of topological diagram, it can be clearly seen in target application and cause back-pressure (namely congestion) existing
Position of the logic unit of elephant in topology.Exception example in back-pressure logic unit (example that abnormal nodes calculate) simultaneously
It can list in detail.
Meanwhile showing the target indicator data for all logic units that target application includes, by understanding based on current streaming
It can be regarded as each target indicator data of each logic unit of industry.And wherein abnormal data information mark is red, to cause in positioning topology
The abnormal cause of back-pressure logic unit provides intuitive, strong, quick positioning question information.
As shown in figure 4, it is red to cause the logic unit (namely logic unit 5) of back-pressure phenomenon to be marked in topological diagram.
Since logic unit 5 is there are exception example, cause its all upstream logic unit in topological relation that a kind of back-pressure is all presented
State (upstream data flow congestion), so the directed edge between the logic unit of 5 upstream of logic unit has been denoted as red.
Since logic unit 4 and logic unit 5 do not have upstream and downstream dependence, so not abnormal by logic unit 5
Influence, the directed edge from logic unit 1 to logic unit 4 is not designated as red.
Meanwhile abnormal index value x, y existing for logic unit 5 are marked in the table of index convergence, and be labeled as red,
The sequence number (0,1,3) that logic unit 5 is existed to abnormal example is shown in the table of exception example.
It is realized by above-mentioned exhibition method and graphically analyzes result to user's display performance.
User can also select reasonable data congestion threshold value to realize and customize positioning service according to business feature.
The technical solution of the embodiment of the present invention is answered by the way that application management unit and performance analysis unit are arranged at target
Actuating station needs not rely on additional system to realize that index reports, polymerization, accesses integrated design.
By carrying out abnormal nodes positioning to the target application using the target indicator data obtained, thus problem of implementation
Positioning in real time.
By to the abnormal nodes, the affiliated logic unit of abnormal nodes, congestion topological structure and the abnormal nodes
Target indicator data are shown, to realize the interaction design for use habit of being close to the users, user are facilitated directly to position exception
Node shows that exception exits problem.
The present embodiment has simply and easily got through streaming computing index and has reported, polymerize, access link, nothing transparent to business
Extra resource consumption.
It should be noted that by the technical teaching of the present embodiment, those skilled in the art have motivation by above-described embodiment
Described in any embodiment carry out the combination of scheme, to reduce the linkage length of data processing, in terms of third party's service end
Cost is built in the consumption and third party system for calculating resource.
Example IV
Fig. 5 is a kind of structural schematic diagram using processing unit that the embodiment of the present invention four provides.Referring to Fig. 5, this implementation
The application processing unit of offer includes: data flow determining module 10, target data extraction module 20 and performance determining module 30.
Wherein, data flow determining module 10, in target application implementation procedure, determining that target application generates real-time
Data flow；
Target data extraction module 20, for extracting the target data for belonging to target signature from the real-time stream；
Performance determining module 30 determines the performance of the target application for the target data according to extraction.
The technical solution of the embodiment of the present invention belongs to the number of targets of target signature by extracting from the real-time stream
According to；The performance of the target application is determined according to the target data of extraction, and the real-time of performance is carried out to target application to realize
Analysis.Because above-mentioned data handling procedure reduces third party's computing resource without the application to third party's service end
It consumes and third party system builds cost.
In addition, because decreasing the linkage length of data processing without sending data to third party's service end.
Further, described device further include: target capabilities obtain module and target signature determining module.
Wherein, target capabilities obtain module, and the mesh of target signature is belonged to for the extraction from the real-time stream
Before marking data, target application target capabilities to be detected are obtained；
Target signature determining module, for determining the mesh according to the mapping relations between candidate performance and candidate feature
Mark target signature associated by performance.
Further, the performance determining module, comprising: congested nodes determination unit, congestion topology determination unit and different
Chang Jiedian determination unit.
Wherein, congested nodes determination unit, if determining the meter for the target data according to any calculate node of extraction
Operator node congestion, it is determined that the affiliated logic unit congestion of the calculate node；
Congestion topology determination unit, for that will have the topological structure between the congestion logic unit of connection relationship, as
Congestion topological structure；
Abnormal nodes determination unit, for by congested nodes in the congestion logic unit of most downstream in congestion topological structure,
The downstream node connected is as abnormal nodes.
Further, the congested nodes determination unit is specifically used for:
According to the target data of any calculate node of extraction, the output data of the calculate node is determined, for detecting
When downstream calculate node reads any output data of the calculate node, the output data is deleted；
According to the remaining output data quantity of the calculate node, determine the calculate node whether congestion.
Further, described device further include: abnormal display module.
Wherein, abnormal display module, for described by congestion in the congestion logic unit of most downstream in congestion topological structure
Node after the downstream node connected is as abnormal nodes, to the abnormal nodes, the affiliated logic unit of abnormal nodes, is gathered around
At least one in the target data of stifled topological structure and the abnormal nodes is shown.
Further, the performance determining module, comprising: target data collection unit and capabilities determination unit.
Wherein, target data collection unit, for summarizing to the target data of extraction；
Capabilities determination unit, if being summarized for detecting that the performance of the target application determines event according to process
Target data determines the performance of the target application.
It can be performed at application provided by any embodiment of the invention provided by the embodiment of the present invention using processing unit
Reason method has the corresponding functional module of execution method and beneficial effect.
Embodiment five
Fig. 6 is a kind of structural schematic diagram for equipment that the embodiment of the present invention five provides.Fig. 6, which is shown, to be suitable for being used to realizing this
The block diagram of the example devices 12 of invention embodiment.The equipment 12 that Fig. 6 is shown is only an example, should not be to of the invention real
The function and use scope for applying example bring any restrictions.
As shown in fig. 6, equipment 12 is showed in the form of universal computing device.The component of equipment 12 may include but unlimited
In one or more processor or processing unit 16, system storage 28, connecting different system components, (including system is deposited
Reservoir 28 and processing unit 16) bus 18.
Bus 18 indicates one of a few class bus structures or a variety of, including memory bus or Memory Controller,
Peripheral bus, graphics acceleration port, processor or the local bus using any bus structures in a variety of bus structures.It lifts
For example, these architectures include but is not limited to industry standard architecture (ISA) bus, microchannel architecture (MAC)
Bus, enhanced isa bus, Video Electronics Standards Association (VESA) local bus and peripheral component interconnection (PCI) bus.
Equipment 12 typically comprises a variety of computer system readable media.These media can be it is any can be by equipment 12
The usable medium of access, including volatile and non-volatile media, moveable and immovable medium.
System storage 28 may include the computer system readable media of form of volatile memory, such as arbitrary access
Memory (RAM) 30 and/or cache memory 32.Equipment 12 may further include it is other it is removable/nonremovable,
Volatile/non-volatile computer system storage medium.Only as an example, storage system 34 can be used for reading and writing irremovable
, non-volatile magnetic media (Fig. 6 do not show, commonly referred to as " hard disk drive ").Although being not shown in Fig. 6, use can be provided
In the disc driver read and write to removable non-volatile magnetic disk (such as " floppy disk "), and to removable anonvolatile optical disk
The CD drive of (such as CD-ROM, DVD-ROM or other optical mediums) read-write.In these cases, each driver can
To be connected by one or more data media interfaces with bus 18.Memory 28 may include at least one program product,
The program product has one group of (for example, at least one) program module, these program modules are configured to perform each implementation of the invention
The function of example.
Program/utility 40 with one group of (at least one) program module 42 can store in such as memory 28
In, such program module 42 include but is not limited to operating system, one or more application program, other program modules and
It may include the realization of network environment in program data, each of these examples or certain combination.Program module 42 is usual
Execute the function and/or method in embodiment described in the invention.
Equipment 12 can also be communicated with one or more external equipments 14 (such as keyboard, sensing equipment, display 24 etc.),
Can also be enabled a user to one or more equipment interacted with the equipment 12 communication, and/or with enable the equipment 12 with
One or more of the other any equipment (such as network interface card, modem etc.) communication for calculating equipment and being communicated.It is this logical
Letter can be carried out by input/output (I/O) interface 22.Also, equipment 12 can also by network adapter 20 and one or
The multiple networks of person (such as local area network (LAN), wide area network (WAN) and/or public network, such as internet) communication.As shown,
Network adapter 20 is communicated by bus 18 with other modules of equipment 12.It should be understood that although not shown in the drawings, can combine
Equipment 12 use other hardware and/or software module, including but not limited to: microcode, device driver, redundant processing unit,
External disk drive array, RAID system, tape drive and data backup storage system etc..
Processing unit 16 by the program that is stored in system storage 28 of operation, thereby executing various function application and
Data processing, such as realize application processing method provided by the embodiment of the present invention.
Embodiment six
The embodiment of the present invention six additionally provides a kind of computer readable storage medium, is stored thereon with computer program, should
The application processing method as described in any one of embodiment of the present invention is realized when program is executed by processor, this method comprises:
In target application implementation procedure, the real-time stream that target application generates is determined；
The target data for belonging to target signature is extracted from the real-time stream；
The performance of the target application is determined according to the target data of extraction.
The computer storage medium of the embodiment of the present invention, can be using any of one or more computer-readable media
Combination.Computer-readable medium can be computer-readable signal media or computer readable storage medium.It is computer-readable
Storage medium for example may be-but not limited to-the system of electricity, magnetic, optical, electromagnetic, infrared ray or semiconductor, device or
Device, or any above combination.The more specific example (non exhaustive list) of computer readable storage medium includes: tool
There are electrical connection, the portable computer diskette, hard disk, random access memory (RAM), read-only memory of one or more conducting wires
(ROM), erasable programmable read only memory (EPROM or flash memory), optical fiber, portable compact disc read-only memory (CD-
ROM), light storage device, magnetic memory device or above-mentioned any appropriate combination.In this document, computer-readable storage
Medium can be any tangible medium for including or store program, which can be commanded execution system, device or device
Using or it is in connection.
Computer-readable signal media may include in a base band or as carrier wave a part propagate data-signal,
Wherein carry computer-readable program code.The data-signal of this propagation can take various forms, including but unlimited
In electromagnetic signal, optical signal or above-mentioned any appropriate combination.Computer-readable signal media can also be that computer can
Any computer-readable medium other than storage medium is read, which can send, propagates or transmit and be used for
By the use of instruction execution system, device or device or program in connection.
The program code for including on computer-readable medium can transmit with any suitable medium, including --- but it is unlimited
In wireless, electric wire, optical cable, RF etc. or above-mentioned any appropriate combination.
The computer for executing operation of the present invention can be write with one or more programming languages or combinations thereof
Program code, described program design language include object oriented program language-such as Java, Smalltalk, C++,
It further include conventional procedural programming language-such as " C " language or similar programming language.Program code can be with
It fully executes, partly execute on the user computer on the user computer, being executed as an independent software package, portion
Divide and partially executes or executed on a remote computer or server completely on the remote computer on the user computer.In
Be related in the situation of remote computer, remote computer can pass through the network of any kind --- including local area network (LAN) or
Wide area network (WAN)-be connected to subscriber computer, or, it may be connected to outer computer (such as mentioned using Internet service
It is connected for quotient by internet).
Note that the above is only a better embodiment of the present invention and the applied technical principle.It will be appreciated by those skilled in the art that
The invention is not limited to the specific embodiments described herein, be able to carry out for a person skilled in the art it is various it is apparent variation,
It readjusts and substitutes without departing from protection scope of the present invention.Therefore, although being carried out by above embodiments to the present invention
It is described in further detail, but the present invention is not limited to the above embodiments only, without departing from the inventive concept, also
It may include more other equivalent embodiments, and the scope of the invention is determined by the scope of the appended claims.
Claims (14)
1. a kind of application processing method, which is characterized in that this method comprises:
In target application implementation procedure, the real-time stream that target application generates is determined；
The target data for belonging to target signature is extracted from the real-time stream；
The performance of the target application is determined according to the target data of extraction.
2. the method according to claim 1, wherein described extract from the real-time stream belongs to target spy
Before the target data of sign, the method also includes:
Obtain target application target capabilities to be detected；
According to the mapping relations between candidate performance and candidate feature, target signature associated by the target capabilities is determined.
3. the method according to claim 1, wherein the target data according to extraction determines that the target is answered
Performance, comprising:
If determining the calculate node congestion according to the target data of any calculate node of extraction, it is determined that the calculate node institute
Belong to logic unit congestion；
By the topological structure between the congestion logic unit with connection relationship, as congestion topological structure；
By congested nodes in the congestion logic unit of most downstream in congestion topological structure, the downstream node connected is as abnormal section
Point.
4. method according to claim 3, which is characterized in that the target data of any calculate node according to extraction,
Determine the calculate node whether congestion, comprising:
According to the target data of any calculate node of extraction, the output data of the calculate node is determined, for detecting downstream
When calculate node reads any output data of the calculate node, the output data is deleted；
According to the remaining output data quantity of the calculate node, determine the calculate node whether congestion.
5. according to the method described in claim 3, it is characterized in that, the congestion logic by most downstream in congestion topological structure
Congested nodes in unit, after the downstream node connected is as abnormal nodes, the method also includes:
To the abnormal nodes, the affiliated logic unit of abnormal nodes, the target data of congestion topological structure and the abnormal nodes
In at least one of be shown.
6. the method according to claim 1, wherein the target data according to extraction determines that the target is answered
Performance, comprising:
The target data of extraction is summarized；
If detecting, the performance of the target application determines event, determines that the target is answered according to the target data by summarizing
Performance.
7. a kind of apply processing unit, which is characterized in that the device includes:
Data flow determining module, the real-time stream generated in target application implementation procedure, determining target application；
Target data extraction module, for extracting the target data for belonging to target signature from the real-time stream；
Performance determining module determines the performance of the target application for the target data according to extraction.
8. device according to claim 7, which is characterized in that described device further include:
Target capabilities obtain module, for it is described from the real-time stream extract belong to target signature target data it
Before, obtain target application target capabilities to be detected；
Target signature determining module, for determining the Objective according to the mapping relations between candidate performance and candidate feature
Target signature associated by energy.
9. device according to claim 7, which is characterized in that the performance determining module, comprising:
Congested nodes determination unit, if determining that the calculate node is gathered around for the target data according to any calculate node of extraction
It is stifled, it is determined that the affiliated logic unit congestion of the calculate node；
Congestion topology determination unit, for that will have the topological structure between the congestion logic unit of connection relationship, as congestion
Topological structure；
Abnormal nodes determination unit, for by congested nodes, company, institute in the congestion logic unit of most downstream in congestion topological structure
The downstream node connect is as abnormal nodes.
10. device according to claim 9, which is characterized in that the congested nodes determination unit is specifically used for:
According to the target data of any calculate node of extraction, the output data of the calculate node is determined, for detecting downstream
When calculate node reads any output data of the calculate node, the output data is deleted；
According to the remaining output data quantity of the calculate node, determine the calculate node whether congestion.
11. device according to claim 9, which is characterized in that described device further include:
Abnormal display module, for described by congested nodes, company, institute in the congestion logic unit of most downstream in congestion topological structure
After the downstream node connect is as abnormal nodes, to the abnormal nodes, the affiliated logic unit of abnormal nodes, congestion topological structure
It is shown at least one in the target data of the abnormal nodes.
12. device according to claim 7, which is characterized in that the performance determining module, comprising:
Target data collection unit, for summarizing to the target data of extraction；
Capabilities determination unit, if for detecting that the performance of the target application determines event, according to the target by summarizing
Data determine the performance of the target application.
13. a kind of equipment, which is characterized in that the equipment includes:
One or more processors；
Storage device, for storing one or more programs,
When one or more of programs are executed by one or more of processors, so that one or more of processors are real
Now such as application processing method of any of claims 1-6.
14. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the program is by processor
Such as application processing method of any of claims 1-6 is realized when execution.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910709067.5A CN110427293A (en) | 2019-08-01 | 2019-08-01 | Application processing method, device, equipment and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910709067.5A CN110427293A (en) | 2019-08-01 | 2019-08-01 | Application processing method, device, equipment and medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110427293A true CN110427293A (en) | 2019-11-08 |
Family
ID=68413901
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910709067.5A Pending CN110427293A (en) | 2019-08-01 | 2019-08-01 | Application processing method, device, equipment and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110427293A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111177199A (en) * | 2019-12-31 | 2020-05-19 | 中国银行股份有限公司 | Stream type calculation index generation system based on structured stream |
| CN113423054A (en) * | 2020-03-02 | 2021-09-21 | 中移物联网有限公司 | Terminal positioning method, system and computer readable storage medium |
-
2019
- 2019-08-01 CN CN201910709067.5A patent/CN110427293A/en active Pending
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111177199A (en) * | 2019-12-31 | 2020-05-19 | 中国银行股份有限公司 | Stream type calculation index generation system based on structured stream |
| CN111177199B (en) * | 2019-12-31 | 2023-05-02 | 中国银行股份有限公司 | Stream type calculation index generation system based on structured stream |
| CN113423054A (en) * | 2020-03-02 | 2021-09-21 | 中移物联网有限公司 | Terminal positioning method, system and computer readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| TWI804575B (en) | Method and apparatus, computer readable storage medium, and computing device for identifying high-risk users | |
| CN107391359B (en) | Service testing method and device | |
| WO2019223142A1 (en) | Application program testing method, apparatus, computer device and storage medium | |
| US11586842B2 (en) | System and method for machine learning based video quality assessment | |
| US8738682B2 (en) | Monitoring a path of a transaction across a composite application | |
| CN110069358A (en) | Call chain trace analysis method, apparatus, electronic equipment and storage medium | |
| WO2019232927A1 (en) | Distributed data deletion flow control method and apparatus, electronic device, and storage medium | |
| WO2019232926A1 (en) | Method and apparatus for data consistency checking and flow control, electronic device and storage medium | |
| US20140237094A1 (en) | Sample based determination of network policy violations | |
| CN109933530A (en) | Components testing method and device, equipment and storage medium | |
| CN109815147A (en) | Test cases generation method, device, server and medium | |
| US20170070401A1 (en) | Network element diagnostic evaluation | |
| CN110427293A (en) | Application processing method, device, equipment and medium | |
| CN109379305A (en) | A kind of data distributing method, device, server and storage medium | |
| CN111814033A (en) | Method, device, equipment and storage medium for determining delivered medium information | |
| CN110647447A (en) | Abnormal instance detection method, apparatus, device and medium for distributed system | |
| CN109189555A (en) | A kind of implementation method of Port Mirroring, device, server and storage medium | |
| CN114253864A (en) | Service testing method and device, electronic equipment and storage medium | |
| CN109933738A (en) | Show method, equipment and the computer storage medium of reading content | |
| CN114172819B (en) | Method, system, electronic equipment and storage medium for predicting demand resources of NFV network element | |
| CN107656999B (en) | Call history tracing method and device, electronic equipment and storage medium | |
| CN115022201B (en) | Data processing function test method, device, equipment and storage medium | |
| CN109559121A (en) | Transaction path calls exception analysis method, device, equipment and readable storage medium storing program for executing | |
| CN108182116A (en) | A kind of bidding documents analysis method, device, equipment and storage medium | |
| CN113065126B (en) | Personal information compliance method and device based on distributed data sandbox |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |