WO2023071861A1 - 数据可视化展示方法、装置、计算机设备和存储介质 - Google Patents
数据可视化展示方法、装置、计算机设备和存储介质 Download PDFInfo
- Publication number
- WO2023071861A1 WO2023071861A1 PCT/CN2022/125844 CN2022125844W WO2023071861A1 WO 2023071861 A1 WO2023071861 A1 WO 2023071861A1 CN 2022125844 W CN2022125844 W CN 2022125844W WO 2023071861 A1 WO2023071861 A1 WO 2023071861A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- target
- video frame
- data
- data analysis
- video
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 44
- 238000013079 data visualisation Methods 0.000 title claims abstract description 37
- 238000007405 data analysis Methods 0.000 claims abstract description 292
- 230000004044 response Effects 0.000 claims abstract description 29
- 238000009877 rendering Methods 0.000 claims abstract description 25
- 238000001514 detection method Methods 0.000 claims description 68
- 238000004458 analytical method Methods 0.000 claims description 46
- 238000004590 computer program Methods 0.000 claims description 30
- 238000012545 processing Methods 0.000 claims description 20
- 238000000605 extraction Methods 0.000 claims description 11
- 230000003993 interaction Effects 0.000 claims description 5
- 230000002452 interceptive effect Effects 0.000 description 19
- 230000008569 process Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 3
- 230000001360 synchronised effect Effects 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000002123 temporal effect Effects 0.000 description 2
- 238000012549 training Methods 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000010191 image analysis Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000007619 statistical method Methods 0.000 description 1
- 238000000547 structure data Methods 0.000 description 1
- 230000001502 supplementing effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04842—Selection of displayed objects or displayed text elements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Definitions
- the present application relates to the technical field of data processing, in particular to a data visualization display method, device, computer equipment and storage medium.
- video data is gradually becoming an important carrier of information transmission.
- video data contains both spatial attributes (position structure of objects in the image) and temporal attributes (image frame sequence), it is necessary to consider the relationship and change of variables in the spatial and temporal dimensions of data during analysis.
- the corresponding layers are obtained by rendering first, and then the layers are displayed on the video data for visual display.
- a data visualization display method comprising:
- the data visualization display method further includes:
- information analysis is performed on the video frames in the video frame set, and the data analysis results corresponding to the video frames include:
- drawing the analysis result of the target data and rendering it to the target video frame includes:
- calling the graphics type according to the data type, drawing and rendering the target data analysis result to the target video frame includes:
- calling the graphics type according to the data type, drawing and rendering the target data analysis result to the target video frame includes:
- the drawing coordinates are determined according to the target data analysis results
- the data visualization display method further includes:
- a data visualization display device comprising:
- the video display module is used to respond to the user's video display operation and display the video data to be processed
- the video frame display module is used to respond to the user's video frame selection operation, determine the target video frame in the video data to be processed, and display the target video frame;
- the data analysis response module is used to respond to the user data analysis selection operation and determine the target data analysis identification corresponding to the target video frame;
- a data acquisition module configured to obtain a target data analysis result corresponding to the target video frame according to the video frame identifier and the target data analysis identifier of the target video frame;
- the processing module is used to draw the target data analysis result and render it to the target video frame.
- a computer device comprising a memory and a processor, the memory stores a computer program, and the processor implements the following steps when executing the computer program:
- a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:
- the above data visualization display method, device, computer equipment and storage medium display the data to be processed by responding to the video display operation of the user, respond to the video frame selection operation of the user, determine the target video frame in the video data to be processed, display the target video frame, and respond
- the user data analysis selection operation determines the target data analysis identifier corresponding to the target video frame, obtains the target data analysis result corresponding to the target video frame according to the video frame identifier and the target data analysis identifier of the target video frame, and performs an analysis on the target data analysis result. Draw and render to the target video frame.
- real-time display control of the data analysis results can be realized, instead of directly displaying the corresponding layer of the data analysis results to the video data, which can reduce the redundancy and complexity of data visualization. Information is vague.
- Fig. 1 is a schematic flow chart of a data visualization display method in an embodiment
- Figure 2 is a schematic diagram of responding to user operations in an embodiment
- Fig. 3 is a schematic flow chart of drawing target data analysis results and rendering them to target video frames in one embodiment
- Fig. 4 is a schematic flow chart of an embodiment rendering the marked numerical curve to the target video frame
- Fig. 5 is a schematic flow chart of a data visualization display method in another embodiment
- Fig. 6 is a structural block diagram of a data visualization display device in an embodiment
- Figure 7 is an internal block diagram of a computer device in one embodiment.
- a data visualization display method is provided.
- the method is applied to a terminal for example. It can be understood that this method can also be applied to a server, and can also be applied to It is based on a system including a terminal and a server, and is realized through the interaction between the terminal and the server.
- the terminal can be, but not limited to, various personal computers, notebook computers, smart phones, tablet computers, portable wearable devices, sports cameras, panoramic cameras or pan-tilt cameras, etc.
- the server can be composed of an independent server or multiple servers server cluster to achieve.
- the method includes the following steps:
- Step 102 display the video data to be processed in response to the user's video display operation.
- the user video display operation refers to an operation in which the user wants to display a video on the terminal.
- the video data to be processed refers to the video data that the user wants to display on the terminal.
- the user first needs to select the video data corresponding to the data visualization.
- the user can interact with the terminal to perform video display operations, that is, select the video data to be displayed, and the terminal will respond to the user's video display. Operation, according to the user's video display operation, acquire and display the video data to be processed. For example, a video list is displayed on the display interface of the terminal, and the user can make a selection according to the video list, and select the video data to be displayed on the terminal.
- Step 104 In response to the user's video frame selection operation, determine the target video frame in the video data to be processed, and display the target video frame.
- the user's video frame selection operation refers to an operation in which the user wants to display any video frame in the video data to be processed on the terminal.
- the target video frame refers to the video frame that the user wants to display on the terminal.
- the user will further interact with the terminal to perform a video frame selection operation, that is, select the video frame data to be displayed, and the terminal will respond to the user's video frame selection operation, and determine according to the user's video frame selection operation
- the target video frame in the video data to be processed displays the target video frame.
- the terminal will synchronously display a video progress bar corresponding to the video data to be processed, and the user can select video frames by dragging the video progress bar or clicking anywhere on the video progress bar.
- Step 106 in response to the user data analysis selection operation, determine the target data analysis identifier corresponding to the target video frame.
- the user data analysis selection operation refers to an operation in which the user wants to display any data analysis result on the terminal.
- the target data analysis identifier refers to the data analysis identifier corresponding to the data analysis result that the user wants to display on the terminal.
- the data analysis identifier is used to distinguish the data analysis results. Different data analysis results correspond to different data analysis identifiers.
- the target data analysis identifier may specifically refer to a character string corresponding to the data analysis result that the user wants to display on the terminal.
- the user will further interact with the terminal to perform a data analysis selection operation, that is, select the target data analysis identification corresponding to the data analysis result to be displayed, and the terminal will respond to the user data analysis selection operation, according to the user
- the data analysis selection operation determines the target data analysis identifier corresponding to the target video frame. For example, when displaying the target video frame, the terminal will simultaneously display the data analysis selection interactive control, and the user can complete the data analysis selection operation by selecting the data analysis selection interactive control.
- the terminal will display the video data to be processed by responding to the video display operation of the user. While displaying the video data to be processed, the terminal will simultaneously display the video progress bar corresponding to the video data to be processed.
- the video frame selection operation can be performed by dragging the video progress bar or clicking anywhere on the video progress bar.
- the terminal will respond to the user's video frame selection operation and display the target video frame. While displaying the target video frame, the terminal will simultaneously display the data analysis Select the interactive control, and the user can select the data analysis selection operation by selecting the data analysis selection interactive control to determine the data analysis results that need to be displayed on the terminal.
- the user when the user needs to view other video frames in the video data to be processed and the corresponding data analysis results, he can reselect the target video frame by dragging the video progress bar, clicking anywhere on the video progress bar, etc., and change the data The selection of the analysis selection interactive control for data analysis selection operation. It should be noted that after re-selecting the target video frame, the user may not select the interactive control for data analysis, and the data analysis result displayed at this time is the same as the data analysis result displayed on the target video frame of the previous frame. Corresponding, belonging to the same data analysis result.
- Step 108 according to the video frame identifier and the target data analysis identifier of the target video frame, obtain the target data analysis result corresponding to the target video frame.
- the video frame identifier is used to distinguish video frames.
- the video frame identifier may specifically refer to a sequence number of a video frame.
- the video frame identifier may specifically refer to a time stamp corresponding to the video frame.
- the target data analysis result refers to the data analysis result that the user wants to display on the terminal.
- the data analysis result refers to the analysis of the spatial information and time information in the video frame by using an appropriate statistical analysis method. Analysis information that is useful for readers or users and can form conclusions, usually expressed in the form of numerical values or characters.
- the data analysis result may specifically refer to global image information such as brightness values of video frames.
- the data analysis result may specifically refer to a target detection result of an object in a video frame detected by using a target detection method, and the target detection result includes detection frame information.
- the data analysis result may specifically refer to the action category information of the person in the video frame.
- the terminal will obtain the video frame identifier of the video frame in advance, and classify the same data analysis result, generate the corresponding data analysis identifier, establish the association relationship between the video frame identifier and the data analysis result according to the data analysis identifier, and determine the target
- the terminal will query the established association relationship according to the video frame identification and target data analysis identification of the target video frame, and obtain the target data analysis result corresponding to the target video frame.
- Step 110 drawing and rendering the target data analysis result to the target video frame.
- the terminal when performing information analysis on the video frames in the video data to be processed in advance, the terminal will specify the data type of the data analysis result, and save the data type and the data analysis result together. Therefore, after obtaining the target data analysis result, the terminal can synchronously obtain the data type of the target data analysis result, and then call the corresponding graphics type according to the data type to draw and render the target data analysis result to the target video frame.
- the data type includes numeric data, text data, structured data, and the like.
- the above data visualization display method by responding to the user's video display operation, displays the data to be processed, responds to the user's video frame selection operation, determines the target video frame in the video data to be processed, displays the target video frame, and responds to the user's data analysis and selection operation.
- the target data analysis identifier corresponding to the target video frame obtains the target data analysis result corresponding to the target video frame, draws the target data analysis result and renders it to the target video frame, In the whole process, by responding to user operations, real-time display control of the data analysis results can be realized, instead of directly displaying the corresponding layer of the data analysis results to the video data, which can reduce the redundancy and information ambiguity of data visualization.
- the data visualization display method further includes:
- the video data to be processed refers to the video data captured by the shooting equipment that can obtain digital video.
- the shooting equipment includes but is not limited to SLR cameras, mirrorless cameras, mobile phones with camera and video functions, sports cameras, panoramic cameras, PTZ cameras, drones, etc.
- the terminal will obtain the video data to be processed, perform frame extraction processing on the video data to be processed, obtain a set of video frames corresponding to the video data to be processed, and apply image processing based on digital image processing.
- Analysis and video analysis methods respectively analyze the information of the video frames in the video frame set to obtain the data analysis results corresponding to the video frames, and obtain the video frame identification of the video frames, and classify the same data analysis results to generate the corresponding
- the data analysis identifier establishes an association relationship between the video frame identifier and the data analysis result according to the data analysis identifier.
- the frame extraction method of the video data to be processed may be a uniform frame extraction method, or a frame extraction method may be set as required, which is not specifically limited in this embodiment.
- performing information analysis may specifically refer to determining global image information such as brightness values of video frames.
- performing information analysis may specifically refer to obtaining detection frame information of an object in a video frame using a target detection method.
- performing information analysis may specifically refer to determining a category of a person's action in a video frame, and the like.
- the data analysis results are expressed in the form of numerical values or characters.
- the brightness value can be directly expressed by numerical value
- the detection frame information can be expressed by numerical coordinates
- the character action category can be expressed by character.
- establishing the association relationship between the video frame identifier and the data analysis result is to generate the corresponding data analysis identifier after classifying the same data analysis result, and add the time attribute synchronized with the video frame to the data analysis result.
- the analysis flag stores the data analysis results added with the time attribute synchronized with the video frame, so as to facilitate the dynamic synchronous display of the video frame and the data analysis results.
- the video frame identifier here may specifically refer to a sequence number of a video frame or a corresponding time stamp. It should be noted that when analyzing the video data to be processed, the number of video frames to be analyzed and the type of information to be analyzed can be set according to the needs.
- the information analysis is performed on all video frames in the video frame set , then directly establish the association relationship between all video frame identifiers and data analysis results. If the information analysis is not performed on all video frames in the video frame set, that is, only part of the video frames are analyzed, then after completing the information analysis on the video frames in the entire video data to be processed, when establishing the association relationship, it is necessary to The data analysis results are supplemented or interpolated so that the number of data analysis results is consistent with the number of video frame identifiers, that is, for video frames that have not been analyzed for information in the video frame set, it is also necessary to establish the video frame identifier and data corresponding to the video frame Relationships between analysis results.
- supplementing or interpolating the data analysis results may be performed when establishing an association relationship or when displaying the data analysis results.
- performing when displaying the data analysis result means that when the data analysis result is displayed on the video frame, if the corresponding data analysis result is not obtained in the association relationship according to the video frame identification corresponding to the video frame, then according to the association relationship
- the existing data analysis results are supplemented or interpolated to obtain the data analysis results of the video frame.
- the association relationship refers to the use of structured sequence data to represent the corresponding relationship between video frame identifiers and data analysis results.
- Structured sequence data includes but is not limited to tables, csv (Comma-Separated Values, comma-separated values), json (JavaScript Object Notation, JS Object Notation) data, etc.
- the specific format is arranged in order of video frames or time, and contains the data corresponding to the data analysis results of each frame or time. Taking csv data as an example, the relationship can be expressed as: frame_id, value (frame number, value): 0, 1.000; 1, 1.000; 2, 1.234.
- the acquisition of the data analysis results and the association between the video frame identifier and the data analysis results can be realized, so that the alignment and accurate display can be realized when the data analysis results need to be displayed on the video frames.
- information analysis is performed on the video frames in the video frame set, and the data analysis results corresponding to the video frames include:
- Target detection is performed on the video frames in the video frame set respectively, and target detection results corresponding to the video frames are obtained, and the target detection results include detection frame information.
- the detection frame information refers to the coordinate information of the object detected in the video frame.
- frame_id is the frame number
- bbox_id is the frame detection frame number
- x1, y1 are the image coordinates of the upper left corner of the detection frame
- x2, y2 are the image coordinates of the lower right corner of the detection frame.
- the detection frame information can be specifically expressed as: frame_id, bbox_id, x1, y1, x2, y2: 0, 0, 20, 20, 40, 30; 0, 1, 15, 15, 25, 35; 1, 2, 30 , 30, 45, 50 such a form.
- the terminal obtains a pre-trained target detection model, uses the pre-trained target detection model to perform target detection on the video frames in the video frame set, and obtains target detection results corresponding to the video frames, and the target detection results include detection frame information.
- the pre-trained target detection model is obtained by training the sample image data carrying the target frame.
- the terminal will first obtain the initial target detection model, and then input the sample image data into the initial target detection model.
- the initial target detection model outputs the predicted detection frame corresponding to the sample image data.
- the loss function corresponding to the initial target detection model is obtained, and the model parameters of the initial target detection model are adjusted.
- the initial target detection model after parameter adjustment performs target detection on the sample image data again to obtain the corresponding loss function until the loss function converges to obtain the pre-trained target detection model.
- target detection results corresponding to the video frames can be obtained by respectively performing target detection on the video frames in the video frame set, and the target detection results include detection frame information to implement information analysis on the video frames.
- the information analysis of the video frame can specifically mean that the target object included in the video frame and the type and location of the target object can be determined according to the target detection result, so that the corresponding target detection can be displayed when the video frame is displayed. result.
- drawing the analysis result of the target data and rendering it to the target video frame includes:
- the terminal when performing information analysis on the video frames in the video data to be processed in advance, the terminal will specify the data type of the data analysis result, and save the data type and the data analysis result together. Therefore, after obtaining the target data analysis result, the terminal can synchronously obtain the data type of the target data analysis result, and then call the corresponding graphics type according to the data type to draw and render the target data analysis result to the target video frame.
- the data type includes numeric data, text data, structured data, and the like. Further, when drawing and rendering, different graphic colors and fonts may be used to identify different target data analysis results.
- the terminal can use the programmable GUI (Graphical User Interface, Graphical User Interface) library to draw the analysis results of the target data and render them to the target video frame.
- GUI code library for operation, it can draw target data analysis results into specific shapes, charts or text according to data types, and render them on the target video frame. For example, a schematic flow chart of drawing target data analysis results and rendering them to target video frames may be shown in FIG. 3 .
- the program in the terminal will read the analysis result data (that is, the target data analysis result), and call the GUI library (that is, the programmable GUI library) corresponding to the chart or graph type according to the data type specified in the analysis result file, so that the GUI library calls the system graphics
- the interface interface draws and renders analysis result charts, graphics and target video frames, and displays the rendering results on the system graphical interface of the terminal.
- the target data analysis result can be drawn and rendered to the target video frame.
- calling the graphics type according to the data type, drawing and rendering the target data analysis result to the target video frame includes:
- the terminal when the data type is numerical data, the terminal will draw the same item data analysis results corresponding to all video frames in the video frame set as a numerical curve, mark the target data analysis results on the numerical curve, and draw the marked numerical curve Render to target video frame.
- the data analysis result is the brightness value of a video frame
- its data type is numerical data.
- the terminal When it is necessary to display the corresponding brightness value on the target video frame, the terminal will first draw the corresponding brightness values of all video frames is a numerical curve, and then mark the brightness value corresponding to the target video frame on the numerical curve, and render the marked numerical curve to the target video frame.
- the flowchart of rendering the marked numerical curve to the target video frame can be shown in Figure 4.
- the marked numerical curve and the target video frame are arranged in the form of layout instead of layer superposition
- the numerical curve can be drawn by using the same item data analysis results corresponding to all video frames.
- the corresponding target data analysis results are marked on the numerical curve , where the target data analysis result corresponding to the left video frame is 0.9, and the target data analysis result corresponding to the right video frame is 0.2.
- the same item data analysis results corresponding to all video frames in the video frame set are drawn as numerical curves, and the target data analysis results are marked on the numerical curves, and the marked numerical values The curve is rendered to the target video frame, which can realize the visual display of numerical data.
- calling the graphics type according to the data type, drawing and rendering the target data analysis result to the target video frame includes:
- the drawing coordinates are determined according to the target data analysis results
- the terminal determines the drawing coordinates according to the target data analysis result, and draws and renders the target data analysis result to the target video frame according to the drawing coordinates.
- the data analysis result is the detection frame information of the video frame
- its data type is structured data
- the terminal will determine the drawing coordinates according to the detection frame information, That is, the coordinates of the detection frame, and then draw and render the detection frame to the target video frame according to the coordinates of the detection frame.
- the drawing coordinates are determined according to the analysis results of the target data, and the analysis results of the target data are drawn and rendered to the target video frame according to the drawing coordinates, so that the visual display of the structured data can be realized.
- the data visualization display method further includes:
- the terminal will create data analysis and selection interactive controls through the programmable GUI library.
- the data analysis and selection interactive controls correspond to the number of data analysis results and are used to respond to user data analysis and selection operations. Users can use data analysis to select interactive controls in real time. Which data analysis results are displayed on the video frame.
- the terminal will also create a data type selection interactive control to respond to the user's data type selection operation, and control the data analysis results of which data types are displayed on the video frame in real time.
- the interactive control for data analysis and selection can be used to respond to the user's data analysis and selection operation, thereby realizing real-time control of data visualization.
- a schematic flow chart is used to illustrate the data visualization display method of the present application, and the data visualization display method specifically includes the following steps:
- Step 502 acquiring video data to be processed
- Step 504 performing frame extraction processing on the video data to be processed to obtain a set of video frames corresponding to the video data to be processed;
- Step 506 respectively performing information analysis on the video frames in the video frame set to obtain data analysis results corresponding to the video frames;
- Step 508 obtaining the video frame identifier of the video frame, and classifying the same data analysis result, generating a corresponding data analysis identifier, and establishing a relationship between the video frame identifier and the data analysis result according to the data analysis identifier;
- Step 510 responding to the user's video display operation, displaying the video data to be processed
- Step 512 responding to the user's video frame selection operation, determining the target video frame in the video data to be processed, and displaying the target video frame;
- Step 514 creating a data analysis selection interactive control, which is used to respond to the user's data analysis selection operation
- Step 516 in response to the user data analysis selection operation, determine the target data analysis identifier corresponding to the target video frame;
- Step 518 according to the video frame identifier and the target data analysis identifier of the target video frame, obtain the target data analysis result corresponding to the target video frame;
- Step 520 determine the data type of the target data analysis result, when the data type is numerical data, jump to step 522, and when the data type is structural data, jump to step 528;
- Step 522 drawing the same item data analysis results corresponding to all video frames in the video frame set as a numerical curve
- Step 524 marking the target data analysis results on the numerical curve
- Step 526 rendering the marked numerical curve to the target video frame
- Step 528 determine the drawing coordinates according to the target data analysis results
- Step 530 draw and render the target data analysis result to the target video frame according to the drawing coordinates.
- steps in the flow charts involved in the above embodiments are shown sequentially as indicated by the arrows, these steps are not necessarily executed sequentially in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and these steps can be executed in other orders. Moreover, at least some of the steps in the flow charts involved in the above embodiments may include multiple steps or stages, and these steps or stages are not necessarily executed at the same time, but may be executed at different times. These steps Or the execution sequence of the stages is not necessarily performed sequentially, but may be executed in turn or alternately with other steps or at least a part of steps or stages in other steps.
- a data visualization display device including: a video display module 602, a video frame display module 604, a data analysis response module 606, a data acquisition module 608 and a processing module 610, wherein :
- Video display module 602 used to respond to user video display operation, display video data to be processed
- the video frame display module 604 is used to respond to the user's video frame selection operation, determine the target video frame in the video data to be processed, and display the target video frame;
- the data analysis response module 606 is used to respond to the user data analysis selection operation and determine the target data analysis identification corresponding to the target video frame;
- a data acquisition module 608, configured to acquire a target data analysis result corresponding to the target video frame according to the video frame identifier and the target data analysis identifier of the target video frame;
- the processing module 610 is configured to draw the analysis result of the target data and render it to the target video frame.
- the above data visualization display device displays the data to be processed by responding to the user's video display operation, responds to the user's video frame selection operation, determines the target video frame in the video data to be processed, displays the target video frame, responds to the user's data analysis and selection operation, determines and The target data analysis identifier corresponding to the target video frame, according to the video frame identifier and the target data analysis identifier of the target video frame, obtains the target data analysis result corresponding to the target video frame, draws the target data analysis result and renders it to the target video frame,
- real-time display control of the data analysis results can be realized, instead of directly displaying the corresponding layer of the data analysis results to the video data, which can reduce the redundancy and information ambiguity of data visualization.
- the data visualization display device further includes an analysis module, the analysis module is used to obtain the video data to be processed, perform frame extraction processing on the video data to be processed, obtain a set of video frames corresponding to the video data to be processed, and analyze the video frames respectively Perform information analysis on the video frames in the collection, obtain the data analysis results corresponding to the video frames, obtain the video frame identifiers of the video frames, and classify the same data analysis results, generate corresponding data analysis identifiers, and establish video frames based on the data analysis identifiers Identify the association relationship with the data analysis results.
- the analysis module is used to obtain the video data to be processed, perform frame extraction processing on the video data to be processed, obtain a set of video frames corresponding to the video data to be processed, and analyze the video frames respectively Perform information analysis on the video frames in the collection, obtain the data analysis results corresponding to the video frames, obtain the video frame identifiers of the video frames, and classify the same data analysis results, generate corresponding data analysis identifiers, and establish video frames based on the
- the analysis module is further configured to perform target detection on the video frames in the video frame set to obtain target detection results corresponding to the video frames, and the target detection results include detection frame information.
- the processing module is further configured to determine the data type of the target data analysis result, call the graphics type according to the data type, and draw and render the target data analysis result to the target video frame.
- the processing module is also used to draw the same item data analysis results corresponding to all video frames in the video frame set as a numerical curve when the data type is numerical data, and mark the target data analysis result on the numerical curve, Render the marked numerical curve to the target video frame.
- the processing module is further configured to determine the drawing coordinates according to the target data analysis results when the data type is structured data, and draw and render the target data analysis results to the target video frame according to the drawing coordinates.
- the data visualization display device further includes a creation module, the creation module is used to create a data analysis selection interaction control, and the data analysis selection interaction control is used to respond to the user's data analysis selection operation.
- Each module in the above-mentioned data visualization display device can be fully or partially realized by software, hardware and a combination thereof.
- the above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, and can also be stored in the memory of the computer device in the form of software, so that the processor can invoke and execute the corresponding operations of the above-mentioned modules.
- a computer device is provided.
- the computer device may be a terminal, and its internal structure may be as shown in FIG. 7 .
- the computer device includes a processor, a memory, a communication interface, a display screen and an input device connected through a system bus. Wherein, the processor of the computer device is used to provide calculation and control capabilities.
- the memory of the computer device includes a non-volatile storage medium and an internal memory.
- the non-volatile storage medium stores an operating system and computer programs.
- the internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage medium.
- the communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be realized through WIFI, an operator network, NFC (Near Field Communication) or other technologies.
- a data visualization display method is realized.
- the display screen of the computer device may be a liquid crystal display screen or an electronic ink display screen
- the input device of the computer device may be a touch layer covered on the display screen, or a button, a trackball or a touch pad provided on the casing of the computer device , and can also be an external keyboard, touchpad, or mouse.
- FIG. 7 is only a block diagram of a part of the structure related to the solution of this application, and does not constitute a limitation to the computer equipment on which the solution of this application is applied.
- the specific computer equipment can be More or fewer components than shown in the figures may be included, or some components may be combined, or have a different arrangement of components.
- a computer device including a memory and a processor, a computer program is stored in the memory, and the processor implements the following steps when executing the computer program:
- the processor when the processor executes the computer program, the following steps are also implemented: acquiring video data to be processed, performing frame extraction processing on the video data to be processed, obtaining a video frame set corresponding to the video data to be processed, Perform information analysis on the video frame to obtain the data analysis result corresponding to the video frame, obtain the video frame identification of the video frame, and classify the same data analysis result, generate the corresponding data analysis identification, and establish the video frame identification and The relationship between data analysis results.
- the processor executes the computer program, the following steps are further implemented: respectively performing object detection on the video frames in the video frame set to obtain object detection results corresponding to the video frames, the object detection results including detection frame information.
- the processor executes the computer program, the following steps are further implemented: determining the data type of the target data analysis result, calling the graphics type according to the data type, drawing and rendering the target data analysis result to the target video frame.
- the processor executes the computer program, the following steps are also implemented: when the data type is numerical data, the same item data analysis results corresponding to all video frames in the video frame set are drawn as a numerical curve, and on the numerical curve Mark the target data analysis results, and render the marked numerical curve to the target video frame.
- the processor executes the computer program, the following steps are also implemented: when the data type is structured data, determine the drawing coordinates according to the target data analysis results, and draw and render the target data analysis results to the target video frame according to the drawing coordinates .
- the processor executes the computer program, the following steps are further implemented: creating an interactive control for data analysis selection, and the interactive control for data analysis selection is used for responding to a user's data analysis selection operation.
- a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:
- the following steps are also implemented: acquiring the video data to be processed, performing frame extraction processing on the video data to be processed, obtaining a set of video frames corresponding to the video data to be processed, and separately processing the set of video frames Perform information analysis on the video frame, obtain the data analysis result corresponding to the video frame, obtain the video frame identification of the video frame, and classify the same data analysis result, generate the corresponding data analysis identification, and establish the video frame identification according to the data analysis identification Correlation with data analysis results.
- the following steps are also implemented: respectively performing target detection on the video frames in the video frame set to obtain target detection results corresponding to the video frames, and the target detection results include detection frame information.
- the following steps are further implemented: determining the data type of the target data analysis result, calling the graphics type according to the data type, drawing and rendering the target data analysis result to the target video frame.
- the following steps are also implemented: when the data type is numerical data, the same item data analysis results corresponding to all video frames in the video frame set are drawn as a numerical curve, and the numerical curve Mark the target data analysis results, and render the marked numerical curve to the target video frame.
- the following steps are also implemented: when the data type is structured data, determine the drawing coordinates according to the target data analysis results, draw and render the target data analysis results to the target video according to the drawing coordinates frame.
- the following steps are further implemented: creating an interactive control for data analysis selection, and the interactive control for data analysis selection is used for responding to a user's data analysis selection operation.
- Non-volatile memory may include read-only memory (Read-Only Memory, ROM), magnetic tape, floppy disk, flash memory or optical memory, etc.
- Volatile memory can include Random Access Memory (RAM) or external cache memory.
- RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM).
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- User Interface Of Digital Computer (AREA)
- Image Generation (AREA)
Abstract
本申请涉及一种数据可视化展示方法、装置、计算机设备和存储介质。所述方法包括:响应用户视频显示操作,显示待处理视频数据;响应用户视频帧选择操作,确定待处理视频数据中目标视频帧,显示目标视频帧;响应用户数据分析选择操作,确定与目标视频帧对应的目标数据分析标识;根据目标视频帧的视频帧标识以及目标数据分析标识,获取与目标视频帧对应的目标数据分析结果;对目标数据分析结果进行绘制并渲染至目标视频帧。采用本方法能够减少数据可视化的冗余与信息模糊。
Description
本申请涉及数据处理技术领域,特别是涉及一种数据可视化展示方法、装置、计算机设备和存储介质。
随着视频拍摄与播放设备的普及,视频数据正逐渐成为传递信息的重要载体。视频数据作为同时包含空间属性(图像中物体的位置结构)与时间属性(图像帧序列)的数据,分析时需要同时考虑变量在空间维度与时间维度的数据的关系与变化。
传统技术中,对于与视频数据对应的图表等分析结果以及检测框等空间结构数据,主要是通过先渲染得到对应图层,再将图层显示至视频数据的方式进行可视化展示的。
然而,传统方法,由于直接将图层显示至视频数据,会造成数据可视化的冗余与信息模糊。
发明内容
基于此,有必要针对上述技术问题,提供一种能够减少数据可视化的冗余与信息模糊的数据可视化展示方法、装置、计算机设备和存储介质。
一种数据可视化展示方法,所述方法包括:
响应用户视频显示操作,显示待处理视频数据;
响应用户视频帧选择操作,确定待处理视频数据中目标视频帧,显示目标视频帧;
响应用户数据分析选择操作,确定与目标视频帧对应的目标数据分析标识;
根据目标视频帧的视频帧标识以及目标数据分析标识,获取与目标视频帧对应的目标数据分析结果;
对目标数据分析结果进行绘制并渲染至目标视频帧。
在一个实施例中,数据可视化展示方法还包括:
获取待处理视频数据;
对待处理视频数据进行抽帧处理,得到与待处理视频数据对应的视频帧集合;
分别对视频帧集合中视频帧进行信息分析,得到与视频帧对应的数据分析结果;
获取视频帧的视频帧标识,并归类同一项数据分析结果,生成对应的数据分析标识,根据数据分析标识,建立视频帧标识与数据分析结果的关联关系。
在一个实施例中,分别对视频帧集合中视频帧进行信息分析,得到与视频帧对应的数据分析结果包括:
分别对视频帧集合中视频帧进行目标检测,得到与视频帧对应的目标检测结果,所述目标检测结果包 括检测框信息。
在一个实施例中,对目标数据分析结果进行绘制并渲染至目标视频帧包括:
确定目标数据分析结果的数据类型;
根据数据类型调用图形类型,绘制并渲染目标数据分析结果至目标视频帧。
在一个实施例中,根据数据类型调用图形类型,绘制并渲染所述目标数据分析结果至目标视频帧包括:
当数据类型为数值型数据时,将视频帧集合中所有视频帧对应的相同项数据分析结果绘制为数值曲线;
在数值曲线上标记目标数据分析结果;
将标记后的数值曲线渲染至目标视频帧。
在一个实施例中,根据数据类型调用图形类型,绘制并渲染目标数据分析结果至目标视频帧包括:
当数据类型为结构型数据时,根据目标数据分析结果确定绘制坐标;
根据绘制坐标,绘制并渲染目标数据分析结果至目标视频帧。
在一个实施例中,数据可视化展示方法还包括:
创建数据分析选择交互控件,数据分析选择交互控件用于响应用户数据分析选择操作。
一种数据可视化展示装置,所述装置包括:
视频显示模块,用于响应用户视频显示操作,显示待处理视频数据;
视频帧显示模块,用于响应用户视频帧选择操作,确定待处理视频数据中目标视频帧,显示目标视频帧;
数据分析响应模块,用于响应用户数据分析选择操作,确定与目标视频帧对应的目标数据分析标识;
数据获取模块,用于根据目标视频帧的视频帧标识以及目标数据分析标识,获取与所述目标视频帧对应的目标数据分析结果;
处理模块,用于对目标数据分析结果进行绘制并渲染至目标视频帧。
一种计算机设备,包括存储器和处理器,所述存储器存储有计算机程序,所述处理器执行所述计算机程序时实现以下步骤:
响应用户视频显示操作,显示待处理视频数据;
响应用户视频帧选择操作,确定待处理视频数据中目标视频帧,显示目标视频帧;
响应用户数据分析选择操作,确定与目标视频帧对应的目标数据分析标识;
根据目标视频帧的视频帧标识以及目标数据分析标识,获取与目标视频帧对应的目标数据分析结果;
对目标数据分析结果进行绘制并渲染至目标视频帧。
一种计算机可读存储介质,其上存储有计算机程序,所述计算机程序被处理器执行时实现以下步骤:
响应用户视频显示操作,显示待处理视频数据;
响应用户视频帧选择操作,确定待处理视频数据中目标视频帧,显示目标视频帧;
响应用户数据分析选择操作,确定与目标视频帧对应的目标数据分析标识;
根据目标视频帧的视频帧标识以及目标数据分析标识,获取与目标视频帧对应的目标数据分析结果;
对目标数据分析结果进行绘制并渲染至目标视频帧。
上述数据可视化展示方法、装置、计算机设备和存储介质,通过响应用户视频显示操作,显示待处理数据数据,响应用户视频帧选择操作,确定待处理视频数据中目标视频帧,显示目标视频帧,响应用户数据分析选择操作,确定与目标视频帧对应的目标数据分析标识,根据目标视频帧的视频帧标识以及目标数据分析标识,获取与目标视频帧对应的目标数据分析结果,对目标数据分析结果进行绘制并渲染至目标视频帧,整个过程,通过响应用户操作,能够实现对数据分析结果的实时显示控制,而不是直接将数据分析结果对应图层显示至视频数据,能够减少数据可视化的冗余与信息模糊。
图1为一个实施例中数据可视化展示方法的流程示意图;
图2为一个实施例中响应用户操作的示意图;
图3为一个实施例中对目标数据分析结果进行绘制并渲染至目标视频帧的流程示意图;
图4为一个实施例将标记后的数值曲线渲染至目标视频帧的流程示意图;
图5为另一个实施例中数据可视化展示方法的流程示意图;
图6为一个实施例中数据可视化展示装置的结构框图;
图7为一个实施例中计算机设备的内部结构图。
为了使本申请的目的、技术方案及优点更加清楚明白,以下结合附图及实施例,对本申请进行进一步详细说明。应当理解,此处描述的具体实施例仅仅用以解释本申请,并不用于限定本申请。
在一个实施例中,如图1所示,提供了一种数据可视化展示方法,本实施例以该方法应用于终端进行举例说明,可以理解的是,该方法也可以应用于服务器,还可以应用于包括终端和服务器的***,并通过终端和服务器的交互实现。其中,终端可以但不限于是各种个人计算机、笔记本电脑、智能手机、平板电脑、便携式可穿戴设备、运动相机、全景相机或者云台相机等,服务器可以用独立的服务器或者是多个服 务器组成的服务器集群来实现。本实施例中,该方法包括以下步骤:
步骤102,响应用户视频显示操作,显示待处理视频数据。
其中,用户视频显示操作是指用户想要在终端上显示视频的操作。待处理视频数据是指用户想要在终端上显示的视频数据。
具体的,当需要进行数据可视化展示时,用户首先需要选定与数据可视化展示对应的视频数据,用户可通过与终端交互进行视频显示操作,即选中需要显示的视频数据,终端会响应用户视频显示操作,根据用户视频显示操作,获取、并显示待处理视频数据。举例说明,在终端的显示界面上会显示视频列表,用户可根据视频列表进行选择,选择想要在终端上显示的视频数据。
步骤104,响应用户视频帧选择操作,确定待处理视频数据中目标视频帧,显示目标视频帧。
其中,用户视频帧选择操作是指用户想要在终端上显示待处理视频数据中任一视频帧的操作。目标视频帧是指用户想要在终端上显示的视频帧。
具体的,终端在显示待处理视频数据后,用户会进一步与终端交互进行视频帧选择操作,即选中需要显示的视频帧数据,终端会响应用户视频帧选择操作,根据用户视频帧选择操作,确定待处理视频数据中目标视频帧,显示目标视频帧。举例说明,终端在显示待处理视频数据时,会同步显示与待处理视频数据对应的视频进度条,用户可通过拖动视频进度条、点击视频进度条上任意位置等方式进行视频帧选择操作。
步骤106,响应用户数据分析选择操作,确定与目标视频帧对应的目标数据分析标识。
其中,用户数据分析选择操作是指用户想要在终端上显示任意数据分析结果的操作。目标数据分析标识是指与用户想要在终端上显示的数据分析结果对应的数据分析标识,数据分析标识用于对数据分析结果进行区分,不同项数据分析结果所对应的数据分析标识不同。比如,目标数据分析标识具体可以是指与用户想要在终端上显示的数据分析结果对应的字符串。
具体的,终端在显示目标视频帧后,用户会进一步与终端交互进行数据分析选择操作,即选中需要显示的数据分析结果所对应的目标数据分析标识,终端会响应用户数据分析选择操作,根据用户数据分析选择操作,确定与目标视频帧对应的目标数据分析标识。举例说明,终端在显示目标视频帧时,会同步显示数据分析选择交互控件,用户通过选中数据分析选择交互控件,即可完成数据分析选择操作。
举例说明,如图2所示,终端通过响应用户视频显示操作,会显示待处理视频数据,在显示待处理视频数据的同时,终端会同步显示与待处理视频数据对应的视频进度条,用户通过拖动视频进度条、点击视频进度条上任意位置等方式可进行视频帧选择操作,终端会响应用户视频帧选择操作,显示目标视频帧,在显示目标视频帧的同时,终端会同步显示数据分析选择交互控件,用户通过选中数据分析选择交互控件, 可进行数据分析选择操作,以确定需要在终端上显示的数据分析结果。
进一步的,当用户需要查看待处理视频数据中其他视频帧以及对应的数据分析结果时,可通过拖动视频进度条、点击视频进度条上任意位置等方式重新选择目标视频帧,并更改对数据分析选择交互控件的选择,以进行数据分析选择操作。需要说明的是,用户在重新选择目标视频帧后,也可以不更高对数据分析选择交互控件的选择,此时所显示的数据分析结果与上一帧目标视频帧上所显示的数据分析结果对应,属于同一项数据分析结果。
步骤108,根据目标视频帧的视频帧标识以及目标数据分析标识,获取与目标视频帧对应的目标数据分析结果。
其中,视频帧标识用于对视频帧进行区分。比如,视频帧标识具体可以是指视频帧的序号。又比如视频帧标识具体可以是指视频帧对应的时间戳。目标数据分析结果是指用户想要在终端上显示的数据分析结果,数据分析结果是指采用适当的统计分析方法,对视频帧中的空间信息与时间信息进行分析,提取出的、对数据分析者或者用户有用的、可形成结论的分析信息,通常以数值或者字符的形式表示。比如,数据分析结果具体可以是指视频帧的亮度值等全局图像信息。又比如,数据分析结果具体可以是指使用目标检测方法检测得到的视频帧内物体的目标检测结果,目标检测结果包括检测框信息。再比如,数据分析结果具体可以是指视频帧中的人物动作类别信息。
具体的,终端会预先获取视频帧的视频帧标识,并归类同一项数据分析结果,生成对应的数据分析标识,根据数据分析标识,建立视频帧标识与数据分析结果的关联关系,在确定目标视频帧标识以及目标数据分析标识后,终端会根据目标视频帧的视频帧标识以及目标数据分析标识,查询已建立的关联关系,获取与目标视频帧对应的目标数据分析结果。
步骤110,对目标数据分析结果进行绘制并渲染至目标视频帧。
具体的,在预先对待处理视频数据中视频帧进行信息分析时,终端会指定数据分析结果的数据类型,并将数据类型与数据分析结果一同保存。因此,在获取目标数据分析结果后,终端可以同步获取到目标数据分析结果的数据类型,进而可以根据数据类型调用对应的图形类型,以绘制并渲染目标数据分析结果至目标视频帧。其中,数据类型包括数值型数据、文本型数据、结构型数据等。
上述数据可视化展示方法,通过响应用户视频显示操作,显示待处理数据数据,响应用户视频帧选择操作,确定待处理视频数据中目标视频帧,显示目标视频帧,响应用户数据分析选择操作,确定与目标视频帧对应的目标数据分析标识,根据目标视频帧的视频帧标识以及目标数据分析标识,获取与目标视频帧对应的目标数据分析结果,对目标数据分析结果进行绘制并渲染至目标视频帧,整个过程,通过响应用户 操作,能够实现对数据分析结果的实时显示控制,而不是直接将数据分析结果对应图层显示至视频数据,能够减少数据可视化的冗余与信息模糊。
在一个实施例中,数据可视化展示方法还包括:
获取待处理视频数据;
对待处理视频数据进行抽帧处理,得到与待处理视频数据对应的视频帧集合;
分别对视频帧集合中视频帧进行信息分析,得到与视频帧对应的数据分析结果;
获取视频帧的视频帧标识,并归类同一项数据分析结果,生成对应的数据分析标识,根据数据分析标识,建立视频帧标识与数据分析结果的关联关系。
其中,待处理视频数据是指通过可获取数字视频的拍摄设备所拍摄的视频数据,拍摄设备包括但不限于单反相机、无反相机、带有拍照与摄像功能的手机、运动相机、全景相机、云台相机、无人机等。
具体的,在需要对视频数据进行分析时,终端会获取待处理视频数据,对待处理视频数据进行抽帧处理,得到与待处理视频数据对应的视频帧集合,应用以数字图像处理为基础的图像分析与视频分析方法,分别对视频帧集合中视频帧进行信息分析,以得到与视频帧对应的数据分析结果,并获取视频帧的视频帧标识,并归类同一项数据分析结果,生成对应的数据分析标识,根据数据分析标识,建立视频帧标识与数据分析结果的关联关系。其中,对待处理视频数据进行抽帧的方式可以为均匀抽帧,也可以按照需要自行设置抽帧方式,本实施例在此处不做具体限定。
其中,应用以数字图像处理为基础的图像分析与视频分析方法,分别对视频帧集合中视频帧进行信息分析,主要是为了得到视频帧的全局或者局部信息。举例说明,进行信息分析具体可以是指确定视频帧的亮度值等全局图像信息。又举例说明,进行信息分析具体可以是指使用目标检测方法得到视频帧的物体的检测框信息。再举例说明,进行信息分析具体可以是指确定视频帧中的人物动作类别等。本实施例中,数据分析结果以数值或者字符的形式表示。比如,亮度值可以通过数值直接表示,检测框信息可以通过数值坐标表示,人物动作类别可以通过字符表示。
其中,建立视频帧标识与数据分析结果的关联关系即是在对同一项数据分析结果进行归类后,生成对应的数据分析标识,在数据分析结果上添加与视频帧同步的时间属性,根据数据分析标识对添加与视频帧同步的时间属性的数据分析结果进行存储,以便于视频帧与数据分析结果的动态同步显示。此处的视频帧标识具体可以是指视频帧的序号或者对应的时间戳。需要说明的是,在对待处理视频数据进行分析时,所需要分析的视频帧数量以及所需要分析的信息类型是可以按照需要自行设置的,如果是对视频帧集合中所有视频帧都进行信息分析,则直接建立所有视频帧标识与数据分析结果的关联关系即可。如果不是对视频 帧集合中所有视频帧都进行信息分析,即只对部分视频帧进行信息分析,则在完成对整个待处理视频数据中视频帧的信息分析后,在建立关联关系时,需要对数据分析结果进行补充或者插值,以使得数据分析结果的数量与视频帧标识的数量一致,即针对视频帧集合中未进行信息分析的视频帧,也需要建立该视频帧对应的视频帧标识与数据分析结果的关联关系。
需要说明的是,对数据分析结果进行补充或者插值,可以在建立关联关系时进行,也可以在显示数据分析结果时进行。其中,在显示数据分析结果时进行是指在将数据分析结果显示至视频帧上时,若根据视频帧对应的视频帧标识未在关联关系中获取到对应的数据分析结果,则根据关联关系中已存在的数据分析结果进行补充或者插值,以得到该视频帧的数据分析结果。
其中,关联关系是指用结构化的序列数据表示视频帧标识与数据分析结果的对应关系,结构化的序列数据包括但不限于表格、csv(Comma-Separated Values,逗号分隔值)、json(JavaScript Object Notation,JS对象简谱)数据等。具体的格式是按视频帧或时间顺序排列,包含有每帧或时间对应数据分析结果的数据,以csv数据为例,关联关系具体可以表示为:frame_id,value(帧序号,值):0,1.000;1,1.000;2,1.234这样的形式。
本实施例中,能够实现对数据分析结果的获取以及视频帧标识与数据分析结果的关联,以便在需要在视频帧上展示数据分析结果时能实现对齐准确展示。
在一个实施例中,分别对视频帧集合中视频帧进行信息分析,得到与视频帧对应的数据分析结果包括:
分别对视频帧集合中视频帧进行目标检测,得到与视频帧对应的目标检测结果,目标检测结果包括检测框信息。
其中,检测框信息是指视频帧中检测出的物体的坐标信息。以一个csv格式的检测框信息为例,frame_id为帧序号,bbox_id为帧检测框序号,x1,y1为检测框左上角图像坐标,x2,y2为检测框右下角图像坐标。则检测框信息具体可以表示为:frame_id,bbox_id,x1,y1,x2,y2:0,0,20,20,40,30;0,1,15,15,25,35;1,2,30,30,45,50这样的形式。
具体的,终端会获取预先训练的目标检测模型,利用预先训练的目标检测模型分别对视频帧集合中视频帧进行目标检测,得到与视频帧对应的目标检测结果,目标检测结果包括检测框信息。其中,预先训练的目标检测模型是通过携带目标框的样本图像数据训练得到的,在预先训练目标检测模型时,终端会先获取初始目标检测模型,再将样本图像数据输入初始目标检测模型,利用初始目标检测模型输出与样本图像数据对应的预测检测框,通过比对预测检测框以及目标框,得到与初始目标检测模型对应的损失函数,并对初始目标检测模型的模型参数进行调整,利用模型参数调整后的初始目标检测模型再次对样本图像数据 进行目标检测,以得到对应的损失函数,直到损失函数收敛为止,得到预先训练的目标检测模型。
本实施例中,通过分别对视频帧集合中视频帧进行目标检测,能够得到与视频帧对应的目标检测结果,目标检测结果包括检测框信息,实现对视频帧的信息分析。举例说明,对视频帧的信息分析具体可以是指根据目标检测结果可以确定视频帧上所包括的目标对象以及目标对象的类型和所处的位置,从而可以在显示视频帧时显示对应的目标检测结果。
在一个实施例中,对目标数据分析结果进行绘制并渲染至目标视频帧包括:
确定目标数据分析结果的数据类型;
根据数据类型调用图形类型,绘制并渲染目标数据分析结果至目标视频帧。
具体的,在预先对待处理视频数据中视频帧进行信息分析时,终端会指定数据分析结果的数据类型,并将数据类型与数据分析结果一同保存。因此,在获取目标数据分析结果后,终端可以同步获取到目标数据分析结果的数据类型,进而可以根据数据类型调用对应的图形类型,以绘制并渲染目标数据分析结果至目标视频帧。其中,数据类型包括数值型数据、文本型数据、结构型数据等。进一步的,在进行绘制并渲染时,可采用不同的图形颜色以及字体标识不同的目标数据分析结果。
具体的,终端可以利用可编程GUI(Graphical User Interface,图形用户界面)库实现对目标数据分析结果进行绘制并渲染至目标视频帧,可编程GUI库指可以通过程序指令,控制计算机采用图形方式显示、操作的GUI代码库,它能够将目标数据分析结果按照数据类型绘制为特定的形状、图表或文字,并渲染在目标视频帧上。举例说明,对目标数据分析结果进行绘制并渲染至目标视频帧的流程示意图可以如图3所示。终端中的程序会读取分析结果数据(即目标数据分析结果),根据分析结果文件中指定的数据类型调用GUI库(即可编程GUI库)对应图表或者图形类型,以使得GUI库调用***图形界面接口,绘制并渲染分析结果图表、图形与目标视频帧,在终端的***图形界面上显示渲染结果。
本实施例中,通过确定目标数据分析结果的数据类型,根据数据类型调用图形类型,能够绘制并渲染目标数据分析结果至目标视频帧。
在一个实施例中,根据数据类型调用图形类型,绘制并渲染所述目标数据分析结果至目标视频帧包括:
当数据类型为数值型数据时,将视频帧集合中所有视频帧对应的相同项数据分析结果绘制为数值曲线;
在数值曲线上标记目标数据分析结果;
将标记后的数值曲线渲染至目标视频帧。
具体的,当数据类型为数值型数据时,终端会将视频帧集合中所有视频帧对应的相同项数据分析结果 绘制为数值曲线,在数值曲线上标记目标数据分析结果,将标记后的数值曲线渲染至目标视频帧。举例说明,当数据分析结果为视频帧的亮度值时,其数据类型为数值型数据,在需要在目标视频帧上显示其对应的亮度值时,终端会先将所有视频帧对应的亮度值绘制为数值曲线,再在数值曲线上标记与目标视频帧对应的亮度值,将标记后的数值曲线渲染至目标视频帧。
举例说明,将标记后的数值曲线渲染至目标视频帧的流程示意图可以如图4所示,此处为了方便展示,将标记后的数值曲线与目标视频帧以布局形式而不是图层叠加形式进行展示,从图4中可以看出,利用所有视频帧对应的相同项数据分析结果可以绘制得到数值曲线,针对左边视频帧和右边视频帧,都在数值曲线上标记处了对应的目标数据分析结果,其中,左边视频帧对应的目标数据分析结果为0.9,右边视频帧对应的目标数据分析结果为0.2。
本实施例中,通过当数据类型为数值型数据时,将视频帧集合中所有视频帧对应的相同项数据分析结果绘制为数值曲线,在数值曲线上标记目标数据分析结果,将标记后的数值曲线渲染至目标视频帧,能够实现对数值型数据的可视化展示。
在一个实施例中,根据数据类型调用图形类型,绘制并渲染目标数据分析结果至目标视频帧包括:
当数据类型为结构型数据时,根据目标数据分析结果确定绘制坐标;
根据绘制坐标,绘制并渲染目标数据分析结果至目标视频帧。
具体的,当数据类型为结构型数据时,终端会根据目标数据分析结果确定绘制坐标,根据绘制坐标,绘制并渲染目标数据分析结果至目标视频帧。举例说明,当数据分析结果为视频帧的检测框信息时,其数据类型为结构型数据,在需要在目标视频帧上显示其对应的检测框信息时,终端会根据检测框信息确定绘制坐标,即检测框坐标,再根据检测框坐标,绘制并渲染检测框至目标视频帧。
本实施例中,通过当数据类型为结构型数据时,根据目标数据分析结果确定绘制坐标,根据绘制坐标,绘制并渲染目标数据分析结果至目标视频帧,能够实现对结构型数据的可视化展示。
在一个实施例中,数据可视化展示方法还包括:
创建数据分析选择交互控件,数据分析选择交互控件用于响应用户数据分析选择操作。
具体的,终端会通过可编程GUI库创建数据分析选择交互控件,数据分析选择交互控件与数据分析结果的数量对应,用于响应用户数据分析选择操作,用户可通过数据分析选择交互控件实时控制在视频帧上展示哪些数据分析结果。进一步的,终端还会创建数据类型选择交互控件,以响应用户数据类型选择操作,实时控制在视频帧上展示哪些数据类型的数据分析结果。
本实施例中,通过创建数据分析选择交互控件,能够利用数据分析选择交互控件实现对用户数据分析 选择操作的响应,从而实现实时控制数据可视化展示。
在一个实施例中,如图5所示,通过一个流程示意图来说明本申请的数据可视化展示方法,该数据可视化展示方法具体包括以下步骤:
步骤502,获取待处理视频数据;
步骤504,对待处理视频数据进行抽帧处理,得到与待处理视频数据对应的视频帧集合;
步骤506,分别对视频帧集合中视频帧进行信息分析,得到与视频帧对应的数据分析结果;
步骤508,获取视频帧的视频帧标识,并归类同一项数据分析结果,生成对应的数据分析标识,根据数据分析标识,建立视频帧标识与数据分析结果的关联关系;
步骤510,响应用户视频显示操作,显示待处理视频数据;
步骤512,响应用户视频帧选择操作,确定待处理视频数据中目标视频帧,显示目标视频帧;
步骤514,创建数据分析选择交互控件,数据分析选择交互控件用于响应用户数据分析选择操作;
步骤516,响应用户数据分析选择操作,确定与目标视频帧对应的目标数据分析标识;
步骤518,根据目标视频帧的视频帧标识以及目标数据分析标识,获取与目标视频帧对应的目标数据分析结果;
步骤520,确定目标数据分析结果的数据类型,当数据类型为数值型数据时,跳转至步骤522,当数据类型为结构型数据时,跳转至步骤528;
步骤522,将视频帧集合中所有视频帧对应的相同项数据分析结果绘制为数值曲线;
步骤524,在数值曲线上标记目标数据分析结果;
步骤526,将标记后的数值曲线渲染至目标视频帧;
步骤528,根据目标数据分析结果确定绘制坐标;
步骤530,根据绘制坐标,绘制并渲染目标数据分析结果至目标视频帧。
应该理解的是,虽然上述实施例涉及的各流程图中的各个步骤按照箭头的指示依次显示,但是这些步骤并不是必然按照箭头指示的顺序依次执行。除非本文中有明确的说明,这些步骤的执行并没有严格的顺序限制,这些步骤可以以其它的顺序执行。而且,上述实施例涉及的各流程图中的至少一部分步骤可以包括多个步骤或者多个阶段,这些步骤或者阶段并不必然是在同一时刻执行完成,而是可以在不同的时刻执行,这些步骤或者阶段的执行顺序也不必然是依次进行,而是可以与其它步骤或者其它步骤中的步骤或者阶段的至少一部分轮流或者交替地执行。
在一个实施例中,如图6所示,提供了一种数据可视化展示装置,包括:视频显示模块602、视频帧显示模块604、数据分析响应模块606、数据获取模块608和处理模块610,其中:
视频显示模块602,用于响应用户视频显示操作,显示待处理视频数据;
视频帧显示模块604,用于响应用户视频帧选择操作,确定待处理视频数据中目标视频帧,显示目标视频帧;
数据分析响应模块606,用于响应用户数据分析选择操作,确定与目标视频帧对应的目标数据分析标识;
数据获取模块608,用于根据目标视频帧的视频帧标识以及目标数据分析标识,获取与所述目标视频帧对应的目标数据分析结果;
处理模块610,用于对目标数据分析结果进行绘制并渲染至目标视频帧。
上述数据可视化展示装置,通过响应用户视频显示操作,显示待处理数据数据,响应用户视频帧选择操作,确定待处理视频数据中目标视频帧,显示目标视频帧,响应用户数据分析选择操作,确定与目标视频帧对应的目标数据分析标识,根据目标视频帧的视频帧标识以及目标数据分析标识,获取与目标视频帧对应的目标数据分析结果,对目标数据分析结果进行绘制并渲染至目标视频帧,整个过程,通过响应用户操作,能够实现对数据分析结果的实时显示控制,而不是直接将数据分析结果对应图层显示至视频数据,能够减少数据可视化的冗余与信息模糊。
在一个实施例中,数据可视化展示装置还包括分析模块,分析模块用于获取待处理视频数据,对待处理视频数据进行抽帧处理,得到与待处理视频数据对应的视频帧集合,分别对视频帧集合中视频帧进行信息分析,得到与视频帧对应的数据分析结果,获取视频帧的视频帧标识,并归类同一项数据分析结果,生成对应的数据分析标识,根据数据分析标识,建立视频帧标识与数据分析结果的关联关系。
在一个实施例中,分析模块还用于分别对视频帧集合中视频帧进行目标检测,得到与视频帧对应的目标检测结果,目标检测结果包括检测框信息。
在一个实施例中,处理模块还用于确定目标数据分析结果的数据类型,根据数据类型调用图形类型,绘制并渲染目标数据分析结果至目标视频帧。
在一个实施例中,处理模块还用于当数据类型为数值型数据时,将视频帧集合中所有视频帧对应的相同项数据分析结果绘制为数值曲线,在数值曲线上标记目标数据分析结果,将标记后的数值曲线渲染至目标视频帧。
在一个实施例中,处理模块还用于当数据类型为结构型数据时,根据目标数据分析结果确定绘制坐标,根据绘制坐标,绘制并渲染目标数据分析结果至目标视频帧。
在一个实施例中,数据可视化展示装置还包括创建模块,创建模块用于创建数据分析选择交互控件,数据分析选择交互控件用于响应用户数据分析选择操作。
关于数据可视化展示装置的具体实施例可以参见上文中对于数据可视化展示方法的实施例,在此不再赘述。上述数据可视化展示装置中的各个模块可全部或部分通过软件、硬件及其组合来实现。上述各模块可以硬件形式内嵌于或独立于计算机设备中的处理器中,也可以以软件形式存储于计算机设备中的存储器中,以便于处理器调用执行以上各个模块对应的操作。
在一个实施例中,提供了一种计算机设备,该计算机设备可以是终端,其内部结构图可以如图7所示。该计算机设备包括通过***总线连接的处理器、存储器、通信接口、显示屏和输入装置。其中,该计算机设备的处理器用于提供计算和控制能力。该计算机设备的存储器包括非易失性存储介质、内存储器。该非易失性存储介质存储有操作***和计算机程序。该内存储器为非易失性存储介质中的操作***和计算机程序的运行提供环境。该计算机设备的通信接口用于与外部的终端进行有线或无线方式的通信,无线方式可通过WIFI、运营商网络、NFC(近场通信)或其他技术实现。该计算机程序被处理器执行时以实现一种数据可视化展示方法。该计算机设备的显示屏可以是液晶显示屏或者电子墨水显示屏,该计算机设备的输入装置可以是显示屏上覆盖的触摸层,也可以是计算机设备外壳上设置的按键、轨迹球或触控板,还可以是外接的键盘、触控板或鼠标等。
本领域技术人员可以理解,图7中示出的结构,仅仅是与本申请方案相关的部分结构的框图,并不构成对本申请方案所应用于其上的计算机设备的限定,具体的计算机设备可以包括比图中所示更多或更少的部件,或者组合某些部件,或者具有不同的部件布置。
在一个实施例中,提供了一种计算机设备,包括存储器和处理器,存储器中存储有计算机程序,该处理器执行计算机程序时实现以下步骤:
响应用户视频显示操作,显示待处理视频数据;
响应用户视频帧选择操作,确定待处理视频数据中目标视频帧,显示目标视频帧;
响应用户数据分析选择操作,确定与目标视频帧对应的目标数据分析标识;
根据目标视频帧的视频帧标识以及目标数据分析标识,获取与目标视频帧对应的目标数据分析结果;
对目标数据分析结果进行绘制并渲染至目标视频帧。
在一个实施例中,处理器执行计算机程序时还实现以下步骤:获取待处理视频数据,对待处理视频数据进行抽帧处理,得到与待处理视频数据对应的视频帧集合,分别对视频帧集合中视频帧进行信息分析,得到与视频帧对应的数据分析结果,获取视频帧的视频帧标识,并归类同一项数据分析结果,生成对应的数据分析标识,根据数据分析标识,建立视频帧标识与数据分析结果的关联关系。
在一个实施例中,处理器执行计算机程序时还实现以下步骤:分别对视频帧集合中视频帧进行目标检测,得到与视频帧对应的目标检测结果,目标检测结果包括检测框信息。
在一个实施例中,处理器执行计算机程序时还实现以下步骤:确定目标数据分析结果的数据类型,根据数据类型调用图形类型,绘制并渲染目标数据分析结果至目标视频帧。
在一个实施例中,处理器执行计算机程序时还实现以下步骤:当数据类型为数值型数据时,将视频帧集合中所有视频帧对应的相同项数据分析结果绘制为数值曲线,在数值曲线上标记目标数据分析结果,将标记后的数值曲线渲染至目标视频帧。
在一个实施例中,处理器执行计算机程序时还实现以下步骤:当数据类型为结构型数据时,根据目标数据分析结果确定绘制坐标,根据绘制坐标,绘制并渲染目标数据分析结果至目标视频帧。
在一个实施例中,处理器执行计算机程序时还实现以下步骤:创建数据分析选择交互控件,数据分析选择交互控件用于响应用户数据分析选择操作。
在一个实施例中,提供了一种计算机可读存储介质,其上存储有计算机程序,计算机程序被处理器执行时实现以下步骤:
响应用户视频显示操作,显示待处理视频数据;
响应用户视频帧选择操作,确定待处理视频数据中目标视频帧,显示目标视频帧;
响应用户数据分析选择操作,确定与目标视频帧对应的目标数据分析标识;
根据目标视频帧的视频帧标识以及目标数据分析标识,获取与目标视频帧对应的目标数据分析结果;
对目标数据分析结果进行绘制并渲染至目标视频帧。
在一个实施例中,计算机程序被处理器执行时还实现以下步骤:获取待处理视频数据,对待处理视频数据进行抽帧处理,得到与待处理视频数据对应的视频帧集合,分别对视频帧集合中视频帧进行信息分析,得到与视频帧对应的数据分析结果,获取视频帧的视频帧标识,并归类同一项数据分析结果,生成对应的数据分析标识,根据数据分析标识,建立视频帧标识与数据分析结果的关联关系。
在一个实施例中,计算机程序被处理器执行时还实现以下步骤:分别对视频帧集合中视频帧进行目标 检测,得到与视频帧对应的目标检测结果,目标检测结果包括检测框信息。
在一个实施例中,计算机程序被处理器执行时还实现以下步骤:确定目标数据分析结果的数据类型,根据数据类型调用图形类型,绘制并渲染目标数据分析结果至目标视频帧。
在一个实施例中,计算机程序被处理器执行时还实现以下步骤:当数据类型为数值型数据时,将视频帧集合中所有视频帧对应的相同项数据分析结果绘制为数值曲线,在数值曲线上标记目标数据分析结果,将标记后的数值曲线渲染至目标视频帧。
在一个实施例中,计算机程序被处理器执行时还实现以下步骤:当数据类型为结构型数据时,根据目标数据分析结果确定绘制坐标,根据绘制坐标,绘制并渲染目标数据分析结果至目标视频帧。
在一个实施例中,计算机程序被处理器执行时还实现以下步骤:创建数据分析选择交互控件,数据分析选择交互控件用于响应用户数据分析选择操作。
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,是可以通过计算机程序来指令相关的硬件来完成,所述的计算机程序可存储于一非易失性计算机可读取存储介质中,该计算机程序在执行时,可包括如上述各方法的实施例的流程。其中,本申请所提供的各实施例中所使用的对存储器、存储、数据库或其它介质的任何引用,均可包括非易失性和易失性存储器中的至少一种。非易失性存储器可包括只读存储器(Read-Only Memory,ROM)、磁带、软盘、闪存或光存储器等。易失性存储器可包括随机存取存储器(Random Access Memory,RAM)或外部高速缓冲存储器。作为说明而非局限,RAM可以是多种形式,比如静态随机存取存储器(Static Random Access Memory,SRAM)或动态随机存取存储器(Dynamic Random Access Memory,DRAM)等。
以上实施例的各技术特征可以进行任意的组合,为使描述简洁,未对上述实施例中的各个技术特征所有可能的组合都进行描述,然而,只要这些技术特征的组合不存在矛盾,都应当认为是本说明书记载的范围。
以上所述实施例仅表达了本申请的几种实施方式,其描述较为具体和详细,但并不能因此而理解为对发明专利范围的限制。应当指出的是,对于本领域的普通技术人员来说,在不脱离本申请构思的前提下,还可以做出若干变形和改进,这些都属于本申请的保护范围。因此,本申请专利的保护范围应以所附权利要求为准。
Claims (10)
- 一种数据可视化展示方法,其特征在于,所述方法包括:响应用户视频显示操作,显示待处理视频数据;响应用户视频帧选择操作,确定所述待处理视频数据中目标视频帧,显示所述目标视频帧;响应用户数据分析选择操作,确定与所述目标视频帧对应的目标数据分析标识;根据所述目标视频帧的视频帧标识以及所述目标数据分析标识,获取与所述目标视频帧对应的目标数据分析结果;对所述目标数据分析结果进行绘制并渲染至所述目标视频帧。
- 根据权利要求1所述的方法,其特征在于,所述方法还包括:获取待处理视频数据;对所述待处理视频数据进行抽帧处理,得到与所述待处理视频数据对应的视频帧集合;分别对所述视频帧集合中视频帧进行信息分析,得到与所述视频帧对应的数据分析结果;获取所述视频帧的视频帧标识,并归类同一项数据分析结果,生成对应的数据分析标识,根据所述数据分析标识,建立所述视频帧标识与所述数据分析结果的关联关系。
- 根据权利要求2所述的方法,其特征在于,所述分别对所述视频帧集合中视频帧进行信息分析,得到与所述视频帧对应的数据分析结果包括:分别对所述视频帧集合中视频帧进行目标检测,得到与所述视频帧对应的目标检测结果,所述目标检测结果包括检测框信息。
- 根据权利要求1所述的方法,其特征在于,所述对所述目标数据分析结果进行绘制并渲染至所述目标视频帧包括:确定所述目标数据分析结果的数据类型;根据所述数据类型调用图形类型,绘制并渲染所述目标数据分析结果至所述目标视频帧。
- 根据权利要求4所述的方法,其特征在于,所述根据所述数据类型调用 图形类型,绘制并渲染所述目标数据分析结果至所述目标视频帧包括:当所述数据类型为数值型数据时,将所述视频帧集合中所有视频帧对应的相同项数据分析结果绘制为数值曲线;在所述数值曲线上标记所述目标数据分析结果;将标记后的数值曲线渲染至所述目标视频帧。
- 根据权利要求4所述的方法,其特征在于,所述根据所述数据类型调用图形类型,绘制并渲染所述目标数据分析结果至所述目标视频帧包括:当所述数据类型为结构型数据时,根据所述目标数据分析结果确定绘制坐标;根据所述绘制坐标,绘制并渲染所述目标数据分析结果至所述目标视频帧。
- 根据权利要求1所述的方法,其特征在于,还包括:创建数据分析选择交互控件,所述数据分析选择交互控件用于响应用户数据分析选择操作。
- 一种数据可视化展示装置,其特征在于,所述装置包括:视频显示模块,用于响应用户视频显示操作,显示待处理视频数据;视频帧显示模块,用于响应用户视频帧选择操作,确定所述待处理视频数据中目标视频帧,显示所述目标视频帧;数据分析响应模块,用于响应用户数据分析选择操作,确定与所述目标视频帧对应的目标数据分析标识;数据获取模块,用于根据所述目标视频帧的视频帧标识以及所述目标数据分析标识,获取与所述目标视频帧对应的目标数据分析结果;处理模块,用于对所述目标数据分析结果进行绘制并渲染至所述目标视频帧。
- 一种计算机设备,包括存储器和处理器,所述存储器存储有计算机程序,其特征在于,所述处理器执行所述计算机程序时实现权利要求1至7中任一项所述的方法的步骤。
- 一种计算机可读存储介质,其上存储有计算机程序,其特征在于,所述计算机程序被处理器执行时实现权利要求1至7中任一项所述的方法的步骤。
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202111277492.5A CN114003160B (zh) | 2021-10-29 | 2021-10-29 | 数据可视化展示方法、装置、计算机设备和存储介质 |
CN202111277492.5 | 2021-10-29 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2023071861A1 true WO2023071861A1 (zh) | 2023-05-04 |
Family
ID=79925927
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2022/125844 WO2023071861A1 (zh) | 2021-10-29 | 2022-10-18 | 数据可视化展示方法、装置、计算机设备和存储介质 |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN114003160B (zh) |
WO (1) | WO2023071861A1 (zh) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN118069727A (zh) * | 2024-02-02 | 2024-05-24 | 太极计算机股份有限公司 | 一种数据可视化平台的数据智能处理方法 |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114003160B (zh) * | 2021-10-29 | 2024-03-29 | 影石创新科技股份有限公司 | 数据可视化展示方法、装置、计算机设备和存储介质 |
CN115237317B (zh) * | 2022-06-13 | 2024-05-17 | 北京达佳互联信息技术有限公司 | 数据展示方法、装置、电子设备及存储介质 |
CN117370602A (zh) * | 2023-04-24 | 2024-01-09 | 深圳云视智景科技有限公司 | 视频处理方法、装置、设备与计算机存储介质 |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20150070587A1 (en) * | 2013-09-09 | 2015-03-12 | General Instrument Corporation | Generating Alerts Based Upon Detector Outputs |
CN106534944A (zh) * | 2016-11-30 | 2017-03-22 | 北京锤子数码科技有限公司 | 视频展现方法和装置 |
CN110213599A (zh) * | 2019-04-16 | 2019-09-06 | 腾讯科技(深圳)有限公司 | 一种附加信息处理的方法、设备及存储介质 |
CN111586319A (zh) * | 2020-05-27 | 2020-08-25 | 北京百度网讯科技有限公司 | 视频的处理方法和装置 |
CN112637670A (zh) * | 2020-12-15 | 2021-04-09 | 上海哔哩哔哩科技有限公司 | 视频生成方法及装置 |
CN112948630A (zh) * | 2021-02-09 | 2021-06-11 | 北京奇艺世纪科技有限公司 | 列表更新方法、电子设备、存储介质及装置 |
CN114003160A (zh) * | 2021-10-29 | 2022-02-01 | 影石创新科技股份有限公司 | 数据可视化展示方法、装置、计算机设备和存储介质 |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109714526B (zh) * | 2018-11-22 | 2021-02-09 | 中国科学院计算技术研究所 | 智能摄像头及控制*** |
CN110134830A (zh) * | 2019-04-15 | 2019-08-16 | 深圳壹账通智能科技有限公司 | 视频信息数据处理方法、装置、计算机设备和存储介质 |
CN111079553A (zh) * | 2019-11-25 | 2020-04-28 | 上海眼控科技股份有限公司 | 客户分析数据的获取方法、装置、设备和存储介质 |
-
2021
- 2021-10-29 CN CN202111277492.5A patent/CN114003160B/zh active Active
-
2022
- 2022-10-18 WO PCT/CN2022/125844 patent/WO2023071861A1/zh unknown
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20150070587A1 (en) * | 2013-09-09 | 2015-03-12 | General Instrument Corporation | Generating Alerts Based Upon Detector Outputs |
CN106534944A (zh) * | 2016-11-30 | 2017-03-22 | 北京锤子数码科技有限公司 | 视频展现方法和装置 |
CN110213599A (zh) * | 2019-04-16 | 2019-09-06 | 腾讯科技(深圳)有限公司 | 一种附加信息处理的方法、设备及存储介质 |
CN111586319A (zh) * | 2020-05-27 | 2020-08-25 | 北京百度网讯科技有限公司 | 视频的处理方法和装置 |
CN112637670A (zh) * | 2020-12-15 | 2021-04-09 | 上海哔哩哔哩科技有限公司 | 视频生成方法及装置 |
CN112948630A (zh) * | 2021-02-09 | 2021-06-11 | 北京奇艺世纪科技有限公司 | 列表更新方法、电子设备、存储介质及装置 |
CN114003160A (zh) * | 2021-10-29 | 2022-02-01 | 影石创新科技股份有限公司 | 数据可视化展示方法、装置、计算机设备和存储介质 |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN118069727A (zh) * | 2024-02-02 | 2024-05-24 | 太极计算机股份有限公司 | 一种数据可视化平台的数据智能处理方法 |
Also Published As
Publication number | Publication date |
---|---|
CN114003160A (zh) | 2022-02-01 |
CN114003160B (zh) | 2024-03-29 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2023071861A1 (zh) | 数据可视化展示方法、装置、计算机设备和存储介质 | |
US11412153B2 (en) | Model-based method for capturing images, terminal, and storage medium | |
CN109117760B (zh) | 图像处理方法、装置、电子设备和计算机可读介质 | |
CN108876934B (zh) | 关键点标注方法、装置和***及存储介质 | |
US10430456B2 (en) | Automatic grouping based handling of similar photos | |
US10902254B2 (en) | Converting a captured image of a layout to a structured document template | |
WO2021088422A1 (zh) | 应用消息的通知方法及装置 | |
WO2017000898A1 (zh) | 软件图标显示方法和装置 | |
US10672168B1 (en) | Annotating an image with a texture fill | |
CN108492349B (zh) | 书写笔画的处理方法、装置、设备和存储介质 | |
CN111223155B (zh) | 图像数据处理方法、装置、计算机设备和存储介质 | |
CN111596848A (zh) | 一种界面取色方法、装置、设备及存储介质 | |
CN110580486A (zh) | 一种数据处理方法、装置、电子设备和可读介质 | |
JP2021006982A (ja) | 文字の色を決定する方法および装置 | |
CN114185544A (zh) | 页面数据处理方法、装置、电子设备及存储介质 | |
CN104881423B (zh) | 信息提供装置以及信息提供方法 | |
CN113794831A (zh) | 视频拍摄方法、装置、电子设备及介质 | |
CN106708958B (zh) | 浏览器内核的排版结构展现方法及装置 | |
CN108614657B (zh) | 图像合成方法、装置、设备及其图像载体 | |
CN112612989A (zh) | 数据展示方法、装置、计算机设备和存储介质 | |
CN109766530B (zh) | 图表边框的生成方法、装置、存储介质和电子设备 | |
CN111107264A (zh) | 图像处理方法、装置、存储介质以及终端 | |
CN114489910B (zh) | 一种视频会议数据显示方法、装置、设备及介质 | |
CN114245193A (zh) | 显示控制方法、装置和电子设备 | |
US20230343038A1 (en) | Method and system for creating augmented reality filters on mobile devices |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22885739 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |