WO2023071861A1 - Procédé et appareil d'affichage de visualisation de données, dispositif informatique et support de stockage - Google Patents

Procédé et appareil d'affichage de visualisation de données, dispositif informatique et support de stockage Download PDF

Info

Publication number
WO2023071861A1
WO2023071861A1 PCT/CN2022/125844 CN2022125844W WO2023071861A1 WO 2023071861 A1 WO2023071861 A1 WO 2023071861A1 CN 2022125844 W CN2022125844 W CN 2022125844W WO 2023071861 A1 WO2023071861 A1 WO 2023071861A1
Authority
WO
WIPO (PCT)
Prior art keywords
target
video frame
data
data analysis
video
Prior art date
Application number
PCT/CN2022/125844
Other languages
English (en)
Chinese (zh)
Inventor
符峥
龙良曲
Original Assignee
影石创新科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 影石创新科技股份有限公司 filed Critical 影石创新科技股份有限公司
Publication of WO2023071861A1 publication Critical patent/WO2023071861A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04842—Selection of displayed objects or displayed text elements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management

Definitions

  • the present application relates to the technical field of data processing, in particular to a data visualization display method, device, computer equipment and storage medium.
  • video data is gradually becoming an important carrier of information transmission.
  • video data contains both spatial attributes (position structure of objects in the image) and temporal attributes (image frame sequence), it is necessary to consider the relationship and change of variables in the spatial and temporal dimensions of data during analysis.
  • the corresponding layers are obtained by rendering first, and then the layers are displayed on the video data for visual display.
  • a data visualization display method comprising:
  • the data visualization display method further includes:
  • information analysis is performed on the video frames in the video frame set, and the data analysis results corresponding to the video frames include:
  • drawing the analysis result of the target data and rendering it to the target video frame includes:
  • calling the graphics type according to the data type, drawing and rendering the target data analysis result to the target video frame includes:
  • calling the graphics type according to the data type, drawing and rendering the target data analysis result to the target video frame includes:
  • the drawing coordinates are determined according to the target data analysis results
  • the data visualization display method further includes:
  • a data visualization display device comprising:
  • the video display module is used to respond to the user's video display operation and display the video data to be processed
  • the video frame display module is used to respond to the user's video frame selection operation, determine the target video frame in the video data to be processed, and display the target video frame;
  • the data analysis response module is used to respond to the user data analysis selection operation and determine the target data analysis identification corresponding to the target video frame;
  • a data acquisition module configured to obtain a target data analysis result corresponding to the target video frame according to the video frame identifier and the target data analysis identifier of the target video frame;
  • the processing module is used to draw the target data analysis result and render it to the target video frame.
  • a computer device comprising a memory and a processor, the memory stores a computer program, and the processor implements the following steps when executing the computer program:
  • a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:
  • the above data visualization display method, device, computer equipment and storage medium display the data to be processed by responding to the video display operation of the user, respond to the video frame selection operation of the user, determine the target video frame in the video data to be processed, display the target video frame, and respond
  • the user data analysis selection operation determines the target data analysis identifier corresponding to the target video frame, obtains the target data analysis result corresponding to the target video frame according to the video frame identifier and the target data analysis identifier of the target video frame, and performs an analysis on the target data analysis result. Draw and render to the target video frame.
  • real-time display control of the data analysis results can be realized, instead of directly displaying the corresponding layer of the data analysis results to the video data, which can reduce the redundancy and complexity of data visualization. Information is vague.
  • Fig. 1 is a schematic flow chart of a data visualization display method in an embodiment
  • Figure 2 is a schematic diagram of responding to user operations in an embodiment
  • Fig. 3 is a schematic flow chart of drawing target data analysis results and rendering them to target video frames in one embodiment
  • Fig. 4 is a schematic flow chart of an embodiment rendering the marked numerical curve to the target video frame
  • Fig. 5 is a schematic flow chart of a data visualization display method in another embodiment
  • Fig. 6 is a structural block diagram of a data visualization display device in an embodiment
  • Figure 7 is an internal block diagram of a computer device in one embodiment.
  • a data visualization display method is provided.
  • the method is applied to a terminal for example. It can be understood that this method can also be applied to a server, and can also be applied to It is based on a system including a terminal and a server, and is realized through the interaction between the terminal and the server.
  • the terminal can be, but not limited to, various personal computers, notebook computers, smart phones, tablet computers, portable wearable devices, sports cameras, panoramic cameras or pan-tilt cameras, etc.
  • the server can be composed of an independent server or multiple servers server cluster to achieve.
  • the method includes the following steps:
  • Step 102 display the video data to be processed in response to the user's video display operation.
  • the user video display operation refers to an operation in which the user wants to display a video on the terminal.
  • the video data to be processed refers to the video data that the user wants to display on the terminal.
  • the user first needs to select the video data corresponding to the data visualization.
  • the user can interact with the terminal to perform video display operations, that is, select the video data to be displayed, and the terminal will respond to the user's video display. Operation, according to the user's video display operation, acquire and display the video data to be processed. For example, a video list is displayed on the display interface of the terminal, and the user can make a selection according to the video list, and select the video data to be displayed on the terminal.
  • Step 104 In response to the user's video frame selection operation, determine the target video frame in the video data to be processed, and display the target video frame.
  • the user's video frame selection operation refers to an operation in which the user wants to display any video frame in the video data to be processed on the terminal.
  • the target video frame refers to the video frame that the user wants to display on the terminal.
  • the user will further interact with the terminal to perform a video frame selection operation, that is, select the video frame data to be displayed, and the terminal will respond to the user's video frame selection operation, and determine according to the user's video frame selection operation
  • the target video frame in the video data to be processed displays the target video frame.
  • the terminal will synchronously display a video progress bar corresponding to the video data to be processed, and the user can select video frames by dragging the video progress bar or clicking anywhere on the video progress bar.
  • Step 106 in response to the user data analysis selection operation, determine the target data analysis identifier corresponding to the target video frame.
  • the user data analysis selection operation refers to an operation in which the user wants to display any data analysis result on the terminal.
  • the target data analysis identifier refers to the data analysis identifier corresponding to the data analysis result that the user wants to display on the terminal.
  • the data analysis identifier is used to distinguish the data analysis results. Different data analysis results correspond to different data analysis identifiers.
  • the target data analysis identifier may specifically refer to a character string corresponding to the data analysis result that the user wants to display on the terminal.
  • the user will further interact with the terminal to perform a data analysis selection operation, that is, select the target data analysis identification corresponding to the data analysis result to be displayed, and the terminal will respond to the user data analysis selection operation, according to the user
  • the data analysis selection operation determines the target data analysis identifier corresponding to the target video frame. For example, when displaying the target video frame, the terminal will simultaneously display the data analysis selection interactive control, and the user can complete the data analysis selection operation by selecting the data analysis selection interactive control.
  • the terminal will display the video data to be processed by responding to the video display operation of the user. While displaying the video data to be processed, the terminal will simultaneously display the video progress bar corresponding to the video data to be processed.
  • the video frame selection operation can be performed by dragging the video progress bar or clicking anywhere on the video progress bar.
  • the terminal will respond to the user's video frame selection operation and display the target video frame. While displaying the target video frame, the terminal will simultaneously display the data analysis Select the interactive control, and the user can select the data analysis selection operation by selecting the data analysis selection interactive control to determine the data analysis results that need to be displayed on the terminal.
  • the user when the user needs to view other video frames in the video data to be processed and the corresponding data analysis results, he can reselect the target video frame by dragging the video progress bar, clicking anywhere on the video progress bar, etc., and change the data The selection of the analysis selection interactive control for data analysis selection operation. It should be noted that after re-selecting the target video frame, the user may not select the interactive control for data analysis, and the data analysis result displayed at this time is the same as the data analysis result displayed on the target video frame of the previous frame. Corresponding, belonging to the same data analysis result.
  • Step 108 according to the video frame identifier and the target data analysis identifier of the target video frame, obtain the target data analysis result corresponding to the target video frame.
  • the video frame identifier is used to distinguish video frames.
  • the video frame identifier may specifically refer to a sequence number of a video frame.
  • the video frame identifier may specifically refer to a time stamp corresponding to the video frame.
  • the target data analysis result refers to the data analysis result that the user wants to display on the terminal.
  • the data analysis result refers to the analysis of the spatial information and time information in the video frame by using an appropriate statistical analysis method. Analysis information that is useful for readers or users and can form conclusions, usually expressed in the form of numerical values or characters.
  • the data analysis result may specifically refer to global image information such as brightness values of video frames.
  • the data analysis result may specifically refer to a target detection result of an object in a video frame detected by using a target detection method, and the target detection result includes detection frame information.
  • the data analysis result may specifically refer to the action category information of the person in the video frame.
  • the terminal will obtain the video frame identifier of the video frame in advance, and classify the same data analysis result, generate the corresponding data analysis identifier, establish the association relationship between the video frame identifier and the data analysis result according to the data analysis identifier, and determine the target
  • the terminal will query the established association relationship according to the video frame identification and target data analysis identification of the target video frame, and obtain the target data analysis result corresponding to the target video frame.
  • Step 110 drawing and rendering the target data analysis result to the target video frame.
  • the terminal when performing information analysis on the video frames in the video data to be processed in advance, the terminal will specify the data type of the data analysis result, and save the data type and the data analysis result together. Therefore, after obtaining the target data analysis result, the terminal can synchronously obtain the data type of the target data analysis result, and then call the corresponding graphics type according to the data type to draw and render the target data analysis result to the target video frame.
  • the data type includes numeric data, text data, structured data, and the like.
  • the above data visualization display method by responding to the user's video display operation, displays the data to be processed, responds to the user's video frame selection operation, determines the target video frame in the video data to be processed, displays the target video frame, and responds to the user's data analysis and selection operation.
  • the target data analysis identifier corresponding to the target video frame obtains the target data analysis result corresponding to the target video frame, draws the target data analysis result and renders it to the target video frame, In the whole process, by responding to user operations, real-time display control of the data analysis results can be realized, instead of directly displaying the corresponding layer of the data analysis results to the video data, which can reduce the redundancy and information ambiguity of data visualization.
  • the data visualization display method further includes:
  • the video data to be processed refers to the video data captured by the shooting equipment that can obtain digital video.
  • the shooting equipment includes but is not limited to SLR cameras, mirrorless cameras, mobile phones with camera and video functions, sports cameras, panoramic cameras, PTZ cameras, drones, etc.
  • the terminal will obtain the video data to be processed, perform frame extraction processing on the video data to be processed, obtain a set of video frames corresponding to the video data to be processed, and apply image processing based on digital image processing.
  • Analysis and video analysis methods respectively analyze the information of the video frames in the video frame set to obtain the data analysis results corresponding to the video frames, and obtain the video frame identification of the video frames, and classify the same data analysis results to generate the corresponding
  • the data analysis identifier establishes an association relationship between the video frame identifier and the data analysis result according to the data analysis identifier.
  • the frame extraction method of the video data to be processed may be a uniform frame extraction method, or a frame extraction method may be set as required, which is not specifically limited in this embodiment.
  • performing information analysis may specifically refer to determining global image information such as brightness values of video frames.
  • performing information analysis may specifically refer to obtaining detection frame information of an object in a video frame using a target detection method.
  • performing information analysis may specifically refer to determining a category of a person's action in a video frame, and the like.
  • the data analysis results are expressed in the form of numerical values or characters.
  • the brightness value can be directly expressed by numerical value
  • the detection frame information can be expressed by numerical coordinates
  • the character action category can be expressed by character.
  • establishing the association relationship between the video frame identifier and the data analysis result is to generate the corresponding data analysis identifier after classifying the same data analysis result, and add the time attribute synchronized with the video frame to the data analysis result.
  • the analysis flag stores the data analysis results added with the time attribute synchronized with the video frame, so as to facilitate the dynamic synchronous display of the video frame and the data analysis results.
  • the video frame identifier here may specifically refer to a sequence number of a video frame or a corresponding time stamp. It should be noted that when analyzing the video data to be processed, the number of video frames to be analyzed and the type of information to be analyzed can be set according to the needs.
  • the information analysis is performed on all video frames in the video frame set , then directly establish the association relationship between all video frame identifiers and data analysis results. If the information analysis is not performed on all video frames in the video frame set, that is, only part of the video frames are analyzed, then after completing the information analysis on the video frames in the entire video data to be processed, when establishing the association relationship, it is necessary to The data analysis results are supplemented or interpolated so that the number of data analysis results is consistent with the number of video frame identifiers, that is, for video frames that have not been analyzed for information in the video frame set, it is also necessary to establish the video frame identifier and data corresponding to the video frame Relationships between analysis results.
  • supplementing or interpolating the data analysis results may be performed when establishing an association relationship or when displaying the data analysis results.
  • performing when displaying the data analysis result means that when the data analysis result is displayed on the video frame, if the corresponding data analysis result is not obtained in the association relationship according to the video frame identification corresponding to the video frame, then according to the association relationship
  • the existing data analysis results are supplemented or interpolated to obtain the data analysis results of the video frame.
  • the association relationship refers to the use of structured sequence data to represent the corresponding relationship between video frame identifiers and data analysis results.
  • Structured sequence data includes but is not limited to tables, csv (Comma-Separated Values, comma-separated values), json (JavaScript Object Notation, JS Object Notation) data, etc.
  • the specific format is arranged in order of video frames or time, and contains the data corresponding to the data analysis results of each frame or time. Taking csv data as an example, the relationship can be expressed as: frame_id, value (frame number, value): 0, 1.000; 1, 1.000; 2, 1.234.
  • the acquisition of the data analysis results and the association between the video frame identifier and the data analysis results can be realized, so that the alignment and accurate display can be realized when the data analysis results need to be displayed on the video frames.
  • information analysis is performed on the video frames in the video frame set, and the data analysis results corresponding to the video frames include:
  • Target detection is performed on the video frames in the video frame set respectively, and target detection results corresponding to the video frames are obtained, and the target detection results include detection frame information.
  • the detection frame information refers to the coordinate information of the object detected in the video frame.
  • frame_id is the frame number
  • bbox_id is the frame detection frame number
  • x1, y1 are the image coordinates of the upper left corner of the detection frame
  • x2, y2 are the image coordinates of the lower right corner of the detection frame.
  • the detection frame information can be specifically expressed as: frame_id, bbox_id, x1, y1, x2, y2: 0, 0, 20, 20, 40, 30; 0, 1, 15, 15, 25, 35; 1, 2, 30 , 30, 45, 50 such a form.
  • the terminal obtains a pre-trained target detection model, uses the pre-trained target detection model to perform target detection on the video frames in the video frame set, and obtains target detection results corresponding to the video frames, and the target detection results include detection frame information.
  • the pre-trained target detection model is obtained by training the sample image data carrying the target frame.
  • the terminal will first obtain the initial target detection model, and then input the sample image data into the initial target detection model.
  • the initial target detection model outputs the predicted detection frame corresponding to the sample image data.
  • the loss function corresponding to the initial target detection model is obtained, and the model parameters of the initial target detection model are adjusted.
  • the initial target detection model after parameter adjustment performs target detection on the sample image data again to obtain the corresponding loss function until the loss function converges to obtain the pre-trained target detection model.
  • target detection results corresponding to the video frames can be obtained by respectively performing target detection on the video frames in the video frame set, and the target detection results include detection frame information to implement information analysis on the video frames.
  • the information analysis of the video frame can specifically mean that the target object included in the video frame and the type and location of the target object can be determined according to the target detection result, so that the corresponding target detection can be displayed when the video frame is displayed. result.
  • drawing the analysis result of the target data and rendering it to the target video frame includes:
  • the terminal when performing information analysis on the video frames in the video data to be processed in advance, the terminal will specify the data type of the data analysis result, and save the data type and the data analysis result together. Therefore, after obtaining the target data analysis result, the terminal can synchronously obtain the data type of the target data analysis result, and then call the corresponding graphics type according to the data type to draw and render the target data analysis result to the target video frame.
  • the data type includes numeric data, text data, structured data, and the like. Further, when drawing and rendering, different graphic colors and fonts may be used to identify different target data analysis results.
  • the terminal can use the programmable GUI (Graphical User Interface, Graphical User Interface) library to draw the analysis results of the target data and render them to the target video frame.
  • GUI code library for operation, it can draw target data analysis results into specific shapes, charts or text according to data types, and render them on the target video frame. For example, a schematic flow chart of drawing target data analysis results and rendering them to target video frames may be shown in FIG. 3 .
  • the program in the terminal will read the analysis result data (that is, the target data analysis result), and call the GUI library (that is, the programmable GUI library) corresponding to the chart or graph type according to the data type specified in the analysis result file, so that the GUI library calls the system graphics
  • the interface interface draws and renders analysis result charts, graphics and target video frames, and displays the rendering results on the system graphical interface of the terminal.
  • the target data analysis result can be drawn and rendered to the target video frame.
  • calling the graphics type according to the data type, drawing and rendering the target data analysis result to the target video frame includes:
  • the terminal when the data type is numerical data, the terminal will draw the same item data analysis results corresponding to all video frames in the video frame set as a numerical curve, mark the target data analysis results on the numerical curve, and draw the marked numerical curve Render to target video frame.
  • the data analysis result is the brightness value of a video frame
  • its data type is numerical data.
  • the terminal When it is necessary to display the corresponding brightness value on the target video frame, the terminal will first draw the corresponding brightness values of all video frames is a numerical curve, and then mark the brightness value corresponding to the target video frame on the numerical curve, and render the marked numerical curve to the target video frame.
  • the flowchart of rendering the marked numerical curve to the target video frame can be shown in Figure 4.
  • the marked numerical curve and the target video frame are arranged in the form of layout instead of layer superposition
  • the numerical curve can be drawn by using the same item data analysis results corresponding to all video frames.
  • the corresponding target data analysis results are marked on the numerical curve , where the target data analysis result corresponding to the left video frame is 0.9, and the target data analysis result corresponding to the right video frame is 0.2.
  • the same item data analysis results corresponding to all video frames in the video frame set are drawn as numerical curves, and the target data analysis results are marked on the numerical curves, and the marked numerical values The curve is rendered to the target video frame, which can realize the visual display of numerical data.
  • calling the graphics type according to the data type, drawing and rendering the target data analysis result to the target video frame includes:
  • the drawing coordinates are determined according to the target data analysis results
  • the terminal determines the drawing coordinates according to the target data analysis result, and draws and renders the target data analysis result to the target video frame according to the drawing coordinates.
  • the data analysis result is the detection frame information of the video frame
  • its data type is structured data
  • the terminal will determine the drawing coordinates according to the detection frame information, That is, the coordinates of the detection frame, and then draw and render the detection frame to the target video frame according to the coordinates of the detection frame.
  • the drawing coordinates are determined according to the analysis results of the target data, and the analysis results of the target data are drawn and rendered to the target video frame according to the drawing coordinates, so that the visual display of the structured data can be realized.
  • the data visualization display method further includes:
  • the terminal will create data analysis and selection interactive controls through the programmable GUI library.
  • the data analysis and selection interactive controls correspond to the number of data analysis results and are used to respond to user data analysis and selection operations. Users can use data analysis to select interactive controls in real time. Which data analysis results are displayed on the video frame.
  • the terminal will also create a data type selection interactive control to respond to the user's data type selection operation, and control the data analysis results of which data types are displayed on the video frame in real time.
  • the interactive control for data analysis and selection can be used to respond to the user's data analysis and selection operation, thereby realizing real-time control of data visualization.
  • a schematic flow chart is used to illustrate the data visualization display method of the present application, and the data visualization display method specifically includes the following steps:
  • Step 502 acquiring video data to be processed
  • Step 504 performing frame extraction processing on the video data to be processed to obtain a set of video frames corresponding to the video data to be processed;
  • Step 506 respectively performing information analysis on the video frames in the video frame set to obtain data analysis results corresponding to the video frames;
  • Step 508 obtaining the video frame identifier of the video frame, and classifying the same data analysis result, generating a corresponding data analysis identifier, and establishing a relationship between the video frame identifier and the data analysis result according to the data analysis identifier;
  • Step 510 responding to the user's video display operation, displaying the video data to be processed
  • Step 512 responding to the user's video frame selection operation, determining the target video frame in the video data to be processed, and displaying the target video frame;
  • Step 514 creating a data analysis selection interactive control, which is used to respond to the user's data analysis selection operation
  • Step 516 in response to the user data analysis selection operation, determine the target data analysis identifier corresponding to the target video frame;
  • Step 518 according to the video frame identifier and the target data analysis identifier of the target video frame, obtain the target data analysis result corresponding to the target video frame;
  • Step 520 determine the data type of the target data analysis result, when the data type is numerical data, jump to step 522, and when the data type is structural data, jump to step 528;
  • Step 522 drawing the same item data analysis results corresponding to all video frames in the video frame set as a numerical curve
  • Step 524 marking the target data analysis results on the numerical curve
  • Step 526 rendering the marked numerical curve to the target video frame
  • Step 528 determine the drawing coordinates according to the target data analysis results
  • Step 530 draw and render the target data analysis result to the target video frame according to the drawing coordinates.
  • steps in the flow charts involved in the above embodiments are shown sequentially as indicated by the arrows, these steps are not necessarily executed sequentially in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and these steps can be executed in other orders. Moreover, at least some of the steps in the flow charts involved in the above embodiments may include multiple steps or stages, and these steps or stages are not necessarily executed at the same time, but may be executed at different times. These steps Or the execution sequence of the stages is not necessarily performed sequentially, but may be executed in turn or alternately with other steps or at least a part of steps or stages in other steps.
  • a data visualization display device including: a video display module 602, a video frame display module 604, a data analysis response module 606, a data acquisition module 608 and a processing module 610, wherein :
  • Video display module 602 used to respond to user video display operation, display video data to be processed
  • the video frame display module 604 is used to respond to the user's video frame selection operation, determine the target video frame in the video data to be processed, and display the target video frame;
  • the data analysis response module 606 is used to respond to the user data analysis selection operation and determine the target data analysis identification corresponding to the target video frame;
  • a data acquisition module 608, configured to acquire a target data analysis result corresponding to the target video frame according to the video frame identifier and the target data analysis identifier of the target video frame;
  • the processing module 610 is configured to draw the analysis result of the target data and render it to the target video frame.
  • the above data visualization display device displays the data to be processed by responding to the user's video display operation, responds to the user's video frame selection operation, determines the target video frame in the video data to be processed, displays the target video frame, responds to the user's data analysis and selection operation, determines and The target data analysis identifier corresponding to the target video frame, according to the video frame identifier and the target data analysis identifier of the target video frame, obtains the target data analysis result corresponding to the target video frame, draws the target data analysis result and renders it to the target video frame,
  • real-time display control of the data analysis results can be realized, instead of directly displaying the corresponding layer of the data analysis results to the video data, which can reduce the redundancy and information ambiguity of data visualization.
  • the data visualization display device further includes an analysis module, the analysis module is used to obtain the video data to be processed, perform frame extraction processing on the video data to be processed, obtain a set of video frames corresponding to the video data to be processed, and analyze the video frames respectively Perform information analysis on the video frames in the collection, obtain the data analysis results corresponding to the video frames, obtain the video frame identifiers of the video frames, and classify the same data analysis results, generate corresponding data analysis identifiers, and establish video frames based on the data analysis identifiers Identify the association relationship with the data analysis results.
  • the analysis module is used to obtain the video data to be processed, perform frame extraction processing on the video data to be processed, obtain a set of video frames corresponding to the video data to be processed, and analyze the video frames respectively Perform information analysis on the video frames in the collection, obtain the data analysis results corresponding to the video frames, obtain the video frame identifiers of the video frames, and classify the same data analysis results, generate corresponding data analysis identifiers, and establish video frames based on the
  • the analysis module is further configured to perform target detection on the video frames in the video frame set to obtain target detection results corresponding to the video frames, and the target detection results include detection frame information.
  • the processing module is further configured to determine the data type of the target data analysis result, call the graphics type according to the data type, and draw and render the target data analysis result to the target video frame.
  • the processing module is also used to draw the same item data analysis results corresponding to all video frames in the video frame set as a numerical curve when the data type is numerical data, and mark the target data analysis result on the numerical curve, Render the marked numerical curve to the target video frame.
  • the processing module is further configured to determine the drawing coordinates according to the target data analysis results when the data type is structured data, and draw and render the target data analysis results to the target video frame according to the drawing coordinates.
  • the data visualization display device further includes a creation module, the creation module is used to create a data analysis selection interaction control, and the data analysis selection interaction control is used to respond to the user's data analysis selection operation.
  • Each module in the above-mentioned data visualization display device can be fully or partially realized by software, hardware and a combination thereof.
  • the above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, and can also be stored in the memory of the computer device in the form of software, so that the processor can invoke and execute the corresponding operations of the above-mentioned modules.
  • a computer device is provided.
  • the computer device may be a terminal, and its internal structure may be as shown in FIG. 7 .
  • the computer device includes a processor, a memory, a communication interface, a display screen and an input device connected through a system bus. Wherein, the processor of the computer device is used to provide calculation and control capabilities.
  • the memory of the computer device includes a non-volatile storage medium and an internal memory.
  • the non-volatile storage medium stores an operating system and computer programs.
  • the internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage medium.
  • the communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be realized through WIFI, an operator network, NFC (Near Field Communication) or other technologies.
  • a data visualization display method is realized.
  • the display screen of the computer device may be a liquid crystal display screen or an electronic ink display screen
  • the input device of the computer device may be a touch layer covered on the display screen, or a button, a trackball or a touch pad provided on the casing of the computer device , and can also be an external keyboard, touchpad, or mouse.
  • FIG. 7 is only a block diagram of a part of the structure related to the solution of this application, and does not constitute a limitation to the computer equipment on which the solution of this application is applied.
  • the specific computer equipment can be More or fewer components than shown in the figures may be included, or some components may be combined, or have a different arrangement of components.
  • a computer device including a memory and a processor, a computer program is stored in the memory, and the processor implements the following steps when executing the computer program:
  • the processor when the processor executes the computer program, the following steps are also implemented: acquiring video data to be processed, performing frame extraction processing on the video data to be processed, obtaining a video frame set corresponding to the video data to be processed, Perform information analysis on the video frame to obtain the data analysis result corresponding to the video frame, obtain the video frame identification of the video frame, and classify the same data analysis result, generate the corresponding data analysis identification, and establish the video frame identification and The relationship between data analysis results.
  • the processor executes the computer program, the following steps are further implemented: respectively performing object detection on the video frames in the video frame set to obtain object detection results corresponding to the video frames, the object detection results including detection frame information.
  • the processor executes the computer program, the following steps are further implemented: determining the data type of the target data analysis result, calling the graphics type according to the data type, drawing and rendering the target data analysis result to the target video frame.
  • the processor executes the computer program, the following steps are also implemented: when the data type is numerical data, the same item data analysis results corresponding to all video frames in the video frame set are drawn as a numerical curve, and on the numerical curve Mark the target data analysis results, and render the marked numerical curve to the target video frame.
  • the processor executes the computer program, the following steps are also implemented: when the data type is structured data, determine the drawing coordinates according to the target data analysis results, and draw and render the target data analysis results to the target video frame according to the drawing coordinates .
  • the processor executes the computer program, the following steps are further implemented: creating an interactive control for data analysis selection, and the interactive control for data analysis selection is used for responding to a user's data analysis selection operation.
  • a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:
  • the following steps are also implemented: acquiring the video data to be processed, performing frame extraction processing on the video data to be processed, obtaining a set of video frames corresponding to the video data to be processed, and separately processing the set of video frames Perform information analysis on the video frame, obtain the data analysis result corresponding to the video frame, obtain the video frame identification of the video frame, and classify the same data analysis result, generate the corresponding data analysis identification, and establish the video frame identification according to the data analysis identification Correlation with data analysis results.
  • the following steps are also implemented: respectively performing target detection on the video frames in the video frame set to obtain target detection results corresponding to the video frames, and the target detection results include detection frame information.
  • the following steps are further implemented: determining the data type of the target data analysis result, calling the graphics type according to the data type, drawing and rendering the target data analysis result to the target video frame.
  • the following steps are also implemented: when the data type is numerical data, the same item data analysis results corresponding to all video frames in the video frame set are drawn as a numerical curve, and the numerical curve Mark the target data analysis results, and render the marked numerical curve to the target video frame.
  • the following steps are also implemented: when the data type is structured data, determine the drawing coordinates according to the target data analysis results, draw and render the target data analysis results to the target video according to the drawing coordinates frame.
  • the following steps are further implemented: creating an interactive control for data analysis selection, and the interactive control for data analysis selection is used for responding to a user's data analysis selection operation.
  • Non-volatile memory may include read-only memory (Read-Only Memory, ROM), magnetic tape, floppy disk, flash memory or optical memory, etc.
  • Volatile memory can include Random Access Memory (RAM) or external cache memory.
  • RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM).

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • User Interface Of Digital Computer (AREA)
  • Image Generation (AREA)

Abstract

La présente demande se rapporte à un procédé et à un appareil d'affichage de visualisation de données, à un dispositif informatique et à un support de stockage. Le procédé consiste : à la suite d'une opération d'affichage vidéo d'un utilisateur, à afficher des données vidéo à traiter; à la suite d'une opération de sélection de trame vidéo de l'utilisateur, à déterminer une trame vidéo cible dans les données vidéo à traiter et à afficher la trame vidéo cible; à la suite d'une opération de sélection d'analyse de données de l'utilisateur, à déterminer un identifiant d'analyse de données cible correspondant à la trame vidéo cible; à obtenir, en fonction de l'identifiant de trame vidéo de la trame vidéo cible et de l'identifiant d'analyse de données cible, un résultat d'analyse de données cible correspondant à la trame vidéo cible; et à dessiner et à rendre le résultat d'analyse de données cibles pour la trame vidéo cible. Au moyen du procédé, la redondance et le flou d'informations dans la visualisation de données peuvent être réduits.
PCT/CN2022/125844 2021-10-29 2022-10-18 Procédé et appareil d'affichage de visualisation de données, dispositif informatique et support de stockage WO2023071861A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202111277492.5 2021-10-29
CN202111277492.5A CN114003160B (zh) 2021-10-29 2021-10-29 数据可视化展示方法、装置、计算机设备和存储介质

Publications (1)

Publication Number Publication Date
WO2023071861A1 true WO2023071861A1 (fr) 2023-05-04

Family

ID=79925927

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/125844 WO2023071861A1 (fr) 2021-10-29 2022-10-18 Procédé et appareil d'affichage de visualisation de données, dispositif informatique et support de stockage

Country Status (2)

Country Link
CN (1) CN114003160B (fr)
WO (1) WO2023071861A1 (fr)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114003160B (zh) * 2021-10-29 2024-03-29 影石创新科技股份有限公司 数据可视化展示方法、装置、计算机设备和存储介质
CN115237317B (zh) * 2022-06-13 2024-05-17 北京达佳互联信息技术有限公司 数据展示方法、装置、电子设备及存储介质
CN117370602A (zh) * 2023-04-24 2024-01-09 深圳云视智景科技有限公司 视频处理方法、装置、设备与计算机存储介质

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150070587A1 (en) * 2013-09-09 2015-03-12 General Instrument Corporation Generating Alerts Based Upon Detector Outputs
CN106534944A (zh) * 2016-11-30 2017-03-22 北京锤子数码科技有限公司 视频展现方法和装置
CN110213599A (zh) * 2019-04-16 2019-09-06 腾讯科技（深圳）有限公司 一种附加信息处理的方法、设备及存储介质
CN111586319A (zh) * 2020-05-27 2020-08-25 北京百度网讯科技有限公司 视频的处理方法和装置
CN112637670A (zh) * 2020-12-15 2021-04-09 上海哔哩哔哩科技有限公司 视频生成方法及装置
CN112948630A (zh) * 2021-02-09 2021-06-11 北京奇艺世纪科技有限公司 列表更新方法、电子设备、存储介质及装置
CN114003160A (zh) * 2021-10-29 2022-02-01 影石创新科技股份有限公司 数据可视化展示方法、装置、计算机设备和存储介质

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109714526B (zh) * 2018-11-22 2021-02-09 中国科学院计算技术研究所 智能摄像头及控制***
CN110134830A (zh) * 2019-04-15 2019-08-16 深圳壹账通智能科技有限公司 视频信息数据处理方法、装置、计算机设备和存储介质
CN111079553A (zh) * 2019-11-25 2020-04-28 上海眼控科技股份有限公司 客户分析数据的获取方法、装置、设备和存储介质

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150070587A1 (en) * 2013-09-09 2015-03-12 General Instrument Corporation Generating Alerts Based Upon Detector Outputs
CN106534944A (zh) * 2016-11-30 2017-03-22 北京锤子数码科技有限公司 视频展现方法和装置
CN110213599A (zh) * 2019-04-16 2019-09-06 腾讯科技（深圳）有限公司 一种附加信息处理的方法、设备及存储介质
CN111586319A (zh) * 2020-05-27 2020-08-25 北京百度网讯科技有限公司 视频的处理方法和装置
CN112637670A (zh) * 2020-12-15 2021-04-09 上海哔哩哔哩科技有限公司 视频生成方法及装置
CN112948630A (zh) * 2021-02-09 2021-06-11 北京奇艺世纪科技有限公司 列表更新方法、电子设备、存储介质及装置
CN114003160A (zh) * 2021-10-29 2022-02-01 影石创新科技股份有限公司 数据可视化展示方法、装置、计算机设备和存储介质

Also Published As

Publication number Publication date
CN114003160A (zh) 2022-02-01
CN114003160B (zh) 2024-03-29

Similar Documents

Publication Publication Date Title
WO2023071861A1 (fr) Procédé et appareil d'affichage de visualisation de données, dispositif informatique et support de stockage
US11412153B2 (en) Model-based method for capturing images, terminal, and storage medium
CN109117760B (zh) 图像处理方法、装置、电子设备和计算机可读介质
CN108876934B (zh) 关键点标注方法、装置和***及存储介质
US10430456B2 (en) Automatic grouping based handling of similar photos
US10902254B2 (en) Converting a captured image of a layout to a structured document template
WO2021088422A1 (fr) Procédé et dispositif de notification de message d'application
WO2017000898A1 (fr) Procédé et appareil d'affichage d'icône de logiciel
US11468613B2 (en) Annotating an image with a texture fill
CN108492349B (zh) 书写笔画的处理方法、装置、设备和存储介质
CN111223155B (zh) 图像数据处理方法、装置、计算机设备和存储介质
CN111596848A (zh) 一种界面取色方法、装置、设备及存储介质
JP2021006982A (ja) 文字の色を決定する方法および装置
CN104881423B (zh) 信息提供装置以及信息提供方法
CN113794831A (zh) 视频拍摄方法、装置、电子设备及介质
CN110580486A (zh) 一种数据处理方法、装置、电子设备和可读介质
CN117576388A (zh) 一种图像处理方法、装置、存储介质及电子设备
CN108614657B (zh) 图像合成方法、装置、设备及其图像载体
CN112612989A (zh) 数据展示方法、装置、计算机设备和存储介质
CN109766530B (zh) 图表边框的生成方法、装置、存储介质和电子设备
CN111107264A (zh) 图像处理方法、装置、存储介质以及终端
CN114489910B (zh) 一种视频会议数据显示方法、装置、设备及介质
CN106708958B (zh) 浏览器内核的排版结构展现方法及装置
CN114245193A (zh) 显示控制方法、装置和电子设备
US20230343038A1 (en) Method and system for creating augmented reality filters on mobile devices

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22885739

Country of ref document: EP

Kind code of ref document: A1