CN111596883B - Data visualization system supporting voice recognition and somatosensory operation remote control - Google Patents
Data visualization system supporting voice recognition and somatosensory operation remote control Download PDFInfo
- Publication number
- CN111596883B CN111596883B CN202010404967.1A CN202010404967A CN111596883B CN 111596883 B CN111596883 B CN 111596883B CN 202010404967 A CN202010404967 A CN 202010404967A CN 111596883 B CN111596883 B CN 111596883B
- Authority
- CN
- China
- Prior art keywords
- module
- data visualization
- instruction
- visualization system
- voice
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000013079 data visualisation Methods 0.000 title claims abstract description 151
- 230000003238 somatosensory effect Effects 0.000 title claims abstract description 27
- 238000012545 processing Methods 0.000 claims description 41
- 230000000007 visual effect Effects 0.000 claims description 15
- 238000000034 method Methods 0.000 claims description 14
- 230000003993 interaction Effects 0.000 claims description 9
- 230000009471 action Effects 0.000 claims description 7
- 238000013461 design Methods 0.000 claims description 6
- 238000012800 visualization Methods 0.000 claims description 5
- 230000000295 complement effect Effects 0.000 claims description 4
- 239000000463 material Substances 0.000 claims description 4
- 230000000694 effects Effects 0.000 claims description 3
- 238000012163 sequencing technique Methods 0.000 claims description 3
- 238000012217 deletion Methods 0.000 claims description 2
- 230000037430 deletion Effects 0.000 claims description 2
- 230000009286 beneficial effect Effects 0.000 abstract description 3
- 230000006872 improvement Effects 0.000 description 8
- 238000005516 engineering process Methods 0.000 description 5
- 238000006243 chemical reaction Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000007781 pre-processing Methods 0.000 description 2
- 238000012549 training Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000033764 rhythmic process Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0482—Interaction with lists of selectable items, e.g. menus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/06—Creation of reference templates; Training of speech recognition systems, e.g. adaptation to the characteristics of the speaker's voice
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/08—Speech classification or search
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/26—Speech to text systems
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- General Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Acoustics & Sound (AREA)
- Software Systems (AREA)
- General Health & Medical Sciences (AREA)
- Artificial Intelligence (AREA)
- User Interface Of Digital Computer (AREA)
- Selective Calling Equipment (AREA)
Abstract
The invention provides a data visualization system supporting voice recognition and somatosensory operation remote control, which comprises a data visualization system remote controller unit, a message bus, a central control bus and a data visualization unit, wherein the data visualization system remote controller unit is used for analyzing voice and somatosensory and converting the voice and somatosensory into instructions; the message bus is used for transmitting an instruction converted by the remote controller unit of the data visualization system; the central control bus is used for receiving, analyzing and converting the instruction of the remote controller unit of the data visualization system and is responsible for transmitting the converted instruction to the data visualization unit. The beneficial effects of the invention are as follows: the data visualization system supporting the voice recognition and somatosensory operation remote control can control the data visualization unit only by voice and somatosensory without holding a mobile phone and performing complex operation on the mobile phone.
Description
Technical Field
The invention relates to the field of data visualization, in particular to a data visualization system supporting voice recognition and somatosensory operation remote control.
Background
With the development of big data technology, a data visualization system has become the best way for people to acquire visual feeling of data in the future. The data visualization system is generally displayed on a large screen, and the data visualization system explains a person (hereinafter, collectively referred to as an explanation personA member) explains the content displayed on the large screen. The existing data visualization system can effectively display the data in the data visualization system to the audience through the mouse and keyboard technology (the traditional interaction mode requires the explanation personnel and the control personnel to perform multiple matching training, so that the display process also requires the personnel of both parties to perform partial communication, thereby wasting a great deal of manpower and material resources and influencing the display result) 、 The mobile phone remote controller (the mobile phone remote controller can not realize the mouse positioning as the mouse is, and can improve partial efficiency through training with a great deal of time, and the mobile phone remote control wastes the time of the explanation personnel and slows down the rhythm. In general, only the display of a data visualization system is realized in the market, and the effective combination of people and machines cannot be realized by the traditional means. And the realization cost is high and the efficiency is low.
At present, when a large screen of a data visualization system is displayed, no particularly good method is available for controlling and interacting the system by the explanatory personnel. Although the traditional mouse, keyboard mode and mobile phone remote controller mode can realize the control of the data visualization system by the explanation personnel, the traditional modes either need personnel cooperation (mouse and keyboard mode), or are difficult to accurately position and have complex steps (mobile phone remote controller mode: the data visualization system displays a computer and a mobile phone and needs to install corresponding App and software at the same time), so that the traditional modes cannot be taken by one's hands. The method has high cost and low efficiency in the project implementation process, and cannot meet the requirement that the explanation personnel can control the data visualization system efficiently and simply.
Disclosure of Invention
The invention provides a data visualization system supporting voice recognition and somatosensory operation remote control, which comprises a data visualization system remote controller unit, a message bus, a central control bus and a data visualization unit, wherein the data visualization system remote controller unit is used for analyzing voice and somatosensory and converting the voice and somatosensory into instructions; the message bus is used for transmitting an instruction converted by the remote controller unit of the data visualization system;
the central control bus is used for receiving, analyzing and converting the instruction of the remote controller unit of the data visualization system and is responsible for transmitting the converted instruction to the data visualization unit;
the data visualization unit is used for receiving and executing the instruction transmitted through the central control bus;
in the data visualization system, firstly starting a remote controller unit of the data visualization system; analyzing the received voice and the body feeling by the remote controller unit of the data visualization system, and commanding the analysis result, namely generating a remote controller command; transmitting a remote controller instruction to the central control bus through the message bus; the central control bus is responsible for analyzing the received remote controller instruction and converting the remote controller instruction into a data visualization unit instruction, and then sending the converted data visualization unit instruction to the data visualization unit; the data visualization unit is responsible for receiving the data visualization unit instruction converted by the central control bus and executing corresponding operation.
As a further improvement of the present invention, the remote controller unit of the data visualization system includes a voice recognition module, a voice search module, an AR recognition module, and an instruction processing module, wherein:
the voice recognition module: the voice command of the person responsible for talkback solution is preprocessed, a voice characteristic value is extracted, a best matched template is found in a template library according to the characteristic value, and a recognition result is output;
the voice search module: the method is responsible for receiving a voice search instruction and converting the voice search instruction into a search on a data visualization unit functional module through the instruction processing module;
the AR identification module: when a remote controller of the digital visual system enters the AR recognition module, a mouse of the visual display system moves along with gestures of an explanation person, and the AR recognition module can recognize action gestures of the explanation person in real time;
the instruction processing module: and converting the processing analysis result of the functional module into an instruction, and sending the instruction to the central control bus through the message bus.
As a further improvement of the invention, the data visualization system remote control unit further comprises an image recognition module, an AI processing module, wherein:
the image recognition module: the image recognition module is complementary to the AR recognition module, and can promote the AR recognition module to perform more efficient recognition processing;
the AI processing module: the AI processing of each time is to train the model library, and the AI processing is needed to assist the model library, including a voice recognition module, an AR recognition module and an image recognition module, and the AI processing module is used for better recognizing the voice and the body feeling of the explanation personnel.
As a further improvement of the invention, the data visualization unit comprises a display module, an instruction execution module, a project management module, a thematic management module, a module library management module, a chart control module, a configuration module, a role authority module and a visual design module, wherein: the display module: the system display unit is used for completing system display according to the configuration of the data visualization unit, and can load dynamic data and man-machine interaction;
the instruction execution module: receiving an instruction transmitted by the central control bus and executing the related instruction;
the project management module: the management of all items of the data visualization system is responsible, and the items can be added, deleted, modified and operated;
the thematic management module: the special panel can perform 'new addition, duplication and deletion' operation on the special pages of the current data visualization system project;
the module management module: all module catalogs used for managing single thematic page reference are arranged in a reverse order according to the newly added time by default, namely, the newly added module catalogs are at the highest level, the manual adjustment of the hierarchy is supported on a module panel, and the module panel can edit, copy, delete and set the module of the current thematic reference as a hidden operation;
the module library management module: all modules comprising the current data visualization unit support editing the attributes of the selected module, such as module name, width and height, transparency, module style, click style, description and enabling IE kernel, and performing 'adding, modifying, deleting, layout and sequencing' operation on the controls contained in the selected module;
the chart control module: the function area for selecting the newly added control when the data visualization system designer edits the module is used;
the configuration module: the configuration module is used for configuring a functional area for all information related to the project for the data visualization system designer, and comprises five states of 'newly built project, selected themes, selected module, module editing and selected control';
the role authority module: the role authority management module comprises role management and user management, wherein the role management is based on user role identity management data to visualize system project thematic page access authority and head screen display thematic; the user management is to take the individual user as a unit, and check the character identity of the user and the access authority of the project thematic page of the data visualization system and the thematic page displayed on the first screen, which are given by the character identity;
the visual design module is as follows: the method is used for previewing the layout of the thematic page and the editing effect of the module of the data visualization system, supporting the selection of the module and the dragging of the layout of the module under the visualization interface, and setting ash to lock other modules under the thematic page when the module is edited.
As a further improvement of the invention, when the difference between the aspect ratio of the screen and the configuration of the large screen is small, the display module supports the starting of global page scaling to adapt to the display requirements of different equipment and resolution.
As a further improvement of the invention, the data visualization system provides a plurality of sets of project templates by default, a user can directly complete the configuration of the project with a large screen on the basis of the templates, and partial modules and controls in the project templates can be used for the configuration of new projects.
As a further improvement of the invention, the chart control panel of the chart control module provides six types of controls of chart, index, map, text, material and interaction, and can select the control to display service data according to actual demands or use the control to realize page action event configuration.
As a further improvement of the invention, the data visualization system comprises a terminal, wherein the terminal comprises a mobile phone, and the remote controller of the data visualization system is an APP installed on the mobile phone.
As a further improvement of the invention, the data visualization system also comprises a unified authentication module and an AI assistant module.
The beneficial effects of the invention are as follows: 1. the data visualization system supporting the voice recognition and somatosensory operation remote control can control the data visualization unit only by voice and somatosensory without holding a mobile phone and performing complex operation on the mobile phone; 2. the explanation personnel can input characters into the data visualization unit through voice and search, and a simple mobile phone remote controller can be realized only by matching a keyboard; 3. the data visualization system can be explained and controlled by a single person without the cooperation of other persons.
Drawings
FIG. 1 is a data visualization system workflow diagram of the present invention;
fig. 2 is a block diagram of a data visualization system of the present invention.
Detailed Description
The invention discloses a data visualization system supporting voice recognition and somatosensory operation remote control, which comprises two parts: the realization idea, the business process, the system composition and the module function introduction.
1. Realizing thought and business flow
1. Data visualization system commandozation
In order to solve the control and interaction problems of the data visualization system by the explanation personnel, the instruction conversion problem is solved first. It is more critical before instruction conversion how the instructions can be made to be recognized and operated on by the data visualization unit. We command the control and interaction of the data visualization unit so that the data visualization unit can recognize the commands and can perform autonomous operations based on the commands.
2. Speech and somatosensory commando
The instruction of the voice and the sense of the body of the explanation personnel is an important ring for explaining the complex operation of the explanation personnel. Only when the instruction of voice and body feeling is realized and the explanation personnel explain the data visualization system, the data visualization system can be controlled without the cooperation of other personnel and the complex operation of a mobile phone. By means of a remote controller App of a data visualization system installed on a mobile phone of an explanation person, the voice and the somatosensory of the explanation person are analyzed by means of a mobile phone camera, a voice recording function, a voice recognition technology, an AR and image recognition technology and an AI technology, and an analysis result is instructed.
3. Instruction communication and conversion
The voice and somatosensory instructions are transmitted to a central control bus (instruction analysis system), and the central control bus is responsible for analyzing and converting the voice and somatosensory instructions into data visualization unit instructions and transmitting the converted data visualization unit instructions to a data visualization unit. The received instructions are executed by the data visualization unit, and the speech and somatosensory control flow chart is shown in fig. 1.
2. The system composition and the function description of each module are as shown in fig. 2:
the invention discloses a data visualization system supporting voice recognition and somatosensory operation remote control, which comprises a data visualization system remote controller unit, a message bus, a central control bus and a data visualization unit, wherein the data visualization system remote controller unit is used for analyzing voice and somatosensory and converting the voice and somatosensory into instructions; the message bus is used for transmitting an instruction converted by the remote controller unit of the data visualization system;
the central control bus is used for receiving, analyzing and converting the instruction of the remote controller unit of the data visualization system and is responsible for transmitting the converted instruction to the data visualization unit;
the data visualization unit is used for receiving and executing the instruction transmitted through the central control bus;
in the data visualization system, as shown in fig. 1, the data visualization system remote controller unit is started first; analyzing the received voice and the body feeling by the remote controller unit of the data visualization system, and commanding the analysis result, namely generating a remote controller command; transmitting a remote controller instruction to the central control bus through the message bus; the central control bus is responsible for analyzing the received remote controller instruction and converting the remote controller instruction into a data visualization unit instruction, and then sending the converted data visualization unit instruction to the data visualization unit; the data visualization unit is responsible for receiving the data visualization unit instruction converted by the central control bus and executing corresponding operation.
The remote controller unit of the data visualization system comprises a voice recognition module, a voice search module, an AR recognition module and an instruction processing module, wherein:
the voice recognition module: the method comprises the steps of preprocessing a voice instruction, extracting a voice characteristic value, searching a best matched template in a template library according to the characteristic value, and outputting a recognition result;
the voice search module: the method is responsible for receiving a voice search instruction and converting the voice search instruction into a search on a data visualization unit functional module through the instruction processing module;
the AR identification module: when a remote controller of the digital visual system enters the AR recognition module, a mouse of the visual display system moves along with gestures of an explanation person, and the AR recognition module can recognize action gestures of the explanation person in real time;
the instruction processing module: and converting the processing analysis result of the functional module into an instruction, and sending the instruction to the central control bus through the message bus.
The remote controller unit of the data visualization system further comprises an image recognition module and an AI processing module, wherein:
the image recognition module: the image recognition module is complementary to the AR recognition module, and can promote the AR recognition module to perform more efficient recognition processing;
the AI processing module: the AI processing of each time is to train the model library, and the AI processing is needed to assist the model library, including a voice recognition module, an AR recognition module and an image recognition module, and the AI processing module is used for better recognizing the voice and the body feeling of the explanation personnel.
The data visualization unit comprises a display module, an instruction execution module, a project management module, a thematic management module, a module library management module, a chart control module, a configuration module, a role authority module and a visualization design module, wherein:
the display module: the system display unit is used for completing system display according to the configuration of the data visualization unit, and can load dynamic data and man-machine interaction; the display module supports the starting of global page scaling to adapt to the display requirements of different equipment and resolution when the difference between the aspect ratio of the screen and the configuration of the large screen is small.
The instruction execution module: receiving an instruction transmitted by the central control bus and executing the related instruction;
the project management module: the management of all items (only the manager has authority) of the data visualization system is responsible, and the items can be added, deleted, modified and operated; the data visualization system provides a plurality of project templates (namely a plurality of large-screen project cases) by default, a user can directly complete the configuration of the self large-screen project on the basis of the templates, and partial modules and controls in the project templates can be used for the configuration of new projects.
The thematic management module: the method comprises the steps that all thematic page directories used for managing single data visualization system projects are arranged in a new time positive sequence (the thematic page directories are ordered and effective only in a thematic panel, and are irrelevant to a display module at the front end of the data visualization system), and the thematic panel can perform 'new addition, copy and delete' operations on thematic pages of the current data visualization system projects;
the module management module: all module catalogs used for managing single thematic page reference are arranged in a reverse order according to newly added time by default, namely, the newly added module catalogs are at the highest level, the manual adjustment of the hierarchy is supported on a module panel (the display module is ordered according to the module catalogs when the thematic page is displayed at the front end of the data visualization system), and the module panel can edit, copy, delete and set to be hidden for the module of the current thematic reference;
the module library management module: all modules comprising the current data visualization unit support editing the attributes of the selected module, such as module name, width and height, transparency, module style, click style, description and enabling IE kernel, and performing operations of adding, modifying, deleting, laying out and sequencing the control contained in the selected module (the editing operation of the module library management module library acts on the module itself, i.e. all thematic pages referring to the module will show the module modification content after editing);
the chart control module: the function area for selecting the newly added control when the data visualization system designer edits the module is used; the chart control panel of the chart control module provides six types of controls of 'chart, index, map, characters, materials and interaction', and can select the controls to display business data according to actual requirements or use the controls to realize page action event configuration.
The configuration module: the configuration module is used for configuring a functional area for all information related to the project of the data visualization system designer, and comprises five states of 'newly built project, selected themes, selected modules, module editing (unselected controls) and selected controls';
the role authority module: the role authority management module comprises role management and user management, wherein the role management is based on user role identity management data to visualize system project thematic page access authority and head screen display thematic; the user management is to take the individual user as a unit, and check the character identity of the user and the access authority of the project thematic page of the data visualization system and the thematic page displayed on the first screen, which are given by the character identity;
the visual design module is as follows: the method is used for previewing the layout of the thematic page and the editing effect of the module (control) of the data visualization system, supporting the selection and dragging of the layout of the module under the visualization interface, and setting gray to lock other modules (namely non-selectable) under the thematic page when the module (control) is edited.
The remote controller unit of the data visualization system comprises a voice recognition module, a voice search module, an AR recognition module and an instruction processing module, wherein:
the voice recognition module: based on the voice recording function of the mobile phone, the voice command of the intercom staff is subjected to preprocessing, the voice characteristic value is extracted, the best matched template is searched in the template library according to the characteristic value, and the recognition result is output;
the voice search module: the method is responsible for receiving a voice search instruction and converting the voice search instruction into a search on a data visualization unit functional module through the instruction processing module; when the lecturer outputs a search instruction, the visual system remote controller can convert the search instruction of the lecturer into a search of the data visual unit functional module through the instruction processing module;
the AR identification module: the lecturer needs to activate the AR recognition module through the voice recognition module. When a remote controller of the digital visual system enters the AR recognition module, a mouse of the visual display system moves along with gestures of an explanation person, and the AR recognition module can recognize action gestures of the explanation person in real time (for example, when the explanation person needs to click, the user can take a hand);
the instruction processing module: and converting the processing analysis result of the functional module into an instruction, and sending the instruction to the central control bus through the message bus.
The remote controller unit of the data visualization system further comprises an image recognition module and an AI processing module, wherein:
the image recognition module: the image recognition module is complementary to the AR recognition module, and can promote the AR recognition module to perform more efficient recognition processing;
the AI processing module: the AI processing of each time is to train the model library, and the AI processing is needed to assist the model library, including a voice recognition module, an AR recognition module and an image recognition module, and the AI processing module is used for better recognizing the voice and the body feeling of the explanation personnel.
The data visualization system comprises a terminal, wherein the terminal comprises a mobile phone, and a remote controller of the data visualization system is an APP installed on the mobile phone.
The data visualization system also includes a unified authentication module and an AI helper module.
The beneficial effects of the invention are as follows: 1. the data visualization system supporting the voice recognition and somatosensory operation remote control can control the data visualization unit only by voice and somatosensory without holding a mobile phone and performing complex operation on the mobile phone; 2. the explanation personnel can input characters into the data visualization unit through voice and search, and a simple mobile phone remote controller can be realized only by matching a keyboard; 3. the data visualization system can be explained and controlled by a single person without the cooperation of other persons.
The foregoing is a further detailed description of the invention in connection with the preferred embodiments, and it is not intended that the invention be limited to the specific embodiments described. It will be apparent to those skilled in the art that several simple deductions or substitutions may be made without departing from the spirit of the invention, and these should be considered to be within the scope of the invention.
Claims (6)
1. A data visualization system supporting voice recognition and somatosensory operation remote control, characterized by: the system comprises a data visualization system remote controller unit, a message bus, a central control bus and a data visualization unit, wherein the data visualization system remote controller unit is used for analyzing voice and somatosensory and converting the voice and somatosensory into instructions; the message bus is used for transmitting an instruction converted by the remote controller unit of the data visualization system;
the central control bus is used for receiving, analyzing and converting the instruction of the remote controller unit of the data visualization system and is responsible for transmitting the converted instruction to the data visualization unit;
the data visualization unit is used for receiving and executing the instruction transmitted through the central control bus;
in the data visualization system, firstly starting a remote controller unit of the data visualization system; analyzing the received voice and the body feeling by the remote controller unit of the data visualization system, and commanding the analysis result, namely generating a remote controller command; transmitting a remote controller instruction to the central control bus through the message bus; the central control bus is responsible for analyzing the received remote controller instruction and converting the remote controller instruction into a data visualization unit instruction, and then sending the converted data visualization unit instruction to the data visualization unit; the data visualization unit is responsible for receiving the data visualization unit instruction converted by the central control bus and executing corresponding operation;
the remote controller unit of the data visualization system comprises a voice recognition module, a voice search module, an AR recognition module and an instruction processing module, wherein:
the voice recognition module: the voice command of the person responsible for talkback solution is preprocessed, a voice characteristic value is extracted, a best matched template is found in a template library according to the characteristic value, and a recognition result is output; the voice search module: the method is responsible for receiving a voice search instruction and converting the voice search instruction into a search on a data visualization unit functional module through the instruction processing module;
the AR identification module: when a remote controller of the digital visual system enters the AR recognition module, a mouse of the visual display system moves along with gestures of an explanation person, and the AR recognition module can recognize action gestures of the explanation person in real time;
the instruction processing module: converting the processing analysis result of the functional module into an instruction, and sending the instruction to the central control bus through the message bus;
the remote controller unit of the data visualization system further comprises an image recognition module and an AI processing module, wherein: the image recognition module: the image recognition module is complementary to the AR recognition module, and can promote the AR recognition module to perform more efficient recognition processing;
the AI processing module: the AI processing of each time is to train a model library, and the model library comprises a voice recognition module, an AR recognition module and an image recognition module which are all assisted by the AI processing, wherein the AI processing module is used for better recognizing the voice and the body feeling of the explanation personnel;
the data visualization unit comprises a display module, an instruction execution module, a project management module, a thematic management module, a module library management module, a chart control module, a configuration module, a role authority module and a visualization design module, wherein:
the display module: the system display unit is used for completing system display according to the configuration of the data visualization unit, and can load dynamic data and man-machine interaction;
the instruction execution module: receiving an instruction transmitted by the central control bus and executing the related instruction;
the project management module: the management of all items of the data visualization system is responsible, and the items can be added, deleted, modified and operated;
the thematic management module: the special panel can perform 'new addition, duplication and deletion' operation on the special pages of the current data visualization system project;
the module management module: all module catalogs used for managing single thematic page reference are arranged in a reverse order according to the newly added time by default, namely, the newly added module catalogs are at the highest level, the manual adjustment of the hierarchy is supported on a module panel, and the module panel can edit, copy, delete and set the module of the current thematic reference as a hidden operation;
the module library management module: all modules comprising the current data visualization unit support editing the attributes of the selected module, such as module name, width and height, transparency, module style, click style, description and enabling IE kernel, and performing 'adding, modifying, deleting, layout and sequencing' operation on the controls contained in the selected module;
the chart control module: the function area for selecting the newly added control when the data visualization system designer edits the module is used;
the configuration module: the configuration module is used for configuring a functional area for all information related to the project for the data visualization system designer, and comprises five states of 'newly built project, selected themes, selected module, module editing and selected control';
the role authority module: the role authority management module comprises role management and user management, wherein the role management is based on user role identity management data to visualize system project thematic page access authority and head screen display thematic; the user management is to take the individual user as a unit, and check the character identity of the user and the access authority of the project thematic page of the data visualization system and the thematic page displayed on the first screen, which are given by the character identity; the visual design module is as follows: the method is used for previewing the layout of the thematic page and the editing effect of the module of the data visualization system, supporting the selection of the module and the dragging of the layout of the module under the visualization interface, and setting ash to lock other modules under the thematic page when the module is edited.
2. The data visualization system of claim 1, wherein the presentation module supports enabling global page scaling to accommodate display requirements of different devices, resolutions, when the screen aspect ratio is less different than the large screen configuration.
3. The data visualization system of claim 1, wherein the data visualization system provides multiple sets of project templates by default, and a user can complete the configuration of the project on a self-contained large screen directly on the basis of the templates, and can also use part of modules and controls in the project templates for the configuration of new projects.
4. The data visualization system of claim 1, wherein the chart control panel of the chart control module provides six types of controls of chart, index, map, text, material and interaction, and the control can be selected to display service data according to actual requirements or be used to realize page action event configuration.
5. The data visualization system of claim 1, comprising a terminal, the terminal comprising a cell phone, the data visualization system remote control being an APP mounted on the cell phone.
6. The data visualization system of claim 1, further comprising a unified authentication module, AI helper module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010404967.1A CN111596883B (en) | 2020-05-14 | 2020-05-14 | Data visualization system supporting voice recognition and somatosensory operation remote control |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010404967.1A CN111596883B (en) | 2020-05-14 | 2020-05-14 | Data visualization system supporting voice recognition and somatosensory operation remote control |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111596883A CN111596883A (en) | 2020-08-28 |
| CN111596883B true CN111596883B (en) | 2023-06-06 |
Family
ID=72190733
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010404967.1A Active CN111596883B (en) | 2020-05-14 | 2020-05-14 | Data visualization system supporting voice recognition and somatosensory operation remote control |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111596883B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113658592B (en) * | 2021-07-29 | 2024-04-02 | 浙江亿秒数字科技有限公司 | Data visualization system capable of supporting voice recognition function |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101753871A (en) * | 2008-11-28 | 2010-06-23 | 康佳集团股份有限公司 | Voice remote control TV system |
| CN104185050A (en) * | 2014-07-30 | 2014-12-03 | 哈尔滨工业大学深圳研究生院 | OTT television based intelligent remote control system and control method thereof |
| CN104636146A (en) * | 2015-03-05 | 2015-05-20 | 北京掌中经纬技术有限公司 | Online visual customizing method and system |
| CN108737869A (en) * | 2018-05-08 | 2018-11-02 | 康佳集团股份有限公司 | Smart television starting processing method based on human body sensing and intelligent television system |
| CN109146190A (en) * | 2018-08-31 | 2019-01-04 | 饶智彬 | Intelligent sound based on interior way system and expansion visualizes real-time situation sensory perceptual system |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108597507A (en) * | 2018-03-14 | 2018-09-28 | 百度在线网络技术（北京）有限公司 | Far field phonetic function implementation method, equipment, system and storage medium |
-
2020
- 2020-05-14 CN CN202010404967.1A patent/CN111596883B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101753871A (en) * | 2008-11-28 | 2010-06-23 | 康佳集团股份有限公司 | Voice remote control TV system |
| CN104185050A (en) * | 2014-07-30 | 2014-12-03 | 哈尔滨工业大学深圳研究生院 | OTT television based intelligent remote control system and control method thereof |
| CN104636146A (en) * | 2015-03-05 | 2015-05-20 | 北京掌中经纬技术有限公司 | Online visual customizing method and system |
| CN108737869A (en) * | 2018-05-08 | 2018-11-02 | 康佳集团股份有限公司 | Smart television starting processing method based on human body sensing and intelligent television system |
| CN109146190A (en) * | 2018-08-31 | 2019-01-04 | 饶智彬 | Intelligent sound based on interior way system and expansion visualizes real-time situation sensory perceptual system |
Non-Patent Citations (1)
| Title |
|---|
| 徐彤 ; .运用数据分析和可视化技术的数据大屏交互体验***研究.河南科技.2019,(07),全文. * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111596883A (en) | 2020-08-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8031943B2 (en) | Automatic natural language translation of embedded text regions in images during information transfer | |
| CN101639755B (en) | Method for supporting picture input and equipment thereof | |
| US5363507A (en) | Method and system for storing and retrieving collaboratively processed information by associated identification data | |
| JP3839468B2 (en) | International data processing system | |
| JP3798014B2 (en) | Balloon help system | |
| US20080282160A1 (en) | Designated screen capturing and automatic image exporting | |
| JPH08501401A (en) | Object-oriented notification framework system | |
| Biller et al. | Webgt: An interactive web-based system for historical document ground truth generation | |
| US9135234B1 (en) | Collaborative generation of digital content with interactive reports | |
| CN111596883B (en) | Data visualization system supporting voice recognition and somatosensory operation remote control | |
| CN102289745A (en) | Method for realizing visual operation interface of ERP (Enterprise Resource Planning) system of power system | |
| JPH09138790A (en) | Scenario editing device | |
| Kumar | Human computer interaction | |
| CN111488147A (en) | Intelligent layout method and device | |
| CN103337050A (en) | A climate diagnosis and value simulation integration analysis system | |
| JPH04507309A (en) | Document annotation and manipulation device using images from window sources | |
| WO2023045053A1 (en) | File comparison method and apparatus based on rpa and ai, device, and storage medium | |
| JPH0628136A (en) | Function selection system of information processor | |
| JP2006244510A (en) | Output control device | |
| US10672287B2 (en) | Method and system for managing assessments | |
| JPH08137648A (en) | Operation device for image input output device | |
| JPH09245035A (en) | Document management device | |
| JP2000076226A (en) | Document data editing system | |
| JP2003099424A (en) | Document data structure, storage medium and information processor | |
| CN114611044B (en) | Data development system and method based on data warehouse |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |