CN109710158B - Man-machine interaction method, system and device applied to intelligent equipment - Google Patents
Man-machine interaction method, system and device applied to intelligent equipment Download PDFInfo
- Publication number
- CN109710158B CN109710158B CN201711005779.6A CN201711005779A CN109710158B CN 109710158 B CN109710158 B CN 109710158B CN 201711005779 A CN201711005779 A CN 201711005779A CN 109710158 B CN109710158 B CN 109710158B
- Authority
- CN
- China
- Prior art keywords
- electronic terminal
- controller
- information
- motion information
- display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Abstract
The invention provides a man-machine interaction method applied to intelligent equipment, wherein the intelligent equipment comprises a controller and at least one electronic terminal, and the method comprises the following steps: the controller receives motion information sent by the at least one electronic terminal; the controller determines target display information of the at least one electronic terminal according to the motion information of the at least one electronic terminal, wherein the display information comprises multimedia information; the controller at least controls the display device of the at least one electronic terminal to display the target display information. The method can make the input mode of the computer more convenient and faster, and make the man-machine interaction mode more close to the natural interaction mode.
Description
Technical Field
The invention relates to the field of human-computer interaction, in particular to a human-computer interaction method, a human-computer interaction system and a human-computer interaction device applied to intelligent equipment.
Background
Human-computer interaction refers to the way a person operates a computing device. In a traditional man-machine interaction mode, a mouse, a keyboard, a touch screen, a joystick and the like are used as input equipment, and a display screen is used as output equipment to carry out man-machine interaction.
However, in the traditional human-computer interaction mode, the input mode of the input equipment is complex, the operation mode is unnatural, and the operation experience of a user is influenced.
Therefore, providing a more natural man-machine interaction mode becomes the most problem to be solved at present.
Disclosure of Invention
The invention aims to provide a human-computer interaction method, a human-computer interaction system and a human-computer interaction device applied to intelligent equipment, which are used for solving the problem that the input mode of input equipment is complex in the traditional human-computer interaction mode.
In order to achieve the above object, according to an embodiment of the present application, a human-computer interaction method applied to an intelligent device is disclosed, where the intelligent device includes a controller and at least one electronic terminal, and the method includes: the controller receives motion information sent by the at least one electronic terminal; the controller determines target display information of the at least one electronic terminal according to the motion information of the at least one electronic terminal, wherein the display information comprises multimedia information; the controller at least controls the display device of the at least one electronic terminal to display the target display information.
Further, the determining, by the controller, the target display information according to the motion information of the at least one electronic terminal includes: the controller detects the type of a received physical action sent by the at least one electronic terminal, wherein the motion information at least comprises the type of the physical action; the controller reads the multimedia information corresponding to the type of the physical action, wherein the multimedia information includes a target graphic and/or a target image.
Further, the physical action includes that a plurality of electronic terminals approach or contact each other or any one of the electronic terminals rotates horizontally, shakes left and right, tilts or turns over.
Further, the controlling at least a display device of the at least one electronic terminal to display the target display information by the controller includes: the controller displays the target display information through a display device of the controller and/or at least a part of a display device of the electronic terminal.
Further, the receiving, by the controller, the motion information sent by the at least one electronic terminal includes: and receiving a type of physical motion transmitted from the electronic terminal, wherein the motion information includes the type of physical motion, and the type of physical motion is determined based on a motion signal detected by a sensor of the electronic terminal.
In order to achieve the purpose, the embodiment of the application discloses a human-computer interaction system applied to intelligent equipment, which comprises at least one electronic terminal, a display module and a display module, wherein the electronic terminal is used for sending motion information to a controller and receiving an instruction which is sent by the controller and used for displaying target display information; the controller is configured to receive motion information sent by the at least one electronic terminal, determine the target display information according to the motion information, and send an instruction for displaying the target display information to the at least one electronic terminal, where the display information includes multimedia information.
Further, the electronic terminal includes: the wireless sensing module is used for sensing the physical action of the wireless sensing module and the azimuth information of the nearby electronic terminal; a processing module, configured to process the physical motion and orientation information of a nearby electronic terminal into the motion information; the first wireless communication module is used for sending the motion information to the controller;
the controller includes: the second wireless communication module is used for receiving the motion information; and the control module is used for determining the target display information of the at least one electronic terminal according to the motion information.
In order to achieve the above object, an embodiment of the present application discloses a human-computer interaction device applied to an intelligent device, where the intelligent device includes a controller and at least one electronic terminal, the human-computer interaction device is disposed in the controller, and the human-computer interaction device includes: a receiving unit, configured to receive motion information sent by the at least one electronic terminal; a determining unit, configured to determine target display information of the at least one electronic terminal according to motion information of the at least one electronic terminal, where the display information includes multimedia information; and the processing unit is used for at least controlling the display device of the at least one electronic terminal to display the target display information.
By adopting the embodiment, the electronic terminals with the display devices are used as input equipment, the motion and mutual touch of the electronic terminals are used as the input of the computing equipment, and the output can be displayed on the display devices of the electronic terminals, so that a novel man-machine interaction mode different from the traditional man-machine interaction mode is provided, and the man-machine interaction mode is more convenient and more close to a natural interaction mode.
Drawings
The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the application. Also, like reference numerals are used to refer to like parts throughout the drawings. In the drawings:
FIG. 1 is a flow chart of a human-computer interaction method provided by an embodiment of the invention;
FIG. 2 is a schematic diagram of a human-computer interaction system provided by an embodiment of the invention;
FIG. 3 is a diagram of a human-computer interaction device according to an embodiment of the present invention.
Detailed Description
In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below.
Fig. 1 is a schematic flow chart of a human-computer interaction method applied to an intelligent device according to the present invention.
In this embodiment, the intelligent device includes a controller and at least one electronic terminal, and the method includes:
step S101, the controller receives the motion information sent by the at least one electronic terminal;
step S102, the controller determines target display information of the at least one electronic terminal according to the motion information of the at least one electronic terminal, wherein the display information comprises multimedia information;
step S103, the controller at least controls the display device of the at least one electronic terminal to display the target display information.
Optionally, the controlling, by the controller, at least the display device of the at least one electronic terminal to display the target display information includes: the controller displays the target display information through a display device of the controller and/or at least a part of a display device of the electronic terminal.
The electronic terminal can be a polyhedron-shaped electronic device so as to embody the positions of east, west, south, north, left and right, and is provided with a display screen used as input and output equipment. The controller can be any independent electronic device with a computing function, such as a desktop computer, a mobile phone, a tablet computer and the like.
For example, the electronic block may be a cube-shaped electronic device, which is called an electronic block, and the controller may be a computer. The electronic square and the computer are in wireless connection through the wireless communication module, the wireless sensor and the motion sensor are arranged in the electronic square, the motion information of at least one electronic square can be sensed and sent to the computer, the computer receives the motion information and sends a multimedia information display instruction to at least one electronic square and/or the computer according to a stored corresponding program, and the electronic square and/or the computer receives the instruction and displays the multimedia information, namely the multimedia information is displayed on the electronic square or the computer display screen independently or simultaneously.
Through the embodiment, a plurality of electronic terminals with display devices are used as input equipment, the motion information of the electronic terminals is used as the input of the computing equipment, and the output can be displayed on the display devices of the electronic terminals, so that a novel human-computer interaction mode different from the traditional human-computer interaction mode is provided, and the human-computer interaction mode is more convenient and more close to the natural interaction mode.
Optionally, the determining, by the controller, the target display information according to the motion information of the at least one electronic terminal includes: the controller detects the type of a received physical action sent by the at least one electronic terminal, wherein the motion information at least comprises the type of the physical action; the controller reads the multimedia information corresponding to the type of the physical action, wherein the multimedia information includes a target graphic and/or a target image.
The physical movement is a movement change of a single electronic terminal or a relative position change or touch of a plurality of electronic terminals. The change of the graphics and/or images is similar to the change operation generated by using a mouse and a keyboard as input devices, such as the change of the graphics and images of opening a menu, opening a file, and the like.
Taking an electronic block and a computer as an example, the electronic block senses that a physical action (such as horizontal rotation of a single electronic block) occurs in the electronic block, processes the physical action into motion information and sends the motion information to the computer, the computer receives the motion information and sends a menu opening instruction to at least one electronic block and/or the computer according to a stored program corresponding to the physical motion, and the electronic block and/or the computer receives the instruction and displays the image change of the menu opening on a display screen.
Optionally, the physical action includes that a plurality of electronic terminals approach or contact each other or any one of the electronic terminals rotates horizontally, shakes left and right, tilts or turns over.
For example, in an alternative embodiment, during the process that two electronic blocks approach each other, the two electronic blocks sense the position change of each other and send the physical action information of the position change to the computer, the computer detects the received physical action as the physical action type that the two electronic blocks approach each other, and runs the internally stored program corresponding to the physical action, and sends out an instruction to move the icon, and the electronic blocks and the computer screen display the icon movement change.
For another example, in another embodiment, when a certain electronic block is turned over, the computer detects that the received physical action type is that the certain electronic block is turned over, then runs an internally stored program corresponding to the physical action, sends out an instruction to open a file, and then displays the opened file on the computer screen. In other embodiments, the input mode of the electronic terminal with respect to the computer depends on the physical action type of the electronic terminal and the pre-stored program of the computer, and is not described in detail herein.
Through the embodiment, the electronic terminals can be used as the input mode of the computer through the relative change or collision of the positions of the electronic terminals or through the physical action of any one electronic terminal, so that the natural physical motion of one or more objects is used as the input of the computer, the input mode can be more diversified and convenient, and the generated human-computer interaction mode is more natural.
Optionally, the receiving, by the controller, the motion information sent by the at least one electronic terminal includes: and receiving a type of physical motion transmitted from the electronic terminal, wherein the motion information includes the type of physical motion, and the type of physical motion is determined based on a motion signal detected by a sensor of the electronic terminal.
The sensor of the electronic terminal detects the physical action, and after the processor in the electronic terminal processes the physical action, the processor records the physical action through an identifier (or characters and the like) and sends the identifier to the controller.
The electronic terminal is internally provided with a motion sensor, the motion sensor detects the relative change of the position of the electronic terminal and other sensors or senses the touch of the electronic terminal with other electronic terminals, or detects the physical actions of horizontal rotation, horizontal shaking, left-right shaking, inclination or overturning and the like of any one electronic terminal, then a processor in the electronic terminal records the physical actions in a way of identification or characters and the like, finally the recorded information is sent to a controller, the controller judges the action type of the electronic terminal, and sends out corresponding instructions according to the type of the physical actions.
Through the embodiment, any electronic terminal processes the physical action of the electronic terminal or the physical action of position change or touch with other electronic terminals into corresponding information and sends the information to the controller, and the controller decodes and judges the type of the physical action, so that the accuracy of judging the action information of the electronic terminal by the controller is improved.
In another alternative embodiment, the controller may also be installed in at least one electronic terminal.
For example, each of a plurality of electronic blocks is mounted with a controller, and the electronic block generates an input on its own screen by its own physical action.
Through the embodiment, any electronic terminal controls the change of the multimedia information of the electronic terminal or other electronic terminals, so that the electronic terminal does not depend on independent computing equipment provided with a controller to realize the processing of physical actions, the electronic terminal can be used as input and output equipment, and the input mode is more convenient and faster.
As shown in fig. 2, corresponding to the human-computer interaction method applied to the intelligent device provided in the embodiment of the present invention, the embodiment of the present invention further provides a human-computer interaction system applied to the intelligent device, where the system includes:
the electronic terminal 2 is used for sending motion information to the controller 1 and receiving an instruction sent by the controller 1 and used for displaying target display information;
the controller 1 is configured to receive motion information sent by the at least one electronic terminal 2, determine the target display information according to the motion information, and send an instruction for displaying the target display information to the at least one electronic terminal 2, where the display information includes multimedia information.
Optionally, the electronic terminal 2 includes: the wireless sensing module 20 is used for sensing the physical action of the wireless sensing module and the azimuth information of the nearby electronic terminal; the nearby electronic terminal is an electronic terminal whose displacement from the target electronic terminal changes. A processing module 21, configured to process the physical motion and orientation information of a nearby electronic terminal into the motion information; a first wireless communication module 22, configured to send the motion information to the controller 1; the controller 1 includes: a second wireless communication module 11, configured to receive the motion information; and the control module 10 is configured to determine target display information of the at least one electronic terminal according to the motion information.
For example, the electronic terminal 2 is provided with the wireless sensor module 20, the processing module 21 and the first wireless communication module 22, when any one of the electronic terminals generates a physical action such as turning over, the wireless sensor module 20 senses the physical action, and passes the signal to the processing module 21, the processing module 21 records the physical action as an identification, and transmits the identifier to the controller 1 through the first wireless communication module, after the second wireless communication module 11 of the controller 1 receives the identifier, the identification is transferred to the control module 10, the control module 10 parses the identification, determines the physical action type of the electronic terminal, and running a pre-stored program corresponding to the physical action, and sending an instruction for displaying image changes to the display devices of the electronic terminal 2 and the controller 1, wherein after the electronic terminal 2 and the controller 1 receive the instruction, the display devices display image changes such as opening files and the like.
As shown in fig. 3, corresponding to the human-computer interaction method applied to the intelligent device provided by the embodiment of the present invention, the embodiment of the present invention further provides a human-computer interaction device applied to the intelligent device, where the intelligent device includes a controller and at least one electronic terminal, the human-computer interaction device is disposed in the controller, and the human-computer interaction device includes: a receiving unit 12, configured to receive motion information sent by the at least one electronic terminal; a determining unit 13, configured to determine target display information of the at least one electronic terminal according to motion information of the at least one electronic terminal, where the display information includes multimedia information; and the processing unit 14 is configured to control at least a display device of the at least one electronic terminal to display the target display information.
The apparatus of this embodiment may be used to implement the technical solution of the method embodiment shown in fig. 1, and the implementation principles thereof are similar and will not be described herein again.
Through the embodiment that this application provided, regard a plurality of electronic terminals that have display device as input device to regard these electronic terminal's motion and mutual touching as the input of computing equipment, can show output on these electronic terminal's display device simultaneously, provide a new man-machine interaction mode that is different from traditional, make man-machine interaction mode more convenient more close to natural interaction mode.
The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.
The above detailed description is provided for the positioning method and apparatus of the remote controller provided by the present invention, and the principle and the implementation of the present invention are explained by applying specific examples, and the description of the above examples is only used to help understanding the method and the core idea of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (7)
1. A human-computer interaction method applied to intelligent equipment, wherein the intelligent equipment comprises a controller and at least one electronic terminal, and the method comprises the following steps:
the controller receives motion information sent by the at least one electronic terminal;
the controller determines target display information of the at least one electronic terminal according to the motion information of the at least one electronic terminal, wherein the display information comprises multimedia information;
the controller at least controls a display device of the at least one electronic terminal to display the target display information; and the number of the first and second electrodes,
the electronic terminal includes:
the wireless sensing module is used for sensing the physical action of the wireless sensing module and the approaching or contacting of the nearby electronic terminal;
the processing module is used for processing the physical action and the approaching or contacting of the nearby electronic terminal into the motion information;
the first wireless communication module is used for sending the motion information to the controller;
the controller includes:
a second wireless communication module for receiving the motion information;
and the control module is used for determining the target display information of the at least one electronic terminal according to the motion information.
2. The method of claim 1, wherein the controller determines the target presentation information according to the motion information of the at least one electronic terminal, comprising:
the controller detects the type of the received physical action sent by the at least one electronic terminal, wherein the motion information at least comprises the type of the physical action;
the controller reads the multimedia information corresponding to the type of the physical action, wherein the multimedia information includes a target graphic and/or a target image.
3. The method of claim 2, wherein the physical action comprises any one of horizontal rotation, horizontal shaking, left-right shaking, tilting and turning of any one of the electronic terminals.
4. The method of claim 1, wherein the controller at least controls a display device of the at least one electronic terminal to display the target display information comprises:
the controller displays the target display information through a display device of the controller and/or at least part of a display device of the electronic terminal.
5. The method according to any one of claims 1 to 4, wherein the controller receiving the motion information transmitted by the at least one electronic terminal comprises:
receiving a type of the transmitted physical action of the electronic terminal, wherein the motion information includes the type of the physical action, and the type of the physical action is determined based on a motion signal detected by a sensor of the electronic terminal.
6. A human-computer interaction system applied to intelligent equipment is characterized by comprising:
the electronic terminal is used for sending motion information to the controller and receiving an instruction sent by the controller and used for displaying target display information;
the controller is configured to receive motion information sent by the at least one electronic terminal, determine the target display information according to the motion information, and send an instruction for displaying the target display information to the at least one electronic terminal, where the display information includes multimedia information;
the electronic terminal includes:
the wireless sensing module is used for sensing the physical action of the wireless sensing module and the approaching or contacting of the nearby electronic terminal;
the processing module is used for processing the physical action and the approaching or contacting of the nearby electronic terminal into the motion information;
the first wireless communication module is used for sending the motion information to the controller;
the controller includes:
a second wireless communication module for receiving the motion information;
and the control module is used for determining the target display information of the at least one electronic terminal according to the motion information.
7. A human-computer interaction device applied to an intelligent device, wherein the intelligent device comprises a controller and at least one electronic terminal of claim 6, the human-computer interaction device is arranged in the controller, and the human-computer interaction device comprises:
the receiving unit is used for receiving the motion information sent by the at least one electronic terminal;
the system comprises a determining unit, a display unit and a display unit, wherein the determining unit is used for determining target display information of at least one electronic terminal according to the motion information of at least one electronic terminal, and the display information comprises multimedia information;
and the processing unit is used for at least controlling the display device of the at least one electronic terminal to display the target display information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711005779.6A CN109710158B (en) | 2017-10-25 | 2017-10-25 | Man-machine interaction method, system and device applied to intelligent equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711005779.6A CN109710158B (en) | 2017-10-25 | 2017-10-25 | Man-machine interaction method, system and device applied to intelligent equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109710158A CN109710158A (en) | 2019-05-03 |
| CN109710158B true CN109710158B (en) | 2021-01-08 |
Family
ID=66251882
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711005779.6A Active CN109710158B (en) | 2017-10-25 | 2017-10-25 | Man-machine interaction method, system and device applied to intelligent equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109710158B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103297609A (en) * | 2012-02-20 | 2013-09-11 | 株式会社泛泰 | Mobile terminal having a multifaceted graphical object and method for performing a display switching operation |
| CN106488025A (en) * | 2016-10-18 | 2017-03-08 | 北京奇虎科技有限公司 | Smart mobile phone and its method that message is processed |
| CN106850938A (en) * | 2015-09-25 | 2017-06-13 | Lg电子株式会社 | Mobile terminal and its control method |
| KR20170084446A (en) * | 2016-01-12 | 2017-07-20 | 엘지전자 주식회사 | Wearable device, display device and method for controlling each device |
| CN107024977A (en) * | 2016-02-01 | 2017-08-08 | 巨擘科技股份有限公司 | watch wireless control function module and application thereof |
| CN107040644A (en) * | 2015-10-27 | 2017-08-11 | Lg电子株式会社 | Watch type mobile terminal and its operating method |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN202495983U (en) * | 2012-01-09 | 2012-10-17 | 广东步步高电子工业有限公司 | Device using infrared sensor to detect mobile phone flipping to realize function switching |
| CN103179277A (en) * | 2013-03-21 | 2013-06-26 | 广东欧珀移动通信有限公司 | Switching method and device for audio/video play mode of mobile phone |
| CN105843524B (en) * | 2016-03-21 | 2019-03-05 | Oppo广东移动通信有限公司 | Camera control method, device and mobile terminal for mobile terminal |
| CN106527691B (en) * | 2016-10-18 | 2020-01-07 | 北京安云世纪科技有限公司 | Method for processing message and cloud server |
-
2017
- 2017-10-25 CN CN201711005779.6A patent/CN109710158B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103297609A (en) * | 2012-02-20 | 2013-09-11 | 株式会社泛泰 | Mobile terminal having a multifaceted graphical object and method for performing a display switching operation |
| CN106850938A (en) * | 2015-09-25 | 2017-06-13 | Lg电子株式会社 | Mobile terminal and its control method |
| CN107040644A (en) * | 2015-10-27 | 2017-08-11 | Lg电子株式会社 | Watch type mobile terminal and its operating method |
| KR20170084446A (en) * | 2016-01-12 | 2017-07-20 | 엘지전자 주식회사 | Wearable device, display device and method for controlling each device |
| CN107024977A (en) * | 2016-02-01 | 2017-08-08 | 巨擘科技股份有限公司 | watch wireless control function module and application thereof |
| CN106488025A (en) * | 2016-10-18 | 2017-03-08 | 北京奇虎科技有限公司 | Smart mobile phone and its method that message is processed |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109710158A (en) | 2019-05-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9063563B1 (en) | Gesture actions for interface elements | |
| EP3647922A1 (en) | User terminal device and method for controlling the user terminal device thereof | |
| JP5304577B2 (en) | Portable information terminal and display control method | |
| EP1783592A1 (en) | Mobile communication terminal, application program, image display control apparatus, electronic device, and image display control method | |
| JP6105822B1 (en) | Touch screen control method and apparatus | |
| WO2017032011A1 (en) | Image rotation control method and mobile terminal | |
| CN109857289B (en) | Display control method and terminal equipment | |
| CN102339141B (en) | Mobile terminal and display control method thereof | |
| CN106547429B (en) | Display method and device for electronic terminal | |
| CN105549878A (en) | Electronic book page turning control method and device | |
| CN110658971A (en) | Screen capturing method and terminal equipment | |
| CN111026480A (en) | Content display method and electronic equipment | |
| CN111475069B (en) | Display method and electronic equipment | |
| US20190196707A1 (en) | User interface for cross-device requests | |
| CN109683764B (en) | Icon management method and terminal | |
| US11354031B2 (en) | Electronic apparatus, computer-readable non-transitory recording medium, and display control method for controlling a scroll speed of a display screen | |
| US20130239069A1 (en) | Control method for mobile device using setting pattern and mobile device | |
| EP3506061A1 (en) | Information processing device, program, and information processing system | |
| US9823890B1 (en) | Modifiable bezel for media device | |
| CN108984062B (en) | Content display method and terminal | |
| EP2815295B1 (en) | Display and method in an electric device | |
| CN110536007B (en) | Interface display method, terminal and computer readable storage medium | |
| CN109710158B (en) | Man-machine interaction method, system and device applied to intelligent equipment | |
| JP5756682B2 (en) | Information processing device | |
| CN114095766B (en) | Display device and rotation control method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |