CN105487646A - Intelligent terminal system with gesture remote function - Google Patents
Intelligent terminal system with gesture remote function Download PDFInfo
- Publication number
- CN105487646A CN105487646A CN201410472802.2A CN201410472802A CN105487646A CN 105487646 A CN105487646 A CN 105487646A CN 201410472802 A CN201410472802 A CN 201410472802A CN 105487646 A CN105487646 A CN 105487646A
- Authority
- CN
- China
- Prior art keywords
- intelligent terminal
- coordinate system
- gesture
- axis
- coordinate
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses an intelligent terminal system with a gesture remote function. The intelligent terminal system comprises an intelligent terminal and a camera. The camera comprises a camera module, a memorizer, a transmission interface, an initialization module, a processing module, an identification module and the like. A storage module used for storing instruction massages corresponding to standard gestures is arranged in the intelligent terminal. The intelligent terminal finishes corresponding operation based on instruction massages.The intelligent terminal system with the gesture remote function adopts a bi-coordinate system to clearly identify gestures of pictorial representations for hand motion so that gesture identification is effectively achieved. Further, the intelligent terminal can be remotely controlled in a gesture form. Remote control is easily and conveniently performed and limitation of touch control is removed. The manner of remotely controlling the intelligent terminal by gestures, operability of the intelligent terminal is further improved and combined with sports and entertainment so that the application function of the intelligent terminal is expanded.
Description
Technical field
The invention belongs to electric equipment field, be specifically related to a kind of gesture remote control intelligent terminal system.
Background technology
Along with the development of society, intelligent terminal such as desktop computer, notebook computer and panel computer, smart mobile phone etc. are used on a large scale, gesture manipulation function makes intelligent terminal system be endowed increasing application scenarios, and such as somatic sensation television game is the game that the another kind of degree of participation that both grows up after plug-in card game machine is higher.In somatic sensation television game now, many usage datas line connects or that wireless sensing mode realizes with intelligent terminal picture is mutual, reaches the object of amusement.Camera can capture the image in image pickup scope, and utilizing camera to catch gesture is a kind of new data entry mode, and camera captures gesture to be changed and is translated in control signal input intelligent terminal system.Which can not only be applied in somatic sensation television game, for remote-controlled intelligent terminal provides a kind of new mode, more can be applied to the occasion with intelligent terminal system interaction, have powerful Potential socialvalue.
Existing identification gesture the multiple camera of the many uses of technology or adopt depth camera, the widespread use that the loaded down with trivial details and fancy price of its application becomes gesture identification intelligent terminal system causes certain obstacle.
Summary of the invention
In order to solve prior art Problems existing, the invention provides a kind of gesture remote control intelligent terminal system, the camera of this system can make identification by setting up coordinate system mode to gesture, and then be transferred to intelligent terminal, realize the remote control of intelligent terminal, to achieve these goals, the present invention is by the following technical solutions:
A kind of gesture remote control intelligent terminal system, comprise intelligent terminal and camera, described camera comprises photographing module, storer and transmission interface, and described photographing module is provided with camera lens and imageing sensor, and described camera also comprises:
Initialization module, for set up with described image sensor surface be the first coordinate plane the first coordinate system, with the second coordinate system to palmar aspect during described camera lens being just the second coordinate plane, determine the position of described second coordinate system in described first coordinate system;
Processing module, for the treatment of the hands movement image that described photographing module gathers, obtains the position video flowing of described second coordinate system in described first coordinate system and the video flowing of hand in described second coordinate system, forms gesture input;
Identification module, makes comparisons for the standard gesture of pre-stored in the gesture that described processing module exported and described storer, if mate with standard gesture described in, then using this standard gesture as recognition result, and be sent to described transmission interface;
Described intelligent terminal is provided with memory module, stores and described standard gesture command information one to one in described memory module;
Described camera is connected with described intelligent terminal by described transmission interface.
Further, described camera also comprises bluetooth module, and the output terminal of described bluetooth module is electrically connected with the input end of described transmission interface.
Further, described transmission interface is USB interface.
Further, described first coordinate system for coordinate axis, is first initial point with the center of described imageing sensor with the perpendicular line of the vertical direction line in described first coordinate plane, horizontal direction line and described vertical direction line, horizontal direction line.
Further, in described second coordinate plane, get that wrist place rectilinear direction is X-axis, palm lateral border place is Y-axis perpendicular to the straight line of X-axis; Described second coordinate system with described X-axis, Y-axis and perpendicular to the Z axis of described X-axis, Y-axis for coordinate axis; Be the second initial point with the intersection point of described X-axis, Y-axis.
Further, described second coordinate is three-dimensional system of coordinate, and described position video flowing is the position video flowing of the second initial point in described second coordinate system; The video flowing of hand in described second coordinate system, comprising: the video flowing that the bending and rotation of palm of finger is formed.
Further, described position video flowing is the position video flowing of the second initial point in described second coordinate system and the video flowing of described second coordinate system rotation; The video flowing of hand in described second coordinate system, comprising: the video flowing be bent to form of finger.
Further, also comprise cloud server terminal, described intelligent terminal is connected by network interface with described cloud server terminal.
Further, described intelligent terminal is desktop computer, notebook computer, panel computer or smart mobile phone.
A kind of gesture remote control intelligent terminal system of the present invention adopts bi-coordinate system method can know the gesture identifying hands movement characterization image, realize effective gesture identification, and then completing gesture mode remote-controlled intelligent terminal, remote control is simple, convenient, has departed from the restriction that contact controls.Adopt the mode of gesture remote control intelligent terminal can improve the operability of intelligent terminal further, combine with motion, amusement, expanded the application function of intelligent terminal.
Accompanying drawing explanation
Fig. 1 is the module map of a kind of gesture remote control intelligent terminal system of the present invention embodiment 1;
Fig. 2 is the schematic diagram of the first coordinate system in the present invention;
Fig. 3 is the schematic diagram of the second coordinate system in the present invention;
Fig. 4 is the module map of a kind of gesture remote control intelligent terminal system of the present invention embodiment 2.
Embodiment
Should be appreciated that specific embodiment described herein only in order to explain the present invention, be not intended to limit the present invention.
With reference to the module map that Fig. 1, Fig. 1 are a kind of gesture remote control intelligent terminal system of the present invention embodiment 1, this gesture remote control intelligent terminal system comprises camera 10 and intelligent terminal 20, and camera 10 is connected with intelligent terminal 20.
Wherein, camera 10 comprises photographing module 1, initialization module 2, processing module 3, identification module 4, storer 5 and transmission interface 6.
Photographing module 1 is for gathering hands movement image, and this photographing module 1 is provided with camera lens 11 and imageing sensor 12, and camera lens 11 is glass lens, plastic lens or plastics and glass hybrid lens,
Imageing sensor 12 is a kind of light receiving semiconductor chips, its surface includes hundreds of thousands to millions of photodiodes, photodiode is subject to will producing electric charge when illumination is penetrated, when the image projection that photographing module 1 receives is on imageing sensor 12, on imageing sensor 12, the distribution of electric charge characterizes the image taken in.
In order to the hands movement image that photographing module 1 gathers can be identified accurately, the present invention's adopt initialization module 2 to set up the first coordinate system that image taking sensor 12 surface is the first coordinate plane, with the second coordinate system to palmar aspect during camera lens being just the second coordinate plane, and determine the position of described second coordinate system in described first coordinate system.Because the position of hand in the second mark system can be determined, and then the position of hand in the first coordinate system can be determined.
In preferably embodiment, first coordinate system as shown in Figure 2, image taking sensor 12 surface is the first coordinate plane, the vertical line L of vertical direction line V, horizontal direction line H in this first coordinate plane and vertical direction line V, horizontal direction line H is coordinate axis, and the center of image taking sensor 12 is the first initial point.At the second coordinate system as shown in Figure 3, palmar aspect is in the second coordinate plane, gets that wrist place rectilinear direction is X-axis, palm lateral border place is Y-axis perpendicular to the straight line of X-axis; Second coordinate system with X-axis, Y-axis and perpendicular to the Z axis of X-axis, Y-axis for coordinate axis; Be the second initial point with the intersection point of X-axis, Y-axis.
Processing module 3 processes the hands movement image that photographing module 1 gathers, and obtains the position video flowing of the second coordinate system in the first coordinate system and the video flowing of hand in the second coordinate system, forms gesture input.
Particularly, photographing module 1 gathers hand image with certain speed, the speed acquisition of such as 30 frames/s, first frame hand image is transferred to processing module 3 after the process of initialization module 2, processing module 3 obtains position in the first coordinate system of the first coordinate system, the second coordinate system and the second coordinate system and the position of hand in the second coordinate system, and in this, as original state.Second frame hand image is transferred to processing module 3 after initialization module 2 processes, the position of the second initial point that processing module 3 obtains the second coordinate system in the first coordinate system and the position of hand in the second coordinate system, successively to the 3rd frame, the 4th frame ... hand image procossing, the position video flowing of the second initial point obtaining the second coordinate system in the first coordinate system and the video flowing of hand in the second coordinate system, form gesture input.In this embodiment, position video flowing is the position video flowing of the second initial point in the first coordinate system in the second coordinate system; The video flowing of hand in the second coordinate system comprises the bending video flowing formed with the rotation of palm of finger.
The acquisition of processing module 3 to input gesture also has the second embodiment, in this scenario, first frame hand image is transferred to processing module 3 after the process of initialization module 2, and processing module 3 obtains position in the first coordinate system of the first coordinate system, the second coordinate system and the second coordinate system and the position of hand in the second coordinate system.Second frame hand image is transferred to processing module 3 after initialization module 2 processes, processing module 3 obtains position in the first coordinate system of the second coordinate system, the second coordinate system and the position of hand in the second coordinate system, successively to the 3rd frame, the 4th frame ... hand image procossing, obtain the position video flowing of the second coordinate system in the first coordinate system and the video flowing of hand in the second coordinate system, form gesture input.In this embodiment, position video flowing is the position video flowing of the second initial point in the first coordinate system and the video flowing of the second coordinate system rotation in the second coordinate system; The video flowing of hand in the second coordinate system comprises the bending video flowing of finger.
In above two kinds of embodiments, the first coordinate system that initialization module 2 is set up is constant, and the second coordinate system of foundation may cause change along with hands movement.In the first embodiment, processing module 3 does not consider the change of the second coordinate system when processing hand image, and the change of the change of the second coordinate system by hand position in the second coordinate system is represented.In the second embodiment, initialization module 2 all re-establishes the second coordinate system in each frame hand image, processing module 3 obtains the position of the second coordinate system in the first coordinate system in each frame hand image, the position of hand in the second coordinate system in each frame hand image.
Identification module 4 receiving processing module 3 export gesture, the standard gesture of pre-stored in this gesture and storer 5 is made comparisons, if mate with a standard gesture, then using this standard gesture as recognition result, be sent to transmission interface 6.
Processing module 3 starts when detecting image in one's hands to identify gesture, and when continuous several times receives identical hand image, the hand image such as received within 0.5-3 second is all identical, identifies that gesture terminates.
Intelligent terminal 20 is provided with memory module 201, stores and standard gesture command information one to one in memory module 201.Recognition result is exported to intelligent terminal 20 by transmission interface 5 by the identification module 4 of camera 10, and intelligent terminal 20 transfers corresponding command information according to this recognition result, completes corresponding operation.
With reference to the module map that Fig. 4, Fig. 4 are a kind of gesture remote control intelligent terminal system of the present invention embodiment 2, this gesture remote control intelligent terminal system comprises camera 10, intelligent terminal 20 and cloud server terminal 30, and cloud server terminal 30 is provided services on the Internet for intelligent terminal 20.
Wherein, camera 10 comprises photographing module 1, initialization module 2, processing module 3, identification module 4, storer 5, USB interface 6 and bluetooth module 7, and photographing module 1 is provided with camera lens 11 and imageing sensor 12.
Compared with embodiment 1, the transmission interface of the present embodiment 2 adopts USB interface, and increase bluetooth module 7, the output terminal of bluetooth module 7 is electrically connected with the input end of USB interface 6, and the data that camera 10 is received by bluetooth module 7 can send out through USB interface simultaneously.
Cloud server terminal 30 is connected by network interface with intelligent terminal 20, and network interface includes wired network interface and radio network interface.
Intelligent terminal 20 includes but not limited to desktop computer, notebook computer, panel computer and smart mobile phone etc., the equipment that such as desktop computer case and projection arrangement are formed by connecting.
When implementing, camera is connected with intelligent terminal by USB interface.In other embodiments, such as, when being applied to the intelligent terminal such as notebook computer, panel computer, intelligent terminal carries camera, now camera is integrated on intelligent terminal, and this kind of mode also should within the protection domain of the claims in the present invention.
The foregoing is only the preferred embodiments of the present invention; not thereby the scope of the claims of the present invention is limited; every utilize instructions of the present invention and accompanying drawing content to do equivalent structure or equivalent flow process conversion; or be directly or indirectly used in other relevant technical fields, be all in like manner included in scope of patent protection of the present invention.
Claims (9)
1. a gesture remote control intelligent terminal system, comprises intelligent terminal and camera, and described camera comprises photographing module, storer and transmission interface, and described photographing module is provided with camera lens and imageing sensor, it is characterized in that, described camera also comprises:
Initialization module, for set up with described image sensor surface be the first coordinate plane the first coordinate system, with the second coordinate system to palmar aspect during described camera lens being just the second coordinate plane, determine the position of described second coordinate system in described first coordinate system;
Processing module, for the treatment of the hands movement image that described photographing module gathers, obtains the position video flowing of described second coordinate system in described first coordinate system and the video flowing of hand in described second coordinate system, forms gesture input;
Identification module, makes comparisons for the standard gesture of pre-stored in the gesture that described processing module exported and described storer, if mate with standard gesture described in, then using this standard gesture as recognition result, and be sent to described transmission interface;
Described intelligent terminal is provided with memory module, stores and described standard gesture command information one to one in described memory module;
Described camera is connected with described intelligent terminal by described transmission interface.
2. gesture remote control intelligent terminal system according to claim 1, is characterized in that, described camera also comprises bluetooth module, and the output terminal of described bluetooth module is electrically connected with the input end of described transmission interface.
3. gesture remote control intelligent terminal system according to claim 1, is characterized in that, described transmission interface is USB interface.
4. gesture remote control intelligent terminal system according to claim 1, it is characterized in that, described first coordinate system for coordinate axis, is first initial point with the center of described imageing sensor with the perpendicular line of the vertical direction line in described first coordinate plane, horizontal direction line and described vertical direction line, horizontal direction line.
5. gesture remote control intelligent terminal system according to claim 1, is characterized in that, in described second coordinate plane, gets that wrist place rectilinear direction is X-axis, palm lateral border place is Y-axis perpendicular to the straight line of X-axis; Described second coordinate system with described X-axis, Y-axis and perpendicular to the Z axis of described X-axis, Y-axis for coordinate axis; Be the second initial point with the intersection point of described X-axis, Y-axis.
6. gesture remote control intelligent terminal system according to claim 1, is characterized in that, described second coordinate is three-dimensional system of coordinate, and described position video flowing is the position video flowing of the second initial point in described second coordinate system; The video flowing of hand in described second coordinate system, comprising: the video flowing that the bending and rotation of palm of finger is formed.
7. gesture remote control intelligent terminal system according to claim 1, is characterized in that, described position video flowing is the position video flowing of the second initial point in described second coordinate system and the video flowing of described second coordinate system rotation; The video flowing of hand in described second coordinate system, comprising: the video flowing be bent to form of finger.
8. gesture remote control intelligent terminal system according to claim 1, is characterized in that, also comprise cloud server terminal, and described intelligent terminal is connected by network interface with described cloud server terminal.
9. gesture remote control intelligent terminal system according to claim 1, is characterized in that, described intelligent terminal is desktop computer, notebook computer, panel computer or smart mobile phone.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410472802.2A CN105487646A (en) | 2014-09-16 | 2014-09-16 | Intelligent terminal system with gesture remote function |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410472802.2A CN105487646A (en) | 2014-09-16 | 2014-09-16 | Intelligent terminal system with gesture remote function |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105487646A true CN105487646A (en) | 2016-04-13 |
Family
ID=55674674
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410472802.2A Pending CN105487646A (en) | 2014-09-16 | 2014-09-16 | Intelligent terminal system with gesture remote function |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105487646A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1276572A (en) * | 1999-06-08 | 2000-12-13 | 松下电器产业株式会社 | Hand shape and gesture identifying device, identifying method and medium for recording program contg. said method |
| CN102012778A (en) * | 2009-09-04 | 2011-04-13 | 索尼公司 | Display control apparatus, display control method, and display control program |
| CN102663364A (en) * | 2012-04-10 | 2012-09-12 | 四川长虹电器股份有限公司 | Imitated 3D gesture recognition system and method |
| US8526675B2 (en) * | 2010-03-15 | 2013-09-03 | Omron Corporation | Gesture recognition apparatus, method for controlling gesture recognition apparatus, and control program |
-
2014
- 2014-09-16 CN CN201410472802.2A patent/CN105487646A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1276572A (en) * | 1999-06-08 | 2000-12-13 | 松下电器产业株式会社 | Hand shape and gesture identifying device, identifying method and medium for recording program contg. said method |
| CN102012778A (en) * | 2009-09-04 | 2011-04-13 | 索尼公司 | Display control apparatus, display control method, and display control program |
| US8526675B2 (en) * | 2010-03-15 | 2013-09-03 | Omron Corporation | Gesture recognition apparatus, method for controlling gesture recognition apparatus, and control program |
| CN102663364A (en) * | 2012-04-10 | 2012-09-12 | 四川长虹电器股份有限公司 | Imitated 3D gesture recognition system and method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102937832B (en) | A kind of gesture method for catching of mobile terminal and device | |
| CN103079036B (en) | A kind of photographic camera and method thereof entering screening-mode fast | |
| CN102253737A (en) | Screen-vision mouse system and realizing method thereof | |
| CN104081307A (en) | Image processing apparatus, image processing method, and program | |
| CN109668545A (en) | Localization method, locator and positioning system for head-mounted display apparatus | |
| CN109839827B (en) | Gesture recognition intelligent household control system based on full-space position information | |
| CN109992111B (en) | Augmented reality extension method and electronic device | |
| CN108881544A (en) | A kind of method taken pictures and mobile terminal | |
| CN102685581B (en) | Multi-hand control system for intelligent television | |
| CN112486394A (en) | Information processing method and device, electronic equipment and readable storage medium | |
| CN106569716B (en) | Single-hand control method and control system | |
| CN102868925A (en) | Intelligent TV (television) control method | |
| CN106598422B (en) | hybrid control method, control system and electronic equipment | |
| CN104077784B (en) | Extract the method and electronic equipment of destination object | |
| CN210691314U (en) | Access control system and login device based on in vivo detection | |
| CN104914985A (en) | Gesture control method and system and video flowing processing device | |
| CN202110500U (en) | Visual mouse system of screen | |
| CN105468249A (en) | Intelligent interaction system and control method therefor | |
| CN109542218B (en) | Mobile terminal, human-computer interaction system and method | |
| CN105404387A (en) | Gesture remote control system for intelligent terminal | |
| WO2019100547A1 (en) | Projection control method, apparatus, projection interaction system, and storage medium | |
| CN111080589A (en) | Target object matching method, system, device and machine readable medium | |
| CN105487646A (en) | Intelligent terminal system with gesture remote function | |
| CN105491425A (en) | Methods for gesture recognition and television remote control | |
| CN114299615A (en) | Key point-based multi-feature fusion action identification method, device, medium and equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160413 |
|
| RJ01 | Rejection of invention patent application after publication |