CN106648050A - Multimedia computer gesture control system and control method based on flexible electronic skin - Google Patents
Multimedia computer gesture control system and control method based on flexible electronic skin Download PDFInfo
- Publication number
- CN106648050A CN106648050A CN201610834276.9A CN201610834276A CN106648050A CN 106648050 A CN106648050 A CN 106648050A CN 201610834276 A CN201610834276 A CN 201610834276A CN 106648050 A CN106648050 A CN 106648050A
- Authority
- CN
- China
- Prior art keywords
- signal
- multimedia computer
- character recognition
- hand
- flexible electronic
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/014—Hand-worn input/output arrangements, e.g. data gloves
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
Abstract
The invention relates to a multimedia computer remote control system and method based on flexible electronic skin. The intelligent system comprises a gesture signal collection unit, a character recognition unit, a singlechip, a signal-radiation unit and a signal-receiving module. The method comprises the steps that a flexible electronic skin sensor attached on the back of a hand is adopted to detect hand back movement when a user gesticulate various gestures, received electric signals are input into the character recognition unit to be recognized, a recognition result corresponds to some kind of code of the singlechip, the signal-radiation unit translates the code of the singlechip to wireless code of a multimedia computer and launches the wireless code, the signal module inserted into a USB interface of the multimedia computer receives the wireless code, and corresponding functions of the multimedia computer are controlled, that is the intelligent control over the multimedia computer is achieved according to the various gestures. The multimedia computer remote control system is simple in structure, convenient to use, light in weight, high in reliability, convenient to carry, low in cost, conducive to industrialization and high in practicality as novel wearable intelligent display equipment.
Description
Technical field
The present invention relates to the field such as sensor, signal processing technology and radio sensing network, Internet of Things, more particularly to one
The intelligent multimedia computer gestural control system and control method based on flexible electronic skin is planted, belongs to Based Intelligent Control and Internet of Things
Field.
Background technology
Used as a kind of new wearable device, its research temperature is constantly lifted intelligent wearable device, its application
It is more and more extensive.Wearable device is not only a kind of hardware device, is even more handed over by software support and data interaction, high in the clouds
Mutually realizing powerful function, wearable device will bring very big transformation to our life, perception.
With the fast development of Information technology, multimedia form is with its good intuitive, iconicity, interest as more next
More people are received.Now, the own Jing of meeting room generally employs computer media equipment, the classroom instruction of many schools
More substituted by multimedia teaching.But, multimedia form there is also some drawbacks, and user cannot be more away from computer
Media device is controlled, very inconvenient in teaching or conference presentation.At present, most widely used is wireless mouse, is swashed
Light pen.But, there are many inconvenience, and price when PPT gives a lecture in dozens of yuan to more than 100 yuan in wireless mouse；Laser
The technology of pen is relatively ripe, but function is more perfect, and price is more expensive, and market at prices is typically in dozens of yuan to hundreds of unit
, or even have thousand of units.
The content of the invention
Present invention aims to the deficiencies in the prior art, there is provided a kind of multimedia electricity based on flexible electronic skin
Brain gestural control system and control method.
The purpose of the present invention is achieved through the following technical solutions：A kind of household gesture control based on flexible electronic skin
System processed, including hand signal collecting unit, character recognition unit, single-chip microcomputer, signal emission module and signal receiving module；Institute
Hand signal collecting unit is stated including flexible electronic skin, the back of the hand motion when gesticulating various gestures for collection produces strain, and
Export as electronic signals；The character recognition unit is used for the signal for gathering hand signal collecting unit and its database
The data of middle storage are compared, and realize character recognition；The single-chip microcomputer is to be compiled into the character that character recognition unit is recognized
Corresponding binary code, and control signal transmitter module sends corresponding control signal；The signal receiving module, by USB
Interface connects computer, receives corresponding wireless signal and multimedia computer is controlled.
Further, the flexible electronic skin is prepared by the following method and obtains：Cu nano wires-graphene film is cut
Go out the strip of 2cm × 0.5cm, two ends elargol is stained with copper cash, then embedded dimethyl silicone polymer (PDMS), be placed in 70 DEG C
2h in air dry oven, makes flexible electronic skin.The preparation method of the Cu nano wires-graphene film is as follows:
(1) 20-42mgCu nano wires are added in 20-25mL ethylene glycol solutions, adds 48-54mg anti-bad after being uniformly dispersed
Hematic acid, adds 3-3.8mL graphene oxides after being uniformly dispersed, in moving to hydrothermal reaction kettle, be placed on 120-160 DEG C of air blast and do
4-6h is reacted in dry case, room temperature is cooled to, Cu nano wires-Graphene composite aquogel is just obtained.
(2) Cu for preparing nano wires-Graphene composite aquogel is placed in 0.5wt% hydrazine hydrate solutions and is dialysed
16h, further takes out to pour into and is uniformly dispersed in 150mL deionized waters, obtains suspension, then with core filter suction filtration, just obtains
Cu nano wires-graphene film.
Further, the database is set up by the following method：Flexible electronic skin is sticked on user's the back of the hand, is adopted
The strain that the back of the hand motion is produced when collection user gesticulates various gestures, and character recognition unit is stored in as electronic signals；It is many
Each demonstrates a kind of gesture of operation correspondence with media computer, i.e., with a corresponding signature waveform.
Further, the multimedia computer function includes：Start demonstration, lower one page, page up, terminate demonstration etc..
A kind of intelligent multimedia computer gestural control method, comprises the following steps：
(1) flexible electronic skin is sticked in into the back of the hand surrounding, gathers what the back of the hand motion when user gesticulates various gestures was produced
Strain, and character recognition unit is sent to as electronic signals, each appliance name or a kind of each gesture of function correspondence are produced
A raw and signal waveform；
(2) character recognition unit utilizes database, by artificial neural network recognizer, to each ripple in electric signal
Shape is identified, and identifies the required function of correspondence multimedia computer；
(3) character that character recognition unit is recognized is compiled into corresponding binary code by single-chip microcomputer, and control signal is launched
Module sends corresponding control signal, receives corresponding signal by signal receiving module and multimedia computer is controlled.
Further, single-chip microcomputer can adopt the single-chip microcomputer of model STC89C51.
Further, signal emission module uses short-distance wireless communication agreement, the short distance with signal receiving module
Home control network communication protocol is IrDA protocol, bluetooth communication agreement, Wi-Fi communications protocol, RF communications protocol, ZigBee communications association
View, NFC agreement, UWB communications protocol.
The advantage of present system is：Multimedia computer is controlled in combination with flexible electronic skin by gesture many
Media demo function setting, by the technological applications of forefront to daily work and education activities, makes life more convenient
With it is comfortable.Conventional wireless mouse high cost has been abandoned, it is the shortcomings of volume is big and this based on the electric signal for determining gesture motion
The intelligent apparatus being identified are easy to carry, simple to operate, low cost, small volume, and real-time is good, and beneficial to industrialization, tool
There is good application prospect.
Description of the drawings：
Fig. 1 is the design sketch that flexible skin sensor is attached to the back of the hand vibration when gesture is gesticulated in the survey of the back of the hand surrounding；
Fig. 2 is that the electric signal waveform for being attached to flexible skin sensor on the back of the hand is measured with the table of Keithley 2400 when clenching fist；
Fig. 3 is that the electric signal waveform for being attached to flexible skin sensor on the back of the hand is measured with the table of Keithley 2400 when waving；
Fig. 4 is the FB(flow block) of present system.
Specific embodiment:
A kind of multimedia computer gestural control system based on flexible electronic skin, including hand signal collecting unit, word
Symbol recognition unit, single-chip microcomputer, signal emission module and signal receiving module；
The hand signal collecting unit includes flexible electronic skin, and the back of the hand motion when gesticulating various gestures for collection is produced
Raw strain, and export as electronic signals；
Described hand signal collecting unit, critical piece be flexible electronic skin, the preparation method of flexible electronic skin
For:Cu nano wires-graphene film is cut into the strip of 2cm × 0.5cm, two ends elargol is stained with into copper cash, then embedded PDMS
In, 2h in 70 DEG C of air dry ovens is placed in, make flexible electronic skin.Wherein, the preparation method of Cu nano wires-graphene film
It is as follows:
(1) 20-42mgCu nano wires are added in 20-25mL ethylene glycol solutions, adds 48-54mg anti-bad after being uniformly dispersed
Hematic acid, adds 3-3.8mL graphene oxides after being uniformly dispersed, in moving to hydrothermal reaction kettle, be placed on 120-160 DEG C of air blast and do
4-6h is reacted in dry case, room temperature is cooled to, Cu nano wires-Graphene composite aquogel is just obtained.
(2) Cu for preparing nano wires-Graphene composite aquogel is placed in 0.5wt% hydrazine hydrate solutions and is dialysed
16h, further takes out to pour into and is uniformly dispersed in 150mL deionized waters, obtains suspension, then with core filter suction filtration, just obtains
Cu nano wires-graphene film.
Flexible electronic skin has higher sensitivity and stability, and its shapes and sizes can be according to each back of people's hand
Feature is customized, it is ensured that flexible electronic skin can be close to the top of the back of the hand, and vibration during gesture is gesticulated in sensitive collection.
The character recognition unit is used for the number of the signal and storage in its database for gathering hand signal collecting unit
According to comparing, character recognition is realized according to artificial neural network algorithm；
Database is set up by training, in user using front, first has to make complete according to user's the back of the hand feature
Flexible skin sensor can be made to be close to the intelligent apparatus above the back of the hand.Then need payment user to be trained, met
These signals are set up a database by the gesture vibration electric signal of the multimedia computer demonstration operation of user action custom.
In identification process, the intelligent apparatus for meeting oneself the back of the hand feature of our designs are sticked, when user gesticulates gesture
When, because the change of the back of the hand motion causes the weekly assembly of the back of the hand four to produce vibration, it is close to the flexible skin sensor of the back of the hand while following
The vibration of the back of the hand can produce the Light deformation on surface, so as to cause resistance strain gage sensor in foil gauge deformation so that strain
Sheet resistance values change, so that externally the magnitude of voltage of output also can change on foil gauge, this voltage signal is input to
The analog acquisition port of single-chip microcomputer, single-chip microcomputer carries out analog-to-digital conversion to the analog voltage signal for collecting, and is changed into reflecting
The digital quantity of each gesture feature.Single-chip microcomputer obtains reflecting the digital quantity of each gesture feature, by the ANN for recognizing
The recognizer of network, carries out matching identification one by one, the result being identified by the signal in database and these signals.The present invention
In database, on the one hand need to be stored in the current signals of various demonstration action names, it is right therewith to be on the other hand also required to be stored in
The current signal of the function choosing-item answered.For multimedia computer, needs are stored in and start demonstration, lower one page, page up, terminate demonstration
Deng the current waveform of function choosing-item.
The single-chip microcomputer is that the character that character recognition unit is recognized is compiled into into corresponding binary code, and control signal is sent out
Penetrate module and send corresponding control signal, received so as to be controlled to multimedia computer by signal receiving module.Know in character
After other unit end of identification, recognition result enters single-chip microcomputer, and the character of identification is compiled into into a binary coding, each gesture
The corresponding binary coding of electric signal waveform be it is different, i.e., hand signal identification database correspondence one binary coded number
According to storehouse.Signal receiving module receives signal and the coding of signal will be decoded according to the agreement being set, then real
The corresponding function of existing multimedia computer.The home control network communication protocol of single-chip microcomputer, signal transmitting and receiver module is base in the present invention
In prior art.Signal emission module uses short-distance wireless communication agreement with signal receiving module, is IrDA protocol, indigo plant
Tooth communications protocol, Wi-Fi communications protocol, RF communications protocol, ZigBee communications protocol, NFC agreement, UWB communications association
View.Specific implementation process：User sticks gesture of our the flexible electronic skin than standardized " clenching fist ", system on the back of the hand
The electric signal waveform for collecting is input in character database and is identified, identify the signal waveform of " clenching fist " gesture, it is single
Piece machine is input to the binary coding corresponding to the signal waveform in signal emission module circuit, and signal emission module is entered two
Code processed is launched by home control network communication protocol, and signal receiving module is solved again to the coding of signal according to the agreement of setting
Code, identifies that " clenching fist " is the signal for starting to show, and drives multimedia computer to start slideshow.User then stretches out food
The gesture that right slip ratio marks " waving " is pointed to, system can be realized in multimedia computer presentation process backward through same process
The function of page turning.If the multimedia computer demo function representated by the gesture that you gesticulate is no in database or recognizes not
Out, then system can bright light remind and re-enter or point out this input invalid etc..
Claims (7)
1. a kind of multimedia computer control system based on flexible electronic skin, it is characterised in that：It is single including hand signal collection
Unit, character recognition unit, single-chip microcomputer, signal transmitter unit and signal receiving unit；
The hand signal collecting unit includes flexible electronic skin, and the back of the hand motion when gesticulating various gestures for collection is produced
Strain, and export as electronic signals；
The signal that the character recognition unit is used to gather hand signal collecting unit enters with the data of storage in its database
Row is compared, and realizes character recognition；
The single-chip microcomputer is that the character that character recognition unit is recognized is compiled into into corresponding binary code, and control signal transmitting is single
Unit sends corresponding control signal；
The signal receiving unit is attached with multimedia computer by USB interface, by receiving radio signal conversion
Into the various instructions of corresponding multimedia computer.
2. system according to claim 1, it is characterised in that the flexible electronic skin is prepared by the following method
Arrive：Cu nano wires-graphene film is cut into the strip of 2cm × 0.5cm, two ends elargol is stained with into copper cash, then embedded poly- two
In methylsiloxane (PDMS), 2h in 70 DEG C of air dry ovens is placed in, makes flexible electronic skin.Cu nano wires-the graphite
The preparation method of alkene film is as follows:
(1) 20-42mgCu nano wires are added in 20-25mL ethylene glycol solutions, 48-54mg Vitamin Cs is added after being uniformly dispersed
Acid, adds 3-3.8mL graphene oxides after being uniformly dispersed, in moving to hydrothermal reaction kettle, be placed on 120-160 DEG C of forced air drying
4-6h is reacted in case, room temperature is cooled to, Cu nano wires-Graphene composite aquogel is just obtained.
(2) Cu for preparing nano wires-Graphene composite aquogel is placed in in 0.5wt% hydrazine hydrate solutions the 16h that dialyses, then
Taking-up is poured into and is uniformly dispersed in 150mL deionized waters, obtains suspension, then with core filter suction filtration, just obtains Cu nanometers
Line-graphene film.
3. system according to claim 1, it is characterised in that the database is set up by the following method：By flexible electrical
Sub- skin is sticked on user's the back of the hand, gathers the strain that the back of the hand motion is produced when user gesticulates various gestures, and with electric signal
Form is stored in character recognition unit；Each a kind of gesture of operation correspondence when multimedia computer is demonstrated, i.e., with a correspondence
Signature waveform.
4. system according to claim 3, it is characterised in that the multimedia computer function includes：Start demonstration, it is next
Page, page up, end demonstration etc..
5. the multimedia computer gestural control method of system described in a kind of claim 1, it is characterised in that comprise the following steps：
(1) flexible electronic skin is sticked in into the back of the hand surrounding, gathers the strain that the back of the hand motion is produced when user gesticulates various gestures,
And be sent to character recognition unit as electronic signals, each a kind of gesture of operation correspondence when multimedia computer is demonstrated and
Produce a signal waveform；
(2) character recognition unit utilizes database, by artificial neural network recognizer, each waveform in electric signal is entered
Row identification, action required when identifying that multimedia computer is demonstrated；
(3) character that character recognition unit is recognized is compiled into corresponding binary code, and control signal transmitter unit by single-chip microcomputer
Corresponding control signal is sent, multimedia computer is controlled.
6. system according to claim 1, it is characterised in that single-chip microcomputer can adopt the monolithic of model STC89C51
Machine.
7. system according to claim 1, it is characterised in that signal emission module uses short distance with signal receiving module
Home control network communication protocol, the short-distance wireless communication agreement be IrDA protocol, bluetooth communication agreement, Wi-Fi communications protocol,
RF communications protocol, ZigBee communications protocol, NFC agreement, UWB communications protocol.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610834276.9A CN106648050A (en) | 2016-09-20 | 2016-09-20 | Multimedia computer gesture control system and control method based on flexible electronic skin |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610834276.9A CN106648050A (en) | 2016-09-20 | 2016-09-20 | Multimedia computer gesture control system and control method based on flexible electronic skin |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106648050A true CN106648050A (en) | 2017-05-10 |
Family
ID=58852670
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610834276.9A Pending CN106648050A (en) | 2016-09-20 | 2016-09-20 | Multimedia computer gesture control system and control method based on flexible electronic skin |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106648050A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107765850A (en) * | 2017-09-22 | 2018-03-06 | 上海交通大学 | A kind of sign Language Recognition based on electronic skin and multi-sensor fusion |
| CN108567565A (en) * | 2018-05-15 | 2018-09-25 | 浙江工业大学 | A kind of flexible normalizing instrument of CPR action |
| CN108621646A (en) * | 2018-05-15 | 2018-10-09 | 浙江工业大学 | A kind of intelligent signature pen of correcting pen-holding posture |
| CN110414633A (en) * | 2019-07-04 | 2019-11-05 | 东南大学 | System and recognition methods for hand-written script identification |
| CN114997227A (en) * | 2022-05-30 | 2022-09-02 | 中国科学院长春应用化学研究所 | Gesture recognition system based on muscle stress |
| CN115002278A (en) * | 2022-05-12 | 2022-09-02 | 中国电信股份有限公司 | Wireless device gesture control method and device, storage medium and electronic device |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104575500A (en) * | 2013-10-24 | 2015-04-29 | 中国科学院苏州纳米技术与纳米仿生研究所 | Application of electronic skin in voice recognition, voice recognition system and voice recognition method |
| CN104801244A (en) * | 2015-04-09 | 2015-07-29 | 浙江理工大学 | Method for preparing three-dimensional graphene-copper nanowire composite aerogel |
| CN105867628A (en) * | 2016-04-18 | 2016-08-17 | 浙江理工大学 | Flexible electronic skin based smart home gesture control system and control method |
-
2016
- 2016-09-20 CN CN201610834276.9A patent/CN106648050A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104575500A (en) * | 2013-10-24 | 2015-04-29 | 中国科学院苏州纳米技术与纳米仿生研究所 | Application of electronic skin in voice recognition, voice recognition system and voice recognition method |
| CN104801244A (en) * | 2015-04-09 | 2015-07-29 | 浙江理工大学 | Method for preparing three-dimensional graphene-copper nanowire composite aerogel |
| CN105867628A (en) * | 2016-04-18 | 2016-08-17 | 浙江理工大学 | Flexible electronic skin based smart home gesture control system and control method |
Non-Patent Citations (1)
| Title |
|---|
| TAKEO YAMADA ET AL: "A Stretchable Carbon Nanotube Strain Sensor for Human-motion Detection", 《NATURE NANOTECHNOLOGY》 * |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107765850A (en) * | 2017-09-22 | 2018-03-06 | 上海交通大学 | A kind of sign Language Recognition based on electronic skin and multi-sensor fusion |
| CN108567565A (en) * | 2018-05-15 | 2018-09-25 | 浙江工业大学 | A kind of flexible normalizing instrument of CPR action |
| CN108621646A (en) * | 2018-05-15 | 2018-10-09 | 浙江工业大学 | A kind of intelligent signature pen of correcting pen-holding posture |
| CN110414633A (en) * | 2019-07-04 | 2019-11-05 | 东南大学 | System and recognition methods for hand-written script identification |
| CN115002278A (en) * | 2022-05-12 | 2022-09-02 | 中国电信股份有限公司 | Wireless device gesture control method and device, storage medium and electronic device |
| CN115002278B (en) * | 2022-05-12 | 2023-10-10 | 中国电信股份有限公司 | Gesture control method and device for wireless device, storage medium and electronic device |
| CN114997227A (en) * | 2022-05-30 | 2022-09-02 | 中国科学院长春应用化学研究所 | Gesture recognition system based on muscle stress |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106648050A (en) | Multimedia computer gesture control system and control method based on flexible electronic skin | |
| CN101707662B (en) | Electronic equipment, mobile communication equipment and remote control device | |
| CN105867628A (en) | Flexible electronic skin based smart home gesture control system and control method | |
| CN103246349B (en) | Input method of wearable finer-sensing wireless communication, and input device using input method | |
| CN202342017U (en) | Intelligent body temperature acquisition system for identifying identity by fingerprint | |
| CN105807925A (en) | Flexible electronic skin based lip language identification system and method | |
| CN106408876A (en) | Fatigue driving monitoring system and monitoring method based on flexible electronic skin | |
| CN100397838C (en) | Digital type infrared-bluetooth two-bridge universal remote control device | |
| CN105867148A (en) | System and method for intelligent home control based on flexible electronic skin | |
| CN202267680U (en) | Intelligent blood sugar collection system with fingerprint identity recognition | |
| CN202342026U (en) | Intelligent blood pressure acquisition system for fingerprint identity recognition | |
| CN108008843A (en) | A kind of wireless speech mouse and voice operating system | |
| CN205751209U (en) | A kind of power information acquisition terminal detection device | |
| CN106445134A (en) | Wearable wireless mouse based on flexible electronic skin | |
| CN202306470U (en) | Wireless laser handle | |
| CN202600936U (en) | Remote controller with voice function | |
| CN202003556U (en) | Digital signal processor (DSP) application technology teaching equipment based on intelligent home control system project | |
| CN202736471U (en) | Piano guide system | |
| CN207721807U (en) | A kind of Wifi transmission electronic sphygmomanometer | |
| CN208188792U (en) | A kind of capacitor active pen | |
| CN202257900U (en) | Sliding touch type PPT (Power Point) wireless controller | |
| CN206179204U (en) | Real time sensor's teaching intelligence laser pen | |
| CN204790541U (en) | Real platform device of instructing is synthesized in thing networking | |
| CN202903871U (en) | Wireless electric energy saving monitor | |
| CN104363494A (en) | Gesture recognition system for smart television |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170510 |