CN100531248C - Method for replacing key-press operation via detecting camera mobile phone cam movement - Google Patents
Method for replacing key-press operation via detecting camera mobile phone cam movement Download PDFInfo
- Publication number
- CN100531248C CN100531248C CNB2005100862428A CN200510086242A CN100531248C CN 100531248 C CN100531248 C CN 100531248C CN B2005100862428 A CNB2005100862428 A CN B2005100862428A CN 200510086242 A CN200510086242 A CN 200510086242A CN 100531248 C CN100531248 C CN 100531248C
- Authority
- CN
- China
- Prior art keywords
- mobile phone
- button
- camera
- video
- sequence
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000000034 method Methods 0.000 title claims abstract description 51
- 230000008878 coupling Effects 0.000 claims description 7
- 238000010168 coupling process Methods 0.000 claims description 7
- 238000005859 coupling reaction Methods 0.000 claims description 7
- 238000013459 approach Methods 0.000 claims description 3
- 238000006073 displacement reaction Methods 0.000 claims description 3
- 238000000605 extraction Methods 0.000 claims description 3
- 238000001914 filtration Methods 0.000 claims description 3
- 238000012790 confirmation Methods 0.000 description 10
- 230000007306 turnover Effects 0.000 description 7
- 238000012544 monitoring process Methods 0.000 description 5
- 230000009471 action Effects 0.000 description 2
- 230000004888 barrier function Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000010295 mobile communication Methods 0.000 description 2
- 230000008901 benefit Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
Images
Landscapes
- Telephone Function (AREA)
Abstract
This invention provides a method by testing the movements of cellphone camera instead of pressing key operation, characterized in that by testing the different movement distance, moving speed and moving direction of cellphone camera, matching the different movement parameters with corresponding key-pressing operation, so as to control the cellphone, and achieve the purpose of different movement parameter standing for different operation, and take the place of key-pressing operation.
Description
Technical field
The invention belongs to mobile phone application and cell phone managing, mobile phone games and cell phone entertainment field, and relate in particular to a kind of by detecting the method for camera mobile phone cam movement replacing key-press operation.
Background technology
Along with the development of mobile phone technique, the function of mobile phone is also more and more abundanter.Except making a phone call, the application of mobile phone games and cell phone entertainment is also more and more, as online, listens song, plays games etc.Wherein button operation is the important means that present people use the mobile phone working procedure, and mobile phone key is mainly finished the program of opening, bolt down procedure, option program, executive program and finished data or the functions such as input of character.
In addition, application number is 200410155088, denomination of invention is a kind of how by the camera photographed data on the mobile phone and to the method for computer input for the Chinese patent application of " band camera mobile phone and to the method for computer inputting video data " discloses, thus but the camera head of substituting for computer.Application number is 200310108642, denomination of invention is a kind of for the Chinese patent application of " monitoring mobile phone multifunctional pick-up head " discloses is contained in the electrical equipment the inside with camera, by the method for mobile phone or computer remote monitoring circuit.Application number is 03128141, denomination of invention realizes the method that supervisory control is carried out at remote moving target, scene for the Chinese patent application of " multimedia message image alarm device " discloses a kind of multimedia message mobile phone that utilizes, promptly when the user wants to see that monitoring is on-the-spot, send an instruction note to warning device, warning device can instantaneous acquiring image and send back to the user at that time, or when changing at the monitoring scene, send the multimedia message image from the trend user mobile phone, realize reporting to the police.The above-mentioned relevant patent application that all belongs to cell-phone camera field or monitoring field, yet, do not occur at present making the operation of mobile phone and using more quick and easy and hommization more, and have more the technology that recreational and more convenient old man, child and individuals with disabilities use without barrier.
Summary of the invention
In view of above-mentioned, the object of the present invention is to provide a kind of by detecting the method for camera mobile phone cam movement replacing key-press operation, its method is by detecting the parameters such as different motion distance, movement velocity and the direction of motion of camera on the camera mobile phone, corresponding the different motion parameter of camera with the respective keys operation of mobile phone, to reach the control handset program, thereby the purpose of different key operation is represented in the difference action that realizes camera, to replace manual button operation.
To achieve these goals, of the present invention a kind of by detecting the method for camera mobile phone cam movement replacing key-press operation, comprise the steps:
Step 1: obtain video by the camera on the mobile phone, promptly when selected program brings into operation, start camera operation simultaneously on the backstage, finish shooting to site environment;
Step 2: the video sequence that obtains in the above-mentioned steps 1 is carried out preliminary treatment, carry out the frame of video in initial analysis and this video sequence of classification;
Step 3: utilize estimation and image tracking technique that above-mentioned video sequence is carried out the extraction of kinematic parameter, wherein above-mentioned kinematic parameter comprises one or more the parameter in the direction of motion, movement velocity, the move distance at least;
Step 4: move coupling, promptly the button operation that the kinematic parameter of said extracted and button are sorted out in the sequence is corresponding; For example the direction of motion is represented the direction options button of mobile phone, and movement velocity is represented digital input key, the handover operation between move distance representative program, as by numeral to the letter switching etc., can freely define here with convenient difference in functionality and the specific operation realized; Button is herein sorted out sequence and is comprised following performing step:
Step 401: the button on the mobile phone of different styles and different model is extracted;
Step 402: the keypress function to the mobile phone of different model is analyzed, and analyzes the major function that its button is finished;
Step 403: by the analysis of 402 pairs of buttons of above-mentioned steps, know the function of its representative, it is sorted out, can be divided into numeric class, alphabetic class, selection class usually, confirm one or more the classification in the class;
Step 404: the content that button in the above-mentioned steps 403 is sorted out is ranked and is put in storage, and each class button is loaded in the database by the sequence number classification, forms button and sorts out sequence;
Step 5: by mobile camera mobile phone, mobile phone detects the kinematic parameter of camera automatically, carries out corresponding operation according to the different implications of its representative.
Wherein, the preliminary treatment of in the above-mentioned steps 2 video sequence being carried out comprises at least and adopts filtering, denoising and edge to strengthen one or more operation in the operation.
Video sequence in the above-mentioned steps 3 comprises the first frame video and the second frame video, and above-mentioned steps 3 comprises the steps:
Step 301: in the first frame video, select object of reference, wherein can select the zone of video hub position 8 * 8 usually, but also can select other any suitable zones in this first frame video;
Step 302: in the second frame video, seek this object of reference The corresponding area, after finding, calculate the displacement and the direction of motion between itself and the first frame video, and then calculate the kinematic parameter of this object of reference; If in second frame, do not find the object of reference in first frame, can be zero or other parameters with all kinematic parameter assignment, promptly think and do not move.
Above-mentioned steps 3 keys comprise following two aspects:
1) choosing of object of reference: in order to guarantee the precision of parameter, select three objects of reference usually, be the zone of 8 * 8 sizes, and distribution triangular in shape; But also can select other any suitable zones, and it is distributed by any suitable mode;
2) coupling of object of reference:, can adopt one or more the method in motion estimation techniques and the three-step approach fast algorithm to realize coupling at least in order to improve matching speed and to guarantee precision.Wherein above-mentioned motion estimation techniques and three-step approach fast algorithm all have introduction in common video technical finesse teaching material and books.
Certainly, under the in running order situation of the method for the invention (promptly replacing the mobile phone key operation) by the motion that detects camera, the user still wishes to return to by the mode of button to carry out relevant operation sometimes, this can be by on mobile phone, setting in advance " hot key " mode or the mode of special mobile phone motor pattern (as continuous several times fast moving up and down), clicking " hot key " or carrying out mobile phone special exercise pattern operation back and realize.
Adopt method of the present invention, it is not only in operation with use more quick and easy and hommization more, and has more recreational and more convenient old man, child and individuals with disabilities and use without barrier.And for the enforcement of the method for the invention, mobile phone producer can design after obtaining the method for the invention and realize voluntarily, and the problem that does not exist a pre-designed cover software to buy or install by mobile phone producer.In addition, mobile phone producer can be applied to method of the present invention in the management of any application of mobile phone.
Below in conjunction with accompanying drawing, the concrete enforcement of the method for the invention is described in further detail.For those skilled in the art that, from the detailed description to the inventive method, above-mentioned and other purposes of the present invention, feature and advantage will be apparent.
Description of drawings
Fig. 1 is the schematic diagram of the method for the invention.
Embodiment
Below in conjunction with accompanying drawing, the concrete enforcement of the method for the invention is described in further detail.
The method of the invention is by detecting the parameters such as different motion distance, movement velocity and the direction of motion of camera on the camera mobile phone, corresponding the different motion parameter of camera with the respective keys operation of mobile phone, reaching the control handset program, thereby realize the purpose that on behalf of different key, the difference action of camera operate.Because the diversity of move distance, movement velocity and the direction of motion of camera on the camera mobile phone, so on behalf of people, it can to a certain extent want the meaning of expressing, and can the instead of manual button.In the application process of camera mobile phone or in mobile communication application (3-G (Generation Three mobile communication system), i.e. 3G),, then can make the people feel to use more convenient and quick if people only can steering program by just moving of camera mobile phone.
Fig. 1 is the schematic diagram of the method for the invention.As shown in Figure 1, method of the present invention comprises the steps:
Step 1: obtain video by the camera on the mobile phone, promptly when selected program brings into operation, start camera operation simultaneously on the backstage, finish shooting to site environment;
Step 2: the video sequence that obtains in the above-mentioned steps 1 is carried out preliminary treatment, carry out initial analysis and sort out frame of video in this video sequence, wherein comprise at least and adopt filtering, denoising and edge to strengthen one or more operation in the operation;
Step 3: utilize estimation and image tracking technique above-mentioned video sequence to be carried out the extraction of kinematic parameter; Above-mentioned kinematic parameter comprises one or more the parameter in the direction of motion, movement velocity, the move distance at least; Wherein at first in the first frame video, select object of reference, wherein can select the zone of video hub position 8 * 8 usually, but also can select other any suitable zones in this first frame video; In the second frame video, seek this object of reference The corresponding area then, after finding, calculate the displacement and the direction of motion between itself and the first frame video, and then calculate the kinematic parameter of this object of reference; If in second frame, do not find the object of reference in first frame, can be zero or other parameters with all kinematic parameter assignment, promptly think and do not move;
Step 4: move coupling, promptly all button operations that the kinematic parameter of said extracted and button are sorted out in the sequence are corresponding; For example the direction of motion is represented the direction options button of mobile phone, and movement velocity is represented digital input key, the handover operation between move distance representative program, as by numeral to the letter switching etc., can freely define here with convenient difference in functionality and the specific operation realized;
Step 5: by mobile camera mobile phone, mobile phone detects the kinematic parameter of camera automatically, carries out corresponding operation according to the different implications of its representative.
Wherein, the button in the above-mentioned steps 4 is sorted out sequence and is comprised following performing step:
Step 401: the button on the mobile phone of different styles and different model is extracted;
Step 402: the keypress function to the mobile phone of different model is analyzed, and analyzes the major function that its button is finished;
Step 403: by the analysis of 402 pairs of buttons of above-mentioned steps, know the function of its representative, it is sorted out, usually can be divided into numeric class, alphabetic class, selection class at least, confirm one or more the classification in the class;
Step 404: the content that button in the above-mentioned steps 403 is sorted out is ranked and is put in storage, and each class button is loaded in the database by the sequence number classification, forms button and sorts out sequence.
For the enforcement of the method for the invention, mobile phone producer can design after obtaining the method for the invention and realize voluntarily, and the problem that does not exist a pre-designed cover software to buy or install by mobile phone producer.In addition, mobile phone producer can be applied to method of the present invention in the management of any application of mobile phone, for example be applied in the broadcast of mobile phone MP3 song, for example suppose that the mobile phone kinematic parameter (kinematic parameter can comprise direction, speed, distance etc.) and the defining relation of button are: mobile phone moves forward, and turns over button in the representative; Mobile phone moves backward, turns over button under the representative; Mobile phone moves right, and represents volume to increase and connects key; Mobile phone is moved to the left, and represents volume to turn button down, and mobile phone moves upward and represents selection key (selection is and begins to play), and mobile phone moves downward, representative cancellation button (cancellation is and stops to play), and it mainly comprises following operation:
1) selects mobile phone MP3 play menu, unfolding mode keys available or method of the present invention (promptly detecting the method for cam movement); At this time mobile phone cam is in background work, and in the hypothesis mobile phone how first MP3 song arranged;
2) move mobile phone after, mobile phone moves after by the movement confirmation mobile phone that detects camera, then corresponding under turn over button, the cursor in the mobile phone display screen moves to next song position in the MP3 menu;
3) reach mobile phone, mobile phone be by detecting the movement confirmation mobile phone reach of camera, then corresponding on turn over button, the cursor in the mobile phone display screen moves to last one first song position in the MP3 menu;
4) mobile phone that moves to right, mobile phone moves to right by the movement confirmation mobile phone that detects camera, then transfers big key corresponding to volume, and mobile phone is transferred big broadcast sound volume automatically;
5) mobile phone that moves to left, mobile phone moves to left by the movement confirmation mobile phone that detects camera, then turns button down corresponding to volume, and mobile phone is turned broadcast sound volume automatically down.
6) move mobile phone on, mobile phone is by moving on the movement confirmation mobile phone that detects camera, and then corresponding to selection key, mobile phone is play the MP3 song of selection automatically;
7) move down mobile phone, mobile phone moves down by the movement confirmation mobile phone that detects camera, and then corresponding to the cancellation button, mobile phone stops to play the MP3 song.
The operation of mobile phone games for another example, be " driving an automobile that shows on the mobile phone screen " such as these mobile phone games, turn on having in the keyboard of this mobile phone, turn over down, turn on a left side, the four direction operation keys is turned on the right side (except numerical key and letter key, also having the button of upper and lower, left and right four direction on the keyboard of a lot of mobile phones).Before not adopting this method, the button operation of this recreation is: click upturning key, the operation automobile moves forward; Click downturning key, the operation automobile moves backward; Click a left side and turn over key, the operation automobile is turned left; Click the right side and turn over key, the operation automobile is turned right.After adopting this method, for example suppose that the defining relation of mobile phone kinematic parameter and button is: mobile phone moves forward, and upturning key is clicked in representative; Mobile phone moves backward, and downturning key is clicked in representative; Mobile phone moves right, and representative is clicked the right side and turned over key; Mobile phone is moved to the left, and representative is clicked a left side and turned over key.It mainly comprises following operation:
1) selects the recreation that drives a car in the mobile phone, unfolding mode keys available or method of the present invention (promptly detecting the method for cam movement); At this time mobile phone cam is in background work;
2) reach mobile phone, mobile phone be by detecting the movement confirmation mobile phone reach of camera, then corresponding on turn over button, automobile moves ahead;
3) move mobile phone after, mobile phone moves after by the movement confirmation mobile phone that detects camera, then corresponding under turn over button, back of automobile;
4) mobile phone that moves to right, mobile phone moves to right by the movement confirmation mobile phone that detects camera, then turns over button corresponding to the right side, and automobile is turned right;
5) mobile phone that moves to left, mobile phone moves to left by the movement confirmation mobile phone that detects camera, then turns over button corresponding to a left side, and automobile turns left.
More than describe operation principle of the present invention in detail, but the example of this visualization of just lifting for the ease of understanding should not be considered to be limitation of the scope of the invention.Equally; the ordinary skill of technical field all can be according to the description of technical scheme of the present invention and preferred embodiment thereof under any; make various possible being equal to and change or replacement, but all these changes or replacement all should belong to the protection range of claim of the present invention.
Claims (5)
1, a kind of by detecting the method for camera mobile phone cam movement replacing key-press operation, it is characterized in that comprising the steps:
Step 1: obtain video by the camera on the mobile phone, promptly when selected program brings into operation, start camera operation simultaneously on the backstage, finish shooting to site environment;
Step 2: the video sequence that obtains in the above-mentioned steps 1 is carried out preliminary treatment, carry out the frame of video in initial analysis and this video sequence of classification;
Step 3: utilize estimation and image tracking technique that above-mentioned video sequence is carried out the extraction of kinematic parameter, wherein above-mentioned kinematic parameter comprises one or more the parameter in the direction of motion, movement velocity and the move distance at least;
Step 4: move coupling, promptly the button operation that the kinematic parameter of said extracted and button are sorted out in the sequence is corresponding, and button is herein sorted out sequence and comprised following performing step:
Step 401: the button on the mobile phone of different styles and different model is extracted;
Step 402: the keypress function to the mobile phone of different model is analyzed, and analyzes the major function that its button is finished;
Step 403: by the analysis of 402 pairs of buttons of above-mentioned steps, it is sorted out, be divided into numeric class, alphabetic class, selection class, confirm one or more the classification in the class;
Step 404: the content that button in the above-mentioned steps 403 is sorted out is ranked and is put in storage, and each class button is loaded in the database by the sequence number classification, forms button and sorts out sequence;
Step 5: by mobile camera mobile phone, mobile phone detects the kinematic parameter of camera automatically, carries out corresponding operation according to the different implications of its representative.
2, method according to claim 1 is characterized in that the preliminary treatment of in the above-mentioned steps 2 video sequence being carried out comprises to adopt filtering, denoising and edge to strengthen one or more operation in the operation.
3, method according to claim 1 is characterized in that, the video sequence of above-mentioned steps 3 comprises the first frame video and the second frame video, and above-mentioned steps 3 comprises the steps:
Step 301: in the first frame video, select object of reference;
Step 302: in the second frame video, seek this object of reference The corresponding area, after finding, calculate the displacement and the direction of motion between itself and the first frame video, and then calculate the kinematic parameter of this object of reference.
4, method according to claim 1 is characterized in that above-mentioned steps 3 comprises at least:
1) object of reference chooses;
2) coupling of object of reference: adopt one or more the method in motion estimation techniques and the three-step approach fast algorithm to realize coupling at least.
5, method according to claim 1, it is characterized in that the mode by on mobile phone, setting in advance " hot key " or the mode of predefined mobile phone motor pattern, under the in running order situation of said method, the user can be as required, and realization is returned to by the mode of button by this method and carries out relevant operation after clicking " hot key " or carrying out the predefined motor pattern operation of mobile phone.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2005100862428A CN100531248C (en) | 2005-08-17 | 2005-08-17 | Method for replacing key-press operation via detecting camera mobile phone cam movement |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2005100862428A CN100531248C (en) | 2005-08-17 | 2005-08-17 | Method for replacing key-press operation via detecting camera mobile phone cam movement |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1731793A CN1731793A (en) | 2006-02-08 |
| CN100531248C true CN100531248C (en) | 2009-08-19 |
Family
ID=35964088
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB2005100862428A Expired - Fee Related CN100531248C (en) | 2005-08-17 | 2005-08-17 | Method for replacing key-press operation via detecting camera mobile phone cam movement |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN100531248C (en) |
Families Citing this family (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101231755B (en) * | 2007-01-25 | 2013-03-06 | 上海遥薇(集团)有限公司 | Moving target tracking and quantity statistics method |
| EP1968320B1 (en) | 2007-02-27 | 2018-07-18 | Accenture Global Services Limited | Video call device control |
| CN101247608B (en) * | 2008-03-10 | 2011-12-07 | 华为终端有限公司 | Method and device for self-adaptive adjusting camera parameter of terminal unit |
| CN101697199B (en) * | 2009-08-11 | 2012-07-04 | 北京盈科成章科技有限公司 | Detection method of head-face gesture and disabled assisting system using same to manipulate computer |
| CN102749994B (en) * | 2012-06-14 | 2016-05-04 | 华南理工大学 | The reminding method of the direction of motion of gesture and speed intensity in interactive system |
| CN103777872A (en) * | 2012-10-24 | 2014-05-07 | 中国电信股份有限公司 | Mobile terminal and unlocking method thereof |
| CN103916519A (en) * | 2012-12-31 | 2014-07-09 | 上海证大喜马拉雅网络科技有限公司 | Method and system for realizing audio play through camera and gyroscope |
| CN104765959A (en) * | 2015-03-30 | 2015-07-08 | 燕山大学 | Computer vision based evaluation method for general movement of baby |
| WO2019100298A1 (en) * | 2017-11-23 | 2019-05-31 | 华为技术有限公司 | Photographing method and terminal |
-
2005
- 2005-08-17 CN CNB2005100862428A patent/CN100531248C/en not_active Expired - Fee Related
Also Published As
| Publication number | Publication date |
|---|---|
| CN1731793A (en) | 2006-02-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN100531248C (en) | Method for replacing key-press operation via detecting camera mobile phone cam movement | |
| CN100552609C (en) | Use the apparatus and method of jog and navigation key control user interface | |
| CN100359441C (en) | Image processing device, image processing program, and image processing method | |
| CN104598111B (en) | Switch the method and device of display pattern | |
| CN102360249B (en) | Discrete keyboard layout system and method to set up, corresponding mancarried electronic aid and control method | |
| CN105446646A (en) | Virtual keyboard based content input method, apparatus and touch device | |
| CN106462293A (en) | Terminal, and touch control responding method and device | |
| JP2000267786A (en) | Information communication equipment | |
| DE202006020369U1 (en) | Multifunctional handheld device | |
| CN107492115A (en) | The detection method and device of destination object | |
| CN104238759A (en) | Method and device for controlling terminal through physical keys | |
| CN106775252A (en) | The message treatment method and mobile terminal of a kind of mobile terminal | |
| DE112008003578T5 (en) | Sensible feedback in an electronic device | |
| CN107992263A (en) | A kind of information sharing method and mobile terminal | |
| CN108933861A (en) | Application icon sort method, device, readable storage medium storing program for executing and intelligent terminal | |
| CN103905717A (en) | Switching method and device and electronic device | |
| CN107632750A (en) | The operating method and mobile terminal of a kind of icon | |
| CN106125923A (en) | Electronic equipment, input/output unit and using method thereof | |
| CN1991766A (en) | Application program switching system and method for electronic communication device | |
| CN105872271A (en) | Calling method for third party contact of teleconference and mobile terminal | |
| CN102855060A (en) | Terminal and cross-application cooperation processing method | |
| CN106257390A (en) | A kind of three-dimensional widget icon exchange method, device and touch terminal | |
| CN106791646A (en) | Show the method and device of video information | |
| CN105872360A (en) | Camera control method, camera control device and mobile equipment | |
| CN107390931A (en) | Response control mehtod, device, storage medium and the mobile terminal of touch operation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| ASS | Succession or assignment of patent right |
Owner name: WANG WEIGUO Free format text: FORMER OWNER: SUN DAN; APPLICANT Effective date: 20070420 |
|
| C41 | Transfer of patent application or patent right or utility model | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20070420 Address after: 100044 Beijing city Xizhimen North Street No. 41 days trillion homes 4C501 Applicant after: Wang Weiguo Address before: 100044 Beijing city Xizhimen North Street No. 41 days trillion homes 4C501 Applicant before: Sun Dan Co-applicant before: Wang Weiguo |
|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C17 | Cessation of patent right | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20090819 Termination date: 20090817 |