CN1731793A - A method of replacing button operation by detecting camera movement of a camera-capable mobile phone - Google Patents
A method of replacing button operation by detecting camera movement of a camera-capable mobile phone Download PDFInfo
- Publication number
- CN1731793A CN1731793A CN200510086242.8A CN200510086242A CN1731793A CN 1731793 A CN1731793 A CN 1731793A CN 200510086242 A CN200510086242 A CN 200510086242A CN 1731793 A CN1731793 A CN 1731793A
- Authority
- CN
- China
- Prior art keywords
- mobile phone
- camera
- motion
- video
- key
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 49
- 230000009471 action Effects 0.000 claims abstract description 4
- 238000012790 confirmation Methods 0.000 claims description 11
- 238000005516 engineering process Methods 0.000 claims description 4
- 238000006073 displacement reaction Methods 0.000 claims description 3
- 238000001914 filtration Methods 0.000 claims description 3
- 238000007781 pre-processing Methods 0.000 claims 2
- 230000007306 turnover Effects 0.000 description 7
- 238000012544 monitoring process Methods 0.000 description 5
- 230000008878 coupling Effects 0.000 description 4
- 238000010168 coupling process Methods 0.000 description 4
- 238000005859 coupling reaction Methods 0.000 description 4
- 238000013459 approach Methods 0.000 description 2
- 230000004888 barrier function Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 238000010295 mobile communication Methods 0.000 description 2
- 230000008901 benefit Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
Images
Landscapes
- Telephone Function (AREA)
Abstract
本发明的一种通过检测可拍照手机摄像头运动代替按键操作的方法，是通过检测可拍照手机上摄像头的不同运动距离、运动速度和运动方向等参数，把摄像头的不同运动参数与手机的相应按键操作相对应，以达到控制手机程序，从而实现摄像头的不同动作代表不同按键操作的目的，以取代手工按键操作。
A kind of method of replacing button operation by detecting the camera movement of the mobile phone that can take pictures of the present invention is to detect the parameters such as different movement distances, speeds and directions of movement of the camera on the mobile phone that can take pictures, and compare the different movement parameters of the camera with the corresponding keys of the mobile phone The operation is corresponding to achieve the purpose of controlling the mobile phone program, so that different actions of the camera represent different button operations, instead of manual button operations.
Description
Technical field
The invention belongs to mobile phone application and cell phone managing, mobile phone games and cell phone entertainment field, and relate in particular to a kind of by detecting the method for camera mobile phone cam movement replacing key-press operation.
Background technology
Along with the development of mobile phone technique, the function of mobile phone is also more and more abundanter.Except making a phone call, the application of mobile phone games and cell phone entertainment is also more and more, as online, listens song, plays games etc.Wherein button operation is the important means that present people use the mobile phone working procedure, and mobile phone key is mainly finished the program of opening, bolt down procedure, option program, executive program and finished data or the functions such as input of character.
In addition, application number is 200410155088, denomination of invention is a kind of how by the camera photographed data on the mobile phone and to the method for computer input for the Chinese patent application of " band camera mobile phone and to the method for computer inputting video data " discloses, thus but the camera head of substituting for computer.Application number is 200310108642, denomination of invention is a kind of for the Chinese patent application of " monitoring mobile phone multifunctional pick-up head " discloses is contained in the electrical equipment the inside with camera, by the method for mobile phone or computer remote monitoring circuit.Application number is 03128141, denomination of invention realizes the method that supervisory control is carried out at remote moving target, scene for the Chinese patent application of " multimedia message image alarm device " discloses a kind of multimedia message mobile phone that utilizes, promptly when the user wants to see that monitoring is on-the-spot, send an instruction note to warning device, warning device can instantaneous acquiring image and send back to the user at that time, or when changing at the monitoring scene, send the multimedia message image from the trend user mobile phone, realize reporting to the police.The above-mentioned relevant patent application that all belongs to cell-phone camera field or monitoring field, yet, do not occur at present making the operation of mobile phone and using more quick and easy and hommization more, and have more the technology that recreational and more convenient old man, child and individuals with disabilities use without barrier.
Summary of the invention
In view of above-mentioned, the object of the present invention is to provide a kind of by detecting the method for camera mobile phone cam movement replacing key-press operation, its method is by detecting the parameters such as different motion distance, movement velocity and the direction of motion of camera on the camera mobile phone, corresponding the different motion parameter of camera with the respective keys operation of mobile phone, to reach the control handset program, thereby the purpose of different key operation is represented in the difference action that realizes camera, to replace manual button operation.
To achieve these goals, of the present invention a kind of by detecting the method for camera mobile phone cam movement replacing key-press operation, comprise the steps:
Step 1: obtain video by the camera on the mobile phone, promptly when selected program brings into operation, start camera operation simultaneously on the backstage, finish shooting to site environment;
Step 2: the video sequence that obtains in the above-mentioned steps 1 is carried out preliminary treatment, carry out the frame of video in initial analysis and this video sequence of classification;
Step 3: utilize estimation and image tracking technique that above-mentioned video sequence is carried out the extraction of kinematic parameter, wherein above-mentioned kinematic parameter comprises one or more the parameter in the direction of motion, movement velocity, the move distance at least;
Step 4: move coupling, promptly the button operation that the kinematic parameter of said extracted and button are sorted out in the sequence is corresponding; For example the direction of motion is represented the direction options button of mobile phone, and movement velocity is represented digital input key, the handover operation between move distance representative program, as by numeral to the letter switching etc., can freely define here with convenient difference in functionality and the specific operation realized;
Step 5: by mobile camera mobile phone, mobile phone detects the kinematic parameter of camera automatically, carries out corresponding operation according to the different implications of its representative.
Wherein, the preliminary treatment of in the above-mentioned steps 2 video sequence being carried out comprises at least and adopts filtering, denoising and edge to strengthen one or more operation in the operation.
Above-mentioned steps 3 comprises the steps:
Step 301: in the first frame video, select object of reference, wherein can select the zone of video hub position 8 * 8 usually, but also can select other any suitable zones in this first frame video;
Step 302: in the second frame video, seek this object of reference The corresponding area, after finding, calculate the displacement and the direction of motion between itself and the first frame video, and then calculate the kinematic parameter of this object of reference; If in second frame, do not find the object of reference in first frame, can be zero or other parameters with all kinematic parameter assignment, promptly think and do not move.
Above-mentioned steps 3 keys comprise following two aspects:
1) choosing of object of reference: in order to guarantee the precision of parameter, select three objects of reference usually, be the zone of 8 * 8 sizes, and distribution triangular in shape; But also can select other any suitable zones, and it is distributed by any suitable mode;
2) coupling of object of reference:, can adopt one or more the method in motion estimation techniques and the three-step approach fast algorithm to realize coupling at least in order to improve matching speed and to guarantee precision.Wherein above-mentioned motion estimation techniques and three-step approach fast algorithm all have introduction in common video technical finesse teaching material and books.
Button in the above-mentioned steps 4 is sorted out sequence and is comprised following performing step:
Step 401: the button on the mobile phone of different styles and different model is extracted;
Step 402: the keypress function to the mobile phone of different model is analyzed, and analyzes the major function that its button is finished;
Step 403: by the analysis of 402 pairs of buttons of above-mentioned steps, know the function of its representative, it is sorted out, usually can be divided into numeric class, alphabetic class, selection class at least, confirm one or more the classification in the class;
Step 404: the content that button in the above-mentioned steps 403 is sorted out is ranked and is put in storage, and each class button is loaded in the database by the sequence number classification, forms button and sorts out sequence.
Certainly, under the in running order situation of the method for the invention (promptly replacing the mobile phone key operation) by the motion that detects camera, the user still wishes to return to by the mode of button to carry out relevant operation sometimes, this can be by on mobile phone, setting in advance " hot key " mode or the mode of special mobile phone motor pattern (as continuous several times fast moving up and down), clicking " hot key " or carrying out mobile phone special exercise pattern operation back and realize.
Adopt method of the present invention, it is not only in operation with use more quick and easy and hommization more, and has more recreational and more convenient old man, child and individuals with disabilities and use without barrier.And for the enforcement of the method for the invention, mobile phone producer can design after obtaining the method for the invention and realize voluntarily, and the problem that does not exist a pre-designed cover software to buy or install by mobile phone producer.In addition, mobile phone producer can be applied to method of the present invention in the management of any application of mobile phone.
Below in conjunction with accompanying drawing, the concrete enforcement of the method for the invention is described in further detail.For those skilled in the art that, from the detailed description to the inventive method, above-mentioned and other purposes of the present invention, feature and advantage will be apparent.
Description of drawings
Fig. 1 is the schematic diagram of the method for the invention.
Embodiment
Below in conjunction with accompanying drawing, the concrete enforcement of the method for the invention is described in further detail.
The method of the invention is by detecting the parameters such as different motion distance, movement velocity and the direction of motion of camera on the camera mobile phone, corresponding the different motion parameter of camera with the respective keys operation of mobile phone, reaching the control handset program, thereby realize the purpose that on behalf of different key, the difference action of camera operate.Because the diversity of move distance, movement velocity and the direction of motion of camera on the camera mobile phone, so on behalf of people, it can to a certain extent want the meaning of expressing, and can the instead of manual button.In the application process of camera mobile phone or in mobile communication application (3-G (Generation Three mobile communication system), i.e. 3G),, then can make the people feel to use more convenient and quick if people only can steering program by just moving of camera mobile phone.
Fig. 1 is the schematic diagram of the method for the invention.As shown in Figure 1, method of the present invention comprises the steps:
Step 1: obtain video by the camera on the mobile phone, promptly when selected program brings into operation, start camera operation simultaneously on the backstage, finish shooting to site environment;
Step 2: the video sequence that obtains in the above-mentioned steps 1 is carried out preliminary treatment, carry out initial analysis and sort out frame of video in this video sequence, wherein comprise at least and adopt filtering, denoising and edge to strengthen one or more operation in the operation;
Step 3: utilize estimation and image tracking technique above-mentioned video sequence to be carried out the extraction of kinematic parameter; Above-mentioned kinematic parameter comprises one or more the parameter in the direction of motion, movement velocity, the move distance at least; Wherein at first in the first frame video, select object of reference, wherein can select the zone of video hub position 8 * 8 usually, but also can select other any suitable zones in this first frame video; In the second frame video, seek this object of reference The corresponding area then, after finding, calculate the displacement and the direction of motion between itself and the first frame video, and then calculate the kinematic parameter of this object of reference; If in second frame, do not find the object of reference in first frame, can be zero or other parameters with all kinematic parameter assignment, promptly think and do not move;
Step 4: move coupling, promptly all button operations that the kinematic parameter of said extracted and button are sorted out in the sequence are corresponding; For example the direction of motion is represented the direction options button of mobile phone, and movement velocity is represented digital input key, the handover operation between move distance representative program, as by numeral to the letter switching etc., can freely define here with convenient difference in functionality and the specific operation realized;
Step 5: by mobile camera mobile phone, mobile phone detects the kinematic parameter of camera automatically, carries out corresponding operation according to the different implications of its representative.
Wherein, the button in the above-mentioned steps 4 is sorted out sequence and is comprised following performing step:
Step 401: the button on the mobile phone of different styles and different model is extracted;
Step 402: the keypress function to the mobile phone of different model is analyzed, and analyzes the major function that its button is finished;
Step 403: by the analysis of 402 pairs of buttons of above-mentioned steps, know the function of its representative, it is sorted out, usually can be divided into numeric class, alphabetic class, selection class at least, confirm one or more the classification in the class;
Step 404: the content that button in the above-mentioned steps 403 is sorted out is ranked and is put in storage, and each class button is loaded in the database by the sequence number classification, forms button and sorts out sequence.
For the enforcement of the method for the invention, mobile phone producer can design after obtaining the method for the invention and realize voluntarily, and the problem that does not exist a pre-designed cover software to buy or install by mobile phone producer.In addition, mobile phone producer can be applied to method of the present invention in the management of any application of mobile phone, for example be applied in the broadcast of mobile phone MP3 song, for example suppose that the mobile phone kinematic parameter (kinematic parameter can comprise direction, speed, distance etc.) and the defining relation of button are: mobile phone moves forward, and turns over button in the representative; Mobile phone moves backward, turns over button under the representative; Mobile phone moves right, and represents volume to increase button; Mobile phone is moved to the left, and represents volume to turn button down, and mobile phone moves upward and represents selection key (selection is and begins to play), and mobile phone moves downward, representative cancellation button (cancellation is and stops to play), and it mainly comprises following operation:
1) selects mobile phone MP3 play menu, unfolding mode keys available or method of the present invention (promptly detecting the method for cam movement); At this time mobile phone cam is in background work, and in the hypothesis mobile phone how first MP3 song arranged;
2) move mobile phone after, mobile phone moves after by the movement confirmation mobile phone that detects camera, then corresponding under turn over button, the cursor in the mobile phone display screen moves to next song position in the MP3 menu;
3) reach mobile phone, mobile phone be by detecting the movement confirmation mobile phone reach of camera, then corresponding on turn over button, the cursor in the mobile phone display screen moves to last one first song position in the MP3 menu;
4) mobile phone that moves to right, mobile phone moves to right by the movement confirmation mobile phone that detects camera, then transfers big key corresponding to volume, and mobile phone is transferred big broadcast sound volume automatically;
5) mobile phone that moves to left, mobile phone moves to left by the movement confirmation mobile phone that detects camera, then turns button down corresponding to volume, and mobile phone is turned broadcast sound volume automatically down.
6) move mobile phone on, mobile phone is by moving on the movement confirmation mobile phone that detects camera, and then corresponding to selection key, mobile phone is play the MP3 song of selection automatically;
7) move down mobile phone, mobile phone moves down by the movement confirmation mobile phone that detects camera, and then corresponding to the cancellation button, mobile phone stops to play the MP3 song.
The operation of mobile phone games for another example, be " driving an automobile that shows on the mobile phone screen " such as these mobile phone games, turn on having in the keyboard of this mobile phone, turn over down, turn on a left side, the four direction operation keys is turned on the right side (except numerical key and letter key, also having the button of upper and lower, left and right four direction on the keyboard of a lot of mobile phones).Before not adopting this method, the button operation of this recreation is: click upturning key, the operation automobile moves forward; Click downturning key, the operation automobile moves backward; Click a left side and turn over key, the operation automobile is turned left; Click the right side and turn over key, the operation automobile is turned right.After adopting this method, for example suppose that the defining relation of mobile phone kinematic parameter and button is: mobile phone moves forward, and upturning key is clicked in representative; Mobile phone moves backward, and downturning key is clicked in representative; Mobile phone moves right, and representative is clicked the right side and turned over key; Mobile phone is moved to the left, and representative is clicked a left side and turned over key.It mainly comprises following operation:
1) selects the recreation that drives a car in the mobile phone, unfolding mode keys available or method of the present invention (promptly detecting the method for cam movement); At this time mobile phone cam is in background work;
2) reach mobile phone, mobile phone be by detecting the movement confirmation mobile phone reach of camera, then corresponding on turn over button, automobile moves ahead;
3) move mobile phone after, mobile phone moves after by the movement confirmation mobile phone that detects camera, then corresponding under turn over button, back of automobile;
4) mobile phone that moves to right, mobile phone moves to right by the movement confirmation mobile phone that detects camera, then turns over button corresponding to the right side, and automobile is turned right;
5) mobile phone that moves to left, mobile phone moves to left by the movement confirmation mobile phone that detects camera, then turns over button corresponding to a left side, and automobile turns left.
More than describe operation principle of the present invention in detail, but the example of this visualization of just lifting for the ease of understanding should not be considered to be limitation of the scope of the invention.Equally; the ordinary skill of technical field all can be according to the description of technical scheme of the present invention and preferred embodiment thereof under any; make various possible being equal to and change or replacement, but all these changes or replacement all should belong to the protection range of claim of the present invention.
Claims (6)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2005100862428A CN100531248C (en) | 2005-08-17 | 2005-08-17 | Method for replacing key operation by detecting camera motion of camera phone |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2005100862428A CN100531248C (en) | 2005-08-17 | 2005-08-17 | Method for replacing key operation by detecting camera motion of camera phone |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1731793A true CN1731793A (en) | 2006-02-08 |
| CN100531248C CN100531248C (en) | 2009-08-19 |
Family
ID=35964088
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB2005100862428A Expired - Fee Related CN100531248C (en) | 2005-08-17 | 2005-08-17 | Method for replacing key operation by detecting camera motion of camera phone |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN100531248C (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2008092393A1 (en) * | 2007-01-25 | 2008-08-07 | Shanghai Yao Wei Industry Co, Ltd | Method of moving target tracking and number accounting |
| CN101247608B (en) * | 2008-03-10 | 2011-12-07 | 华为终端有限公司 | Method and device for self-adaptive adjusting camera parameter of terminal unit |
| CN101697199B (en) * | 2009-08-11 | 2012-07-04 | 北京盈科成章科技有限公司 | Detection method of head-face gesture and disabled assisting system using same to manipulate computer |
| CN102749994A (en) * | 2012-06-14 | 2012-10-24 | 华南理工大学 | Indicating method for motion direction and speed strength of gesture in interaction system |
| CN101622871B (en) * | 2007-02-27 | 2013-05-15 | 埃森哲环球服务有限公司 | Video Call Device Control |
| CN103777872A (en) * | 2012-10-24 | 2014-05-07 | 中国电信股份有限公司 | Mobile terminal and unlocking method thereof |
| CN103916519A (en) * | 2012-12-31 | 2014-07-09 | 上海证大喜马拉雅网络科技有限公司 | Method and system for realizing audio play through camera and gyroscope |
| CN104765959A (en) * | 2015-03-30 | 2015-07-08 | 燕山大学 | Computer vision based evaluation method for general movement of baby |
| WO2019100298A1 (en) * | 2017-11-23 | 2019-05-31 | 华为技术有限公司 | Photographing method and terminal |
-
2005
- 2005-08-17 CN CNB2005100862428A patent/CN100531248C/en not_active Expired - Fee Related
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2008092393A1 (en) * | 2007-01-25 | 2008-08-07 | Shanghai Yao Wei Industry Co, Ltd | Method of moving target tracking and number accounting |
| CN101231755B (en) * | 2007-01-25 | 2013-03-06 | 上海遥薇(集团)有限公司 | Moving target tracking and quantity statistics method |
| US8467778B2 (en) | 2007-02-27 | 2013-06-18 | Accenture Global Services Limited | Video call device control |
| CN101622871B (en) * | 2007-02-27 | 2013-05-15 | 埃森哲环球服务有限公司 | Video Call Device Control |
| CN101247608B (en) * | 2008-03-10 | 2011-12-07 | 华为终端有限公司 | Method and device for self-adaptive adjusting camera parameter of terminal unit |
| CN101697199B (en) * | 2009-08-11 | 2012-07-04 | 北京盈科成章科技有限公司 | Detection method of head-face gesture and disabled assisting system using same to manipulate computer |
| CN102749994A (en) * | 2012-06-14 | 2012-10-24 | 华南理工大学 | Indicating method for motion direction and speed strength of gesture in interaction system |
| CN102749994B (en) * | 2012-06-14 | 2016-05-04 | 华南理工大学 | The reminding method of the direction of motion of gesture and speed intensity in interactive system |
| CN103777872A (en) * | 2012-10-24 | 2014-05-07 | 中国电信股份有限公司 | Mobile terminal and unlocking method thereof |
| CN103916519A (en) * | 2012-12-31 | 2014-07-09 | 上海证大喜马拉雅网络科技有限公司 | Method and system for realizing audio play through camera and gyroscope |
| CN104765959A (en) * | 2015-03-30 | 2015-07-08 | 燕山大学 | Computer vision based evaluation method for general movement of baby |
| WO2019100298A1 (en) * | 2017-11-23 | 2019-05-31 | 华为技术有限公司 | Photographing method and terminal |
| US11843715B2 (en) | 2017-11-23 | 2023-12-12 | Huawei Technologies Co., Ltd. | Photographing method and terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| CN100531248C (en) | 2009-08-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN1187673C (en) | Method fo inputting information and equipment using said method | |
| CN1941982A (en) | A mobile communication terminal having multiple displays and a data processing method thereof | |
| DE202006020369U1 (en) | Multifunctional handheld device | |
| CN105657535A (en) | Audio recognition method and device | |
| CN110263729B (en) | A shot boundary detection method, model training method and related device | |
| CN1731793A (en) | A method of replacing button operation by detecting camera movement of a camera-capable mobile phone | |
| WO2010150893A1 (en) | Communication device and electronic device | |
| CN101038546A (en) | User interface method of multi-tasking and computer readable recording medium storing program for executing the method | |
| JP2007122496A (en) | Display information selection apparatus and method, program, and recording medium | |
| CN1955906A (en) | One key multi program execution method | |
| CN1592329A (en) | Portable terminal device and method and program for specifying function of portable terminal device | |
| CN105512220A (en) | Image page output method and device | |
| CN110007826A (en) | The mobile method and apparatus of voice control cursor | |
| CN101853076A (en) | Method for acquiring input information by input equipment | |
| CN1825901A (en) | Multimedia User Behavior Predictor | |
| JP5254137B2 (en) | Mobile communication device and communication device | |
| CN107566724B (en) | A panoramic image shooting method and mobile terminal | |
| CN1664755A (en) | Video recognition input system | |
| CN107092412A (en) | A kind of quick startup APP method and mobile terminal | |
| CN1199095C (en) | Touching input method and device with the functions of both right and left mouse keys | |
| CN1217521C (en) | Mobile communication electronic device and method for automatically simplifying function menu | |
| JP2011034149A (en) | Communication device and portable electronic device | |
| CN105528134A (en) | Hand-held apparatus, motion operation method and medium | |
| CN108418908A (en) | A kind of mobile phone right-hand man operates identification device and method | |
| CN105306665A (en) | Method for replacing key operations by intelligently detecting motion of camera |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| ASS | Succession or assignment of patent right |
Owner name: WANG WEIGUO Free format text: FORMER OWNER: SUN DAN; APPLICANT Effective date: 20070420 |
|
| C41 | Transfer of patent application or patent right or utility model | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20070420 Address after: 100044 Beijing city Xizhimen North Street No. 41 days trillion homes 4C501 Applicant after: Wang Weiguo Address before: 100044 Beijing city Xizhimen North Street No. 41 days trillion homes 4C501 Applicant before: Sun Dan Co-applicant before: Wang Weiguo |
|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C17 | Cessation of patent right | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20090819 Termination date: 20090817 |