TW201429217A - Cell phone with contact free controllable function - Google Patents

Abstract

The present invention is a cell phone with contact free controllable function having a body and a detecting module. The detecting module is connected integrally in the body and is used for detecting a reflected super-sonic wave and an image. The detecting module uses the reflected super-sonic wave and the image to define a location and movement of a hand of a user. The body may use the result of the location and movement to display a menu and control a curser, thus the user may control the cell phone without direct contact to a screen or uses vocal control.

Description

Mobile phone with non-contact hand control

The present invention is a mobile phone, and more particularly to a mobile phone that can achieve control purposes in a contactless manner.

Smart mobile phones are undoubtedly the fastest growing electronic products in recent years. Mobile phones are no longer mobile phones, but are mobile assistants, play equipment, information sources or navigation systems that many people must carry with them.

There are many ways to control smart mobile phones. Traditionally, there are keyboards and touches. Recently, many manufacturers are committed to developing voice control. A variety of control modes are available to meet the user's various needs, and users can more easily control smart mobile phones. However, the current touch form is easy to pollute the screen, and the sound control is not used in noisy environments, and the use is subject to many restrictions.

In order to solve the inconvenience and limitation caused by the control form of the smart mobile phone, the present invention controls the mobile phone with a non-contact hand, so that the user can change the menu without touching the screen or with sound control. And execute the application.

The invention provides a mobile phone with a non-contact hand control function In addition, the mobile phone host and the one-hand position determining module are integrated and installed on the mobile phone host. The hand position determining module uses ultrasonic waves, image output and reflection results to detect The mobile phone host changes the position and motion state of the user's palm and the mobile phone, and the mobile phone host changes the page content, the cursor position and the execution application displayed on the screen according to the detected positional relationship and the motion state. .

The positional relationship includes a distance relationship and a horizontal and vertical positional relationship, and the motion state includes at least a change in the distance relationship between the palms and a change in the change in the horizontal and vertical positional relationships.

The hand position determining module includes a menu control processing module and an ultrasonic transmitting circuit, an ultrasonic receiving circuit and a camera connected to the menu control processing module, and the ultrasonic receiving circuit receives the palm After the reflected ultrasonic wave, the mobile phone host determines the distance relationship and the motion state according to the path of the ultrasonic wave; the camera receives the image of the corresponding position of the palm, and the mobile phone host analyzes the partial image or specific part of the palm of the image. Obtaining a partial or vertical positional relationship, appearance or gesture of the partial image of the palm or a specific part.

The determining the position relationship and the motion state comprises: receiving the reflected ultrasonic wave and capturing the image; calculating the palm distance relationship according to the time difference of the reflected ultrasonic wave transmitted to the receiving path; determining the palm or the specific part according to the image analysis The palm is in a horizontal and vertical positional relationship, appearance and gesture; determining whether the distance relationship falls within a predetermined distance range; and outputting the distance relationship, the horizontal and vertical positional relationship, the motion state, and the gesture to The mobile phone host.

The mobile phone host changes the page content, the cursor position and the execution application represented by the screen according to the following steps: reading the distance relationship, the horizontal and vertical positional relationship, and the motion state; when the distance relationship falls within the specific distance range Displaying the distance range corresponding to one of the display pages, wherein the display page is one of the multi-page pages; continuously determining whether the distance relationship is continuously maintained in the distance range, and if the distance relationship exceeds the distance range, Switching to display different display pages; displaying a cursor on the screen according to the horizontal and vertical positional relationship, the position of the cursor corresponding to the horizontal and vertical positional relationship; determining whether the distance relationship performs a reciprocating movement within a specific time interval, and When the distance relationship generates the reciprocating movement, it is determined whether the cursor corresponds to one of the application options on the display page; and when the position of the cursor corresponds to the application option and the reciprocating movement is generated, the application option is executed.

As can be seen from the foregoing description, the present invention can achieve the function of selecting an application to be executed by selecting a single switch, and not only solving the shortcomings of existing contact control and sound control, but also greatly improving the future. The diversity and possibilities of mobile phone control.

10‧‧‧Mobile phone host

12‧‧‧ camera

20‧‧‧Hand position judgment module

21‧‧‧Menu Control Processing Module

22‧‧‧Supersonic transmitting circuit

23‧‧‧Supersonic receiving circuit

50‧‧‧ palm

The first figure is a schematic diagram of a system in accordance with a preferred embodiment of the present invention.

The second figure is a schematic diagram of the shooting range of the preferred embodiment of the present invention.

The third figure is a schematic diagram of the use of the preferred embodiment of the present invention.

The fourth figure is a schematic diagram of page switching usage according to a preferred embodiment of the present invention.

Figure 5 is a schematic illustration of the use of distance changes in accordance with a preferred embodiment of the present invention.

Figure 6 is a schematic view showing the flow of use of the preferred embodiment of the present invention

Figure 7 is a schematic diagram showing the control flow of a preferred embodiment of the present invention.

Please refer to the first to fourth figures, which are the mobile phone with the non-contact hand control function of the present invention, which comprises a mobile phone host 10 and a hand position determining module 20, and the hand position determining module 20 The integrated installation is on the mobile phone host 10. The hand position determining module 20 receives a positional relationship and a motion state of one of the palms of the user, and outputs the result to the mobile phone host 10, so that the mobile phone host 10 selects and outputs a menu page according to the positional relationship and the motion state. Control a cursor. The positional relationship includes a distance relationship (Z) between the hand position determining module 20 and the palm 50 and a horizontal and vertical positional relationship (X, Y), the motion state including at least a change in the distance relationship between the palms 50, and a horizontal longitudinal direction. Changes in positional relationship, changes in the shape of the palm posture.

The hand position determining module 20 of the embodiment is partially installed on the surface of the mobile phone host 10, and continuously receives the reflected ultrasonic wave of the output ultrasonic wave, and continuously captures the external image, thereby calculating and determining the position. Relationship, the state of the sport. The hand position determining module 20 includes a menu control processing module 21 and a signal transmitting circuit 22 connected to the menu control processing module 21, an ultrasonic wave transmitting circuit 22, an ultrasonic wave receiving circuit 23, and a camera 12, the ultrasonic wave After the receiving circuit 23 receives the ultrasonic wave reflected by the palm 50, the mobile phone host 10 determines that the ultrasonic wave is returned by the ultrasonic wave transmitting circuit 22 and returns to the path of the ultrasonic wave receiving circuit 23 to determine the path. The distance relationship and the motion state (as shown in the second to fourth figures), wherein the motion state sensed by the ultrasonic distance sensing module 22 means that the palm 50 changes with the ultrasonic distance sensing module 22 Distance relationship.

The camera 12 continuously captures the image of the palm 50 and stores the mobile phone host 10. The mobile phone host 10 can determine the horizontal and vertical positional relationship between the palm 50 and the light sensing module 23 according to the image; one of the cameras 12 The shooting range A is as shown in the second figure. When the palm 50 falls within the shooting range, the mobile phone main body 10 determines that the captured image determines the horizontal and vertical positional relationship of the palm 50.

Referring to FIG. 5 to FIG. 7 , the menu control processing module 21 controls the camera 12 and the ultrasonic distance sensing module 22 to capture images and receive reflected ultrasonic waves, and then determine the palm according to the image and the ultrasonic waves. The positional relationship and the state of motion of the mobile phone host 10 can be determined according to the following steps:

(1) Receive Image Signal/Receive Reflection Ultrasound: The menu control processing module 21 continuously receives the ultrasonic waves and images reflected by the palm 50.

(2) Capture (gesture) image: The menu control processing module 21 or the mobile phone host 10 separates and extracts a gesture image from the captured image. The gesture image can be captured by determining that the image includes a partial image corresponding to or similar to the shape of the palm 50. The method for comparing the appearance of the palm 50 can be obtained by using an image comparison method. For example, the mobile phone host 10 or the menu control processing module 21 determines whether the image is in the image by using a data stored in a database. Including the shape of the palm of the hand; in order to reduce the chance of misjudgment, the user's palm can be limited to 50 gestures, such as only the five-finger gesture, the gesture of extending the index finger, and the like.

The image recognition is performed: the menu control processing module 21 performs the detailed identification and analysis from the captured gesture image, thereby determining the hand image. The so-called image recognition may define a specific part of the gesture image (for example, a finger or a gesture) in a comparative manner, and find a horizontal and vertical coordinate position relationship (X, Y-axis coordinate) of the specific part in the shooting range A.

Further, before the image recognition is performed, a step of extracting a feature vector may be performed, which may be used as a part of the gesture change and the movement relationship, and the part of the gesture is converted into a feature vector, etc., thereby Image recognition and reduction of judgment errors or calculation speed.

(3) Calculating the Z-axis distance parameter by using the time difference: The menu control processing module 21 determines the distance relationship between the palm 50 and the ultrasonic distance sensing module 22 according to the time difference of the ultrasonic waves transmitted to the reflection. Since the wavelength of the ultrasonic wave is fixed, the distance between the palm 50 and the mobile phone main body 10 can be calculated by calculating the time difference between transmission and reception, as shown in the fifth figure. After the calculation of the Z-axis distance parameter is completed, the judgment of whether the signal is normal can be performed to reduce the occurrence of the error. The judgment of whether the signal is normal or not refers to whether the calculated Z-axis distance parameter falls within a reasonable range.

(4) Performing image recognition: The mobile phone host 10 or the option control processing module 21 performs detailed identification and analysis from the captured gesture image to determine the hand image. The so-called image recognition may define a specific part of the gesture image (for example, a finger or a gesture) in a comparative manner, and find a horizontal and vertical coordinate position relationship (X, Y-axis coordinate) of the specific part in the shooting range A.

(5) Calculating the X, Y, Z movement parameter/outlet combination judgment result by using the time difference: the menu control processing module 21 is based on the aforementioned ultrasonic reflection and The image calculates a movement parameter of the palm 50 and the mobile phone host 10, and the movement parameter includes the foregoing positional relationship and a motion state, wherein the positional relationship includes a distance relationship (Z-axis coordinate) and a horizontal and vertical positional relationship (X-axis coordinate, Y The axis coordinate) is the amount of change (ΔX/Δt, ΔY/Δt, ΔZ/Δt) of the distance relationship and the horizontal and vertical positional relationship in a specific time interval. In the aspect of the specific part of the image, after the menu control processing module 21 or the mobile phone host 10 obtains the image of the specific part, if the specific part includes a preset gesture combination, for example, the thumb and the index finger are straight but the remaining fingers are In the posture of the fist, the position and appearance of the gesture combination are continuously calculated, for example, the distance between the thumb and the index finger is changed.

(6) determining whether the Z-axis parameter exceeds a critical setting: the menu control processing module 21 determines that the distance relationship is within a preset distance range. As shown in the fourth figure, the menu control processing module 21 may preset a plurality of The distance range L1~L4, wherein the Z-axis coordinate of each distance range L1 is 5cm, and each distance range L1~L4 includes a spacing range (2cm). Thus, the menu control processing module 21 can determine the palm according to the determination. The distance relationship of 50 falls within this distance.

(7) Output X, Y, X movement parameters: The menu control processing module 21 outputs the sensed movement parameters, the determined distance range, and the result of the gesture appearance to the mobile phone host 10.

After the mobile parameter and distance range are sent to the mobile phone host 10, the mobile phone host 10 can present different page displays (menu), cursor positions, and execute function options on the page according to the received parameters. The steps of the mobile phone host 10 to perform display, change cursor coordinates, and execute function options may be as shown in the seventh figure, as follows:

(1) Reading the XYZ movement parameter: The mobile phone host 10 continuously receives the distance range, the movement parameter, and the gesture judgment result by the menu control processing module 21.

(2) Calculating the software interface level (Z direction): The mobile phone host 10 calculates the distance range in which the distance parameter is located.

(3) Whether to stay at a specific level: the mobile phone host 10 selects to display a display page by a multi-layer page according to the distance parameter, the distance range (the value of the Z-axis and the change state), wherein the multi-page page Each of the display pages corresponds to a range of distances. As shown in the sixth figure, when the distance between the palm 50 and the mobile phone host 10 is changed, different display pages can be continuously displayed on the screen. The mobile phone host 10 selects a display page corresponding to the distance range in which the distance parameter is located according to the value of the distance parameter, and the mobile phone host 10 continuously determines that the distance parameter continuously adjusts the displayed display page.

(4) The cursor is displayed at a specific level and moved according to the XY movement parameter: the mobile phone host 10 changes the position of the cursor displayed on the display page on the display page according to the horizontal and vertical positional relationship.

(5) Whether to change Z (reverse vibration) within a specific time interval: the mobile phone main body 10 judges the positional relationship and the motion state in the Z-axis direction, and determines whether the palm 50 reciprocates in a certain time interval against the Z-axis direction. If the determination is yes, proceed to the next step.

(6) Whether the cursor is in the selected function position (key position): the mobile phone host 10 determines whether the horizontal and vertical positional relationship is within one of the function application options in the display page, and when the judgment result is the horizontal and vertical position If the relationship overlaps the coordinate range of the feature application option, then proceed The next step.

(7) Execution function application: The mobile phone host 10 executes the function corresponding to the function application option.

Further, the mobile phone host 10 can perform a gesture determination result and perform a corresponding preset function action, for example, when the mobile phone host 10 is displaying an image photo and the gesture is such that the thumb and the index finger are extended. The mobile phone host 10 can control the functions of zooming in, reducing, rotating, and the like according to the distance or angle between the thumb and the index finger.

As can be seen from the foregoing description, the present invention can achieve the function of selecting an application to execute an application without switching through a direct touch of a finger, and not only solves the shortcomings of contact control and sound control, but also greatly enhances future actions. The diversity and possibilities of telephone control.

10‧‧‧Mobile phone host

12‧‧‧ camera

20‧‧‧Hand position judgment module

21‧‧‧Menu Control Processing Module

22‧‧‧Supersonic transmitting circuit

23‧‧‧Supersonic receiving circuit

Claims (9)

A mobile phone with a non-contact hand control function includes a mobile phone host and a hand position determination module. The hand position determination module is integrally installed on the mobile phone host, and the hand position determination module is Ultrasound, image output and reflection result, detecting and judging the positional relationship and motion state of a user's palm and the mobile phone, and the mobile phone host changes its screen according to the detected positional relationship and the motion state The rendered page content, cursor position, and execution application. The mobile phone with the non-contact hand control function according to claim 1, wherein the positional relationship includes a distance relationship and a horizontal and vertical positional relationship, the motion state including at least a change in the distance relationship between the palms and the horizontal and vertical directions. The change in positional relationship. For example, in the mobile phone with the non-contact hand control function described in claim 2, the hand position determination module includes a menu control processing module and one of the ultrasonic control signals connected to the menu control processing module. a circuit, an ultrasonic receiving circuit and a camera. After the ultrasonic receiving circuit receives the ultrasonic wave reflected by the palm, the mobile phone host determines the distance relationship and the motion state according to the path of the ultrasonic wave; the camera receives the palm Corresponding to the image of the location, the mobile phone host analyzes the partial image or specific part of the palm of the image to obtain a horizontal partial positional relationship, appearance or gesture of the palm local image or a specific part. The mobile phone with the non-contact hand control function described in claim 3, the positional relationship and the determining step of the motion state include: receiving the reflected ultrasonic wave and capturing the image; and transmitting the ultrasonic wave according to the reflection Calculate the palm of the hand to the time difference of the receiving path Distance relationship; analyzing the palm or a specific part according to the image, judging the positional relationship and appearance of the palm in the horizontal and vertical directions; judging whether the distance relationship falls within a predetermined distance range; and outputting the distance relationship, the horizontal and vertical positional relationship, and the motion state to The mobile phone host. The mobile phone with the non-contact hand control function described in claim 3, the positional relationship and the determining step of the motion state include: receiving the reflected ultrasonic wave and capturing the image; and transmitting the ultrasonic wave according to the reflection Calculate the distance of the palm from the time difference of the received path; analyze the palm or the specific part according to the image, determine the positional relationship, appearance and gesture of the palm in the horizontal and vertical directions; determine whether the distance relationship falls within a preset distance range; and output the distance relationship , horizontal and vertical positional relationship, motion status and gestures to the mobile phone host. According to the mobile phone with the non-contact hand control function described in claim 4 or 5, the mobile phone host changes the page content, the cursor position and the execution application displayed by the screen according to the following steps: reading distance a relationship, a horizontal and vertical positional relationship, and a motion state; when the distance relationship falls within the specific distance range, displaying the distance range corresponding to one of the display pages, wherein the display page is one of a multi-page page; Determining whether the distance relationship is continuously maintained in the distance range, and if the distance relationship exceeds the distance range, switching to display different display pages; Displaying a cursor according to the horizontal and vertical positional relationship on the screen, the position of the cursor corresponding to the horizontal and vertical positional relationship; determining whether the distance relationship performs a reciprocating movement within a specific time interval, and generating the reciprocating movement when the distance relationship is generated And determining whether the cursor corresponds to one of the application options on the display page; and when the position of the cursor corresponds to the application option and the reciprocating movement is generated, the application option is executed. According to the mobile phone with the non-contact hand control function described in claim 4 or 5, the mobile phone host changes the page content, the cursor position and the execution application displayed by the screen according to the following steps: reading distance a relationship, a horizontal and vertical positional relationship, a motion state, and a gesture feature; when the distance relationship falls within the specific distance range, displaying the distance range corresponding to one of the display pages, wherein the display page is one of a multi-layer page a page; continuously determining whether the distance relationship is continuously maintained in the distance range, and if the distance relationship exceeds the distance range, switching to display different display pages; displaying a cursor on the screen according to the horizontal and vertical position relationship, the position of the cursor is Corresponding to the horizontal and vertical positional relationship; determining whether the distance relationship performs a reciprocating movement within a specific time interval, and determining whether the cursor corresponds to one of the application options on the display page when the reciprocating movement is generated by the distance relationship; Execute when the position of the cursor corresponds to the application option and the reciprocating movement is generated With a program option; the generation of a particular state to change to the gesture, performs the preset functions of the movable Work. For example, in the mobile phone with the non-contact hand control function described in claim 7, the menu control processing module performs the change of the size of the display content according to the change of the judgment gesture. For example, in the mobile phone with the non-contact hand control function described in claim 7, the menu control processing module performs a change of the rotation angle of the display content according to the change of the judgment gesture.