TW201910897A - Object focusing device and method thereof - Google Patents

Abstract

An object focusing device and a method thereof are provided. The method includes: sensing a gesture of a user; displaying an object and the gesture of the user; determining whether the gesture of the user is a first gesture; generating a virtual target and displaying the virtual target at the location of the first gesture when the user's gesture is the first gesture; and when the location of the first gesture is adjacent to the location of the object and the gesture of the user is transformed from the first gesture to the other gesture, binding the virtual target to the object in order to focus the object.

Description

Object focusing device and method thereof

The present invention relates to an object focusing device and method, and more particularly to an object focusing device and method for focusing using a gesture.

When performing augmented reality or virtual reality functions using a head mounted immersive device (eg, Hololens from Microsoft), the user can typically focus on the objects displayed by the device and perform the functions of the object in focus. However, how to allow the user to accurately focus and perform the function of the object is one of the problems to be solved by those skilled in the art.

The invention provides an object focusing method and an object focusing device combined with gesture recognition, which can allow a user to generate a virtual center of mind to focus on an object, and perform the function of the focused object with another gesture after the focus is completed. Thereby, the user can accurately focus on the objects displayed on the device.

The invention provides an object focusing device, which comprises a sensing unit, a display unit and a processing unit. The sensing unit detects the gesture of the user. The display unit displays an object and a gesture of the user. The processing unit determines whether the gesture of the user is the first gesture. When the gesture of the user is the first gesture, the processing unit generates a virtual alignment and displays the position of the virtual alignment by the display unit by the display unit. When the position of the first gesture is adjacent to the position of the object and the processing unit determines that the gesture of the user changes from the first gesture to the other gesture, the processing unit binds the virtual alignment to the object to focus on the object.

In an embodiment of the invention, wherein in the operation of displaying a position that is virtually aligned with the first gesture, the display unit displays a virtual first alignment with the first position of the first gesture. When the first gesture moves from the first position to the second position, the display unit displays the virtual alignment to the second position.

In an embodiment of the invention, after the binding is virtually aligned with the operation of the object, the processing unit determines whether the gesture of the user is the second gesture. When the gesture of the user is the second gesture, the processing unit performs a function corresponding to the object.

In an embodiment of the invention, the processing unit determines whether the gesture of the user is a third gesture. When the gesture of the user is the third gesture, the processing unit generates a virtual eccentricity and displays, by the display unit, a line-of-sight focus position that is virtually aligned with the virtual line of sight of the user. When the line-of-sight focus position is adjacent to the position of the object and the processing unit determines that the gesture of the user is the second gesture, the processing unit performs a function corresponding to the object.

In an embodiment of the invention, the processing unit defines a virtual line of sight in a direction that is the same as a direction faced by the user's face with a midpoint of a horizontal line between the two eyes of the user, wherein the virtual line of sight is The horizontal lines are perpendicular and intersect at the midpoint of the horizontal line, and the line of sight focus is the position where the virtual line of sight intersects an object.

The invention provides an object focusing method. This object focusing method is used for an object focusing device. The method includes: detecting a gesture of the user; displaying an object and a gesture of the user; determining whether the gesture of the user is the first gesture; and when the gesture of the user is the first gesture, generating a virtual alignment and displaying the Virtually aligning with the position of the first gesture; and when the position of the first gesture is adjacent to the position of the object and the gesture of the user changes from the first gesture to the other gesture, binding the virtual focus to the object to focus on the object .

In an embodiment of the invention, the step of displaying the virtual centering position of the first gesture includes: displaying a virtual first alignment with the first position of the first gesture; and when the first gesture is moving from the first position to the second When positioned, the virtual alignment is displayed in the second position.

In an embodiment of the invention, after the step of binding the virtual focus to the object, the method further comprises: determining whether the gesture of the user is the second gesture. When the gesture of the user is the second gesture, the function corresponding to the object is performed.

In an embodiment of the invention, the method further includes: determining whether the gesture of the user is a third gesture; when the gesture of the user is the third gesture, generating a virtual alignment and displaying the virtual alignment by the display unit a line-of-sight focus position of the user's virtual line of sight; and when the line-of-sight focus position is adjacent to the position of the object and the processing unit determines that the gesture of the user is the second gesture, the processing unit performs a function corresponding to the object.

In an embodiment of the invention, the method further comprises: defining a virtual line of sight in a direction that is the same as a direction facing the face of the user, with a midpoint of a horizontal connection between the two eyes of the user, The virtual line of sight is perpendicular to the horizontal line of the operation and intersects at the midpoint of the horizontal line, and the line of sight focus position is the position where the virtual line of sight intersects with an object.

Based on the above, the object focusing method and the object focusing device proposed by the present invention allow the user to create a virtual center of gravity to focus on the object, and perform the function of the focused object with another gesture after the focus is completed. Thereby, the user can accurately focus on the objects displayed on the device. In addition, the object focusing method of the present invention can also allow the user to select the desired focusing mode by gesture, for example, focusing on the user's virtual line of sight. Thereby, the diversity of the focusing method can be achieved to enhance the user experience.

The above described features and advantages of the invention will be apparent from the following description.

FIG. 1 is a schematic diagram of an object focusing device according to an embodiment of the invention. Referring to FIG. 1 , the object focusing apparatus 100 may include a display unit 112 , a sensing unit 114 , and a processing unit 116 .

The display unit 112 is, for example, a display device that provides a display function such as a liquid crystal display (LCD), a light-emitting diode (LED), or a field emission display (FED).

The sensing unit 114 is, for example, a charge coupled device (CCD) lens, a complementary metal oxide semiconductor transistor (CMOS) lens, or a depth camera (Depth Camera, Time-Of-Flight Camera). ), Stereo Camera.

The processing unit 116 can be a central processing unit (CPU), or other programmable general purpose or special purpose microprocessor (Microprocessor), digital signal processor (DSP), programmable A controller, an Application Specific Integrated Circuit (ASIC) or other similar component or a combination of the above components.

In the present exemplary embodiment, the display unit 112 and the sensing unit 114 can be connected to the processing unit 116 by wire or wirelessly, respectively. In the present exemplary embodiment, the object focus device 100 may be a head mounted device (or an immersive device) and may be used to perform functions similar to the augmented reality or virtual reality of Hololens introduced by Microsoft.

In the present exemplary embodiment, the object focusing device 100 may further include a storage unit (not shown). The storage unit can be any type of fixed or removable random access memory (RAM), read-only memory (ROM), flash memory or the like. A combination of the above elements. In the present exemplary embodiment, a plurality of code segments are stored in the storage unit of the object focusing device 100, and are executed by the processing unit 116 after the code segments are installed. For example, the storage unit of the object focusing device 100 includes a plurality of modules, and each of the operations of the object focusing device 100 is performed by the modules, wherein each module is composed of one or more code segments. However, the present invention is not limited thereto, and the respective operations of the object focusing apparatus 100 may be implemented by using other hardware forms.

2 is a flow chart showing a method of using an object focusing device according to an embodiment of the invention. Here, the object focusing device 100 of Fig. 1 will be described.

Referring to FIG. 2, first, the sensing unit 114 can detect (or sense) a gesture of a user wearing the object focusing device 100 (step S201). In the exemplary embodiment, the sensing unit 114 may be an image capturing unit for capturing a gesture of the user. Meanwhile, the display unit 112 may display the gesture of the user captured by the sensing unit 114, and the processing unit 116 may determine whether the gesture of the user is the first gesture, the second gesture, or the third gesture (step S203).

In this exemplary embodiment, the first gesture, the second gesture, and the third gesture may be static or dynamic gestures that are different from each other. For example, the first gesture may be a gesture in which the user's hand grips but only extends the index finger, and the second gesture may be a gesture in which the user's hand grips but only extends the index finger and the middle finger, and the third gesture may be the user. The hand clenched the fist but only extended the gesture of the index finger, middle finger and ring finger. It should be noted, however, that the first gesture, the second gesture, and the third gesture are merely illustrative, and the present invention is not used to define gestures of the first gesture, the second gesture, and the third gesture.

When the processing unit 116 determines that the gesture of the user is the first gesture, the processing unit 116 may determine that the user will use the first gesture to focus on the object displayed by the object focusing apparatus 100 (step S205).

In particular, FIG. 3 is a schematic flow chart of a method for focusing an object using a first gesture according to an embodiment of the invention. 4A-4C are schematic diagrams of focusing an object using a first gesture according to an embodiment of the invention. The detailed process of the above step S205 can be explained by FIG. 3 and FIG. 4A to FIG. 4C.

Referring to FIG. 3 and FIG. 4A simultaneously, it is assumed that the display unit 112 displays the screen 400. The screen 400 includes a gesture 40 of the user detected by the sensing unit 114 and an object 42. When the processing unit 116 determines that the gesture 40 of the user is the first gesture, the processing unit 116 generates a virtual alignment 44 and displays the virtual alignment 44 at the position of the first gesture by the display unit 112 (step S301). Thereafter, the processing unit 116 determines whether the gesture 40 of the user remains as the first gesture and moves (step S303). When the user's gesture 40 remains as the first gesture and moves, the processing unit 116 continuously displays the generated virtual alignment 44 at the position of the user's gesture 40 to cause the virtual alignment 44 to simultaneously move with the first gesture. . That is, it is assumed that the display unit 112 initially displays the virtual center 44 at the first position where the first gesture is located, and when the first gesture moves from the first position to the second position, the display unit 112 also displays the virtual The center of gravity 44 is in the second position.

Next, please refer to FIG. 3, FIG. 4B to FIG. 4C at the same time. In FIG. 4B, it is assumed that the user maintains the first gesture and moves the hand to the position adjacent to the object 42. When the position of the first gesture is adjacent to the position of the object 42 and the gesture of the user changes from the first gesture to the other gesture, the processing unit 116 determines that the gesture of the user changes from the first gesture to the other gesture (step S305). At this time, the processing unit 116 binds the virtual alignment 44 to the object 42 to focus on the object 42 (step S307), as shown in FIG. 4C. When the virtual alignment 44 is bound to the object 42, the user does not affect the position of the virtual alignment 44 if the user performs another gesture or the user's gesture is not within the sensing range of the sensing unit 114.

After that, referring to FIG. 2 again, after the virtual alignment 44 is bound to the object 42, the processing unit 116 can determine again whether the gesture captured (or detected) by the sensing unit 114 is the first gesture, and the second. Gesture or third gesture. At this time, when the processing unit 116 determines that the gesture of the user is the second gesture, since the virtual centering 44 has been bound to the object 42, the processing unit 116 can perform the function corresponding to the object 42 (step S207).

In particular, since the object focusing device of the present invention can be a head mounted device that is worn on the user's head, the object focusing method of the present invention can also simulate the function of focusing with the user's line of sight. Specifically, if the processing unit 116 determines that the gesture captured (or detected) by the sensing unit 114 is the third gesture, the processing unit 116 may determine that the user will focus on the object displayed by the object focusing device 100 by the line of sight. (Step S209). In detail, after detecting the third gesture, the processing unit 116 generates a virtual alignment and displays a line-of-sight focus position that is virtually aligned with the user's line of sight (also referred to as a virtual line of sight) by the display unit 112. Wherein, the processing unit 116 defines a virtual line of sight whose direction is the same as the direction faced by the user's face by a midpoint of a horizontal line between the two eyes of the user, and the virtual line of sight is connected with the above-mentioned horizontal line. The lines are vertical and intersect at the midpoint of the above horizontal connection. The above-mentioned line-of-sight focusing position is a position at which the virtual line of sight intersects an object in a field of view.

It is assumed that the above-described line-of-sight focus position is adjacent to the position of the object 42 as in FIGS. 4A to 4C, for example, as shown in FIG. 4C. At the same time, if the processing unit 116 determines that the gesture of the user is the second gesture described above, the processing unit 116 performs a function corresponding to the object 42.

FIG. 5 is a flow chart of a method for focusing an object according to an embodiment of the invention.

Referring to FIG. 5, in step S501, the sensing unit 114 detects a gesture of the user. In step S503, the display unit 112 displays an object and a gesture of the user. In step S505, the processing unit 116 determines whether the gesture of the user is the first gesture. When the gesture of the user is the first gesture, in step S507, the processing unit 116 generates a virtual eccentricity and displays a position that is virtually aligned with the first gesture. When the position of the first gesture is adjacent to the position of the object and the gesture of the user changes from the first gesture to the other gesture, in step S509, the processing unit 116 binds the virtual alignment to the object to focus on the displayed object.

In summary, the object focusing method and the object focusing device proposed by the present invention allow the user to generate a virtual center of gravity to focus on the object, and perform the function of the focused object with another gesture after the focus is completed. Thereby, the user can accurately focus on the objects displayed on the device. In addition, the object focusing method of the present invention can also allow the user to select the desired focusing mode by gesture, for example, focusing on the user's virtual line of sight. Thereby, the diversity of the focusing method can be achieved to enhance the user experience.

Although the present invention has been disclosed in the above embodiments, it is not intended to limit the present invention, and any one of ordinary skill in the art can make some changes and refinements without departing from the spirit and scope of the present invention. The scope of the invention is defined by the scope of the appended claims.

100‧‧‧object focusing device

112‧‧‧Display unit

114‧‧‧Sensor unit

116‧‧‧Processing unit

S201‧‧‧Steps to detect the user's gesture

S203‧‧‧ Steps of determining whether the user's gesture is the first gesture, the second gesture, or the third gesture

S205‧‧‧Steps for focusing using the first gesture

S207‧‧‧Steps for performing the function of the object in focus

S209‧‧‧Steps for focusing with virtual line of sight

S301‧‧‧Steps to create a virtual alignment and display the virtual alignment to the position of the first gesture

S303‧‧‧Steps for determining whether the first gesture is moving

S305‧‧‧ When the position of the first gesture is adjacent to the position of the object, the step of determining whether the gesture of the user changes from the first gesture to the other gesture

S307‧‧‧Steps for binding virtual alignments to objects

400‧‧‧ screen

40‧‧‧ gestures

42‧‧‧ objects

44‧‧‧virtual alignment

S501‧‧‧Steps to detect the user's gesture

S503‧‧‧Steps for displaying objects and user gestures

S505‧‧‧Steps for determining whether the user's gesture is the first gesture

S507‧‧‧ When the user's gesture is the first gesture, the step of generating a virtual alignment and displaying the virtual alignment to the position of the first gesture

S509‧‧‧ When the position of the first gesture is adjacent to the position of the object and the gesture of the user changes from the first gesture to the other gesture, the step of binding the virtual focus to the object to focus on the object

FIG. 1 is a schematic diagram of an object focusing device according to an embodiment of the invention. 2 is a flow chart showing a method of using an object focusing device according to an embodiment of the invention. FIG. 3 is a schematic flow chart of a method for focusing an object using a first gesture according to an embodiment of the invention. 4A-4C are schematic diagrams of focusing an object using a first gesture according to an embodiment of the invention. FIG. 5 is a flow chart of a method for focusing an object according to an embodiment of the invention.

Claims (10)

An object focusing device includes: a sensing unit that detects a gesture of a user; a display unit that displays an object and a gesture of the user; and a processing unit that determines whether the gesture of the user is a first a gesture, wherein when the gesture of the user is the first gesture, the processing unit generates a virtual alignment and displays the position of the virtual alignment by the display unit by the display unit, when the position of the first gesture Adjacent to the location of the object and the processing unit determines that the gesture of the user changes from the first gesture to the other gesture, the processing unit binds the virtual alignment to the object to focus on the object. The object focusing device of claim 1, wherein in the operation of displaying the position of the virtual centering of the first gesture, the display unit displays the virtual centering at a first position of the first gesture And when the first gesture moves from the first position to a second position, the display unit displays the virtual alignment to the second position. The object focusing device of claim 1, wherein the processing unit determines whether the gesture of the user is a second gesture after binding the virtual alignment to the operation of the object, and when the use When the gesture of the person is the second gesture, the processing unit performs a function corresponding to the object. The object focusing device of claim 1, wherein the processing unit determines whether the gesture of the user is a third gesture, and when the gesture of the user is the third gesture, the processing unit generates the virtual Aligning and displaying, by the display unit, a virtual line of sight of a virtual line of sight of the user, when the line of sight position is adjacent to the position of the object and the processing unit determines that the user's gesture is one In the second gesture, the processing unit performs a function corresponding to the object. The object focusing device of claim 4, wherein the processing unit defines a direction equal to a face of the user's face with a midpoint of a horizontal line between the two eyes of the user. The virtual line of sight of the direction, wherein the virtual line of sight is perpendicular to the horizontal line and intersects at a midpoint of the horizontal line, and the line of sight focus position is a position at which the virtual line of sight intersects an object. An object focusing method for an object focusing device, the method comprising: detecting a user's gesture; displaying an object and the user's gesture; determining whether the user's gesture is a first gesture; When the gesture of the user is the first gesture, generating a virtual alignment and displaying the position of the virtual alignment to the first gesture; and when the position of the first gesture is adjacent to the position of the object and the gesture of the user When the first gesture is changed to other gestures, the virtual binding is bound to the object to focus on the object. The object focusing method of claim 6, wherein displaying the virtual centering position of the first gesture comprises: displaying the virtual centering at a first position of the first gesture; and when When the first gesture moves from the first position to the second position, the virtual alignment is displayed in the second position. The object focusing method of claim 6, wherein after the step of binding the virtual centering to the object, the method further comprises: determining whether the gesture of the user is a second gesture; When the gesture of the user is the second gesture, a function corresponding to the object is performed. The object focusing method of claim 6, further comprising: determining whether the gesture of the user is a third gesture; when the gesture of the user is the third gesture, generating the virtual alignment and displaying The virtual focus is on a line of sight focus position of a virtual line of sight of the user; and when the line of sight focus position is adjacent to the position of the object and the gesture of the user is a second gesture, performing corresponding to the object Features. The object focusing method according to claim 9, further comprising: defining a direction that is the same as a direction of the user's face with a midpoint of a horizontal line between the two eyes of the user The virtual line of sight, wherein the virtual line of sight is perpendicular to the horizontal line and intersects at a midpoint of the horizontal line, and the line of sight focus position is a position where the virtual line of sight intersects an object.