CN103295028A - Gesture operation control method, gesture operation control device and intelligent display terminal - Google Patents

Abstract

The invention discloses a gesture operation control method, device and intelligent display terminal. The method includes: collecting image information of an operator; identifying the identity of the operator according to the image information of the operator, and obtaining the identity information of the operator; Look up the preset distance matching table, obtain the effective gesture operation distance of the operator relative to the terminal and remind the operator. The invention enables the gesture control system to automatically remind the operator of the effective distance from the intelligent display terminal, which not only improves the accuracy of the gesture control system for the operator's gesture recognition, but also prevents the operator from causing operational damage; in addition, according to the obtained operator image Information to search the gesture recognition function table, and adjust the corresponding functions of the terminal according to the search results, so as to realize the purpose of controlling the TV functions through the operator's gesture operation.

Description

Gesture operation control method, device and intelligent display terminal

technical field

The present invention relates to the technical field of intelligent remote control, in particular to a gesture operation control method, device and intelligent display terminal.

Background technique

With the increasing advancement of global TV digitization, more and more consumer electronic devices have appeared, such as Pad, DVD, digital TV, audio and air conditioners; and for various electronic devices, there have also been various Intelligent remote control system, such as TV intelligent remote control, air conditioner remote control, mobile phone as remote control, IPAD as remote control system, etc.

At present, the modes of remote control of TV mainly include: infrared TV remote control, remote control input similar to a mouse, remote control handwriting input using tablet, etc. control. In order to improve the quality of life, increase the humanization of intelligent systems, and allow users to control intelligent terminals more conveniently, gesture control technology has emerged.

Gesture control technology is characterized by controlling terminal devices such as TVs through the operator's hand movements (such as waving), such as switching TV channels, adjusting volume, etc., thereby eliminating the need to find and operate the remote control. Free yourself from the dependence on the remote control, and control the TV with a wave of your hand.

However, in the current gesture control technology, when the user performs a gesture action, the TV terminal cannot remind the user to keep an effective distance from the TV. For example, if a child or family member at home does not remind him whether the current gesture control distance is correct, it is easy for the user to be too close to the TV during gesture operation, resulting in the following two problems:

First, cause the gesture recognition system to recognize incorrectly, for example: the user is too close to the camera, and the camera cannot obtain the user's gesture picture, resulting in the system being unable to correctly recognize the user's gesture;

Second, the user's hands will touch the TV, causing hand injuries; for example: the TV is placed on the cabinet in the living room, and the children see their parents making gestures and imitate them by themselves. Since the children are very close to the TV, they will slap when they wave On TV, causing hand injuries, etc.

Contents of the invention

The main purpose of the present invention is to provide a gesture operation control method, device and intelligent display terminal, aiming at improving the recognition accuracy of gesture actions by the gesture control system and avoiding operation injuries caused by users.

In order to achieve the above object, the present invention proposes a gesture operation control method, including:

Collect operator image information;

identifying the identity of the operator according to the image information of the operator, and obtaining the identity information of the operator;

Search the preset distance matching table according to the identity information of the operator, obtain the effective gesture operation distance of the operator relative to the terminal, and remind the operator.

Preferably, after the step of collecting the image information of the operator, the step further includes:

Perform size truncation, color conversion and/or denoising processing on the operator image information.

Preferably, the step of identifying the operator's identity information according to the operator's image information includes:

Obtaining the operator's profile picture information from the operator's image information;

According to the avatar information of the operator, a preset image library is searched to obtain the identity information of the operator.

Preferably, after the step of collecting the image information of the operator, the step further includes:

Judging whether the operator's current gesture action is an operator's operation instruction according to the operator image information; if so, performing a step of identifying the operator's identity information according to the operator image information; otherwise, not processing.

Preferably, the step of judging whether the operator's current gesture action is an operator's operation instruction according to the operator's image information includes:

Construct a human body model by means of multi-target tracking;

Perform trajectory discrimination and dynamic gesture recognition on the operator image information based on the human body model;

If the current operator image information is the operator's gesture feature data, it is determined that the current gesture action is an operator's operation instruction; otherwise, it is an operator's misoperation.

Preferably, after the step of obtaining the effective gesture operation distance of the operator relative to the terminal and reminding the operator, the step further includes:

Search the preset gesture recognition function table according to the operator's image information, and adjust the corresponding functions of the terminal according to the search results.

Preferably, before the step of collecting image information of the operator, the step further includes:

Configure the distance matching table and the gesture recognition function table.

The present invention also proposes a gesture operation control device, including:

The collection module is used to collect image information of the operator;

An identification module, configured to identify the identity of the operator according to the image information of the operator, and obtain the identity information of the operator;

The obtaining reminder module is used to search a preset distance matching table according to the identity information of the operator, obtain the effective gesture operation distance of the operator relative to the terminal, and remind the operator.

Preferably, the device also includes:

A processing module, configured to perform size truncation, color conversion and/or denoising processing on the operator image information.

Preferably, the identification module is further configured to obtain the operator's profile picture information from the operator's image information; search a preset image library according to the operator's profile picture information, and obtain the operator's identity information.

Preferably, the device also includes:

A judging module, configured to judge whether the operator's current gesture action is an operator's operation instruction according to the operator's image information; if so, the identification module identifies the operator's identity information according to the operator's image information; otherwise, No processing.

Preferably, the judging module is also used to construct a human body model in a multi-target tracking manner; perform trajectory discrimination and dynamic gesture recognition on the operator image information based on the human body model; if the current operator image information is the operator's gesture feature data, it is determined that the current gesture action is an operator's operation instruction; otherwise, it is an operator's misoperation.

Preferably, the device also includes:

The execution module is used to search the preset gesture recognition function table according to the operator's image information, and correspondingly adjust the corresponding functions of the terminal according to the search results.

Preferably, the device also includes:

A configuration module, configured to configure the distance matching table and the gesture recognition function table.

The present invention also proposes an intelligent display terminal, including the above-mentioned device.

A gesture operation control method, device, and intelligent display terminal proposed by the present invention obtain the operator's identity information by collecting operator image information; identifying the operator's identity information according to the operator's image information; The distance matching table obtains the effective gesture operation distance of the operator from the terminal and reminds the operator, so that the gesture control system can automatically remind the operator of the effective distance from the smart display terminal, which not only improves the gesture control system’s ability to recognize the operator’s gesture actions Accuracy, but also to avoid operator injury.

Description of drawings

FIG. 1 is a schematic flowchart of the first embodiment of the gesture operation control method of the present invention;

FIG. 2 is a schematic flowchart of a second embodiment of the gesture operation control method of the present invention;

FIG. 3 is a schematic flowchart of a third embodiment of the gesture operation control method of the present invention;

FIG. 4 is a schematic flowchart of a fourth embodiment of the gesture operation control method of the present invention;

Fig. 5 is a schematic flowchart of a fifth embodiment of the gesture operation control method of the present invention;

Fig. 6 is a schematic structural diagram of the first embodiment of the gesture operation control device of the present invention;

Fig. 7 is a schematic structural diagram of the second embodiment of the gesture operation control device of the present invention;

Fig. 8 is a schematic structural diagram of the third embodiment of the gesture operation control device of the present invention;

FIG. 9 is a schematic structural diagram of a fourth embodiment of the gesture operation control device of the present invention;

Fig. 10 is a schematic structural diagram of a fifth embodiment of the gesture operation control device of the present invention.

In order to make the technical solution of the present invention clearer and clearer, it will be further described below in conjunction with the accompanying drawings.

Detailed ways

As shown in Figure 1, the first embodiment of the present invention proposes a gesture operation control method, including:

Step S101, collecting image information of the operator;

The operating environment of the method in this embodiment involves a gesture control system of an intelligent display terminal, wherein the intelligent display terminal may be a display device such as a smart TV, and this embodiment uses a TV as an example for illustration.

The operating software of the above-mentioned gesture control system can be installed on the TV to identify the distance status of the gesture operator facing the TV, and perform corresponding analysis to remind the operator to adjust the correct distance relative to the TV, that is, the effective distance, so as to realize the control of the TV. Gesture control for TV related functions.

Firstly, the image information of the operator is collected. The operator can perform gesture operations by waving his hand in front of the TV, and send a remote control command to the TV system to control the TV to perform corresponding function adjustments, such as adjusting the volume of the TV.

The TV gesture control system can capture the operator's gesture operation through the camera installed on the TV, and obtain the operator's image information, the operator's image information can include the image information of the operator's head, shoulders and arm parts, thus User gestures can be captured.

Step S102, identifying the identity of the operator according to the image information of the operator, and obtaining the identity information of the operator;

After the TV gesture control system captures the operator's image information, it obtains the operator's head information, and matches the head information with the preset image library to obtain the operator's identity information. The preset image library stores corresponding head information according to different operator identities, such as the head information of grandpa, grandma, father and mother, children, etc., so according to the captured current head information of the operator The identity information of the operator can be matched and identified by searching the above-mentioned preset image library.

Step S103, searching a preset distance matching table according to the identity information of the operator, obtaining the effective gesture operation distance of the operator relative to the terminal, and reminding the operator.

In this embodiment, operators of different identities are pre-set with their own effective operating distances relative to the TV. For example, grandpa needs to stand at a distance of 1-2 meters to perform gesture operations, etc., and the operator identity information and the respective effective distances The corresponding relationship between is stored in a distance matching table, as shown in Table 1 below.

Table 1

When in use, the operator can configure the corresponding distance value according to the system setting options before performing the gesture operation, or use the default recommended reference value of the system, and store the data in the above distance matching table after configuration.

When the operator performs a gesture operation and recognizes the identity of the operator, the preset distance matching table is searched according to the identity information of the operator, and the effective gesture operation distance of the operator relative to the terminal is obtained by matching, and the distance The value is displayed to the operator, which can remind the operator of the correct gesture operation distance relative to the TV. After the operator sees the distance value displayed on the TV screen, if the current distance does not meet the display distance requirements, he can adjust himself relative to the TV. The effective distance of the TV screen. For example, it is set that the grandfather needs to stand at a distance of 1-2 meters to perform gesture operations. If the grandfather stands at a distance of 2 meters, after seeing the effective distance displayed on the screen, the grandfather adjusts the distance to the effective range of 1-2 meters to Improve the recognition accuracy of gesture operations. For another example, if the effective distance of the son is set to 1 meter, the son can keep the effective distance from the TV screen according to the reminder information on the TV screen when performing gesture operations, which not only improves the recognition accuracy of gesture operations, but also avoids If you are too close to the TV, your hands will touch the TV and cause hand injuries.

In this embodiment, the operator's image information of the operator is collected through the above-mentioned scheme; the operator's identity is identified according to the operator's image information to obtain the operator's identity information; according to the operator's identity information, the preset distance matching table is searched to obtain the operation The effective gesture operation distance of the operator relative to the terminal is displayed to the operator, so that the gesture control system can automatically remind the operator of the effective distance relative to the intelligent display terminal, which not only improves the accuracy of the gesture control system for the operator's gesture recognition, but also avoids the operator Cause handling injury.

As shown in FIG. 2 , the second embodiment of the present invention proposes a gesture operation control method. On the basis of the above first embodiment, after the above step S101, it also includes:

Step S104, performing size truncation, color conversion and/or denoising processing on the operator image information.

The difference between this embodiment and the above-mentioned first embodiment is that, after the gesture control system in this embodiment captures the image information of the operator, it needs to perform corresponding processing on the image information of the operator.

Specifically, after capturing the operator's operation information, it is necessary to analyze the information, such as processing the operator's head and shoulder data, and setting the size of the operator's image to a suitable calculation size; Color conversion of the original image, such as processing RGB 24bit to 8bit gray scale; at the same time, denoising processing is performed on the image data to remove interference. Among them, the denoising method can be realized by selecting a low-pass filter.

In this embodiment, the accuracy of the image information data of the operator can be improved through the above solution, thereby providing a more accurate data source for subsequent gesture operation recognition, and further improving the accuracy of the gesture control system for operator gesture recognition.

As shown in FIG. 3 , the third embodiment of the present invention proposes a gesture operation control method. On the basis of the above-mentioned second embodiment, after the above-mentioned step S104, it also includes:

Step S105, judge according to the operator's image information whether the operator's current gesture action is the operator's operation command; if so, enter step S102, otherwise, do not process, and exit the process.

The difference between this embodiment and the above-mentioned second embodiment is that, after the gesture control system of this embodiment collects the operator image information of the operator and performs corresponding processing, it also needs to judge whether the information is the operator's gesture operation instruction .

Specifically, when judging, the following methods can be used:

Firstly, the human body model is constructed by means of multi-target tracking;

Among them, the multi-eye tracking method can use the joint probabilistic data association filter (JPDAF), the multi-hypothesis tracking (MHT) algorithm, and the dynamic multi-bit allocation algorithm, etc. The above-mentioned various algorithms can use existing mature solutions, and will not be repeated here. .

Using the method of multi-target tracking, the corresponding targets are found for these gesture moving objects, and the human body model is established for the effective targets of the hand characteristics of the operator's human body parts according to these trajectory symbols.

In the multi-target human body model, each effective target corresponds to a corresponding space-time trajectory, and the effective targets have the characteristics of continuity, and different targets have their own different forms of expression. For example a gesture target exhibits a span of motion.

Then, based on the human body model, trajectory discrimination and dynamic gesture recognition are performed on the operator image information; if the current operator image information is the operator's gesture feature data, then the current gesture action is the operator's operation instruction; otherwise, it is the operation instruction. operator's misuse.

Through the above solution, this embodiment can accurately identify whether the operator's gesture operation is an operation command that the operator needs to perform, thereby effectively eliminating the operator's misoperation, and further improving the recognition of the operator's gesture action by the gesture control system. precision.

As shown in FIG. 4 , the fourth embodiment of the present invention proposes a gesture operation control method. On the basis of the above third embodiment, after the above step S103, it also includes:

Step S106, searching a preset gesture recognition function table according to the operator's image information, and correspondingly adjusting corresponding functions of the terminal according to the search result.

The difference between this embodiment and the above-mentioned third embodiment is that this embodiment also includes a scheme that the system adjusts corresponding functions according to the operator's gesture operation.

Specifically, in this embodiment, corresponding terminal adjustment functions are matched in advance according to different gesture operations of the operator, and a gesture recognition function table is established based on this corresponding relationship. For example, waving in the horizontal direction means adjusting the volume of the TV. It means to increase the volume, and waving to the right means to decrease the volume, for example, when the gesture moves 20cm from left to right, the volume adjustment will be increased by one unit, and so on.

When the TV gesture control system recognizes that the operator's gesture operation is a normal operation instruction, it will call the corresponding function. First, it will search the preset gesture recognition function table according to the acquired operator image information, and correspond to the corresponding function according to the search result. Adjust the corresponding functions of the terminal. In this way, the purpose of controlling the functions of the TV through the operator's gesture operation is realized.

As shown in FIG. 5 , the fifth embodiment of the present invention proposes a gesture operation control method. On the basis of the above-mentioned fourth embodiment, before the above-mentioned step S101, it also includes:

Step S100, configuring the distance matching table and gesture recognition function table.

The difference between this embodiment and the foregoing fourth embodiment is that this embodiment also includes a solution for configuring the distance matching table and the gesture recognition function table.

Specifically, the operator can configure the distance matching table and the gesture recognition function table according to the system setting options. For example, the TV gesture control system can set a gesture operation prompt menu, and remind the operator of the correct distance range and gesture recognition through the gesture operation prompt menu. corresponding function options.

This embodiment configures the distance matching table and the gesture recognition function table through the above scheme, and collects the image information of the operator; identifies the identity of the operator according to the image information of the operator, and obtains the identity information of the operator; searches for the distance according to the identity information of the operator. The matching table obtains the effective gesture operation distance of the operator relative to the terminal and displays it to the operator, so that the gesture control system can automatically remind the operator of the effective distance from the intelligent display terminal, which not only improves the recognition accuracy of the gesture control system for the operator's gesture action , and prevent the operator from causing operation damage; in addition, according to the obtained operator image information, the gesture recognition function table is searched, and the corresponding functions of the terminal are adjusted according to the search results, so as to realize the purpose of controlling the TV function through the operator's gesture operation.

As shown in FIG. 6, the first embodiment of the present invention proposes a gesture operation control device, including: a collection module 201, an identification module 202, and an acquisition reminder module 203, wherein:

A collection module 201, configured to collect image information of the operator;

An identification module 202, configured to identify the identity of the operator according to the image information of the operator, and acquire the identity information of the operator;

The acquisition and display module 203 is configured to search a preset distance matching table according to the identity information of the operator, acquire the effective gesture operation distance of the operator relative to the terminal, and remind the operator.

The gesture operation control device in this embodiment can be set on the intelligent display terminal as the gesture control system of the intelligent display terminal, which is used to identify the distance state of the gesture operator facing the TV, and perform corresponding analysis to remind the operator to adjust the relative distance. The correct distance of the TV, that is, the effective distance, so as to realize the gesture control of the TV related functions.

The smart display terminal described herein may be a display device such as a smart TV, and this embodiment uses a TV as an example for illustration.

First, the collection module 201 collects image information of the operator. The operator can perform gesture operations by waving his hand in front of the TV, and send a remote control command to the TV system to control the TV to perform corresponding function adjustments, such as adjusting the volume of the TV.

The TV gesture control system can capture the operator's gesture operation through the camera installed on the TV, and obtain the operator's image information, which can include the image information of the operator's head, shoulders and arm parts.

After the TV gesture control system captures the image information of the operator, it obtains the head information of the operator through the identification module 202, and matches the head information with the preset image library to obtain the identity information of the operator. The preset image library stores corresponding head information according to different operator identities, such as the head information of grandpa, grandma, father and mother, children, etc., so according to the captured current head information of the operator The identity information of the operator can be matched and identified by searching the above-mentioned preset image library.

In this embodiment, operators of different identities are pre-set with their own effective operating distances relative to the TV. For example, grandpa needs to stand at a distance of 1-2 meters to perform gesture operations, etc., and the operator identity information and the respective effective distances The corresponding relationship between is stored in a distance matching table, as shown in Table 1 above.

When in use, the operator can configure the corresponding distance value according to the system setting options before performing the gesture operation, or use the default recommended reference value of the system, and store the data in the above distance matching table after configuration.

When the operator performs a gesture operation and recognizes the identity of the operator, the obtaining reminder module 203 searches the preset distance matching table according to the identity information of the operator, and obtains the effective gesture operation distance of the operator relative to the terminal through matching, And display the distance value to the operator, so as to remind the operator of the correct gesture operation distance relative to the TV. After the operator sees the distance value displayed on the TV screen, if the current distance does not meet the display distance requirements, it can be Adjust your effective distance relative to the TV screen. For example, it is set that the grandfather needs to stand at a distance of 1-2 meters to perform gesture operations. If the grandfather stands at a distance of 2 meters, after seeing the effective distance displayed on the screen, the grandfather adjusts the distance to the effective range of 1-2 meters to Improve the recognition accuracy of gesture operations. For another example, if the effective distance of the son is set to 1 meter, the son can keep the effective distance from the TV screen according to the reminder information on the TV screen when performing gesture operations, which not only improves the recognition accuracy of gesture operations, but also avoids If you are too close to the TV, your hands will touch the TV and cause hand injuries.

In this embodiment, the image information of the operator is collected through the above scheme; the identity of the operator is identified according to the image information of the operator, and the identity information of the operator is obtained; the preset distance matching table is searched according to the identity information of the operator, and the relative terminal of the operator is obtained The effective gesture operation distance is displayed to the operator, so that the gesture control system can automatically remind the operator of the effective distance from the intelligent display terminal, which not only improves the accuracy of the gesture control system for the operator's gesture recognition, but also prevents the operator from causing operational damage .

As shown in FIG. 7 , the second embodiment of the present invention proposes a gesture operation control device. On the basis of the first embodiment above, it also includes:

The processing module 204 is configured to perform size truncation, color conversion and/or denoising processing on the operator image information.

The difference between this embodiment and the above-mentioned first embodiment is that, after the gesture control system in this embodiment captures the image information of the operator, it needs to perform corresponding processing on the image information of the operator.

Specifically, after capturing the image information of the operator, it is necessary to analyze the information, such as processing the data of the operator's head and shoulders, and setting the size of the operator's image to a suitable calculation size; Image color conversion, such as processing RGB 24bit to 8bit grayscale; at the same time, denoising processing is performed on the image data to remove interference. Among them, the denoising method can be realized by selecting a low-pass filter.

In this embodiment, the accuracy of the image information data of the operator can be improved through the above solution, thereby providing a more accurate data source for subsequent gesture operation recognition, and further improving the accuracy of the gesture control system for operator gesture recognition.

As shown in FIG. 8 , the third embodiment of the present invention proposes a gesture operation control device. On the basis of the above-mentioned second embodiment, it also includes:

The judging module 205 is used to judge whether the operator's current gesture action is the operator's operation instruction according to the operator's image information; if so, the identification module 202 identifies the operator's identity information according to the operator's image information; Otherwise, do not process.

The difference between this embodiment and the above-mentioned second embodiment is that after the gesture control system of this embodiment collects the image information of the operator and performs corresponding processing, it also needs to judge whether the information is a gesture operation command of the operator.

Specifically, when judging, the following methods can be used:

Firstly, the human body model is constructed by means of multi-target tracking;

Among them, the multi-eye tracking method can use the joint probabilistic data association filter (JPDAF), the multi-hypothesis tracking (MHT) algorithm, and the dynamic multi-bit allocation algorithm, etc. The above-mentioned various algorithms can use existing mature solutions, and will not be repeated here. .

Using the method of multi-target tracking, the corresponding targets are found for these gesture moving objects, and the human body model is established for the effective targets of the hand characteristics of the operator's human body parts according to these trajectory symbols.

In the multi-target human body model, each effective target corresponds to a corresponding space-time trajectory, and the effective targets have the characteristics of continuity, and different targets have their own different forms of expression. For example a gesture target exhibits a span of motion.

Then, based on the human body model, trajectory discrimination and dynamic gesture recognition are performed on the operator image information; if the current operator image information is the operator's gesture feature data, then the current gesture action is the operator's operation instruction; otherwise, it is the operation instruction. operator's misuse.

Through the above solution, this embodiment can accurately identify whether the operator's gesture operation is an operation command that the operator needs to perform, thereby effectively eliminating the operator's misoperation, and further improving the recognition of the operator's gesture action by the gesture control system. precision.

As shown in FIG. 9 , the fourth embodiment of the present invention proposes a gesture operation control device. On the basis of the third embodiment above, it further includes:

The execution module 206 is configured to search a preset gesture recognition function table according to the operator's image information, and correspondingly adjust corresponding functions of the terminal according to the search results.

The difference between this embodiment and the above-mentioned third embodiment is that this embodiment also includes a scheme that the system adjusts corresponding functions according to the operator's gesture operation.

Specifically, in this embodiment, corresponding terminal adjustment functions are matched in advance according to different gesture operations of the operator, and a gesture recognition function table is established based on this corresponding relationship. For example, waving in the horizontal direction means adjusting the volume of the TV. It means to increase the volume, and waving to the right means to decrease the volume, for example, when the gesture moves 20cm from left to right, the volume adjustment will be increased by one unit, and so on.

When the TV gesture control system recognizes that the operator's gesture operation is a normal operation instruction, it will call the corresponding function. First, it will search the preset gesture recognition function table according to the acquired operator image information, and correspond to the corresponding function according to the search result. Adjust the corresponding functions of the terminal. In this way, the purpose of controlling the functions of the TV through the operator's gesture operation is realized.

As shown in FIG. 10 , the fifth embodiment of the present invention proposes a gesture operation control device. On the basis of the fourth embodiment above, it further includes:

The configuration module 200 is configured to configure the distance matching table and the gesture recognition function table.

The difference between this embodiment and the foregoing fourth embodiment is that this embodiment also includes a solution for configuring the distance matching table and the gesture recognition function table.

Specifically, the operator can configure the distance matching table and the gesture recognition function table according to the system setting options. For example, the TV gesture control system can set a gesture operation prompt menu, and remind the operator of the correct distance range and gesture recognition through the gesture operation prompt menu. corresponding function options.

In this embodiment, the distance matching table and the gesture recognition function table are configured through the above scheme, and the image information of the operator is collected; the identity information of the operator is identified according to the image information of the operator; the identity information of the operator is obtained; the distance matching is searched according to the identity information of the operator The table obtains the effective gesture operation distance of the operator relative to the terminal and displays it to the operator, so that the gesture control system can automatically remind the operator of the effective distance from the intelligent display terminal, which not only improves the accuracy of the gesture control system for the operator's gesture recognition, Moreover, the operator is prevented from causing operation damage; in addition, the gesture recognition function table is searched according to the acquired operator image information, and the corresponding functions of the terminal are adjusted according to the search results, so as to realize the purpose of controlling the TV function through the operator's gesture operation.

It should be noted that the above functional modules can be controlled by a CPU (microprocessor) of the TV.

In addition, the present invention also proposes an intelligent display terminal, which includes the device described in any of the above embodiments, wherein the intelligent display terminal may be a display device such as a smart TV.

The gesture operation control method, device, and intelligent display terminal of the embodiment of the present invention obtain the operator's identity information by collecting the operator's image information; identifying the operator's identity according to the operator's image information; and searching for a preset distance based on the operator's identity information The matching table obtains the effective gesture operation distance of the operator relative to the terminal and displays it to the operator, so that the gesture control system can automatically remind the operator of the effective distance from the intelligent display terminal, which not only improves the recognition accuracy of the gesture control system for the operator's gesture action , and prevent the operator from causing operation damage; in addition, according to the obtained operator image information, the gesture recognition function table is searched, and the corresponding functions of the terminal are adjusted according to the search results, so as to realize the purpose of controlling the TV function through the operator's gesture operation.

The above is only a preferred embodiment of the present invention, and does not limit the patent scope of the present invention. Any equivalent structure or process transformation made by using the description of the present invention and the contents of the accompanying drawings, or directly or indirectly used in other related technical fields , are all included in the scope of patent protection of the present invention in the same way.

Claims (15)

1. a gesture operation control method is characterized in that, comprising:

Acquisition operations person's image information;

According to described operator's image information identifying operation person's identity, obtain operator's identity information;

Search defaultly apart from matching list according to described operator's identity information, obtain effective gesture operation distance of the relative terminal of operator and remind the operator.

2. method according to claim 1 is characterized in that, also comprises after the step of described acquisition operations person's image information:

Described operator's image information is carried out size intercepting, color conversion and/or denoising.

3. method according to claim 1 is characterized in that, the step of described identity information according to operator's image information identifying operation person comprises:

From described operator's image information, obtain operator's head image information;

Search default image library according to described operator's head image information, obtain operator's identity information.

4. according to each described method among the claim 1-3, it is characterized in that, also comprise after the step of described acquisition operations person's image information:

Whether be operator's operational order according to the current gesture motion of described operator's image information decision operation person; If then execution in step is according to described operator's image information identifying operation person's identity information; Otherwise, do not deal with.

5. method according to claim 4 is characterized in that, whether described be that the step of operator's operational order comprises according to the current gesture motion of operator's image information decision operation person:

Adopt the mode of multiple target tracking to make up manikin;

Based on described manikin described operator's image information is carried out track differentiation and dynamic gesture identification;

If the gesture feature data that current operator's image information is the operator judge that then current gesture motion is operator's operational order; Otherwise, be operator's maloperation.

6. method according to claim 5 is characterized in that, effective gesture operation distance of the relative terminal of the described operator of obtaining also reminds operator's step also to comprise afterwards:

Search default gesture identification menu according to operator's image information, according to the corresponding corresponding function of terminal of adjusting of lookup result.

7. method according to claim 6 is characterized in that, also comprises before the step of described acquisition operations person's image information:

Dispose described apart from matching list and gesture identification menu.

8. a gesture operation control device is characterized in that, comprising:

Acquisition module is used for acquisition operations person's image information;

Identification module is used for the identity according to described operator's image information identifying operation person, obtains operator's identity information;

Obtain prompting module, be used for searching according to described operator's identity information default apart from matching list, obtain effective gesture operation distance of the relative terminal of operator and remind the operator.

9. device according to claim 8 is characterized in that, also comprises:

Processing module is used for described operator's image information is carried out size intercepting, color conversion and/or denoising.

10. device according to claim 8 is characterized in that, described identification module also is used for obtaining from described operator's image information operator's head image information; Search default image library according to described operator's head image information, obtain operator's identity information.

11. each described device is characterized in that according to Claim 8-10, also comprises:

Judge module, whether be used for according to the current gesture motion of described operator's image information decision operation person is operator's operational order; If, then by the identity information of described identification module according to described operator's image information identifying operation person; Otherwise, do not deal with.

12. device according to claim 11 is characterized in that, described judge module also is used for adopting the mode of multiple target tracking to make up manikin; Based on described manikin described operator's image information is carried out track differentiation and dynamic gesture identification; If the gesture feature data that current operator's image information is the operator judge that then current gesture motion is operator's operational order; Otherwise, be operator's maloperation.

13. device according to claim 11 is characterized in that, also comprises:

Execution module is used for searching default gesture identification menu according to operator's image information, according to the corresponding corresponding function of terminal of adjusting of lookup result.

14. device according to claim 13 is characterized in that, also comprises:

Configuration module, it is described apart from matching list and gesture identification menu to be used for configuration.

15. an intelligent display terminal is characterized in that, comprises each described device among the claim 8-14.

Images