CN115826838A - Gesture recognition method and related equipment - Google Patents

Abstract

The present application provides a gesture recognition method and related equipment. The method includes: acquiring the number of touch points on the touch screen, and acquiring pixel data of the touch points according to the number of touch points; The physical parameters of the touch screen and the acquired resolution of the touch screen are calculated to obtain the physical data of the touch point; according to the physical data of the touch point and a preset threshold, the gesture corresponding to the touch point is obtained. The embodiment of the present application calculates the physical data of the touch point through the obtained pixel data and the physical data and resolution of the touch screen, and effectively converts the pixel data into actual physical data. Further, the physical data is used to further perform touch gesture Recognition effectively solves the problem of inaccurate recognition of gestures by setting a single pixel threshold, prevents large errors in judging gestures, and effectively improves the accuracy of touch gesture recognition.

Description

Gesture recognition method and related equipment

technical field

The present application relates to the technical field of gesture recognition, in particular to a gesture recognition method and related equipment.

Background technique

Gesture operation is very convenient for users when using a touch screen. The judgment of whether a gesture is formed is generally carried out by analyzing information such as the trajectory and speed of the user's multiple fingers, and the contact area. Since the user's touch data obtained by the application software is based on pixel values, gestures are generally processed and judged based on pixel values. . However, when judging gestures based on pixel values, it is necessary to set the judgment conditions in units of pixels, and the touch screen can be set to different resolutions, and the touch screen itself also has a variety of sizes, which will lead to the same finger operation, in different The pixel values obtained on touch screens with different resolutions or different sizes are different. When performing gesture judgment, the pixel value error is prone to be too large, resulting in situations where some gestures cannot be triggered or are triggered by mistake.

Contents of the invention

In view of this, the purpose of this application is to propose a gesture recognition method and related equipment.

Based on the above purpose, the application provides a gesture recognition method, including:

Obtain the number of touch points on the touch screen, and obtain pixel data of the touch points according to the number of touch points;

Calculate and obtain the physical data of the touch points according to the number of the touch points, the pixel data of the touch points, the acquired physical parameters of the touch screen, and the acquired resolution of the touch screen;

A gesture corresponding to the touch point is obtained according to the physical data of the touch point and a preset threshold.

In a possible implementation manner, the number of the touch point is one, and the pixel data of the touch point includes: the maximum pixel width value of the touch area of the touch point, the maximum value of the touch area of the touch point Pixel height value.

In a possible implementation manner, the physical parameters of the touch screen include: a physical width value of the touch screen and a physical height value of the touch screen;

The resolution of the touch screen includes: the resolution width of the touch screen and the resolution height of the touch screen;

The physical data of the touch point includes: a physical maximum width value of the touch point and a physical maximum height value of the touch point;

The calculation of the physical data of the touch points according to the number of the touch points, the pixel data of the touch points, the obtained physical parameters of the touch screen and the obtained resolution of the touch screen includes:

Calculate the physical maximum width value of the touch point according to the maximum pixel width value of the touch area of the touch point, the physical width value of the touch screen, and the resolution width of the touch screen;

The physical maximum height value of the touch point is calculated according to the maximum pixel height value of the touch area, the physical height value of the touch screen, and the resolution height of the touch screen.

In a possible implementation manner, the number of the touch points is greater than one, and the pixel data of the touch points includes: the pixel abscissa value of the central pixel of the touch point and the central pixel of the touch point The pixel ordinate value; the center pixel point is located at the center point of the touch area corresponding to the touch point.

In a possible implementation manner, the physical parameters of the touch screen include: a physical width value of the touch screen and a physical height value of the touch screen;

The resolution of the touch screen includes: the resolution width of the touch screen and the resolution height of the touch screen;

The physical data of the touch point includes a physical abscissa value of the touch point and a physical ordinate value of the touch point;

Wherein, the calculation of the physical data of the touch points according to the number of the touch points, the pixel data of the touch points, the obtained physical parameters of the touch screen and the obtained resolution of the touch screen includes:

Calculate the physical abscissa value of the touch point according to the pixel abscissa value of the central pixel point of the touch point, the physical width value of the touch screen, and the resolution width of the touch screen;

Calculate the physical ordinate value of the touch point according to the pixel ordinate value of the central pixel point of the touch point, the physical height value of the touch screen, and the resolution height of the touch screen;

In a possible implementation manner, the gestures corresponding to the touch point include: erasing on the back of the hand, normal writing, and writing with a fine pen; the preset threshold includes: a first threshold and a second threshold; the second threshold is less than said first threshold;

Wherein, the obtaining the gesture corresponding to the touch point according to the physical data of the touch point and a preset threshold includes:

When the physical data of any of the touch points is greater than the first threshold, it is obtained that the gesture corresponding to the touch point is erasing the back of the hand;

When the physical data of all the touch points is less than the first threshold and the physical data of any of the touch points is greater than the second threshold, it is obtained that the gesture corresponding to the touch point is normal writing;

When the physical data of all the touch points are smaller than the second threshold, it is obtained that the gesture corresponding to the touch point is writing with a fine pen.

In a possible implementation manner, the gestures corresponding to the touch point include: zooming and rotating with two fingers, panning with two fingers, and erasing with five fingers; the preset thresholds include: a third threshold and a fourth threshold; The physical abscissa of the point and the physical ordinate of the touch point are used as the physical coordinates of the touch point;

Wherein, the obtaining the gesture corresponding to the touch point according to the physical data of the touch point and a preset threshold includes:

When the number of the touch points is two, calculate the first physical distance between the two touch points;

When the first physical distance is greater than the third threshold, the gesture corresponding to the touch point is two-finger zooming and rotating;

When the first physical distance is smaller than the third threshold, it is obtained that the gesture corresponding to the touch point is two-finger translation;

When the number of the touch points is five, calculate the second physical distance between the physical coordinates of every two adjacent touch points;

When all the second physical distances are smaller than the fourth threshold, it is obtained that the gesture corresponding to the touch point is five-finger erasing.

In a possible implementation manner, the preset threshold can be automatically adjusted according to the physical data.

Based on the same inventive concept, the embodiment of the present application also provides a gesture recognition device, including:

An acquisition module configured to acquire the number of touch points on the touch screen, and acquire pixel data of the touch points according to the number of touch points;

The calculation module is configured to calculate the physical data of the touch points according to the number of the touch points, the pixel data of the touch points, the acquired physical parameters of the touch screen and the acquired resolution of the touch screen;

The judging module is configured to obtain the gesture corresponding to the touch point according to the physical data of the touch point and a preset threshold.

In a possible implementation manner, the number of the touch point is one, and the pixel data of the touch point includes: the maximum pixel width value of the touch area of the touch point, the maximum value of the touch area of the touch point Pixel height value.

In a possible implementation manner, the physical parameters of the touch screen include: the physical parameters of the touch screen include: a physical width value of the touch screen and a physical height value of the touch screen;

The resolution of the touch screen includes: the resolution width of the touch screen and the resolution height of the touch screen;

The physical data of the touch point includes: a physical maximum width value of the touch point and a physical maximum height value of the touch point;

The computing module is further configured to:

Calculate the physical maximum width value of the touch point according to the maximum pixel width value of the touch area of the touch point, the physical width value of the touch screen, and the resolution width of the touch screen;

The physical maximum height value of the touch point is calculated according to the maximum pixel height value of the touch area, the physical height value of the touch screen, and the resolution height of the touch screen.

In a possible implementation manner, the number of the touch points is greater than one, and the pixel data of the touch points includes: the pixel abscissa value of the central pixel of the touch point and the central pixel of the touch point The pixel ordinate value; the center pixel point is located at the center point of the touch area corresponding to the touch point.

In one possible implementation,

The physical parameters of the touch screen include: the physical width value of the touch screen and the physical height value of the touch screen;

The resolution of the touch screen includes: the resolution width of the touch screen and the resolution height of the touch screen;

The physical data of the touch point includes a physical abscissa value of the touch point and a physical ordinate value of the touch point;

The computing module is further configured to:

Calculate the physical abscissa value of the touch point according to the pixel abscissa value of the central pixel point of the touch point, the physical width value of the touch screen, and the resolution width of the touch screen;

Calculate the physical ordinate value of the touch point according to the pixel ordinate value of the central pixel point of the touch point, the physical height value of the touch screen, and the resolution height of the touch screen;

In a possible implementation manner, the gestures corresponding to the touch point include: erasing on the back of the hand, normal writing, and writing with a fine pen; the preset threshold includes: a first threshold and a second threshold; the second threshold is less than said first threshold;

The judging module is further configured to:

When the physical data of any of the touch points is greater than the first threshold, it is obtained that the gesture corresponding to the touch point is erasing the back of the hand;

When the physical data of all the touch points is less than the first threshold and the physical data of any of the touch points is greater than the second threshold, it is obtained that the gesture corresponding to the touch point is normal writing;

When the physical data of all the touch points are smaller than the second threshold, it is obtained that the gesture corresponding to the touch point is writing with a fine pen.

In a possible implementation manner, the gestures corresponding to the touch point include: zooming and rotating with two fingers, panning with two fingers, and erasing with five fingers; the preset thresholds include: a third threshold and a fourth threshold; The physical abscissa of the point and the physical ordinate of the touch point are used as the physical coordinates of the touch point;

The judging module is further configured to:

When the number of the touch points is two, calculate the first physical distance between the two touch points;

When the first physical distance is greater than the third threshold, the gesture corresponding to the touch point is two-finger zooming and rotating;

When the first physical distance is smaller than the third threshold, it is obtained that the gesture corresponding to the touch point is two-finger translation;

When the number of the touch points is five, calculate the second physical distance between the physical coordinates of every two adjacent touch points;

When all the second physical distances are smaller than the fourth threshold, it is obtained that the gesture corresponding to the touch point is five-finger erasing.

In a possible implementation manner, the preset threshold can be automatically adjusted according to the physical data.

Based on the same inventive concept, an embodiment of the present application also provides an electronic device, including a memory, a processor, and a computer program stored on the memory and operable on the processor. When the processor executes the program, the above-mentioned Any one of the gesture recognition methods.

As can be seen from the above, the gesture recognition method and related equipment provided by the present application obtain the number of touch points on the touch screen, and obtain the pixel data of the touch points according to the number of the touch points; The number of the touch point, the pixel data of the touch point, the acquired physical parameters of the touch screen and the resolution of the acquired touch screen are calculated to obtain the physical data of the touch point; according to the physical data of the touch point and the preset threshold value, the obtained The gesture corresponding to the touch point. This application effectively converts the pixel data corresponding to the touch action into actual physical data, and then uses the actual physical data to further identify the gesture corresponding to the touch action, effectively preventing large errors in judging gestures, and effectively improving the accuracy of gestures. judgment accuracy.

Description of drawings

In order to more clearly illustrate the technical solutions in the present application or related technologies, the following will briefly introduce the accompanying drawings that need to be used in the description of the embodiments or related technologies. Obviously, the accompanying drawings in the following description are only for this application Embodiments, for those of ordinary skill in the art, other drawings can also be obtained based on these drawings without any creative effort.

FIG. 1 is a flowchart of a gesture recognition method according to an embodiment of the present application;

FIG. 2 is a schematic diagram of a gesture recognition device according to an embodiment of the present application;

FIG. 3 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed ways

In order to make the purpose, technical solutions and advantages of the present application clearer, the present application will be further described in detail below in conjunction with specific embodiments and with reference to the accompanying drawings.

It should be noted that, unless otherwise defined, the technical terms or scientific terms used in the embodiments of the present application shall have the usual meanings understood by those skilled in the art to which the present application belongs. "First", "second" and similar words used in the embodiments of the present application do not indicate any order, quantity or importance, but are only used to distinguish different components. "Comprising" or "comprising" and similar words mean that the elements or items appearing before the word include the elements or items listed after the word and their equivalents, without excluding other elements or items. Words such as "connected" or "connected" are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. "Up", "Down", "Left", "Right" and so on are only used to indicate the relative positional relationship. When the absolute position of the described object changes, the relative positional relationship may also change accordingly.

As mentioned in the background technology section, the technical solutions of gesture recognition in the related art are generally recognized based on pixel values, but when performing gesture judgment based on pixel values, it is necessary to set judgment conditions in units of pixels, and because the touch screen Different resolutions can be set, and the touch screen itself has multiple sizes, which will lead to different pixel values in the final response on touch screens with different resolutions or different sizes under the same finger operation. As a result, when the gesture is subsequently judged based on the pixel value of the above response, the error of the pixel value is too large, resulting in the inability to recognize the correct gesture.

Based on the above considerations, the embodiment of the present application proposes a gesture recognition method, which obtains pixel data according to the obtained number of touch points on the touch screen; according to the pixel data, the obtained physical parameters of the touch screen and the obtained resolution of the touch screen rate, and calculate the corresponding physical data of the touch point; according to the size relationship between the physical data and the preset threshold, the gesture corresponding to the touch point can be obtained, so that the gesture can be effectively displayed on touch screens with different sizes and different resolutions. The pixel value corresponding to the touch action is measured by the actual physical size. Based on the actual physical size, the touch action can be accurately judged to accurately identify the corresponding gesture.

The technical solutions of the embodiments of the present application are described below through specific embodiments.

With reference to Fig. 1, the gesture recognition method of the embodiment of the present application comprises the following steps:

Step S101, obtaining the number of touch points on the touch screen, and obtaining pixel data of the touch points according to the number of touch points;

Step S102, calculating the physical data of the touch points according to the number of the touch points, the pixel data of the touch points, the acquired physical parameters of the touch screen and the acquired resolution of the touch screen;

Step S103, according to the physical data of the touch point and the preset threshold, the gesture corresponding to the touch point is obtained.

For step S101 , first obtain the physical parameters of the touch screen and the resolution of the touch screen, and then obtain the number of touch points on the touch screen, and correspondingly obtain the pixel data corresponding to the touch points.

In the following, when the number of touch points is one as an example, the pixel data corresponding to the touch point is the maximum pixel width value and maximum pixel height value of the touch area. In general, when the user touches the touch screen with a finger or the back of the hand, the touch area formed is an irregular figure, so the maximum pixel width and maximum pixel height of the irregular figure are directly taken, and the accuracy is guaranteed. The steps of secondary calculation are saved.

Further, for step S102, the physical data of the touch point is calculated according to the acquired physical parameters of the touch screen and the resolution of the touch screen, combined with the pixel data of the touch point. Specifically, the acquired physical parameters of the touch screen include a physical width value and a physical height value of the touch screen, and the resolution of the touch screen includes a resolution width of the touch screen and a resolution height of the touch screen. Further, according to the above-mentioned maximum width value of the touch area, the physical width value of the touch screen and the resolution width of the touch screen, the physical width value of the touch point is calculated, and the physical width value of the touch point is the actual physical width value of the touch area corresponding to the touch point. size.

Specifically, the physical width value of the touch point is calculated by the following formula:

Wherein, W _p represents the physical width value of the touch point, P _w represents the maximum pixel width value, W _s represents the physical width value of the touch screen, and D _w represents the resolution width value of the touch screen.

Further, according to the above-mentioned maximum pixel height value of the touch area, the physical height value of the touch screen, and the resolution height of the touch screen, the physical height value of the touch point is calculated, and the physical height value of the touch point is the actual touch area corresponding to the touch point. physical size.

Specifically, the physical height value of the touch point is calculated by the following formula:

Among them, H _p represents the physical height value of the touch point, _Ph represents the maximum pixel height value, H _s represents the physical height value of the touch screen, and D _h represents the resolution height value of the touch screen.

After the physical width value and the physical height value of the touch point are acquired, further, for step S103, it is necessary to obtain the gesture corresponding to the touch point according to the physical data of the touch point and a preset threshold. In this embodiment, the physical data of the touch point is the physical width value and the physical height value of the touch area corresponding to the touch point, and the preset threshold value includes a first threshold value and a second threshold value, and the second threshold value is smaller than the first threshold value.

Specifically, when any one of the physical width value of the touch point and the physical height value of the touch point is greater than the first threshold, the gesture corresponding to the touch point is obtained as the back of the hand, and when the physical width value of the touch point and the touch point When the physical height value of the touch point is less than the first threshold and any one of the physical width value of the touch point and the physical height value of the touch point is greater than the second threshold value, it is obtained that the gesture operation corresponding to the touch point is normal writing. When both the width value and the physical height value of the touch point are smaller than the second threshold, it is obtained that the gesture operation corresponding to the touch point is writing with a fine pen.

It should be noted that the first threshold and the second threshold involved in the above embodiments can be set according to requirements, and can also be automatically adjusted during the user's use. The specific automatic adjustment technical solution should be understood by those skilled in the art It can be implemented after adaptive adjustment according to the technology in the art, so details will not be repeated here.

In an optional embodiment, the size of the touch screen is 60 inches, the corresponding physical width of the touch screen is 1328 mm, the physical height of the touch screen is 747 mm, the resolution of the touch screen is 3840*2160, and the resolution of the corresponding touch screen The resolution width value is 3840 pixels, the resolution height value of the touch screen is 2160 pixels, the preset first threshold value is 40 mm, and the second threshold value is 5 mm. At this time, the number of touch points is one, and the maximum pixel height value of the contact area corresponding to the touch point is 144 pixels, and the maximum pixel width value is 160 pixels. Correspondingly, the physical height value of the touch point is 49.8 mm , the physical width value of the touch point is 55.2 mm. Further, after the judgment, it can be seen that the above-mentioned obtained physical height value and physical width value of the touch point are both greater than 40 mm. It can be seen that the gesture is erasing the back of the hand.

In another optional embodiment, under the same touch condition, the size of the touch screen is changed to 96 inches, the corresponding physical width value of the touch screen is 2162 mm, the physical height value of the touch screen is 1217 mm, and the resolution of the touch screen is 1920*1080, the corresponding touch screen resolution width is 1920, resolution height is 1080. The obtained maximum pixel height value of the contact area corresponding to the touch point is 44 pixels, and the maximum pixel width value is 49 pixels. Compared with the above-mentioned embodiment, it can be seen that when the actual physical size and resolution of the touch screen are different, the same The change of the pixel value corresponding to the gesture is very large. Obviously, using the pixel value to judge the gesture will introduce a large error, but using the technical solution of this application, the pixel value is converted into the actual physical size, regardless of the size and size of the touch screen. No matter how the pixel value changes, the physical size of the actual touch area will not change, which effectively reduces the error of gesture recognition.

It should be noted that, the above-mentioned embodiment only uses a part of the gesture when the touch point is a single point as an example in this embodiment, and those skilled in the art can undoubtedly apply the technical solution of this application to other gestures when the touch point is a single point Recognition, the step of converting the touch point from pixel data to physical data in the recognition process can be the same as the above steps, and those skilled in the art can also set thresholds by themselves to limit the recognition of other gestures.

In an optional embodiment, taking the number of touch points as two as an example, on the basis of the physical parameters of the touch screen and the resolution of the touch screen that have been obtained above, the center pixel of each of the above two touch points is obtained The pixel coordinate value of the touch point, the center pixel of the touch point is located at the center point of the touch area corresponding to the touch point, that is, the intersection of the center line in the height direction of the touch area and the center line in the width direction of the touch area is recorded as the center pixel point. The pixel coordinate value of the above-mentioned center pixel point comprises the pixel abscissa value of the center pixel point and the pixel ordinate value of the center pixel point. After obtaining the pixel coordinate value of the center pixel point, according to the pixel abscissa value of the center pixel point, the touch screen The physical width value of the touch screen and the resolution width of the touch screen are calculated to obtain the physical abscissa value of the touch point.

Specifically, the physical abscissa value of the touch point is calculated by the following formula:

Wherein, X represents the physical abscissa value of the touch point, P _x represents the pixel abscissa value of the central pixel point, W _s represents the physical width value of the touch screen, and D _w represents the resolution width value of the touch screen.

Further, the physical ordinate value of the touch point is calculated according to the pixel ordinate value of the central pixel point, the physical height value of the touch screen, and the resolution height of the touch screen.

Specifically, the physical ordinate value of the touch point is calculated by the following formula:

Wherein, Y represents the physical ordinate value of the touch point, P _y represents the pixel ordinate value of the central pixel point, H _s represents the physical height value of the touch screen, and D _h represents the resolution height value of the touch screen.

After the physical coordinate values corresponding to the two touch points are obtained, the first physical distance between the two touch points is calculated, and the preset threshold is the third threshold. Any method can be used to calculate the first physical distance. The so-called first physical distance is the linear distance between the central pixels corresponding to two touch points. The specific calculation process will not be repeated here, and those skilled in the art should know it. Further, the size relationship between the first physical distance and the third threshold is judged. Generally speaking, when performing translation operations, the distance between the two fingers is relatively short, and when performing zoom and rotation operations, the distance between the two fingers is relatively long, so when When the first physical distance is greater than the third threshold, the gesture corresponding to the touch point is two-finger zooming and rotation; when the first physical distance is smaller than the third threshold, the gesture corresponding to the touch point is two-finger translation.

Similarly, as noted in the above embodiments, this embodiment only takes a part of gestures when the touch points are two points as an example, and those skilled in the art can undoubtedly apply the technical solution of the application to two touch points. For other gesture recognition when pointing, the step of converting the touch point from pixel data to physical data in the recognition process can be the same as the above steps, and those skilled in the art can also set the threshold by themselves to limit the recognition of other gestures, according to the implementation of this application For example, adapting the thresholds of other gestures does not require creative efforts, so details will not be repeated here.

In an optional embodiment, taking the number of touch points as five as an example, on the basis of the physical parameters of the touch screen and the resolution of the touch screen that have been obtained above, the central pixel of each of the above five touch points is obtained The pixel coordinate value of the touch point, the center pixel of the touch point is located at the center of the touch area corresponding to the touch point, that is, the intersection of the center line in the height direction of the touch area and the center line in the width direction of the touch area is recorded as the center pixel point. The pixel coordinate value of the above-mentioned center pixel point comprises the pixel abscissa value of the center pixel point and the pixel ordinate value of the center pixel point. After obtaining the pixel coordinate value of the center pixel point, according to the pixel abscissa value of the center pixel point, the touch screen The physical width value of the touch screen and the resolution width of the touch screen are calculated to obtain the physical abscissa value of the touch point.

Specifically, the physical abscissa value of the touch point is calculated by the following formula:

Wherein, X represents the physical abscissa value of the touch point, P _x represents the pixel abscissa value of the central pixel point, W _s represents the physical width value of the touch screen, and D _w represents the resolution width value of the touch screen.

Further, the physical ordinate value of the touch point is calculated according to the pixel ordinate value of the central pixel point, the physical height value of the touch screen, and the resolution height of the touch screen.

Specifically, the physical ordinate value of the touch point is calculated by the following formula:

Wherein, Y represents the physical ordinate value of the touch point, P _y represents the pixel ordinate value of the central pixel point, H _s represents the physical height value of the touch screen, and D _h represents the resolution height value of the touch screen.

After obtaining the physical coordinate values corresponding to the five touch points, calculate the second physical distance between every two touch points among the five touch points, and the preset threshold is the fourth threshold. Any method can be used to calculate the second physical distance. The so-called second physical distance is the straight-line distance between the two center pixels corresponding to every two touch points among the five touch points. The specific calculation process will not be repeated here. Those skilled in the art should know. Further, judge the size relationship between the second physical distance and the fourth threshold. Generally speaking, considering that sometimes there will be multiple people operating the large screen at the same time, if the five fingers are different people in different areas of the large screen For writing, it is necessary not to trigger the five-finger erasing gesture. Generally, if the five fingers are written by different people in different areas of the large screen, there will be a large distance between at least two fingers. Therefore, when any second physical distance is greater than the fourth threshold, the gesture corresponding to the touch point is a writing operation; when all the second physical distances are smaller than the fourth threshold, the gesture corresponding to the touch point is five-finger erasing. In general, the fourth threshold is set to 200 millimeters. Of course, those skilled in the art should undoubtedly know that the above fourth threshold can be adjusted by themselves.

Similarly, as noted in the above embodiments, this embodiment only takes a part of gestures when the touch points are five points as an example, and those skilled in the art can undoubtedly apply the technical solution of this application to five touch points. For other gesture recognition when pointing, the step of converting the touch point from the pixel data of the touch point to the physical data of the touch point in the recognition process can be the same as the above steps, and those skilled in the art can also set the threshold by themselves to limit the recognition of other gestures In some cases, adaptive changes to the thresholds of other gestures according to the embodiment of the present application do not require creative efforts, so details are not described here.

It can be seen from the above-mentioned embodiments that the gesture recognition method described in the embodiment of the present application calculates the physical data of the touch point through the acquired pixel data of the touch point and the physical data and resolution of the touch screen, and effectively converts the touch point The pixel data of the pixel is converted into the actual physical data of the pixel. Further, the physical data of the pixel is used to further identify the touch gesture, which effectively solves the problem of the difference of the pixel data in different sizes of large screens and different resolutions. On screens of different sizes and screens with different resolutions, large errors occur when judging gestures, which effectively improves the accuracy of judging gestures.

It should be noted that the method in the embodiment of the present application may be executed by a single device, such as a computer or a server. The method of this embodiment can also be applied in a distributed scenario, and is completed by cooperation of multiple devices. In the case of such a distributed scenario, one of the multiple devices may only perform one or more steps in the method of the embodiment of the present application, and the multiple devices will interact with each other to complete all described method.

It should be noted that some embodiments of the present application are described above. Other implementations are within the scope of the following claims. In some cases, the actions or steps recited in the claims can be performed in an order different from those in the above-described embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. Multitasking and parallel processing are also possible or may be advantageous in certain embodiments.

Based on the same inventive concept, the present application further provides a gesture recognition device corresponding to the method in any of the above embodiments.

Referring to Fig. 2, the gesture recognition device includes:

The acquiring module 21 is configured to acquire the number of touch points on the touch screen, and acquire pixel data of the touch points according to the number of touch points;

The calculation module 22 is configured to calculate the physical data of the touch points according to the number of the touch points, the pixel data of the touch points, the acquired physical parameters of the touch screen and the acquired resolution of the touch screen;

The judging module 23 is configured to obtain the gesture corresponding to the touch point according to the physical data of the touch point and a preset threshold.

In a possible implementation manner, the number of the touch point is one, and the pixel data of the touch point includes: the maximum pixel width value of the touch area of the touch point, the maximum value of the touch area of the touch point Pixel height value.

In a possible implementation manner, the physical parameters of the touch screen include: a physical width value of the touch screen and a physical height value of the touch screen;

The resolution of the touch screen includes: the resolution width of the touch screen and the resolution height of the touch screen;

The physical data of the touch point includes: a physical maximum width value of the touch point and a physical maximum height value of the touch point;

The computing module is further configured to:

Calculate the physical maximum width value of the touch point according to the maximum pixel width value of the touch area of the touch point, the physical width value of the touch screen, and the resolution width of the touch screen;

The physical maximum height value of the touch point is calculated according to the maximum pixel height value of the touch area, the physical height value of the touch screen, and the resolution height of the touch screen.

In a possible implementation manner, the number of the touch points is greater than one, and the pixel data of the touch points includes: the pixel abscissa value of the central pixel of the touch point and the central pixel of the touch point The pixel ordinate value; the center pixel point is located at the center point of the touch area corresponding to the touch point.

In a possible implementation manner, the physical parameters of the touch screen include: a physical width value of the touch screen and a physical height value of the touch screen;

The resolution of the touch screen includes: the resolution width of the touch screen and the resolution height of the touch screen;

The physical data of the touch point includes a physical abscissa value of the touch point and a physical ordinate value of the touch point;

The computing module is further configured to:

Calculate the physical abscissa value of the touch point according to the pixel abscissa value of the central pixel point of the touch point, the physical width value of the touch screen, and the resolution width of the touch screen;

Calculate the physical ordinate value of the touch point according to the pixel ordinate value of the central pixel point of the touch point, the physical height value of the touch screen, and the resolution height of the touch screen;

In a possible implementation manner, the gestures corresponding to the touch point include: erasing on the back of the hand, normal writing, and writing with a fine pen; the preset threshold includes: a first threshold and a second threshold; the second threshold is less than said first threshold;

The judging module is further configured to:

When the physical data of any of the touch points is greater than the first threshold, it is obtained that the gesture corresponding to the touch point is erasing the back of the hand;

When the physical data of all the touch points is less than the first threshold and the physical data of any of the touch points is greater than the second threshold, it is obtained that the gesture corresponding to the touch point is normal writing;

When the physical data of all the touch points are smaller than the second threshold, it is obtained that the gesture corresponding to the touch point is writing with a fine pen.

In a possible implementation manner, the gestures corresponding to the touch point include: zooming and rotating with two fingers, panning with two fingers, and erasing with five fingers; the preset thresholds include: a third threshold and a fourth threshold; The physical abscissa of the point and the physical ordinate of the touch point are used as the physical coordinates of the touch point;

The judging module is further configured to:

When the number of the touch points is two, calculate the first physical distance between the two touch points;

When the first physical distance is greater than the third threshold, the gesture corresponding to the touch point is two-finger zooming and rotating;

When the first physical distance is smaller than the third threshold, it is obtained that the gesture corresponding to the touch point is two-finger translation;

When the number of the touch points is five, calculate the second physical distance between the physical coordinates of every two adjacent touch points;

When all the second physical distances are smaller than the fourth threshold, it is obtained that the gesture corresponding to the touch point is five-finger erasing.

In a possible implementation manner, the preset threshold can be automatically adjusted according to the physical data.

For the convenience of description, when describing the above devices, functions are divided into various modules and described separately. Of course, when implementing the present application, the functions of each module can be realized in one or more pieces of software and/or hardware.

The devices in the above embodiments are used to implement the corresponding gesture recognition method in any of the above embodiments, and have the beneficial effects of the corresponding method embodiments, so details are not repeated here.

Based on the same inventive concept, and corresponding to the method in any of the above embodiments, the present application also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and operable on the processor, the processor The gesture recognition method described in any one of the above embodiments is realized when the program is executed.

FIG. 3 shows a schematic diagram of a more specific hardware structure of an electronic device provided by this embodiment. The device may include: a processor 1010 , a memory 1020 , an input/output interface 1030 , a communication interface 1040 and a bus 1050 . The processor 1010 , the memory 1020 , the input/output interface 1030 and the communication interface 1040 are connected to each other within the device through the bus 1050 .

The processor 1010 may be implemented by a general-purpose CPU (Central Processing Unit, central processing unit), a microprocessor, an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), or one or more integrated circuits, and is used to execute related programs to realize the technical solutions provided by the embodiments of this specification.

The memory 1020 may be implemented in the form of ROM (Read Only Memory, read only memory), RAM (Random Access Memory, random access memory), static storage device, dynamic storage device, and the like. The memory 1020 can store operating systems and other application programs. When implementing the technical solutions provided by the embodiments of this specification through software or firmware, the relevant program codes are stored in the memory 1020 and invoked by the processor 1010 for execution.

The input/output interface 1030 is used to connect the input/output module to realize information input and output. The input/output/module can be configured in the device as a component (not shown in the figure), or can be externally connected to the device to provide corresponding functions. The input device may include a keyboard, mouse, touch screen, microphone, various sensors, etc., and the output device may include a display, a speaker, a vibrator, an indicator light, and the like.

The communication interface 1040 is used to connect a communication module (not shown in the figure), so as to realize the communication interaction between the device and other devices. The communication module can realize communication through wired means (such as USB, network cable, etc.), and can also realize communication through wireless means (such as mobile network, WIFI, Bluetooth, etc.).

Bus 1050 includes a path that carries information between the various components of the device (eg, processor 1010, memory 1020, input/output interface 1030, and communication interface 1040).

It should be noted that although the above device only shows the processor 1010, the memory 1020, the input/output interface 1030, the communication interface 1040 and the bus 1050, in the specific implementation process, the device may also include other components. In addition, those skilled in the art can understand that the above-mentioned device may only include components necessary to implement the solutions of the embodiments of this specification, and does not necessarily include all the components shown in the figure.

The electronic device in the foregoing embodiments is used to implement the corresponding gesture recognition method in any of the preceding embodiments, and has the beneficial effects of the corresponding method embodiments, which will not be repeated here.

Those of ordinary skill in the art should understand that: the discussion of any of the above embodiments is exemplary only, and is not intended to imply that the scope of the application (including claims) is limited to these examples; under the thinking of the application, the above embodiments or Combinations of technical features in different embodiments are also possible, steps may be implemented in any order, and there are many other variations of the different aspects of the embodiments of the application as described above, which are not provided in detail for the sake of brevity.

In addition, for simplicity of illustration and discussion, and so as not to obscure the embodiments of the present application, well-known power/connections associated with integrated circuit (IC) chips and other components may or may not be shown in the provided figures. ground connection. Furthermore, devices may be shown in block diagram form in order to avoid obscuring the embodiments of the present application, and this also takes into account the fact that details regarding the implementation of these block diagram devices are highly dependent on the implementation of the embodiments of the present application to be implemented. platform (ie, the details should be well within the purview of those skilled in the art). Where specific details (eg, circuits) have been set forth to describe exemplary embodiments of the present application, it will be apparent to those skilled in the art that other embodiments may be implemented without or with variations from these specific details. Implement the embodiment of the present application below. Accordingly, these descriptions should be regarded as illustrative rather than restrictive.

Although the application has been described in conjunction with specific embodiments thereof, many alternatives, modifications and variations of those embodiments will be apparent to those of ordinary skill in the art from the foregoing description. For example, other memory architectures such as dynamic RAM (DRAM) may use the discussed embodiments.

The embodiments of the present application are intended to embrace all such alternatives, modifications and variations that fall within the broad scope of the appended claims. Therefore, any omissions, modifications, equivalent replacements, improvements, etc. within the spirit and principles of the embodiments of the present application shall be included within the protection scope of the present application.

Claims (10)

1. A gesture recognition method, comprising:

acquiring the number of touch points of a touch screen, and acquiring pixel data of the touch points according to the number of the touch points;

calculating to obtain physical data of the touch points according to the number of the touch points, the pixel data of the touch points, the acquired physical parameters of the touch screen and the acquired resolution of the touch screen;

and obtaining a gesture corresponding to the touch point according to the physical data of the touch point and a preset threshold value.

2. The method of claim 1, wherein the number of touch points is one, and the pixel data of the touch points comprises: the maximum pixel width value of the touch area of the touch point and the maximum pixel height value of the touch area of the touch point.

3. The method of claim 2, wherein the physical parameters of the touch screen comprise: a physical width value of the touch screen and a physical height value of the touch screen;

the resolution of the touch screen includes: a resolution width of the touch screen and a resolution height of the touch screen;

the physical data of the touch point includes: a physical maximum width value of the touch point and a physical maximum height value of the touch point;

the calculating the physical data of the touch points according to the number of the touch points, the pixel data of the touch points, the obtained physical parameters of the touch screen and the obtained resolution of the touch screen comprises:

calculating to obtain a physical maximum width value of the touch point according to the maximum pixel width value of the touch area of the touch point, the physical width value of the touch screen and the resolution width of the touch screen;

and calculating to obtain the physical maximum height value of the touch point according to the maximum pixel height value of the touch area, the physical height value of the touch screen and the resolution height of the touch screen.

4. The method of claim 1, wherein the number of touch points is greater than one, and the pixel data of the touch points comprises: the pixel abscissa value of the central pixel point of the touch point and the pixel ordinate value of the central pixel point of the touch point; and the central pixel point is positioned at the central point of the touch area corresponding to the touch point.

5. The method of claim 4, wherein the physical parameters of the touch screen comprise: a physical width value of the touch screen and a physical height value of the touch screen;

the resolution of the touch screen includes: a resolution width of the touch screen and a resolution height of the touch screen;

the physical data of the touch point comprises a physical abscissa value of the touch point and a physical ordinate value of the touch point;

the calculating the physical data of the touch points according to the number of the touch points, the pixel data of the touch points, the obtained physical parameters of the touch screen and the obtained resolution of the touch screen comprises the following steps:

calculating to obtain a physical abscissa value of the touch point according to a pixel abscissa value of a central pixel point of the touch point, a physical width value of the touch screen and a resolution width of the touch screen;

and calculating to obtain a physical longitudinal coordinate value of the touch point according to the pixel longitudinal coordinate value of the central pixel point of the touch point, the physical height value of the touch screen and the resolution height of the touch screen.

6. The method of claim 3, wherein the gesture corresponding to the touch point comprises: hand back erasing, normal writing and fine writing; the preset threshold includes: a first threshold and a second threshold; the second threshold is less than the first threshold;

obtaining a gesture corresponding to the touch point according to the physical data of the touch point and a preset threshold, wherein the obtaining of the gesture corresponding to the touch point comprises:

when the physical data of any touch point is larger than the first threshold value, acquiring that the gesture corresponding to the touch point is hand back erasure;

when the physical data of all the touch points are smaller than the first threshold value and the physical data of any one touch point are larger than the second threshold value, obtaining that the gesture corresponding to the touch point is normal writing;

and when the physical data of all the touch points are smaller than the second threshold value, obtaining that the gesture corresponding to the touch point is fine-pen writing.

7. The method of claim 5, wherein the gesture corresponding to the touch point comprises: two-finger zoom rotation, two-finger translation and five-finger erasing; the preset threshold includes: a third threshold and a fourth threshold; taking the physical abscissa of the touch point and the physical ordinate of the touch point as the physical coordinate of the touch point;

obtaining a gesture corresponding to the touch point according to the physical data of the touch point and a preset threshold, wherein the obtaining of the gesture corresponding to the touch point comprises:

when the number of the touch points is two, calculating a first physical distance between the two touch points;

when the first physical distance is larger than the third threshold value, obtaining that the gesture corresponding to the touch point is two-finger zooming rotation;

when the first physical distance is smaller than the third threshold value, obtaining that the gesture corresponding to the touch point is two-finger translation;

when the number of the touch points is five, calculating a second physical distance between the physical coordinates of every two adjacent touch points;

and when all the second physical intervals are smaller than the fourth threshold value, obtaining that the gesture corresponding to the touch point is five-finger erasing.

8. The method according to any of claims 1-7, wherein the preset threshold is automatically adjustable based on the physical data.

9. A gesture recognition apparatus, comprising:

the touch screen display control device comprises an acquisition module, a display module and a display module, wherein the acquisition module is configured to acquire the number of touch points of the touch screen and acquire pixel data of the touch points according to the number of the touch points;

the calculation module is configured to calculate physical data of the touch points according to the number of the touch points, the pixel data of the touch points, the acquired physical parameters of the touch screen and the acquired resolution of the touch screen;

and the judging module is configured to obtain a gesture corresponding to the touch point according to the physical data of the touch point and a preset threshold value.

10. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the method according to any of claims 1 to 8 when executing the program.

Images