CN106383597B - Method and device for realizing interaction with intelligent terminal and VR equipment - Google Patents

Abstract

The invention discloses a method and a device for realizing interaction with an intelligent terminal and VR equipment. The method comprises the following steps: setting a data acquisition period with the size equal to a preset time length; acquiring data by using a gyroscope and an acceleration sensor in the intelligent terminal; when a data acquisition period is finished, judging whether the intelligent terminal is in the motion process according to data acquired by the gyroscope in the period; if the intelligent terminal is judged not to be in the motion process, whether the terminal equipment is knocked or not is further judged according to the data collected by the acceleration sensor in the period; and if the operation is judged to be knocked, determining the operation corresponding to the knocking instruction and executing the operation in the intelligent terminal. Therefore, the technical scheme of the invention can ensure the convenience and rapidness of interaction with the intelligent terminal or the VR equipment, the accuracy and reliability of operation judgment of interaction with the intelligent terminal or the VR equipment, reduce misjudgment and enhance the experience of a user.

Description

A method and device for realizing interaction with smart terminals and VR equipment

technical field

The present invention relates to the field of computer technology, in particular to a method and device for realizing interaction with an intelligent terminal and a VR device.

Background technique

In recent years, the interaction between users and smart terminals is no longer limited to the relationship between mechanical input commands and execution commands, but a more realistic and humanized interaction. In particular, virtual reality (VR, Virtual Reality) technology promotes the miniaturization, portability and practicality of the interaction between people and smart terminals (VR devices), and our life becomes more convenient. However, in the existing technologies and products, it is still inconvenient to realize the interaction between users and smart terminals, especially with VR devices. For example, users need to pause, fast-forward, and rewind during video playback. When operating some function keys, in order to eliminate the user's misoperation, the hovering method is usually adopted. After the user locates the focus coordinate on an operation key, he needs to passively wait for 2-3 seconds before the function key can be operated. Such an interactive operation cannot quickly determine the user's intention, wastes the user's time, brings great inconvenience to the user, and affects the user's experience.

SUMMARY OF THE INVENTION

In view of the above problems, the present invention is proposed to provide a method and apparatus for realizing interaction with smart terminals and VR devices that overcome the above problems or at least partially solve the above problems.

According to one aspect of the present invention, a method for realizing interaction with an intelligent terminal is provided, wherein the method includes:

Set the data collection period equal to the preset time length;

Use the gyroscope and acceleration sensor in the smart terminal to collect data;

Whenever a data acquisition cycle ends,

Determine whether the smart terminal is in motion according to the data collected by the gyroscope in this period;

If it is determined that the smart terminal is not in motion, further determine whether the terminal device is knocked according to the data collected by the acceleration sensor in the period;

If it is determined that a tap has been received, the operation corresponding to the tapping instruction is determined and the operation is executed in the smart terminal.

Optionally, judging whether the intelligent terminal is in motion according to the data collected by the gyroscope in this period includes:

Calculate the average value of the three-axis data of the gyroscope in this period respectively;

If the average value of any axis is greater than the first preset threshold, it is determined that the smart terminal is in the process of movement; otherwise, it is determined that the smart terminal is not in the process of movement.

Optionally, judging whether the terminal device is knocked according to the data collected by the acceleration sensor in the period includes:

According to the X, Y, Z three-axis data collected by the acceleration sensor in this period, it is judged whether the change of the X-axis data is less than the preset range, and whether there is a sudden peak in either of the Y-axis and Z-axis data, and if both are judged If yes, it is determined that the terminal device is hit.

Optionally, the judging whether the change of the X-axis data is less than a preset range includes:

Determine whether the average value of the X-axis data in the cycle is less than the second preset threshold and there is no data greater than the third preset threshold in the X-axis data in the cycle, and if it is determined to be yes, determine that the change in the X-axis data is less than the preset range .

Optionally, the judging whether there is a burst peak in any of the Y-axis and Z-axis data includes:

In the Y-axis/Z-axis data in this period, if the number of data higher than the fourth preset threshold is less than n, and the average value of the highest m data is less than the fifth preset threshold, it is determined that there is a burst peak; wherein m is greater than n.

Optionally, the method further includes:

If it is determined that the smart terminal is in motion, the detection in the period is terminated and the data collected in the period is cleared;

And, if it is determined that there is no knock, the detection in this period is terminated and the data collected in this period is cleared.

Optionally, wherein, determining the operation corresponding to the tapping instruction includes:

Determine the operation corresponding to the percussion instruction according to the predefined percussion instruction and the corresponding relationship of the execution operation;

or,

It is judged whether the operable area on the display interface of the smart terminal is selected, and if so, the execution operation corresponding to the operable area is regarded as the operation corresponding to the tapping instruction.

According to another aspect of the present invention, a method for interacting with a VR device is provided, wherein the method includes:

Set the data collection period equal to the preset time length;

Use the acceleration sensor in the VR device to collect data;

Whenever a data acquisition cycle ends,

Determine whether the interactive area in the VR video interface is selected;

If the interactive area is selected, judge whether the VR device is knocked according to the data collected by the acceleration sensor in this period;

If it is determined that a tap is received, the operation corresponding to the selected interactive area is performed.

Optionally, the method further includes:

Use the gyroscope in the VR device to collect data;

Before the step of judging whether the VR device is struck according to the data collected by the acceleration sensor in the cycle, determine whether the VR device is in motion according to the data collected by the gyroscope in the cycle; if it is determined that the VR device is not in motion, Then execute the step of judging whether the terminal device is knocked according to the data collected by the acceleration sensor in the period.

Optionally, judging whether the VR device is in motion according to the data collected by the gyroscope in this period includes:

Calculate the average value of the three-axis data of the gyroscope in this period respectively;

If the average value of any axis is greater than the first preset threshold, it is determined that the VR device is in the process of movement, otherwise it is determined that the VR device is not in the process of movement.

Optionally, the judging whether the interactive area in the VR video interface is selected includes:

It is determined whether the user's focus in the VR video interface falls on the interactive area and the stay time exceeds a preset time period, and if it is determined to be yes, it is determined that the interactive area is selected.

Optionally, performing the operation corresponding to the selected interactable area includes:

According to the control keys drawn in the interactive area, corresponding operations are performed on the VR video.

Optionally, judging whether the terminal device is knocked according to the data collected by the acceleration sensor in the period includes:

According to the X, Y, Z three-axis data collected by the acceleration sensor in this period, it is judged whether the change of the X-axis data is less than the preset range, and whether there is a sudden peak in either of the Y-axis and Z-axis data, and if both are judged If yes, it is determined that the terminal device is hit.

Optionally, the judging whether the change of the X-axis data is less than a preset range includes:

Determine whether the average value of the X-axis data in the cycle is less than the second preset threshold and there is no data greater than the third preset threshold in the X-axis data in the cycle, and if it is determined to be yes, determine that the change in the X-axis data is less than the preset range .

Optionally, the judging whether there is a burst peak in any of the Y-axis and Z-axis data includes:

For the Y-axis/Z-axis data in this period, if the number of data higher than the fourth preset threshold is less than n, and the average value of the highest m data is less than the fifth preset threshold, it is determined that there is a burst peak; where m greater than n.

Optionally, the method further includes:

If it is determined that the VR device is in motion, the detection in this period is terminated and the data collected in this period is cleared;

And, if it is determined that there is no knock, the detection in this period is terminated and the data collected in this period is cleared.

According to yet another aspect of the present invention, an apparatus for realizing interaction with a smart terminal is provided, wherein the apparatus includes:

a setting unit, suitable for setting a data collection period whose size is equal to a preset time length;

The data acquisition unit is suitable for collecting data by using the gyroscope and the acceleration sensor in the smart terminal;

The detection unit is adapted to determine whether the smart terminal is in the process of movement according to the data collected by the gyroscope in the cycle when the data collection cycle ends; if it is determined that the smart terminal is not in the process of movement, then further according to the data collected by the acceleration sensor in the cycle The data judges whether the terminal equipment is knocked; if it is judged to be knocked, the execution unit is notified;

The execution unit is adapted to, after receiving the notification, determine the operation corresponding to the tapping instruction and execute the operation in the intelligent terminal.

Optionally, the detection unit is adapted to calculate the average value of the three-axis data of the gyroscope in the cycle respectively; if the average value of any axis is greater than the first preset threshold, it is determined that the intelligent terminal is in the process of movement, otherwise it is determined that The smart terminal is not in motion.

Optionally, the detection unit is adapted to judge whether the change of the X-axis data is less than a preset range according to the X, Y, Z three-axis data collected by the acceleration sensor in this period, and to judge whether the Y-axis and Z-axis data are any. Whether there is a sudden peak in one of them, and if both are judged to be yes, it is determined that the terminal device is knocked.

Optionally, the detection unit is adapted to determine whether the mean value of the X-axis data in the cycle is less than the second preset threshold and there is no data greater than the third preset threshold in the X-axis data in the cycle, and if it is determined to be yes Then it is determined that the change of the X-axis data is less than the preset range.

Optionally, the detection unit is adapted to when, in the X-axis/Y-axis data in the period, the number of data higher than the fourth preset threshold is less than n, and the mean value of the highest m data is less than the fifth preset threshold. When the threshold is set, it is determined that there is a burst peak; where m is greater than n.

Optionally, the detection unit is adapted to terminate the detection in this period and clear the data collected in this period when it is judged that the intelligent terminal is in motion; Detects in a period and clears the data collected in this period.

Optionally, the execution unit is adapted to determine the operation corresponding to the tapping instruction according to the predefined corresponding relationship between the tapping instruction and the execution operation; or, is adapted to determine whether the operable area on the display interface of the smart terminal is is selected, if it is selected, the execution operation corresponding to the operable area is regarded as the operation corresponding to the tapping instruction.

According to yet another aspect of the present invention, an apparatus for realizing interaction with a VR device is provided, wherein the apparatus includes:

a setting unit, suitable for setting a data collection period whose size is equal to a preset time length;

The data acquisition unit is suitable for collecting data by using the acceleration sensor in the VR device;

The detection unit is adapted to judge whether the interactive area in the VR video interface is selected every time a data collection period ends; if the interactive area is selected, judge whether the VR device is knocked according to the data collected by the acceleration sensor in the period Strike; if it is judged to be struck, notify the execution unit;

The execution unit is adapted to execute the operation corresponding to the selected interactive area after receiving the notification.

Optionally, the data collection unit is further adapted to use a gyroscope in the VR device to collect data;

The detection unit is further adapted to determine whether the VR device is in motion according to the data collected by the gyroscope in the cycle before the step of judging whether the VR device is knocked according to the data collected by the acceleration sensor in the cycle; if It is judged that the VR device is not in motion, and then the step of judging whether the terminal device is knocked according to the data collected by the acceleration sensor in the period is performed.

Optionally, the detection unit is adapted to respectively calculate the average value of the three-axis data of the gyroscope in the period; if the average value of any axis is greater than the first preset threshold, it is determined that the VR device is in motion, otherwise, it is determined that the VR device is in motion. The VR device is not in motion.

Optionally, the detection unit is adapted to determine whether the user's focus in the VR video interface falls on the interactable area and the stay time exceeds a preset time period, and if the determination is yes, it is determined that the interactable area is selected.

Optionally, the execution unit performs corresponding operations on the VR video according to the control keys drawn in the interactable area.

Optionally, the detection unit is adapted to judge whether the change of the X-axis data is less than a preset range according to the X, Y, Z three-axis data collected by the acceleration sensor in this period, and to judge whether the Y-axis and Z-axis data are any. Whether there is a sudden peak in one of them, and if both are judged to be yes, it is determined that the terminal device is knocked.

Optionally, the detection unit is adapted to determine whether the mean value of the X-axis data in the cycle is less than the second preset threshold and there is no data greater than the third preset threshold in the X-axis data in the cycle, and if it is determined to be yes Then it is determined that the change of the X-axis data is less than the preset range.

Optionally, the detection unit is adapted to the X-axis/Y-axis data in this period, if the number of data higher than the fourth preset threshold is less than n, the mean value of the highest m data is less than the fifth preset. Threshold, it is determined that there is a burst peak; where m is greater than n.

Optionally, the detection unit is adapted to terminate the detection in the period and clear the data collected in the period when it is judged that the VR device is in motion; Detects in a period and clears the data collected in this period.

According to the technical solution of the present invention, in the process of interacting with the intelligent terminal, the existing gyroscope and acceleration sensor in the intelligent terminal are fully utilized to collect data within a set time period to determine whether the intelligent terminal is in the process of movement. If the judgment is NO, it is further judged whether the smart terminal is knocked, and if it is judged as yes again, the operation corresponding to the knocking instruction is executed. That is to say, in the process of using the smart terminal, if the user wants to perform the operation of a certain function key, he no longer needs to wait for 2-3 seconds. Instead, the user can confirm the operation of the function key by tapping the smart terminal to achieve the same The interaction of the intelligent terminal is convenient and fast; at the same time, in order to eliminate the misoperation of the user when using the intelligent terminal during exercise and reduce misjudgment, the collected data is used to judge whether the intelligent terminal is in the process of exercise, which ensures the intelligent terminal to the user's operation. Accuracy and reliability of judgment. It can be seen that the technical solution of the present invention ensures the convenience and speed of interaction with the intelligent terminal, reduces the passive waiting time of the user, and ensures the accuracy and reliability of the operation judgment of the interaction with the intelligent terminal, which can reduce misjudgments and enhance the user experience.

The above description is only an overview of the technical solutions of the present invention, in order to be able to understand the technical means of the present invention more clearly, it can be implemented according to the content of the description, and in order to make the above and other purposes, features and advantages of the present invention more obvious and easy to understand , the following specific embodiments of the present invention are given.

Description of drawings

Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are for the purpose of illustrating preferred embodiments only and are not to be considered limiting of the invention. Also, the same components are denoted by the same reference numerals throughout the drawings. In the attached image:

1 shows a flowchart of a method for implementing interaction with an intelligent terminal according to an embodiment of the present invention;

FIG. 2 shows a flowchart of a method for implementing interaction with a VR device according to an embodiment of the present invention;

3 shows a schematic diagram of an apparatus for implementing interaction with a smart terminal according to an embodiment of the present invention;

FIG. 4 shows a schematic diagram of an apparatus for implementing interaction with a VR device according to an embodiment of the present invention.

Detailed ways

Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided so that the present disclosure will be more thoroughly understood, and will fully convey the scope of the present disclosure to those skilled in the art.

FIG. 1 shows a flowchart of a method for implementing interaction with an intelligent terminal according to an embodiment of the present invention. As shown in Figure 1, the method includes:

Step S110, setting a data collection period equal to a preset time length.

Because this method needs to judge whether the smart terminal is in the process of running and tapping, the movement or tapping is a continuous process, so the judgment process is not based on the time data of a specific point, but Judgment is made according to whether the data in a period of time conforms to the characteristics of movement or tapping. Therefore, at the beginning, a preset time length needs to be set, and the magnitude of the preset time length is very small to ensure the real-time nature of the user's operation process. , which will not make the user feel the time delay in the execution of the operation. For example, the preset time length may be set to the order of milliseconds, such as 300ms.

Step S120, using the gyroscope and the acceleration sensor in the smart terminal to collect data.

Both the gyroscope and the acceleration sensor in this step are functional modules built into the smart terminal (mobile phone, tablet computer, etc.), and can periodically collect data within the above preset time period to provide data basis for the judgment process.

In step S130, each time a data collection period ends, it is judged whether the smart terminal is in motion according to the data collected by the gyroscope in the period.

It is conceivable that when a user performs interactive operations using a smart terminal, it is basically performed in a static or stable state. The method first needs to judge whether the smart terminal is in motion, which can prevent the user from misoperation when using the smart terminal during the motion, further reduce misjudgment, and ensure the accuracy and reliability of the operation judgment interacting with the smart terminal. In this step, it is determined whether the intelligent terminal is in the process of movement according to the data collected by the gyroscope in the period, which means whether the collected data conforms to the data characteristics of the movement state.

Step S140, if it is determined that the smart terminal is in motion, no processing is performed; if it is determined that the smart terminal is not in motion, it is further determined whether the terminal device is knocked according to the data collected by the acceleration sensor in the period.

In step S150, if it is determined that a tap is received, the operation corresponding to the tapping instruction is determined and the operation is executed in the smart terminal; if it is determined that the tap is not received, no processing is performed.

When the user needs to perform a certain function operation, the focus coordinate will be placed on the corresponding function operation. If the user decides to perform the operation, there is no need to wait. Just tap the smart terminal. After the smart terminal judges that it is a tapping action, confirm The operation corresponding to the tapping instruction is executed in the intelligent terminal, so as to realize the convenience of the interaction between the user and the intelligent terminal.

To sum up, according to the technical solution of the present invention, in the process of interacting with the smart terminal, the existing gyroscope and acceleration sensor in the smart terminal are fully utilized to collect data within a set time period to determine whether the smart terminal is in the During the movement, if it is judged as NO, it is further judged whether the intelligent terminal has been tapped, and if it is judged as yes again, the operation corresponding to the tap instruction is executed. That is to say, in the process of using the smart terminal, if the user wants to perform the operation of a certain function key, he no longer needs to wait for the hovering time of 2-3 seconds, and the operation of the function key can be performed by tapping the smart terminal. Confirmation, realizing convenient and quick interaction with the smart terminal and reducing the passive waiting time of the user; at the same time, in order to eliminate the misoperation of the user when using the smart terminal during exercise and reduce misjudgment, the collected data is used to check whether the smart terminal is in the process of exercising. This ensures the accuracy and reliability of the intelligent terminal's operation judgment on the user's operation.

The angular velocity of the moving equipment on the X, Y and Z axes of the space coordinate will have a large value or fluctuation. By comparing the average value of the acceleration on the three coordinate axes with a preset value, it can be judged Whether the device is in motion, and the preset value must meet the basic magnitude of acceleration in motion. Therefore, in an embodiment of the present invention, the angular velocity data of the smart terminal is collected by the gyroscope, and in step S130, determining whether the smart terminal is in motion according to the data collected by the gyroscope in the cycle includes: separately calculating the gyroscope in the cycle. The average value of the three-axis data; if the average value of any axis is greater than the first preset threshold, it is determined that the smart terminal is in the process of movement, otherwise it is determined that the smart terminal is not in the process of movement.

If the device is knocked, the characteristics of the acceleration change on its spatial coordinates are: the data on the X-axis is basically stable and unchanged; the Y-axis has a small burst peak; the Z-axis has a large burst peak. Therefore, when judging whether the device is knocked, the acceleration data characteristics on the three axes of the device can be judged respectively. In an embodiment of the present invention, in step S140, judging whether the terminal device is knocked according to the data collected by the acceleration sensor in the period includes: according to the X, Y, Z three-axis data collected by the acceleration sensor in the period, judging X Whether the change of the axis data is less than the preset range, and whether there is a sudden peak in either of the Y-axis and Z-axis data, if both are determined to be yes, it is determined that the terminal device is knocked. It is necessary to judge whether the change of the X-axis data is smaller than the preset range, because when the device receives a tap, the X-axis data will be affected and will no longer remain unchanged, but will float in a small range. If it floats within the range, it can be determined that the data of the X-axis is basically stable. Therefore, a variation range is preset here first, and as long as the data of the X-axis floats within the variation range, it can be determined that the data of the X-axis is basically stable.

Further, judging whether the change of the X-axis data is less than a preset range includes: judging whether the average value of the X-axis data in the cycle is less than a second preset threshold, that is, the X-axis data is basically stable, and no individual sudden change peak affects the X-axis data; And it is judged that there is no data greater than the third preset threshold in the X-axis data in this period, that is, it is further ensured that the X-axis data has no sudden change peak. If the judgment is all yes, it is determined that the change of the X-axis data is less than the preset range, indicating that the X-axis data is within the preset range. data is basically stable.

Specifically, judging whether there is a burst peak in any of the Y-axis and Z-axis data includes:

In the Y-axis/Z-axis data in this period, if the number of data higher than the fourth preset threshold is less than n, and the mean value of the highest m (m>n) data is less than the fifth preset threshold, it is determined that there are Burst peak. The characteristic of the burst peak in the periodic data is that the value corresponding to the burst peak is much larger than the value of other data in the period, otherwise it may be a gentle fluctuation peak in the period. In this embodiment, the number of data higher than the fourth preset threshold is less than n, in order to determine that there is a small amount of large-value data on the Y-axis/Z-axis, that is, there may be a burst peak; the highest m (m>n) The mean value of the data is less than the fifth preset threshold, which specifically refers to taking out the m maximum data greater than n in the data of the Y-axis/Z-axis to take the average value, and the m data includes the above-mentioned large value greater than the fourth preset threshold. The data also includes data less than the fourth preset threshold. If the large value data is a burst peak, the data less than the fourth preset threshold in the m data is much smaller than the large value data, and the averaged value must be For a small data, preset a fifth preset threshold to ensure that the averaged value is less than the fifth preset threshold, and further determine that there are a small number of burst peaks in the data, rather than the flatness of the Y-axis/Z-axis data. fluctuating peaks. For example, if n is set to 3, the fourth preset threshold is 7m/s ² , and the fifth preset threshold is 5m/s ² ; if there are four Y-axis data collected in the period greater than 7m/s ² If the data is 10m/s ² , 9m/s ² , 8m/s ² and 8m/s ² , it does not meet the condition that the number of data above the fourth preset threshold is less than n, that is, there is no sudden peak in the Y-axis data; If there are only two data 10m/s ² and 8m/s ^{2 greater than 7m/s 2 ,} the Y-axis data meets the condition that the number of data above the fourth preset threshold is less than n, and there may be a burst peak; further, Take the largest data of m=5 in the Y-axis data, if the five largest data of the Y-axis data are 10m/s ² , 8m/s ² , 7m/s ² , 6m/s ² and 5m/s ² , take After averaging, it is 7.2m/s ² , then the mean value of the highest m=5 data is less than the fifth preset threshold 5m/s ² , here 10m/s ² , 8m/s ² , 7m/s ² , 6m/ There is little difference between the values of the five data of s ² and 5m/s ² , which means that the Y-axis data only has a gentle fluctuation peak, not a sudden peak; if the five largest data of the Y-axis data are 10m/s ² , 8m/s ² , 2m/s ² , 1m/s ² and 1m/s ² , the average is 4.2m/s ² , and the mean value of the highest m=5 data is less than the fifth preset threshold 5m/s ² , indicating that the peaks corresponding to the two values of 10m/s ² and 8m/s ² are burst peaks, that is, there are burst peaks in the Y-axis data. It can also be seen from here that 10m/s ² and 8m/s ² are compared. 2m/s ² , 1m/s ² and 1m/s ² are much larger, which are in line with the characteristics of burst peaks.

In an embodiment of the present invention, the method shown in FIG. 1 further includes: if it is determined that the smart terminal is in motion, terminating the detection in the period and clearing the data collected in the period.

And, if it is determined that there is no knock, the detection in this period is terminated and the data collected in this period is cleared.

In an embodiment of the present invention, determining the operation corresponding to the knocking instruction in step S150 includes: determining the operation corresponding to the knocking instruction according to the predefined correspondence between the knocking instruction and the execution operation, that is to say, in advance Set a specific command, the triggering operation of this specific command is a tapping action, and when a tapping action is detected, the command is executed correspondingly. For example, specify a pause as a specific command, and when it is determined to be a tap action, the video being played will be paused.

Or, determine whether the operable area or function button on the display interface of the smart terminal is selected, and if so, the execution operation corresponding to the operable area or function button is regarded as the operation corresponding to the tapping instruction, if the operable area is not selected. Or the function button, it may be the user's misoperation, and no action will be taken. For example, the operable area or function button may be a pause key, a stop key, or a fast-forward key, etc., and the operation corresponding to the tapping instruction refers to the operation of the corresponding pause, stop or fast-forward instruction.

Fig. 2 shows a flowchart of a method for implementing interaction with a VR device according to an embodiment of the present invention. As shown in Figure 2, the method includes:

Step S210, setting a data collection period equal to a preset time length.

Step S220, using the acceleration sensor in the VR device to collect data.

When using a VR device, it is used in conjunction with a smart terminal such as a mobile phone. For example, when the mobile phone is inserted into the VR device, when collecting data, the acceleration sensor in the mobile phone inserted into the VR device can be used to collect data.

Step S230, each time a data collection period ends, determine whether the interactive area in the VR video interface is selected.

The user may accidentally touch the VR device when using the VR device. When the user touches the VR device by mistake, the interactive area in the video interface may not be selected. First, determine whether the interactive area is selected to avoid the accidental touch by the user. The next step is to go to the next step, which wastes effective resources; and when the user interacts with the VR device, only after first judging whether the interactive area is selected, can it be ensured that the corresponding operation can be performed after it is judged as a tapping action.

In step S240, if the interactive area is selected, it is determined whether the VR device is knocked according to the data collected by the acceleration sensor in the period. If the interactable area is not selected, nothing is done.

In step S250, if it is determined that a tap has been received, the operation corresponding to the selected interactable area is executed.

In one embodiment of the present invention, the method shown in FIG. 2 further includes:

In order to determine whether the VR device is in motion, it is necessary to use the gyroscope in the VR device to collect data.

Before the step of judging whether the VR device is hit according to the data collected by the acceleration sensor in the cycle in step S240, it is judged whether the VR device is in motion according to the data collected by the gyroscope in the cycle; if it is judged that the VR device is not in the motion process , and then perform the step of judging whether the terminal device is knocked according to the data collected by the acceleration sensor in the period.

Specifically, judging whether the VR device is in motion according to the data collected by the gyroscope in the period includes: calculating the average value of the three-axis data of the gyroscope in the period respectively; if the average value of any axis is greater than the first preset threshold, Then it is determined that the VR device is in the process of exercising, otherwise it is determined that the VR device is not in the process of exercising.

In one embodiment of the present invention, judging whether the interactive area in the VR video interface is selected in step S230 includes: judging whether the user's focus in the VR video interface falls on the interactive area and the stay time exceeds a preset time length, if judging whether the user's focus in the VR video interface falls on the interactive area If yes, make sure that the interactive area is selected. When users use VR devices to watch videos, they can watch videos in an omni-directional space. In order to ensure the convenience of interaction between users and VR devices, a focus should be set at the center of the user's line of sight when watching videos. , you need to move the focus to the interactive area. Then, in this embodiment, judging whether the interactive area is selected is to judge whether the user's focus falls on the interactive area; in addition, when the user is watching the video, he can watch from various angles, and it may happen that the user's focus is on the interactive area. In order to prevent misjudgment in this situation, it is necessary to judge whether the user's focus falls on the interactive area and at the same time it is necessary to judge whether the user's focus in the interactive area exceeds the preset time. If yes, it is determined that the interactive area is selected. If it is judged to be no, it means that the user's focus is not in the interactive area or just glanced over the interactive area during the viewing process, and no processing is performed.

In an embodiment of the present invention, performing the operation corresponding to the selected interactive area in step S250 includes: performing a corresponding operation on the VR video according to the control keys drawn in the interactive area.

In an embodiment of the present invention, in step S240, judging whether the terminal device is knocked according to the data collected by the acceleration sensor in the period includes: according to the X, Y, Z three-axis data collected by the acceleration sensor in the period, judging the X axis Whether the change of the data is less than the preset range, and whether there is a sudden peak in any one of the Y-axis and Z-axis data, if both are determined to be yes, it is determined that the terminal device is knocked.

Specifically, judging whether the change of the X-axis data is less than the preset range includes:

Determine whether the average value of the X-axis data in the cycle is less than the second preset threshold and there is no data greater than the third preset threshold in the X-axis data in the cycle, and if it is determined to be yes, determine that the change in the X-axis data is less than the preset range .

Further, judging whether there is a burst peak in any of the Y-axis and Z-axis data includes:

For the Y-axis/Z-axis data in this period, if the number of data higher than the fourth preset threshold is less than n, and the mean value of the highest m (m>n) data is less than the fifth preset threshold, it is determined that there is a sudden peak.

In one embodiment of the present invention, the method shown in FIG. 2 further includes:

If it is judged that the VR device is in motion, the detection in the period is terminated and the data collected in the period is cleared; and, if it is judged that the VR device is not hit, the detection in the period is terminated and the data collected in the period is cleared data.

It should be noted that the method shown in FIG. 2 corresponds to each embodiment of the method shown in FIG. 1 , which has been described in detail above and will not be repeated here.

Fig. 3 shows a schematic diagram of an apparatus for implementing interaction with a smart terminal according to an embodiment of the present invention. As shown in FIG. 3, the apparatus 300 for realizing interaction with an intelligent terminal includes:

a setting unit 310, adapted to set a data collection period whose size is equal to a preset time length;

a data acquisition unit 320, adapted to collect data by using a gyroscope and an acceleration sensor in the smart terminal;

The detection unit 330 is adapted to judge whether the smart terminal is in the process of movement according to the data collected by the gyroscope in the cycle whenever a data collection cycle ends; if it is judged that the smart terminal is not in the process of movement, then further according to the acceleration sensor in the cycle The collected data judges whether the terminal equipment is knocked; if it is judged to be knocked, the execution unit is notified;

The execution unit 340 is adapted to, after receiving the notification, determine the operation corresponding to the tapping instruction and execute the operation in the smart terminal.

In an embodiment of the present invention, the detection unit 330 is adapted to respectively calculate the average value of the three-axis data of the gyroscope in the period; if the average value of any axis is greater than the first preset threshold, it is determined that the smart terminal is in the process of movement , otherwise it is determined that the smart terminal is not in motion.

In an embodiment of the present invention, the detection unit 330 is adapted to determine whether the change of the X-axis data is less than a preset range, and to determine whether the change of the X-axis data is less than a preset range, and determine whether the Y-axis and Z-axis data are collected by the acceleration sensor in the period. Whether there is a sudden peak in any of the axis data, and if both are judged to be yes, it is determined that the terminal device is struck.

Specifically, the detection unit 330 is adapted to determine whether the average value of the X-axis data in the period is less than the second preset threshold and there is no data greater than the third preset threshold in the X-axis data in the period, and if it is determined to be yes, determine The change in the X-axis data is smaller than the preset range.

Further, the detection unit 330 is adapted to when, in the X-axis/Y-axis data in the period, the number of data higher than the fourth preset threshold is less than n, and the mean value of the highest m (m>n) data is less than At the fifth preset threshold, it is determined that there is a sudden peak.

In one embodiment of the present invention, the detection unit 330 is adapted to terminate the detection in the period and clear the data collected in the period when it is determined that the smart terminal is in the process of movement; , the detection in this period is terminated and the data collected in this period is cleared.

In an embodiment of the present invention, the execution unit 340 is adapted to determine the operation corresponding to the tapping instruction according to the predefined correspondence between the tapping instruction and the execution operation; or, is adapted to determine the operation on the display interface of the smart terminal. Whether the operable area is selected, if so, the execution operation corresponding to the operable area is regarded as the operation corresponding to the tapping instruction.

It should be noted that each embodiment of the apparatus shown in FIG. 3 corresponds to each embodiment of the method shown in FIG. 1 , which has been described in detail above and will not be repeated here.

FIG. 4 shows a schematic diagram of an apparatus for implementing interaction with a VR device according to an embodiment of the present invention. As shown in FIG. 4 , the apparatus 400 for realizing interaction with a VR device includes:

The setting unit 410 is adapted to set a data collection period whose size is equal to a preset time length;

a data acquisition unit 420, adapted to collect data by using an acceleration sensor in the VR device;

The detection unit 430 is adapted to judge whether the interactable area in the VR video interface is selected every time a data collection period ends; if the interactive area is selected, judge whether the VR device is affected by the data collected by the acceleration sensor in the period. Knock; if it is judged to be knocked, the execution unit is notified;

The execution unit 440 is adapted to execute the operation corresponding to the selected interactable area after receiving the notification.

In an embodiment of the present invention, the data collection unit 420 is further adapted to collect data by using a gyroscope in the VR device;

Then the detection unit 430 is further adapted to determine whether the VR device is in motion according to the data collected by the gyroscope in the cycle before the step of judging whether the VR device is struck according to the data collected by the acceleration sensor in the cycle; When the device is not in motion, the step of judging whether the terminal device is knocked according to the data collected by the acceleration sensor in the period is performed again.

Further, the detection unit 430 is adapted to calculate the average value of the three-axis data of the gyroscope in the period respectively; if the average value of any axis is greater than the first preset threshold, it is determined that the VR device is in motion, otherwise it is determined that the VR device is in motion not during exercise.

In one embodiment of the present invention, the detection unit 430 is adapted to determine whether the user's focus in the VR video interface falls on the interactive area and stays for longer than a preset time period, and if it is determined to be yes, it is determined that the interactive area is selected.

In one embodiment of the present invention, the execution unit 440 performs corresponding operations on the VR video according to the control keys drawn in the interactive area.

In an embodiment of the present invention, the detection unit 430 is adapted to determine whether the change of the X-axis data is less than a preset range, and to determine whether the change of the X-axis data is less than a preset range, and determine whether the Y-axis and Z-axis Whether there is a sudden peak in any of the axis data, and if both are judged to be yes, it is determined that the terminal device is struck.

Specifically, the detection unit 430 is adapted to determine whether the mean value of the X-axis data in the period is less than the second preset threshold and there is no data greater than the third preset threshold in the X-axis data in the period, and if it is determined to be yes, then determine The change in the X-axis data is smaller than the preset range.

Further, the detection unit 430 is adapted to the X-axis/Y-axis data in this cycle, if the number of data higher than the fourth preset threshold is less than n, the mean value of the highest m (m>n) data is less than the th Five preset thresholds, it is determined that there is a sudden peak.

In one embodiment of the present invention, the detection unit 430 is adapted to terminate the detection in the period and clear the data collected in the period when it is determined that the VR device is in motion; , the detection in this period is terminated and the data collected in this period is cleared.

It should be noted that each embodiment of the apparatus shown in FIG. 4 corresponds to each embodiment of the method shown in FIG. 2 , which has been described in detail above and will not be repeated here.

To sum up, according to the technical solution of the present invention, in the process of interacting with the smart terminal, the existing gyroscope and acceleration sensor in the smart terminal are fully utilized to collect data within a set time period to determine whether the smart terminal is in the During the movement, if it is judged as NO, it is further judged whether the intelligent terminal has been tapped, and if it is judged as yes again, the operation corresponding to the tap instruction is executed. That is to say, in the process of using the smart terminal, if the user wants to perform an operation of a function key, he no longer needs to wait for 2-3 seconds, and can confirm the operation of the function key by gently tapping the smart terminal. Realize the convenience and speed of interaction with the intelligent terminal; at the same time, in order to eliminate the misoperation of the user when using the intelligent terminal during exercise and reduce misjudgment, the collected data is used to judge whether the intelligent terminal is in the process of exercise, and the intelligent terminal is guaranteed to the user. The accuracy and reliability of operational judgments. It can be seen that the technical solution of the present invention ensures the convenience and speed of interaction with the intelligent terminal, reduces the passive waiting time of the user, and ensures the accuracy and reliability of the operation judgment of the interaction with the intelligent terminal, which can reduce misjudgments and enhance the user experience.

It should be noted:

The algorithms and displays provided herein are not inherently related to any particular computer, virtual appliance, or other device. Various general-purpose devices can also be used with the teachings based on this. The structure required to construct such a device is apparent from the above description. Furthermore, the present invention is not directed to any particular programming language. It is to be understood that various programming languages may be used to implement the inventions described herein, and that the descriptions of specific languages above are intended to disclose the best mode for carrying out the invention.

In the description provided herein, numerous specific details are set forth. It will be understood, however, that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.

Similarly, it is to be understood that in the above description of exemplary embodiments of the invention, various features of the invention are sometimes grouped together into a single embodiment, figure, or its description. This disclosure, however, should not be construed as reflecting an intention that the invention as claimed requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the Detailed Description are hereby expressly incorporated into this Detailed Description, with each claim standing on its own as a separate embodiment of this invention.

Those skilled in the art will understand that the modules in the device in the embodiment can be adaptively changed and arranged in one or more devices different from the embodiment. The modules or units or components in the embodiments may be combined into one module or unit or component, and further they may be divided into multiple sub-modules or sub-units or sub-assemblies. All features disclosed in this specification (including accompanying claims, abstract and drawings) and any method so disclosed may be employed in any combination, unless at least some of such features and/or procedures or elements are mutually exclusive. All processes or units of equipment are combined. Each feature disclosed in this specification (including accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.

Furthermore, those skilled in the art will appreciate that although some of the embodiments described herein include certain features, but not others, included in other embodiments, that combinations of features of different embodiments are intended to be within the scope of the invention within and form different embodiments. For example, in the following claims, any of the claimed embodiments may be used in any combination.

Various component embodiments of the present invention may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. Those skilled in the art should understand that a microprocessor or a digital signal processor (DSP) may be used in practice to implement some or all of the components of the apparatus for implementing interaction with a smart terminal and a VR device according to embodiments of the present invention. some or all functions. The present invention can also be implemented as apparatus or apparatus programs (eg, computer programs and computer program products) for performing part or all of the methods described herein. Such a program implementing the present invention may be stored on a computer-readable medium, or may be in the form of one or more signals. Such signals may be downloaded from Internet sites, or provided on carrier signals, or in any other form.

It should be noted that the above-described embodiments illustrate rather than limit the invention, and that alternative embodiments may be devised by those skilled in the art without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention can be implemented by means of hardware comprising several different elements and by means of a suitably programmed computer. In a unit claim enumerating several means, several of these means may be embodied by one and the same item of hardware. The use of the words first, second, and third, etc. do not denote any order. These words can be interpreted as names.

The present invention provides A1, a method for realizing interaction with an intelligent terminal, wherein the method includes:

Set the data collection period equal to the preset time length;

Use the gyroscope and acceleration sensor in the smart terminal to collect data;

Whenever a data acquisition cycle ends,

Determine whether the smart terminal is in motion according to the data collected by the gyroscope in this period;

If it is determined that the smart terminal is not in motion, further determine whether the terminal device is knocked according to the data collected by the acceleration sensor in the period;

If it is determined that a tap has been received, the operation corresponding to the tapping instruction is determined and the operation is executed in the smart terminal.

A2. The method of A1, wherein the determining whether the smart terminal is in motion according to the data collected by the gyroscope in the cycle includes:

Calculate the average value of the three-axis data of the gyroscope in this period respectively;

If the average value of any axis is greater than the first preset threshold, it is determined that the smart terminal is in the process of movement; otherwise, it is determined that the smart terminal is not in the process of movement.

A3. The method according to A1, wherein the determining whether the terminal device is knocked according to the data collected by the acceleration sensor in the period includes:

According to the X, Y, Z three-axis data collected by the acceleration sensor in this period, it is judged whether the change of the X-axis data is less than the preset range, and whether there is a sudden peak in either of the Y-axis and Z-axis data, and if both are judged If yes, it is determined that the terminal device is hit.

A4. The method according to A3, wherein the judging whether the change of the X-axis data is less than a preset range includes:

Determine whether the average value of the X-axis data in the cycle is less than the second preset threshold and there is no data greater than the third preset threshold in the X-axis data in the cycle, and if it is determined to be yes, determine that the change in the X-axis data is less than the preset range .

A5. The method according to A3, wherein the judging whether there is a burst peak in any one of the Y-axis and Z-axis data includes:

In the Y-axis/Z-axis data in this period, if the number of data higher than the fourth preset threshold is less than n, and the average value of the highest m data is less than the fifth preset threshold, it is determined that there is a burst peak; wherein m is greater than n.

A6. The method of A1, wherein the method further comprises:

If it is determined that the smart terminal is in motion, the detection in the period is terminated and the data collected in the period is cleared;

And, if it is determined that there is no knock, the detection in this period is terminated and the data collected in this period is cleared.

A7. The method according to any one of A1-A6, wherein determining the operation corresponding to the tapping instruction includes:

Determine the operation corresponding to the percussion instruction according to the predefined percussion instruction and the corresponding relationship of the execution operation;

or,

It is judged whether the operable area on the display interface of the smart terminal is selected, and if so, the execution operation corresponding to the operable area is regarded as the operation corresponding to the tapping instruction.

The present invention also provides B8, a method for realizing interaction with a VR device, wherein the method includes:

Set the data collection period equal to the preset time length;

Use the acceleration sensor in the VR device to collect data;

Whenever a data acquisition cycle ends,

Determine whether the interactive area in the VR video interface is selected;

If the interactive area is selected, judge whether the VR device is knocked according to the data collected by the acceleration sensor in this period;

If it is determined that a tap is received, the operation corresponding to the selected interactive area is performed.

B9. The method of B8, wherein the method further comprises:

Use the gyroscope in the VR device to collect data;

Before the step of judging whether the VR device is struck according to the data collected by the acceleration sensor in the cycle, determine whether the VR device is in motion according to the data collected by the gyroscope in the cycle; if it is determined that the VR device is not in motion, Then execute the step of judging whether the terminal device is knocked according to the data collected by the acceleration sensor in the period.

B10. The method according to B9, wherein determining whether the VR device is in motion according to the data collected by the gyroscope in the cycle includes:

Calculate the average value of the three-axis data of the gyroscope in this period respectively;

If the average value of any axis is greater than the first preset threshold, it is determined that the VR device is in the process of movement, otherwise it is determined that the VR device is not in the process of movement.

B11. The method according to B8, wherein the determining whether the interactable area in the VR video interface is selected includes:

It is determined whether the user's focus in the VR video interface falls on the interactive area and the stay time exceeds a preset time period, and if it is determined to be yes, it is determined that the interactive area is selected.

B12. The method according to B8, wherein the performing the operation corresponding to the selected interactable area includes:

According to the control keys drawn in the interactive area, corresponding operations are performed on the VR video.

B13. The method according to B8, wherein the determining whether the terminal device is knocked according to the data collected by the acceleration sensor in the period includes:

According to the X, Y, Z three-axis data collected by the acceleration sensor in this period, it is judged whether the change of the X-axis data is less than the preset range, and whether there is a sudden peak in either of the Y-axis and Z-axis data, and if both are judged If yes, it is determined that the terminal device is hit.

B14. The method according to B13, wherein the judging whether the change of the X-axis data is less than a preset range includes:

Determine whether the average value of the X-axis data in the cycle is less than the second preset threshold and there is no data greater than the third preset threshold in the X-axis data in the cycle, and if it is determined to be yes, determine that the change in the X-axis data is less than the preset range .

B15. The method according to B13, wherein the judging whether there is a burst peak in any one of the Y-axis and Z-axis data includes:

For the Y-axis/Z-axis data in this period, if the number of data higher than the fourth preset threshold is less than n, and the average value of the highest m data is less than the fifth preset threshold, it is determined that there is a burst peak; where m greater than n.

B16. The method of B9, wherein the method further comprises:

If it is determined that the VR device is in motion, the detection in this period is terminated and the data collected in this period is cleared;

And, if it is determined that there is no knock, the detection in this period is terminated and the data collected in this period is cleared.

The present invention also provides C17, a device for realizing interaction with an intelligent terminal, wherein the device includes:

a setting unit, suitable for setting a data collection period whose size is equal to a preset time length;

The data acquisition unit is suitable for collecting data by using the gyroscope and the acceleration sensor in the smart terminal;

The detection unit is adapted to determine whether the smart terminal is in the process of movement according to the data collected by the gyroscope in the cycle when the data collection cycle ends; if it is determined that the smart terminal is not in the process of movement, then further according to the data collected by the acceleration sensor in the cycle The data judges whether the terminal equipment is knocked; if it is judged to be knocked, the execution unit is notified;

The execution unit is adapted to, after receiving the notification, determine the operation corresponding to the tapping instruction and execute the operation in the intelligent terminal.

C18. The apparatus of C17, wherein,

The detection unit is adapted to calculate the average value of the three-axis data of the gyroscope in the period respectively; if the average value of any axis is greater than the first preset threshold, it is determined that the smart terminal is in the process of movement, otherwise it is determined that the smart terminal is not in motion in the process.

C19. The apparatus of C17, wherein,

The detection unit is suitable for judging whether the change of the X-axis data is less than the preset range according to the X, Y, Z three-axis data collected by the acceleration sensor in this period, and whether there is any one of the Y-axis and Z-axis data. Burst peaks, if both are judged to be yes, it is determined that the terminal device is knocked.

C20. The apparatus of C19, wherein,

The detection unit is adapted to determine whether the average value of the X-axis data in the cycle is less than the second preset threshold and there is no data greater than the third preset threshold in the X-axis data in the cycle, and if it is determined to be yes, determine the X-axis The change in data is less than the preset range.

C21. The apparatus of C19, wherein,

The detection unit is adapted to when, in the X-axis/Y-axis data in the period, the number of data higher than the fourth preset threshold is less than n, and the mean value of the highest m data is less than the fifth preset threshold, A burst peak is determined; where m is greater than n.

C22. The apparatus of C17, wherein,

The detection unit is adapted to terminate the detection in the period and clear the data collected in the period when it is judged that the smart terminal is in motion; and, when it is judged that it has not been knocked, terminate the detection in the period And clear the data collected in this period.

C23. The device of any one of C17-C22, wherein,

The execution unit is suitable for determining the operation corresponding to the knocking instruction according to the predefined knocking instruction and the corresponding relationship of the execution operation; or, suitable for judging whether the operable area on the display interface of the intelligent terminal is selected, if If it is selected, the execution operation corresponding to the operable area is regarded as the operation corresponding to the tapping instruction.

The present invention also provides D24, an apparatus for realizing interaction with VR equipment, wherein the apparatus includes:

a setting unit, suitable for setting a data collection period whose size is equal to a preset time length;

The data acquisition unit is suitable for collecting data by using the acceleration sensor in the VR device;

The detection unit is adapted to judge whether the interactive area in the VR video interface is selected every time a data collection period ends; if the interactive area is selected, judge whether the VR device has been knocked according to the data collected by the acceleration sensor in the period Strike; if it is judged to be struck, notify the execution unit;

The execution unit is adapted to execute the operation corresponding to the selected interactive area after receiving the notification.

D25. The device of D24, wherein,

The data acquisition unit is further adapted to use the gyroscope in the VR device to collect data;

The detection unit is further adapted to determine whether the VR device is in motion according to the data collected by the gyroscope in the cycle before the step of judging whether the VR device is knocked according to the data collected by the acceleration sensor in the cycle; if It is judged that the VR device is not in motion, and then the step of judging whether the terminal device is knocked according to the data collected by the acceleration sensor in the period is performed.

D26. The device of D25, wherein,

The detection unit is adapted to calculate the average value of the three-axis data of the gyroscope in the period respectively; if the average value of any axis is greater than the first preset threshold, it is determined that the VR device is in motion, otherwise it is determined that the VR device is not in motion in the process.

D27. The device of D24, wherein,

The detection unit is adapted to determine whether the user's focus in the VR video interface falls on the interactable area and the staying time exceeds a preset time period, and if it is determined to be yes, it is determined that the interactable area is selected.

D28. The device of D24, wherein,

The execution unit performs corresponding operations on the VR video according to the control keys drawn in the interactable area.

D29. The device of D24, wherein,

The detection unit is suitable for judging whether the change of the X-axis data is less than the preset range according to the X, Y, Z three-axis data collected by the acceleration sensor in this period, and whether there is any one of the Y-axis and Z-axis data. Burst peaks, if both are judged to be yes, it is determined that the terminal device is knocked.

D30. The device of D29, wherein,

The detection unit is adapted to determine whether the average value of the X-axis data in the cycle is less than the second preset threshold and there is no data greater than the third preset threshold in the X-axis data in the cycle, and if it is determined to be yes, determine the X-axis The change in data is less than the preset range.

D31. The device of D29, wherein,

The detection unit is adapted to, for the X-axis/Y-axis data in the cycle, if the number of data higher than the fourth preset threshold is less than n, and the average value of the highest m data is less than the fifth preset threshold, then determine There are burst peaks; where m is greater than n.

D32. The apparatus of D24, wherein,

The detection unit is adapted to terminate the detection in the period and clear the data collected in the period when it is determined that the VR device is in motion; and, when it is determined that the VR device is not hit, terminate the detection in the period And clear the data collected in this period.

Claims (26)

1. A method for realizing interaction with an intelligent terminal is provided, wherein the method comprises the following steps:

setting a data acquisition period with the size equal to a preset time length;

acquiring data by using a gyroscope and an acceleration sensor in the intelligent terminal;

each time a data acquisition cycle is completed,

judging whether the intelligent terminal is in the motion process according to the data acquired by the gyroscope in the period so as to prevent misoperation when a user uses the intelligent equipment in the motion process;

if the intelligent terminal is judged not to be in the motion process, whether the terminal equipment is knocked or not is further judged according to the data collected by the acceleration sensor in the period;

if the intelligent terminal is judged to be knocked, determining the operation corresponding to the knocking instruction and executing the operation in the intelligent terminal;

wherein the operation corresponding to the tapping instruction is determined according to a user focus in the VR video interface;

the method further comprises the following steps:

if the intelligent terminal is judged to be in the motion process, stopping the detection in the period and clearing the data collected in the period;

and if the knocking is judged not to be received, terminating the detection in the period and clearing the data collected in the period.

2. The method of claim 1, wherein the determining whether the intelligent terminal is in motion according to the data collected by the gyroscope in the period comprises:

respectively calculating the average value of the three-axis data of the gyroscope in the period;

and if the average value of any axis is larger than a first preset threshold value, determining that the intelligent terminal is in the motion process, otherwise, determining that the intelligent terminal is not in the motion process.

3. The method of claim 1, wherein the determining whether the terminal device is knocked according to the data collected by the acceleration sensor in the period comprises:

and judging whether the change of the X-axis data is smaller than a preset range or not and whether any one of the Y-axis data and the Z-axis data has a sudden peak or not according to X, Y, Z triaxial data acquired by the acceleration sensor in the period, and if so, determining that the terminal equipment is knocked.

4. The method of claim 3, wherein the determining whether the change of the X-axis data is less than a preset range comprises:

and judging whether the mean value of the X-axis data in the period is smaller than a second preset threshold value and whether data larger than a third preset threshold value does not exist in the X-axis data in the period, and if so, determining that the change of the X-axis data is smaller than a preset range.

5. The method of claim 3, wherein the determining whether there is a burst peak in any of the Y-axis and Z-axis data comprises:

in Y-axis or Z-axis data in the period, if the number of data higher than a fourth preset threshold is less than n and the average value of the highest m data is less than a fifth preset threshold, determining that a burst peak exists; wherein m is greater than n.

6. The method of any of claims 1-5, wherein determining an operation corresponding to a tap instruction comprises:

determining an operation corresponding to the tapping instruction according to a predefined corresponding relation between the tapping instruction and the execution operation;

or,

judging whether an operable area on a display interface of the intelligent terminal is selected, and if so, taking the execution operation corresponding to the operable area as the operation corresponding to the knocking instruction.

7. A method of enabling interaction with a VR device, wherein the method comprises:

setting a data acquisition period with the size equal to a preset time length;

acquiring data by using an acceleration sensor in VR equipment;

each time a data acquisition cycle is completed,

judging whether an interactive area in a VR video interface is selected;

if the interactive area is selected, judging whether the VR equipment is knocked according to data collected by the acceleration sensor in the period;

if the touch is judged to be touched, the operation corresponding to the selected interactive area is executed;

the method further comprises the following steps:

acquiring data by using a gyroscope in VR equipment;

before the step of judging whether the VR equipment is knocked according to the data collected by the acceleration sensor in the period, judging whether the VR equipment is in the motion process according to the data collected by the gyroscope in the period; if the VR equipment is judged not to be in the motion process, the step of judging whether the terminal equipment is knocked or not according to the data collected by the acceleration sensor in the period is executed;

the method further comprises the following steps:

if the VR equipment is judged to be in the motion process, the detection in the period is stopped, and the data collected in the period are cleared;

and if the knocking is judged not to be received, terminating the detection in the period and clearing the data collected in the period.

8. The method of claim 7, wherein determining whether the VR device is in motion based on the data collected by the gyroscope during the period comprises:

respectively calculating the average value of the three-axis data of the gyroscope in the period;

and if the average value of any axis is larger than a first preset threshold value, determining that the VR device is in the process of moving, otherwise, determining that the VR device is not in the process of moving.

9. The method of claim 7, wherein the determining whether an interactable region in the VR video interface is selected comprises:

judging whether a user focus in a VR video interface is in an interactive area and the stay time exceeds a preset time length, and if so, determining that the interactive area is selected.

10. The method of claim 7, wherein the performing the operation corresponding to the selected interactive area comprises:

and executing corresponding operation on the VR video according to the control keys drawn in the interactive area.

11. The method as claimed in claim 7, wherein the determining whether the terminal device is knocked according to the data collected by the acceleration sensor during the period comprises:

and judging whether the change of the X-axis data is smaller than a preset range or not and whether any one of the Y-axis data and the Z-axis data has a sudden peak or not according to X, Y, Z triaxial data acquired by the acceleration sensor in the period, and if so, determining that the terminal equipment is knocked.

12. The method of claim 11, wherein the determining whether the change of the X-axis data is less than a preset range comprises:

and judging whether the mean value of the X-axis data in the period is smaller than a second preset threshold value and whether data larger than a third preset threshold value does not exist in the X-axis data in the period, and if so, determining that the change of the X-axis data is smaller than a preset range.

13. The method of claim 11, wherein the determining whether there is a burst peak in any one of the Y-axis and Z-axis data comprises:

for Y-axis or Z-axis data in the period, if the number of data higher than a fourth preset threshold is less than n and the average value of the highest m data is less than a fifth preset threshold, determining that a burst peak exists; wherein m is greater than n.

14. An apparatus for realizing interaction with a smart terminal, wherein the apparatus comprises:

the setting unit is suitable for setting a data acquisition period with the size equal to the preset time length;

the data acquisition unit is suitable for acquiring data by utilizing a gyroscope and an acceleration sensor in the intelligent terminal;

the detection unit is suitable for judging whether the intelligent terminal is in the motion process or not according to the data collected by the gyroscope in the period when one data collection period is finished so as to prevent misoperation when a user uses the intelligent equipment in the motion process; if the intelligent terminal is judged not to be in the motion process, whether the terminal equipment is knocked or not is further judged according to the data collected by the acceleration sensor in the period; if the knocking is judged to be received, the execution unit is informed;

the execution unit is suitable for determining the operation corresponding to the knocking instruction and executing the operation in the intelligent terminal after receiving the notification;

wherein the operation corresponding to the tapping instruction is determined according to a user focus in the VR video interface;

the detection unit is suitable for terminating the detection in the period and clearing the data collected in the period when the intelligent terminal is judged to be in the motion process; and when the knocking is judged not to be received, terminating the detection in the period and clearing the data collected in the period.

15. The apparatus of claim 14, wherein,

the detection unit is suitable for respectively calculating the average value of the three-axis data of the gyroscope in the period; and if the average value of any axis is larger than a first preset threshold value, determining that the intelligent terminal is in the motion process, otherwise, determining that the intelligent terminal is not in the motion process.

16. The apparatus of claim 14, wherein,

and the detection unit is suitable for judging whether the change of the X-axis data is smaller than a preset range or not and judging whether any one of the Y-axis data and the Z-axis data has a burst peak or not according to the X, Y, Z three-axis data acquired by the acceleration sensor in the period, and if so, determining that the terminal equipment is knocked.

17. The apparatus of claim 16, wherein,

the detection unit is suitable for judging whether the mean value of the X-axis data in the period is smaller than a second preset threshold value and whether data larger than a third preset threshold value does not exist in the X-axis data in the period, and if the mean value of the X-axis data in the period is smaller than the second preset threshold value, the change of the X-axis data is determined to be smaller than a preset range.

18. The apparatus of claim 16, wherein,

the detection unit is suitable for determining that a burst peak exists when the number of data higher than a fourth preset threshold in X-axis or Y-axis data in the period is less than n and the average value of the highest m data is less than a fifth preset threshold; wherein m is greater than n.

19. The apparatus of any one of claims 14-18,

the execution unit is suitable for determining the operation corresponding to the knocking instruction according to the corresponding relation of the predefined knocking instruction and the execution operation; or, the method is suitable for judging whether an operable area on a display interface of the intelligent terminal is selected, and if the operable area is selected, the execution operation corresponding to the operable area is used as the operation corresponding to the tapping instruction.

20. An apparatus that enables interaction with a VR device, wherein the apparatus comprises:

the setting unit is suitable for setting a data acquisition period with the size equal to the preset time length;

the data acquisition unit is suitable for acquiring data by utilizing an acceleration sensor in the VR equipment;

the detection unit is suitable for judging whether an interactive area in the VR video interface is selected or not when one data acquisition cycle is finished; if the interactive area is selected, judging whether the VR equipment is knocked according to data collected by the acceleration sensor in the period; if the knocking is judged to be received, the execution unit is informed;

the execution unit is suitable for executing the operation corresponding to the selected interactive area after receiving the notification;

the data acquisition unit is further suitable for acquiring data by utilizing a gyroscope in the VR device;

the detection unit is further suitable for judging whether the VR equipment is in the motion process according to the data collected by the gyroscope in the period before the step of judging whether the VR equipment is knocked according to the data collected by the acceleration sensor in the period; if the VR equipment is judged not to be in the motion process, the step of judging whether the terminal equipment is knocked or not according to the data collected by the acceleration sensor in the period is executed;

the detection unit is suitable for terminating the detection in the period and clearing the data collected in the period when the VR equipment is judged to be in the motion process; and when the knocking is judged not to be received, terminating the detection in the period and clearing the data collected in the period.

21. The apparatus of claim 20, wherein,

the detection unit is suitable for respectively calculating the average value of the three-axis data of the gyroscope in the period; and if the average value of any axis is larger than a first preset threshold value, determining that the VR device is in the process of moving, otherwise, determining that the VR device is not in the process of moving.

22. The apparatus of claim 20, wherein,

the detection unit is suitable for judging whether a user focus in the VR video interface is in an interactive area and the stay time exceeds preset time, and if yes, the interactive area is determined to be selected.

23. The apparatus of claim 20, wherein,

and the execution unit executes corresponding operation on the VR video according to the control key drawn in the interactive area.

24. The apparatus of claim 20, wherein,

and the detection unit is suitable for judging whether the change of the X-axis data is smaller than a preset range or not and judging whether any one of the Y-axis data and the Z-axis data has a burst peak or not according to the X, Y, Z three-axis data acquired by the acceleration sensor in the period, and if so, determining that the terminal equipment is knocked.

25. The apparatus of claim 24, wherein,

the detection unit is suitable for judging whether the mean value of the X-axis data in the period is smaller than a second preset threshold value and whether data larger than a third preset threshold value does not exist in the X-axis data in the period, and if the mean value of the X-axis data in the period is smaller than the second preset threshold value, the change of the X-axis data is determined to be smaller than a preset range.

26. The apparatus of claim 24, wherein,

the detection unit is suitable for determining that a burst peak exists if the number of data higher than a fourth preset threshold is less than n and the average value of the highest m data is less than a fifth preset threshold for Y-axis or Z-axis data in the period; wherein m is greater than n.

Images