CN108022601A - The real-time based reminding method of virtual reality and virtual reality device - Google Patents

Abstract

The invention discloses a virtual reality real-time reminder method and a virtual reality device. The virtual reality real-time reminder method comprises: the virtual reality device presets a normal noise parameter range, the normal noise parameter range includes a noise frequency range and a noise intensity range; a microphone is set on the virtual reality device, and the microphone is configured to When the device plays video and audio, it collects external sounds in real time; judges whether the collected external sounds meet the normal noise parameter range; if the external sound does not meet the normal noise parameter range, the virtual reality device sends a prompt to the user. A technical effect of the present invention is that it can send a reminder to the user of the virtual reality effect to attract the user's attention.

Description

Virtual reality real-time reminder method and virtual reality equipment

technical field

The invention belongs to the technical field of virtual reality, and in particular relates to a virtual reality real-time reminder method and a virtual reality device.

Background technique

In recent years, virtual reality technology has developed rapidly. With the continuous improvement of hardware electronic equipment, virtual reality technology can gradually be realized on special equipment or small electronic equipment. Virtual reality technology can bring users a full range of virtual immersion experience. By wearing head-mounted reality equipment and headphones, users can receive the virtual environment created by the equipment. This kind of virtual environment can be applied to daily entertainment, work task simulation and drill, etc., and has broad application prospects.

At this stage, consumers mainly apply virtual reality technology in daily entertainment. In addition to dedicated virtual reality games and audio-visual equipment, technology manufacturers have even introduced a combination of mobile phones, tablet computers and head-mounted display devices to achieve virtual reality effects. This implementation method greatly reduces the difficulty for users to experience virtual reality applications, improves the convenience of applications, and consumers can even use virtual reality devices anytime and anywhere. Commonly, virtual reality software can be installed on the mobile phone, and then the mobile phone is placed in the virtual reality device, and the display screen of the mobile phone is used as the display of the virtual reality device. Consumers can experience virtual reality effects by wearing virtual reality equipment and headsets.

However, as virtual reality effects become easier to achieve, they also bring some technical problems. When users experience virtual reality effects, their vision and hearing are directly interfered by virtual reality equipment and headphones, and they are usually unable to perceive changes in the surrounding environment. If there is an abnormality in the surrounding environment, or other people or equipment convey information to the user, it is difficult for the user to perceive. If the information to be conveyed is very important, or abnormal conditions have occurred in the surrounding environment, this is very unfavorable to the user of the virtual reality device.

Contents of the invention

An object of the present invention is to provide an improved technical solution for virtual reality technology.

According to a first aspect of the present invention, a virtual reality real-time reminder method is provided, including:

The virtual reality device presets a normal noise parameter range, and the normal noise parameter range includes a noise frequency range and a noise intensity range;

A microphone is set on the virtual reality device, and the microphone is configured to collect external sounds in real time when the virtual reality device plays images and audios;

Judging whether the collected external sound conforms to the normal noise parameter range;

If the external sound does not meet the normal noise parameter range, the virtual reality device will send a prompt to the user.

Optionally, the virtual reality device pre-sets vocal reminder conditions, and the vocal reminder conditions include a vocal intensity range;

The virtual reality device is configured to recognize human voices from external sounds picked up by the microphone;

Judging whether the recognized human voice meets the human voice reminder condition;

If the human voice reminder condition is met, the virtual reality device sends a reminder to the user.

Optionally, the human voice reminder condition includes the result of semantic recognition of human voice, a standard reminder voice is preset in the virtual reality device, and the recognized human voice is compared with the standard reminder voice, if the recognized human voice is different from the standard reminder If the voices match, the virtual reality device prompts the user.

Optionally, the virtual reality device performs clear processing on the recognized human voice and plays it to the user.

Optionally, the microphone is configured to collect a predetermined duration of external sound before the virtual reality device plays the video and audio, and the predetermined duration of the external sound of the virtual reality device sets a normal noise parameter range.

Optionally, the prompt sent by the virtual reality device to the user includes at least one of a voice prompt, an image display prompt, and a vibration prompt.

Optionally, the prompt sent by the virtual reality device to the user includes interrupting the played video and audio.

The present invention also provides a virtual reality device configured to perform the above method, including a head-mounted display device and an earphone, the earphone forms a signal connection with the head-mounted display device, and the head-mounted display device A microphone is arranged on the device, and a sound processing module is arranged in the head-mounted display device, and the sound processing module is configured to process external sounds collected by the microphone.

Optionally, the head-mounted display device is provided with a circuit board and a processing chip provided on the circuit board, and the sound processing module is integrated in the circuit board or the processing chip.

According to an embodiment of the present disclosure, the method provided by the present invention can send a reminder to the user of the virtual reality effect to attract the user's attention.

Other features of the present invention and advantages thereof will become apparent from the following detailed description of exemplary embodiments of the present invention with reference to the accompanying drawings.

Description of drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention.

Fig. 1 is a schematic flow chart of the steps of the virtual reality real-time reminder method provided by the present invention;

Fig. 2 is a schematic structural diagram of a virtual reality device provided by the present invention.

Detailed ways

Various exemplary embodiments of the present invention will now be described in detail with reference to the accompanying drawings. It should be noted that the relative arrangements of components and steps, numerical expressions and numerical values set forth in these embodiments do not limit the scope of the present invention unless specifically stated otherwise.

The following description of at least one exemplary embodiment is merely illustrative in nature and in no way taken as limiting the invention, its application or uses.

Techniques, methods and devices known to those of ordinary skill in the relevant art may not be discussed in detail, but where appropriate, such techniques, methods and devices should be considered part of the description.

In all examples shown and discussed herein, any specific values should be construed as exemplary only, and not as limitations. Therefore, other instances of the exemplary embodiment may have different values.

It should be noted that like numerals and letters denote like items in the following figures, therefore, once an item is defined in one figure, it does not require further discussion in subsequent figures.

The present invention provides a virtual reality real-time reminder method, which is used for selectively sending reminders to the user when the user is immersed in the virtual reality effect, so as to prevent the user from being unable to perceive important information or abnormal conditions of the surrounding environment.

As shown in Figure 1, firstly, the normal noise parameter range is preset in the virtual reality device. The environment used by the virtual reality device has normal environmental noise or ambient background sound, which represents the normal conditions of the surrounding environment, and the virtual reality device does not need to issue prompts to the user based on such environmental noise. Therefore, a noise parameter range is preset in the virtual reality device, and if the received sound conforms to the noise parameter range, there is no need to generate a reminder. The normal noise parameter range includes a noise frequency range and a noise intensity range.

The virtual reality device is provided with a microphone for receiving external sounds. At least when the virtual reality device is playing video and audio, the microphone is activated and continuously collects the sound of the surrounding environment.

The real-time reminding method provided by the present invention determines whether the surrounding environment is abnormal or whether there is information that needs to be known by the user according to the sound. When the virtual reality device plays video and audio, it continuously judges whether the collected sound meets the normal noise parameter range. When the surrounding environment is normal, the external sound collected by the microphone will form a stable sound wave. The acoustic parameters of this wave should meet the above-mentioned preset normal noise parameter range, which means that there is no abnormality in the environment around the virtual reality device. .

When the microphone detects an abnormal sound, for example, when the frequency is too high or too low, and the intensity is too strong, the previously formed stable sound wave will change abruptly. If the parameters of the external sound causing sudden changes exceed the preset range of normal noise parameters, it indicates that there is an abnormal situation in the surrounding environment. The virtual reality device sends a prompt message to the user to remind the user that there is an abnormality in the surrounding environment.

In particular, the above-mentioned normal noise parameter range can be set according to conventional environmental noise, and is stored in the running software of the device when the virtual reality device completes processing. For example, under normal circumstances, the noise intensity of the residential environment is 55 decibels, and the noise intensity of the commercial area is 60 decibels, and the virtual reality equipment is usually used in the above two environments. Therefore, it is possible to set the noise intensity of the external sound at 60 decibels as a normal situation. In the above-mentioned environment, if the noise intensity reaches more than 70 decibels, it indicates that an abnormal situation may have occurred. In the above-mentioned environment, the external sound usually does not reach the intensity of more than 70 decibels. Therefore, optionally, the noise intensity range in the normal noise parameter range may be set to be less than or equal to 70 decibels. If the intensity of the external sound detected by the microphone is greater than 70 decibels, or suddenly increases above 70 decibels, a prompt is issued to the user.

Similarly, the noise frequency range in the normal noise parameter range can also be set according to the usual actual situation, which is not limited by the present invention.

Through the method provided by the invention, the user of the virtual reality device can receive a prompt when the surrounding environment is abnormal, and make timely adjustments or stop using the virtual reality device.

Further preferably, the method provided by the present invention can also be configured to be able to recognize human voices, diversify the reminder method of the present invention, and provide users with more accurate and effective reminders. Specifically, as shown in FIG. 1 , the virtual reality device can also preset a human voice reminder condition, and the human voice reminder condition includes a range of human voice intensity. The human voice intensity range means that when the intensity of the surrounding human voice is greater than the human voice intensity range, a prompt needs to be issued to the user for the human voice.

First of all, the software configuration of the virtual reality device can recognize the human voice, and select the human voice from the external sound collected by the microphone. Afterwards, it is judged whether the recognized human voice meets the human voice reminder condition. Finally, if the human voice meets the human voice reminder condition, a prompt is issued to the user.

The general human voice intensity is between 40 and 60 decibels. If the microphone picks up a human voice exceeding 60 decibels, it may be a human voice that needs the user's attention. Optionally, the human voice intensity range in the above human voice reminder condition is greater than 60 decibels. The virtual reality device judges the intensity of the recognized human voice, and if the intensity of the human voice is greater than 60 decibels, a prompt is sent to the user to remind the user that there is a human voice that needs attention.

Preferably, the human voice reminder condition may also include the human voice semantic recognition result. The human voice semantic recognition result refers to: comparing the recognized human voice with the pre-stored standard reminder voice with reminder meaning, if the recognized human voice can match a certain standard reminder voice, it means that the collected The received human voice contains basically the same semantics as the standard reminder voice.

A variety of standard reminder voices can be pre-set in the virtual reality device, and the standard reminder voice includes human voice reminders that the user may receive when actually using the virtual reality device, such as "be careful", "stop the game" and so on. In the actual application of the virtual reality device, if a human voice is recognized from the external sound collected by the microphone, the human voice is compared with the standard reminder voice. If the human voice matches the voice of the standard body type, it means that someone has spoken words to remind the user. Further, the virtual reality device may send a prompt to the user in combination with the above-mentioned condition of whether the human voice conforms to the human voice intensity range.

The advantage of this preferred embodiment is that, by judging the human voice reminder condition, the virtual reality device can filter which of the collected human voices have semantics that require the user's attention. Furthermore, in conjunction with the judgment of the range of human voice intensity, if some of the recognized human voices are of high intensity, meet the voice reminder conditions, and contain semantics that require the user's attention, it is necessary to issue a reminder to the user. Get the user's attention. For example, when someone reminds the user loudly to stop the game, this scenario meets the above two human voice recognition conditions. And if it is just someone making loud noises and what they say does not conform to the result of the semantic recognition of life, there is no need to send a prompt to the user.

In addition, the present invention is not limited to how to compare and match the recognized human voice with the standard reminder voice. This matching method may be full clause matching or partial clause matching, which can be selected by those skilled in the art according to the semantic recognition technology.

The present invention does not limit that the human voice prompting condition must include two conditions: the human voice intensity range and the human voice semantic recognition result, and in other implementation manners, it may also include different and other conditions.

In particular, the present invention also provides an improved means for the method of recognizing human voice and issuing a prompt to the user. When it has been judged that a section of human voice meets the human voice reminder condition, the section of human voice collected by the microphone can be directly cleared, and then directly played to the user through the earphone. This prompting method can directly and effectively let the user know the semantics and intentions of external human voices, so that the user can take corresponding actions.

In addition, in addition to the above-mentioned prompts for abnormal environmental noises, human voices and other sounds, the method of the present invention can also be configured to: identify sounds with specific meanings such as cell phone ringtones and issue prompts to the user. The present invention is not limited thereto.

For the selection of the above normal noise parameter range, the present invention also provides an improved method. The use environment of virtual reality equipment may be different each time, and the intensity of environmental noise may also be different. Preferably, the virtual reality device can be configured to start the microphone before starting to play the video and audio, so that the microphone collects external sounds for a predetermined duration. The virtual reality device determines the parameters of the stable sound wave in its environment according to the external sound of the predetermined duration, and automatically sets the normal parameter range according to the parameters of the smooth sound wave. For example, according to the external sound of the predetermined duration above, the parameters for obtaining a stable sound wave are calculated as follows: the noise intensity is 40 decibels, and the noise frequency is between 500-2000 Hz. Then the virtual reality device can automatically set the noise intensity range to be less than 60 decibels, and the noise frequency range to be 400-3000 Hz.

Optionally, in the method of the present invention, the prompt sent to the user may include at least one of voice prompt, image display prompt and vibration prompt. Through the above prompting methods, the user's attention can be aroused. Voice prompts can be delivered to the user through the headset. The image display prompt may be directly displaying a prompt image or text on the display screen, which can be directly observed by the user. The vibration prompt can be triggered by a vibrator configured in the virtual reality device, and the user can feel it through the wearing part.

In particular, the reminding method provided by the present invention may also include directly interrupting the video and audio played by the virtual reality device. This prompt method directly interrupts the user's virtual reality experience, and is applicable to the obvious abnormality of the external sound detected by the microphone or the receipt of a high-priority human voice reminder.

Another aspect of the present invention also provides a virtual reality device, which can execute the above virtual reality real-time reminder method. As shown in Figure 2, the virtual reality device includes a head-mounted display device 1 and an earphone, the earphone forms a signal connection with the head-mounted display device, the head-mounted display device 1 is provided with a microphone 11, and the head-mounted display device 1 is provided with a microphone 11. A sound processing module is provided in the wearable display device 1 , and the sound processing module is configured to process external sounds collected by the microphone 11 .

The sound processing module is configured to be able to perform the above-mentioned judgment on whether the external sound conforms to the normal noise parameter range, identify the human voice in the external sound, and determine whether the recognized human voice meets the human voice reminder condition, etc.

Optionally, a circuit board is arranged in the head-mounted display device, and a processing chip is arranged on the circuit board. The circuit board and the processing chip are used for computing and executing software to control playing video and audio. The sound processing module may be integrated in the circuit board or processing chip.

Although some specific embodiments of the present invention have been described in detail through examples, those skilled in the art should understand that the above examples are for illustration only and not intended to limit the scope of the present invention. Those skilled in the art will appreciate that modifications can be made to the above embodiments without departing from the scope and spirit of the invention. The scope of the invention is defined by the appended claims.

Claims (9)

1. A virtual reality real-time reminder method is characterized in that, comprising: The virtual reality device presets a normal noise parameter range, and the normal noise parameter range includes a noise frequency range and a noise intensity range; A microphone is set on the virtual reality device, and the microphone is configured to collect external sounds in real time when the virtual reality device plays images and audios; Judging whether the collected external sound conforms to the normal noise parameter range; If the external sound does not meet the normal noise parameter range, the virtual reality device will send a prompt to the user. 2. The virtual reality real-time reminder method according to claim 1, wherein the virtual reality device presets a human voice reminder condition, and the human voice reminder condition includes a voice intensity range; The virtual reality device is configured to recognize human voices from external sounds picked up by the microphone; Judging whether the recognized human voice meets the human voice reminder condition; If the human voice reminder condition is met, the virtual reality device sends a reminder to the user. 3. The virtual reality real-time reminder method according to claim 2, wherein the human voice reminder condition includes a human voice semantic recognition result, a standard reminder voice is preset in the virtual reality device, and the recognized human voice is combined with The standard reminder voice is compared, and if the recognized human voice matches the standard reminder voice, the virtual reality device sends a prompt to the user. 4. The virtual reality real-time reminder method according to claim 2 or 3, characterized in that the virtual reality device performs clear processing on the recognized human voice and plays it to the user. 5. The virtual reality real-time reminder method according to claim 1, wherein the microphone is configured to collect external sounds of a predetermined duration before the virtual reality device plays the video and audio, and the external sound of the predetermined duration of the virtual reality device Set the normal noise parameter range. 6 . The virtual reality real-time reminder method according to claim 1 , wherein the prompt sent by the virtual reality device to the user includes at least one of a voice prompt, an image display prompt, and a vibration prompt. 7 . The virtual reality real-time reminder method according to claim 1 , wherein the prompt sent by the virtual reality device to the user includes interrupting the played video and audio. 8 . 8. A virtual reality device configured to perform the method according to any one of claims 1-7, characterized in that it comprises a head-mounted display device and an earphone, the earphone and the head-mounted The display device forms a signal connection, the head-mounted display device is provided with a microphone, and the head-mounted display device is provided with a sound processing module, and the sound processing module is configured to process external sounds collected by the microphone. 9. The virtual reality device according to claim 8, wherein the head-mounted display device is provided with a circuit board and a processing chip disposed on the circuit board, and the sound processing module is integrated on the circuit board or processing chip.