CN104182052A - Fast interaction method for multimedia devices within effective spatial range - Google Patents

Abstract

The invention discloses a fast interaction method within the effective space range of multimedia equipment, comprising the following steps: synchronizing each equipment through a synchronization signal; generating at least three positioning detection signals between one equipment and each other equipment, each The positioning detection signal is converted into distance information after receiving, and the real-time relative spatial coordinates of the device are obtained by calculating the distance information, and transmitted to the device; each device generates a motion detection signal separately, and calculates the distance of the moving object relative to each device , the device with the smallest distance recognizes the interaction command; when one multimedia device receives the data sending command and the other multimedia device receives the data receiving command, the corresponding data transmission action is executed between the pair of multimedia devices. The method can increase the effective distance, reduce the power consumption of the device, greatly reduce the calculation amount of gesture recognition, and improve the interaction flexibility.

Description

Fast interactive method within effective space range of multimedia equipment

technical field

The invention relates to a method for realizing gesture recognition between devices in a three-dimensional space.

Background technique

As human-computer interaction technology becomes more and more mature, gesture recognition has attracted much attention recently. There are also many principles and methods for recognition technology. Vision-based gesture recognition technology is currently relatively mature and has been applied to some products, while sound-wave-based gesture recognition Technology is also developing. Although the interaction between multiple devices based on gesture recognition is currently very rarely used, it will surely develop rapidly on the basis of mature gesture recognition.

In the field of human-computer interaction, device gesture recognition is to map gestures to computer interaction to convey people's ideas and express a simple command attention. Gestures work with the device's interface based on a certain agreement. In the existing interaction between devices based on gesture recognition, within the common effective distance range of each device, first determine the target device that needs to be interacted with, and then jointly identify and determine the obstacle (for example, the obstacle is a hand) by means of sound wave ranging. Movement mode, according to the movement mode is matched with a certain action agreed in advance in the device, and the agreed operation will be executed if the match is found. The disadvantage of this technology is that the common effective range of each device is relatively small, and the interaction range is limited. When the interaction range is expanded, the power consumption of the device will increase greatly. This is because of the attenuation characteristics of sound wave transmission, and gesture recognition based on sound waves has a certain effective distance. , the effective distance is proportional to the energy of the sound wave, the greater the energy of the sound wave, the greater the power consumption of the device, especially for some portable devices, the power consumption must be strictly controlled; in addition, when multiple devices jointly identify a certain When a gesture is performed, it is difficult for each device to process the received signal, the real-time performance is poor, and the interaction speed is slow. 

Contents of the invention

The purpose of the present invention is to address the shortcomings of the above-mentioned prior art, and propose an improved method for the shortcomings of short interaction distance and large amount of calculation during gesture recognition interaction between multiple devices based on sound waves.

In order to achieve the above purpose, the technical solution is: a fast interaction method within the effective space range of multimedia equipment, which is used to interact between at least two multimedia equipment distributed within the effective space range, and each multimedia equipment is equipped with a signal transmission unit, a signal receiving unit, the method comprises the steps of:

S1: a synchronization step between devices, synchronizing multiple multimedia devices within the effective space through a synchronization signal;

S2: The inter-device positioning step. During positioning, at least three positioning detection signals formed between the signal transmitting unit and the signal receiving unit are generated between one multimedia device and each other multimedia device. Each positioning detection signal is received After being converted into a distance information, the real-time relative spatial coordinates between the multimedia device and each other multimedia device are obtained by calculating multiple distance information, and transmitted to the multimedia device;

S3: Action recognition step. During recognition, each multimedia device generates a motion detection signal respectively, calculates the distance of each moving object relative to each multimedia device, and each multimedia device recognizes the interaction command represented by the moving object with the smallest distance from itself. ;

S4: Instruction response step, each multimedia device executes corresponding actions according to the interactive instructions received respectively. When one multimedia device receives a data sending instruction and another multimedia device receives a data receiving instruction, the pair of multimedia devices Perform corresponding data transfer actions between them.

As a further improvement of the present invention, in the step S2, the positioning detection signal has an agreed frequency, or amplitude, or an agreed number of sending cycles, or an agreed sending time interval.

As a further improvement of the present invention, the sending time of the positioning detection signal is shorter than the sending time of the motion detection signal.

As a further improvement of the present invention, the signal energy of the positioning detection signal is greater than the signal energy of the motion detection signal.

As a further improvement of the present invention, a total of at least four signal receiving units and signal transmitting units are distributed on each multimedia device. the

As a further improvement of the present invention, the position detection signal adopts a sound wave signal, the signal transmitting unit includes a speaker part, and the signal receiving unit includes a microphone part. The present invention is based on sound wave gesture recognition technology, sound wave generator and receiver The transmitter can use the microphone and speaker that comes with the electronic device itself, and can send sound waves of a certain frequency and cycle, with very low power consumption, very little impact on battery life, low cost, and low technical difficulty, which can greatly improve the quality of electronic products. Competitive in peer products, and high resolution, high feasibility.

As a further improvement of the present invention, in the steps S2 and S3, the distance information is calculated by measuring the time difference or intensity difference of the signals received by the positioning signal receiving unit.

As a further improvement of the present invention, the multimedia device includes a portable device or a non-portable device.

As a further improvement of the present invention, the multimedia device includes one or more of a smart phone, a tablet computer, a smart TV, and a notebook computer.

As a further improvement of the present invention, the data transmission between the multimedia devices is realized through bluetooth, wireless local area network, mobile cellular network or near field communication.

With the increasingly widespread application of gesture recognition technology, the interactive function of gesture recognition between multiple electronic devices will also enter a new research field. The solution provided by this patent can improve device interaction without affecting power consumption. The distance can greatly reduce the amount of calculations, improve the speed of device interaction, and the implementation difficulty is low, and the cost of the device will not be increased. the

Description of drawings

Fig. 1 has described the process of determining the relative position of each device according to the method of the present invention;

Fig. 2 has described the process that each device recognizes the gesture closest to the device;

Figure 3 describes the signal processing process when detecting motion.

Detailed ways

The preferred embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings, so that the advantages and features of the present invention can be more easily understood by those skilled in the art, so as to define the protection scope of the present invention more clearly.

Referring to accompanying drawings 1 and 2, the purpose of the present invention is to realize synchronous interactive control of multiple multimedia devices distributed in the space, including two or more electronic devices (which can be portable or non-portable) ), for example, may be one or more of a smart phone, a tablet computer (ipad), a smart TV, and a notebook computer. With the development of technology, there are more and more multimedia devices in people's daily life, and they often encounter scenes that need to be operated between multiple devices at the same time. Two or more electronic devices in a three-dimensional space recognize gestures To interact, each device needs at least one sound generator, three sound receivers, or three sound generators, one sound receiver, or some other number of generators and receivers.

As shown in Figure 1, before interacting, it is first necessary to determine the target device for interaction. The device that sends data needs to determine the location information of the receiving device. One of the devices sends a synchronization signal. After each device is synchronized, it sends a positioning signal. The relative positional relationship between other devices and this device. When within the effective range of the device, the sound wave generator of the device emits a positioning detection signal, and the sound wave is reflected back to the sound wave receiver of the device. After receiving each positioning detection signal, it is converted into a distance information. The calculation of the distance information obtains the real-time relative spatial coordinates between the multimedia device and each other multimedia device, and transmits the coordinates to the multimedia device. Because it is a three-dimensional space, each device must have four or more generators and receivers, for example, one sound wave generator and three sound wave receivers, or other numbers of sound wave generators and sound wave receivers. Calculating the time from emission to reception of the sound wave can provide information about the relative position of the device and other devices.

In the above steps, one device can send a paired coded signal (a special sound wave), other devices receive the sound wave, and the matching multimedia device that receives the paired coded signal returns a confirmation signal to the sender; the special sound wave is agreed in advance The signal, so that the device receiving the sound wave knows that the signal is a positioning signal. For example, the positional sound wave may have the following characteristics: a specific frequency or amplitude, or a specific number of cycles for each sending, or a specific time interval for each sending, and so on. Second, the energy of the sound wave signal is appropriately increased to increase the distance of sound wave transmission. Third, the time for sending the sound wave is short, and the time is: after the device sending the signal sends the sound wave, the receiving device receives the sound wave, and after the calculation is completed, the result is sent back to the device sending the positioning sound wave. For example, two devices are 2 meters apart, and the time from sending the sound wave to receiving the sound wave is 5.88ms. After the calculation is completed, the device receiving the sound wave can send it to the device sending the positioning sound wave through bluetooth, wifi, NFC and other signals. The entire positioning process takes a very short time. This short-term energy increase will not affect power consumption. After the positioning is completed, each device enters the gesture recognition state.

As shown in Figure 2, during action recognition, each multimedia device generates an action detection signal by the positioning signal transmitting unit, and recognizes a predefined interaction command after being received by the positioning signal receiving unit through the reflection of the moving mode and moving direction of the moving object. When multiple devices recognize a certain gesture at the same time, the acoustic signal is reflected and received multiple times, and the processing is very complicated. This patent provides an improved method for gesture recognition in three-dimensional space. Each device only recognizes the gesture above its own device, and the Don't recognize gestures over other devices. In the illustrated scene, two hands can operate in front of two devices at the same time, or multiple people can operate in front of multiple devices at the same time. This method can greatly improve the interaction speed. These devices only need to process the strongest sound wave signal received , the sound wave signal sent by other devices is refracted by hands or obstacles, and the received signal is an interference signal. After filtering out the interference signal with a filter, the gesture mode corresponding to the sound wave signal is judged, and the device performs corresponding data based on these gestures. Transfer processing. In FIG. 2 , 5 and 6 are the acoustic wave receiver and the acoustic wave generator of the device 3 , and 7 and 8 are the acoustic wave receiver and the acoustic wave generator of the device 4 . Hand 1 is the closest to device 3, and device 3 only needs to recognize the movement of hand 1. The hand 2 is closest to the device 4, and the device 4 only needs to recognize the movement of the hand 2. The sound wave signal received by device 4 and reflected by hand 1 is much smaller than the signal reflected by hand 2 received by device 4, so the signal received by device 4 and reflected by hand 1 can be filtered out as a noise signal. Similarly, the sound wave signal reflected by hand 2 received by device 3 is much smaller than the sound wave signal reflected by hand 1, so the signal reflected by hand 2 can be filtered out as noise. The data processing when the device detects the action is shown in Figure 3. When the hand and other obstacles move, the sound wave generator on the device emits sound waves, and the sound wave receiver receives the sound waves. The distance between the hand and other obstacles and these sound wave receivers will also change. Comparing this change, you can know the movement mode of obstacles such as hands, and calculate the distance of the action object relative to each multimedia device. The multimedia device with the smallest distance recognizes the interaction command represented by the action object. The application software in the device has a gesture The recognition library has an agreement on the recognized gesture and the corresponding operation of the device. The movement method is matched with the gesture library of the application software of the device. If it can be matched, the device will perform the corresponding operation under the gesture.

After the electronic device recognizes a specific gesture, each multimedia device executes a corresponding action according to the interaction instruction received respectively. The gesture is a way of cooperating with the interactive interface of the device based on a certain agreement. By recognizing certain agreed gestures, the device that sends data can become the device that receives data, and the device that receives data can also become the device that sends data. The data exchange between devices is very flexible. When multiple devices interact, one of the devices sends data and instructions to other devices, and other devices receive data or instructions. The number of devices receiving data or instructions can be one or more. For example, in a game, after a device recognizes a certain gesture, the device performs the corresponding operation, and then waits for the next gesture to be recognized, and other devices also perform gesture recognition at the same time and perform the corresponding operation. This requires the application software in the device to agree in advance, when multiple devices interact, which gestures will be recognized and which operations will be performed by the device. When one multimedia device receives a data sending instruction and another multimedia device receives a data receiving instruction, a corresponding data transmission action is executed between the pair of multimedia devices. For example, select the file to be transferred. After selecting the file, the hand or input object performs a specific action, such as "pick up", moves to the top of device 2, and then performs a specific action, such as "put down", and the device 2. Identify the movement mode and direction of the action, locate the position of the hand or an input object, and start transmitting the file. The data transmission between device 1 and device 2 can be through wifi, bluetooth, mobile network, NFC, etc., thereby completing a certain interaction between two or more electronic devices.

The present invention interacts between two or more than two electronic devices in a three-dimensional space based on acoustic wave gesture recognition, and sends a positioning acoustic wave with a special cutting energy when locating. When the device interaction enters the gesture recognition stage, each device only recognizes gestures above the device, and does not need to recognize gestures from other devices. By recognizing certain agreed gestures, the device that sends data can become the device that receives data, and the device that receives data can also become the device that sends data. In this patent, each device recognizes the gesture closest to the device, and there is no need to analyze gestures on other devices. If the distance between the devices is relatively close and within the common recognition range, then the sound wave signal will be strong or weak, the sound wave signal reflected back by the gesture closest to the machine is stronger, and the sound wave signal reflected back by the gesture farther away from the machine Weaker, during the processing of the acoustic signal of each device, the weaker signal will be filtered out, and only the stronger signal will be identified. In this way, it is relatively easy for each device to process signals when recognizing gestures, with high accuracy, stronger real-time performance, and faster interaction speed.

In addition, it should be pointed out that the positioning detection signal in the above embodiments uses sound signals or ultrasonic signals. This is because many electronic devices currently have microphone parts and speaker parts. The microphone part can be used as a sound wave receiver, and the speaker part can be used as a sound wave generator. The device does not need to add additional components to the electronic device, does not affect the hardware layout of the device, can increase the stability and reliability of the product, consumes very low power, has very little impact on the battery life, and is low in cost and technically difficult. , can greatly improve the competitiveness of electronic products in the same industry, and has high resolution and high feasibility. It should be pointed out that the positioning method in the present invention can also be calculated by other signals such as optical signals, electromagnetic wave signals, and sound signals.

The above embodiments are only to illustrate the technical concept and characteristics of the present invention. All equivalent changes or modifications shall fall within the protection scope of the present invention.

Claims (10)

1. rapid interactive method within the scope of a multimedia equipment useful space, for mutual to carrying out between distribute within the scope of the useful space at least two multimedia equipments, it is characterized in that, on every multimedia equipment, be provided with signal transmitter unit, signal receiving unit, the method comprises the steps:

S1: equipment room synchronizing step, makes many multimedia equipment synchronizations within the scope of the useful space by synchronizing signal;

S2: equipment room positioning step,, between a multimedia equipment and every other multimedia equipment, produce at least three by the coordinate detection signal forming between described signal transmitter unit, signal receiving unit when the location, each coordinate detection signal is converted into a range information after reception, by the calculating of multiple range informations being obtained to the real-time space coordinate between this multimedia equipment and every other multimedia equipment, and transfer to this multimedia equipment;

S3: action recognition step, when identification, every multimedia equipment produces respectively action detectable signal, calculate each action object respectively with respect to the distance of each multimedia equipment, every multimedia equipment is identified respectively the interactive instruction represented apart from minimum action object with self;

S4: instruction response of step, every multimedia equipment is carried out corresponding action according to the interactive instruction receiving separately respectively, in the time that a multimedia equipment receives data and sends instruction, another multimedia equipment and receive data receiver instruction, between this is to multimedia equipment, carry out corresponding data transmission action.

2. according to rapid interactive method within the scope of the multimedia equipment useful space described in right 1, it is characterized in that: in described step S2, described coordinate detection signal has the frequency of agreement, or amplitude, or the transmission number of cycles of agreement, or the transmission time interval of agreement.

3. according to rapid interactive method within the scope of the multimedia equipment useful space described in right 1, it is characterized in that: the transmitting time of described coordinate detection signal is shorter than the transmitting time of action detectable signal.

4. according to rapid interactive method within the scope of the multimedia equipment useful space described in right 1, it is characterized in that: the signal energy of described coordinate detection signal is greater than moves the signal energy of detectable signal.

5. according to rapid interactive method within the scope of the multimedia equipment useful space described in right 1, it is characterized in that: on every multimedia equipment, be distributed with signal receiving unit and signal transmitter unit that sum is at least 4.

6. according to rapid interactive method within the scope of the multimedia equipment useful space described in right 5, it is characterized in that: described coordinate detection signal adopts acoustic signals, described signal transmitter unit comprises loudspeaker assembly, and described signal receiving unit comprises microphone assembly.

7. according to rapid interactive method within the scope of the multimedia equipment useful space described in right 1, it is characterized in that: in described step S2 and S3, the mistiming or the intensity difference that receive signal by measurement and positioning signal receiving unit calculate range information.

8. according to rapid interactive method within the scope of the multimedia equipment useful space described in right 1, it is characterized in that: described multimedia equipment comprises portable set or non-portable equipment.

9. according to rapid interactive method within the scope of the multimedia equipment useful space described in right 8, it is characterized in that: described multimedia equipment comprises one or more in smart mobile phone, panel computer, intelligent TV set, notebook computer.

10. according to rapid interactive method within the scope of the multimedia equipment useful space described in right 1, it is characterized in that: the data transmission between described multimedia equipment realizes by bluetooth, WLAN (wireless local area network), mobile cellular network or near-field communication.