[ summary of the invention ]
In order to solve the technical problem, the application provides an intelligent left-right ear identification method and related equipment.
In a first aspect, the present application provides a left-right ear intelligent identification method, including:
detecting whether a user wears an earphone device;
if the user wears the earphone device, judging whether a first reference vein image of a first ear and a second reference vein image of a second ear are stored or not;
if the first reference vein image and the second reference vein image are stored, acquiring a first actual vein image through a first earphone, or acquiring a second actual vein image through a second earphone; matching the first actual vein image with the first reference vein image, or the second actual vein image with the second reference vein image, or the first actual vein image with the second reference vein image, or the second actual vein image with the first reference vein image;
if the first actual vein image is matched with the first reference vein image or the second actual vein image is matched with the second reference vein image, determining that the first actual vein image and the first earphone correspond to the first ear part and the second actual vein image and the second earphone correspond to the second ear part;
if the first actual vein image is not matched with the first reference vein image, or the second actual vein image is not matched with the second reference vein image, and the first actual vein image is not matched with the second reference vein image, or the second actual vein image is not matched with the first reference vein image, acquiring a general left ear vein image and a general right ear vein image, and matching the first actual vein image, the second actual vein image, the acquired general left ear vein image and the acquired general right ear vein image;
if the first actual vein image is matched with the general left ear vein image or the second actual vein image is matched with the general right ear vein image, determining that the first actual vein image and the first earphone correspond to the first ear and the second actual vein image and the second earphone correspond to the second ear;
if the first reference vein image and the second reference vein image are not stored, acquiring a third actual vein image and a fourth actual vein image through the first earphone and/or the second earphone;
according to the user instruction, storing the third actual vein image as the first reference vein image, and storing the fourth actual vein image as the second reference vein image;
and sending indication information indicating the first earphone and the second earphone to a terminal connected with the first earphone and the second earphone.
In a possible implementation manner, the left-right ear intelligent identification method further includes: if the first actual vein image is matched with the second reference vein image, or the second actual vein image is matched with the first reference vein image, it is determined that the first actual vein image corresponds to the second ear with the first earphone, and the second actual vein image corresponds to the first ear with the second earphone.
In a possible implementation manner, the left-right ear intelligent identification method further includes: and if the first actual vein image is matched with the second reference vein image or the second actual vein image is matched with the first reference vein image, sending indication information indicating the first earphone and the second earphone to the terminal.
In a possible implementation manner, the left-right ear intelligent identification method further includes: if first actual vein image with general right ear vein image matching, perhaps second actual vein image with general left ear vein image matching, confirm first actual vein image with first earphone corresponds the second ear, just second actual vein image with the second earphone corresponds first ear.
In a possible implementation manner, the left-right ear intelligent identification method further includes: and if the first actual vein image is matched with the general right ear vein image or the second actual vein image is matched with the general left ear vein image, sending indication information indicating the first earphone and the second earphone to the terminal.
In a second aspect, the present application provides a headset device comprising a wear detection sensor, one or more processors, one or more memories, a first headset, a second headset:
the wear detection sensor is used for detecting headset movement and/or posture data;
the one or more memories are arranged in the first earphone and/or the second earphone for storing one or more programs;
the one or more processors are to, when the one or more programs are executed, cause the headset device to perform the following:
determining whether a user wears the earphone device according to the detection data of the wearing detection sensor, and if the user wears the earphone device, judging whether a first reference vein image of a first ear and a second reference vein image of a second ear are stored;
if the first reference vein image and the second reference vein image are stored, the first earphone acquires a first actual vein image, or the second earphone acquires a second actual vein image; matching the first actual vein image with the first reference vein image, or the second actual vein image with the second reference vein image, or the first actual vein image with the second reference vein image, or the second actual vein image with the first reference vein image;
if the first actual vein image is matched with the first reference vein image or the second actual vein image is matched with the second reference vein image, determining that the first actual vein image and the first earphone correspond to the first ear part and the second actual vein image and the second earphone correspond to the second ear part;
if the first actual vein image is not matched with the first reference vein image, or the second actual vein image is not matched with the second reference vein image, and the first actual vein image is not matched with the second reference vein image, or the second actual vein image is not matched with the first reference vein image, acquiring a general left ear vein image and a general right ear vein image, and matching the first actual vein image, the second actual vein image, the acquired general left ear vein image and the acquired general right ear vein image;
if the first actual vein image is matched with the general left ear vein image or the second actual vein image is matched with the general right ear vein image, determining that the first actual vein image and the first earphone correspond to the first ear and the second actual vein image and the second earphone correspond to the second ear;
if the first reference vein image and the second reference vein image are not stored, the first earphone and/or the second earphone collects a third actual vein image and a fourth actual vein image;
storing the third actual vein image as the first reference vein image to the memory and the fourth actual vein image as the second reference vein image to the memory according to a user instruction;
and sending indication information indicating the first earphone and the second earphone to a terminal connected with the earphone device.
In a possible implementation manner, if the first actual vein image matches the second reference vein image, or the second actual vein image matches the first reference vein image, it is determined that the first actual vein image and the first earphone correspond to the second ear, and the second actual vein image and the second earphone correspond to the first ear.
In a possible implementation manner, if the first actual vein image matches the second reference vein image, or the second actual vein image matches the first reference vein image, sending indication information indicating the first earphone and the second earphone to the terminal.
In a possible implementation manner, if the first actual vein image matches with the general right ear vein image, or the second actual vein image matches with the general left ear vein image, it is determined that the first actual vein image corresponds to the first ear, and the second actual vein image corresponds to the second ear.
In a possible implementation manner, if the first actual vein image is matched with the general right ear vein image, or the second actual vein image is matched with the general left ear vein image, indication information indicating the first earphone and the second earphone is sent to the terminal.
In a third aspect, the present application provides a computer-readable storage medium comprising instructions that, when executed on an electronic device, cause the electronic device to perform the method.
In a fourth aspect, the present application provides a computer program product comprising instructions which, when run on an electronic device, cause the electronic device to perform the method.
In the present application, the headset device stores the first and second reference vein images and acquires the first and second actual vein images. Then, the headphone apparatus matches the first actual vein image or the second actual vein image with the first reference vein image or the second reference vein image. Like this, the accurate left ear that corresponds owner user of first earphone of discernment of earphone device and the right ear that corresponds owner user of second earphone. Then, the earphone device transmits indication information indicating the first earphone and the second earphone to a terminal connected to the first earphone and the second earphone. Thus, the earphone device informs the terminal that the first earphone corresponds to the left ear of the owner user and the second earphone corresponds to the right ear of the owner user. The headset device requests the terminal to transmit a left channel signal to the first headset and a right channel signal to the second headset. In addition, the ear speaker device acquires a general left ear vein image and a general right ear vein image. Then, the headphone apparatus matches the first actual vein image or the second actual vein image with the common left ear vein image and the common right ear vein image. Like this, the accurate discernment of earphone device is first earphone to correspond non-owner user's left ear and the second earphone corresponds non-owner user's right ear. The earphone device sends indication information indicating the first earphone and the second earphone to a terminal connected with the first earphone and the second earphone. Thus, the headset informs the terminal that the first headset corresponds to the left ear of the non-owner user and the second headset corresponds to the right ear of the non-owner user. The headset device requests the terminal to transmit a left channel signal to the first headset and a right channel signal to the second headset. The left ear of the owner user or the non-owner user listens to the left channel signal, and the right ear of the owner user or the non-owner user listens to the right channel signal. Therefore, the user who is the owner or the user who is not the owner can normally listen to the stereo sound without watching the earphone device with both eyes and adjusting the earphone device with both hands, and the listening experience is excellent.
[ detailed description ] embodiments
For better understanding of the technical solutions of the present invention, the following detailed descriptions of the embodiments of the present invention are provided with reference to the accompanying drawings.
It should be understood that the described embodiments are only some embodiments of the invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The terminology used in the embodiments of the invention is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in the examples of the present invention and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
It should be understood that the term "and/or" as used herein is merely one type of association that describes an associated object, meaning that three relationships may exist, e.g., a and/or B may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" herein generally indicates that the former and latter related objects are in an "or" relationship.
It should be understood that although the terms first, second, etc. may be used herein to describe devices in accordance with embodiments of the present invention, these devices should not be limited by these terms. These terms are only used to distinguish one device from another. For example, a first device may also be referred to as a second device, and similarly, a second device may also be referred to as a first device, without departing from the scope of embodiments of the present invention.
The embodiment of the application provides a left ear and right ear intelligent identification method and an earphone.
FIG. 2 is a schematic flow chart of a left-right ear intelligent identification method implemented by the present application; fig. 3 is a schematic view of an application scenario of an intelligent left-right ear identification method according to an embodiment of the present application.
As shown in fig. 2 and 3, the left and right ear intelligent recognition method 1 includes steps S111 to S116.
In step S111, it is detected whether the user wears the headphone device 2.
The user is an owner or non-owner user. The headphone device 2 is one of an in-ear headphone, and a headphone.
In step S112, if the user wears the headphone apparatus 2, it is determined whether the first reference vein image of the first ear and the second reference vein image of the second ear are stored.
The user has a first ear and a second ear. The first ear is the user's left ear. The second ear is the user's right ear. When the master user wears the ear speaker device 2 for the first time, the vein image of the first ear is used as a first reference vein image, and the vein image of the second ear is used as a second reference vein image. The first reference vein image represents the left ear vein of the individual user. The second reference vein image represents the right ear vein of the individual user. The first reference vein image and the second reference vein image are different. When the first user does not wear the headphone apparatus 2 for the first time, the first reference vein image and the second reference vein image are stored.
In step S113, if the first reference vein image and the second reference vein image are stored, the first earphone 21 is used to obtain the first actual vein image, or the second earphone 22 is used to obtain the second actual vein image.
The ear speaker device 2 has a first ear speaker 21 and a second ear speaker 22. The first earpiece 21 is part of the earpiece device 2. The second earpiece 22 is another part of the earpiece device 2. When the host user does not wear the earphone device 2 for the first time, the first earphone 21 corresponds to the first ear and the second earphone 22 corresponds to the second ear, or the first earphone 21 corresponds to the second ear and the second earphone 22 corresponds to the first ear. At this time, the vein image of the first headphone 21 is used as the first actual vein image. The vein image of the second headphone 22 is used as the second actual vein image. The first actual vein image represents one of a left ear vein or a right ear vein of the individual user. The second actual vein image represents the other of the left ear vein or the right ear vein of the individual user. The first actual vein image and the second actual vein image are different.
Fig. 4 is a schematic diagram illustrating a position of a first earphone in a left-right ear intelligent identification method according to an embodiment of the present application; fig. 5 is a schematic diagram illustrating a position of a second earphone in a left-right ear intelligent identification method according to an embodiment of the present application; fig. 6 is an image of left ear veins in a left and right ear intelligent identification method according to an embodiment of the present application; fig. 7 is an image of a vein of a right ear in a left-right ear smart identification method according to an embodiment of the present application.
As shown in fig. 4, the first earphone 21 corresponds to the left ear of the individual user. As shown in fig. 5, the second earpiece 22 corresponds to the right ear of the individual user. As shown in fig. 6, the first actual vein image and the first reference vein image are left ear vein images. As shown in fig. 7, the second actual vein image and the second reference vein image are right ear vein images.
Step S114, matching the first actual vein image with the first reference vein image, or the second actual vein image with the second reference vein image, or the first actual vein image with the second reference vein image, or the second actual vein image with the first reference vein image.
When the first actual vein image matches the first reference vein image, the second actual vein image matches the second reference vein image. When the first actual vein image does not match the first reference vein image, the second actual vein image does not match the second reference vein image. When the first actual vein image matches the second reference vein image, the second actual vein image matches the first reference vein image. When the first actual vein image does not match the second reference vein image, the second actual vein image does not match the first reference vein image.
Step S115, if the first actual vein image matches the first reference vein image, or the second actual vein image matches the second reference vein image, it is determined that the first actual vein image and the first earphone 21 correspond to the first ear, and the second actual vein image and the second earphone 22 correspond to the second ear.
The first actual vein image is matched to the first reference vein image, the first actual vein image representing a left ear vein of the host user. At this time, the first actual vein image and the first headphone 21 correspond to the left ear of the host user. The second actual vein image is matched to the second reference vein image, the second actual vein image representing a right ear vein of the host user. At this point, the second actual vein image and the second earpiece 22 correspond to the right ear of the individual user.
Step S116, if the first actual vein image does not match the first reference vein image, or the second actual vein image does not match the second reference vein image, and the first actual vein image does not match the second reference vein image, or the second actual vein image does not match the first reference vein image, acquiring the general left ear vein image and the general right ear vein image, and matching the first actual vein image, the second actual vein image, the acquired general left ear vein image, and the acquired general right ear vein image.
And if the first actual vein image is not matched with the first reference vein image in a matching mode, or the second actual vein image is not matched with the second reference vein image in a matching mode, and the first actual vein image is not matched with the second reference vein image in a matching mode, or the second actual vein image is not matched with the first reference vein image in a matching mode, the user is a non-owner user. When the non-owner user wears the earphone device 2, the first earphone 21 corresponds to the left ear and the second earphone 22 corresponds to the right ear, or the first earphone 21 corresponds to the right ear and the second earphone 22 corresponds to the left ear. At this time, the vein image of the first headphone 21 is used as the first actual vein image. The vein image of the second headphone 22 is used as the second actual vein image. The first actual vein image represents one of a left ear vein or a right ear vein of the non-individual user. The second actual vein image represents the other of the left ear vein or the right ear vein of the non-individual user. The first actual vein image and the second actual vein image are different. Meanwhile, here, a general left ear vein image and a general right ear vein image are acquired. The general left ear vein image and the general right ear vein image are stored in advance. The generic left ear vein image represents the left ear vein of the non-individual user. The universal right ear vein image represents the right ear vein of the non-individual user.
Step S117, if the first actual vein image matches the general left ear vein image, or the second actual vein image matches the general right ear vein image, it is determined that the first actual vein image and the first headphone 21 correspond to the first ear, and the second actual vein image and the second headphone 22 correspond to the second ear.
The first ear is a left ear of the non-active user. The second ear is a right ear of the non-active user. When the general left ear vein image is matched with the first actual vein image, the first actual vein image corresponds to the left ear of the non-owner user. And when the general right ear vein image is matched with the second actual vein image, the second actual vein image corresponds to the right ear of the non-owner user.
In step S118, if the first reference vein image and the second reference vein image are not stored, the first earphone 21 and/or the second earphone 22 are used to collect the first actual vein image and the second actual vein image.
When the master user first puts on the headphone set 2, first the first reference vein image and the second reference vein image are not stored. The first reference vein image represents the left ear vein of the individual user. The second reference vein image represents the right ear vein of the individual user. At this time, the ear speaker device 2 captures a first actual vein image through the first ear speaker 21, and captures a second actual vein image through the second ear speaker 22. For example, the ear speaker device 2 acquires a vein image of the left ear or the right ear through an infrared camera and a flash. Then, the first actual vein image acquired for the first time is used as a first reference vein image. The first acquired second actual vein image is used as a second reference vein image.
And step S119, storing the first actual vein image as a first reference vein image and the second actual vein image as a second reference vein image according to the instruction of the user.
When the master user first puts on the headphone set 2, first the first reference vein image and the second reference vein image are not stored. At this time, the headphone device 2 prompts the user to instruct the left and right directions of the headphone device 2 through the terminal 3. Meanwhile, the ear speaker device 2 acquires the first actual vein image through the first ear speaker 21 as the first reference vein image, and acquires the second actual vein image through the second ear speaker 22 as the second reference vein image. For example, the ear speaker device 2 acquires a vein image of the left ear or the right ear through an infrared camera and a flash. Then, the individual user touches the first headphone 21 with a hand to define that the first reference vein image is a left ear vein image. The individual user manually touching the second earpiece 22 defines that the second reference vein image is a right ear vein image. Then, the ear speaker device 2 stores the first reference vein image and the second reference vein image.
Step S120, sending indication information indicating the first earphone 21 and the second earphone 22 to the terminal 3 connected to the first earphone 21 and the second earphone 22.
The terminal 3 is a smart phone or a tablet computer or the like. The terminal 3 stores a left channel signal 31 and a right channel signal 32. When the first earphone 21 corresponds to the left ear of the user, the earphone device 2 informs the terminal 3 that the first earphone 21 corresponds to the left ear of the user. The headphone set 2 requests the terminal 3 to transmit the left channel signal 31 to the first headphone 21. The user's left ear then listens to the left channel signal. When the second earphone 22 corresponds to the right ear of the user, the earphone device 2 informs the terminal 3 that the second earphone 22 corresponds to the right ear of the user. The earphone device 2 requests the terminal 3 to transmit the right channel signal 32 to the second earphone 22. Thus, the right ear of the user listens to the right channel signal.
In the present embodiment, the ear speaker device 2 stores the first reference vein image and the second reference vein image and acquires the first actual vein image and the second actual vein image. Then, the ear speaker device 2 matches the first actual vein image or the second actual vein image with the first reference vein image or the second reference vein image. In this way, the ear speaker device 2 accurately recognizes that the first ear speaker 21 corresponds to the left ear of the owner user and the second ear speaker 22 corresponds to the right ear of the owner user. Then, the ear speaker device 2 transmits the instruction information instructing the first ear speaker 21 and the second ear speaker 22 to the terminal 3 connected to the first ear speaker 21 and the second ear speaker 22. The earphone arrangement 2 then informs the terminal 3 that the first earphone 21 corresponds to the left ear of the owner user and that the second earphone 22 corresponds to the right ear of the owner user. The ear speaker device 2 requests the terminal 3 to transmit a left channel signal to the first ear speaker 21 and a right channel signal to the second ear speaker 22. In addition, the ear speaker device 2 acquires a general left ear vein image and a general right ear vein image. Then, the ear speaker device 2 matches the first actual vein image or the second actual vein image with the common left ear vein image and the common right ear vein image. In this way, the earphone device 2 accurately identifies that the first earphone 21 corresponds to the left ear of the non-owner user and the second earphone 22 corresponds to the right ear of the non-owner user. Then, the ear speaker device 2 transmits the instruction information instructing the first ear speaker 21 and the second ear speaker 22 to the terminal 3 connected to the first ear speaker 21 and the second ear speaker 22. The earphone arrangement 2 then informs the terminal 3 that the first earphone 21 corresponds to the left ear of the non-owner user and that the second earphone 22 corresponds to the right ear of the non-owner user. The ear speaker device 2 requests the terminal 3 to transmit a left channel signal to the first ear speaker 21 and a right channel signal to the second ear speaker 22. The left ear of the owner user or the non-owner user listens to the left channel signal, and the right ear of the owner user or the non-owner user listens to the right channel signal. Thus, the user who is an owner or a non-owner can normally listen to stereo sound without watching the headphone device 2 with both eyes and without adjusting the headphone device 2 with both hands, and such listening experience is excellent.
FIG. 8 is a schematic flowchart of another left-right ear intelligent recognition method according to an embodiment of the present application; fig. 9 is a schematic view of an application scenario of another left-right ear intelligent recognition method according to an embodiment of the present application.
As shown in fig. 8 and 9, the left and right ear intelligent identification method 1 further includes: if the first actual vein image matches the second reference vein image, or the second actual vein image matches the first reference vein image, it is determined that the first actual vein image and the first headphone 21 correspond to the second ear, and the second actual vein image and the second headphone 22 correspond to the first ear.
In the present embodiment, the earphone device 2 is worn by the host user. The first earpiece 21 acquires a first actual vein image. The second reference vein image represents the right ear vein of the individual user. When the first actual vein image matches the second reference vein image, the first actual vein image and the first headphone 21 correspond to the right ear of the host user. The second ear is the right ear of the owner user. The first actual vein image and the first earpiece 21 correspond to the second ear. In addition, the second earpiece 22 acquires a second actual vein image. The first reference vein image represents the left ear vein of the individual user. When the second actual vein image matches the first reference vein image, the second actual vein image and the second earpiece 22 correspond to the left ear of the individual user. The first ear is the left ear of the owner user. The second actual vein image and the second earpiece 22 correspond to the first ear.
As shown in fig. 8 and 9, the left and right ear intelligent identification method 1 further includes: if the first actual vein image matches the second reference vein image, or the second actual vein image matches the first reference vein image, indication information indicating the first earphone 21 and the second earphone 22 is sent to the terminal 3.
In the present embodiment, the first headphone 21 acquires a first actual vein image. The second reference vein image represents the right ear vein of the individual user. When the first actual vein image matches the second reference vein image, the first actual vein image and the first headphone 21 correspond to the right ear of the host user. At this time, the ear speaker device 2 transmits instruction information instructing the first ear speaker 21 to the terminal 3. The earphone arrangement 2 then informs the terminal 3 that the first earphone 21 corresponds to the right ear of the individual user. The ear speaker device 2 requests the terminal 3 to transmit the right channel signal to the first ear speaker 21. Then, the right ear of the main user listens to the right channel signal. In addition, the second earpiece 22 acquires a second actual vein image. The first reference vein image represents the left ear vein of the individual user. When the second actual vein image matches the first reference vein image, the second actual vein image and the second earpiece 22 correspond to the left ear of the individual user. At this time, the ear speaker device 2 transmits instruction information instructing the second ear speaker 22 to the terminal 3. The earphone arrangement 2 then informs the terminal 3 that the second earphone 22 corresponds to the left ear of the individual user. The ear speaker device 2 requests the terminal 3 to transmit the left channel signal to the second ear speaker 22. The left ear of the host user then listens to the left channel signal.
Fig. 10 is a schematic flowchart of another left-right ear intelligent identification method according to an embodiment of the present application.
As shown in fig. 9 and 10, the left and right ear intelligent identification method 1 further includes: if the first actual vein image is matched with the general right ear vein image or the second actual vein image is matched with the general left ear vein image, it is determined that the first actual vein image and the first earphone 21 correspond to a second ear part and the second actual vein image and the second earphone 22 correspond to the first ear part.
In the present embodiment, the headphone apparatus 2 is worn by an non-owner user. The first ear is a left ear of the non-active user. The second ear is a right ear of the non-active user. The first earpiece 21 acquires a first actual vein image. The universal right ear vein image represents the right ear vein of the non-individual user. When the first actual vein image matches the general right ear vein image, the first actual vein image and the first headphone 21 correspond to the right ear of the non-individual user. The second ear is a right ear of the non-active user. The first actual vein image and the first earpiece 21 correspond to the second ear. In addition, the second earpiece 22 acquires a second actual vein image. The generic left ear vein image represents the left ear vein of the non-individual user. When the second actual vein image matches the generic left ear vein image, the second actual vein image and the second earpiece 22 correspond to the left ear of the non-individual user. The first ear is a left ear of the non-active user. The second actual vein image and the second earpiece 22 correspond to the first ear.
As shown in fig. 9 and 10, the left and right ear intelligent identification method 1 further includes: if the first actual vein image matches the general right ear vein image or the second actual vein image matches the general left ear vein image, indication information indicating the first earphone 21 and the second earphone 22 is sent to the terminal 3.
In the present embodiment, the first headphone 21 acquires a first actual vein image. The universal right ear vein image represents the right ear vein of the non-individual user. When the first actual vein image matches the general right ear vein image, the first actual vein image and the first headphone 21 correspond to the right ear of the non-individual user. At this time, the ear speaker device 2 transmits instruction information instructing the first ear speaker 21 to the terminal 3. The earphone arrangement 2 then informs the terminal 3 that the first earphone 21 corresponds to the right ear of the non-individual user. The ear speaker device 2 requests the terminal 3 to transmit the right channel signal to the first ear speaker 21. Thus, the right ear of the non-owner user listens to the right channel signal. In addition, the second earpiece 22 acquires a second actual vein image. The generic left ear vein image represents the left ear vein of the non-individual user. When the second actual vein image matches the generic left ear vein image, the second actual vein image and the second earpiece 22 correspond to the left ear of the non-individual user. At this time, the ear speaker device 2 transmits instruction information instructing the second ear speaker 22 to the terminal 3. The earphone arrangement 2 then informs the terminal 3 that the second earphone 22 corresponds to the left ear of the non-individual user. The ear speaker device 2 requests the terminal 3 to transmit the left channel signal to the second ear speaker 22. The left ear of the non-individual user then listens to the left channel signal.
FIG. 11 is a vein image before denoising in another left-right ear intelligent recognition method according to the embodiment of the present application; fig. 12 is a denoised vein image in another left-right ear intelligent recognition method according to the embodiment of the present application.
The headphone device 2 obtains a vein image of the left ear or the right ear, and then denoises the vein image of the left ear or the right ear. As shown in fig. 11, the vein image of the left ear or the right ear is noisy and rough before denoising. As shown in fig. 12, the vein image of the left ear or the right ear is free from noise and fine after denoising. Such images have accurate information and take up little storage space.
Fig. 13 is a schematic structural diagram of an earphone according to an embodiment of the present application.
As shown in fig. 13, the ear speaker device 2 includes a processor 201, a wearing detection sensor 202, a memory 203, a bluetooth communication device 204, a speaker 205, a touch input device 206, and a battery 207. The processor 201 is connected to and controls the wear detection sensor 202, the memory 203, the bluetooth communication device 204, the speaker 205, the touch input device 206, and the battery 207. The wear detection sensor 202 detects a vein image. The memory 203 stores vein images. The bluetooth communication device 204 transmits the audio signal of the terminal to the ear speaker device 2. The speaker 205 plays an audio signal. The touch input device 206 defines an ear vein image according to a touch input by a user. A battery 207 provides electrical energy.
As shown in fig. 3 and 13, the headphone apparatus 2 includes a wear detection sensor 202, one or more processors 201, one or more memories 203, a first headphone 21, and a second headphone 22:
the wear detection sensor 202 is used to detect headset movement and/or pose data;
one or more memories 203 are provided in the first earpiece 21 and/or the second earpiece 22 for storing one or more programs;
the one or more processors 201 are operable to, when executed with the one or more programs, cause the headphone apparatus 2 to perform the following:
determining whether the user wears the earphone device 2 or not according to the detection data of the wearing detection sensor 202, and if the user wears the earphone device 2, determining whether a first reference vein image of a first ear and a second reference vein image of a second ear are stored or not;
if the first reference vein image and the second reference vein image are stored, the first earphone 21 acquires a first actual vein image, or the second earphone 22 acquires a second actual vein image; matching the first actual vein image with the first reference vein image, or the second actual vein image with the second reference vein image, or the first actual vein image with the second reference vein image, or the second actual vein image with the first reference vein image;
if the first actual vein image is matched with the first reference vein image or the second actual vein image is matched with the second reference vein image, determining that the first actual vein image and the first earphone 21 correspond to a first ear part and the second actual vein image and the second earphone 22 correspond to a second ear part;
if the first actual vein image is not matched with the first reference vein image, or the second actual vein image is not matched with the second reference vein image, and the first actual vein image is not matched with the second reference vein image, or the second actual vein image is not matched with the first reference vein image, acquiring a general left ear vein image and a general right ear vein image, and matching the first actual vein image, the second actual vein image, the acquired general left ear vein image and the acquired general right ear vein image;
if the first actual vein image is matched with the general left ear vein image or the second actual vein image is matched with the general right ear vein image, determining that the first actual vein image and the first earphone 21 correspond to a first ear part and the second actual vein image and the second earphone 22 correspond to a second ear part;
if the first reference vein image and the second reference vein image are not stored, the first earphone 21 and/or the second earphone 22 acquires a third actual vein image and a fourth actual vein image;
according to the user instruction, storing the third actual vein image as the first reference vein image in the memory 203, and storing the fourth actual vein image as the second reference vein image in the memory 203;
the indication information indicating the first earphone 21 and the second earphone 22 is transmitted to the terminal 3 connected to the earphone device 2.
In the present embodiment, the ear speaker device 2 stores the first reference vein image and the second reference vein image and acquires the first actual vein image and the second actual vein image. Then, the ear speaker device 2 matches the first actual vein image or the second actual vein image with the first reference vein image or the second reference vein image. In this way, the ear speaker device 2 accurately recognizes that the first ear speaker 21 corresponds to the left ear of the owner user and the second ear speaker 22 corresponds to the right ear of the owner user. Then, the ear speaker device 2 transmits instruction information instructing the first ear speaker 21 and the second ear speaker 22 to the terminal 3 connected to the ear speaker device 2. The earphone arrangement 2 then informs the terminal 3 that the first earphone 21 corresponds to the left ear of the owner user and that the second earphone 22 corresponds to the right ear of the owner user. The ear speaker device 2 requests the terminal 3 to transmit a left channel signal to the first ear speaker 21 and a right channel signal to the second ear speaker 22. In addition, the ear speaker device 2 acquires a general left ear vein image and a general right ear vein image. Then, the ear speaker device 2 matches the first actual vein image or the second actual vein image with the common left ear vein image and the common right ear vein image. In this way, the earphone device 2 accurately identifies that the first earphone 21 corresponds to the left ear of the non-owner user and the second earphone 22 corresponds to the right ear of the non-owner user. Then, the ear speaker device 2 transmits instruction information instructing the first ear speaker 21 and the second ear speaker 22 to the terminal 3 connected to the ear speaker device 2. The earphone arrangement 2 then informs the terminal 3 that the first earphone 21 corresponds to the left ear of the non-owner user and that the second earphone 22 corresponds to the right ear of the non-owner user. The ear speaker device 2 requests the terminal 3 to transmit a left channel signal to the first ear speaker 21 and a right channel signal to the second ear speaker 22. The left ear of the owner user or the non-owner user listens to the left channel signal, and the right ear of the owner user or the non-owner user listens to the right channel signal. Thus, the user who is an owner or a non-owner can normally listen to stereo sound without watching the headphone device 2 with both eyes and without adjusting the headphone device 2 with both hands, and such listening experience is excellent.
In another embodiment, the one or more processors 201 are operable to, when running the one or more programs, cause the headphone apparatus 2 to perform the following:
if the first actual vein image matches the second reference vein image, or the second actual vein image matches the first reference vein image, it is determined that the first actual vein image and the first headphone 21 correspond to the second ear, and the second actual vein image and the second headphone 22 correspond to the first ear.
In another embodiment, the one or more processors 201 are operable to, when running the one or more programs, cause the headphone apparatus 2 to perform the following:
if the first actual vein image matches the second reference vein image, or the second actual vein image matches the first reference vein image, the left channel signal 31 and the right channel signal 32 send indication information indicating the first earphone 21 and the second earphone 22 to the terminal 3.
In another embodiment, the one or more processors 201 are operable to, when running the one or more programs, cause the headphone apparatus 2 to perform the following:
if the first actual vein image is matched with the general right ear vein image or the second actual vein image is matched with the general left ear vein image, it is determined that the first actual vein image and the first earphone 21 correspond to a second ear part and the second actual vein image and the second earphone 22 correspond to the first ear part.
In another embodiment, the one or more processors 201 are operable to, when running the one or more programs, cause the headphone apparatus 2 to perform the following:
if the first actual vein image matches the general right ear vein image or the second actual vein image matches the general left ear vein image, the left channel signal 31 and the right channel signal 32 send indication information indicating the first earphone 21 and the second earphone 22 to the terminal 3.
In another embodiment, a computer-readable storage medium comprises instructions that, when executed on an electronic device, cause the electronic device to perform left and right ear smart recognition method 1 as shown in fig. 2. The electronic device may be the earphone arrangement 2 as shown in fig. 13. The flow of the left and right ear intelligent identification method 1 and the structure of the earphone device 2 are as described above, and are not described again.
In another embodiment, a computer program product containing instructions which, when run on an electronic device, causes the electronic device to perform the left and right ear intelligent recognition method 1 as shown in fig. 2. The electronic device may be the earphone arrangement 2 as shown in fig. 13. The flow of the left and right ear intelligent identification method 1 and the structure of the earphone device 2 are as described above, and are not described again.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like made within the spirit and principle of the present invention should be included in the scope of the present invention.