TWI802795B - Audio concealment method and wireless audio output device using the same - Google Patents

Abstract

The invention discloses a wireless audio output device, including the first and second audio output units. The wireless audio output device communicates with an audio source which transmitting the first and second original audio data, and the first and the second original audio data are configured to be outputted through the first and the second audio output units simultaneously. When the first audio output unit successfully receives the first original audio data, but the second audio output unit fails to receive the second original audio data, then (1) the first audio output unit will drop the received first original audio data, and (2) the first and the second audio output units will generate a first and a second conceal audio data based on a PLC algorithm, and then output a first and a second conceal audio data simultaneously.

Description

Audio compensation method and corresponding wireless audio input using this method out device

The present disclosure relates to an audio compensation method and a corresponding wireless audio output device using the method.

Portable and wearable electronic devices such as mobile phones, tablet computers, walkmans, smart watches, etc. are becoming increasingly popular. Among the peripheral devices of these portable and wearable electronic devices, the audio output device plays an important role. Portable audio output devices usually include earphones and speakers. In order to improve portability and omit wired earphone jacks on portable and wearable electronic devices, it will be an inevitable trend to wirelessly transmit audio data between the audio output device and the audio source.

According to the first aspect of the present invention, a wireless audio output device is proposed, the wireless audio output device can establish a wireless signal link with the audio source, the audio source outputs the first original audio data and the second original audio data, the first original audio data and The second original audio data is set to be output to the user for listening at the same time. The wireless audio output device includes a first output unit and a second output unit. first export order The unit can receive and play the first original audio data through the wireless signal link, the second output unit R2 can receive and play the second original audio data through the wireless signal link, and the first output unit and the second output unit Can exchange or detect the results of whether they have successfully received the first original audio data and the second original audio data respectively. When both the first original audio data and the second original audio data are successfully received, the first output unit and the second output unit decode and output the first original audio data and the second original audio data respectively. However, when at least one of (1) the first original audio data cannot be successfully received by the first output unit, or (2) the second original audio data cannot be successfully received by the second output unit occurs, then the first output unit and the second output unit respectively generate first compensation audio data and second compensation audio data according to the compensation algorithm. At the time point, the first output unit and the second output unit respectively play the first compensation audio data and the second compensation audio data.

According to another aspect of the present invention, an audio compensation method suitable for a wireless audio output device is proposed, and the audio compensation method includes the following steps. (a) When the first original audio data is successfully received by the first output unit of the wireless audio output device, and the second original audio data is successfully received by the second output unit of the wireless audio output device, the first output unit and the second The output unit respectively plays the first original audio data and the second original audio data, wherein the first original audio data and the second original audio data are output by the audio source, and the wireless audio output device establishes a wireless signal link with the audio source. The first original audio data and the second original audio data are set to be output simultaneously, the first output unit can be used to receive and play the first original audio data through the wireless signal link, and the second output unit can be connected through the wireless signal link available to receive and Play the second original audio data. The first output unit and the second output unit can exchange or detect whether they have successfully received the first original audio data and the second original audio data respectively. (b) When at least one of (1) the failure of the first raw audio data to be received by the first output unit, or (2) the failure of the second raw audio data to be successfully received by the second output unit occurs, then the first The output unit and the second output unit respectively generate the first compensation audio data and the second compensation audio data according to the compensation algorithm, and the first output unit and the second output unit respectively play the first compensation audio data and the second compensation audio data.

In order to have a better understanding of the above and other aspects of the present disclosure, the following specific embodiments are described in detail in conjunction with the attached drawings as follows:

10, 20, 40: Wireless audio output device

101~115: Process steps

102A, 202A, 402A: the first output unit

102B, 202B, 402B: the second output unit

ACK: Acknowledgment message

CA23, CA1X, CA2X: Compensation audio data

ML, IFL: wireless signal link

ML1: bidirectional link

ML2: one-way link

NAK: Unconfirmed message

OA11~OA14, OA21~OA24, OA1X, OA2X: Original audio data

R1: main communication unit

R2: secondary communication unit

RL: Relay Signal Link

S: audio source

WL: Wireless Signal Link

FIG. 1 is a schematic diagram of a wireless audio output device in the prior art.

FIG. 2 shows a conventional wireless audio output device. When one of the output units fails to receive a packet, the output waveforms of the two output units are inconsistent.

FIG. 3 shows a system architecture diagram of a wireless audio output device applied to an audio source according to an embodiment of the present disclosure.

FIG. 4 is a flow chart of the synchronous discarding mechanism executed by two output units in the embodiment of FIG. 3 according to the present disclosure.

FIG. 5 is a schematic diagram of output waveforms after two output units implement the synchronous discarding mechanism according to the embodiment of FIG. 3 of the present disclosure.

FIG. 6 shows an embodiment of the present disclosure, a schematic diagram of the timing sequence of packet transmission and reception when designed according to the Bluetooth standard communication protocol.

FIGS. 7A-7B are schematic diagrams of two output units implementing a synchronous discarding mechanism in the first situation according to the embodiment of FIG. 6 of the present disclosure.

FIG. 8 is a schematic diagram illustrating the timing sequence of sending and receiving packets exchanged between two output units according to the embodiment of FIGS. 7A-7B of the present disclosure.

9A-9C are schematic diagrams of two output units implementing a synchronous discarding mechanism in the second situation according to the embodiment of FIG. 6 of the present disclosure.

FIGS. 10A-10B illustrate the timing diagrams of sending and receiving packets exchanged between two output units according to the embodiment of FIGS. 9A-9C of the present disclosure.

FIG. 11 shows another embodiment of the present disclosure, a schematic diagram of a wireless audio output device with two output units having a synchronous discarding mechanism.

12A-12C are schematic diagrams of two output units implementing a synchronous discarding mechanism in the third situation according to the embodiment of FIG. 11 of the present disclosure.

Please refer to FIG. 1 . FIG. 1 shows a schematic diagram of a wireless audio output device 10 currently available on the market. The wireless audio output device 10 includes a first output unit 102A and a second output unit 102B, and the wireless audio output device 10 can establish a wireless signal link WL with the mobile phone audio source S, and the audio source S outputs the first original audio data OA1 (such as left channel audio data) and the second original audio data OA2 (such as right channel audio data). The wireless audio output device 10 is, for example, a Bluetooth wireless headset, and the first output unit 102A and the second output unit 102B are respectively a Bluetooth wireless headset The left channel output and the right channel output, the first original audio data OA1 and the second original audio data OA2 are set to pass through the first output unit 102A and the second output unit 102B respectively, and can be output and played to the user at the same time listen.

In addition, in the application situation of voice communication (Speech), the voice of the speaker is generally not a stereo sound with differences between the left and right channels, so the first original audio data OA1 and the second original audio data OA2 (left and right channels) output by the mobile phone signal source S audio data) are in principle the same. Therefore, when the first output unit 102A (left earphone) and the second output unit 102B (right earphone) successfully receive the first original audio data OA1 and the second original audio data OA2 respectively, the listener hears from the left and right earphones It will be the same close voice, so the listener has a better subjective sense of hearing.

For the convenience of explanation, this patent defines the following codes: In the code "OAxy", the prefix OA represents the original audio data (Original Audio Data) output by the audio source S, x is the number of the relevant output unit, and y is the reservation Output time sequence number. Similarly, in the code "CAxy", the prefix CA stands for Concealment Audio Data, x is the number of the relevant output unit, and y is the serial number of the scheduled output time. For example, the code OA23 represents the original audio data expected to be output by the second output unit 102B at the time point T3, and for example, the code CA14 represents the compensated audio data expected to be output by the first output unit 102A at the time point T4. The compensated audio data is generally a substitute audio data generated according to a packet loss compensation algorithm (Packet Loss Concealment, PLC). The packet loss compensation algorithm uses the original audio data successfully received by the first few wireless audio output devices 10 to obtain the periodic signal corresponding to the fundamental frequency of the human voice to construct the compensation audio data.

Please refer to Figure 2. Figure 2 shows possible packet loss during wireless transmission of audio data. As shown in Figure 2, for the original audio data expected to be output at time points T1~T4, as shown in the upper left part of Figure 2, the first column describes that the first output unit 102A successfully received the original audio data OA11~ For the four packets of OA14, the second column describes that the first output unit 102A will respectively output the received first original audio data OA11-OA14 at time points T1-T4. But on the other hand, as shown in the upper right part of FIG. 2 , the first column describes that the second output unit 102B only successfully received three packets containing original audio data OA21 ˜ OA22 and OA24 , and the third packet failed to be received. The second output unit 102B only obtains part of the second original audio data OA21 ˜ OA22 and OA24 , so that the second output unit 102B lacks part of the second original audio data OA23 expected to be output at the time point T3 .

According to the possible remedial measures of products currently on the market, at this time the second output unit 102B will generate a compensation audio data CA23 according to the packet loss compensation algorithm, and the second output unit 102B fills the compensation audio data CA23 as a replacement for the lost packet time point T3 Audio data, which is used to output audio. As shown in the upper right part of FIG. 2, the second column describes that the second output unit 102B will output the first original audio data OA21-OA22, the compensation audio data CA23 and the first original audio data OA24 at time points T1-T4 respectively. At the predetermined time point T3, the first output unit 102A outputs the first original audio data OA13 included in the third packet, and the second output unit 102B outputs the compensated audio data CA23.

If at the time point T3, when the fundamental frequency of the human voice changes greatly at this time, as shown in the lower left and lower right parts of Figure 2, (1) the output generated by the audio data CA23 filled in according to the packet loss compensation algorithm Waveform and (2) The output waveform generated according to the original audio data OA13, there is a significant difference between the two waveforms, and such a significant difference will cause a relatively obvious audio imbalance between the left and right ears, and the user will feel the obvious difference when listening at T3 time point Differences, and even noise signals appear, thereby reducing the user's subjective hearing experience.

Please refer to FIG. 3 , which shows a wireless audio output device 20 according to an embodiment of the present disclosure. The wireless audio output device 20 can establish a wireless signal link ML with an audio source S. Referring to FIG. The audio source S outputs the first original audio data OA1x and the second original audio data OA2x. The first original audio data OA1x and the second original audio data OA1x are set to be output to the user at the time Tx at the same time. The wireless audio output device 20 includes a first output unit 202A and a second output unit 202B. The wireless signal link ML includes a bidirectional link ML1 and a unidirectional link ML2. A two-way link ML1 is established between the first output unit 202A and the audio source S, through the two-way link ML1, the first output unit 202A can receive and play the first original audio data OA1x. A one-way link ML2 is established between the second output unit 202B and the audio source S, through the one-way link ML2, the second output unit 202B can receive and play the second original audio data OA2x. Because the link between the first output unit 202A and the audio source S is a two-way link ML1, and the link between the second output unit 202B and the audio source S is a one-way link ML2, so the first output unit 202A is set as The primary communication unit R1 and the second output unit 202B are set as the secondary communication unit R2. Between the first output unit 202A and the second output unit 202B, a wireless signal link IFL is established to extend the packet time. By this wireless signal link IFL, the first output unit 202A and the second output unit The unit 202B is capable of exchanging or detecting results of whether the first original audio data OA1x and the second original audio data OA2x are successfully received respectively. Wherein when at least one of (1) the first original audio data OA1x fails to be successfully received by the first output unit 202A, or (2) the second original audio data OA2x fails to be successfully received by the second output unit 202B occurs, then The first output unit 202A and the second output unit 202B respectively generate the first compensation audio data CA1x and the second compensation audio data CA2x according to the compensation algorithm, and the first output unit 202A and the second output unit 202B respectively play the first compensation audio data CA1x and second compensation audio data CA2x.

According to another aspect of the present invention, an audio compensation method is proposed, which is applicable to the wireless audio output device 20 shown in FIG. 3 . The steps of the audio compensation method include the following steps. (a) When the first original audio data OA1x is successfully received by the first output unit 202A of the wireless audio output device 20, and the second original audio data OA2x is successfully received by the second output unit 202B of the wireless audio output device 20, then the first An output unit 202A and a second output unit 202B respectively play the first original audio data OA1x and the second original audio data OA2x, wherein the first original audio data OA1x and the second original audio data OA2x are output by the audio source S, wireless audio output The device 20 establishes a wireless signal link ML with the audio source S. The first original audio data OA1x and the second original audio data OA2x are set to be output at the same time, the first output unit 202A can be used to receive and play the first original audio data OA1x through the wireless signal link ML, and the second output unit 202B borrows The ML is connected to the wireless signal to receive and play the second original audio data OA2x. The first output unit 202A and the second output unit 202B can exchange or detect whether they have successfully received the first original audio information respectively. The results of the raw audio data OA1x and the second raw audio data OA2x. (b) when at least one of (1) the first original audio data OA1x failed to be successfully received by the first output unit 202A, or (2) the second original audio data OA2x was not successfully received by the second output unit 202B occurred , then the first output unit 202A and the second output unit 202B respectively generate the first compensation audio data CA1x and the second compensation audio data CA2x according to the compensation algorithm, and the first output unit 202A and the second output unit 202B play the first compensation audio data respectively The audio data CA1x and the second compensation audio data CA2x.

Please refer to FIG. 4 , which shows a detailed flowchart of an example of an audio compensation method according to an embodiment of the present disclosure. In this embodiment, the wireless audio output device has two output units 202A-202B, and each of the two output units 202A-202B executes the method shown in FIG. 4 .

The following is an example of specific steps when the first output unit 202A executes the process shown in FIG. 4 . The process shown in FIG. 4 includes steps 101 to 115 .

In step 101, the first output unit 202A receives a packet, the packet is from the audio source S and the packet contains original audio data OA1x, and the original audio data OA1x is the original audio that the first output unit 202A is expected to output at Tx time point material. Then enter step 103, the first output unit 202A judges whether the packet from the audio source S is successfully received, if not, execute step 105, and if yes, execute step 111. In step 105, the first output unit 202A checks whether the wireless audio output device 20 has other output units. For example, check whether there are other output units that jointly receive the audio data packets output by the audio source S, and determine whether the second output unit 202B exists; if yes, execute step 107; otherwise, execute step 109. In step 107, the first output unit 202A notifies other output units of packet loss, such as the first output unit The output unit 202A informs the second output unit 202B with a message: "The first output unit 202A fails to receive the packet and loses the audio packet containing the original audio data OA1x". In step 109, the first output unit 202A generates the compensation audio data CA1x according to the packet loss compensation algorithm, and outputs the compensation audio waveform at the Tx time point according to the compensation audio data CA1x. In step 111 , the first output unit 202A checks whether the wireless audio output device 20 has other output units. For example, check whether there are other output units that jointly receive the audio data packets output by the audio source S, and determine whether the second output unit 202B exists. If yes, perform step 113 , otherwise, perform step 115 . In step 113, the first output unit 202A confirms whether the audio packet loss occurs in the second output unit 202B by exchanging messages with the second output unit 202B or detecting the state of the second output unit 202B, and if so, executes step 109, If not, go to step 115 . In step 115, the first output unit 202A outputs audio according to the received original audio data OA1x at Tx time point according to the original audio data OA1x.

Similarly, the specific steps when the second output unit 202B executes the process shown in FIG. 4 are taken as an example for illustration below.

In step 101, the second output unit 202B receives a packet, the packet is from the audio source S and the packet contains original audio data OA2x, the original audio data OA2x is the original audio that the second output unit 202B is expected to output at Tx time point material. Then enter step 103, the second output unit 202B judges whether the packet from the audio source S is successfully received, if not, execute step 105, and if yes, execute step 111. In step 105, the second output unit 202B checks whether the wireless audio output device 20 has other output units. For example, check whether there are other output units that jointly receive the audio data packets output by the audio source S, and determine the first output unit Whether 202A exists; if yes, execute step 107; otherwise, execute step 109. In step 107, the second output unit 202B notifies other output units of the packet loss. For example, the second output unit 202B notifies the first output unit 202A of the message: "The second output unit 202B failed to receive the packet and lost the original audio data OA2x. Audio Packet". In step 109, the second output unit 202B generates the compensation audio data CA2x according to the packet loss compensation algorithm, and decodes and outputs the compensation audio waveform according to the compensation audio data CA2x at Tx time point. In step 111 , the second output unit 202B checks whether the wireless audio output device 20 has other output units. For example, check whether there are other output units that jointly receive the audio data packets output by the audio source S, and determine whether the first output unit 202A exists. If yes, perform step 113 , otherwise, perform step 115 . In step 113, the second output unit 202B exchanges messages with the first output unit 202A or detects the state of the first output unit 202A to confirm whether the audio packet loss occurs in the first output unit 202A, and if so, execute step 109 , otherwise go to step 115. In step 115 , the second output unit 202B outputs audio according to the received original audio data OA2x at Tx time point according to the original audio data OA2x.

Through the above process, when the first output unit 202A fails to receive the packet, and thus lacks the original audio data OA1x expected to be output at the Tx time point. Even if the second output unit can successfully receive the packet, when the second output unit 202B has obtained the original audio data OA2x expected to be output at the Tx time point, the second output unit 202B will still discard the successfully received original audio data OA2x . The two output units 202A-202B are calculated according to the same packet loss compensation algorithm to obtain the compensated audio data CA1x and CA2x expected to be output by the two output units 202A-202B at the Tx time point.

In this way, when both the first original audio data OA1x and the second original audio data OA2x are successfully received, at the predetermined time point Tx, the first output unit 202A and the second output unit 202B play and output the first original audio data OA1x and the second original audio data OA1x respectively. 2. Original audio data OA2x. But relatively, when at least (1) the first original audio data OA1x is not successfully received by the first output unit 202A, or (2) the second original audio data OA2x is not successfully received by the second output unit 202B one of them occurs , the first output unit 202A and the second output unit 202B respectively generate the first compensated audio data CA1x and the second compensated audio data CA2x according to the packet loss compensation algorithm. At a predetermined time point Tx, the first output unit 202A and the second output unit 202B respectively play and output the first compensation audio data CA1x and the second compensation audio data CA2x.

In addition, when the wireless audio output device 20 has at least two output units by default, the steps 105 and 111 of the above process can be omitted, so that the two branches of step 103 "yes" and "no" are directly connected to steps 113 and 107 respectively.

Please refer to FIG. 5 , which shows a schematic diagram of output waveforms after two output units implement the synchronous discarding mechanism. Figure 5 illustrates that according to an embodiment of the present disclosure, when each output unit has a synchronous discarding mechanism, and as shown in Figure 2, when a single earphone successfully receives a packet, but the other earphone fails to receive a packet, this disclosure is about The output waveform of the earphones will be improved compared with the waveform of the current market products shown in Figure 2.

For the original audio data expected to be output at time points T1~T4, wherein (1) as shown in the upper left part of FIG. 5, the first column describes that the first output unit 202A has successfully received the first original audio data OA11~OA14 of four packets. (2) As shown in the upper right part of Figure 5, the first column describes the second output unit 202B successfully received Three packets including part of the second original audio data OA21, OA22 and OA24. However, when the second output unit 202B fails to receive the third packet, the second output unit 202B lacks part of the second original audio data OA23 expected to be output at the time point T3. According to this disclosure, the first output unit 202A will actively discard the successfully received first original audio data OA13, and the first output unit 202A and the second output unit 202B will respectively generate the first compensation audio according to the same packet loss compensation algorithm The data CA13 and the second compensation audio data CA23. When the first original audio data OA11, OA12, and OA14 are the same as the second original audio data OA21, OA22, and OA24 respectively, the generated first compensation audio data CA13 and second compensation audio data CA23 are, for example, the same compensation audio material.

As described in the second column in the upper left part of Fig. 5, during the time period T1~T4, the first output unit 202A sequentially outputs "the first original audio data OA11~OA12, the first compensation audio data CA13 and the first original audio data OA14 audio Data", and obtain the first waveform W1 as shown in the lower left part of Fig. 5. As described in the second row of the upper right part of Fig. 5, the second output unit 202B sequentially outputs "the second original audio data OA21~OA22, the second compensation audio data CA23 and the second original audio data OA24 audio data", and obtains the following 5 shows the second waveform W2 in the lower right part. In this way, the first waveform W1 and the second waveform W2 are close to each other, so that the left and right ears of the user cannot hear the difference, thereby improving the user's subjective sense of hearing.

Please refer to FIG. 6, which shows when the embodiment in FIG. 3 is designed according to the Bluetooth standard communication protocol, FIG. 6 shows a schematic diagram of packet transmission and reception timing of an embodiment. In this embodiment, the audio source S is a standard bluetooth device, that is, the audio The time slot design of the source S is according to the standard Bluetooth specification. The first output unit 202A is set as the main communication unit R1 , and the second output unit 202B is set as the secondary communication unit R2 , and the time period design of the two is based on the standard Bluetooth specification and extended. Assume that the wireless audio output device 20 has been paired with the audio source S, and a wireless signal link ML (Multicast Link) of a multicast link has been established. That is, the wireless audio output device 20 and the audio source S can be regarded as a packet transmission system. The main communication unit R1 is configured to establish a multicast link ML with the audio source S, and perform two-way communication with the audio source S through the multicast link ML. The secondary communication unit R2 is used to join the multicast link ML, and perform one-way communication with the audio source S through the multicast link ML, and two-way communication with the main communication unit R1.

From the perspective of the time domain, the time axis of the packet transmission system can be divided into two types of packet transmission times, including the standard packet time GE and the extended packet time IF. During the standard packet time GE, the audio source S can send control signals and audio packets to the primary communication unit R1 and the secondary communication unit R2. The main communication unit R1 can receive control signals and audio packets from the audio source S, and send a reply to the audio source S in response to the received control signals and audio packets. And the secondary communication unit R2 can receive the control signal and the audio packet of the audio source S. During the extended packet time IF, the primary communication unit R1 and the secondary communication unit R2 can exchange one or more extended packets. The details of the extended packets will be further described below.

For example, the period T1 and T3 is the transmission period (TX slot) of the audio source S, and is the reception period (RX slot) of the primary communication unit R1 and the secondary communication unit R2. The period T2 and T4 is the receiving period (RX slot) of the audio source S, and is The transmission slot (TX slot) of the master communication unit R1. During the time T1, the audio source S transmits a control signal to the primary communication unit R1 and the secondary communication unit R2. During the time T2, the main communication unit R1 sends a response to the audio source S based on the control signal. During time T3, the audio source S sends audio packets to the primary communication unit R1 and the secondary communication unit R2. During the time T4, the main communication unit R1 sends a response to the audio source S based on the audio packet.

The period of time T5 is the transmission period (TX slot) of the main communication unit R1, and it is the reception period (RX slot) of the secondary communication unit R2, and the period of time T6 is the reception period (RX slot) of the main communication unit R1, and it is the secondary communication The transmit slot (TX slot) of unit R2. Therefore, during T5, the primary communication unit R1 sends the extended packet to the secondary communication unit R2. During the time T6, the secondary communication unit R2 sends the extended packet to the primary communication unit R1.

It should be noted that when the primary communication unit R1 and the secondary communication unit R2 exchange extended packets, the start time of sending the extended packets may not be aligned with the start time of the receiving period used by the audio source S. Therefore, the audio source S will not receive the extended packets sent by the primary communication unit R1 and the secondary communication unit R2, and can maintain the operation of the standard Bluetooth specification. In other words, the wireless audio output device 20 can support the audio source S device conforming to the Bluetooth standard.

Please refer to FIGS. 7A-7B , which are schematic diagrams of two output units implementing a synchronous discarding mechanism in the first situation according to the embodiment in FIG. 6 of the present disclosure. As shown in Figure 7A, when (1) the audio source S cannot transmit the first original audio data OA1x to the main communication unit R1 through the multicast link ML, that is, the main communication unit R1 receives the first original audio data OA1x The packet fails, and (2) the audio source S is successfully transmitted through the multicast link ML The second original audio data OA2x is delivered to the secondary communication unit R2, that is, the secondary communication unit R2 successfully receives the packet containing the second original audio data OA2x. FIG. 7B is a schematic diagram of a synchronous abandonment mechanism executed between the primary communication unit R1 and the secondary communication unit R2 (the first output unit and the second output unit).

As shown in Figure 7A, in step (a), the main communication unit R1 replies a non-acknowledgement message (NAK) to the audio source S, and the secondary communication unit R2 monitors the non-acknowledgement message (NAK), at this time the main communication unit R1 It is expected to output and play the first compensation audio data CA1x at the time point Tx. As shown in Figure 7B, in step (b), the unacknowledged message (NAK) triggers the secondary communication unit R2 to discard the received second original audio data OA2x, and the secondary communication unit R2 outputs and plays the second original audio data at time Tx Compensation audio data CA2x.

Please refer to FIG. 8 , which shows a schematic diagram of the timing sequence of packet exchange transmission and reception between the primary communication unit R1 and the secondary communication unit R2 as shown in FIGS. 7A-7B . As shown in Figure 7A, when the main communication unit R1 (the first output unit) cannot successfully receive the first original audio data OA1x from the audio source S through the multicast link ML, the main communication unit R1 will use the sixth The flag message in the time period of Figure T4 is used as an unacknowledged message (NAK) in reply to the audio source S. Here, the flag message is an example of a flag message (Automatic Request Not, ARQN) that requires the other party to resend, but Not limited to this. On the other hand, when the secondary communication unit R2 monitors and detects that the flag message contains a non-acknowledgement message (NAK), it knows that the primary communication unit R1 has failed to receive the first original audio data OA1x. Then trigger the secondary communication unit R2 to perform the step of discarding the second original audio data OA2x shown in FIG. 7B.

Please refer to FIGS. 9A-9C , which illustrate a schematic diagram of two output units implementing a synchronous discarding mechanism in the embodiment of FIG. 6 under the second condition. According to the embodiment in FIG. 6 of this disclosure, when the multicast link ML(1) successfully transmits the first original audio data OA1x to the main communication unit R1 for reception, that is, the main communication unit R1 successfully receives the first original audio data OA1x packet, and (2) the second original audio data OA2x cannot be delivered from the audio source S to the secondary communication unit R2, that is, when the secondary communication unit R2 fails to receive the packet containing the second original audio data OA2x, the 9A~9C The figure shows a schematic diagram of the three-stage steps for implementing the synchronization rejection mechanism between the primary communication unit R1 and the secondary communication unit R2 (the first output unit and the second output unit).

As shown in FIG. 9A, in step (a), the primary communication unit R1 first replies an acknowledgment message (ACK) to the audio source S, and the secondary communication unit R2 monitors the acknowledgment message (ACK). But at this time, the secondary communication unit R2 has not successfully received the second original audio data OA2x, so the secondary communication unit R2 is expected to output the second compensated audio data CA2x at the time point Tx. As shown in FIG. 9B, in step (b), the acknowledgment message (ACK) sent by the primary communication unit R1 triggers the secondary communication unit R2 to send a non-acknowledgement message (NAK) to the primary communication unit R1. As shown in FIG. 9C, in step (c), the non-acknowledgment message (NAK) makes the main communication unit R1 discard the received first original audio data OA1x, and output and play the first compensation audio data CA1x at the time point Tx.

10A-10B are schematic diagrams illustrating the timing diagrams of sending and receiving packets exchanged between the primary communication unit R1 and the secondary communication unit R2 (the first output unit and the second output unit) according to the embodiment of FIGS. 9A-9C of the present disclosure.

When the multicast link cannot transmit the second original audio data OA2x from the audio source S to the secondary communication unit R2 (the second output unit), it corresponds to the steps shown in Fig. 9A, and Fig. 10A shows the sequence diagram of sending and receiving related packets : The primary communication unit R1 will reply an acknowledgment message (ACK) to the audio source S at the ARQN message in the time period T4 in FIG. 6, and the secondary communication unit R2 will monitor the ARQN message as an acknowledgment message (ACK).

Corresponding to the steps shown in Figure 9B, Figure 10B shows the timing diagram for the transmission and reception of related packets: when the secondary communication unit R2 detects that the ARQN message is an acknowledgment message (ACK), it triggers the secondary communication unit R2 to use the second half of the ARQN message period to send out A non-acknowledgement message (NAK) is sent to the master communication unit R1.

As described above in FIG. 10B , the secondary communication unit R2 sends a non-acknowledgement message (NAK) to the primary communication unit R1 in the second half of the ARQN message period. The multicast link defines an audio source S receiving time slot (Source Receive Timeslot). In the audio source S receiving time slot, the audio source can be set to receive a flag message from the main communication unit R1 as an acknowledgment message (ACK) to the audio source S. ) or unacknowledged message (NAK). However, the secondary communication unit R2 uses the second half of the period after the midpoint of the flag message period to send the unacknowledged message (NAK), so the sending start time of the unacknowledged message (NAK) is not aligned with the start time of the receiving period of the audio source S , so as to prevent the audio source S from mistakenly receiving the unacknowledged message from the secondary communication unit R2. As shown in Figure 10B, the secondary communication unit R2 can choose to send a non-acknowledgement message (NAK) in the period T4, wherein the starting point of the transmission of the non-acknowledgement message (NAK) in the period T4, for example, can be aligned with the midpoint of the transmission period of the primary communication unit R1 , and is located in the second half of the receiving period of the audio source S. Thus the unacknowledged message (NAK) is not aligned with the audio source S when it is received in the time period T4 The start time of the segment, so the audio source S will not receive the non-acknowledgment message (NAK) from the secondary communication unit R2 by mistake.

Please refer to FIG. 11 . FIG. 11 shows that according to an embodiment of the present disclosure, the wireless audio output device 40 can establish a relay wireless signal link (Relay, RL) with the audio source S. Referring to FIG. The audio source S outputs the first original audio data OA1x and the second original audio data OA2x. The first original audio data OA1x and the second original audio data OA1x are set to be simultaneously output and played to the user at the time point Tx. The wireless audio output device 40 includes a first output unit 402A and a second output unit 402B. The first output unit 402A is set as the main communication unit R1, the second output unit 402B is set as the secondary communication unit R2, the main communication unit R1 is set to establish a relay link RL with the audio source S, and the main communication unit R1 Two-way communication is performed with the audio source through the relay link RL, and the secondary communication unit R2 indirectly receives the second original audio data OA1x through the relay link RL. The second original audio data OA2x is first transmitted from the audio source S to the primary communication unit R1, and then transmitted from the primary communication unit R1 to the secondary communication unit R2. Link RL through the relay signal, (1) the main communication unit R1 can receive the first original audio data OA1x and the second original audio data OA2x from the audio source S, (2) the main communication unit R1 can then send the second original audio data The data OA2x is delivered to the secondary communication unit R2, and (3) the secondary communication unit R2 can notify the primary communication unit R1 whether the second original audio data OA2x is successfully received.

Please refer to FIGS. 12A-12C , which illustrate a schematic diagram of two output units implementing a synchronous discarding mechanism in the third situation according to the embodiment in FIG. 11 of the present disclosure. As in the embodiment shown in Figure 11, when (1) the relay link RL successfully transmits the first original audio data OA1x from the audio source S to the main communication unit R1, but (2) the relay link RL fails When the second original audio data OA2x is successfully delivered to the secondary communication unit R2 (the second output unit), Figures 12A-12C illustrate the execution between the primary communication unit R1 and the secondary communication unit R2 (the first output unit and the second output unit). Schematic diagram of the three-stage steps of the synchronous discard mechanism.

As shown in Figure 12A, in step (a), the main communication unit R1 first replies an acknowledgment message (ACK) to the audio source S, and the secondary communication unit R2 listens to the acknowledgment message (ACK), at this time the main communication unit R1 It is currently estimated that the first original audio data OA1x will be output and played at the time point Tx. As shown in FIG. 12B, in step (b), the acknowledgment message (ACK) triggers the secondary communication unit R2 to send a non-acknowledgement message (NAK) to the primary communication unit R1. Because the secondary communication unit R2 fails to receive the second original audio data OA2x, it is expected to output and play the second compensated audio data CA2x at the time point Tx. As shown in Figure 12C, in step (c), the unacknowledged message (NAK) triggers the main communication unit R1 to discard the received first original audio data OA1x, and output and play the first compensation audio data CA1x at the time point Tx .

The wireless audio output device described in the above embodiments of this disclosure can support the audio source S as a Bluetooth device that provides multicast signal links. The audio source S only establishes a two-way link with the first output unit R1, and the audio source S and the second output unit. The present disclosure is implemented under the condition that only a one-way link is established between the two output units R2. That is to say, it is suitable for wireless earphones that use the Bluetooth standard framework of version 3.0 in the market, and only one of the left earphone or the right earphone establishes a two-way Bluetooth connection with the audio source. In other words, without changing the original operation mode of the audio source, the wireless audio output device provided by the present disclosure can also be used compatible. In addition, since the present disclosure provides a plurality of output units of the wireless audio output device, common Following a synchronous discarding mechanism, the original audio data can be replaced by the compensation audio data synchronously, so that the listener can hear close voices from the left and right earphones, so that the listener has a better subjective sense of hearing.

On the other hand, the present disclosure is also applicable to implementation under the condition that the audio source S establishes independent wireless signal links with the first output unit R1 and the second output unit R2 respectively. For example: this disclosure is also applicable to wireless earphones constructed using the Bluetooth Low Energy (BLE) standard. Establish a two-way wireless signal link, that is, the first BLE wireless link and the second BLE wireless link (BLE link 1, BLE link 2), the first BLE wireless link and the second BLE wireless link are independent of each other, and the second BLE wireless link There is a wireless signal link IFL between the first output unit R1 and the second output unit R2. The first output unit R1 can receive the first original audio data OA1x through the first BLE wireless link BLE link 1 . The second output unit R2 can receive the second original audio data OA2x through the second BLE wireless link BLE link 2 . The first output unit R1 and the second output unit R2 can exchange or detect whether they have successfully received the first original audio data OA1x and the second original audio data OA2x through the wireless signal link IFL.

So when at least (1) the first BLE wireless link BLE link 1 cannot successfully transmit the first original audio data OA1x to the first output unit R1, and (2) the second BLE wireless link BLE link 2 cannot successfully transmit the second original audio data The audio data OA2x is sent to the second output unit R2. When one of the two occurs, then: (b1) the first output unit R1 and the second output unit R2 respectively generate the first output unit according to the packet loss compensation algorithm. The compensation audio data CA1x and the second compensation audio data CA2x, and (b2) the first output unit R1 and the second output unit R2 respectively play the first compensation audio data CA1x and the second compensation audio data CA2x.

When a traditional wireless audio output device (such as a pair of wireless Bluetooth earphones) is applied to a voice call situation where the fundamental frequency of the human voice changes greatly, when the first output unit (such as the left earphone) fails to receive the original audio data, and the second When the output unit (such as the right earphone) successfully receives the original audio data, there will be a gap between (1) the compensation audio data output by the first output unit and (2) the original audio data output by the second output unit. At this time, the user will hear unbalanced left and right ear audio, and even hear noise, which will greatly reduce the user's subjective hearing experience. The wireless audio output device and the audio compensation method of the embodiments of the present disclosure, by judging that when one of the multiple output units fails to receive the original audio data, the first output unit and the second output unit are respectively based on the compensation algorithm The first compensation audio data and the second compensation audio data are generated, and the first output unit and the second output unit respectively play the first compensation audio data and the second compensation audio data. With the relatively close first compensation audio data and second compensation audio data, the user can hear balanced audio from the left and right ears, avoid hearing noise, and improve the user's subjective sense of hearing.

To sum up, although the present disclosure has been disclosed above with embodiments, it is not intended to limit the present disclosure. Those with ordinary knowledge in the technical field to which this disclosure belongs may make various changes and modifications without departing from the spirit and scope of this disclosure. Therefore, the scope of protection of this disclosure should be defined by the scope of the appended patent application.

20: Wireless audio output device

202A, 202B: output unit

ML, IFL: wireless signal link

ML1: bidirectional link

ML2: one-way link

R1: main communication unit

R2: secondary communication unit

S: audio source

Claims (19)

A wireless audio output device, capable of establishing a wireless signal link with an audio source, the wireless audio output device includes: a first output unit, the first output unit can receive and play a first original audio through the wireless signal link data, the audio source outputs the first original audio data and a second original audio data, the first original audio data and the second original audio data are set to be output simultaneously; a second output unit, the second output unit is connected via a wireless signal chain As a result, the second original audio data can be received and played; wherein, the first output unit and the second output unit can exchange or detect the results of whether they respectively successfully receive the first original audio data and the second original audio data; wherein, When at least one of (1) the first original audio data is not successfully received by the first output unit, or (2) the second original audio data is not successfully received by the second output unit occurs, the first output unit and The second output unit respectively generates a first compensation audio data and a second compensation audio data according to a compensation algorithm, and the first output unit and the second output unit respectively play the first compensation audio data and the second compensation audio data. The wireless audio output device as described in claim 1, wherein the wireless signal link is a multicast link (multicast link), the first output unit is set as a master communication unit, and the second output unit is set It is a primary communication unit, wherein the main communication unit is set to establish a multicast link with the audio source, and conduct two-way communication with the audio source through the multicast link; and the secondary communication unit is used to join multiple broadcast link, and perform one-way communication with the audio source through the multicast link, and perform two-way communication with the main communication unit. The wireless audio output device as described in claim 2, wherein when the multicast link successfully transmits the second original audio data, but the first original audio data fails to be transmitted, the main communication unit replies a non-confirmation message (NAK) to the audio source ; The unacknowledged message triggers the secondary communication unit to drop the received second original audio data, and output the second compensation audio data. The wireless audio output device as described in claim 2, wherein when the multicast link successfully transmits the first original audio data, but the second original audio data fails to be transmitted, the main communication unit first returns a confirmation message to the audio source; confirm The message triggers the secondary communication unit to send an unacknowledged message to the primary communication unit, so that the primary communication unit discards the received first original audio data and outputs the first compensation audio data. The wireless audio output device as described in claim item 4, wherein the multicast link defines a source receive timeslot (source receive timeslot), in the source receive timeslot of the audio source, the source of the audio can be set to receive messages from the main communication unit, unacknowledged messages The send start time of is not aligned with the start time of the audio source receive period. The wireless audio output device as described in Claim 5, wherein the sending start time of the unconfirmed message is within the second half of the receiving period of the audio source. The wireless audio output device as described in claim item 2, wherein the multicast link system conforms to a bluetooth specification, and the bluetooth specification defines an audio source receiving period and an audio source not listening period; in the audio source receiving period, the audio source can be set Receive messages from the primary communication unit; during periods when the audio source is not listening, the primary communication unit and the secondary communication unit An extension packet can be exchanged between the communication units, and the sending start time of the extension packet is not aligned with the start time of the receiving period of the audio source. The wireless audio output device as described in Claim 7, wherein the period of time when the audio source is not listening includes a flag message, and the primary communication unit uses the flag message to transmit an unconfirmed message to the secondary communication units. The wireless audio output device as described in Claim 7, wherein the period of time when the audio source is not listening includes a second half period of a flag message, and the secondary communication unit uses the second half period of the flag message to transmit an unacknowledged message to the main communication unit. The wireless audio output device as described in Claim 1, wherein the wireless signal link is a relay link, the first output unit is set as a main communication unit, and the second output unit is set as a primary communication unit , wherein the main communication unit is set to establish a relay link with the audio source, and conduct two-way communication with the audio source through the relay link, and the secondary communication unit is used to join the relay link; wherein, through the relay Linking, the second original audio data is first transmitted from the audio source to the primary communication unit, and then transmitted from the primary communication unit to the secondary communication unit. The wireless audio output device as described in claim 10, wherein, when the primary communication unit successfully receives the first original audio data, but fails to transmit the second original audio data to the secondary communication unit, the primary communication unit first replies with a confirmation message To the audio source, confirm the message and trigger the secondary communication unit to send an unconfirmed message to the main communication unit, so that the main communication unit discards the received first original audio data and outputs the first compensation audio data. The wireless audio output device as described in claim 1, wherein, when the first original audio data and the second original audio data are successfully received, the first output unit and the second output unit respectively play the first original audio data and The second original audio data. The wireless audio output device as described in claim 1, wherein the wireless signal link includes a first wireless link and a second wireless link, the first wireless link and the second wireless link are independent of each other, and the first There is a wireless signal link between the output unit and the second output unit; the first output unit can receive the first original audio data through the first wireless link, and the second output unit can receive the first original audio data through the second wireless link. 2. Original audio data: The first output unit and the second output unit can exchange or detect whether they have successfully received the first original audio data and the second original audio data through a wireless signal link. The wireless audio output device according to claim 13, wherein the first wireless link and the second wireless link are a low-power Bluetooth connection. An audio compensation method, suitable for a wireless audio output device, the steps of the audio compensation method include: (a) when a first original audio data is successfully received by a first output unit of a wireless audio output device, and a second original audio When the data is successfully received by the second output unit of the wireless audio output device, the first output unit and the second output unit respectively play the first original audio data and the second original audio data, wherein the first original audio data and the second original audio data The audio data is output by an audio source, the wireless audio output device is used to establish a wireless signal link with the audio source, the first original audio data and the second The original audio data is set to be output at the same time, the first output unit can be used to receive and play the first original audio data through the wireless signal link, and the second output unit can be used to receive and play the second original audio data through the wireless signal link Audio data, the results of whether the first output unit and the second output unit can exchange or detect whether they have successfully received the first original audio data and the second original audio data respectively; (b) when at least (1) the first original audio data Failed to be successfully received by the first output unit, or (2) when one of the second original audio data failed to be successfully received by the second output unit occurs, then: (b1) the first output unit and the second output unit according to a The compensation algorithm generates a first compensation audio data and a second compensation audio data respectively, and (b2) the first output unit and the second output unit respectively play the first compensation audio data and the second compensation audio data. The audio compensation method as described in claim 15, wherein the wireless signal link is a multicast link, the first output unit performs bidirectional communication with the audio source; and the second output unit performs unidirectional communication with the audio source, and communicates with the audio source The first output unit performs two-way communication; wherein, when the multicast link successfully transmits the second original audio data, but the transmission of the first original audio data fails, the first output unit replies an unconfirmed message to the audio source; the unconfirmed message triggers the second The second output unit discards the received second original audio data and outputs the second compensated audio data. The audio compensation method as described in claim 15, wherein the wireless signal link is a multicast link, the first output unit performs bidirectional communication with the audio source; and the second output unit performs unidirectional communication with the audio source, and with the first output unit Two-way communication; where, when the multicast link successfully transmits the first original audio data, but the second original audio data fails to be transmitted, the first output unit first returns a confirmation message to the audio source; confirm the message and trigger the second output The unit sends an unacknowledged message to the first output unit, so that the first output unit discards the received first original audio data and outputs the first compensation audio data. The audio compensation method as described in claim 15, wherein the wireless signal link includes a first wireless link and a second wireless link, the first wireless link and the second wireless link are independent of each other, and the first output There is a wireless signal link between the unit and the second output unit; the first output unit can receive the first original audio data through the first wireless link, and the second output unit can receive the second original audio data through the second wireless link. Original audio data; the first output unit and the second output unit can exchange or detect whether they have successfully received the first original audio data and the second original audio data through a wireless signal link. The audio compensation method as claimed in claim 18, wherein the first wireless link and the second wireless link are a low-power Bluetooth connection.

Images