[go: up one dir, main page]

CN108600894A - A kind of earphone adaptive active noise control system and method - Google Patents

A kind of earphone adaptive active noise control system and method Download PDF

Info

Publication number
CN108600894A
CN108600894A CN201810758793.1A CN201810758793A CN108600894A CN 108600894 A CN108600894 A CN 108600894A CN 201810758793 A CN201810758793 A CN 201810758793A CN 108600894 A CN108600894 A CN 108600894A
Authority
CN
China
Prior art keywords
signal
noise
analog
earphone
matrix
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810758793.1A
Other languages
Chinese (zh)
Other versions
CN108600894B (en
Inventor
不公告发明人
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Gansu Midi Acoustics Co ltd
Original Assignee
Chongqing Music Audio Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chongqing Music Audio Technology Co Ltd filed Critical Chongqing Music Audio Technology Co Ltd
Priority to CN201810758793.1A priority Critical patent/CN108600894B/en
Publication of CN108600894A publication Critical patent/CN108600894A/en
Application granted granted Critical
Publication of CN108600894B publication Critical patent/CN108600894B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00Details of transducers, loudspeakers or microphones
    • H04R1/10Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H04R1/1083Reduction of ambient noise
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2201/00Details of transducers, loudspeakers or microphones covered by H04R1/00 but not provided for in any of its subgroups
    • H04R2201/10Details of earpieces, attachments therefor, earphones or monophonic headphones covered by H04R1/10 but not provided for in any of its subgroups
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00Reducing energy consumption in communication networks
    • Y02D30/70Reducing energy consumption in communication networks in wireless communication networks

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Soundproofing, Sound Blocking, And Sound Damping (AREA)

Abstract

本发明公开了一种耳机自适应有源噪声控制系统及方法,该系统至少包括,一个用于采集采集噪音信号的参考麦克风,一个用于采集误差噪音信号的误差麦克风,参考麦克风设于耳机外部,误差麦克风设于耳机内部;一个扬声器单元,用于播放次级声信号;两个模数转换器AD,分别用于将参考噪音信号和误差噪音信号转换为对应的数字信号;一个数模转换器DA,用于将滤波输出信号转化成模拟信号并馈给次级扬声器;一个处理器,用于更新滤波系数并产生次级扬声器的输入信号。该发明能够解决普通自适应算法实时跟踪能力不足和计算延时过大等问题,对不同的环境和不同的耳机佩戴方式都具有较好的自适应性能,提高了耳机自适应有源噪声控制的收敛性能和跟踪性能。

The invention discloses an earphone self-adaptive active noise control system and method. The system at least includes a reference microphone for collecting and collecting noise signals, and an error microphone for collecting error noise signals. The reference microphone is arranged outside the earphone. , the error microphone is set inside the earphone; a speaker unit is used to play the secondary sound signal; two analog-to-digital converters AD are used to convert the reference noise signal and the error noise signal into corresponding digital signals; a digital-to-analog converter A device DA is used to convert the filtered output signal into an analog signal and feed it to the secondary speaker; a processor is used to update the filter coefficient and generate the input signal of the secondary speaker. The invention can solve the problems of insufficient real-time tracking ability and excessive calculation delay of ordinary adaptive algorithms, and has good adaptive performance for different environments and different earphone wearing methods, and improves the performance of adaptive active noise control of earphones. Convergence performance and tracking performance.

Description

一种耳机自适应有源噪声控制系统及方法A headphone adaptive active noise control system and method

技术领域technical field

本发明涉及噪声消除领域,具体涉及一种耳机自适应有源噪声控制系统及方法。The invention relates to the field of noise elimination, in particular to an earphone adaptive active noise control system and method.

背景技术Background technique

噪声时刻影响着人们的生活,例如在机舱、地铁和办公环境中,人们无时无刻不受到噪声的侵扰,噪声的存在使人的心理变得烦躁和不安,如何有效的控制噪声,降低它对人们身心的危害一直是科学研究的重要目标之一。科学研究表明长时间暴露在强噪声环境下,容易导致对所有或部分听力频率敏感性的永久丧失,甚至造成耳聋。降低噪声主要有主动噪声控制和被动噪声控制两种方法。被动噪声控制主要利用特殊材料的反射隔离声音的传播或利用材料的多孔性和粘滞性衰减所通过的声能,被动噪声控制方法对高频噪声比较有效。有源降噪耳机是利用主动噪声控制技术在耳机内部产生一个与噪声幅度相同而相位相反的声信号,使得在目标处次级声波和原声场的声波相互抵消,从而达到控制噪声的目的,主动噪声控制技术对低频噪声效果较好。Noise affects people's life all the time. For example, in the cabin, subway and office environment, people are disturbed by noise all the time. The existence of noise makes people feel restless and restless. Harm has always been one of the important goals of scientific research. Scientific research shows that long-term exposure to strong noise can easily lead to permanent loss of all or part of the hearing frequency sensitivity, and even cause deafness. There are two main ways to reduce noise: active noise control and passive noise control. Passive noise control mainly uses the reflection of special materials to isolate sound transmission or uses the porosity and viscosity of materials to attenuate the passing sound energy. Passive noise control methods are more effective for high-frequency noise. Active noise-canceling earphones use active noise control technology to generate an acoustic signal inside the earphone that has the same amplitude as the noise but has an opposite phase, so that the secondary sound waves at the target and the sound waves in the original sound field cancel each other out, thereby achieving the purpose of noise control. Noise control technology works better for low frequency noise.

在有源噪声控制中一个关键的问题是如何更新滤波器系数。FxLMS(Filtered-xleast mean square)算法是最为流行的用于有源噪声控制的自适应算法,但是该算法由于在时域实现,计算复杂度很高,在资源有限的系统中实现受到限制,另外该算法本质上属于LMS类算法,其收敛速度取决于输入信号自相关矩阵的条件数。频域自适应滤波算法由于具有很低的计算复杂度和很好的收敛性能已经被广泛的应用在回声抵消、波束形成和啸叫抑制等场合。也有文献已经尝试利用频域自适应算法来做有源噪声控制。例如:文献《Q.Shen and A.S.Spanias,“Time and frequency domain xblock LMS algorithms forsingle channel active noise control,”in Proceedings ofthe 2ndInternationalCongress ofRecent Developments inAir-and Structure-Borne SoundVibration,1992,pp.353–360》首先提出将频域算法应用到有源噪声控制,文献《Das,D.P.,G.Panda,andS.M.Kuo."New block filtered-X LMS algorithms for active noisecontrolsystems."IET Signal Processing 1.2(2007):73-81》进一步讨论了更为彻底的频域自适应有源控制技术。但是这些方法由于是基于块处理,数据缓存和处理引入了延时,该延时对于系统辨识的应用而言不会引起性能的下降只是带来算法延时,但是对于有源噪声控制系统的影响却很大,因为该延时可能直接导致有源系统是非因果的,特别是对于耳机的应用中,前馈麦克风和次级扬声器之间的距离非常短,因而算法允许的延时非常小。例如,在大多数耳罩式耳机中,前馈麦克风和扬声器之间距离的典型值是d=1厘米,假设采样率为fS=16000Hz,那么为保证系统因果性允许的算法最大延时为4.7个采样周期,而直接实现的频域算法通常会引入例如128个采样周期的延时,因而直接将频域算法用于耳机有源降噪系统是不可行的。为了解决这个问题,文献《X.Qiu and C.H.Hansen,“Multidelayadaptive filters for active noisecontrol,”in Proceedings of the 14thInternational Congress on Sound andVibration(ICSV),Cairns,Australia,2007,pp.724–732》采用无延时的算法,但是这个方法的峰值复杂度非常高,因为该算法要求在一个采样周期内完成傅里叶变换等一系列复杂度密集的操作,这对绝大多数DSP芯片都是一个很大的挑战。A key issue in active noise control is how to update the filter coefficients. The FxLMS (Filtered-xleast mean square) algorithm is the most popular adaptive algorithm for active noise control. However, due to its implementation in the time domain, the algorithm has high computational complexity and is limited in resource-limited systems. In addition, This algorithm belongs to the LMS algorithm in essence, and its convergence speed depends on the condition number of the autocorrelation matrix of the input signal. Frequency-domain adaptive filtering algorithm has been widely used in echo cancellation, beamforming and howling suppression due to its low computational complexity and good convergence performance. There are also literatures that have attempted to use frequency-domain adaptive algorithms for active noise control. For example: the document "Q.Shen and ASSpanias, "Time and frequency domain xblock LMS algorithms for single channel active noise control," in Proceedings of the 2nd International Congress of Recent Developments in Air-and Structure-Borne SoundVibration, 1992, pp.353–360" first proposed the Frequency domain algorithm applied to active noise control, literature "Das,DP,G.Panda,andS.M.Kuo."New block filtered-X LMS algorithms for active noisecontrolsystems."IET Signal Processing 1.2(2007):73-81 》A more thorough frequency-domain adaptive active control technique is further discussed. However, because these methods are based on block processing, data caching and processing introduce delays, which will not cause performance degradation for system identification applications, but only bring algorithm delays, but the impact on active noise control systems But it is very large, because the delay may directly cause the active system to be non-causal, especially for the application of headphones, the distance between the feedforward microphone and the secondary speaker is very short, so the delay allowed by the algorithm is very small. For example, in most earphones, the typical value of the distance between the feed-forward microphone and the loudspeaker is d = 1 cm, assuming the sampling rate f S = 16000 Hz, then the maximum delay of the algorithm allowed to ensure the causality of the system is 4.7 sampling periods, and the directly implemented frequency domain algorithm usually introduces a delay of, for example, 128 sampling periods, so it is not feasible to directly apply the frequency domain algorithm to the earphone active noise reduction system. In order to solve this problem, the document "X.Qiu and CHHansen, "Multidelay adaptive filters for active noise control," in Proceedings of the 14th International Congress on Sound and Vibration (ICSV), Cairns, Australia, 2007, pp.724–732" adopts no delay algorithm, but the peak complexity of this method is very high, because the algorithm requires a series of complex operations such as Fourier transform to be completed within one sampling period, which is a great challenge for most DSP chips .

采用频域自适应算法的另外一个问题是步长的选择必须在收敛速度和稳态失调之间折中。一个较大的步长可以保证算法具有较快的初始收敛速度,以及当系统发生变化时具有快速的再跟踪的能力,但是大的步长很容易使得算法稳态时具有较大的失调,这是不被期望的特性。在实际的环境中,主通道和次级通道的传递函数都是时变的,例如不同人的耳朵大小不同导致佩戴上耳机后其次级通道是不同的,在实际中佩戴者也会经常的调整耳机的松紧度引起上述两个传递函数的变化。因而自适应算法必须具备良好的实时跟踪性能。Another problem with frequency-domain adaptive algorithms is that the choice of step size must be a compromise between convergence speed and steady-state misalignment. A larger step size can ensure that the algorithm has a faster initial convergence speed, and has the ability to quickly re-track when the system changes, but a large step size can easily make the algorithm have a larger misalignment in the steady state, which is is an undesirable property. In the actual environment, the transfer functions of the main channel and the secondary channel are time-varying. For example, the size of the ears of different people is different, so the secondary channel is different after wearing the earphones. In practice, the wearer will often adjust The tightness of the earphones causes changes in the above two transfer functions. Therefore, the adaptive algorithm must have good real-time tracking performance.

发明内容Contents of the invention

针对现有技术存在的上述不足,本发明的目的在于:提供一种耳机自适应有源噪声控制系统及方法,能够解决普通自适应算法实时跟踪能力不足和计算延时过大等问题,对不同的环境和不同的耳机佩戴方式都具有较好的自适应性能,提高了耳机自适应有源噪声控制的收敛性能和跟踪性能。In view of the above-mentioned deficiencies existing in the prior art, the purpose of the present invention is to provide an earphone adaptive active noise control system and method, which can solve the problems of insufficient real-time tracking ability and excessive calculation delay of ordinary adaptive algorithms, and is suitable for different The environment and different earphone wearing styles have good adaptive performance, which improves the convergence performance and tracking performance of the adaptive active noise control of the earphone.

一种耳机自适应有源噪声控制系统,该系统至少包括:An earphone adaptive active noise control system, the system at least includes:

第一音频采集器和第二音频采集器,第一音频采集器安装在耳机外部,用于采集参考噪音信号;第二音频采集器安装在耳机内部,用于采集降噪后的误差噪音信号;A first audio collector and a second audio collector, the first audio collector is installed outside the earphone for collecting reference noise signals; the second audio collector is installed inside the earphone for collecting error noise signals after noise reduction;

第一模数转换器AD和第二模数转换器AD,第一模数转换器AD和第一音频采集器电连接,用于将第一音频采集器采集的参考噪音信号转换为对应的数字信号,第二模数转换器AD和第二音频采集器电连接,用于将第二音频采集器采集的误差噪音信号转换为对应的数字信号;The first analog-to-digital converter AD and the second analog-to-digital converter AD, the first analog-to-digital converter AD is electrically connected to the first audio collector, and is used to convert the reference noise signal collected by the first audio collector into a corresponding digital signal, the second analog-to-digital converter AD is electrically connected to the second audio collector, and is used to convert the error noise signal collected by the second audio collector into a corresponding digital signal;

处理器单元,第一模数转换器AD和处理器单元第一信息输入端连接,第二模数转换器AD和处理器单元第二信息输入端连接;The processor unit, the first analog-to-digital converter AD is connected to the first information input end of the processor unit, and the second analog-to-digital converter AD is connected to the second information input end of the processor unit;

数模转换器DA和次级扬声器,处理器单元信息输出端经数模转换器DA后和次级扬声器连接,次级扬声器安装在耳机内,数模转换器DA用于将处理器单元的输出滤波信号转换为对应的模拟信号并馈给到次级扬声器,次级扬声器用于播放次级声音信号。The digital-to-analog converter DA and the secondary speaker, the information output end of the processor unit is connected to the secondary speaker after the digital-to-analog converter DA, the secondary speaker is installed in the earphone, and the digital-to-analog converter DA is used to convert the output of the processor unit The filtered signal is converted to a corresponding analog signal and fed to a secondary speaker, which is used to play the secondary sound signal.

进一步地,该控制系统还包括存储器单元,存储器单元和处理器单元双向通信连接。Further, the control system also includes a memory unit, and the memory unit and the processor unit are connected in bidirectional communication.

进一步地,该控制系统还包括电源模块,电源模块和处理器单元供电端连接。Further, the control system also includes a power module, which is connected to a power supply terminal of the processor unit.

进一步地,该控制系统还包括控制逻辑单元,控制逻辑单元用于控制有源降噪功能的开关。Further, the control system also includes a control logic unit, which is used to control the switch of the active noise reduction function.

一种耳机自适应有源噪声控制方法,包括以下步骤:A kind of earphone adaptive active noise control method, comprises the following steps:

由第一音频采集器实时采集参考噪音信号,并通过第一模数转换器将参考噪音信号转换为对应的数字信号x(n)后传输到处理器单元;由第二音频采集器实时采集误差噪音信号,并通过第二模数转换器将误差噪音信号转换为对应的数字信号e(n)后传输到处理器单元;The reference noise signal is collected in real time by the first audio collector, and the reference noise signal is converted into a corresponding digital signal x(n) by the first analog-to-digital converter and then transmitted to the processor unit; the error is collected in real time by the second audio collector noise signal, and the error noise signal is converted into a corresponding digital signal e(n) by the second analog-to-digital converter and then transmitted to the processor unit;

通过处理器单元计算滤波器系数向量和计算输出滤波信号y(n),在频域内采用卡尔曼滤波计算滤波器系数向量在时域内对数字信号x(n)和时域滤波器系数进行卷积得到输出滤波信号y(n);其中,时域滤波器系数是滤波系数向量的逆傅里叶变换;Calculation of the filter coefficient vector by the processor unit and calculate the output filtered signal y(n), and use the Kalman filter to calculate the filter coefficient vector in the frequency domain In the time domain for the digital signal x(n) and the time domain filter coefficients Perform convolution to obtain the output filtered signal y(n); where, the time domain filter coefficient is the filter coefficient vector The inverse Fourier transform of ;

通过数模转换器将输出滤波信号y(n)转换为对应的模拟信号并馈给到次级扬声器,次级扬声器用于播放次级声音信号。The output filtered signal y(n) is converted into a corresponding analog signal by a digital-to-analog converter and fed to the secondary speaker, which is used to play the secondary sound signal.

进一步地,在频域内采用卡尔曼滤波计算滤波器系数向量的步骤如下:Further, the Kalman filter is used to calculate the filter coefficient vector in the frequency domain The steps are as follows:

在频域内,参考噪音信号对应的数字信号x(n)经过估计的次级通道滤波得到卡尔曼滤波输入信号v(n);In the frequency domain, the digital signal x(n) corresponding to the reference noise signal is estimated by the secondary channel Filter to obtain the Kalman filter input signal v(n);

将最近的2L点卡尔曼滤波输入信号v(n)组成的序列做傅里叶变换得到频域向量v(k),将频域向量v(k)的元素依次放置于对角线组成对角矩阵V(k);Fourier transform the sequence composed of the nearest 2L-point Kalman filter input signal v(n) to obtain the frequency domain vector v(k), and place the elements of the frequency domain vector v(k) on the diagonal to form the diagonal matrix V(k);

将最近的L点误差噪音信号e(n)组成的序列做傅里叶变换得到频域向量E(k);Perform Fourier transform on the sequence composed of the nearest L point error noise signal e(n) to obtain the frequency domain vector E(k);

更新卡尔曼增益矩阵K(k)=P(k)VH(k)[V(k)P(k)VH(k)+2ψee(k)]-1,其中,P(k)是状态误差矩阵,ψee(k)是观测噪声误差对角协方差矩阵,上标H代表共轭转置操作;Update the Kalman gain matrix K(k)=P(k)V H (k)[V(k)P(k)V H (k)+2ψ ee (k)] -1 , where P(k) is The state error matrix, ψ ee (k) is the diagonal covariance matrix of the observation noise error, and the superscript H represents the conjugate transpose operation;

更新频域滤波器系数向量其中是约束矩阵,IL是维数为L×L的单位矩阵,0L是维数为L×L的零矩阵,F是傅里叶变换矩阵,K(k)是卡尔曼增益矩阵;Update frequency-domain filter coefficient vector in is a constraint matrix, I L is an identity matrix whose dimension is L×L, 0 L is a zero matrix whose dimension is L×L, F is a Fourier transform matrix, and K(k) is a Kalman gain matrix;

更新状态误差矩阵P(k):其中,ψΔΔ(k)是过程噪声对角矩阵,I2L是维数为2L×2L的单位矩阵。Update state error matrix P(k): Among them, ψ ΔΔ (k) is the process noise diagonal matrix, and I 2L is the identity matrix whose dimension is 2L×2L.

进一步地,为了计算卡尔曼增益矩阵K(k),我们需要知道ψee(k),本发明中所述观测噪声误差矩阵ψee(k)采用误差噪音信号e(n)的平滑功率谱计算得到。Further, in order to calculate the Kalman gain matrix K (k), we need to know ψ ee (k), the observation noise error matrix ψ ee (k) in the present invention is calculated by using the smooth power spectrum of the error noise signal e (n) get.

进一步地,为了计算状态误差矩阵P(k),我们还需要计算过程噪声协方差矩阵ψΔΔ(k),本发明中所述的过程噪声对角矩阵ψΔΔ(k)的对角线元素ψΔΔ,i(k)的计算方法是其中,是滤波系数向量的第i个元素。Further, in order to calculate the state error matrix P(k), we also need to calculate the process noise covariance matrix ψ ΔΔ (k), the diagonal element ψ of the process noise diagonal matrix ψ ΔΔ (k) described in the present invention ΔΔ,i (k) is calculated by in, is the filter coefficient vector The i-th element of .

相比于现有技术,本发明具有以下优点:Compared with the prior art, the present invention has the following advantages:

本发明公开的一种耳机自适应有源噪声控制系统及方法,在频域内采用卡尔曼滤波算法来更新滤波系数,由于卡尔曼滤波算法具有很好的跟踪性能,从而解决了普通的自适应算法跟踪能力不足的问题,使得可以满足不同的应用环境和不同的耳机佩戴方式。同时,将频域的滤波系数转换到时域,在时域内利用卷积直接计算得到输出滤波,从而避免了在频域计算引入的块延时。通过该控制系统和方法,提高了计算的收敛性能和跟踪性能。An earphone self-adaptive active noise control system and method disclosed in the present invention adopts a Kalman filter algorithm to update the filter coefficients in the frequency domain. Since the Kalman filter algorithm has good tracking performance, it solves the problem of common self-adaptive algorithms. The problem of insufficient tracking ability makes it possible to meet different application environments and different wearing styles of headphones. At the same time, the filter coefficients in the frequency domain are converted to the time domain, and the output filter is directly calculated by convolution in the time domain, thereby avoiding the block delay introduced by the frequency domain calculation. Through the control system and method, the convergence performance and tracking performance of calculation are improved.

附图说明Description of drawings

图1为本发明实施例中耳机自适应有源噪声控制系统的系统框图;Fig. 1 is a system block diagram of an earphone adaptive active noise control system in an embodiment of the present invention;

图2为本发明实施例中耳机自适应有源噪声的控制示意图;FIG. 2 is a schematic diagram of control of earphone adaptive active noise in an embodiment of the present invention;

图3为本发明实施例中处理器单元的滤波流程图;Fig. 3 is the filtering flowchart of processor unit in the embodiment of the present invention;

图4为本发明实施例中在频域内采用卡尔曼滤波的流程图;Fig. 4 is the flowchart of adopting Kalman filter in the frequency domain in the embodiment of the present invention;

图5为本发明实施例中观测噪声功率谱计算流程图。Fig. 5 is a flow chart of calculating the power spectrum of the observation noise in the embodiment of the present invention.

附图标记:Reference signs:

102、第一音频采集器;104、第二音频采集器;106、次级扬声器;108、第一模数转换器AD;110、数模转换器DA;112、第二模数转换器AD;114、估计的次级通道;116、滤波器时域系数;118、卡尔曼滤波;120、控制器单元;150、存储器单元;160、电源模块;170、控制逻辑单元;180、耳机;202、移位单元;204、移位单元;206、移位单元;208、乘法器;210、乘法器;212、乘法器;214、乘法器;216、加法器;218、加法器;220、加法器;302、傅里叶变换单元;304、卡尔曼增益矩阵;306、傅里叶变换单元;308、乘法器;310、逆傅里叶变换运算单元;312、序列后半部分置零;314、傅里叶变换;316、加法器;318、延时单元;320、逆傅里叶变换;402、取共轭模块;404、乘法单元;406、乘法单元;408、加法单元;410、乘法单元;412、延时单元。102. A first audio collector; 104. A second audio collector; 106. A secondary speaker; 108. A first analog-to-digital converter AD; 110. A digital-to-analog converter DA; 112. A second analog-to-digital converter AD; 114, estimated secondary channel; 116, filter time domain coefficient; 118, Kalman filter; 120, controller unit; 150, memory unit; 160, power module; 170, control logic unit; 180, earphone; 202, Shift unit; 204, shift unit; 206, shift unit; 208, multiplier; 210, multiplier; 212, multiplier; 214, multiplier; 216, adder; 218, adder; 220, adder ; 302, Fourier transform unit; 304, Kalman gain matrix; 306, Fourier transform unit; 308, multiplier; 310, inverse Fourier transform operation unit; 312, the second half of the sequence is set to zero; 314, Fourier transform; 316, adder; 318, delay unit; 320, inverse Fourier transform; 402, conjugate module; 404, multiplication unit; 406, multiplication unit; 408, addition unit; 410, multiplication unit ; 412, delay unit.

具体实施方式Detailed ways

下面将结合附图对本发明技术方案的实施例进行详细的描述。以下实施例仅用于更加清楚地说明本发明的技术方案,因此只是作为示例,而不能以此来限制本发明的保护范围。Embodiments of the technical solutions of the present invention will be described in detail below in conjunction with the accompanying drawings. The following examples are only used to illustrate the technical solution of the present invention more clearly, so they are only examples, and should not be used to limit the protection scope of the present invention.

实施例:Example:

参照图1和图2,一种耳机自适应有源噪声控制系统,该系统包括:Referring to Figure 1 and Figure 2, a headphone adaptive active noise control system, the system includes:

第一音频采集器102和第二音频采集器104,第一音频采集器安装在耳机180外部,用于采集参考噪音信号;第二音频采集器安装在耳机内部,用于采集降噪后的误差噪音信号;The first audio collector 102 and the second audio collector 104, the first audio collector is installed outside the earphone 180 for collecting reference noise signals; the second audio collector is installed inside the earphone for collecting errors after noise reduction noise signal;

第一模数转换器AD108和第二模数转换器AD112,第一模数转换器AD和第一音频采集器电连接,用于将第一音频采集器采集的参考噪音信号转换为对应的数字信号x(n),第二模数转换器AD和第二音频采集器电连接,用于将第二音频采集器采集的误差噪音信号转换为对应的数字信号e(n);The first analog-to-digital converter AD108 and the second analog-to-digital converter AD112, the first analog-to-digital converter AD is electrically connected to the first audio collector, for converting the reference noise signal collected by the first audio collector into corresponding digital Signal x(n), the second analog-to-digital converter AD is electrically connected to the second audio collector, and is used to convert the error noise signal collected by the second audio collector into a corresponding digital signal e(n);

处理器单元140,第一模数转换器AD和处理器单元第一信息输入端连接,第二模数转换器AD和处理器单元第二信息输入端连接;数字信号x(n)和数字信号e(n)输入到处理器单元,处理器单元分析后得到滤波器时域系数116和输出滤波信号y(n);处理器单元140有两部分功能,一是利用参考噪声信号对应的数字信号x(n)和误差噪音信号对应的数字信号e(n)更新滤波器系数向量二是计算滤波输出信号y(n)。其中滤波器系数向量是在频域内逐帧更新得到的,滤波输出信号y(n)是在时域逐点计算得到的。Processor unit 140, the first analog-to-digital converter AD is connected to the first information input end of the processor unit, and the second analog-to-digital converter AD is connected to the second information input end of the processor unit; digital signal x(n) and digital signal e(n) is input to the processor unit, and the processor unit analyzes and obtains the time domain coefficient of the filter 116 and the output filter signal y (n); the processor unit 140 has two functions, one is to utilize the digital signal x (n) corresponding to the reference noise signal and the digital signal e (n) corresponding to the error noise signal to update the filter coefficient vector The second is to calculate the filtered output signal y(n). where the filter coefficient vector is updated frame by frame in the frequency domain, and the filtered output signal y(n) is calculated point by point in the time domain.

数模转换器DA110和次级扬声器106,处理器单元信息输出端经数模转换器DA后和次级扬声器连接,次级扬声器安装在耳机内,数模转换器DA用于将处理器单元的输出滤波信号转换为对应的模拟信号并馈给到次级扬声器,次级扬声器用于播放次级声音信号;输出滤波信号y(n)经过数模转换器DA110后送给次级扬声器106播放。具体实施时,第一音频采集器和第二音频采集器均可以采用麦克风。Digital-to-analog converter DA110 and secondary loudspeaker 106, the information output end of the processor unit is connected with the secondary loudspeaker after the digital-to-analog converter DA, the secondary loudspeaker is installed in the earphone, and the digital-to-analog converter DA is used to convert the processor unit The output filtered signal is converted into a corresponding analog signal and fed to the secondary speaker for playing the secondary sound signal; the output filtered signal y(n) is sent to the secondary speaker 106 for playback after passing through the digital-to-analog converter DA110 . During specific implementation, both the first audio collector and the second audio collector may use microphones.

本实施例中,该控制系统还包括存储器单元150,存储器单元和处理器单元双向通信连接。该控制系统还包括电源模块160,电源模块和处理器单元供电端连接。该控制系统还包括控制逻辑单元170,控制逻辑单元用于控制有源降噪功能的开关。具体实施时,所述处理器单元可以采用DSP、ARM或其他专用处理器芯片。所述存储器单元用来做存储程序和变量。该控制系统还包括安装壳体和电路板,安装壳体内设有电路板安装腔,所述第二音频采集器、第一模数转换器、第二模数转换器、处理器单元、数模转换器和次级扬声器均安装在电路板上。所述安装壳体外表面设有一安装座,第一音频采集器安装在安装座上。In this embodiment, the control system further includes a memory unit 150, and the memory unit is connected to the processor unit in bidirectional communication. The control system also includes a power module 160, which is connected to the power supply terminal of the processor unit. The control system also includes a control logic unit 170 for controlling the switch of the active noise reduction function. During specific implementation, the processor unit may adopt DSP, ARM or other special-purpose processor chips. The memory unit is used to store programs and variables. The control system also includes an installation housing and a circuit board, the installation housing is provided with a circuit board installation cavity, the second audio collector, the first analog-to-digital converter, the second analog-to-digital converter, the processor unit, the digital-to-analog Both the converter and the secondary speakers are mounted on the circuit board. An installation base is provided on the outer surface of the installation housing, and the first audio collector is installed on the installation base.

参照图2~图5,一种耳机自适应有源噪声控制方法,包括以下步骤:Referring to Figures 2 to 5, an adaptive active noise control method for earphones includes the following steps:

由第一音频采集器实时采集参考噪音信号,并通过第一模数转换器将参考噪音信号转换为对应的数字信号x(n)后传输到处理器单元;由第二音频采集器实时采集误差噪音信号,并通过第二模数转换器将误差噪音信号转换为对应的数字信号e(n)后传输到处理器单元;The reference noise signal is collected in real time by the first audio collector, and the reference noise signal is converted into a corresponding digital signal x(n) by the first analog-to-digital converter and then transmitted to the processor unit; the error is collected in real time by the second audio collector noise signal, and the error noise signal is converted into a corresponding digital signal e(n) by the second analog-to-digital converter and then transmitted to the processor unit;

通过处理器单元计算滤波器系数向量和计算输出滤波信号y(n),在频域内采用卡尔曼滤波118计算滤波器系数向量在时域内对数字信号x(n)和时域滤波器系数进行卷积得到输出滤波信号y(n);其中,时域滤波器系数是滤波系数向量的逆傅里叶变换;Calculation of the filter coefficient vector by the processor unit and calculate the output filtered signal y(n), and use the Kalman filter 118 to calculate the filter coefficient vector in the frequency domain In the time domain for the digital signal x(n) and the time domain filter coefficients Perform convolution to obtain the output filtered signal y(n); where, the time domain filter coefficient is the filter coefficient vector The inverse Fourier transform of ;

通过数模转换器将输出滤波信号y(n)转换为对应的模拟信号并馈给到次级扬声器,次级扬声器用于播放次级声音信号。The output filtered signal y(n) is converted into a corresponding analog signal by a digital-to-analog converter and fed to the secondary speaker, which is used to play the secondary sound signal.

本实施例中,在频域内采用卡尔曼滤波计算滤波器系数向量的步骤如下:In this embodiment, the Kalman filter is used to calculate the filter coefficient vector in the frequency domain The steps are as follows:

在频域内,参考噪音信号对应的数字信号x(n)经过估计的次级通道滤波得到卡尔曼滤波输入信号v(n);In the frequency domain, the digital signal x(n) corresponding to the reference noise signal is estimated by the secondary channel Filter to obtain the Kalman filter input signal v(n);

将最近的2L点卡尔曼滤波输入信号v(n)组成的序列做傅里叶变换得到频域向量v(k),将频域向量v(k)的元素依次放置于对角线组成对角矩阵V(k);Fourier transform the sequence composed of the nearest 2L-point Kalman filter input signal v(n) to obtain the frequency domain vector v(k), and place the elements of the frequency domain vector v(k) on the diagonal to form the diagonal matrix V(k);

将最近的L点误差噪音信号e(n)组成的序列做傅里叶变换得到频域向量E(k);Perform Fourier transform on the sequence composed of the nearest L point error noise signal e(n) to obtain the frequency domain vector E(k);

更新卡尔曼增益矩阵K(k)=P(k)VH(k)[V(k)P(k)VH(k)+2ψee(k)]-1,其中,P(k)是状态误差矩阵,ψee(k)是观测噪声误差对角协方差矩阵,上标H代表共轭转置操作;Update the Kalman gain matrix K(k)=P(k)V H (k)[V(k)P(k)V H (k)+2ψ ee (k)] -1 , where P(k) is The state error matrix, ψ ee (k) is the diagonal covariance matrix of the observation noise error, and the superscript H represents the conjugate transpose operation;

更新频域滤波器系数向量其中是约束矩阵,IL是维数为L×L的单位矩阵,0L是维数为L×L的零矩阵,F是傅里叶变换矩阵,K(k)是卡尔曼增益矩阵;Update frequency-domain filter coefficient vector in is a constraint matrix, I L is an identity matrix whose dimension is L×L, 0 L is a zero matrix whose dimension is L×L, F is a Fourier transform matrix, and K(k) is a Kalman gain matrix;

更新状态误差矩阵P(k):其中,ψΔΔ(k)是过程噪声对角矩阵,I2L是维数为2L×2L的单位矩阵。Update state error matrix P(k): Among them, ψ ΔΔ (k) is the process noise diagonal matrix, and I 2L is the identity matrix whose dimension is 2L×2L.

具体实施时,为了计算卡尔曼增益矩阵K(k),我们需要知道ψee(k),本发明中的观测噪声误差矩阵ψee(k)采用误差噪音信号e(n)的平滑功率谱计算得到。为了计算状态误差矩阵P(k),我们还需要计算过程噪声协方差矩阵ψΔΔ(k),本发明中的过程噪声对角矩阵ψΔΔ(k)的对角线元素ψΔΔ,i(k)的计算方法是:During specific implementation, in order to calculate the Kalman gain matrix K (k), we need to know ψ ee (k), the observation noise error matrix ψ ee (k) in the present invention adopts the smooth power spectrum calculation of the error noise signal e (n) get. In order to calculate the state error matrix P(k), we also need to calculate the process noise covariance matrix ψ ΔΔ (k), the diagonal elements of the process noise diagonal matrix ψ ΔΔ (k) in the present invention ψ ΔΔ,i (k ) is calculated as:

其中,是滤波系数向量的第i个元素。控制器单元120由第一模数转换器AD、数模转换器DA、第二模数转换器AD、估计的次级通道、滤波时域系数和卡尔曼滤波组成。 in, is the filter coefficient vector The i-th element of . The controller unit 120 consists of a first analog-to-digital converter AD, a digital-to-analog converter DA, a second analog-to-digital converter AD, estimated secondary channels, filtered time-domain coefficients and Kalman filtering.

下面,我们来阐述图2中的116模块的具体实现方式:参照图3,输出滤波信号y(n)的计算过程,其中,长度为L的滤波向量数字信号x(n)和输出滤波信号y(n)之间的关系式为:Below, we will describe the specific implementation of the 116 module in Figure 2: with reference to Figure 3, the calculation process of the output filter signal y(n), wherein the length of the filter vector of L The relationship between the digital signal x(n) and the output filtered signal y(n) is:

其中,表示时域滤波器系数向量的第i个元素。每一个新的采样数据到来时,我们要按照表达式(1)执行L次乘法运算和L-1次加法运算得到卷积得到输出滤波信号y(n)。具体的说,系统内部维护一个缓冲区或者移位寄存器用来存放当前及过去的采样数据。参照图3,每当新的采样数据到来时,旧的数据通过一系列移位单元202、204、206和其他单元等得到x(n-1),x(n-2),直到x(n-L+1)共L个元素。然后这些元素通过乘法器单元和滤波器权值相乘,也就是数字信号x(n)和权值通过乘法器208相乘,数字信号x(n-1)和权值通过乘法器210相乘,数字信号x(n-2)和权值通过乘法器212相乘,以此类推,最后x(n-L+1)和权值通过乘法器214相乘,然后把所有的乘法结果用加法器216、218和220相加得到输出滤波信号y(n)。该信号在下一个采样时刻到来时输出给数模转换器DA110,也就是滤波模块的延时是一个采样周期Ts。在实际中,我们可以通过提高数字系统的采样频率fs使得采样周期Ts足够的小,从而该延时对整个系统的因果性影响可以忽略不计。当然采样频率fs也不能无限增大,因为fs越大,建模控制器需要的FIR滤波器的阶数L也越大,从而表达式(1)需要的计算量也急剧增大。实际应用中需要做出平衡选择。处理器的运算速度必须足够快,保证执行表达式(1)需的时间小于一个采样周期,否则这就不是一个实时系统,造成有源控制系统的性能下降甚至失败。in, Represents a vector of time-domain filter coefficients The i-th element of . When each new sampling data arrives, we need to perform L times of multiplication and L-1 times of addition according to the expression (1) to obtain the convolution to obtain the output filter signal y(n). Specifically, the system maintains a buffer or shift register to store current and past sampling data. With reference to Fig. 3, whenever new sampling data arrives, old data obtains x(n-1), x(n-2) through a series of shift units 202, 204, 206 and other units, until x(n -L+1) has a total of L elements. Then these elements are multiplied by the multiplier unit and the filter weight, that is, the digital signal x(n) and the weight Multiplied by multiplier 208, digital signal x(n-1) and weight Multiplied by the multiplier 210, the digital signal x(n-2) and the weight Multiplied by multiplier 212, and so on, finally x(n-L+1) and weight are multiplied by the multiplier 214, and then all the multiplication results are added by the adders 216, 218 and 220 to obtain the output filtered signal y(n). The signal is output to the digital-to-analog converter DA110 when the next sampling moment arrives, that is, the delay of the filtering module is one sampling period T s . In practice, we can make the sampling period T s sufficiently small by increasing the sampling frequency f s of the digital system, so that the causal impact of the delay on the entire system can be ignored. Of course, the sampling frequency f s cannot be increased indefinitely, because the larger f s is, the larger the order L of the FIR filter required by the modeling controller is, so the amount of calculation required by the expression (1) also increases sharply. A balanced choice needs to be made in practical applications. The operation speed of the processor must be fast enough to ensure that the time required to execute expression (1) is less than one sampling period, otherwise this is not a real-time system, resulting in performance degradation or even failure of the active control system.

下面我们讨论另一个关键问题,处理器滤波系数向量的更新,最常用的自适应算法是FxLMS算法。处理器用一个传递函数W(z)来表示,次级扬声器至第二音频采集器的传递函数写为S(z),从第一音频采集器到第二音频采集器的传递函数记为P(z)。那么当自适应算法收敛到稳态时,我们得到W(z)=-P(z)/S(z),则第二音频采集器处的声压为零,从而达到完美的控制噪声的目的。Next we discuss another key issue, the update of the processor filter coefficient vector, the most commonly used adaptive algorithm is the FxLMS algorithm. The processor is represented by a transfer function W(z), the transfer function from the secondary speaker to the second audio collector is written as S(z), and the transfer function from the first audio collector to the second audio collector is written as P( z). Then when the adaptive algorithm converges to a steady state, we get W(z)=-P(z)/S(z), then the sound pressure at the second audio collector is zero, thus achieving the goal of perfect noise control .

在实际应用中,主通道传递函数P(z)和次级通道传递函数S(z)可能是时变的。具体到耳机的应用中,每个人的头部尺寸具有个性化并且个体佩戴耳机喜欢的松紧度也不同,在佩戴的过程中,佩戴者也会不时的调整耳机的位置和松紧度,这都导致次级通道传递函数S(z)有差异,从而处理器传递函数W(z)也是时变的。这就要求所采用的自适应滤波器具有很好的跟踪性能。在本发明专利中,我们是利用频域卡尔曼滤波算法来得到图2中116模块的滤波系数也就是图2中模块118需要实现的功能。为了使得技术人员更好的理解本发明的主要思想,我们在图4具体的给出了图2中模块118的实现步骤。In practical applications, the primary channel transfer function P(z) and the secondary channel transfer function S(z) may be time-varying. Specifically in the application of earphones, each person's head size is individualized and the degree of tightness that individuals prefer to wear earphones is also different. During the wearing process, the wearer will also adjust the position and tightness of the earphones from time to time, which leads to The secondary channel transfer function S(z) varies, and thus the processor transfer function W(z) is also time-varying. This requires the adaptive filter used to have good tracking performance. In the patent of this invention, we use the frequency-domain Kalman filter algorithm to obtain the filter coefficients of the 116 modules in Figure 2 That is, the function to be realized by the module 118 in FIG. 2 . In order to make technical personnel better understand the main idea of the present invention, we specifically show the implementation steps of module 118 in FIG. 2 in FIG. 4 .

然而我们控制器传递函数的变化很难用精确的数学模型描述出来。为了便于描述问题又能符合实际的需求,我们采用简化的一阶马尔科夫模型来描述控制器,也就是However, the variation of our controller transfer function is difficult to describe with an accurate mathematical model. In order to facilitate the description of the problem and meet the actual needs, we use a simplified first-order Markov model to describe the controller, that is,

W(k+1)=W(k)+Δ(k) (2)W(k+1)=W(k)+Δ(k) (2)

在上式中,W(k)表示频域的滤波系数向量,Δ(k)表示从第k帧到k+1帧时频域滤波系数的变化,称为过程噪声。当Δ(k)接近零向量时,表示系统几乎没有变化,当Δ(k)较大时,表明系统有较大的变化。在卡尔曼滤波的语言中,表达式(2)被称为状态方程。现在我们来给出基于卡尔曼滤波的频域自适应滤波算法。In the above formula, W(k) represents the filter coefficient vector in the frequency domain, and Δ(k) represents the change of the filter coefficient in the frequency domain from the kth frame to the k+1 frame, which is called process noise. When Δ(k) is close to the zero vector, it means that there is almost no change in the system, and when Δ(k) is large, it means that the system has a large change. In the language of Kalman filtering, expression (2) is called the equation of state. Now let's give a frequency-domain adaptive filtering algorithm based on Kalman filtering.

卡尔曼滤波器的输入信号v(n)是输入数字信号x(n)经过估计的次级通道滤波得到的,也就是图2中的模块114实现的表达式为:The input signal v(n) of the Kalman filter is the estimated secondary channel of the input digital signal x(n) Obtained by filtering, that is, the expression realized by module 114 in Fig. 2 is:

该操作可以在时域卷积或者频域傅里叶变换完成。还需要注意的是为了顺利的实现该发明的方法,需要估计次级通道传递函数该传递函数的估计可以事先利用经典的系统辨识的方法得到,例如西蒙赫金的经典论著《S.Haykin,Adaptive FilterTheory,5th Edition,Prentice Hall,2013》中描述了利用各种自适应算法可以用来估计该传递函数。This operation can be done in time-domain convolution or frequency-domain Fourier transform. It should also be noted that in order to successfully implement the method of the invention, it is necessary to estimate the transfer function of the secondary channel The estimation of the transfer function can be obtained in advance by using the classical system identification method. For example, Simon Hekin’s classic treatise "S. Haykin, Adaptive Filter Theory, 5th Edition, Prentice Hall, 2013" describes that using various adaptive algorithms can be used to estimate the transfer function.

参照图4,阐述卡尔曼滤波的具体实现。首先,傅里叶变换单元302将最近的2L点v(n)组成的序列做傅里叶变换得到频域向量v(k)=F[v(kL-2L+1),…,v(kL)]T,其中,F表示傅里叶变换矩阵,将v(k)的元素依次放置于对角线组成对角矩阵V(k)。Referring to FIG. 4 , the specific implementation of the Kalman filter is described. First, the Fourier transform unit 302 performs Fourier transform on the sequence composed of the nearest 2L points v(n) to obtain the frequency domain vector v(k)=F[v(kL-2L+1),...,v(kL )] T , where F represents the Fourier transform matrix, and the elements of v(k) are placed on the diagonal in turn to form a diagonal matrix V(k).

傅里叶变换单元306将最近的L点e(n)组成的序列做傅里叶变换得到频域向量The Fourier transform unit 306 performs Fourier transform on the sequence composed of the nearest L points e(n) to obtain the frequency domain vector

那么根据表达式(2),频域卡尔曼滤波的更新方程是: Then according to expression (2), the update equation of frequency domain Kalman filter is:

其中,是频域滤波器系数向量,实际上它是时域滤波器系数向量的2L点傅里叶变换,K(k)是卡尔曼增益矩阵304,是约束矩阵,IL是维数为L×L的单位矩阵,0L是维数为L×L的零矩阵。in, is a vector of frequency-domain filter coefficients, in fact it is a vector of time-domain filter coefficients The 2L point Fourier transform of , K(k) is the Kalman gain matrix 304, is a constraint matrix, I L is an identity matrix with a dimension of L×L, and 0 L is a zero matrix with a dimension of L×L.

现在,我们根据图4来阐述表达式(4)的具体实施。304单元根据输入V(k)计算出卡尔曼增益矩阵K(k),乘法器308完成输入矩阵V(k)和增益矩阵K(k)相乘运算得到对角矩阵C(k)。取对角矩阵C(k)的对角线元素得到向量c(k),然后逆傅里叶变换运算单元310完成向量c(k)的逆傅里叶变换得到维数为2L×1的实数向量a(k)。接下来序列后半部分置零模块312实现约束功能,也就是将序列a(k)后面的L个元素置为零而前面的L个元素保持不变得到一个新的序列b(k)。接着,傅里叶变换模块314对序列b(k)执行傅里叶变换,在加法器316处与延时单元318的输出相加得到同时将在单元320进行逆傅里叶变换变换得到用来在下一帧赋值给图2的模块116,卡尔曼增益矩阵K(k)的表达式为:Now, we illustrate the specific implementation of expression (4) according to FIG. 4 . Unit 304 calculates the Kalman gain matrix K(k) according to the input V(k), and the multiplier 308 completes the multiplication operation of the input matrix V(k) and the gain matrix K(k) to obtain a diagonal matrix C(k). Take the diagonal elements of the diagonal matrix C(k) to obtain the vector c(k), and then the inverse Fourier transform operation unit 310 completes the inverse Fourier transform of the vector c(k) to obtain a real number whose dimension is 2L×1 vector a(k). Next, the zero-setting module 312 in the second half of the sequence implements the constraint function, that is, the L elements behind the sequence a(k) are set to zero while the previous L elements remain unchanged to obtain a new sequence b(k). Next, the Fourier transform module 314 performs Fourier transform on the sequence b(k), and at the adder 316 and the output of the delay unit 318 Add up to get At the same time will Perform inverse Fourier transform in unit 320 to obtain Used to assign values to the module 116 of FIG. 2 in the next frame, the expression of the Kalman gain matrix K (k) is:

K(k)=P(k)VH(k)[V(k)P(k)VH(k)+2ψee(k)]-1 (5)K(k)=P(k)V H (k)[V(k)P(k)V H (k)+2ψ ee (k)] -1 (5)

其中,P(k)是状态误差矩阵,ψee(k)=diag{[ψee,0(k),ψee,1(k),…,ψee,2L-1(k)]T}是系统噪声误差对角矩阵,上标H代表共轭转置操作。P(k)的计算方法为:Among them, P(k) is the state error matrix, ψ ee (k)=diag{[ψ ee,0 (k),ψ ee,1 (k),…,ψ ee,2L-1 (k)] T } is the system noise error diagonal matrix, and the superscript H stands for the conjugate transpose operation. The calculation method of P(k) is:

其中,ψee(k)=diag{[ψee,0(k),ψee,1(k),…,ψee,2L-1(k)]T}是过程噪声对角矩阵,I是维数为2L×2L的单位矩阵,也就是图4中304模块的实施由表达式(5)和表达式(6)描述。Among them, ψ ee (k)=diag{[ψ ee,0 (k),ψ ee,1 (k),…,ψ ee,2L-1 (k)] T } is the process noise diagonal matrix, I is An identity matrix with a dimension of 2L×2L, that is, the implementation of module 304 in FIG. 4 is described by Expression (5) and Expression (6).

系统观测噪声信号的功率谱ψee,i(k)的估计是一个重要的问题,在实际中我们没有一种手段可以测量叠加在误差麦克风的系统噪声信号。但是,当滤波器收敛到一定程度的时候,数字信号e(n)可以较好的逼近系统的观测噪声信号。基于这个事实,在本发明专利中,我们利用误差信号的功率谱来代替观测噪声功率谱。也就是我们采用对误差信号瞬时功率经过一个低通滤波器平滑得到,如下式:Estimation of the power spectrum ψ ee,i (k) of the system observation noise signal is an important issue. In practice, we do not have a means to measure the system noise signal superimposed on the error microphone. However, when the filter converges to a certain degree, the digital signal e(n) can better approximate the observed noise signal of the system. Based on this fact, in the patent of the present invention, we use the power spectrum of the error signal to replace the power spectrum of the observation noise. That is, we use the instantaneous power of the error signal to smooth through a low-pass filter, as follows:

ψee,i(k)=αψee,i(k-1)+(1-α)|Ei(k)|2 (7)ψ ee,i (k)=αψ ee,i (k-1)+(1-α)|E i (k)| 2 (7)

其中,α是平滑因子,建议取α=0.8。依据这个公式,图5给出了计算系统观测噪声信号的功率谱ψee,i(k)的具体框图,首先在模块402对输入Ei(k)取共轭操作,然后将Ei(k)和它的共轭在404单元进行乘法运算,然后对乘法单元404的输出在406乘上因子1-α。延时单元412对ψee,i(k)进行延时操作得到ψee,i(k-1),然后与因子α在单元410进行乘法运算,乘法单元406的输出和乘法单元410的输出在加法单元408处求和得到ψee,i(k)。Among them, α is a smoothing factor, it is recommended to take α=0.8. According to this formula, Fig. 5 shows the specific block diagram for calculating the power spectrum ψ ee,i (k) of the system observation noise signal. First, the conjugate operation is performed on the input E i (k) in module 402, and then E i (k ) and its conjugate are multiplied at unit 404, and then the output of multiplication unit 404 is multiplied at 406 by a factor of 1-α. Delay unit 412 carries out delay operation to ψ ee,i (k) and obtains ψ ee,i (k-1), then multiplies with factor α in unit 410, and the output of multiplication unit 406 and the output of multiplication unit 410 are in The addition unit 408 sums to obtain ψ ee,i (k).

为了使得上述算法顺利执行,我们还需要估计过程噪声Δ(k)的协方差矩阵ψΔΔ(k)。我们知道在表达式(4)式中的右边第二项在某种程度上反应了滤波器系数向量的波动情况,因而本发明利用这一项来估计实际的过程噪声矩阵:In order to make the above algorithm run smoothly, we also need to estimate the covariance matrix ψ ΔΔ (k) of the process noise Δ(k). We know that the second term on the right in the expression (4) formula reflects the fluctuation situation of the filter coefficient vector to some extent, so the present invention utilizes this term to estimate the actual process noise matrix:

那么在系统的初始收敛阶段,ψΔΔ,i(k)取比较大的值,这样可以加快滤波器的收敛;当算法达到稳态并且实际的系统波动较小时,ψΔΔ,i(k)取很小的值,这有利于算法在稳态达到更小的失调;而一旦系统发生变动需要快速跟踪的时候,ψΔΔ,i(k)能够取比较大的值从而加快算法的跟踪性能。这从原理上解释了本发明提出的方法具有比传统的频域算法更好的性能。Then in the initial convergence stage of the system, ψ ΔΔ,i (k) takes a relatively large value, which can speed up the convergence of the filter; when the algorithm reaches a steady state and the actual system fluctuation is small, ψ ΔΔ,i (k) takes A small value is beneficial for the algorithm to achieve a smaller misalignment in the steady state; and once the system changes and needs to be tracked quickly, ψ ΔΔ,i (k) can take a relatively large value to speed up the tracking performance of the algorithm. This explains in principle that the method proposed by the present invention has better performance than the traditional frequency domain algorithm.

最后说明的是,以上实施例仅用以说明本发明的技术方案而非限制,尽管参照实施例对本发明进行了详细说明,本领域的普通技术人员应当理解,可以对本发明的技术方案进行修改或者等同替换,而不脱离本发明技术方案的宗旨和范围,其均应涵盖在本发明的保护范围当中。Finally, it is noted that the above embodiments are only used to illustrate the technical solutions of the present invention without limitation. Although the present invention has been described in detail with reference to the embodiments, those of ordinary skill in the art should understand that the technical solutions of the present invention can be modified or Equivalent replacements without departing from the spirit and scope of the technical solution of the present invention shall fall within the protection scope of the present invention.

Claims (8)

1.一种耳机自适应有源噪声控制系统,其特征在于,该系统至少包括:1. An earphone adaptive active noise control system, characterized in that the system at least includes: 第一音频采集器和第二音频采集器,第一音频采集器安装在耳机外部,用于采集参考噪音信号;第二音频采集器安装在耳机内部,用于采集降噪后的误差噪音信号;A first audio collector and a second audio collector, the first audio collector is installed outside the earphone for collecting reference noise signals; the second audio collector is installed inside the earphone for collecting error noise signals after noise reduction; 第一模数转换器AD和第二模数转换器AD,第一模数转换器AD和第一音频采集器电连接,用于将第一音频采集器采集的参考噪音信号转换为对应的数字信号,第二模数转换器AD和第二音频采集器电连接,用于将第二音频采集器采集的误差噪音信号转换为对应的数字信号;The first analog-to-digital converter AD and the second analog-to-digital converter AD, the first analog-to-digital converter AD is electrically connected to the first audio collector, and is used to convert the reference noise signal collected by the first audio collector into a corresponding digital signal, the second analog-to-digital converter AD is electrically connected to the second audio collector, and is used to convert the error noise signal collected by the second audio collector into a corresponding digital signal; 处理器单元,第一模数转换器AD和处理器单元第一信息输入端连接,第二模数转换器AD和处理器单元第二信息输入端连接;The processor unit, the first analog-to-digital converter AD is connected to the first information input end of the processor unit, and the second analog-to-digital converter AD is connected to the second information input end of the processor unit; 数模转换器DA和次级扬声器,处理器单元信息输出端经数模转换器DA后和次级扬声器连接,次级扬声器安装在耳机内,数模转换器DA用于将处理器单元的输出滤波信号转换为对应的模拟信号并馈给到次级扬声器,次级扬声器用于播放次级声音信号。The digital-to-analog converter DA and the secondary speaker, the information output end of the processor unit is connected to the secondary speaker after the digital-to-analog converter DA, the secondary speaker is installed in the earphone, and the digital-to-analog converter DA is used to convert the output of the processor unit The filtered signal is converted to a corresponding analog signal and fed to a secondary speaker, which is used to play the secondary sound signal. 2.根据权利要求1所述的耳机自适应有源噪声控制系统,其特征在于,该控制系统还包括存储器单元,存储器单元和处理器单元双向通信连接。2. The earphone adaptive active noise control system according to claim 1, characterized in that the control system further comprises a memory unit, and the memory unit and the processor unit are connected in bidirectional communication. 3.根据权利要求1所述的耳机自适应有源噪声控制系统,其特征在于,该控制系统还包括电源模块,电源模块和处理器单元供电端连接。3. The earphone adaptive active noise control system according to claim 1, characterized in that the control system further comprises a power supply module connected to a power supply terminal of the processor unit. 4.根据权利要求1所述的耳机自适应有源噪声控制系统,其特征在于,该控制系统还包括控制逻辑单元,控制逻辑单元用于控制有源降噪功能的开关。4. The headphone adaptive active noise control system according to claim 1, characterized in that the control system further comprises a control logic unit for controlling the switch of the active noise reduction function. 5.一种耳机自适应有源噪声控制方法,其特征在于,包括以下步骤:5. an earphone self-adaptive active noise control method, is characterized in that, comprises the following steps: 由第一音频采集器实时采集参考噪音信号,并通过第一模数转换器将参考噪音信号转换为对应的数字信号x(n)后传输到处理器单元;由第二音频采集器实时采集误差噪音信号,并通过第二模数转换器将误差噪音信号转换为对应的数字信号e(n)后传输到处理器单元;The reference noise signal is collected in real time by the first audio collector, and the reference noise signal is converted into a corresponding digital signal x(n) by the first analog-to-digital converter and then transmitted to the processor unit; the error is collected in real time by the second audio collector noise signal, and the error noise signal is converted into a corresponding digital signal e(n) by the second analog-to-digital converter and then transmitted to the processor unit; 通过处理器单元计算滤波器系数向量和计算输出滤波信号y(n),在频域内采用卡尔曼滤波计算滤波器系数向量在时域内对数字信号x(n)和时域滤波器系数进行卷积得到输出滤波信号y(n);其中,时域滤波器系数是滤波系数向量的逆傅里叶变换;Calculation of the filter coefficient vector by the processor unit and calculate the output filtered signal y(n), and use the Kalman filter to calculate the filter coefficient vector in the frequency domain In the time domain for the digital signal x(n) and the time domain filter coefficients Perform convolution to obtain the output filtered signal y(n); where, the time domain filter coefficient is the filter coefficient vector The inverse Fourier transform of ; 通过数模转换器将输出滤波信号y(n)转换为对应的模拟信号并馈给到次级扬声器,次级扬声器用于播放次级声音信号。The output filtered signal y(n) is converted into a corresponding analog signal by a digital-to-analog converter and fed to the secondary speaker, which is used to play the secondary sound signal. 6.根据权利要求5所述的耳机自适应有源噪声控制方法,其特征在于,在频域内采用卡尔曼滤波计算滤波器系数向量的步骤如下:6. earphone adaptive active noise control method according to claim 5, is characterized in that, adopts Kalman filtering to calculate filter coefficient vector in frequency domain The steps are as follows: 在频域内,参考噪音信号对应的数字信号x(n)经过估计的次级通道滤波得到卡尔曼滤波输入信号v(n);In the frequency domain, the digital signal x(n) corresponding to the reference noise signal is estimated by the secondary channel Filter to obtain the Kalman filter input signal v(n); 将最近的2L点卡尔曼滤波输入信号v(n)组成的序列做傅里叶变换得到频域向量v(k),将频域向量v(k)的元素依次放置于对角线组成对角矩阵V(k);Fourier transform the sequence composed of the nearest 2L-point Kalman filter input signal v(n) to obtain the frequency domain vector v(k), and place the elements of the frequency domain vector v(k) on the diagonal to form the diagonal matrix V(k); 将最近的L点误差噪音信号e(n)组成的序列做傅里叶变换得到频域向量E(k);Perform Fourier transform on the sequence composed of the nearest L point error noise signal e(n) to obtain the frequency domain vector E(k); 更新卡尔曼增益矩阵K(k)=P(k)VH(k)[V(k)P(k)VH(k)+2ψee(k)]-1,其中,P(k)是状态误差矩阵,ψee(k)是观测噪声误差对角协方差矩阵,上标H代表共轭转置操作;Update the Kalman gain matrix K(k)=P(k)V H (k)[V(k)P(k)V H (k)+2ψ ee (k)] -1 , where P(k) is The state error matrix, ψ ee (k) is the diagonal covariance matrix of the observation noise error, and the superscript H represents the conjugate transpose operation; 更新频域滤波器系数向量其中是约束矩阵,IL是维数为L×L的单位矩阵,0L是维数为L×L的零矩阵,F是傅里叶变换矩阵,K(k)是卡尔曼增益矩阵;Update frequency-domain filter coefficient vector in is a constraint matrix, I L is an identity matrix whose dimension is L×L, 0 L is a zero matrix whose dimension is L×L, F is a Fourier transform matrix, and K(k) is a Kalman gain matrix; 更新状态误差矩阵P(k):其中,ψΔΔ(k)是过程噪声对角矩阵,I2L是维数为2L×2L的单位矩阵。Update state error matrix P(k): Among them, ψ ΔΔ (k) is the process noise diagonal matrix, and I 2L is the identity matrix whose dimension is 2L×2L. 7.根据权利要求6所述的耳机自适应有源噪声控制方法,其特征在于,所述观测噪声误差矩阵ψee(k)采用误差噪音信号e(n)的平滑功率谱计算得到。7. The earphone adaptive active noise control method according to claim 6, wherein the observed noise error matrix ψ ee (k) is calculated by using the smooth power spectrum of the error noise signal e(n). 8.根据权利要求6所述的耳机自适应有源噪声控制方法,其特征在于,所述过程噪声对角矩阵ψΔΔ(k)的对角线元素ψΔΔ,i(k)的计算方法是其中,是滤波系数向量的第i个元素。8. The earphone adaptive active noise control method according to claim 6, characterized in that, the diagonal element ψ ΔΔ of the process noise diagonal matrix ψ ΔΔ (k), the calculation method of i(k) is in, is the filter coefficient vector The i-th element of .
CN201810758793.1A 2018-07-11 2018-07-11 A headphone adaptive active noise control system and method Expired - Fee Related CN108600894B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810758793.1A CN108600894B (en) 2018-07-11 2018-07-11 A headphone adaptive active noise control system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810758793.1A CN108600894B (en) 2018-07-11 2018-07-11 A headphone adaptive active noise control system and method

Publications (2)

Publication Number Publication Date
CN108600894A true CN108600894A (en) 2018-09-28
CN108600894B CN108600894B (en) 2023-07-04

Family

ID=63615309

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810758793.1A Expired - Fee Related CN108600894B (en) 2018-07-11 2018-07-11 A headphone adaptive active noise control system and method

Country Status (1)

Country Link
CN (1) CN108600894B (en)

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109658947A (en) * 2018-11-18 2019-04-19 南京大学 A kind of active noise controlling method of synchronous modeling and control
CN110166880A (en) * 2019-07-02 2019-08-23 上海电机学院 A kind of modified form adaptive noise reduction earphone and its noise-reduction method
CN110737456A (en) * 2019-09-10 2020-01-31 中山市格美通用电子有限公司 Online upgrade method for wireless earphone and earphone device
CN110896512A (en) * 2019-12-13 2020-03-20 恒玄科技(上海)股份有限公司 Noise reduction method and system for semi-in-ear earphone and semi-in-ear earphone
CN111063333A (en) * 2019-12-19 2020-04-24 湖南国声声学科技股份有限公司 Adaptive noise reduction method, adaptive noise reduction system, adaptive noise reduction device, and computer-readable storage medium
CN111341336A (en) * 2020-03-16 2020-06-26 北京字节跳动网络技术有限公司 Echo cancellation method, device, terminal equipment and medium
CN111554263A (en) * 2020-04-30 2020-08-18 华南理工大学 An active noise distributed control system and method for open spaces
CN112492438A (en) * 2020-11-16 2021-03-12 上海电机学院 Active noise reduction method for feedback type active noise reduction earphone in cabin
CN113115157A (en) * 2021-04-13 2021-07-13 北京安声科技有限公司 Active noise reduction method and device of earphone and semi-in-ear active noise reduction earphone
CN113132846A (en) * 2021-04-13 2021-07-16 北京安声科技有限公司 Active noise reduction method and device of earphone and semi-in-ear active noise reduction earphone
CN113488016A (en) * 2021-06-30 2021-10-08 展讯通信(上海)有限公司 Coefficient determination method and device
CN114040285A (en) * 2021-09-26 2022-02-11 北京小米移动软件有限公司 Method and device for generating parameters of feedforward filter of earphone, earphone and storage medium

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100014685A1 (en) * 2008-06-13 2010-01-21 Michael Wurm Adaptive noise control system
US20110305345A1 (en) * 2009-02-03 2011-12-15 University Of Ottawa Method and system for a multi-microphone noise reduction
JP2013120358A (en) * 2011-12-08 2013-06-17 Nippon Hoso Kyokai <Nhk> Noise suppression device, noise suppression method and noise suppression program
CN103905959A (en) * 2012-12-26 2014-07-02 上海航空电器有限公司 Active noise control device based on pilot headset
US20160255446A1 (en) * 2015-02-27 2016-09-01 Giuliano BERNARDI Methods, Systems, and Devices for Adaptively Filtering Audio Signals
CN107171735A (en) * 2017-05-16 2017-09-15 浙江工业大学 A kind of big line width CO OFDM phase noise compensation methods of time-frequency domain Kalman filtering
CN108172231A (en) * 2017-12-07 2018-06-15 中国科学院声学研究所 A method and system for removing reverberation based on Kalman filter

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100014685A1 (en) * 2008-06-13 2010-01-21 Michael Wurm Adaptive noise control system
US20110305345A1 (en) * 2009-02-03 2011-12-15 University Of Ottawa Method and system for a multi-microphone noise reduction
JP2013120358A (en) * 2011-12-08 2013-06-17 Nippon Hoso Kyokai <Nhk> Noise suppression device, noise suppression method and noise suppression program
CN103905959A (en) * 2012-12-26 2014-07-02 上海航空电器有限公司 Active noise control device based on pilot headset
US20160255446A1 (en) * 2015-02-27 2016-09-01 Giuliano BERNARDI Methods, Systems, and Devices for Adaptively Filtering Audio Signals
CN107171735A (en) * 2017-05-16 2017-09-15 浙江工业大学 A kind of big line width CO OFDM phase noise compensation methods of time-frequency domain Kalman filtering
CN108172231A (en) * 2017-12-07 2018-06-15 中国科学院声学研究所 A method and system for removing reverberation based on Kalman filter

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
刘洁波;黄纯;江亚群;汤涛;谢兴;: "基于强跟踪泰勒-卡尔曼滤波器的动态相量估计算法" *
张谦;景占荣;: "一种过程噪声自适应调节的卡尔曼滤波算法" *
郇战;戴永惠;王振海;陶亚辉;: "基于FxLMS算法和预测滤波器的数字耳机降噪研究" *

Cited By (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109658947A (en) * 2018-11-18 2019-04-19 南京大学 A kind of active noise controlling method of synchronous modeling and control
CN110166880A (en) * 2019-07-02 2019-08-23 上海电机学院 A kind of modified form adaptive noise reduction earphone and its noise-reduction method
CN110737456A (en) * 2019-09-10 2020-01-31 中山市格美通用电子有限公司 Online upgrade method for wireless earphone and earphone device
CN110737456B (en) * 2019-09-10 2023-08-15 中山市格美通用电子有限公司 A kind of online upgrade method of wireless earphone and earphone equipment
CN110896512A (en) * 2019-12-13 2020-03-20 恒玄科技(上海)股份有限公司 Noise reduction method and system for semi-in-ear earphone and semi-in-ear earphone
CN111063333A (en) * 2019-12-19 2020-04-24 湖南国声声学科技股份有限公司 Adaptive noise reduction method, adaptive noise reduction system, adaptive noise reduction device, and computer-readable storage medium
CN111341336A (en) * 2020-03-16 2020-06-26 北京字节跳动网络技术有限公司 Echo cancellation method, device, terminal equipment and medium
CN111341336B (en) * 2020-03-16 2023-08-08 北京字节跳动网络技术有限公司 Echo cancellation method, device, terminal equipment and medium
CN111554263A (en) * 2020-04-30 2020-08-18 华南理工大学 An active noise distributed control system and method for open spaces
CN111554263B (en) * 2020-04-30 2023-03-24 华南理工大学 Active noise distributed control system and method for open space
CN112492438B (en) * 2020-11-16 2022-07-26 上海电机学院 In-cabin feedback active noise reduction headset active noise reduction method
CN112492438A (en) * 2020-11-16 2021-03-12 上海电机学院 Active noise reduction method for feedback type active noise reduction earphone in cabin
CN113132846A (en) * 2021-04-13 2021-07-16 北京安声科技有限公司 Active noise reduction method and device of earphone and semi-in-ear active noise reduction earphone
CN113115157A (en) * 2021-04-13 2021-07-13 北京安声科技有限公司 Active noise reduction method and device of earphone and semi-in-ear active noise reduction earphone
CN113115157B (en) * 2021-04-13 2024-05-03 北京安声科技有限公司 Active noise reduction method and device for earphone and semi-in-ear active noise reduction earphone
CN113132846B (en) * 2021-04-13 2024-05-10 北京安声科技有限公司 Active noise reduction method and device for earphone and semi-in-ear active noise reduction earphone
CN113488016A (en) * 2021-06-30 2021-10-08 展讯通信(上海)有限公司 Coefficient determination method and device
CN114040285A (en) * 2021-09-26 2022-02-11 北京小米移动软件有限公司 Method and device for generating parameters of feedforward filter of earphone, earphone and storage medium
CN114040285B (en) * 2021-09-26 2024-02-06 北京小米移动软件有限公司 Method and device for generating feedforward filter parameters of earphone, earphone and storage medium

Also Published As

Publication number Publication date
CN108600894B (en) 2023-07-04

Similar Documents

Publication Publication Date Title
CN108600894A (en) A kind of earphone adaptive active noise control system and method
CN108428445A (en) A kind of adaptive active denoising method of error free microphone
Zhang et al. Causality study on a feedforward active noise control headset with different noise coming directions in free field
US8804979B2 (en) Method of determining parameters in an adaptive audio processing algorithm and an audio processing system
WO2020248164A1 (en) Active noise reduction method, device and chip, and active control system and storage medium
CN115474121A (en) Active noise reduction method, device, chip, earphone and storage medium
CN111031442A (en) Earphone active noise reduction self-adaptive system based on DSP virtual sensing
Shen et al. A wireless reference active noise control headphone using coherence based selection technique
CN113096629B (en) Relative path virtual sensing method for single-channel feedback active noise control system
EP4439550A1 (en) Active noise reduction method and device for vehicle and storage medium
CN113078884B (en) Add adaptive algorithm for nonlinear fitting
US11790882B2 (en) Active noise cancellation filter adaptation with ear cavity frequency response compensation
Löllmann et al. Challenges in acoustic signal enhancement for human-robot communication
CN108630216A (en) A kind of MPNLMS acoustic feedback suppressing methods based on dual microphone model
CN103929704B (en) The method and system that a kind of adaptive acoustic feedback based on transform domain is eliminated
EP3486896B1 (en) Noise cancellation system and signal processing method
CN109658947A (en) A kind of active noise controlling method of synchronous modeling and control
Hasegawa et al. Headrest application of multi-channel feedback active noise control with virtual sensing technique
CN105721729A (en) Echo cancellation method based on block-sparse proportionate reuse weight coefficient affine projection
CN111436014A (en) Filtering device and filtering method of active noise reduction earphone and active noise reduction earphone
TWI386018B (en) Speech communication device with noise canceling structure
CN115499756A (en) An Open Noise Reduction Algorithm for Audio Devices
Håkansson et al. Noise Canceling Headsets for Speech Communication
CN113488016B (en) Coefficient determination method and device
Sachau et al. Real-time implementation of the frequency-domain FxLMS algorithm without block delay for an adaptive noise blocker

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20230608

Address after: Building 11, Phase II, Smart Terminal Optoelectronics Industrial Park, Industrial Park, Pingliang City, Gansu Province 744000

Applicant after: Gansu Midi Acoustics Co.,Ltd.

Address before: 402360 Building 1, No. 7, Tianxing Avenue, Shuangqiao Economic Development Zone, Dazu District, Chongqing (101 office buildings for standard plants)

Applicant before: CHONGQING CHUANLE AUDIO TECHNOLOGY Co.,Ltd.

GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20230704