CN106878866A - Audio signal processing method, device and terminal - Google Patents
Audio signal processing method, device and terminal Download PDFInfo
- Publication number
- CN106878866A CN106878866A CN201710124912.3A CN201710124912A CN106878866A CN 106878866 A CN106878866 A CN 106878866A CN 201710124912 A CN201710124912 A CN 201710124912A CN 106878866 A CN106878866 A CN 106878866A
- Authority
- CN
- China
- Prior art keywords
- audio signal
- sound
- signal processing
- sound effect
- played
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2430/00—Signal processing covered by H04R, not provided for in its groups
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Circuit For Audible Band Transducer (AREA)
Abstract
Description
技术领域technical field
本发明涉及终端技术领域,尤其涉及一种音频信号处理方法、装置及终端。The present invention relates to the technical field of terminals, in particular to an audio signal processing method, device and terminal.
背景技术Background technique
目前,多基于标准的信号源来对移动终端的音频播放模块进行调试,当调试出理想的声音效果后,将该理想声音效果对应的音频播放模块的处理参数作为移动终端的固定处理参数。At present, the audio playback module of the mobile terminal is usually debugged based on a standard signal source. When an ideal sound effect is debugged, the processing parameters of the audio playback module corresponding to the ideal sound effect are used as fixed processing parameters of the mobile terminal.
在移动终端每次播放音频时,移动终端都基于该固定处理参数,来对音源发出的音频进行调整,以使播放出的音频效果较佳。但是,实际应用中,通常移动终端播放的音源是很随机的,有的音源与标准的信号源差异很大,移动终端仍然按照上述固定处理参数,对该音源发出的音频进行处理,就导致播放后的声音效果会比较差。Every time the mobile terminal plays audio, the mobile terminal adjusts the audio from the sound source based on the fixed processing parameters, so that the played audio has a better effect. However, in practical applications, the audio sources played by the mobile terminal are usually very random, and some audio sources are very different from the standard signal sources. The mobile terminal still processes the audio from the audio source according to the above fixed processing parameters, resulting in The final sound effect will be worse.
发明内容Contents of the invention
本发明旨在至少在一定程度上解决相关技术中的技术问题之一。The present invention aims to solve one of the technical problems in the related art at least to a certain extent.
为此,本发明的第一个目的在于提出一种音频信号处理方法,以实现动态调整移动终端的音频信号处理模块的处理参数,用于解决现有技术中当音源差异较大时基于固定处理参数处理音频时存在播放后声音效果较差的问题。For this reason, the first purpose of the present invention is to propose an audio signal processing method to dynamically adjust the processing parameters of the audio signal processing module of the mobile terminal, and to solve the problem in the prior art based on fixed processing when the sound source difference is large. There is a problem that the sound effect after playback is poor when the parameter is processing the audio.
本发明的第二个目的在于提出音频信号处理装置。A second object of the present invention is to propose an audio signal processing device.
本发明的第三个目的在于提出一种终端。The third object of the present invention is to provide a terminal.
为达上述目的,本发明第一方面实施例提出了一种音频信号处理方法,包括:In order to achieve the above purpose, the embodiment of the first aspect of the present invention proposes an audio signal processing method, including:
采集声音播放装置所播放的音频信号;Collecting the audio signal played by the sound playback device;
根据所述音频信号分析所述声音播放装置的声音效果;analyzing the sound effect of the sound playing device according to the audio signal;
根据所述声音效果调整终端中的音频信号处理模块的处理参数,以对所述声音效果进行修正。Adjust the processing parameters of the audio signal processing module in the terminal according to the sound effect, so as to modify the sound effect.
本发明实施例的音频信号处理方法,能够根据扬声器或者受话器所播放出来的声音效果,然后自动调整音频处理模块内部的处理参数,可以使得各音源具有与其对应的最优的处理参数,这样就可以使得在播放任意音源时,扬声器或者受话器所播放出来声音的效果都处于最优状态。The audio signal processing method of the embodiment of the present invention can automatically adjust the processing parameters inside the audio processing module according to the sound effect played by the speaker or receiver, so that each sound source has the optimal processing parameters corresponding to it, so that it can So that when playing any audio source, the effect of the sound played by the speaker or the receiver is in the best state.
另外,本发明实施例的音频信号处理方法,还具有如下附加的技术特征:In addition, the audio signal processing method of the embodiment of the present invention also has the following additional technical features:
在本发明的一个实施例中,所述根据所述音频信号分析所述声音播放装置的声音效果,包括:In an embodiment of the present invention, the analyzing the sound effect of the sound playback device according to the audio signal includes:
对所述音频信号进行快速傅里叶变换,得到所述音频信号的语谱图;performing a fast Fourier transform on the audio signal to obtain a spectrogram of the audio signal;
从所述语谱图中提取所述音频信号的高频成分和低频成分;extracting high frequency components and low frequency components of the audio signal from the spectrogram;
如果所述高频成分与所述低频成分失衡,则确定所述声音效果为声音的高低频失衡。If the high-frequency component is out of balance with the low-frequency component, it is determined that the sound effect is a high-low frequency imbalance of sound.
在本发明的一个实施例中,所述根据所述声音效果调整终端中的音频信号处理模块的处理参数,以对所述声音效果进行修正,包括:In an embodiment of the present invention, the adjusting the processing parameters of the audio signal processing module in the terminal according to the sound effect to modify the sound effect includes:
调整所述音频信号处理模块中数字滤波器的滤波器参数,以使后续播放的所述音频信号中所携带的所述高频成分和所述低频成分处于均衡状态。Adjusting the filter parameters of the digital filter in the audio signal processing module, so that the high frequency component and the low frequency component carried in the audio signal played subsequently are in a balanced state.
在本发明的一个实施例中,所述根据所述音频信号分析所述声音播放装置的声音效果,包括:In an embodiment of the present invention, the analyzing the sound effect of the sound playback device according to the audio signal includes:
获取所述音频信号的振幅;obtaining the amplitude of the audio signal;
将所述振幅与预设的阈值范围进行比较;comparing the amplitude with a preset threshold range;
如果所述振幅未处于所述阈值范围内,则确定所述声音效果为声音的音量异常。If the amplitude is not within the threshold range, it is determined that the sound effect is an abnormal sound volume.
在本发明的一个实施例中,所述根据所述声音效果动态调整终端中的音频信号处理模块的处理参数,包括:In an embodiment of the present invention, the dynamically adjusting the processing parameters of the audio signal processing module in the terminal according to the sound effect includes:
调整所述音频信号处理模块中放大器的增益,以使后续播放的所述音频信号的振幅处于所述阈值范围内。Adjusting the gain of the amplifier in the audio signal processing module, so that the amplitude of the audio signal played subsequently is within the threshold range.
在本发明的一个实施例中,所述根据所述声音效果调整终端中的音频信号处理模块的处理参数,以对所述声音效果进行修正之后,包括:In an embodiment of the present invention, after adjusting the processing parameters of the audio signal processing module in the terminal according to the sound effect to modify the sound effect, it includes:
基于调整后的所述音频信号处理模块对音源所发出的音频信号进行处理;Processing the audio signal sent by the sound source based on the adjusted audio signal processing module;
将处理后的所述音频信号通过所述声音播放装置播放。and playing the processed audio signal through the sound playing device.
在本发明的一个实施例中,所述采集声音播放装置所播放的音频信号,包括:In one embodiment of the present invention, the audio signal played by the collection sound playback device includes:
通过所述终端上的麦克风对所述声音播放装置所播放的音频信号进行采集。The audio signal played by the sound playback device is collected through the microphone on the terminal.
为达上述目的,本发明第二方面实施例提出了一种音频信号处理装置,包括:In order to achieve the above purpose, the embodiment of the second aspect of the present invention proposes an audio signal processing device, including:
采集模块,用于采集声音播放装置所播放的音频信号;The collection module is used to collect the audio signal played by the sound playback device;
分析模块,用于根据所述音频信号分析所述声音播放装置的声音效果;An analysis module, configured to analyze the sound effect of the sound playback device according to the audio signal;
参数调整模块,用于根据所述声音效果调整终端中的音频信号处理模块的处理参数,以对所述声音效果进行修正。The parameter adjustment module is configured to adjust the processing parameters of the audio signal processing module in the terminal according to the sound effect, so as to modify the sound effect.
本发明实施例的音频信号处理装置,能够根据扬声器或者受话器所播放出来的声音效果,然后自动调整音频处理模块内部的处理参数,可以使得各音源具有与其对应的最优的处理参数,这样就可以使得在播放任意音源时,扬声器或者受话器所播放出来声音的效果都处于最优状态。The audio signal processing device of the embodiment of the present invention can automatically adjust the processing parameters inside the audio processing module according to the sound effect played by the speaker or the receiver, so that each sound source has the optimal processing parameters corresponding to it, so that it can So that when playing any audio source, the effect of the sound played by the speaker or the receiver is in the best state.
另外,本发明实施例的音频信号处理装置,还具有如下附加的技术特征:In addition, the audio signal processing device in the embodiment of the present invention also has the following additional technical features:
在本发明的一个实施例中,所述分析模块,包括:In one embodiment of the present invention, the analysis module includes:
变换单元,用于对所述音频信号进行快速傅里叶变换,得到所述音频信号的语谱图;A transform unit, configured to perform fast Fourier transform on the audio signal to obtain a spectrogram of the audio signal;
提取单元,用于从所述语谱图中提取所述音频信号的高频成分和低频成分;an extraction unit, configured to extract high-frequency components and low-frequency components of the audio signal from the spectrogram;
第一确定单元,用于如果所述高频成分与所述低频成分失衡,则确定所述声音效果为声音的高低频失衡。The first determining unit is configured to determine that the sound effect is a high-low frequency imbalance of sound if the high-frequency component is out of balance with the low-frequency component.
在本发明的一个实施例中,所述参数调整模块,具体用于调整所述音频信号处理模块中数字滤波器的滤波器参数,以使后续播放的所述音频信号中所携带的所述高频成分和所述低频成分处于均衡状态。In an embodiment of the present invention, the parameter adjustment module is specifically configured to adjust the filter parameters of the digital filter in the audio signal processing module, so that the high The frequency components and the low frequency components are in a balanced state.
在本发明的一个实施例中,所述分析模块,包括:In one embodiment of the present invention, the analysis module includes:
振幅获取单元,用于获取所述音频信号的振幅;an amplitude acquisition unit, configured to acquire the amplitude of the audio signal;
比较单元,用于将所述振幅与预设的阈值范围进行比较;a comparison unit, configured to compare the amplitude with a preset threshold range;
第二确定单元,用于如果所述振幅未处于所述阈值范围内,则确定所述声音效果为声音的音量异常。The second determining unit is configured to determine that the sound effect is an abnormal sound volume if the amplitude is not within the threshold range.
在本发明的一个实施例中,所述参数调整模块,具体用于调整所述音频信号处理模块中放大器的增益,以使后续播放的所述音频信号的振幅处于所述阈值范围内。In an embodiment of the present invention, the parameter adjustment module is specifically configured to adjust the gain of the amplifier in the audio signal processing module, so that the amplitude of the audio signal played subsequently is within the threshold range.
在本发明的一个实施例中,所述装置还包括:In one embodiment of the invention, the device also includes:
处理模块,用于基于调整后的所述音频信号处理模块对音源所发出的音频信号进行处理;A processing module, configured to process the audio signal sent by the sound source based on the adjusted audio signal processing module;
播放模块,用于将处理后的所述音频信号通过所述声音播放装置播放。The playing module is used to play the processed audio signal through the sound playing device.
在本发明的一个实施例中,所述采集模块,具体用于通过所述终端上的麦克风对所述声音播放装置所播放的音频信号进行采集。In an embodiment of the present invention, the collection module is specifically configured to collect the audio signal played by the sound playback device through the microphone on the terminal.
为达上述目的,本发明第三方面实施例提出了另一种终端,包括:To achieve the above purpose, the embodiment of the third aspect of the present invention proposes another terminal, including:
壳体和位于所述壳体内的处理器、存储器、麦克风和声音播放装置,其中,所述处理器通过读取所述存储器中存储的可执行程序代码来运行与所述可执行程序代码对应的程序,以用于执行以下步骤:A housing and a processor, a memory, a microphone, and a sound playback device located in the housing, wherein the processor executes the program corresponding to the executable program code by reading the executable program code stored in the memory program to perform the following steps:
采集声音播放装置所播放的音频信号;Collecting the audio signal played by the sound playback device;
根据所述音频信号分析所述声音播放装置的声音效果;analyzing the sound effect of the sound playing device according to the audio signal;
根据所述声音效果调整终端中的音频信号处理模块的处理参数,以对所述声音效果进行修正。Adjust the processing parameters of the audio signal processing module in the terminal according to the sound effect, so as to modify the sound effect.
本发明实施例的终端,能够根据扬声器或者受话器所播放出来的声音效果,然后自动调整音频处理模块内部的处理参数,可以使得各音源具有与其对应的最优的处理参数,这样就可以使得在播放任意音源时,扬声器或者受话器所播放出来声音的效果都处于最优状态。The terminal of the embodiment of the present invention can automatically adjust the processing parameters inside the audio processing module according to the sound effect played by the speaker or the receiver, so that each sound source has the optimal processing parameters corresponding to it, so that it can be played during playback. When using any sound source, the effect of the sound played by the speaker or the receiver is in the best state.
本发明附加的方面和优点将在下面的描述中部分给出,部分将从下面的描述中变得明显,或通过本发明的实践了解到。Additional aspects and advantages of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention.
附图说明Description of drawings
本发明上述的和/或附加的方面和优点从下面结合附图对实施例的描述中将变得明显和容易理解,其中:The above and/or additional aspects and advantages of the present invention will become apparent and easy to understand from the following description of the embodiments in conjunction with the accompanying drawings, wherein:
图1为本发明实施例提供的一种音频信号处理方法的流程示意图;FIG. 1 is a schematic flowchart of an audio signal processing method provided by an embodiment of the present invention;
图2为本发明实施例提供的另一种音频信号处理方法的流程示意图;FIG. 2 is a schematic flowchart of another audio signal processing method provided by an embodiment of the present invention;
图3为本发明实施例提供的另一种音频信号处理方法的流程示意图;FIG. 3 is a schematic flowchart of another audio signal processing method provided by an embodiment of the present invention;
图4为本发明实施例提供的一种音频信号处理方法的应用示意图;Fig. 4 is an application schematic diagram of an audio signal processing method provided by an embodiment of the present invention;
图5为本发明实施例提供的一种音频信号处理装置的结构示意图;FIG. 5 is a schematic structural diagram of an audio signal processing device provided by an embodiment of the present invention;
图6为本发明实施例提供的另一种音频信号处理装置的结构示意图;FIG. 6 is a schematic structural diagram of another audio signal processing device provided by an embodiment of the present invention;
图7为本发明实施例提供的另一种音频信号处理装置的结构示意图;FIG. 7 is a schematic structural diagram of another audio signal processing device provided by an embodiment of the present invention;
图8为本发明实施例提供的另一种音频信号处理装置的结构示意图;FIG. 8 is a schematic structural diagram of another audio signal processing device provided by an embodiment of the present invention;
图9为本发明实施例提供的一种终端的结构示意图。FIG. 9 is a schematic structural diagram of a terminal provided by an embodiment of the present invention.
具体实施方式detailed description
下面详细描述本发明的实施例,所述实施例的示例在附图中示出,其中自始至终相同或类似的标号表示相同或类似的元件或具有相同或类似功能的元件。下面通过参考附图描述的实施例是示例性的,旨在用于解释本发明,而不能理解为对本发明的限制。Embodiments of the present invention are described in detail below, examples of which are shown in the drawings, wherein the same or similar reference numerals designate the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the figures are exemplary and are intended to explain the present invention and should not be construed as limiting the present invention.
下面参考附图描述本发明实施例的音频信号处理方法、装置及终端。The audio signal processing method, device and terminal according to the embodiments of the present invention are described below with reference to the accompanying drawings.
图1为本发明实施例提供的一种音频信号处理方法的流程示意图。本发明实施例的音频信号处理方法,可应用于各种装置或终端设备,如平板电脑、笔记本电脑、个人电脑、智能手机等。如图1所示,该音频信号处理方法包括以下步骤:FIG. 1 is a schematic flowchart of an audio signal processing method provided by an embodiment of the present invention. The audio signal processing method of the embodiment of the present invention can be applied to various devices or terminal devices, such as tablet computers, notebook computers, personal computers, smart phones, and the like. As shown in Figure 1, the audio signal processing method comprises the following steps:
S101、采集声音播放装置所播放的音频信号。S101. Collect an audio signal played by a sound playing device.
用户可以基于终端进行语音通话、视频聊天或者音视频文件的播放。当终端获取到音源后,可以获取音源所发出的音频信号,经过终端中的音频信号处理模块,对音源发出的音频信号进行处理后,就可以通过受话器或者扬声器等声音播放装置播放出去。本实施例中,可以对声音播放装置所播放的音频信号进行采集,例如可以通过麦克风采集声音播放装置所播放的音频信号。Users can make voice calls, video chats, or play audio and video files based on the terminal. After the terminal acquires the audio source, it can acquire the audio signal from the audio source, and after the audio signal processing module in the terminal processes the audio signal from the audio source, it can be played through a receiver or a speaker or other audio playback device. In this embodiment, the audio signal played by the sound playing device may be collected, for example, the audio signal played by the sound playing device may be collected through a microphone.
S102、根据音频信号分析声音播放装置的声音效果。S102. Analyze the sound effect of the sound playing device according to the audio signal.
在采集到声音播放装置所播放的音频信号后,可以音频信号进行分析,例如,可以对音频信号的频率和/或者振幅等特征进行提取,根据提取的频率和/或者振幅等特征,确定声音播放装置的声音效果。声音效果可以包括所播放出的声音高低频处于失衡状态,例如,所播放出的声音效果为刺耳的啸声,或者所播放出的声音效果为沉闷的声音,使得用户无法听清声音携带的信息,或者所播放出来的声音的音量异常例如声音较小或者过大。After collecting the audio signal played by the sound playback device, the audio signal can be analyzed, for example, the frequency and/or amplitude and other features of the audio signal can be extracted, and the sound playback can be determined according to the extracted frequency and/or amplitude and other features. Device sound effects. The sound effect may include that the high and low frequencies of the played sound are in an unbalanced state, for example, the played sound effect is a piercing howling sound, or the played sound effect is a dull sound, so that the user cannot hear the information carried by the sound clearly , or the volume of the played sound is abnormal, for example, the sound is too low or too loud.
S103、根据声音效果调整终端中的音频信号处理模块的处理参数,以对声音效果进行修正。S103. Adjust the processing parameters of the audio signal processing module in the terminal according to the sound effect, so as to correct the sound effect.
在获取到声音效果后,可以根据声音效果来动态调整终端中的音频信号处理模块的处理参数,然后利用调整后的处理参数对声音效果进行修正。其中,音频信号处理模块的处理参数在初始时刻为基于标准信号源进行调试后,所播放出的理想声音效果时所对应的处理参数。After the sound effect is obtained, the processing parameters of the audio signal processing module in the terminal can be dynamically adjusted according to the sound effect, and then the sound effect can be corrected by using the adjusted processing parameters. Wherein, the processing parameters of the audio signal processing module are the processing parameters corresponding to the ideal sound effect after being debugged based on the standard signal source at the initial moment.
例如,声音效果为高低频失衡的情况下,如果高频成分较多时,可以降低音频信号处理模块中数字滤波器的截止频率,降低该数字滤波器的带宽,抑制音频信号中的高频成分,即对当前所播放出的高低频失衡状的声音效果进行修正,使后续播放的声音效果为高低频处于均衡状态。For example, when the sound effect is unbalanced between high and low frequencies, if there are many high-frequency components, the cut-off frequency of the digital filter in the audio signal processing module can be reduced, the bandwidth of the digital filter can be reduced, and the high-frequency components in the audio signal can be suppressed. That is to correct the currently played sound effect with unbalanced high and low frequencies, so that the sound effect played later will be in a state of balanced high and low frequencies.
再例如,声音效果为音量异常的情况下,如果音量较大,则可以降低音频信号处理模块中的增益,使经过音频信号处理模块输出的音频信号的信号降低较低,以达到抑制音量的目的,即对当前所播放出的音量异常的声音效果进行修正,使得后续播放的声音效果的音量处于正常范围内。For another example, when the sound effect is an abnormal volume, if the volume is high, the gain in the audio signal processing module can be reduced, so that the signal of the audio signal output by the audio signal processing module can be lowered to achieve the purpose of suppressing the volume , that is, modify the currently played sound effect with an abnormal volume, so that the volume of the sound effect to be played later is within the normal range.
本发明实施例提供的音频信号处理方法,通过采集声音播放装置所播放的音频信号,根据音频信号分析声音播放装置的声音效果,根据声音效果调整终端中的音频信号处理模块的处理参数,以对声音效果进行修正。本实施例中,能够根据扬声器或者受话器所播放出来的声音效果,然后自动调整音频处理模块内部的处理参数,可以使得各音源具有与其对应的最优的处理参数,这样就可以使得在播放任意音源时,扬声器或者受话器所播放出来声音的效果都处于最优状态。The audio signal processing method provided by the embodiment of the present invention collects the audio signal played by the sound playback device, analyzes the sound effect of the sound playback device according to the audio signal, and adjusts the processing parameters of the audio signal processing module in the terminal according to the sound effect, so as to Sound effects were corrected. In this embodiment, the processing parameters inside the audio processing module can be automatically adjusted according to the sound effect played by the speaker or the receiver, so that each sound source has the optimal processing parameters corresponding to it, so that any sound source can be played When , the effect of the sound played by the speaker or the receiver is in the best state.
图2为本发明实施例提供的另一种音频信号处理方法的流程示意图。如图2所示,该音频信号处理方法包括以下步骤:Fig. 2 is a schematic flowchart of another audio signal processing method provided by an embodiment of the present invention. As shown in Figure 2, the audio signal processing method comprises the following steps:
S201、采集声音播放装置所播放的音频信号。S201. Collect an audio signal played by a sound playing device.
具体地,可以通过终端上的麦克风或者拾音装置,来采集受话器或者扬声器等声音播放装置所播放的音频信号。Specifically, an audio signal played by a sound playback device such as a receiver or a speaker may be collected through a microphone or a sound pickup device on the terminal.
S202、对音频信号进行快速傅里叶变换,得到音频信号的语谱图。S202. Perform fast Fourier transform on the audio signal to obtain a spectrogram of the audio signal.
在采集到受话器或者扬声器所播放的音频信号后,可以对音频信号进行特征分析,从音频信号中提取出音频信号的频率特征,可以获取到音频信号中所携带的高频成分和低频成分。具体地,可以采用快速傅里叶变换(Fast Fourier Transform,简称FFT)对采集到的音频信号进行频谱分析,从而得到音频信号的语谱图。其中,语谱图的横坐标为音频信号所对应的时间,语谱图的纵坐标为音频信号所含的频率分量,语谱图的坐标点值为音频信号的能量值。After the audio signal played by the receiver or speaker is collected, the audio signal can be characterized, and the frequency characteristics of the audio signal can be extracted from the audio signal, and the high-frequency and low-frequency components carried in the audio signal can be obtained. Specifically, a fast Fourier transform (Fast Fourier Transform, FFT for short) may be used to perform spectrum analysis on the collected audio signal, so as to obtain a spectrogram of the audio signal. Wherein, the abscissa of the spectrogram is the time corresponding to the audio signal, the ordinate of the spectrogram is the frequency component contained in the audio signal, and the coordinate point value of the spectrogram is the energy value of the audio signal.
S203、从语谱图中提取音频信号的高频成分和低频成分。S203. Extract high-frequency components and low-frequency components of the audio signal from the spectrogram.
具体地,可以从语谱图中提取出音频信号所携带的高频成分和低频成分。一般情况下,高频频段为800hz以上的频段,低频频段的频率范围为20hz-800hz。在获取到音频信号的语谱图之后,可以统计出超过800hz每个频点上的能量,获取到音频信号所携带的高频成分,进一步地,可以统计出20hz~800hz每个频点上的能量,获取到音频信号所携带的低频成分。Specifically, the high-frequency components and low-frequency components carried by the audio signal can be extracted from the spectrogram. Generally, the high-frequency band is the frequency band above 800hz, and the frequency range of the low-frequency band is 20hz-800hz. After obtaining the spectrogram of the audio signal, the energy at each frequency point exceeding 800hz can be counted, and the high-frequency components carried by the audio signal can be obtained. Further, the energy at each frequency point from 20hz to 800hz can be counted Energy, to obtain the low-frequency components carried by the audio signal.
S204、如果高频成分与低频成分失衡,则确定声音效果为声音的高低频失衡。S204. If the high-frequency component and the low-frequency component are unbalanced, determine that the sound effect is a high-low frequency unbalance of sound.
实际应用中,为了保证所播放的声音的质量或者效果,往往会将音频信号中高频成分和低频成分之间的比值为预设为1:1。当高频成分之间的比值为1:1时,说明音频信号中所携带的高低频成分处于均衡状态,播放出来的声音效果最佳。如果高频成分与低频成分之间的比值不为1:1,说明采集到的所播放的音频信号处于高低频失衡。例如,当高频成分较多时,所播放出的声音效果则为刺耳的声音,而当低频成分较多时,所播放出的声学效果则为沉闷的声音,用户可能无法从声音中获取到实际的信息。In practical applications, in order to ensure the quality or effect of the played sound, the ratio between the high-frequency component and the low-frequency component in the audio signal is often preset as 1:1. When the ratio between the high-frequency components is 1:1, it means that the high- and low-frequency components carried in the audio signal are in a balanced state, and the sound effect played is the best. If the ratio between the high-frequency component and the low-frequency component is not 1:1, it means that the collected and played audio signal is out of balance between high and low frequencies. For example, when there are many high-frequency components, the sound effect played is harsh, and when there are many low-frequency components, the acoustic effect played is dull sound, and the user may not be able to obtain the actual effect from the sound. information.
S205、调整音频信号处理模块中数字滤波器的滤波器参数,以使后续播放的音频信号中所携带的高频成分和低频成分处于均衡状态。S205. Adjust the filter parameters of the digital filter in the audio signal processing module, so that the high-frequency components and low-frequency components carried in the subsequent audio signal are in a balanced state.
当音频信号所携带的高低频成分失衡时,需要对音频信号处理模块中数字滤波器的滤波器参数进行调整,例如数字滤波器的截止频率、带宽等。当音频信号中所携带的高频成分较多时,可以调整数字滤波器以通过数字滤波器来衰减高频成分。而当音频信号中所携带的高频成分较少时,可以调整数字滤波器以通过数字滤波器来提升高频成分。经过调整后可以后续通过受话器或者扬声器播放的音频信号中所携带的高低频成分处于均衡状态。When the high and low frequency components carried by the audio signal are out of balance, it is necessary to adjust the filter parameters of the digital filter in the audio signal processing module, such as the cutoff frequency and bandwidth of the digital filter. When the audio signal carries many high-frequency components, the digital filter can be adjusted to attenuate the high-frequency components through the digital filter. When the audio signal carries less high-frequency components, the digital filter can be adjusted to enhance the high-frequency components through the digital filter. After adjustment, the high and low frequency components carried in the audio signal played through the receiver or the loudspeaker can be in a balanced state.
S206、基于调整后的音频信号处理模块对音源所发出的音频信号进行处理。S206. Process the audio signal from the sound source based on the adjusted audio signal processing module.
音源不断地向外发出音频信号,所发出的音频信号需要不断地进入音频信号处理模块中进行处理后才能输入到受话器或者扬声器中进行播放。音频信号进入音频信号处理模块后,该音频信号处理模块可以基于调整后的处理参数,对后续进入的音频信号进行处理。一般情况下,对于同一个音源所发出的音频信号的特征是稳定的,基于调整后的音频信号处理模块对音源后续所发出的音频信号进行处理时,处理后的音频信号基本可以克服高低频失衡的问题,使得播放出来的声音效果较佳。The audio source continuously sends out audio signals, and the sent audio signals need to be continuously processed in the audio signal processing module before being input to the receiver or the speaker for playback. After the audio signal enters the audio signal processing module, the audio signal processing module can process the subsequent incoming audio signal based on the adjusted processing parameters. Under normal circumstances, the characteristics of the audio signal emitted by the same audio source are stable. When the audio signal emitted by the audio source is processed based on the adjusted audio signal processing module, the processed audio signal can basically overcome the high and low frequency imbalance. The problem of making the sound effect of playback is better.
S207、将处理后的音频信号通过声音播放装置播放。S207. Play the processed audio signal through the sound playing device.
本实施例中,当音频信号处理模块对音源发出的音频信号进行处理后,就可以将处理后的音频信号通过受话器或者扬声器进行播放。In this embodiment, after the audio signal processing module processes the audio signal from the sound source, the processed audio signal can be played through the receiver or the speaker.
本实施例中,采集扬声器或者受话器等声音播放装置所播放出来的音频信号,然后分析音频信号的频率特征,当音频信号所携带的高低频成分不均衡时,会导致所播放出的声音高低频失衡,所播放的声音效果较差,为了使得高低频成分均衡,调整音频信号处理模块中的数字滤波器的滤波参数,可以基于调整后的处理参数对后续音源发出的音频信号进行处理,以保证处理后的音频信号被扬声器或者受话器播放时声音效果较佳,从而可以克服之前所播放的声音效果存在高低频失衡的问题。In this embodiment, the audio signal played by a sound playback device such as a loudspeaker or a receiver is collected, and then the frequency characteristics of the audio signal are analyzed. When the high and low frequency components carried by the audio signal are unbalanced, the played sound will be high and low frequency. Unbalanced, the sound effect played is poor. In order to balance the high and low frequency components, adjust the filter parameters of the digital filter in the audio signal processing module, and process the audio signal from the subsequent audio source based on the adjusted processing parameters to ensure When the processed audio signal is played by the loudspeaker or the receiver, the sound effect is better, so that the problem of high and low frequency imbalance in the previously played sound effect can be overcome.
图3为本发明实施例提供的另一种音频信号处理方法的流程示意图。如图3所示,该音频信号处理方法包括:Fig. 3 is a schematic flowchart of another audio signal processing method provided by an embodiment of the present invention. As shown in Figure 3, the audio signal processing method includes:
S301、采集声音播放装置所播放的音频信号。S301. Collect an audio signal played by a sound playing device.
S302、获取音频信号的振幅。S302. Acquire the amplitude of the audio signal.
具体地,从音频信号中提起出音频信号的信号强度,即音频信号的振幅。Specifically, the signal strength of the audio signal, that is, the amplitude of the audio signal, is extracted from the audio signal.
S303、将振幅与预设的阈值范围进行比较。S303. Compare the amplitude with a preset threshold range.
S304、如果振幅未处于阈值范围内,则确定声音效果为声音的音量异常。S304. If the amplitude is not within the threshold range, determine that the sound effect is abnormal sound volume.
本实施例中,可以预先设置有阈值范围,该阈值范围可以包括上限阈值和下限阈值。在获取到音频信号的振幅后,可以将该音频信号的振幅与阈值范围比较,如果振幅超出阈值范围,即振幅大于上限阈值或者振幅小于下限阈值,说明播放的声音存在音量异常的问题。In this embodiment, a threshold range may be preset, and the threshold range may include an upper threshold and a lower threshold. After the amplitude of the audio signal is obtained, the amplitude of the audio signal can be compared with the threshold range. If the amplitude exceeds the threshold range, that is, the amplitude is greater than the upper threshold or the amplitude is smaller than the lower threshold, it means that there is an abnormal volume of the played sound.
S305、调整音频信号处理模块中放大器的增益,以使后续播放的音频信号的振幅处于阈值范围内。S305. Adjust the gain of the amplifier in the audio signal processing module, so that the amplitude of the audio signal to be played subsequently is within the threshold range.
具体地,可以根据音量异常的具体情况来调整音频信号处理模块中放大器的增益。如果音量异常为声音较小,则提高音频信号处理模块中放大器的增益,使后续播放的音频信号的声音变大,使音频信号的振幅超过下限阈值,落入阈值范围内。而如果音量异常为声音较大,则降低音频信号处理模块中放大器的增益,使后续播放的音频信号的声音变小,使音频信号的振幅低于上限阈值,落入阈值范围内。Specifically, the gain of the amplifier in the audio signal processing module can be adjusted according to the specific situation of the abnormal volume. If the volume is abnormally small, then increase the gain of the amplifier in the audio signal processing module to make the sound of the audio signal played subsequently louder, so that the amplitude of the audio signal exceeds the lower threshold and falls within the threshold range. And if the volume is abnormally loud, then reduce the gain of the amplifier in the audio signal processing module to make the sound of the audio signal played subsequently smaller, so that the amplitude of the audio signal is lower than the upper threshold and falls within the threshold range.
S306、基于调整后的音频信号处理模块对音源所发出的音频信号进行处理。S306. Process the audio signal from the sound source based on the adjusted audio signal processing module.
S307、将处理后的音频信号通过声音播放装置播放。S307. Play the processed audio signal through the sound playing device.
关于S306~S307的相关介绍,可参见上述实施例中相关内容的记载,此处不再赘述。For related introductions of S306-S307, reference may be made to the records of relevant content in the foregoing embodiments, and details are not repeated here.
本实施例中,采集扬声器或者受话器等声音播放装置所播放出来的音频信号,提取音频信号的振幅,当音频信号的振幅未处于预设的阈值范围内时,会导致所播放出的声音音量异常,所播放的声音效果较差,在音量异常时,可以调整音频信号处理模块中的放大器的增益,基于调整后的处理参数对后续音源发出的音频信号进行处理,以保证处理后的音频信号被扬声器或者受话器播放时声音效果较佳,从而可以克服之前所播放的声音效果存在高低频失衡的问题。In this embodiment, the audio signal played by a sound playback device such as a speaker or a receiver is collected, and the amplitude of the audio signal is extracted. When the amplitude of the audio signal is not within the preset threshold range, the volume of the played sound will be abnormal. , the sound effect played is poor. When the volume is abnormal, you can adjust the gain of the amplifier in the audio signal processing module, and process the audio signal from the subsequent audio source based on the adjusted processing parameters to ensure that the processed audio signal is The sound effect is better when the speaker or the receiver is played, so that the problem of high and low frequency imbalance in the previously played sound effect can be overcome.
实际应用中,可以根据所采集的音频信号的频率和/或振幅,来确定所播放的声音效果。例如,当根据音频信号的频率和振幅中一个判断出声音效果较差时,就可以对音频信号处理模块的处理参数。在分析声音效果时,可能音频信号的频率和振幅均导致声音效果较差,可以对音频信号处理模块的数字滤波器和放大器同时进行调整。本发明提供的实施例中并不对此进行限制。In practical applications, the played sound effect can be determined according to the frequency and/or amplitude of the collected audio signal. For example, when it is judged that the sound effect is poor according to one of the frequency and the amplitude of the audio signal, the processing parameters of the audio signal processing module can be adjusted. When analyzing sound effects, both the frequency and amplitude of the audio signal may lead to poor sound effects, and the digital filter and amplifier of the audio signal processing module can be adjusted at the same time. This is not limited in the embodiments provided by the present invention.
图4为本发明实施例提供的一种音频信号处理方法的应用示意图。如图4所示,音源发出音频信号,音频信号经过解码后可以进入终端上的音频信号处理模块,该音频信号处理模块可以为语音信号处理模块,也可以为音乐信号处理模块,可以根据音源的不同具体选择。FIG. 4 is a schematic diagram of an application of an audio signal processing method provided by an embodiment of the present invention. As shown in Figure 4, the sound source sends out an audio signal, and the audio signal can enter the audio signal processing module on the terminal after being decoded. The audio signal processing module can be a speech signal processing module or a music signal processing module. different specific options.
其中,音频处理模块中用于处理数字的音频信号的单元可以集成在数字信号处理(Digital Signal Processing,简称DSP)芯片中。例如音频信号处理模块中的卷积、数字滤波器、可编程增益放大器(Programmable Gain Amplifier,简称PGA)以及多段动态压缩器可以集成在DSP芯片。音源发出的音频信号经过解码后的数字音频信号,可以在音频信号处理模块中进行卷积、滤波以及多段动态压缩处理,然后由数/模转换器进行数模转换,再经过功率放大器(Power Amplifier,简称PA)输入到扬声器中播放。Wherein, the unit for processing digital audio signals in the audio processing module may be integrated in a digital signal processing (Digital Signal Processing, DSP for short) chip. For example, the convolution, digital filter, programmable gain amplifier (Programmable Gain Amplifier, PGA for short) and multi-segment dynamic compressor in the audio signal processing module can be integrated in the DSP chip. The decoded digital audio signal of the audio signal from the audio source can be processed in the audio signal processing module by convolution, filtering, and multi-segment dynamic compression, and then the digital-to-analog conversion is performed by the digital-to-analog converter, and then passed through the power amplifier (Power Amplifier). , referred to as PA) input to the speaker to play.
进一步地,设置在扬声器附近的麦克风可以对扬声器播放的声音进行采集,经过PGA放大、然后由模/数转换器进行模数转换后,进入DSP芯片。DSP芯片中可以设置有声音效果分析模块,D该声音效果分析模块可以对采集的音频信号进行声音效果的分析,然后根据声音效果调整音频信号处理模块的处理参数。Furthermore, the microphone arranged near the speaker can collect the sound played by the speaker, amplified by the PGA, and converted by the analog-to-digital converter before entering the DSP chip. A sound effect analysis module can be arranged in the DSP chip, and the sound effect analysis module can analyze the sound effect of the collected audio signal, and then adjust the processing parameters of the audio signal processing module according to the sound effect.
例如,声音效果分析模块中可以设置有FFT单元,通过FFT单元分析所采集的音频信号的高低频成分,进而调整音频信号处理模块中的数字滤波器的滤波器参数。For example, the sound effect analysis module may be provided with an FFT unit, which analyzes the high and low frequency components of the collected audio signal through the FFT unit, and then adjusts the filter parameters of the digital filter in the audio signal processing module.
再例如,声音效果分析模块中还可以设置有振幅比较单元,通过振幅比较单元分析所采集的音频信号的声音音量是否存在异常,进而调整音频信号处理模块中的放大器的增益。For another example, the sound effect analysis module may also be provided with an amplitude comparison unit, which analyzes whether the sound volume of the collected audio signal is abnormal, and then adjusts the gain of the amplifier in the audio signal processing module.
本实施例中,能够根据扬声器或者受话器所播放出来的声音效果,然后自动调整音频处理模块内部的处理参数,可以使得各音源具有与其对应的最优的处理参数,这样就可以使得在播放任意音源时,扬声器或者受话器所播放出来声音的效果都处于最优状态。In this embodiment, the processing parameters inside the audio processing module can be automatically adjusted according to the sound effect played by the speaker or the receiver, so that each sound source has the optimal processing parameters corresponding to it, so that any sound source can be played When , the effect of the sound played by the speaker or the receiver is in the best state.
图5为本发明实施例提供的一种音频信号处理装置的结构示意图。如图5所示,该音频信号处理装置包括:采集模块11、分析模块12和参数调整模块13。Fig. 5 is a schematic structural diagram of an audio signal processing device provided by an embodiment of the present invention. As shown in FIG. 5 , the audio signal processing device includes: an acquisition module 11 , an analysis module 12 and a parameter adjustment module 13 .
其中,采集模块11,用于采集声音播放装置所播放的音频信号。Wherein, the collecting module 11 is used for collecting the audio signal played by the sound playing device.
分析模块12,用于根据所述音频信号分析所述声音播放装置的声音效果。The analysis module 12 is configured to analyze the sound effect of the sound playback device according to the audio signal.
参数调整模块13,用于根据所述声音效果调整终端中的音频信号处理模块的处理参数,以对所述声音效果进行修正。The parameter adjustment module 13 is configured to adjust the processing parameters of the audio signal processing module in the terminal according to the sound effect, so as to modify the sound effect.
本实施例中,能够根据扬声器或者受话器所播放出来的声音效果,然后自动调整音频处理模块内部的处理参数,可以使得各音源具有与其对应的最优的处理参数,这样就可以使得在播放任意音源时,扬声器或者受话器所播放出来声音的效果都处于最优状态。In this embodiment, the processing parameters inside the audio processing module can be automatically adjusted according to the sound effect played by the speaker or the receiver, so that each sound source has the optimal processing parameters corresponding to it, so that any sound source can be played When , the effect of the sound played by the speaker or the receiver is in the best state.
图6为本发明实施例提供的另一种音频信号处理装置的结构示意图。如图6所示,该音频信号处理装置包括上述实施例中的采集模块11、分析模块12和参数调整模块13。FIG. 6 is a schematic structural diagram of another audio signal processing device provided by an embodiment of the present invention. As shown in FIG. 6 , the audio signal processing device includes the acquisition module 11 , the analysis module 12 and the parameter adjustment module 13 in the above-mentioned embodiments.
可选地,分析模块12的一种可能的结构方式包括:变换单元121、提取单元122和第一确定单元123。Optionally, a possible structure of the analysis module 12 includes: a transformation unit 121 , an extraction unit 122 and a first determination unit 123 .
变换单元121,用于对所述音频信号进行快速傅里叶变换,得到所述音频信号的语谱图。The transformation unit 121 is configured to perform fast Fourier transformation on the audio signal to obtain a spectrogram of the audio signal.
提取单元122,用于从所述语谱图中提取所述音频信号的高频成分和低频成分。The extraction unit 122 is configured to extract high frequency components and low frequency components of the audio signal from the spectrogram.
第一确定单元123,用于如果所述高频成分与所述低频成分失衡,则确定所述声音效果为声音的高低频失衡。The first determining unit 123 is configured to determine that the sound effect is an imbalance between high and low frequencies of the sound if the high frequency component is out of balance with the low frequency component.
进一步地,参数调整模块13,具体用于调整所述音频信号处理模块中数字滤波器的滤波器参数,以使后续播放的所述音频信号中所携带的所述高频成分和所述低频成分处于均衡状态。Further, the parameter adjustment module 13 is specifically configured to adjust the filter parameters of the digital filter in the audio signal processing module, so that the high-frequency components and the low-frequency components carried in the audio signal played subsequently in equilibrium.
本实施例中,采集扬声器或者受话器等声音播放装置所播放出来的音频信号,然后分析音频信号的频率特征,当音频信号所携带的高低频成分不均衡时,会导致所播放出的声音高低频失衡,所播放的声音效果较差,为了使得高低频成分均衡,调整音频信号处理模块中的数字滤波器的滤波参数,可以基于调整后的处理参数对后续音源发出的音频信号进行处理,以保证处理后的音频信号被扬声器或者受话器播放时声音效果较佳,从而可以克服之前所播放的声音效果存在高低频失衡的问题。In this embodiment, the audio signal played by a sound playback device such as a loudspeaker or a receiver is collected, and then the frequency characteristics of the audio signal are analyzed. When the high and low frequency components carried by the audio signal are unbalanced, the played sound will be high and low frequency. Unbalanced, the sound effect played is poor. In order to balance the high and low frequency components, adjust the filter parameters of the digital filter in the audio signal processing module, and process the audio signal from the subsequent audio source based on the adjusted processing parameters to ensure When the processed audio signal is played by the loudspeaker or the receiver, the sound effect is better, so that the problem of high and low frequency imbalance in the previously played sound effect can be overcome.
图7为本发明实施例提供的另一种音频信号处理装置的结构示意图。如图7所示,该音频信号处理装置包括上述实施例中采集模块11、分析模块12和参数调整模块13。Fig. 7 is a schematic structural diagram of another audio signal processing device provided by an embodiment of the present invention. As shown in FIG. 7 , the audio signal processing device includes an acquisition module 11 , an analysis module 12 and a parameter adjustment module 13 in the above embodiments.
可选地,分析模块12的一种可能的结构方式包括:振幅获取单元124、比较单元125和第二确定单元126。Optionally, a possible structure of the analysis module 12 includes: an amplitude acquisition unit 124 , a comparison unit 125 and a second determination unit 126 .
振幅获取单元124,用于获取所述音频信号的振幅。The amplitude acquiring unit 124 is configured to acquire the amplitude of the audio signal.
比较单元125,用于将所述振幅与预设的阈值范围进行比较。The comparison unit 125 is configured to compare the amplitude with a preset threshold range.
第二确定单元126,用于如果所述振幅未处于所述阈值范围内,则确定所述声音效果为声音的音量异常。The second determining unit 126 is configured to determine that the sound effect is an abnormal sound volume if the amplitude is not within the threshold range.
进一步地,参数调整模块13,具体用于调整所述音频信号处理模块中放大器的增益,以使后续播放的所述音频信号的振幅处于所述阈值范围内。Further, the parameter adjustment module 13 is specifically configured to adjust the gain of the amplifier in the audio signal processing module, so that the amplitude of the audio signal played subsequently is within the threshold range.
本实施例中,采集扬声器或者受话器等声音播放装置所播放出来的音频信号,提取音频信号的振幅,当音频信号的振幅未处于预设的阈值范围内时,会导致所播放出的声音音量异常,所播放的声音效果较差,在音量异常时,可以调整音频信号处理模块中的放大器的增益,基于调整后的处理参数对后续音源发出的音频信号进行处理,以保证处理后的音频信号被扬声器或者受话器播放时声音效果较佳,从而可以克服之前所播放的声音效果存在高低频失衡的问题。In this embodiment, the audio signal played by a sound playback device such as a speaker or a receiver is collected, and the amplitude of the audio signal is extracted. When the amplitude of the audio signal is not within the preset threshold range, the volume of the played sound will be abnormal. , the sound effect played is poor. When the volume is abnormal, you can adjust the gain of the amplifier in the audio signal processing module, and process the audio signal from the subsequent audio source based on the adjusted processing parameters to ensure that the processed audio signal is The sound effect is better when the speaker or the receiver is played, so that the problem of high and low frequency imbalance in the previously played sound effect can be overcome.
图8为本发明实施例提供另一种音频信号处理装置的结构示意图。如图6所示,该音频信号处理装置包括上述实施例中的采集模块11、分析模块12和参数调整模块13,还包括:处理模块14和播放模块15。FIG. 8 is a schematic structural diagram of another audio signal processing device according to an embodiment of the present invention. As shown in FIG. 6 , the audio signal processing device includes the acquisition module 11 , the analysis module 12 and the parameter adjustment module 13 in the above embodiments, and also includes: a processing module 14 and a playback module 15 .
实际应用中,可以根据所采集的音频信号的频率和/或振幅,来确定所播放的声音效果。本实施例中分析模块12可以包括:上述实施例中的变换单元121、提取单元122、第一确定单元123、振幅获取单元124、比较单元125和第二确定单元126。In practical applications, the played sound effect can be determined according to the frequency and/or amplitude of the collected audio signal. The analysis module 12 in this embodiment may include: the transformation unit 121 , the extraction unit 122 , the first determination unit 123 , the amplitude acquisition unit 124 , the comparison unit 125 and the second determination unit 126 in the above embodiments.
通过本实施例提供的分析模块12可以实现所采集的音频信号的频率和/或振幅,来确定所播放的声音效果的目的。具体过程可参见上述实施例中相关内容的记载,此处不再赘述。The frequency and/or amplitude of the collected audio signal can be realized through the analysis module 12 provided in this embodiment to determine the purpose of the played sound effect. For the specific process, reference may be made to the records of related content in the foregoing embodiments, and details are not repeated here.
处理模块14,用于基于调整后的所述音频信号处理模块对音源所发出的音频信号进行处理。The processing module 14 is configured to process the audio signal sent by the sound source based on the adjusted audio signal processing module.
播放模块15,用于将处理后的所述音频信号通过所述声音播放装置播放。The playing module 15 is configured to play the processed audio signal through the sound playing device.
进一步地,采集模块11,具体用于通过所述终端上的麦克风对所述声音播放装置所播放的音频信号进行采集。Further, the collection module 11 is specifically configured to collect the audio signal played by the sound playback device through the microphone on the terminal.
本实施例中,能够根据扬声器或者受话器所播放出来的声音效果,然后自动调整音频处理模块内部的处理参数,可以使得各音源具有与其对应的最优的处理参数,这样就可以使得在播放任意音源时,扬声器或者受话器所播放出来声音的效果都处于最优状态。In this embodiment, the processing parameters inside the audio processing module can be automatically adjusted according to the sound effect played by the speaker or the receiver, so that each sound source has the optimal processing parameters corresponding to it, so that any sound source can be played When , the effect of the sound played by the speaker or the receiver is in the best state.
图9为本发明实施例提供的一种终端设备的结构示意图。如图5所示,该终端设备包括以下一个或多个组件:壳体21和位于壳体21内包括处理器211、存储器212、麦克风213和扬声器214或者受话器215。FIG. 9 is a schematic structural diagram of a terminal device provided by an embodiment of the present invention. As shown in FIG. 5 , the terminal device includes one or more of the following components: a housing 21 and a processor 211 , a memory 212 , a microphone 213 , and a speaker 214 or receiver 215 located in the housing 21 .
其中,处理器211通过读取存储器212中存储的可执行程序代码来运行与可执行程序代码对应的程序,以用于执行以下步骤:Wherein, the processor 211 runs the program corresponding to the executable program code by reading the executable program code stored in the memory 212, so as to perform the following steps:
采集声音播放装置所播放的音频信号;其中,声音播放装置可以为扬声器214,也可以为受话器215。具体地,可以通过麦克风213来采集扬声器214或者受话器215所播放的音频信号。The audio signal played by the sound playing device is collected; wherein, the sound playing device may be a speaker 214 or a receiver 215 . Specifically, the audio signal played by the speaker 214 or the receiver 215 may be collected through the microphone 213 .
根据音频信号分析声音播放装置的声音效果。The sound effect of the sound playing device is analyzed according to the audio signal.
根据声音效果调整终端中的音频信号处理模块的处理参数,以对所述声音效果进行修正。Adjust the processing parameters of the audio signal processing module in the terminal according to the sound effect, so as to modify the sound effect.
本实施例中,能够根据扬声器或者受话器所播放出来的声音效果,然后自动调整音频处理模块内部的处理参数,可以使得各音源具有与其对应的最优的处理参数,这样就可以使得在播放任意音源时,扬声器或者受话器所播放出来声音的效果都处于最优状态。In this embodiment, the processing parameters inside the audio processing module can be automatically adjusted according to the sound effect played by the speaker or the receiver, so that each sound source has the optimal processing parameters corresponding to it, so that any sound source can be played When , the effect of the sound played by the speaker or the receiver is in the best state.
在本说明书的描述中,参考术语“一个实施例”、“一些实施例”、“示例”、“具体示例”、或“一些示例”等的描述意指结合该实施例或示例描述的具体特征、结构、材料或者特点包含于本发明的至少一个实施例或示例中。在本说明书中,对上述术语的示意性表述不必须针对的是相同的实施例或示例。而且,描述的具体特征、结构、材料或者特点可以在任一个或多个实施例或示例中以合适的方式结合。此外,在不相互矛盾的情况下,本领域的技术人员可以将本说明书中描述的不同实施例或示例以及不同实施例或示例的特征进行结合和组合。In the description of this specification, descriptions referring to the terms "one embodiment", "some embodiments", "example", "specific examples", or "some examples" mean that specific features described in connection with the embodiment or example , structure, material or characteristic is included in at least one embodiment or example of the present invention. In this specification, the schematic representations of the above terms are not necessarily directed to the same embodiment or example. Furthermore, the described specific features, structures, materials or characteristics may be combined in any suitable manner in any one or more embodiments or examples. In addition, those skilled in the art can combine and combine different embodiments or examples and features of different embodiments or examples described in this specification without conflicting with each other.
此外,术语“第一”、“第二”仅用于描述目的,而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括至少一个该特征。在本发明的描述中,“多个”的含义是至少两个,例如两个,三个等,除非另有明确具体的限定。In addition, the terms "first" and "second" are used for descriptive purposes only, and cannot be interpreted as indicating or implying relative importance or implicitly specifying the quantity of indicated technical features. Thus, the features defined as "first" and "second" may explicitly or implicitly include at least one of these features. In the description of the present invention, "plurality" means at least two, such as two, three, etc., unless otherwise specifically defined.
流程图中或在此以其他方式描述的任何过程或方法描述可以被理解为,表示包括一个或更多个用于实现定制逻辑功能或过程的步骤的可执行指令的代码的模块、片段或部分,并且本发明的优选实施方式的范围包括另外的实现,其中可以不按所示出或讨论的顺序,包括根据所涉及的功能按基本同时的方式或按相反的顺序,来执行功能,这应被本发明的实施例所属技术领域的技术人员所理解。Any process or method descriptions in flowcharts or otherwise described herein may be understood to represent a module, segment or portion of code comprising one or more executable instructions for implementing custom logical functions or steps of a process , and the scope of preferred embodiments of the invention includes alternative implementations in which functions may be performed out of the order shown or discussed, including substantially concurrently or in reverse order depending on the functions involved, which shall It is understood by those skilled in the art to which the embodiments of the present invention pertain.
在流程图中表示或在此以其他方式描述的逻辑和/或步骤,例如,可以被认为是用于实现逻辑功能的可执行指令的定序列表,可以具体实现在任何计算机可读介质中,以供指令执行系统、装置或设备(如基于计算机的系统、包括处理器的系统或其他可以从指令执行系统、装置或设备取指令并执行指令的系统)使用,或结合这些指令执行系统、装置或设备而使用。就本说明书而言,"计算机可读介质"可以是任何可以包含、存储、通信、传播或传输程序以供指令执行系统、装置或设备或结合这些指令执行系统、装置或设备而使用的装置。计算机可读介质的更具体的示例(非穷尽性列表)包括以下:具有一个或多个布线的电连接部(电子装置),便携式计算机盘盒(磁装置),随机存取存储器(RAM),只读存储器(ROM),可擦除可编辑只读存储器(EPROM或闪速存储器),光纤装置,以及便携式光盘只读存储器(CDROM)。另外,计算机可读介质甚至可以是可在其上打印所述程序的纸或其他合适的介质,因为可以例如通过对纸或其他介质进行光学扫描,接着进行编辑、解译或必要时以其他合适方式进行处理来以电子方式获得所述程序,然后将其存储在计算机存储器中。The logic and/or steps represented in the flowcharts or otherwise described herein, for example, can be considered as a sequenced listing of executable instructions for implementing logical functions, can be embodied in any computer-readable medium, For use with instruction execution systems, devices, or devices (such as computer-based systems, systems including processors, or other systems that can fetch instructions from instruction execution systems, devices, or devices and execute instructions), or in conjunction with these instruction execution systems, devices or equipment used. For the purposes of this specification, a "computer-readable medium" may be any device that can contain, store, communicate, propagate or transmit a program for use in or in conjunction with an instruction execution system, device or device. More specific examples (non-exhaustive list) of computer-readable media include the following: electrical connection with one or more wires (electronic device), portable computer disk case (magnetic device), random access memory (RAM), Read Only Memory (ROM), Erasable and Editable Read Only Memory (EPROM or Flash Memory), Fiber Optic Devices, and Portable Compact Disc Read Only Memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program can be printed, since the program can be read, for example, by optically scanning the paper or other medium, followed by editing, interpretation or other suitable processing if necessary. The program is processed electronically and stored in computer memory.
应当理解,本发明的各部分可以用硬件、软件、固件或它们的组合来实现。在上述实施方式中,多个步骤或方法可以用存储在存储器中且由合适的指令执行系统执行的软件或固件来实现。如,如果用硬件来实现和在另一实施方式中一样,可用本领域公知的下列技术中的任一项或他们的组合来实现:具有用于对数据信号实现逻辑功能的逻辑门电路的离散逻辑电路,具有合适的组合逻辑门电路的专用集成电路,可编程门阵列(PGA),现场可编程门阵列(FPGA)等。It should be understood that various parts of the present invention can be realized by hardware, software, firmware or their combination. In the embodiments described above, various steps or methods may be implemented by software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware as in another embodiment, it can be implemented by any one or a combination of the following techniques known in the art: a discrete Logic circuits, ASICs with suitable combinational logic gates, Programmable Gate Arrays (PGA), Field Programmable Gate Arrays (FPGA), etc.
本技术领域的普通技术人员可以理解实现上述实施例方法携带的全部或部分步骤是可以通过程序来指令相关的硬件完成,所述的程序可以存储于一种计算机可读存储介质中,该程序在执行时,包括方法实施例的步骤之一或其组合。Those of ordinary skill in the art can understand that all or part of the steps carried by the methods of the above embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium. During execution, one or a combination of the steps of the method embodiments is included.
此外,在本发明各个实施例中的各功能单元可以集成在一个处理模块中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个模块中。上述集成的模块既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。所述集成的模块如果以软件功能模块的形式实现并作为独立的产品销售或使用时,也可以存储在一个计算机可读取存储介质中。In addition, each functional unit in each embodiment of the present invention may be integrated into one processing module, each unit may exist separately physically, or two or more units may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware or in the form of software function modules. If the integrated modules are realized in the form of software function modules and sold or used as independent products, they can also be stored in a computer-readable storage medium.
上述提到的存储介质可以是只读存储器,磁盘或光盘等。尽管上面已经示出和描述了本发明的实施例,可以理解的是,上述实施例是示例性的,不能理解为对本发明的限制,本领域的普通技术人员在本发明的范围内可以对上述实施例进行变化、修改、替换和变型。The storage medium mentioned above may be a read-only memory, a magnetic disk or an optical disk, and the like. Although the embodiments of the present invention have been shown and described above, it can be understood that the above embodiments are exemplary and should not be construed as limiting the present invention, and those skilled in the art can make the above-mentioned The embodiments are subject to changes, modifications, substitutions and variations.
Claims (15)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710124912.3A CN106878866B (en) | 2017-03-03 | 2017-03-03 | Audio signal processing method and device and terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710124912.3A CN106878866B (en) | 2017-03-03 | 2017-03-03 | Audio signal processing method and device and terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106878866A true CN106878866A (en) | 2017-06-20 |
| CN106878866B CN106878866B (en) | 2020-01-10 |
Family
ID=59169691
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710124912.3A Expired - Fee Related CN106878866B (en) | 2017-03-03 | 2017-03-03 | Audio signal processing method and device and terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106878866B (en) |
Cited By (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107197101A (en) * | 2017-06-23 | 2017-09-22 | 努比亚技术有限公司 | Audio regulation method, mobile terminal and computer-readable recording medium |
| CN107465824A (en) * | 2017-08-18 | 2017-12-12 | 广东欧珀移动通信有限公司 | volume adjusting method, device, mobile terminal and storage medium |
| CN107479852A (en) * | 2017-08-18 | 2017-12-15 | 广东欧珀移动通信有限公司 | Volume adjustment method, device, terminal equipment and storage medium |
| CN107479851A (en) * | 2017-08-18 | 2017-12-15 | 广东欧珀移动通信有限公司 | Volume adjustment method, device, terminal equipment and storage medium |
| CN107979702A (en) * | 2017-11-30 | 2018-05-01 | 北京小米移动软件有限公司 | Acoustic signal processing method, device, terminal and storage medium |
| CN107995559A (en) * | 2017-12-26 | 2018-05-04 | 上海展扬通信技术有限公司 | The terminal and method of a kind of audio frequency control |
| CN108510999A (en) * | 2018-02-09 | 2018-09-07 | 杭州默安科技有限公司 | The zero permission terminal device recognition methods based on audio-frequency fingerprint |
| CN108834028A (en) * | 2017-07-14 | 2018-11-16 | 博频(上海)科技股份有限公司 | Audio playing system |
| CN109561222A (en) * | 2017-09-27 | 2019-04-02 | 华为终端(东莞)有限公司 | A kind of method for detecting abnormality and device of voice data |
| CN109831710A (en) * | 2019-02-19 | 2019-05-31 | 泽丰音频技术(深圳)有限公司 | Microphone and sound integrated equipment and adjusting method and system |
| CN110349594A (en) * | 2019-07-18 | 2019-10-18 | Oppo广东移动通信有限公司 | Audio processing method and device, mobile terminal and computer readable storage medium |
| CN111049972A (en) * | 2019-11-20 | 2020-04-21 | 维沃移动通信有限公司 | Audio playing method and terminal equipment |
| WO2020103527A1 (en) * | 2018-11-23 | 2020-05-28 | 北京达佳互联信息技术有限公司 | Loudness adjustment method and apparatus, and electronic device and storage medium |
| CN112130495A (en) * | 2020-09-22 | 2020-12-25 | 湖北大学 | Digital configurable acoustic signal filtering device and filtering method |
| CN113412630A (en) * | 2019-02-14 | 2021-09-17 | Jvc建伍株式会社 | Processing device, processing method, reproduction method, and program |
| CN113643719A (en) * | 2021-08-26 | 2021-11-12 | Oppo广东移动通信有限公司 | Audio signal processing method, device, storage medium and terminal device |
| CN113784157A (en) * | 2021-08-31 | 2021-12-10 | 江西创成微电子有限公司 | Live broadcast audio signal processing method and sound card |
| CN115396781A (en) * | 2022-08-15 | 2022-11-25 | 音曼(北京)科技有限公司 | Method for tuning and adapting sound field uniformity based on audio processor |
| WO2023044608A1 (en) * | 2021-09-22 | 2023-03-30 | 京东方科技集团股份有限公司 | Audio adjustment method, apparatus and device, and storage medium |
| CN117406654A (en) * | 2023-12-15 | 2024-01-16 | 荣耀终端有限公司 | Sound processing methods and electronic equipment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1932970A (en) * | 2005-09-13 | 2007-03-21 | 乐金电子(中国)研究开发中心有限公司 | Method for generating harmonics using fourier transform and apparatus thereof, method for generating harmonics by down-sampling and apparatus thereof and method for enhancing sound and apparatus there |
| CN101577848A (en) * | 2009-03-12 | 2009-11-11 | 北京中星微电子有限公司 | Supper bass boosting method and system |
| US20140064509A1 (en) * | 2012-09-02 | 2014-03-06 | QoSound, Inc. | Computer program product for adaptive audio signal shaping for improved playback in a noisy environment |
| CN106303836A (en) * | 2016-11-15 | 2017-01-04 | 广东小天才科技有限公司 | Method and device for adjusting stereo playing |
-
2017
- 2017-03-03 CN CN201710124912.3A patent/CN106878866B/en not_active Expired - Fee Related
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1932970A (en) * | 2005-09-13 | 2007-03-21 | 乐金电子(中国)研究开发中心有限公司 | Method for generating harmonics using fourier transform and apparatus thereof, method for generating harmonics by down-sampling and apparatus thereof and method for enhancing sound and apparatus there |
| CN101577848A (en) * | 2009-03-12 | 2009-11-11 | 北京中星微电子有限公司 | Supper bass boosting method and system |
| US20140064509A1 (en) * | 2012-09-02 | 2014-03-06 | QoSound, Inc. | Computer program product for adaptive audio signal shaping for improved playback in a noisy environment |
| CN106303836A (en) * | 2016-11-15 | 2017-01-04 | 广东小天才科技有限公司 | Method and device for adjusting stereo playing |
Cited By (33)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107197101B (en) * | 2017-06-23 | 2020-12-29 | 努比亚技术有限公司 | Audio adjusting method, mobile terminal and computer readable storage medium |
| CN107197101A (en) * | 2017-06-23 | 2017-09-22 | 努比亚技术有限公司 | Audio regulation method, mobile terminal and computer-readable recording medium |
| CN108834028B (en) * | 2017-07-14 | 2021-01-15 | 博频(上海)科技股份有限公司 | Audio playing system |
| CN108834028A (en) * | 2017-07-14 | 2018-11-16 | 博频(上海)科技股份有限公司 | Audio playing system |
| CN107479851B (en) * | 2017-08-18 | 2019-07-16 | Oppo广东移动通信有限公司 | Volume adjusting method and device, terminal equipment and storage medium |
| CN107465824A (en) * | 2017-08-18 | 2017-12-12 | 广东欧珀移动通信有限公司 | volume adjusting method, device, mobile terminal and storage medium |
| CN107479852A (en) * | 2017-08-18 | 2017-12-15 | 广东欧珀移动通信有限公司 | Volume adjustment method, device, terminal equipment and storage medium |
| CN107479851A (en) * | 2017-08-18 | 2017-12-15 | 广东欧珀移动通信有限公司 | Volume adjustment method, device, terminal equipment and storage medium |
| WO2019033943A1 (en) * | 2017-08-18 | 2019-02-21 | Oppo广东移动通信有限公司 | Volume adjusting method and device, mobile terminal and storage medium |
| CN109561222A (en) * | 2017-09-27 | 2019-04-02 | 华为终端(东莞)有限公司 | A kind of method for detecting abnormality and device of voice data |
| CN107979702A (en) * | 2017-11-30 | 2018-05-01 | 北京小米移动软件有限公司 | Acoustic signal processing method, device, terminal and storage medium |
| CN107995559B (en) * | 2017-12-26 | 2020-12-01 | 上海展扬通信技术有限公司 | Audio control terminal and method |
| CN107995559A (en) * | 2017-12-26 | 2018-05-04 | 上海展扬通信技术有限公司 | The terminal and method of a kind of audio frequency control |
| CN108510999A (en) * | 2018-02-09 | 2018-09-07 | 杭州默安科技有限公司 | The zero permission terminal device recognition methods based on audio-frequency fingerprint |
| CN108510999B (en) * | 2018-02-09 | 2020-07-14 | 杭州默安科技有限公司 | Zero-authority terminal equipment identification method based on audio fingerprints |
| WO2020103527A1 (en) * | 2018-11-23 | 2020-05-28 | 北京达佳互联信息技术有限公司 | Loudness adjustment method and apparatus, and electronic device and storage medium |
| US11284151B2 (en) | 2018-11-23 | 2022-03-22 | Beijing Dajia Internet Information Technology Co., Ltd. | Loudness adjustment method and apparatus, and electronic device and storage medium |
| CN113412630B (en) * | 2019-02-14 | 2024-03-08 | Jvc建伍株式会社 | Processing device, processing method, reproduction method, and program |
| CN113412630A (en) * | 2019-02-14 | 2021-09-17 | Jvc建伍株式会社 | Processing device, processing method, reproduction method, and program |
| US11997468B2 (en) | 2019-02-14 | 2024-05-28 | Jvckenwood Corporation | Processing device, processing method, reproducing method, and program |
| CN109831710A (en) * | 2019-02-19 | 2019-05-31 | 泽丰音频技术(深圳)有限公司 | Microphone and sound integrated equipment and adjusting method and system |
| CN110349594A (en) * | 2019-07-18 | 2019-10-18 | Oppo广东移动通信有限公司 | Audio processing method and device, mobile terminal and computer readable storage medium |
| CN111049972A (en) * | 2019-11-20 | 2020-04-21 | 维沃移动通信有限公司 | Audio playing method and terminal equipment |
| CN111049972B (en) * | 2019-11-20 | 2021-04-27 | 维沃移动通信有限公司 | A kind of audio playback method and terminal device |
| CN112130495A (en) * | 2020-09-22 | 2020-12-25 | 湖北大学 | Digital configurable acoustic signal filtering device and filtering method |
| CN113643719A (en) * | 2021-08-26 | 2021-11-12 | Oppo广东移动通信有限公司 | Audio signal processing method, device, storage medium and terminal device |
| CN113784157B (en) * | 2021-08-31 | 2023-11-03 | 江西创成微电子有限公司 | Live broadcast audio signal processing method and sound card |
| CN113784157A (en) * | 2021-08-31 | 2021-12-10 | 江西创成微电子有限公司 | Live broadcast audio signal processing method and sound card |
| WO2023044608A1 (en) * | 2021-09-22 | 2023-03-30 | 京东方科技集团股份有限公司 | Audio adjustment method, apparatus and device, and storage medium |
| US12315529B2 (en) | 2021-09-22 | 2025-05-27 | Boe Technology Group Co., Ltd. | Audio compensation with sound effect characteristic curve to adjust abnormal frequency points |
| CN115396781A (en) * | 2022-08-15 | 2022-11-25 | 音曼(北京)科技有限公司 | Method for tuning and adapting sound field uniformity based on audio processor |
| CN117406654A (en) * | 2023-12-15 | 2024-01-16 | 荣耀终端有限公司 | Sound processing methods and electronic equipment |
| CN117406654B (en) * | 2023-12-15 | 2024-04-16 | 荣耀终端有限公司 | Sound effect processing method and electronic device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106878866B (en) | 2020-01-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106878866B (en) | Audio signal processing method and device and terminal | |
| US9208767B2 (en) | Method for adaptive audio signal shaping for improved playback in a noisy environment | |
| JP5704470B2 (en) | Audio intelligibility increasing method and apparatus and computer apparatus | |
| TWI535299B (en) | Bass enhancement system and method thereof | |
| JP4986182B2 (en) | Acoustic processing system, method and mobile phone terminal for electronic equipment | |
| CN106911996A (en) | Microphone state detection method, device and terminal equipment | |
| CN101609685A (en) | Audio signal processing device and audio signal processing method | |
| CN103152668A (en) | Adjusting method of output audio and system thereof | |
| US11153043B2 (en) | Measuring and evaluating a test signal generated by a device under test (DUT) | |
| CN103179496A (en) | Audio testing system and method for earphone microphone and speaker of mobile terminal | |
| CN105404642A (en) | Audio playing method and user terminal | |
| CN111796790A (en) | Sound effect adjusting method and device, readable storage medium and terminal equipment | |
| US20060239472A1 (en) | Sound quality adjusting apparatus and sound quality adjusting method | |
| CN105764008B (en) | A method and device for debugging the transmission frequency characteristics of a sound reinforcement system | |
| CN106066782B (en) | A kind of data processing method and electronic equipment | |
| CN101600132B (en) | Method and device for adjusting audio file play effect on portable handheld device | |
| TW201317983A (en) | Hearing aid and method of enhancing speech output in real time | |
| CN109889170B (en) | Audio signal control method and device | |
| WO2026020511A1 (en) | Audio compression method and apparatus | |
| CN116634221A (en) | Multi-channel audio source automatic mixing method, system, device and medium based on Android system | |
| CN107750038B (en) | Volume adjusting method, device, equipment and storage medium | |
| CN114640939B (en) | Method, device and system for detecting audio playing device and storage medium | |
| CN116778949A (en) | Personalized loudness compensation method, device, computer equipment and storage medium | |
| CN115567845A (en) | An information processing method and device | |
| CN221227711U (en) | Active sound box circuit capable of eliminating high-frequency tooth sound |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Applicant after: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. Address before: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Applicant before: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20200110 |