[go: up one dir, main page]

US20180184227A1 - Method and apparatus for rendering acoustic signal, and computer-readable recording medium - Google Patents

Method and apparatus for rendering acoustic signal, and computer-readable recording medium Download PDF

Info

Publication number
US20180184227A1
US20180184227A1 US15/129,218 US201515129218A US2018184227A1 US 20180184227 A1 US20180184227 A1 US 20180184227A1 US 201515129218 A US201515129218 A US 201515129218A US 2018184227 A1 US2018184227 A1 US 2018184227A1
Authority
US
United States
Prior art keywords
channel
deviation
output
channels
elevation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US15/129,218
Other languages
English (en)
Inventor
Sang-Bae Chon
Sun-min Kim
Hyun Jo
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics Co Ltd filed Critical Samsung Electronics Co Ltd
Priority to US15/129,218 priority Critical patent/US20180184227A1/en
Assigned to SAMSUNG ELECTRONICS CO., LTD. reassignment SAMSUNG ELECTRONICS CO., LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: CHON, SANG-BAE, JO, HYUN, KIM, SUN-MIN
Publication of US20180184227A1 publication Critical patent/US20180184227A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/308—Electronic adaptation dependent on speaker or headphone connection
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/008—Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S3/00—Systems employing more than two channels, e.g. quadraphonic
    • H04S3/002—Non-adaptive circuits, e.g. manually adjustable or static, for enhancing the sound image or the spatial distribution
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S3/00—Systems employing more than two channels, e.g. quadraphonic
    • H04S3/008—Systems employing more than two channels, e.g. quadraphonic in which the audio signals are in digital form, i.e. employing more than two discrete digital channels
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/01—Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/03—Aspects of down-mixing multi-channel audio to configurations with lower numbers of playback channels, e.g. 7.1 -> 5.1
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/11—Positioning of individual sound objects, e.g. moving airplane, within a sound field
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/13—Aspects of volume control, not necessarily automatic, in stereophonic sound systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
    • H04S2420/01—Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
    • H04S2420/03—Application of parametric coding in stereophonic audio systems

Definitions

  • the inventive concept relates to a method and apparatus for rendering audio signal, and more particularly, to a rendering method and apparatus for reproducing location of a sound image and tone color more accurately, by modifying a panning gain or a filter coefficient when there is a misalignment between a standard layout and an arrangement layout of output channels.
  • Stereophonic sound denotes a sound, to which spatial information is added, capable of reproducing a direction or a distance of a sound, as well as pitch and tone color of a sound, allowing a listener to have an immersive feeling, and making a listener, who does not exist in a space where a sound source has occurred, experience directional, distance, and spatial perceptions.
  • a channel signal such as a 22.2 channel is rendered as a 5.1 channel
  • a three-dimensional (3D) stereophonic sound may be reproduced using a two-dimensional (2D) output channel, but rendered audio signals are so sensitive to a layout of speakers that a sound image distortion may occur if an arrangement layout of speakers is different from a standard layout.
  • a channel signal such as a 22.2 channel is rendered as a 5.1 channel
  • a three-dimensional (3D) stereophonic sound may be reproduced using a two-dimensional (2D) output channel, but rendered audio signals are so sensitive to a layout of speakers that a sound image distortion may occur if an arrangement layout of speakers is different from a standard layout.
  • the inventive concept provides reduction in a sound image distortion even when a layout of installed speakers is different from a standard layout.
  • the present invention includes embodiments below.
  • An audio signal rendering method includes: receiving a multi-channel signal comprising a plurality of input channels that are to be converted to a plurality of output channels; obtaining deviation information about at least one output channel, from a location of a speaker corresponding to each of the plurality of output channels and a standard location; and modifying a panning gain from a height channel included in the plurality of input channels to the output channel having the deviation information, based on obtained deviation information.
  • an audio signal may be rendered so as to reduce sound image distortion even if a layout of installed speakers is different from a standard layout or a location of a sound image has changed.
  • FIG. 1 is a block diagram illustrating an internal structure of a stereophonic sound reproduction apparatus according to an embodiment
  • FIG. 2 is a block diagram of a renderer in the stereophonic sound reproduction apparatus according to the embodiment
  • FIG. 3 is a diagram of a layout of channels in a case where a plurality of input channels are down-mixed to a plurality of output channels, according to an embodiment
  • FIG. 4 is a diagram of a panning unit in a case where a positional deviation occurs between a standard layout and an arrangement layout of output channels, according to an embodiment
  • FIG. 5 is a diagram illustrating configuration of a panning unit in a case where there is an elevation deviation between a standard layout and an arrangement layout of output channels, according to an embodiment
  • FIG. 6 is diagrams showing locations of a sound image according to an arrangement layout of output channels, when a center channel signal is rendered from a left channel signal and a right channel signal;
  • FIG. 7 is diagrams showing localization of a location of a sound image by correcting an elevation effect according to an embodiment, if there is an elevation deviation in output channels;
  • FIG. 8 is a flowchart illustrating a method of rendering a stereophonic audio signal, according to an embodiment
  • FIG. 9 is a diagram showing an elevation deviation versus a panning gain with respect to each channel when a center channel signal is rendered from a left channel signal and a right channel signal, according to an embodiment
  • FIG. 10 is a diagram showing spectrums of tones at locations, according to a positional deviation between speakers
  • FIG. 11 is a flowchart illustrating a method of rendering a stereophonic audio signal according to an embodiment
  • FIG. 12 is diagrams for illustrating methods of designing sound quality correction filters, according to an embodiment
  • FIG. 13 is diagrams showing examples in which an elevation deviation exists between output channels for 3D virtual rendering and a virtual sound source
  • FIG. 14 is a diagram for illustrating a method of virtual rendering a TFC channel by using L/R/LS/RS channels according to an embodiment
  • FIG. 15 is a block diagram of a renderer for processing a deviation in a virtual rendering by using 5.1 output channels, according to an embodiment.
  • the present invention includes embodiments below.
  • an audio signal rendering method including: receiving a multi-channel signal comprising a plurality of input channels that are to be converted to a plurality of output channels; obtaining deviation information about at least one output channel, from a location of a speaker corresponding to each of the plurality of output channels and a standard location; and modifying a panning gain from a height channel included in the plurality of input channels to the output channel having the deviation information, based on obtained deviation information.
  • the plurality of output channels may be horizontal channels.
  • the output channel having the deviation information may include at least one of a left horizontal channel and a right horizontal channel.
  • the deviation information may include at least one of an azimuth deviation and an elevation deviation.
  • the modifying of the panning gain may modify an effect caused by an elevation deviation, when the obtained deviation information includes the elevation deviation.
  • the modifying of the panning gain may correct the panning gain by a two-dimensional (2D) panning method, when the obtained deviation information does not include the elevation deviation.
  • the correcting of the effect caused by the elevation deviation may include correcting an inter-aural level difference (ILD) resulting from the elevation deviation.
  • ILD inter-aural level difference
  • the correcting of the effect caused by the elevation deviation may include modifying the panning gain of the output channel corresponding to obtained elevation deviation, in proportional to the obtained elevation deviation.
  • a sum of square values of panning gains with respect to the left horizontal channel and the right horizontal channel may be 1.
  • an apparatus for rendering an audio signal including: a receiver configured to receive a multi-channel signal including a plurality of input channels that are to be converted to a plurality of output channels; an obtaining unit configured to obtain deviation information about at least one output channel, from a location of speaker corresponding to each of the plurality of output channels and a standard location; and a panning gain modifier configured to modify a panning gain from a height channel comprised in the plurality of input channels to the output channel having the deviation information, based on obtained deviation information.
  • the plurality of output channels may be horizontal channels.
  • the output channel having the deviation information may include at least one of a left horizontal channel and a right horizontal channel.
  • the deviation information may include at least one of an azimuth deviation and an elevation deviation.
  • the panning gain modifier may correct an effect caused by an elevation deviation, when the obtained deviation information includes the elevation deviation.
  • the panning gain modifier may modify the panning gain by a two-dimensional (2D) panning method, when the obtained deviation information does not include the elevation deviation.
  • the panning gain modifier may correct an inter-aural level difference caused by the elevation deviation to correct an effect caused by the elevation deviation.
  • the panning gain modifier may modify a panning gain of an output channel corresponding to the elevation deviation, in proportional to obtained elevation deviation, so as to correct an effect caused by the obtained elevation deviation.
  • a sum of square values of panning gains with respect to the left horizontal channel and the right horizontal channel may be 1.
  • a computer-readable recording medium having recorded thereon a computer program for executing the above method.
  • FIG. 1 is a block diagram illustrating an internal structure of a stereophonic sound reproducing apparatus according to an embodiment.
  • the stereophonic sound reproducing apparatus 100 may output a multi-channel audio signal, in which a plurality of input channels are mixed to a plurality of output channels to reproduce.
  • the input channels are down-mixed according to the number of output channels.
  • Stereophonic sound denotes sound, to which spatial information is added, allowing a listener to have an immersive feeling by reproducing a direction or feeling of distance of a sound, as well as an elevation and timbre of the sound, so that even a listener who does not exist in a space where a sound source has occurred may experience directional, distance, and spatial perceptions.
  • an output channel of an audio signal may denote the number of speakers that output sound. The more the output channels, the more the number of speakers from which the sound is output.
  • the stereophonic sound reproducing apparatus 100 may render and mix a multi-channel audio input signal to output channels that will reproduce the sound, so that the multi-channel audio signal from a large number of input channels may be output and reproduced in an environment where a less number of output channels are provided.
  • the multi-channel audio signal may include a channel capable of outputting an elevated sound.
  • the channel capable of outputting the elevated sound may denote a channel capable of outputting an audio signal via a speaker located above a head of a listener so that the listener may experience elevated feeling.
  • a horizontal channel may denote a channel capable of outputting an audio signal via a speaker located on a horizontal plane with respect to the listener.
  • the above-described environment in which less number of output channels are provided may denote an environment in which the sound may be output via a speaker provided on a horizontal plane, without using an output channel capable of outputting the elevated sound.
  • a horizontal channel may denote a channel including an audio signal that may be output via a speaker provided on the horizontal plane.
  • An overhead channel may denote a channel including an audio signal that may be output via a speaker that is provided on an elevated position, not on the horizontal plane, in order to output the elevated sound.
  • the stereophonic sound reproducing apparatus 100 may include an audio core 110 , a renderer 120 , a mixer 130 , and a post-processor 140 .
  • the stereophonic sound reproducing apparatus 100 may render, mix, and output a multi-channel input audio signal to an output channel to reproduce.
  • the multi-channel input audio signal may be a 22.2 channel signal
  • the output channel to reproduce may be 5.1 or 7.1 channels.
  • the stereophonic sound reproducing apparatus 100 performs a rendering by designating output channels to which channels of the multi-channel input audio signal will correspond, and performs mixing of the rendered audio signals by mixing signals of the channels respectively corresponding to the channels to reproduce and outputs a final signal.
  • An encoded audio signal is input to the audio core 110 in a format of a bistream, and the audio core 110 decodes the input audio signal after selecting a decoder tool suitable for the encoded format of the audio signal.
  • the renderer 120 may render the multi-channel input audio signal to a multi-channel output channels according to channels and frequencies.
  • the renderer 120 may perform three-dimensional (3D) rendering and two-dimensional (2D) rendering on the multi-channel audio signal according to overhead channels and horizontal channels. A configuration of the renderer and a detailed rendering method will be described in more detail later with reference to FIG. 2 .
  • the mixer 130 may mix the signals of the channels corresponding to the horizontal channels by the renderer 120 , and output the final signal.
  • the mixer 130 may mix the signals of the respective channels according to each of predetermined sections. For example, the mixer 130 may mix the signals of the respective channels by one frame unit.
  • the mixer 130 may perform the mixing based on power values of the signals that are rendered to the respective channels to produce. That is, the mixer 130 may determine amplitude of the final signal or a gain to be applied to the final signal based on the power values of the signals rendered to the respective channels to reproduce.
  • the post-processor 140 performs a controlling of a dynamic range with respect to a multi-band signal and binaurlaizing on an output signal of the mixer 130 to be suitable for the respective reproducing apparatus (speaker, headphones, etc.).
  • An output audio signal output from the post-processor 140 is output via a device such as a speaker, and the output audio signal may be reproduced in a 2D or 3D manner according to the process performed by each element.
  • the stereophonic sound reproducing apparatus 100 illustrated with reference to FIG. 1 according to the embodiment is shown based on a configuration of an audio decoder, and other additional configurations are omitted.
  • FIG. 2 is a block diagram illustrating configuration of the renderer among the configuration of the stereophonic sound reproducing apparatus according to an embodiment.
  • the renderer 120 includes a filtering unit 121 and a panning unit 123 .
  • the filtering unit 121 compensates for a tone or the like of a decoded audio signal according to a location, and may perform filtering of an input audio signal by using a head-related transfer function (HRTF) filter.
  • HRTF head-related transfer function
  • the filtering unit 121 may render an overhead channel that has passed through the HRTF filter in different manners according to a frequency thereof, in order to perform 3D rendering on the overhead channel.
  • the HRTF filter may allow a stereophonic sound to be recognized according to a phenomenon in which a characteristic of a complicated path such as diffraction on a surface of a head, reflection by auricles, etc. is changed depending on a transfer direction of a sound, as well as a simple difference between paths such as an inter-aural level difference (ILD) and an inter-aural time difference (ITD) which occurs when a sound reaches two ears, etc.
  • the HRTF filter may process the audio signals included in the overhead channel, that is, by changing sound quality of the audio signal so that the stereophonic sound may be recognized.
  • the panning unit 123 calculates and applies a panning coefficient that is to be applied to each frequency band and each channel, in order to pan the input audio signal with respect to each output channel.
  • Panning of the audio signal denotes controlling a magnitude of a signal applied to each output channel, in order to render a sound source at a certain location between two output channels.
  • the panning unit 123 may render a low frequency signal among the overhead channel signals according to add-to-the-closest channel method, and may render a high frequency signal according to a multichannel panning method.
  • a gain value that is set to differ in channels to be rendered to each of channel signals is applied to signals of each of channels of a multichannel audio signal, so that each of the signals may be rendered to at least one horizontal channel.
  • the signals of each channel to which the gain value is applied may be synthesized via mixing and may be output as a final signal.
  • the stereophonic sound reproducing apparatus 100 may render the low frequency signal according to the add-to-the-closest channel method, and thus, sound quality degradation that may occur when various channels are mixed to one output channel may be prevented. That is, if various channels are mixed to one output channel, sound quality may be amplified or decreased due to interference between the channel signals and thus may degrade, and thus, the sound quality degradation may be prevented by mixing one channel to one output channel.
  • each channel of the multi-channel audio signal may be rendered to a closest channel from among the channels to reproduce, instead of being rendered to various channels.
  • the stereophonic sound reproducing apparatus 100 performs the rendering operation differently from the frequency, thereby increasing a sweet spot without degrading the sound quality. That is, the low frequency signal having a high diffractive property is rendered according to the add-to-the-closest channel method in order to prevent the sound quality degradation that may occur when various channels are mixed to one output channel.
  • the sweet spot denotes a predetermined range in which the listener may optimally listen to the stereophonic sound that has not been distorted.
  • the listener may optimally listen to the stereophonic sound that has not been distorted within a large range.
  • the listener may listen to the sound, the sound quality or the sound image of which has been distorted.
  • FIG. 3 is a diagram of a layout of channels in a case where a plurality of input channels are down-mixed to a plurality of output channels, according to an embodiment.
  • a technology for providing a stereophonic sound with a stereoscopic image has been being developed in order to provide a user with realism and immersive feeling that are equal to or more exaggerated than reality.
  • a stereophonic sound denotes that an audio signal itself has an elevation of sound and spatiality, and in order to reproduce the stereophonic sound, at least two or more loud speakers, that is, output channels, are necessary. Also, a large number of output channels are necessary in order to accurately reproduce feelings of elevation, distance, and spatiality of the sound, except for a binaural stereophonic sound using an HRTF.
  • FIG. 3 is a diagram illustrating an example in which a stereophonic audio signal of 22.2 channels is reproduced by a 5.1-channel output system.
  • a 5.1-channel system is a generalized name of a 5-channel surround multi-channel sound system, and has been widely distributed and used as home-theater in households and a sound system for theatres. All kinds of 5.1 channels include a front left (FL) channel, a center (C) channel, a front right (FR) channel, a surround left (SL) channel, and a surround right (SR) channel. As denoted in FIG. 3 , since the output channels of the 5.1-channel system are placed on a same horizontal plane, the 5.1-channel system physically corresponds to 2D system. In order for the 5.1-channel system to reproduce stereophonic audio signals, a rendering process for granting 3D effect to a signal to be reproduced has to be performed.
  • the 5.1-channel system is widely used in various fields such as digital versatile disc (DVD) video, DVD sound, super audio compact disc (SACD), or digital broadcasting, as well as in movies.
  • DVD digital versatile disc
  • SACD super audio compact disc
  • the 5.1-channel system provides an improved spatiality when comparing with the stereo system, there are many restrictions in forming wider listening space.
  • the 5.1-channel system forms a narrow sweet spot and may not provide a vertical sound image having an elevation angle, and thus, the 5.1-channel system may not be suitable for a wide listening space, e.g., a theater.
  • a 22.2-channel system suggested by NHK includes three-layers of output channels.
  • An upper layer includes a Voice of God (VOG), T0, T180, TL45, TL90, TL135, TR45, TR90, and TR45 channels.
  • VOG Voice of God
  • T0, T180, TL45, TL90, TL135, TR45, TR90, and TR45 channels are examples of channels.
  • index T denotes an upper layer
  • indexes L and R respectively denote left and right
  • a number at the rear denotes an azimuth angle from a center channel.
  • a middle layer is on a same plane as the 5.1 channels, and includes ML60, ML90, ML135, MR60, MR90, and MR135 channels in addition to output channels of the 5.1 channels.
  • an index M at the front means a middle layer
  • a number at the rear denotes an azimuth angle from a center channel.
  • a low layer includes L0, LL45, and LR45 channels.
  • an index L at the front of the name of each channel denotes a low layer
  • a number at the rear denotes an azimuth angle from a center channel.
  • the middle layer is referred to as a horizontal channel
  • the VOG, T0, T180, T180, M180, L, and C channels having azimuth angle of 0° or 180° are referred to as vertical channels.
  • FIG. 4 illustrates a panning unit according to an embodiment in a case where a positional deviation occurs between a standard layout and an arrangement layout of output channels.
  • General rendering techniques are supposed to perform rendering based on a case where speakers, that is, output channels, are arranged according to the standard layout. However, when the output channels are not arranged to accurately match the standard layout, distortion of a location of a sound image and distortion of a tone occur.
  • the distortion of the sound image widely includes distortion of the elevation and distortion of a phase angle that are not sensitively felt in a relatively low level.
  • the distortion of the sound image may be sensitively perceived.
  • a sound image of a front side may be further sensitively perceived.
  • the first process corresponds to an initializing process in which a panning gain with respect to an input multichannel signal is calculated according to a standard layout of output channels.
  • a calculated panning gain is modified based on a layout with which the output channels are actually arranged.
  • a sound image of an output signal may be present at a more accurate location.
  • the panning unit 123 in order for the panning unit 123 to perform processing, information about the standard layout of the output channels and information about the arrangement layout of the output channels are required, in addition to the audio input signal.
  • the audio input signal indicates an input signal to be reproduced via the C channel
  • an audio output signal indicates modified panning signals output from the L channel and the R channel according to the arrangement layout.
  • FIG. 5 is a diagram of a configuration of a panning unit according to an embodiment in a case where there is an elevation deviation between a standard layout and an arrangement layout of the output channels.
  • the 2D panning method that only takes into account the azimuth deviation as shown in FIG. 4 may not correct an effect caused by an elevation deviation if there is an elevation deviation between the standard layout and the arrangement layout of the output channels. Therefore, if there is an elevation deviation between the standard layout and the arrangement layout of the output channels, an elevation rising effect due to the elevation deviation has to be compensated for by an elevation effect compensator 124 as shown in FIG. 5 .
  • the elevation effect compensator 124 and the panning unit 123 are shown as separate elements, but the elevation effect compensator 124 may be implemented as an element included in the panning unit 123 .
  • FIGS. 6 to 9 illustrate a method of determining a panning coefficient according to a layout of speakers in detail.
  • FIG. 6 is diagrams showing a location of a sound image according to an arrangement layout of output channels, in a case where a center channel signal is rendered from a left channel signal and a right channel signal.
  • the L channel and the R channel are located at a same plane while having azimuth angles of 30° to left and right sides from the C channel according to the standard layout.
  • a C channel signal is rendered only by a gain obtained through an initialization of the panning unit 123 and is located at a regular position, and thus, there is no need to additionally modify the panning gain.
  • the L channel and the R channel are located on a same plane like in FIG. 6A , and a location of the R channel matches the standard layout, whereas the L channel has the azimuth angle of 45° that is greater than 30°. That is, the L channel has an azimuth deviation of 15° with respect to the standard layout.
  • the panning gain calculated through the initialization process is the same with respect to the L channel and the R channel, and when the panning gain is applied, a location of the sound image is determined to be C′ that is biased toward the R channel.
  • the above phenomenon occurs because the ILD varies depending on a change in the azimuth angle.
  • the azimuth angle is defined as 0° based on the location of the C channel, a level difference ILD of the audio signals reaching two ears of a listener increases as the azimuth angle increases.
  • the azimuth deviation has to be compensated for by modifying the panning gain according to the 2D panning method.
  • a signal of the R channel is increased or a signal of the L channel is reduced so that the sound image may be formed at the location of the C channel.
  • FIG. 7 is diagrams showing localization of the sound image by compensating for the elevation effect according to an embodiment, when there is an elevation deviation between the output channels.
  • FIG. 7A shows a case in which the R channel is arranged on a location of R′ having an elevation angle so as to have an azimuth angle of 30° that satisfies the standard layout, whereas the R channel is not located on the same plane as the L channel and has an elevation angle of 30° from the horizontal channel.
  • location of the sound image C′ that has been changed due to the change of the ILD according to the rising of the elevation of the R channel is not located at the center between the L channel and the R channel, but is biased toward the L channel.
  • the ILD is changed due to the elevation rising like in the case where there is the azimuth deviation exists. If the elevation angle is defined to be 0° based on the horizontal channel, the level difference ILD of the audio signals reaching two ears of the listener is reduced as the elevation angle increases. Therefore, C′ is biased toward the L channel that is the horizontal channel (having no elevation angle).
  • the elevation effect compensator 124 compensates for the ILD of the sound having the elevation angle in order to prevent bias of the sound image.
  • the elevation effect compensator modifies the panning gain of the channel having the elevation angle to be increased so as to prevent the bias of the sound image and to form the sound image at the azimuth angle 0°.
  • FIG. 7B shows a location of the sound image that is localized through the compensation of the elevation effect.
  • the sound image before compensation of the elevation effect is located at C′, that is, a biased position toward the channel having no elevation angle as shown in FIG. 7A .
  • the sound image may be localized so as to be positioned at the center between the L channel and an R′ channel.
  • FIG. 8 is a flowchart illustrating a method of rendering a stereophonic audio signal, according to an embodiment.
  • the method of rendering the stereophonic audio signal illustrated with reference to FIGS. 6 and 7 is performed in following order.
  • the renderer 120 receives a multi-channel input signal having a plurality of channels ( 810 ). For panning the received multi-channel input signal through multi-channel output, the panning unit 123 obtains deviation information about each of output channels by comparing locations where the speakers corresponding to the output channels are arranged with standard output locations ( 820 ).
  • the output channels are horizontal channels located on the same plane.
  • Deviation information may include at least one of information about an azimuth deviation and information about an elevation deviation.
  • the information about the azimuth deviation may include the azimuth angle formed by a center channel and output channels on the horizontal plane where the horizontal channels exist, and information about the elevation deviation may include an elevation angle formed by the horizontal plane on which the horizontal channels exist and the output channel.
  • the panning unit 123 obtains a panning gain that is to be applied to the input multi-channel signal, based on the standard output location ( 830 ).
  • an order of the obtaining of the deviation information ( 820 ) and the obtaining of the panning gain ( 830 ) may be switched.
  • operation 820 as a result of obtaining the deviation information about each output channel, if the deviation information exists in the output channel, the panning gain obtained in operation 830 has to be modified.
  • operation 840 it is determined whether there is an elevation deviation based on the deviation information obtained in operation 820 .
  • the panning gain is modified only by taking into account the azimuth deviation ( 850 ).
  • VBAP vector base amplitude panning
  • WFS wave field synthesis
  • a hybrid virtual rendering method that performs the rendering process after selecting a 2D (timbral)/3D (spatial) rendering modes according to an importance of a spatial perception and sound quality in each scene may be applied.
  • a rendering method that combines a virtual rendering for providing spatial perception and a technique using an active down-mix that improves sound quality by preventing comb-filtering during a down-mix process may be used.
  • the panning gain is modified while taking into account the elevation deviation ( 860 ).
  • the modifying of the panning gain taking into account the elevation deviation includes a process of compensating for the rising effect according to the increase in the elevation angle, that is, modifies the panning gain so as to compensate for the ILD that is reduced according to the elevation increasing.
  • processes from operation 820 that is, obtaining the deviation information about each output channel
  • to operation 850 or 860 that is, modifying the panning gain that is to be applied to the corresponding channel, may be repeatedly performed as many as the number of output channels.
  • FIG. 9 is a diagram showing an elevation deviation versus a panning gain with respect to each channel, when a center channel signal is rendered from a left channel signal and a right channel signal, according to an embodiment.
  • FIG. 9 shows relation between the panning gains that are to be applied to a channel having the elevation angle (elevated) and a channel on a horizontal plane (fixed) and the elevation angle, as an embodiment of the elevation effect compensator 124 .
  • the panning gain has to be modified according to the elevation angle in order to compensate for the effect caused by the elevation increase.
  • the panning gain is modified to increase by a ratio of 8 dB/90° according to the change in the elevation angle.
  • a gain of an elevated channel corresponding to the elevation angle 30° is applied to the R channel, and then, g R is modified to 0.81, that is, increased from 0.707, and a gain of a fixed channel is applied to the L channel, and then, g L is modified to 0.58, decreased from 0.707.
  • the panning gains g L and g R have to satisfy Equation 2 below for energy normalization.
  • the panning gain is modified to increase linearly by the ratio of 8 dB/90° according to the change in the elevation angle.
  • the increasing ratio may vary depending on the example of the elevation effect compensator, or the panning gain may increase non-linearly.
  • FIG. 10 is a diagram showing spectrums of tone colors at different locations, according to a positional deviation between the speakers.
  • the panning unit 123 and the elevation effect compensator 124 process the audio signals so that the sound image may not be biased according to locations of the speakers corresponding to the output channels, but to be located at an original location. However, if the locations of the speakers corresponding to the output channels actually change, the sound image is not only changed, but the tone color is also changed.
  • a spectrum of the tone color that a human being perceives according to the location of the sound image may be obtained based on an HRTF that is a function for transferring the sound image at a certain spatial location to human ears.
  • the HRTF may be obtained by performing Fourier transformation on a head-related impulse response (HRIR) obtained from a time domain.
  • HRIR head-related impulse response
  • an audio signal from a spatial audio source propagates through the air and passes through an auricle, an external auditory canal, and an eardrum, a magnitude or a phase of the audio signal have changed.
  • the audio signal that is transferred is also changed due to a head, a torso, or the like of the listener. Therefore, the listener finally listens to a distorted audio signal.
  • HRTF a transfer function of the audio signal that the listener listens to, in particular, between an acoustic pressure and the audio signal.
  • the HRTF Since each person has a unique size and shape of head, auricle, and torso, the HRTF is unique to each person. However, since it is impossible to measure the HRTF from each person, the HRTF may be modelled by using a common HRTF, a customized HRTF, etc.
  • a diffraction effect of a head is shown from about 600 Hz and is rarely shown after 4 kHz, and a torso effect that may be observed from 1 kHz to 2 kHz is increased as an audio source is located at ipsilateral azimuth and an elevation angle of the audio source is low, and is observed to 13 kHz at which the auricle dominantly affects sound image of the audio signal.
  • a peak is shown due to resonance of the auricle.
  • a first notch due to the auricle is shown within a range of 6 kHz to 10 kHz
  • a second notch due to the auricle is shown within a range of 10 kHz to 15 kHz
  • a third notch due to the auricle is shown in a range of 15 kHz or greater.
  • an ITD and an ILD of the audio source and peaks and notches shown in monaural spectral cues are used.
  • the peaks and notches are generated due to the diffraction and dispersion of the torso, head, and auricle, and may be identified in the HRTF.
  • FIG. 10 shows a graph of the spectrum of tone color that a human being perceives according to a frequency of the audio source, in a case where the azimuth angle of the speaker is 30°, 60°, and 110°.
  • the tone color of the azimuth angle of 30° has more intense component at 400 Hz or less by about 3 dB to about 5 dB, than that of the tone color of the azimuth angle of 60°.
  • the tone color of the azimuth angle of 110° has less intense component within a range of 2 kHz to 5 kHz by about 3 dB, than that of the tone color of the azimuth angle of 60°.
  • tone colors of a wideband signal provided to a listener may be similar to each other, and thus, the rendering may be performed more effectively.
  • FIG. 11 is a flowchart illustrating a method of rendering a stereophonic audio signal, according to an embodiment.
  • FIG. 11 is a flowchart illustrating an embodiment of the method of rendering the stereophonic audio signal, that is, a method of performing a tone color conversion filtering on an input channel when the input channel is panned to at least two output channels.
  • a multi-channel audio signal that is to be converted to a plurality of output channels is input to the filtering unit 121 ( 1110 ).
  • the filtering unit 121 obtains a mapping relation between the predetermined input channel and the output channels to which the input channel is to be panned ( 1130 ).
  • the filtering unit 121 obtains a tone color filter coefficient based on an HRTF about a location of the input channel and locations of the output channels for panning based on the mapping relation, and performs a tone color correction filtering by using the tone color filter coefficient ( 1150 ).
  • the tone color correction filter may be designed by following processes.
  • FIG. 12 is diagrams illustrating a method of designing a tone color correction filter, according to an embodiment.
  • the HRTF transferred to a listener when an azimuth angle of the audio source is ° (degree) is defined as II e
  • an audio source having an azimuth angle of ⁇ s is panned (localized) to speakers located at azimuth angles of ⁇ D1 and ⁇ D1 .
  • the HRTF with respect to the azimuth angles are respectively H ⁇ S , H ⁇ D1 , and H ⁇ Ds .
  • Purpose of the tone color correction is to correct the sound reproduced from the speakers located at the azimuth angles of ⁇ D1 and ⁇ D1 to have similar tone color to that of the sound at the azimuth angle ⁇ S , and thus, an output signal from the azimuth angle ⁇ D1 passes through a filter having a transfer function such as
  • an output signal from the azimuth angle ⁇ D2 passes through a filter having a transfer function such as
  • the sound reproduced from the speakers located at the azimuth angles ⁇ D1 and ⁇ D2 may be corrected to have similar tone colors to that of the sound from the azimuth angle of ⁇ S .
  • the tone color at the azimuth angle of 30° has more intense component at 400 Hz or less by about 3 dB to about 5 dB, than that of the azimuth angle of 60°, and the tone color at the azimuth angle of 110° has a smaller component within a range of 2 kHz to 5 kHz by about 4 dB than that of the azimuth angle of 60°.
  • the tone color correction Since the purpose of the tone color correction is to correct the sound reproduced from the speakers located at the angles of 30° and 110° to have similar tone color to that of the sound reproduced at the angle of 60°, the component at 400 Hz or less in the sound reproduced from the speaker at the angle of 30° is reduced by 4 dB in order to make the tone color to be similar to that of the sound at the angle of 60°, and the component within the range of 2 kHz to 5 kHz in the sound reproduced from the speaker located at the angle of 110° is increased by 4 dB in order to make the tone color to be similar to that of the sound at the angle of 60°.
  • FIG. 12A shows a tone color correction filter that is to be applied to an audio signal from the azimuth angle of 60° to be reproduced through the speaker at the azimuth angle of 30°, wherein the sound quality correction filter is applied to an entire frequency section, that is, a ratio
  • FIG. 13 is diagrams showing cases where there is an elevation deviation between an output channel and a virtual audio source in a 3D virtual rendering.
  • a virtual rendering is a technique for reproducing 3D sound from a 2D output system such as the 5.1-channel system, that is, a rendering technique for forming an sound image at a virtual location where there is no speaker, in particular, at a location having an elevation angle.
  • Virtual rendering techniques that provide an elevation perception by using 2D output channels basically include two operations, that is, an HRTF correction filtering and a multi-channel panning coefficient distribution.
  • the HRTF correction filtering denotes a tone color correction operation for providing a user with the elevation perception, that is, performs similar functions as those of the tone color correction filtering described above with reference to FIGS. 10 to 12 .
  • an elevation angle ⁇ of a virtual audio source is 35°.
  • an elevation difference between an L channel, that is, a reproducing output channel, and the virtual audio source is 35, and the HRTF with respect to the virtual audio source may be defined as H E(35) .
  • the output channel has a greater elevation angle.
  • the HRTF with respect to the virtual audio source may be defined as H E( ⁇ 35) .
  • H E ⁇ ( - 35 ) 1 H E ⁇ ( 35 )
  • the tone color correction by using the elevation correction filter H E( ⁇ ) is not performed.
  • the above rendering operation may be generalized as shown in Table 1 below.
  • Elevation angle Whether to Elevation angle of reproduction use tone color of virtual speaker (output conversion Filter type (filter audio source channel) filter coefficient) 0° 0° Not used 0° ⁇ ° Used 1 H E ⁇ ( ⁇ ) ⁇ ° 0° Used H E ( ⁇ ) ⁇ ° ⁇ ° Not used
  • a case where the tone color conversion filter is not used is the same as a case where a by-pass filtering is performed.
  • Table 1 above may be applied to a case when the elevation difference is within a predetermined range from ⁇ , as well as a case when the elevation difference is accurately ⁇ or ⁇ .
  • FIG. 14 is a diagram illustrating a virtual rendering of a TFC channel by using L/R/LS/RS channels, according to an embodiment.
  • the TFC channel is located at an azimuth angle of 0° and an elevation angle of 35°, and locations of horizontal channels L, R, LS, and RS for virtually rendering the TFC channel are as shown in FIG. 14 and Table 2 below.
  • Elevation angle (output channel) (azimuth) (elevation) L ⁇ 45° 35° R 30° 0° LS ⁇ 110° 0° RS 135° 0°
  • the R channel and the LS channel are arranged according to the standard layout, the RS channel has an azimuth deviation of 25°, and the L channel has an elevation deviation of 35° and an azimuth deviation of 15°.
  • the method of applying the virtual rendering to the TFC channel by using the L/R/LS/RS channels according to an embodiment is performed in following order.
  • the panning gain may be calculated by loading initial values for virtual rendering of the TFC channel, wherein the initial values are stored in a storage, or by using a 2D rendering, a VBAP, etc.
  • the panning coefficient is modified (corrected) according to the arrangement of channels.
  • the L channel has the elevation deviation
  • a panning gain that is modified by the elevation effect compensator 124 is applied to the L channel and the R channel for performing a pair-wise panning using the L-R channels.
  • the RS channel has the azimuth deviation
  • a panning coefficient that is modified by a general method is applied to the LS channel and the RS channel for performing the pair-wise panning using the LS-RS channels.
  • the tone color is corrected by the tone color conversion filter. Since the R channel and the LS channel are arranged according to the standard layout, a filter H E that is the same as that of the original virtual rendering is applied thereto.
  • the filter H E that is the same as that of the original virtual rendering operation is used, but a filter H M110 /H M135 for correcting the component shifted from 110° that is the azimuth angle of the RS channel according to the standard layout to the azimuth angle 135°.
  • H M110 /H M135 for correcting the component shifted from 110° that is the azimuth angle of the RS channel according to the standard layout to the azimuth angle 135°.
  • H M135 is an HRTF with respect to the audio source at the angle of 135°.
  • the TFC channel signal rendered to RS output channel may be by-passed.
  • the L channel has both the azimuth deviation and the elevation deviation from the standard layout, and thus, the filter H E that is to be applied originally for performing the virtual rendering, a filter H T000 /H T045 for compensating for the tone color of the TFC channel and the tone color at the location of the L channel is applied.
  • H T000 is an HRTF with respect to the standard layout of the TFC channel
  • H T345 is an HRTF with respect to the location where the L channel is arranged.
  • the rendering unit generates an output signal by filtering the input signal and multiplying the input signal by the panning gain, and the panning unit and the filtering unit operate independently from each other. This will be cleared with reference to a block diagram of FIG. 15 .
  • FIG. 15 is a block diagram of a renderer that processes a deviation in a virtual rendering by using 5.1 output channels, according to an embodiment.
  • the block diagram of the renderer shown in FIG. 15 illustrates an output and a process of each block, when the L/R/LS/RS output channels that are arranged according to the layout of FIG. 14 are used to perform the virtual rendering of the TFC channel by using the L/S/LS/RS channels like in the embodiment illustrated with reference to FIG. 14 .
  • the panning unit firstly calculates a virtual rendering panning gain in the 5.1 channels.
  • the panning gain may be determined by loading initial values that are set to perform the virtual rendering of the TFC channel by using the L/R/LS/RS channels.
  • the panning gains determined to be applied to the L/R/LS/RS channels are g L0 , g R0 , g L50 , and g R50 .
  • the panning gains between the L-R channels and the LS-RS channels are modified based on the deviation between the standard layout of the output channels and the arrangement layout of the output channels.
  • the panning gains may be modified by a general method. Modified panning gains are g LS and g RS . In a case of the L-R channels, since the R channel has the elevation deviation, the panning gains are modified by the elevation effect compensator 124 for correcting the elevation effect. Modified panning gains are g L and g R .
  • the filtering unit 121 receives an input signal X TFC , and performs the filtering operation with respect to each channel. Since the R channel and the LS channel are arranged according to the standard layout, the filter H E that is the same as that of the original virtual rendering operation is applied thereto. Here, outputs from the filter are X TFC,R and X TFC,LS .
  • the filter H g that is the same as that of the original virtual rendering is used, and a correction filter H M110 /H M135 is applied to a component that is shifted from the azimuth angle 110° of the LS channel according to the standard layout to the angle 135°.
  • an output signal from the filter is X TFC,RS .
  • the L channel has both the azimuth deviation and the elevation deviation with respect to the standard layout, and thus, the filter H E that is originally applied for performing the virtual rendering is not applied, but a filter H T000 /H T045 is applied for correcting a tone color of the TFC channel and a tone color at the location of the L channel.
  • an output signal from the filter is X TFC,L .
  • the output signals from the filters applied respectively to the channels are multiplied by the panning gains g L , g R , g LS , and g RS that are modified by the panning unit to output signals y TPC,L , y TPC,R , y TPC,LS , and y TFC,RS from the renderer with respect to the channel signals.
  • the embodiments according to the present invention can also be embodied as programmed commands to be executed in various computer configuration elements, and then can be recorded to a computer readable recording medium.
  • the computer readable recording medium may include one or more of the programmed commands, data files, data structures, or the like.
  • the programmed commands recorded to the computer readable recording medium may be particularly designed or configured for the invention or may be well known to one of ordinary skill in the art of computer software fields.
  • Examples of the computer readable recording medium include magnetic media including hard disks, magnetic tapes, and floppy disks, optical media including CD-ROMs, and DVDs, magneto-optical media including floptical disks, and a hardware apparatus designed to store and execute the programmed commands in read-only memory (ROM), random-access memory (RAM), flash memories, and the like.
  • Examples of the programmed commands include not only machine codes generated by a compiler but also include great codes to be executed in a computer by using an interpreter.
  • the hardware apparatus can be configured to function as one or more software modules so as to perform operations for the invention, or vice versa.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Computational Linguistics (AREA)
  • Mathematical Physics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Stereophonic System (AREA)
  • Signal Processing Not Specific To The Method Of Recording And Reproducing (AREA)
  • Electrophonic Musical Instruments (AREA)
  • Recording Or Reproducing By Magnetic Means (AREA)
US15/129,218 2014-03-24 2015-03-24 Method and apparatus for rendering acoustic signal, and computer-readable recording medium Abandoned US20180184227A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US15/129,218 US20180184227A1 (en) 2014-03-24 2015-03-24 Method and apparatus for rendering acoustic signal, and computer-readable recording medium

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201461969357P 2014-03-24 2014-03-24
PCT/KR2015/002891 WO2015147530A1 (ko) 2014-03-24 2015-03-24 음향 신호의 렌더링 방법, 장치 및 컴퓨터 판독 가능한 기록 매체
US15/129,218 US20180184227A1 (en) 2014-03-24 2015-03-24 Method and apparatus for rendering acoustic signal, and computer-readable recording medium

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2015/002891 A-371-Of-International WO2015147530A1 (ko) 2014-03-24 2015-03-24 음향 신호의 렌더링 방법, 장치 및 컴퓨터 판독 가능한 기록 매체

Related Child Applications (2)

Application Number Title Priority Date Filing Date
US17/841,380 Continuation US12035129B2 (en) 2014-03-24 2022-06-15 Method and apparatus for rendering acoustic signal, and computer-readable recording medium
US17/841,412 Continuation US12035130B2 (en) 2014-03-24 2022-06-15 Method and apparatus for rendering acoustic signal, and computer-readable recording medium

Publications (1)

Publication Number Publication Date
US20180184227A1 true US20180184227A1 (en) 2018-06-28

Family

ID=54195970

Family Applications (3)

Application Number Title Priority Date Filing Date
US15/129,218 Abandoned US20180184227A1 (en) 2014-03-24 2015-03-24 Method and apparatus for rendering acoustic signal, and computer-readable recording medium
US17/841,412 Active US12035130B2 (en) 2014-03-24 2022-06-15 Method and apparatus for rendering acoustic signal, and computer-readable recording medium
US17/841,380 Active US12035129B2 (en) 2014-03-24 2022-06-15 Method and apparatus for rendering acoustic signal, and computer-readable recording medium

Family Applications After (2)

Application Number Title Priority Date Filing Date
US17/841,412 Active US12035130B2 (en) 2014-03-24 2022-06-15 Method and apparatus for rendering acoustic signal, and computer-readable recording medium
US17/841,380 Active US12035129B2 (en) 2014-03-24 2022-06-15 Method and apparatus for rendering acoustic signal, and computer-readable recording medium

Country Status (11)

Country Link
US (3) US20180184227A1 (ru)
EP (3) EP3125240B1 (ru)
JP (2) JP6674902B2 (ru)
KR (3) KR102380231B1 (ru)
CN (2) CN106463124B (ru)
AU (2) AU2015234454B2 (ru)
BR (1) BR112016022042B1 (ru)
CA (3) CA3101903C (ru)
MX (2) MX357405B (ru)
RU (2) RU2752600C2 (ru)
WO (3) WO2015147533A2 (ru)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10484810B2 (en) 2014-06-26 2019-11-19 Samsung Electronics Co., Ltd. Method and device for rendering acoustic signal, and computer-readable recording medium
US11006210B2 (en) 2017-11-29 2021-05-11 Samsung Electronics Co., Ltd. Apparatus and method for outputting audio signal, and display apparatus using the same
US11290821B2 (en) 2018-08-09 2022-03-29 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Audio processor and a method considering acoustic obstacles and providing loudspeaker signals
US11477595B2 (en) * 2018-04-10 2022-10-18 Sony Corporation Audio processing device and audio processing method
US20250088820A1 (en) * 2021-07-30 2025-03-13 Areal Bv Audio Signal Processing Method

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
MX357405B (es) 2014-03-24 2018-07-09 Samsung Electronics Co Ltd Metodo y aparato de reproduccion de señal acustica y medio de grabacion susceptible de ser leido en computadora.
MX375543B (es) 2014-04-11 2025-03-06 Samsung Electronics Co Ltd Metodo y aparato para emitir una señal sonora, y medio de grabacion legible en computadora.
BR112018008504B1 (pt) * 2015-10-26 2022-10-25 Fraunhofer - Gesellschaft Zur Förderung Der Angewandten Forschung E.V Aparelho para gerar um sinal de áudio filtrado e seu método, sistema e método para fornecer informações de modificação de direção
US20170325043A1 (en) 2016-05-06 2017-11-09 Jean-Marc Jot Immersive audio reproduction systems
US10979844B2 (en) * 2017-03-08 2021-04-13 Dts, Inc. Distributed audio virtualization systems
KR102409376B1 (ko) * 2017-08-09 2022-06-15 삼성전자주식회사 디스플레이 장치 및 그 제어 방법
JP7039985B2 (ja) * 2017-12-15 2022-03-23 ヤマハ株式会社 ミキサ、ミキサの制御方法およびプログラム
US11159905B2 (en) * 2018-03-30 2021-10-26 Sony Corporation Signal processing apparatus and method
CN114531640A (zh) 2018-12-29 2022-05-24 华为技术有限公司 一种音频信号处理方法及装置
JP7199601B2 (ja) * 2020-04-09 2023-01-05 三菱電機株式会社 音声信号処理装置及び音声信号処理方法、並びにプログラム及び記録媒体
US11373662B2 (en) * 2020-11-03 2022-06-28 Bose Corporation Audio system height channel up-mixing
US11595775B2 (en) * 2021-04-06 2023-02-28 Meta Platforms Technologies, Llc Discrete binaural spatialization of sound sources on two audio channels
GB2605970B (en) * 2021-04-19 2023-08-30 Waves Audio Ltd Content based spatial remixing
CN113645531B (zh) * 2021-08-05 2024-04-16 高敬源 一种耳机虚拟空间声回放方法、装置、存储介质及耳机
CN114143699B (zh) * 2021-10-29 2023-11-10 北京奇艺世纪科技有限公司 一种音频信号处理方法、装置及计算机可读存储介质
KR20240116852A (ko) * 2021-12-20 2024-07-30 돌비 레버러토리즈 라이쎈싱 코오포레이션 몰입형 오디오의 재생을 위해 오디오를 처리하는 방법

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040151476A1 (en) * 2003-02-03 2004-08-05 Denon, Ltd. Multichannel reproducing apparatus
US20050078833A1 (en) * 2003-10-10 2005-04-14 Hess Wolfgang Georg System for determining the position of a sound source
US20070133813A1 (en) * 2004-02-18 2007-06-14 Yamaha Corporation Sound reproducing apparatus and method of identifying positions of speakers
US20080031462A1 (en) * 2006-08-07 2008-02-07 Creative Technology Ltd Spatial audio enhancement processing method and apparatus
US20090092259A1 (en) * 2006-05-17 2009-04-09 Creative Technology Ltd Phase-Amplitude 3-D Stereo Encoder and Decoder
US20090110204A1 (en) * 2006-05-17 2009-04-30 Creative Technology Ltd Distributed Spatial Audio Decoder
US20110222693A1 (en) * 2010-03-11 2011-09-15 Samsung Electronics Co., Ltd. Apparatus, method and computer-readable medium producing vertical direction virtual channel
US20120008789A1 (en) * 2010-07-07 2012-01-12 Korea Advanced Institute Of Science And Technology 3d sound reproducing method and apparatus
US20120250869A1 (en) * 2011-03-30 2012-10-04 Yamaha Corporation Sound Image Localization Control Apparatus
US20150271622A1 (en) * 2012-09-24 2015-09-24 Martin Dausel Method for controlling a three-dimensional multi-layer speaker arrangement and apparatus for playing back three-dimensional sound in an audience area

Family Cites Families (34)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR0123755B1 (ko) * 1993-08-19 1997-12-01 김광호 음성신호 송수신시스템
GB2374772B (en) * 2001-01-29 2004-12-29 Hewlett Packard Co Audio user interface
JP4581831B2 (ja) * 2005-05-16 2010-11-17 ソニー株式会社 音響装置、音響調整方法および音響調整プログラム
EP1899958B1 (en) * 2005-05-26 2013-08-07 LG Electronics Inc. Method and apparatus for decoding an audio signal
KR101370365B1 (ko) * 2005-09-13 2014-03-05 코닌클리케 필립스 엔.브이. 3ｄ 사운드를 발생시키기 위한 방법 및 디바이스
KR101366291B1 (ko) * 2006-01-19 2014-02-21 엘지전자 주식회사 신호 디코딩 방법 및 장치
US7876904B2 (en) * 2006-07-08 2011-01-25 Nokia Corporation Dynamic decoding of binaural audio signals
DE102006053919A1 (de) * 2006-10-11 2008-04-17 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Vorrichtung und Verfahren zum Erzeugen einer Anzahl von Lautsprechersignalen für ein Lautsprecher-Array, das einen Wiedergaberaum definiert
RU2406165C2 (ru) * 2007-02-14 2010-12-10 ЭлДжи ЭЛЕКТРОНИКС ИНК. Способы и устройства для кодирования и декодирования объектно-базированных аудиосигналов
EP3712888B1 (en) 2007-03-30 2024-05-08 Electronics and Telecommunications Research Institute Apparatus and method for coding and decoding multi object audio signal with multi channel
WO2009093867A2 (en) 2008-01-23 2009-07-30 Lg Electronics Inc. A method and an apparatus for processing audio signal
KR101024924B1 (ko) * 2008-01-23 2011-03-31 엘지전자 주식회사 오디오 신호의 처리 방법 및 이의 장치
US8699742B2 (en) * 2008-02-11 2014-04-15 Bone Tone Communications Ltd. Sound system and a method for providing sound
PL2154677T3 (pl) * 2008-08-13 2013-12-31 Fraunhofer Ges Forschung Urządzenie do wyznaczania konwertowanego przestrzennego sygnału audio
EP2351384A1 (en) * 2008-10-14 2011-08-03 Widex A/S Method of rendering binaural stereo in a hearing aid system and a hearing aid system
US8000485B2 (en) * 2009-06-01 2011-08-16 Dts, Inc. Virtual audio processing for loudspeaker or headphone playback
EP2486737B1 (en) * 2009-10-05 2016-05-11 Harman International Industries, Incorporated System for spatial extraction of audio signals
KR101567461B1 (ko) * 2009-11-16 2015-11-09 삼성전자주식회사 다채널 사운드 신호 생성 장치
FR2955996B1 (fr) * 2010-02-04 2012-04-06 Goldmund Monaco Sam Methode pour creer un environnement audio avec n haut-parleurs
JP5417227B2 (ja) * 2010-03-12 2014-02-12 日本放送協会 マルチチャンネル音響信号のダウンミックス装置及びプログラム
JP5533248B2 (ja) * 2010-05-20 2014-06-25 ソニー株式会社 音声信号処理装置および音声信号処理方法
WO2012002768A2 (ko) * 2010-07-01 2012-01-05 엘지전자 주식회사 오디오 신호 처리 방법 및 장치
US9154897B2 (en) * 2011-01-04 2015-10-06 Dts Llc Immersive audio rendering system
WO2013006330A2 (en) 2011-07-01 2013-01-10 Dolby Laboratories Licensing Corporation System and tools for enhanced 3d audio authoring and rendering
WO2013064943A1 (en) * 2011-11-01 2013-05-10 Koninklijke Philips Electronics N.V. Spatial sound rendering system and method
KR101651419B1 (ko) * 2012-03-23 2016-08-26 돌비 레버러토리즈 라이쎈싱 코오포레이션 머리 전달 함수들의 선형 믹싱에 의한 머리 전달 함수 생성을 위한 방법 및 시스템
JP5843705B2 (ja) * 2012-06-19 2016-01-13 シャープ株式会社 音声制御装置、音声再生装置、テレビジョン受像機、音声制御方法、プログラム、および記録媒体
KR102201713B1 (ko) * 2012-07-19 2021-01-12 돌비 인터네셔널 에이비 다채널 오디오 신호들의 렌더링을 향상시키기 위한 방법 및 디바이스
JP6045696B2 (ja) 2012-07-31 2016-12-14 インテレクチュアル ディスカバリー シーオー エルティディＩｎｔｅｌｌｅｃｔｕａｌ Ｄｉｓｃｏｖｅｒｙ Ｃｏ．，Ｌｔｄ． オーディオ信号処理方法および装置
KR101815195B1 (ko) * 2013-03-29 2018-01-05 삼성전자주식회사 오디오 장치 및 이의 오디오 제공 방법
CN105637901B (zh) * 2013-10-07 2018-01-23 杜比实验室特许公司 空间音频处理系统和方法
KR102231755B1 (ko) 2013-10-25 2021-03-24 삼성전자주식회사 입체 음향 재생 방법 및 장치
MX357405B (es) 2014-03-24 2018-07-09 Samsung Electronics Co Ltd Metodo y aparato de reproduccion de señal acustica y medio de grabacion susceptible de ser leido en computadora.
EP4199544B1 (en) * 2014-03-28 2025-12-10 Samsung Electronics Co., Ltd. Method and apparatus for rendering acoustic signal

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040151476A1 (en) * 2003-02-03 2004-08-05 Denon, Ltd. Multichannel reproducing apparatus
US20050078833A1 (en) * 2003-10-10 2005-04-14 Hess Wolfgang Georg System for determining the position of a sound source
US20070133813A1 (en) * 2004-02-18 2007-06-14 Yamaha Corporation Sound reproducing apparatus and method of identifying positions of speakers
US20090092259A1 (en) * 2006-05-17 2009-04-09 Creative Technology Ltd Phase-Amplitude 3-D Stereo Encoder and Decoder
US20090110204A1 (en) * 2006-05-17 2009-04-30 Creative Technology Ltd Distributed Spatial Audio Decoder
US20080031462A1 (en) * 2006-08-07 2008-02-07 Creative Technology Ltd Spatial audio enhancement processing method and apparatus
US20110222693A1 (en) * 2010-03-11 2011-09-15 Samsung Electronics Co., Ltd. Apparatus, method and computer-readable medium producing vertical direction virtual channel
US20120008789A1 (en) * 2010-07-07 2012-01-12 Korea Advanced Institute Of Science And Technology 3d sound reproducing method and apparatus
US20120250869A1 (en) * 2011-03-30 2012-10-04 Yamaha Corporation Sound Image Localization Control Apparatus
US20150271622A1 (en) * 2012-09-24 2015-09-24 Martin Dausel Method for controlling a three-dimensional multi-layer speaker arrangement and apparatus for playing back three-dimensional sound in an audience area

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10484810B2 (en) 2014-06-26 2019-11-19 Samsung Electronics Co., Ltd. Method and device for rendering acoustic signal, and computer-readable recording medium
US11006210B2 (en) 2017-11-29 2021-05-11 Samsung Electronics Co., Ltd. Apparatus and method for outputting audio signal, and display apparatus using the same
US11477595B2 (en) * 2018-04-10 2022-10-18 Sony Corporation Audio processing device and audio processing method
US11290821B2 (en) 2018-08-09 2022-03-29 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Audio processor and a method considering acoustic obstacles and providing loudspeaker signals
US11671757B2 (en) 2018-08-09 2023-06-06 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Audio processor and a method considering acoustic obstacles and providing loudspeaker signals
US12309562B2 (en) 2018-08-09 2025-05-20 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Audio processor and a method for providing loudspeaker signals
US20250088820A1 (en) * 2021-07-30 2025-03-13 Areal Bv Audio Signal Processing Method

Also Published As

Publication number Publication date
KR20160141765A (ko) 2016-12-09
KR102574480B1 (ko) 2023-09-04
RU2752600C2 (ru) 2021-07-29
CN113038355A (zh) 2021-06-25
RU2018101706A3 (ru) 2021-05-26
EP3125240A1 (en) 2017-02-01
KR102380231B1 (ko) 2022-03-29
AU2018200684A1 (en) 2018-02-15
MX2016012543A (es) 2016-12-14
KR102443054B1 (ko) 2022-09-14
JP2017513382A (ja) 2017-05-25
CA2943670C (en) 2021-02-02
CA3101903A1 (en) 2015-10-01
CA3101903C (en) 2023-03-21
MX357405B (es) 2018-07-09
WO2015147530A1 (ko) 2015-10-01
WO2015147532A3 (ko) 2017-05-18
CN106463124A (zh) 2017-02-22
KR20220041248A (ko) 2022-03-31
US20220322027A1 (en) 2022-10-06
WO2015147533A2 (ko) 2015-10-01
CN106463124B (zh) 2021-03-30
EP3125240A4 (en) 2017-11-29
EP3832645A1 (en) 2021-06-09
BR112016022042B1 (pt) 2022-09-27
AU2018200684B2 (en) 2019-08-01
JP6772231B2 (ja) 2020-10-21
WO2015147532A2 (ko) 2015-10-01
EP4604583A3 (en) 2025-11-19
CN113038355B (zh) 2022-12-16
AU2015234454B2 (en) 2017-11-02
US20220322026A1 (en) 2022-10-06
WO2015147533A3 (ko) 2017-05-18
JP2019033506A (ja) 2019-02-28
EP4604583A2 (en) 2025-08-20
JP6674902B2 (ja) 2020-04-01
AU2015234454A1 (en) 2016-10-27
US12035129B2 (en) 2024-07-09
MX375544B (es) 2025-03-06
EP3125240B1 (en) 2021-05-05
US12035130B2 (en) 2024-07-09
RU2018101706A (ru) 2019-02-21
RU2643630C1 (ru) 2018-02-02
CA3188561A1 (en) 2015-10-01
BR112016022042A2 (ru) 2017-08-15
CA2943670A1 (en) 2015-10-01
KR20220129104A (ko) 2022-09-22

Similar Documents

Publication Publication Date Title
US12035130B2 (en) Method and apparatus for rendering acoustic signal, and computer-readable recording medium
KR102423757B1 (ko) 음향 신호의 렌더링 방법, 장치 및 컴퓨터 판독 가능한 기록 매체

Legal Events

Date Code Title Description
AS Assignment

Owner name: SAMSUNG ELECTRONICS CO., LTD., KOREA, REPUBLIC OF

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:CHON, SANG-BAE;KIM, SUN-MIN;JO, HYUN;REEL/FRAME:039857/0513

Effective date: 20160923

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STCV Information on status: appeal procedure

Free format text: EXAMINER'S ANSWER TO APPEAL BRIEF MAILED

STCV Information on status: appeal procedure

Free format text: ON APPEAL -- AWAITING DECISION BY THE BOARD OF APPEALS

STCV Information on status: appeal procedure

Free format text: BOARD OF APPEALS DECISION RENDERED

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION