EP2080411B1 - Device and method for generating a number of loudspeaker signals for a loudspeaker array which defines a reproduction area - Google Patents
Device and method for generating a number of loudspeaker signals for a loudspeaker array which defines a reproduction area Download PDFInfo
- Publication number
- EP2080411B1 EP2080411B1 EP07818894A EP07818894A EP2080411B1 EP 2080411 B1 EP2080411 B1 EP 2080411B1 EP 07818894 A EP07818894 A EP 07818894A EP 07818894 A EP07818894 A EP 07818894A EP 2080411 B1 EP2080411 B1 EP 2080411B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- loudspeaker
- virtual
- signals
- positions
- prestage
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S3/00—Systems employing more than two channels, e.g. quadraphonic
- H04S3/008—Systems employing more than two channels, e.g. quadraphonic in which the audio signals are in digital form, i.e. employing more than two discrete digital channels
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
- H04S2420/11—Application of ambisonics in stereophonic audio systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
- H04S2420/13—Application of wave-field synthesis in stereophonic audio systems
Definitions
- the present invention relates to the reproduction of spatial audio signals, such as occur in the playback of film material, concerts or in the field of computer and video games.
- wave field synthesis In the field of spatial audio transmission in the prior art, several methods are known, including, for example, the wave field synthesis, the basic idea is based on the Huygen principle, according to which every point that is detected by a wave is the starting point of an elementary wave, which is spherical or spreads circularly. Wavefield synthesis is applied in acoustics based on a large number of loudspeakers arranged side by side, a so-called loudspeaker array, and is in principle able to emulate any form of incoming wavefront.
- the audio signals of each loudspeaker can be filtered with a time delay and amplitude scaling so that a corresponding spatial impression results for a listener, with the radiated sound fields of the individual loudspeakers correspondingly overlap. If several sound sources are available, the contribution to each loudspeaker is calculated separately for each source and the resulting signals are added together. If the sources to be reproduced are located in a room with reflective walls, it may be possible to compensate for reflections via corresponding filters with the help of the loudspeaker array.
- Ambisonic Another known technique for spatial sound field reproduction is Ambisonic. This technique is based on a harmonic decomposition of the acoustic field along a spherical surface (3-D) or along a circumference (2-D). During playback, a finite number of these harmonic components are used to reproduce the original sound field at a point, the listening point. Depending on the number of harmonic components used (called order), the spatial extent of the area of optimal reconstruction of the sound field increases. In the simplest reasonable case (1st order), a sound information is encoded into four channels, which is also known under the synonym Ambisonic B format. A channel contains a mono signal of the sound information. The three other channels contain the spatial components of the three spatial dimensions.
- Ambisonic allows a spatial audio signal in the described four channels to disassemble, and reassemble accordingly.
- the signals refer to a reference point, which is arranged in the middle of a sphere, on the surface of which the corresponding loudspeakers are located.
- the representation of spatial audio signals according to the Ambisonic method thus offer a less complex possibility to store and reproduce spatial signals.
- a disadvantage of this technology is that the spatial resolution and thus the achievable impression of a room sound are limited.
- WFS reconstructs within a volume (or area) in a quality that depends on the effort implemented (e.g., LS distance).
- the signals refer to a reference point in which a listener is ideally located, what the supply a larger area, such as a cinema or a concert hall accordingly difficult.
- both the playback speakers with respect to the listening point and the virtual sound objects with respect to the playback speakers are located at a sufficiently distant distance, so that in any case even wavefronts can be assumed.
- DTS Digital Theater System
- DTS Digital Theater System
- Methods such as DTS, Dolby Surround can also be considered as encoding formats. This makes it possible to use audio signals suitable for 5.1 reproduction on e.g. save a DVD.
- variable delay values of a moving audio source give rise to Doppler artifacts.
- Wave field synthesis is dependent from the computational effort, which in turn depends on the number of virtual audio sources, the number of rendering channels, the source movements, the filtering method, the delay interpolation method and so on.
- the core idea of the present invention lies in recognizing that, for example with the help of wave field synthesis, a high spatial resolution can be achieved, which can be used to simulate static virtual sound waves.
- the static virtual sound waves can then be adapted to the respective audio format.
- the property of the virtual sound waves can be adjusted to the reproduction format so that the characteristics of point sources or plane waves can be used.
- a 5.1. Audio signal which is transmitted over five z. B. arranged on a circle speaker is reproduced by five simulated sound waves using a wave field synthesis, for example, a speaker array of one hundred speakers, emulated.
- a wave field synthesis for example, a speaker array of one hundred speakers, emulated.
- the advantages of wave field synthesis that is, the higher spatial resolution, and the advantages of other spatial audio signal processing methods, such as ambisonic, can be exploited.
- a plurality of mobile sources can now be reproduced via a wave field synthesis, whereby the computation outlay for the wave field synthesis can be kept constant since this only has to simulate static sources which are based on static filters.
- An advantage of the method according to the invention is also the selectable adaptation of the complexity of the necessary calculations to the resources available during the reproduction.
- FIG. 10 shows a device 100 for generating a number of speaker signals 102 for a loudspeaker array that defines a playback space.
- the apparatus 100 includes a pre-stage 110 configured to generate a plurality of output audio signals 116 using one or more input audio signals 112 associated with one or more virtual locations 114, each output audio signal 116 associated with a loudspeaker position 118 defined by the pre-stage 110, and wherein the pre-stage 110 is configured such that the plurality of output audio signals 116 together simulate a reproduction of the input audio signal (s) 112 at the virtual position (s) 114, and wherein a number of output audio signals 116 is less than a number of loudspeaker signals 102 for the loudspeaker array.
- the apparatus 100 further includes a main stage 120 configured to receive the plurality of output audio signals 116 and further as a virtual position for each output audio signal 116 to receive the loudspeaker positions 118 determined by the pre-stage 110, and wherein the main stage 120 is formed, to generate the number of speaker signals 102 for the speaker array such that the loudspeaker array replicates the loudspeaker positions 118 defined by the pre-stage 110 as a virtual source.
- a main stage 120 configured to receive the plurality of output audio signals 116 and further as a virtual position for each output audio signal 116 to receive the loudspeaker positions 118 determined by the pre-stage 110, and wherein the main stage 120 is formed, to generate the number of speaker signals 102 for the speaker array such that the loudspeaker array replicates the loudspeaker positions 118 defined by the pre-stage 110 as a virtual source.
- the main stage 120 is configured to generate the number of loudspeaker signals 102 and those generated by the pre-stage 110 fixed loudspeaker positions 118 by wave field synthesis.
- the loudspeaker array is controlled accordingly by the main stage 120.
- the defined loudspeaker positions 118 are thereby generated statically or in another embodiment semi-statically such that changes in position of the loudspeaker positions 118 occur less frequently or more slowly than changes in position of the virtual positions 114.
- the main stage 120 is configured to emulate a virtual speaker system that includes fewer speakers than the speaker array.
- the virtual speaker system can be emulated by point sources or by plane waves. If moving sources are to be simulated, this can be achieved by adapting the output audio signals 116 via the pre-stage 110, wherein the loudspeaker positions 118 can be left unchanged.
- Input audio signals 112 are conceivable in many formats in embodiments of the present invention.
- the input audio signals 112 are provided separately from their virtual positions 114 of the pre-stage.
- Pre-stage 110 via its input terminals, such as in the Fig. 1 the input audio signals 112 and the virtual positions 114, an image area in an audio format available.
- This image area is then imaged by the device 100 according to the invention into a real area that corresponds to the loudspeaker array and its loudspeaker signals 102.
- the pre-stage 110 converts the image area into an intermediate area, which can be mapped inexpensively from the main stage 120 into the real area.
- the inventive device 100 may be further configured to receive additional audio signals or additional locations that are also mapped to the loudspeaker signals 102 and the loudspeaker array, and whose format may differ from the format of the input audio signals 112.
- additional audio signals or additional locations that are also mapped to the loudspeaker signals 102 and the loudspeaker array, and whose format may differ from the format of the input audio signals 112.
- the loudspeaker array itself can be realized, for example, by a circular loudspeaker array.
- the main stage 120 may be designed to map the arbitrary shapes of loudspeaker arrays onto a virtual circle.
- Fig. 2 an embodiment of a movie theater or concert hall 200.
- a speaker array 210 is disposed on a circle 215.
- the speaker array 210 encloses an auditorium 220 in which the spectators are present during a performance.
- virtual sound waves 225 can now be generated via wave field synthesis.
- These virtual sound waves 225 can now be used at low cost, ie without increasing the computational requirements of wave field synthesis, in order to generate a spatial sound experience for a viewer in the auditorium 220.
- wave field synthesis is used as a rendering system with the known advantages.
- only static sources are represented with the aid of wave field synthesis, which results in the elimination of the disadvantages caused by swelling and, for example, by dynamic filters.
- the computational effort of the wave field synthesis is kept largely constant, if necessary, the number of virtual sources can be reduced.
- the wave field synthesis thus provides a constant virtual speaker system.
- a hybrid method for. As coding of movements in Ambisonic, 5.1, VBAP, etc., now moving sources can be realized via the virtual speaker system.
- a virtual sound source in the wave field synthesis represents a speaker of the virtual display device for the respective audio playback method into which the dynamic scene can be converted.
- These virtual speakers can be reproduced in wave field synthesis as point sources or even plane waves.
- an image area for example in the Ambisonic domain, can be scaled in the degree of representation.
- the movement of a sound source takes place in the virtual speaker system as a change in volume of the virtual speakers. If necessary, in one embodiment, the duration of an original source, for example, directly in the original area, or changed, as in Higher Order Ambisonic possible, even in the image area.
- the format of the audio scenes is not subject to any restrictions.
- a wave field synthesis scene could be made from e.g. B. Ambientic XMT SAW or in any other multi-channel audio playback method, such as 5.1. Characteristic of this hybrid method is a separation into two areas, the original and the image area. Synonymous with this is an independence in the scene creation or coding of the ultimately used speaker set-up.
- the following is a preferred conversion of WFS input data into Ambisonic data.
- the starting point is the XML format.
- the individual sound events are encoded as objects.
- the following information is contained in the object descriptions: Position of the .wav file with the audio signal of the source, existence period of the source, and movement information of the source (position of the source with time stamps).
- the coding then takes place as follows: The position (distance and angle of incidence) of the sound source are calculated accurately to the sample. This information can be used to directly calculate Ambisonic signals for simple Ambisonic and Ambisonic-WFS Hybrid. In ambisonic with near-field coding, the ambisonic weighting factors in the frequency domain are calculated. With a window length which allows a good reproduction quality, only a sudden movement of the source is possible. Window overlapping, however, can mitigate the effect. The Ambisonic-WFS hybrid method calculates the symmetry properties of Ambisonic for more efficient computation. When hybrid and near field coded Ambisonic is to be noted that the Ambisonics signals are valid for a circle with a given radius, since the near field effects of both the source and the speaker are included in the calculation.
- the Ambisonics signals from the hybrid and near-field coded method can also be used directly. If the display does not exactly match, there are two possibilities: The near field effects of the speakers are considered exactly. This takes into account the near-field effect already assumed during decoding. However, this method is expensive.
- the second possibility is an approximate solution.
- the signals of the loudspeakers are delayed and amplified according to their distance from the center of the circle. Simulations have shown that this approach provides results comparable to the first (exact) approach.
- the prerequisite is that the radius of the loudspeaker assumed in the coding is on the order of magnitude of the radii of the playback loudspeakers (best mean value).
- FIG. 4 A preferred arrangement of the circle is in Fig. 4 shown. If you set the radius so that sources are within the radius, so you would attenuate the signals according to their distance from the center and "accelerate" compared to the other speakers, which z. B. can be achieved by delaying all other speaker signals, so that the one non-delayed speaker is accelerated compared to the other speakers.
- the pre-stage 110 is preferably configured to change the position of the moved virtual positions 114 by matching the output audio signals 116 and leaving the speaker positions 118 unchanged, the adaptation comprising delaying or amplifying a component component signal originating from a virtual source corresponding to a distance of a virtual source from an imaginary circle center on which the speaker positions are placeable.
- the loudspeaker component signals for the moving virtual sources be added after the respective delay or gain to produce a matched output audio signal.
- changing the position of a source away from one loudspeaker and towards another loudspeaker causes the component signal of the source for the loudspeaker from which the source has been moved to be delayed and somewhat attenuated depending on the amount of change in position becomes.
- the component signal of the loudspeaker to which the source has been moved may be delayed negatively and somewhat amplified depending on the displacement of the position change. If a negative delay is not possible, the signal can not be changed, but all other signals, so that effectively a negative delay or "acceleration" of the one signal with respect to the other signals is achieved.
- Embodiments of the present invention may also use non-circular or irregular speaker assemblies.
- the signals are prefiltered according to their reproduction position, ie, their amplitude and phase and sound spectrum are changed in such a way that the distance of a loudspeaker from a virtual circle is compensated.
- irregular loudspeaker arrangements are restored to a virtual circular loudspeaker arrangement displayed.
- Fig. 2 also clarified.
- embodiments of the present invention may map these non-regular speakers to a virtual circle 215 by scaling the corresponding signals in amplitude, and whose delay is adjusted.
- embodiments of the present invention offer the possibility of adapting the ideal listening area. This possibility is given indirectly by the virtual sound sources, which in another embodiment are adaptable or semi-static.
- FIG. 12 shows an original area 300, an image area 310, and a wave field synthesis rendering 320.
- the original area 300 there is, for example, a stereo signal or a signal in any other spatial audio format.
- This signal can now be converted into an image area, whereby the order of the image area is scalable according to the audio format.
- the image area 310 could be, for example, an ambisonic signal.
- the image area 310 is based on the Fig. 1 provided by the pre-stage 110. From the image area 310 is adapted to a speaker setup, which also irregular speaker setups are taken into account, there is a hybridization of the audio signal.
- Wave field synthesis playback 320 in FIG Fig. 3 corresponds to the main level 120 of Fig. 1 and finally maps the image area into a real area, namely loudspeaker signals for a loudspeaker array.
- the complexity that is, the computational effort required for wave field synthesis, can thus be finite Number of static filters are restricted.
- many problems of wave field synthesis with respect to moving sound waves can be solved, such as the occurrence of Doppler artifacts and temporal interpolation artifacts.
- the computational effort of the wave field synthesis can thus be kept almost constant and much lower than comparable wave field synthesis rendering.
- the signals of the original range could be made, for example, from the direction coding according to the classical Ambisonic theory and a distance-dependent coding.
- Distance coding can be done by filtering the ambisonic signals of the individual orders. Near-field effects of the loudspeaker array loudspeakers as well as the coded sound sources can be combined, so that the resulting ambisonic signals can be kept limited.
- the filters used for wave field synthesis depend both on the frequency of the input signal and on the distance between the loudspeakers and the reproduced sound source. The filtering can be done in the frequency domain, with variable distance, a sliding windowing in the time domain can be made, the filter can be adjusted according to a different distance.
- a calculation of the near-field-coded ambisonic signals by the hybrid approach provides a filter in the time domain, which is automatically valid for all frequencies.
- the consideration of different distances of the reproduced sound sources, ie the virtual sound sources is easily possible.
- Rotational matrices for Ambisonic can also be exploited to reduce the computational burden. The computational effort can then be reduced to a quarter, the two-dimensional case, or to an eighth, in the three-dimensional case, the cost of the direct calculation.
- Embodiments of the present invention thus offer the advantage that the computational effort of spatial audio signals can be significantly reduced, and an adaptive system is realized.
- the inventive scheme can also be implemented in software.
- the implementation may be on a digital storage medium, in particular a floppy disk or a CD with electronically readable control signals, which may cooperate with a programmable computer system such that the corresponding method is executed.
- the invention thus also consists in a computer program product with program code stored on a machine-readable carrier for carrying out the method according to the invention when the computer program product runs on a computer.
- the invention can thus be realized as a computer program with a program code for carrying out the method when the computer program product runs on a computer.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Stereophonic System (AREA)
- Circuit For Audible Band Transducer (AREA)
- Stereophonic Arrangements (AREA)
- Obtaining Desirable Characteristics In Audible-Bandwidth Transducers (AREA)
Abstract
Description
Die vorliegende Erfindung bezieht sich auf die Wiedergabe von räumlichen Audiosignalen, wie sie beispielsweise bei der Wiedergabe von Filmmaterial, Konzerten oder auch im Bereich der Computer- und Videospiele vorkommen.The present invention relates to the reproduction of spatial audio signals, such as occur in the playback of film material, concerts or in the field of computer and video games.
Im Bereich der räumlichen Audiowidergabe sind im Stand der Technik mehrere Verfahren bekannt, darunter beispielsweise die Wellenfeldsynthese, deren Grundidee auf dem Huygen'schen Prinzip basiert, wonach jeder Punkt, der von einer Welle erfasst wird, Ausgangspunkt einer Elementarwelle ist, die sich kugelförmig bzw. kreisförmig ausbreitet. Die Wellenfeldsynthese wird in der Akustik, basierend auf einer großen Anzahl von Lautsprechern, die nebeneinander angeordnet sind, einem sog. Lautsprecher-Array, angewendet, und ist prinzipiell in der Lage, jede beliebige Form einer einlaufenden Wellenfront nachzubilden. Im einfachsten Fall, einer einzelnen wiederzugebenden Punktquelle und einer linearen Anordnung der Lautsprecher, können die Audiosignale eines jeden Lautsprechers mit einer Zeitverzögerung und Amplitudenskalierung so gefiltert werden, dass sich ein entsprechender räumlicher Eindruck für einen Hörer ergibt, wobei die abgestrahlten Klangfelder der einzelnen Lautsprecher sich entsprechend überlagern. Sind mehrere Schallquellen vorhanden, wird für jede Quelle der Beitrag zu jedem Lautsprecher getrennt berechnet und die resultierenden Signale addiert. Befinden sich die wiederzugebenden Quellen in einem Raum mit reflektierenden Wänden, so können unter Umständen auch Reflexionen über entsprechende Filter mit Hilfe des Lautsprecher-Arrays kompensiert werden.In the field of spatial audio transmission in the prior art, several methods are known, including, for example, the wave field synthesis, the basic idea is based on the Huygen principle, according to which every point that is detected by a wave is the starting point of an elementary wave, which is spherical or spreads circularly. Wavefield synthesis is applied in acoustics based on a large number of loudspeakers arranged side by side, a so-called loudspeaker array, and is in principle able to emulate any form of incoming wavefront. In the simplest case, a single point source to be reproduced and a linear arrangement of the loudspeakers, the audio signals of each loudspeaker can be filtered with a time delay and amplitude scaling so that a corresponding spatial impression results for a listener, with the radiated sound fields of the individual loudspeakers correspondingly overlap. If several sound sources are available, the contribution to each loudspeaker is calculated separately for each source and the resulting signals are added together. If the sources to be reproduced are located in a room with reflective walls, it may be possible to compensate for reflections via corresponding filters with the help of the loudspeaker array.
Der Aufwand bei der Berechnung einer Wellenfeldsynthese hängt stark von der Anzahl der wiederzugebenden Schallquellen, den Reflexionseigenschaften eines Wiedergaberaumes und der Anzahl der Lautsprecher ab. Die Möglichkeiten der Wellenfeldsynthese können umso besser ausgeschöpft werden, je größer die Lautsprecher-Arrays sind, d. h. umso mehr einzelne Lautsprecher bereitgestellt werden. Nachteilig ist dabei jedoch, dass die erforderliche Rechenleistung mit der Anzahl der verwendeten Einzellautsprecher steigt. Für jede virtuelle Schallquelle, d.h. wiederzugebende Schallquelle, muss für jeden einzelnen Lautsprecher des Lautsprecher-Arrays ein entsprechendes Signal berechnet und übertragen werden. Insbesondere bei sich bewegenden virtuellen Quellen steigt der Rechenwand immens, so dass konventionelle Systeme durch die Darstellung bewegter Klangwellen sehr schnell an ihre Grenzen stoßen, wobei der limitierende Faktor die Rechenleistung ist.The effort involved in calculating a wave field synthesis depends heavily on the number of sound sources to be reproduced, the reflection characteristics of a playback room, and the number of speakers. The possibilities of wave field synthesis can be better exploited the larger the speaker arrays are, ie. H. the more individual speakers are provided. The disadvantage here, however, that the required computing power increases with the number of individual speakers used. For each virtual sound source, i. To be reproduced sound source, a corresponding signal must be calculated and transmitted for each speaker of the speaker array. Particularly in the case of moving virtual sources, the arithmetic wall rises immensely, so that conventional systems very quickly reach their limits by displaying moving sound waves, the limiting factor being the computing power.
Eine weitere bekannte Technik zur räumlichen Schallfeldreproduktion ist Ambisonic. Diese Technik basiert auf einer harmonischen Zerlegung des akustischen Feldes entlang einer Kugeloberfläche (3-D) oder entlang eines Kreisumfangs (2-D). Bei der Wiedergabe wird eine endliche Anzahl dieser harmonischen Anteile zur Reproduktion des originalen Schallfeldes an einem Punkt, dem Abhörpunkt, verwendet. Abhängig von der Anzahl der verwendeten harmonischen Anteile (genannt Ordnung) vergrößert sich die räumliche Ausdehnung des Gebietes der optimalen Rekonstruktion des Schallfeldes. Im einfachsten sinnvollen Fall (1. Ordnung) wird hierbei eine Toninformation in vier Kanäle codiert, was auch unter dem Synonym Ambisonic B-Format bekannt ist. Ein Kanal enthält dabei ein Monosignal der Toninformation. Die drei anderen Kanäle enthalten die räumlichen Komponenten der drei räumlichen Dimensionen. Diese drei Signale basieren auf einer harmonischen Zerlegung des akustischen Feldes entlang einer Kugeloberfläche und spiegeln die instantane Druckverteilung der Tonwellen wieder. Dieser Fall ist auch der kommerziell nutzbarste Fall. Weil die vier Signale ursprünglich als Konkurrenz zur Quadrofonie auf Schallplatte Platz finden mussten. Derzeit arbeitet man an der Ausarbeitung einer Spezifikation, die das Medium DVD benutzt und dementsprechend mehr Kanäle zulässt.Another known technique for spatial sound field reproduction is Ambisonic. This technique is based on a harmonic decomposition of the acoustic field along a spherical surface (3-D) or along a circumference (2-D). During playback, a finite number of these harmonic components are used to reproduce the original sound field at a point, the listening point. Depending on the number of harmonic components used (called order), the spatial extent of the area of optimal reconstruction of the sound field increases. In the simplest reasonable case (1st order), a sound information is encoded into four channels, which is also known under the synonym Ambisonic B format. A channel contains a mono signal of the sound information. The three other channels contain the spatial components of the three spatial dimensions. These three signals are based on a harmonic decomposition of the acoustic field along a spherical surface and reflect the instantaneous pressure distribution of the sound waves. This case is also the most commercially viable case. Because the four signals originally as a competitor to Quadrofonie on record had to find space. Currently working on a specification that uses the medium of DVD and therefore allows more channels.
Ambisonic erlaubt ein räumliches Audiosignal in die beschriebenen vier Kanäle zu zerlegen, und entsprechend wieder zusammenzusetzen. Die Signale beziehen sich dabei auf einen Referenzpunkt, der inmitten einer Kugel angeordnet ist, auf deren Oberfläche sich die entsprechenden Lautsprecher befinden. Die Darstellung von räumlichen Audiosignalen nach der Ambisonic-Methode bieten demnach eine weniger komplexe Möglichkeit, räumliche Signale zu speichern und wiederzugeben. Nachteilig an dieser Technologie ist jedoch, dass die räumliche Auflösung und damit der erzielbare Eindruck eines Raumklangs begrenzt sind.Ambisonic allows a spatial audio signal in the described four channels to disassemble, and reassemble accordingly. The signals refer to a reference point, which is arranged in the middle of a sphere, on the surface of which the corresponding loudspeakers are located. The representation of spatial audio signals according to the Ambisonic method thus offer a less complex possibility to store and reproduce spatial signals. A disadvantage of this technology, however, is that the spatial resolution and thus the achievable impression of a room sound are limited.
Mit zunehmender Ambisonic-Ordnung lassen sich zwar qualitativ ähnliche Ergebnisse erzielen, wie mit WFS. Allerdings steigt damit auch die Komplexität stark an, und es gibt kein Mikrofon, dass die Richtcharakteristik dieser höheren Harmonischen besitzt. Hier müssen dann ausgeklügelte Mic-Arrays verwendet werdenWith increasing ambisonic order, it is possible to achieve qualitatively similar results as with WFS. However, this increases the complexity and there is no microphone that has the directional characteristic of these higher harmonics. Sophisticated mic arrays must be used here
WFS rekonstruiert innerhalb eines Volumens (oder Fläche) und das in einer Qualität, die vom implementierten Aufwand (z.B. LS-Abstand) abhängig ist.WFS reconstructs within a volume (or area) in a quality that depends on the effort implemented (e.g., LS distance).
Ambisonic rekonstruiert zwar exakt, aber von einem Punkt ausgehend und nur für sehr hohe Ordnungen auf einer vergleichbar großen Fläche wie WFS.Although Ambisonic reconstructs exactly, but starting from one point and only for very high orders on a surface as large as WFS.
Beide Verfahren haben aber eine gemeinsame Theoretische Basis, die Holophonie.Both methods have a common theoretical basis, holophony.
Die Signale beziehen sich auf einen Referenzpunkt, indem sich ein Hörer idealerweise befindet, was die Versorgung einer größeren Fläche, wie beispielsweise eines Kinos oder einer Konzerthalle entsprechend erschwert.The signals refer to a reference point in which a listener is ideally located, what the supply a larger area, such as a cinema or a concert hall accordingly difficult.
Ferner ist es eine Vorraussetzung, dass sich sowohl die Wiedergabelautsprecher bezüglich des Abhörpunktes als auch die virtuellen Klangobjekte bezüglich der Wiedergabelautsprecher in ausreichend weiter Entfernung befinden, sodass in jedem Fall ebene Wellenfronten angenommen werden können.Furthermore, it is a prerequisite that both the playback speakers with respect to the listening point and the virtual sound objects with respect to the playback speakers are located at a sufficiently distant distance, so that in any case even wavefronts can be assumed.
Ferner sind aus der Technologie weitere Methoden zur Darstellung räumlicher Tonquellen bekannt. Beispielsweise DTS (DTS = Digital Theatre System) ist ein digitales Mehrkanal-Surroundsoundformat.Furthermore, other methods for displaying spatial sound sources are known from technology. For example, DTS (Digital Theater System) is a multi-channel digital surround sound format.
Verfahren wie DTS, Dolby Surround, kann man auch als Kodierungsformate betrachten. Damit kann man Audiosignale, die für die 5.1-Wiedergabe geeignet sind auf z.B. einer DVD speichern.Methods such as DTS, Dolby Surround, can also be considered as encoding formats. This makes it possible to use audio signals suitable for 5.1 reproduction on e.g. save a DVD.
Es kommt sowohl in Filmtheatern als auch auf Datenträgern, wie beispielsweise DVDs zum Einsatz. Die Wiedergabe erfolgt dabei idealerweise über kreisförmig angeordnete Lautsprecher, in deren Mitte sich ein für die räumliche Klangwiedergabe günstiger Wiedergaberaum befindet, der auch "sweet area" genannt wird. Eine weitere Gruppe von räumlichen Klangsignalen stellen die Dolby Digital-Signale dar, die in mehreren Varianten verfügbar sind. Abgesehen von der Wellenfeldsynthese haben viele Audioformate den Nachteil, dass nur eine sehr begrenzte räumliche Auflösung und damit auch ein begrenzter räumlicher Klangeffekt erzielt werden kann. Die Wellenfeldsynthese selbst bietet zwar die räumliche Auflösung, jedoch ist diese gerade im Falle von mehreren bewegten virtuellen Tonquellen aufgrund limitierter Rechenleistung nicht zu erzielen, wenn z. B. für Consumer-Anwendungen auch Kostenargumente im Hinblick auf die verfügbare Rechenleistung eine Rolle spielen. Ferner entstehen durch die variablen Verzögerungswerte einer bewegten Audioquelle Dopplerartefakte. Die Wellenfeldsynthese ist abhängig von dem Rechenaufwand, der wiederum von der Anzahl der virtuellen Audioquellen, der Anzahl der Renderingkanäle, den Quellbewegungen, den Filterverfahren, den Verzögerungsinterpolationsverfahren usw. abhängt.It is used both in movie theaters and on data carriers, such as DVDs. The reproduction ideally takes place via circularly arranged loudspeakers, in the middle of which there is a reproduction room that is more favorable for the spatial reproduction of sound, which is also called "sweet area". Another group of spatial sound signals is the Dolby Digital signals, which are available in several variants. Apart from the wave field synthesis, many audio formats have the disadvantage that only a very limited spatial resolution and thus a limited spatial sound effect can be achieved. Although the wave field synthesis itself provides the spatial resolution, but this is just in the case of multiple moving virtual sound sources due to limited computing power can not be achieved if z. For example, for consumer applications, cost arguments also play a role with regard to the available computing power. Furthermore, the variable delay values of a moving audio source give rise to Doppler artifacts. Wave field synthesis is dependent from the computational effort, which in turn depends on the number of virtual audio sources, the number of rendering channels, the source movements, the filtering method, the delay interpolation method and so on.
Hinsichtlich der Signalverarbeitung von Ambisonic-Surround-Signalen liefert Jerome Daniel, "Further Study of Sound Field Coding with Higher Order Ambisonics" presented at the AES 116 th Convention, Berlin 2004 einen guten Überblick. Eine Beurteilung der Qualität der Schallfeldreproduktion durch Ambisonic kann in Martin Dewhirst, Slawomir Zielinski, Philip Jackson, Francis Rumsey: "Objective Assessment of Spatial Localisation Attributes of Surround-Sound Reproduction Systems", presented at the AES 118th Convention, Barcelona 2005 gefunden werden. Alois Sontacchi, Robert Höldrich, "Further Investigations on 3D Sound Fields using distance coding", presented at the Proceedings of the COST G-6 Conference on Digital Audio Effects, Limerick 2001 beschäftigt sich mit der Speicherung von räumlichen Audiosignalen. Die
Es ist die Aufgabe der vorliegenden Erfindung, eine Vorrichtung und ein Verfahren zu schaffen, um räumliche Audiosignale effizienter und mit besserer räumlicher Auflösung wiederzugeben.It is the object of the present invention to provide an apparatus and a method for reproducing spatial audio signals more efficiently and with better spatial resolution.
Diese Aufgabe wird gelöst durch eine Vorrichtung gemäß Anspruch 1, ein Verfahren gemäß Anspruch 17, oder ein Computerprogramm gemäß Anspruch 18.This object is achieved by a device according to claim 1, a method according to claim 17, or a computer program according to claim 18.
Der Kerngedanke der vorliegenden Erfindung liegt in der Erkenntnis, dass beispielsweise mit Hilfe der Wellenfeldsynthese eine hohe räumliche Auflösung erzielt werden kann, die genutzt werden kann, um statische virtuelle Klangwellen zu simulieren. Die statischen virtuellen Klangwellen können dann wiederum an das jeweilige Audioformat angepasst werden.The core idea of the present invention lies in recognizing that, for example with the help of wave field synthesis, a high spatial resolution can be achieved, which can be used to simulate static virtual sound waves. The static virtual sound waves can then be adapted to the respective audio format.
Bevorzugterweise kann auch die Eigenschaft der virtuellen Klangwellen auf das Wiedergabeformat angepasst werden, so daß die Charakteristika von Punktquellen oder ebenen Wellen verwendet werden können.It is also preferable that the property of the virtual sound waves can be adjusted to the reproduction format so that the characteristics of point sources or plane waves can be used.
Beispielsweise kann ein 5.1. Audiosignal, das über fünf z. B. auf einem Kreis angeordnete Lautsprecher wiedergegeben wird, durch fünf simulierte Klangwellen mit Hilfe einer Wellenfeldsynthese, die beispielsweise ein Lautsprecher-Array von hundert Lautsprechern bedient, emuliert werden. Auf diese Weise können die Vorteile der Wellenfeldsynthese, das heißt, die höhere räumliche Auflösung, und die Vorteile anderer räumlicher Audiosignalverarbeitungsverfahren, wie beispielsweise Ambisonic genutzt werden. Mit dem erfindungsgemäßen Verfahren können demnach über eine Wellenfeldsynthese nun auch mehrere bewegliche Quellen wiedergegeben werden, wobei der Rechenaufwand für die Wellenfeldsynthese konstant gehalten werden kann, da diese lediglich statische Quellen simulieren muss, die auf statische Filter zurückgehen.For example, a 5.1. Audio signal, which is transmitted over five z. B. arranged on a circle speaker is reproduced by five simulated sound waves using a wave field synthesis, for example, a speaker array of one hundred speakers, emulated. In this way, the advantages of wave field synthesis, that is, the higher spatial resolution, and the advantages of other spatial audio signal processing methods, such as ambisonic, can be exploited. Accordingly, with the method according to the invention, a plurality of mobile sources can now be reproduced via a wave field synthesis, whereby the computation outlay for the wave field synthesis can be kept constant since this only has to simulate static sources which are based on static filters.
Ein Vorteil des erfindungsgemäßen Verfahrens ist auch die wählbare Anpassung der Komplexität der notwendigen Berechnungen auf die bei der Wiedergabe zur Verfügung stehenden Ressourcen.An advantage of the method according to the invention is also the selectable adaptation of the complexity of the necessary calculations to the resources available during the reproduction.
Ausführungsbeispiele der vorliegenden Erfindung werden im Folgenden anhand der beigefügten Figuren näher erläutert. Es zeigen:
- Fig. 1
- ein Ausführungsbeispiel der vorliegenden Erfindung;
- Fig. 2
- ein weiteres Ausführungsbeispiel der vorliegenden Erfindung;
- Fig. 3
- eine Veranschaulichung eines Ausführungsbeispiels der vorliegenden Erfindung; und
- Fig. 4
- eine beispielhafte Implementierung der Näherungslösung mit Lautsprechern außerhalb eines Kreises.
- Fig. 1
- an embodiment of the present invention;
- Fig. 2
- another embodiment of the present invention;
- Fig. 3
- an illustration of an embodiment of the present invention; and
- Fig. 4
- an exemplary implementation of the approximate solution with speakers outside a circle.
In einem Ausführungsbeispiel der vorliegenden Erfindung ist die Hauptstufe 120 ausgebildet, um die Anzahl von Lautsprechersignalen 102 und die durch die Vorstufe 110 erzeugten festgelegten Lautsprecherpositionen 118 durch eine Wellenfeldsynthese zu erzeugen. Das Lautsprecherarray wird dabei von der Hauptstufe 120 entsprechend angesteuert. Die festgelegten Lautsprecherpositionen 118 werden dabei statisch oder in einem anderen Ausführungsbeispiel semi-statisch derart erzeugt, dass Positionsänderungen der Lautsprecherpositionen 118 weniger häufig oder langsamer erfolgen als Positionsänderungen der virtuellen Positionen 114.In one embodiment of the present invention, the
Dies hat zur Folge, dass über die Wellenfeldsynthese nur statische Quellen bzw. semi-statische Quellen erzeugt werden. Dadurch verringert sich der Rechenaufwand für die Wellenfeldsynthese erheblich, wobei bewegte Quellen immer noch über die vorgeschaltete Vorstufe 110 durch entsprechende Ansteuerung der Ausgangsaudiosignale 116 erfolgen kann.As a result, only static sources or semi-static sources are generated via wave field synthesis. As a result, the computation outlay for wavefield synthesis is reduced considerably, with moving sources still being able to take place via the preceding
In einem weiteren Ausführungsbeispiel der vorliegenden Erfindung ist die Hauptstufe 120 ausgebildet, um ein virtuelles Lautsprechersystem zu emulieren, das weniger Lautsprecher umfasst als das Lautsprecherarray. Das virtuelle Lautsprechersystem kann dabei durch Punktquellen oder aber durch ebene Wellen emuliert werden. Sollen bewegte Quellen simuliert werden, so kann dies durch eine Anpassung der Ausgangsaudiosignale 116 über die Vorstufe 110 realisiert werden, wobei die Lautsprecherpositionen 118 unverändert belassen werden können.In another embodiment of the present invention, the
Eingangsaudiosignale 112 sind in Ausführungsbeispielen der vorliegenden Erfindung in vielerlei Formaten denkbar. Im Ausführungsbeispiel, das in
In einem weiteren Ausführungsbeispiel kann die erfindungsgemäße Vorrichtung 100 ferner dazu ausgebildet sein, um zusätzliche Audiosignale oder zusätzliche Positionen zu erhalten, die ebenfalls auf die Lautsprechersignale 102 und das Lautsprecher-Array abgebildet werden, und deren Format sich von dem Format der Eingangsaudiosignale 112 unterscheiden kann. Beispielsweise wäre es denkbar, statische Quellen direkt über die Wellenfeldsynthese anzusteuern, und deren virtuelle Quellpositionen und Ausgangsaudiosignale direkt der Hauptstufe 120 zur Verfügung zu stellen, wohingegen bewegte Audioquellen, über die Vorstufe 110 angesteuert werden. Das Lautsprecherarray selbst kann beispielsweise durch ein zirkulares Lautsprecherarray realisiert sein. Generell sind jedoch beliebige Formen von Lautsprecherarrays denkbar, wobei die Hauptstufe 120 dazu ausgelegt sein kann, die beliebigen Formen von Lautsprecherarrays auf einen virtuellen Kreis abzubilden. Dies kann beispielsweise durch Filterung der Signale der einzelnen Lautsprecher geschehen, wie z. B. durch Amplitudenskalierung und Verzögerungen pro Lautsprecher. Es kann in diesem Zusammenhang auch von irregulären Lautsprecher-Arrays gesprochen werden, die in Ausführungsbeispielen der vorliegenden Erfindung beispielsweise auf ein virtuelles zirkulares Array abgebildet werden können.In another embodiment, the inventive device 100 may be further configured to receive additional audio signals or additional locations that are also mapped to the loudspeaker signals 102 and the loudspeaker array, and whose format may differ from the format of the input audio signals 112. For example, it would be conceivable to drive static sources directly via the wave field synthesis, and to provide their virtual source positions and output audio signals directly to the
Zur weiteren Verdeutlichung der vorliegenden Erfindung zeigt
In einem Ausführungsbeispiel der vorliegenden Erfindung wird die Wellenfeldsynthese als Wiedergabesystem mit den bekannten Vorteilen genutzt. Es werden dabei nur statische Quellen mit Hilfe der Wellenfeldsynthese dargestellt, was ein Wegfallen der Nachteile durch Quellbewegung und beispielsweise durch dynamische Filter zur Folge hat. Der Rechenaufwand der Wellenfeldsynthese wird dadurch weitgehend konstant gehalten, ggf. kann die Anzahl der virtuellen Quellen reduziert werden. Die Wellenfeldsynthese stellt somit ein konstantes virtuelles Lautsprechersystem zu Verfügung. Über ein hybrides Verfahren, z. B. Codierung von Bewegungen in Ambisonic, 5.1, VBAP, usw., können nun bewegte Quellen über das virtuelle Lautsprechersystem realisiert werden.In one embodiment of the present invention, wave field synthesis is used as a rendering system with the known advantages. In this case, only static sources are represented with the aid of wave field synthesis, which results in the elimination of the disadvantages caused by swelling and, for example, by dynamic filters. The computational effort of the wave field synthesis is kept largely constant, if necessary, the number of virtual sources can be reduced. The wave field synthesis thus provides a constant virtual speaker system. About a hybrid method, for. As coding of movements in Ambisonic, 5.1, VBAP, etc., now moving sources can be realized via the virtual speaker system.
Es wird somit eine Übertragung in einem Bildbereich realisiert. Eine virtuelle Klangquelle in der Wellenfeldsynthese repräsentiert einen Lautsprecher der virtuellen Wiedergabeanordnung für das jeweilige Audiowiedergabeverfahren, in welches die dynamische Szene konvertiert werden kann. Diese virtuellen Lautsprecher können in der Wellenfeldsynthese als Punktquellen oder auch durch ebene Wellen wiedergegeben werden. Je nach erwünschtem Realitätsgrad oder verfügbarer Rechenkapazität kann ein Bildbereich, z.B. in der Ambisonic-Domäne, im Grad der Darstellung skaliert werden. Die Bewegung einer Klangquelle erfolgt im virtuellen Lautsprechersystem als Lautstärkeveränderung der virtuellen Lautsprecher. Falls notwendig, kann in einem Ausführungsbeispiel auch die Laufzeit einer Originalquelle, beispielsweise direkt im Originalbereich, verändert werden oder, wie bei Higher Order-Ambisonic möglich, auch im Bildbereich. Generell ist das Format der Audioszenen keinen Einschränkungen unterworfen. Zum Beispiel könnte eine Wellenfeldsynthese-Szene aus z. B. XMT-SAW nach Ambisonic kodiert werden oder auch in einem beliebigen anderen Mehrkanal-Audiowiedergabeverfahren, wie beispielsweise 5.1. Charakteristisch an diesem Hybridverfahren ist eine Trennung in zwei Bereiche, den Original- und den Bildbereich. Gleichbedeutend damit ist eine Unabhängigkeit bei der Szenenerstellung respektive Codierung von der letztendlich verwendeten Lautsprecheraufstellung.Thus, a transmission in an image area is realized. A virtual sound source in the wave field synthesis represents a speaker of the virtual display device for the respective audio playback method into which the dynamic scene can be converted. These virtual speakers can be reproduced in wave field synthesis as point sources or even plane waves. Depending on the desired degree of reality or available computing capacity, an image area, for example in the Ambisonic domain, can be scaled in the degree of representation. The movement of a sound source takes place in the virtual speaker system as a change in volume of the virtual speakers. If necessary, in one embodiment, the duration of an original source, for example, directly in the original area, or changed, as in Higher Order Ambisonic possible, even in the image area. In general, the format of the audio scenes is not subject to any restrictions. For example, a wave field synthesis scene could be made from e.g. B. Ambientic XMT SAW or in any other multi-channel audio playback method, such as 5.1. Characteristic of this hybrid method is a separation into two areas, the original and the image area. Synonymous with this is an independence in the scene creation or coding of the ultimately used speaker set-up.
Nachfolgend wird eine bevorzugte Umrechnung von WFS-Eingangsdaten in Ambisonic-Daten dargestellt. Ausgangspunkt ist das XML Format. Die einzelnen Schallereignisse sind als Objekte kodiert. Folgende Informationen sind in den Objektbeschreibungen enthalten: Position der .wav Datei mit dem Audiosignal der Quelle, Existenzzeitraum der Quelle, und Bewegungsinformationen der Quelle (Position der Quelle mit time stamps).The following is a preferred conversion of WFS input data into Ambisonic data. The starting point is the XML format. The individual sound events are encoded as objects. The following information is contained in the object descriptions: Position of the .wav file with the audio signal of the source, existence period of the source, and movement information of the source (position of the source with time stamps).
Die Kodierung findet dann wie folgt statt: Die Position (Abstand und Einfallswinkel) der Schallquelle werden Samplegenau berechnet. Mit diesen Informationen können für einfaches Ambisonic und Ambisonic-WFS Hybrid direkt die Ambisonic Signale berechnet werden. Bei Ambisonic mit Nahfeldkodierung werden die Ambisonic Gewichtsfaktoren im Frequenzraum berechnet. Bei einer Fensterlänge, die eine gute Wiedergabequalität ermöglicht, ist nur eine sprunghafte Bewegung der Quelle möglich. Durch Fensterüberlappung kann der Effekt allerdings abgeschwächt werden. Bei der Berechnung mit dem Ambisonic-WFS-Hybridverfahren werden die Symmetrieeigenschaften von Ambisonic genutzt, um eine effizientere Berechnung zu ermöglichen. Beim Hybrid- und Nahfeldkodierten Ambisonic ist zu beachten, dass die Ambisonicsignale für einen Kreis mit vorgegebenem Radius gültig sind, da die Nahfeldeffekte sowohl der Quelle als auch der Lautsprecher in die Berechnung eingehen.The coding then takes place as follows: The position (distance and angle of incidence) of the sound source are calculated accurately to the sample. This information can be used to directly calculate Ambisonic signals for simple Ambisonic and Ambisonic-WFS Hybrid. In ambisonic with near-field coding, the ambisonic weighting factors in the frequency domain are calculated. With a window length which allows a good reproduction quality, only a sudden movement of the source is possible. Window overlapping, however, can mitigate the effect. The Ambisonic-WFS hybrid method calculates the symmetry properties of Ambisonic for more efficient computation. When hybrid and near field coded Ambisonic is to be noted that the Ambisonics signals are valid for a circle with a given radius, since the near field effects of both the source and the speaker are included in the calculation.
Bei der Wiedergabe von einfachen Ambisonicsignalen müssen keine weiteren Effekte beachtet werden. Die Wiedergabe findet einfach über den Ambisonicplayer statt.When playing simple Ambisonics signals no further effects need to be considered. Playback simply takes place via the Ambisonicplayer.
Wenn die Wiedergabeanordnung exakt den Annahmen bei der Kodierung entspricht, können auch die Ambisonicsignale aus dem Hybrid- und Nahfeldkodierten Verfahren direkt verwendet werden. Sollte die Wiedergabeanordnung nicht exakt übereinstimmen, gibt es zwei Möglichkeiten: Die Nahfeldeffekte der Lautsprecher werden exakt berücksichtigt. Dabei wird der bei der Dekodierung bereits angenommene Nahfeldeffekt berücksichtigt. Dieses Verfahren ist allerdings aufwendig.If the display corresponds exactly to the assumptions in the encoding, the Ambisonics signals from the hybrid and near-field coded method can also be used directly. If the display does not exactly match, there are two possibilities: The near field effects of the speakers are considered exactly. This takes into account the near-field effect already assumed during decoding. However, this method is expensive.
Die zweite Möglichkeit stellt eine Näherungslösung dar. Dafür werden die Signale der Lautsprecher entsprechend ihres Abstandes vom Kreismittelpunkt verzögert und verstärkt. Simulationen haben gezeigt, dass diese Vorgehensweise Ergebnisse vergleichbar zum ersten (exakten) Ansatz liefert. Voraussetzung ist, dass der bei der Kodierung angenommene Radius des Lautsprechers in der Größenordnung der Radii der Wiedergabelautsprecher (am besten Mittelwert) liegt.The second possibility is an approximate solution. For this purpose, the signals of the loudspeakers are delayed and amplified according to their distance from the center of the circle. Simulations have shown that this approach provides results comparable to the first (exact) approach. The prerequisite is that the radius of the loudspeaker assumed in the coding is on the order of magnitude of the radii of the playback loudspeakers (best mean value).
Eine bevorzugte Anordnung des Kreises ist in
Allgemein gesagt ist die Vorstufe 110 vorzugsweise ausgebildet, um Positionsänderungen der bewegten virtuellen Positionen 114 durch eine Anpassung der Ausgangsaudiosignale 116 abzubilden und die Lautsprecherpositionen 118 unverändert zu belassen, wobei die Anpassung eine Verzögerung oder Verstärkung eines auf eine virtuelle Quelle zurückgehenden Lautsprecherkomponentensignals entsprechend einem Abstand einer virtuellen Quelle von einem gedachten Kreismittelpunkt, auf dem die Lautsprecherpositionen platzierbar sind, aufweist.Generally speaking, the pre-stage 110 is preferably configured to change the position of the moved
Hierbei wird es bevorzugt, dass wobei für jede Lautsprecherposition die Lautsprecherkomponentensignale für die bewegten virtuellen Quellen nach der jeweiligen Verzögerung oder Verstärkung addiert werden, um ein angepasstes Ausgangsaudiosignal zu erzeugen.Here, it is preferred that for each loudspeaker position, the loudspeaker component signals for the moving virtual sources be added after the respective delay or gain to produce a matched output audio signal.
Beispielsweise führt eine Veränderung der Position einer Quelle von einem Lautsprecher weg und zu einem anderen Lautsprecher hin dazu, dass das Komponentensignal der Quelle für den Lautsprecher, von dem die Quelle wegbewegt wurde, abhängig von der Verschiebung bzw. dem Betrag der Positionsänderung verzögert und etwas gedämpft wird. Dagegen kann das Komponentensignal des Lautsprechers, zu dem die Quelle hinbewegt wurde, abhängig von der Verschiebung bzw. dem Betrag der Positionsänderung negativ verzögert und etwas verstärkt werden. Falls eine negative Verzögerung nicht möglich ist, kann das Signal nicht verändert werden, aber alle anderen Signale, so dass effektiv eine negative Verzögerung oder "Beschleunigung" des einen Signals bezüglich der anderen Signale erreicht wird.For example, changing the position of a source away from one loudspeaker and towards another loudspeaker causes the component signal of the source for the loudspeaker from which the source has been moved to be delayed and somewhat attenuated depending on the amount of change in position becomes. In contrast, the component signal of the loudspeaker to which the source has been moved may be delayed negatively and somewhat amplified depending on the displacement of the position change. If a negative delay is not possible, the signal can not be changed, but all other signals, so that effectively a negative delay or "acceleration" of the one signal with respect to the other signals is achieved.
Ausführungsbeispiele der vorliegenden Erfindung können auch nicht-kreisförmige oder irreguläre Lautsprecheranordnungen verwenden. Dabei werden die Signale entsprechend ihrer Wiedergabeposition vorgefiltert, d.h. in ihrer Amplitude und Phase und Klangspektrum derart verändert, dass die Entfernung eines Lautsprechers von einem virtuellen Kreis kompensiert wird. Dabei werden also irreguläre Lautsprecheranordnungen wieder auf eine virtuelle kreisförmige Lautsprecheranordnung abgebildet. Dieser Effekt ist in der
Dabei ist es unerheblich, auf welchem Wege beispielsweise die Ambisonic-Signale gewonnen wurden. Ferner bieten Ausführungsbeispiele der vorliegenden Erfindung die Möglichkeit einer Anpassung des idealen Hörbereichs. Diese Möglichkeit ist indirekt durch die virtuellen Klangquellen gegeben, die in einem anderen Ausführungsbeispiel anpassbar oder semi-statisch sind.It does not matter how the ambisonic signals were obtained, for example. Furthermore, embodiments of the present invention offer the possibility of adapting the ideal listening area. This possibility is given indirectly by the virtual sound sources, which in another embodiment are adaptable or semi-static.
Die
Die Komplexität, das heißt der Rechenaufwand, der für die Wellenfeldsynthese notwendig ist, kann somit auf eine endliche Zahl statischer Filter eingeschränkt werden. Damit können vielerlei Probleme der Wellenfeldsynthese bezüglich bewegter Klangwellen gelöst werden, wie beispielsweise das Auftreten von Dopplerartefakten und von zeitlichen Interpolationsartefakten. Der Rechenaufwand der Wellenfeldsynthese kann somit nahezu konstant und wesentlich geringer als bei vergleichbaren Wellenfeldsynthesen-Rendering gehalten werden. Ausführungsbeispiele der vorliegenden Erfindung bieten somit den Vorteil, dass eine Realisierung auf DSP-Boards wesentlich kostengünstiger erfolgen kann (DSP = Digital Signal Processor).The complexity, that is, the computational effort required for wave field synthesis, can thus be finite Number of static filters are restricted. Thus, many problems of wave field synthesis with respect to moving sound waves can be solved, such as the occurrence of Doppler artifacts and temporal interpolation artifacts. The computational effort of the wave field synthesis can thus be kept almost constant and much lower than comparable wave field synthesis rendering. Embodiments of the present invention thus offer the advantage that a realization on DSP boards can be carried out much more cost-effectively (DSP = Digital Signal Processor).
Zur Realisierung einer Wellenfeldsynthese kann für die Codierung beispielsweise die exakte Lösung einer Wellengleichung verwendet werden. Die Signale des Originalbereichs könnten sich beispielsweise aus der Richtungscodierung nach der klassischen Ambisonic-Theorie und einer abstandsabhängigen Codierung erfolgen. Eine Abstandscodierung kann durch eine Filterung der Ambisonic-Signale der einzelnen Ordnungen erfolgen. Nahfeldeffekte der Lautsprecher des Lautsprecher-Arrays, als auch der codierten Schallquellen können kombiniert werden, somit können die entstehenden Ambisonic-Signale beschränkt gehalten werden. Die zur Wellenfeldsynthese zum Einsatz kommenden Filter sind sowohl von der Frequenz des Eingangssignals als auch vom Abstand der Lautsprecher und der reproduzierten Schallquelle abhängig. Die Filterung kann im Frequenzbereich vorgenommen werden, bei veränderlichem Abstand kann eine gleitende Fensterung im Zeitbereich vorgenommen werden, wobei die Filter bei verändertem Abstand entsprechend angepasst werden können.To realize a wave field synthesis, for example, the exact solution of a wave equation can be used for the coding. The signals of the original range could be made, for example, from the direction coding according to the classical Ambisonic theory and a distance-dependent coding. Distance coding can be done by filtering the ambisonic signals of the individual orders. Near-field effects of the loudspeaker array loudspeakers as well as the coded sound sources can be combined, so that the resulting ambisonic signals can be kept limited. The filters used for wave field synthesis depend both on the frequency of the input signal and on the distance between the loudspeakers and the reproduced sound source. The filtering can be done in the frequency domain, with variable distance, a sliding windowing in the time domain can be made, the filter can be adjusted according to a different distance.
Eine Berechnung der nahfeldkodierten Ambisonic-Signale durch den Hybridansatz liefert ein Filter im Zeitbereich, das automatisch für alle Frequenzen gültig ist. Somit ist auch die Berücksichtigung von unterschiedlichen Abständen der reproduzierten Schallquellen, d.h. der virtuellen Klangquellen, leicht möglich. Ferner bietet sich die Möglichkeit einer Vorfilterung der Signale, um verfahrensbedingte Dämpfungen von hohen Frequenzen auszugleichen. Dann können auch höhere Frequenzen diskret reproduziert werden um Aliasing-Effekte auszuschließen. Rotationsmatrizen für Ambisonic können ferner ausgenutzt werden, um den Berechnungsaufwand zu verringern. Der Berechnungsaufwand kann dann auf ein Viertel, dem zweidimensionalen Fall, bzw. auf ein Achtel, im dreidimensionalen Fall, des Aufwands bei der direkten Berechnung reduziert werden.A calculation of the near-field-coded ambisonic signals by the hybrid approach provides a filter in the time domain, which is automatically valid for all frequencies. Thus, the consideration of different distances of the reproduced sound sources, ie the virtual sound sources, is easily possible. Furthermore, there is the possibility of prefiltering the signals to process-related To compensate for attenuation of high frequencies. Then even higher frequencies can be discretely reproduced to exclude aliasing effects. Rotational matrices for Ambisonic can also be exploited to reduce the computational burden. The computational effort can then be reduced to a quarter, the two-dimensional case, or to an eighth, in the three-dimensional case, the cost of the direct calculation.
Ausführungsbeispiele der vorliegenden Erfindung bieten somit den Vorteil, dass der Berechnungsaufwand von räumlichen Audiosignalen erheblich reduziert werden kann, und ein anpassungsfähiges System realisiert wird.Embodiments of the present invention thus offer the advantage that the computational effort of spatial audio signals can be significantly reduced, and an adaptive system is realized.
Insbesondere wird darauf hingewiesen, dass abhängig von den Gegebenheiten, das erfindungsgemäße Schema auch in Software implementiert sein kann. Die Implementation kann auf einem digitalen Speichermedium, insbesondere einer Diskette oder einer CD mit elektronisch auslesbaren Steuersignalen erfolgen, die so mit einem programmierbaren Computersystem zusammenwirken können, dass das entsprechende Verfahren ausgeführt wird. Allgemein besteht die Erfindung somit auch in einem Computerprogrammprodukt mit auf einem maschinenlesbaren Träger gespeicherten Programmcode zur Durchführung des erfindungsgemäßen Verfahrens, wenn das Computerprogrammprodukt auf einem Rechner abläuft. In anderen Worten ausgedrückt, kann die Erfindung somit als ein Computerprogramm mit einem Programmcode zur Durchführung des Verfahrens realisiert werden, wenn das Computerprogrammprodukt auf einem Computer abläuft.In particular, it should be noted that, depending on the circumstances, the inventive scheme can also be implemented in software. The implementation may be on a digital storage medium, in particular a floppy disk or a CD with electronically readable control signals, which may cooperate with a programmable computer system such that the corresponding method is executed. In general, the invention thus also consists in a computer program product with program code stored on a machine-readable carrier for carrying out the method according to the invention when the computer program product runs on a computer. In other words, the invention can thus be realized as a computer program with a program code for carrying out the method when the computer program product runs on a computer.
- 100100
- Vorrichtung zum Erzeugen einer Anzahl von LautsprechersignalenApparatus for generating a number of loudspeaker signals
- 102102
- LautsprechersignalLoudspeaker signal
- 110110
- Vorstufepreliminary stage
- 112112
- EingangsaudiosignalInput audio signal
- 114114
- virtuelle Positionenvirtual positions
- 116116
- AusgangsausgangssignaleOutput Output signals
- 118118
- LautsprecherpositionenSpeaker positions
- 120120
- Hauptstufemain stage
- 200200
- Filmtheater oder KonzertsaalMovie theater or concert hall
- 210210
- Lautsprecher-Array für WellenfeldsyntheseSpeaker array for wave field synthesis
- 215215
- Kreis.Circle.
- 220220
- Zuschauerraumauditorium
- 225225
- virtuelle Klangquellenvirtual sound sources
- 230230
- rechteckiger Lautsprecheranordnungrectangular speaker arrangement
- 300300
- Originalbereichoriginal area
- 310310
- Bildbereichimage area
- 320320
- WellenfeldsynthesewiedergabeWave field synthesis reproduction
Claims (18)
- An apparatus (100) for generating a number of loudspeaker signals (102) for a loudspeaker array which defines a reproduction space, the apparatus comprising:a prestage (110) configured to generate a plurality of output audio signals (116) while using one or more virtual sources, a virtual source comprising one input audio signal (112), respectively, which is associated with a virtual position (114), each output audio signal (116) being associated to a loudspeaker position (118) specified by the prestage (110), and the prestage (110) being configured such that the plurality of output audio signals (116) together replicate a reproduction of the input audio signal(s) (112) at the virtual position(s) (114), and a number of output audio signals (116) being smaller than a number of loudspeaker signals (102) for the loudspeaker array; anda main stage (120) configured to obtain the plurality of output audio signals (116) and further to obtain, as a virtual position for each output audio signal (116), the loudspeaker positions (118) specified by the prestage (110), and the main stage (120) being configured to generate the number of loudspeaker signals (102) for the loudspeaker array such that the loudspeaker positions (118) specified by the prestage (110) are replicated as virtual sources by the loudspeaker array.
- The apparatus as claimed in claim 1,
wherein the virtual sources employed by the prestage (110) are moving virtual sources with variable positions,
wherein the specified loudspeaker positions are static, and
wherein the virtual positions corresponding to the specified static loudspeaker positions are static positions. - The apparatus (100) as claimed in claims 1 or 2,
wherein the prestage is configured to process all of the moving virtual sources of a number of virtual sources input comprising moving and static virtual sources, and
wherein the main stage is configured to process only static virtual sources,
wherein the static virtual sources comprise the virtual sources which are specified by the static loudspeaker positions, and additionally comprise the static virtual sources input. - The apparatus (100) as claimed in any of claims 1 to 3, wherein the main stage (120) is configured to generate, by means of wave field synthesis, the number of loudspeaker signals (102) and the loudspeaker positions (118) specified by the prestage (110).
- The apparatus (100) as claimed in any of claims 1 to 4, wherein the prestage (110) is configured to statically or semi-statically generate the specified loudspeaker positions (118) in such a manner that positional changes in the loudspeaker position (118) occur less frequently or more slowly than positional changes in the virtual positions (114).
- The apparatus as claimed in any of claims 1 to 5, wherein the main stage (120) is configured to emulate a virtual loudspeaker system which comprises fewer loudspeakers than the loudspeaker array.
- The apparatus (100) as claimed in claim 6, wherein the virtual loudspeaker system is emulated by point sources or plane waves.
- The apparatus (100) as claimed in any of claims 1 to 7, wherein the prestage (110) is configured to map positional changes in the virtual positions (114) by adapting the output audio signals (116), and to leave the loudspeaker positions (118) unchanged.
- The apparatus (100) as claimed in claim 8, wherein the prestage (110) is configured to effect the adaptation of the output audio signals (116) by means of a delay or amplification of a loudspeaker component signal going back to a virtual source, the delay or amplification corresponding to a distance of a virtual source from an imaginary center of a circle on which the loudspeaker positions may be placed.
- The apparatus (100) as claimed in claim 9, wherein the prestage (110) is configured to add, for each loudspeaker position, the loudspeaker component signals for the moving virtual sources after the respective delay or amplification in order to generate an adapted output audio signal.
- The apparatus (100) as claimed in any of claims 1 to 10, wherein the prestage (110) is configured to process input audio signals (112) encoded in accordance with XMT-SAW, Open-AI 5.1, Ambisonic, Quadrophonic, Prologic, Prologic II, Dolby Digital, Dolby Digital-EX, DTS, DTS-ES, SDDS, 10.2, THX or IMAX.
- The apparatus (100) as claimed in any of claims 1 to 11, configured to provide, via the input audio signals (112) and the virtual positions (114), an image domain which is mapped to an original domain via the loudspeaker signals (102) and the loudspeaker array.
- The apparatus (100) as claimed in any of claims 1 to 12, wherein the main stage (120) is configured to obtain additional audio signals or additional positions which are mapped to the loudspeaker signals (102) and to the loudspeaker array, and the formats of which differ from the formats of the input audio signals (112).
- The apparatus (100) as claimed in any of claims 1 to 13, wherein the main stage (120) is configured to control a circular loudspeaker array.
- The apparatus (100) as claimed in any of claims 1 to 14, wherein the main stage (120) is configured to control an irregular loudspeaker array such that the individual loudspeaker signals (102) are adapted to the irregular shape of the loudspeaker array.
- The apparatus (100) as claimed in claim 15, wherein the main stage (120) is configured to perform the adaptation of the loudspeaker signals (102) to the irregular loudspeaker array by individually delaying and amplifying the loudspeaker signals (102).
- A method of generating a number of loudspeaker signals (102) for a loudspeaker array which defines a reproduction space, the method comprising:generating a plurality of output audio signals (116) while using one or more virtual sources, a virtual source comprising one input audio signal (112), respectively, which is associated with one or more virtual positions (114), each output audio signal (116) being associated to a loudspeaker position (118) specified by a prestage (110), and the plurality of output audio signals (116) together replicating a reproduction of the input audio signals (112) at the virtual positions (114), and a number of output audio signals (116) being smaller than a number of loudspeaker signals (102) for the loudspeaker array;obtaining the plurality of output audio signals (116) and the loudspeaker positions (118) for each output audio signal (116); andgenerating the number of loudspeaker signals (102) for the loudspeaker array, so that the loudspeaker positions (118) specified by the prestage (110) are replicated as virtual sources by the loudspeaker array.
- A computer program having a program code for performing the method as claimed in claim 17, when the computer program runs on a computer or microcontroller.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| DE102006048205 | 2006-10-11 | ||
| DE102006053919A DE102006053919A1 (en) | 2006-10-11 | 2006-11-15 | Apparatus and method for generating a number of speaker signals for a speaker array defining a playback space |
| PCT/EP2007/008823 WO2008043549A1 (en) | 2006-10-11 | 2007-10-10 | Device and method for generating a number of loudspeaker signals for a loudspeaker array which defines a reproduction area |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| EP2080411A1 EP2080411A1 (en) | 2009-07-22 |
| EP2080411B1 true EP2080411B1 (en) | 2012-04-25 |
Family
ID=38924436
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP07818894A Active EP2080411B1 (en) | 2006-10-11 | 2007-10-10 | Device and method for generating a number of loudspeaker signals for a loudspeaker array which defines a reproduction area |
Country Status (6)
| Country | Link |
|---|---|
| US (1) | US8358091B2 (en) |
| EP (1) | EP2080411B1 (en) |
| JP (1) | JP5111511B2 (en) |
| AT (1) | ATE555618T1 (en) |
| DE (1) | DE102006053919A1 (en) |
| WO (1) | WO2008043549A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109362025A (en) * | 2018-11-23 | 2019-02-19 | 武汉轻工大学 | Non-central point-based sound field reconstruction method, device, storage medium and device |
Families Citing this family (28)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE102006053919A1 (en) | 2006-10-11 | 2008-04-17 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Apparatus and method for generating a number of speaker signals for a speaker array defining a playback space |
| EP2234989B1 (en) * | 2007-12-17 | 2014-08-13 | F. Hoffmann-La Roche AG | Tetrazole-substituted arylamide derivatives and their use as p2x3 and/or p2x2/3 purinergic receptor antagonists |
| JP5693579B2 (en) | 2009-08-03 | 2015-04-01 | アイマックス コーポレイション | System and method for monitoring cinema loudspeakers to ensure quality issues |
| EP2309781A3 (en) | 2009-09-23 | 2013-12-18 | Iosono GmbH | Apparatus and method for calculating filter coefficients for a predefined loudspeaker arrangement |
| CN102823277B (en) | 2010-03-26 | 2015-07-15 | 汤姆森特许公司 | Method and device for decoding an audio soundfield representation for audio playback |
| US20130058505A1 (en) * | 2010-05-21 | 2013-03-07 | Bang & Olufsen A/S | Circular loudspeaker array with controllable directivity |
| NZ587483A (en) * | 2010-08-20 | 2012-12-21 | Ind Res Ltd | Holophonic speaker system with filters that are pre-configured based on acoustic transfer functions |
| US9271081B2 (en) | 2010-08-27 | 2016-02-23 | Sonicemotion Ag | Method and device for enhanced sound field reproduction of spatially encoded audio input signals |
| US20150131824A1 (en) * | 2012-04-02 | 2015-05-14 | Sonicemotion Ag | Method for high quality efficient 3d sound reproduction |
| WO2013167164A1 (en) * | 2012-05-07 | 2013-11-14 | Imm Sound S.A. | Method and apparatus for layout and format independent 3d audio reproduction |
| US9736609B2 (en) * | 2013-02-07 | 2017-08-15 | Qualcomm Incorporated | Determining renderers for spherical harmonic coefficients |
| IL319169A (en) * | 2013-03-28 | 2025-04-01 | Dolby Laboratories Licensing Corp | Rendering of audio objects with apparent size to arbitrary loudspeaker layouts |
| US20140358565A1 (en) | 2013-05-29 | 2014-12-04 | Qualcomm Incorporated | Compression of decomposed representations of a sound field |
| US9466305B2 (en) | 2013-05-29 | 2016-10-11 | Qualcomm Incorporated | Performing positional analysis to code spherical harmonic coefficients |
| US9807538B2 (en) * | 2013-10-07 | 2017-10-31 | Dolby Laboratories Licensing Corporation | Spatial audio processing system and method |
| US9489955B2 (en) | 2014-01-30 | 2016-11-08 | Qualcomm Incorporated | Indicating frame parameter reusability for coding vectors |
| US9922656B2 (en) | 2014-01-30 | 2018-03-20 | Qualcomm Incorporated | Transitioning of ambient higher-order ambisonic coefficients |
| US20180184227A1 (en) * | 2014-03-24 | 2018-06-28 | Samsung Electronics Co., Ltd. | Method and apparatus for rendering acoustic signal, and computer-readable recording medium |
| WO2015147433A1 (en) * | 2014-03-25 | 2015-10-01 | 인텔렉추얼디스커버리 주식회사 | Apparatus and method for processing audio signal |
| CN106105270A (en) * | 2014-03-25 | 2016-11-09 | 英迪股份有限公司 | For processing the system and method for audio signal |
| CA3183535A1 (en) * | 2014-04-11 | 2015-10-15 | Samsung Electronics Co., Ltd. | Method and apparatus for rendering sound signal, and computer-readable recording medium |
| US9852737B2 (en) | 2014-05-16 | 2017-12-26 | Qualcomm Incorporated | Coding vectors decomposed from higher-order ambisonics audio signals |
| US10770087B2 (en) | 2014-05-16 | 2020-09-08 | Qualcomm Incorporated | Selecting codebooks for coding vectors decomposed from higher-order ambisonic audio signals |
| US9620137B2 (en) | 2014-05-16 | 2017-04-11 | Qualcomm Incorporated | Determining between scalar and vector quantization in higher order ambisonic coefficients |
| US9747910B2 (en) | 2014-09-26 | 2017-08-29 | Qualcomm Incorporated | Switching between predictive and non-predictive quantization techniques in a higher order ambisonics (HOA) framework |
| EP3523799B1 (en) * | 2016-10-25 | 2021-12-08 | Huawei Technologies Co., Ltd. | Method and apparatus for acoustic scene playback |
| GB2563635A (en) * | 2017-06-21 | 2018-12-26 | Nokia Technologies Oy | Recording and rendering audio signals |
| DE112020002711T5 (en) * | 2019-06-05 | 2022-02-17 | Sony Group Corporation | INFORMATION PROCESSING DEVICE, INFORMATION PROCESSING METHOD AND PROGRAM |
Family Cites Families (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH10174199A (en) * | 1996-12-11 | 1998-06-26 | Fujitsu Ltd | Speaker sound image control device |
| DE10035827C2 (en) | 2000-07-22 | 2003-10-16 | Groz Beckert Kg | Latch needle with offset tongue shaft |
| JP4465870B2 (en) * | 2000-12-11 | 2010-05-26 | ソニー株式会社 | Audio signal processing device |
| FR2847376B1 (en) * | 2002-11-19 | 2005-02-04 | France Telecom | METHOD FOR PROCESSING SOUND DATA AND SOUND ACQUISITION DEVICE USING THE SAME |
| US7706544B2 (en) * | 2002-11-21 | 2010-04-27 | Fraunhofer-Geselleschaft Zur Forderung Der Angewandten Forschung E.V. | Audio reproduction system and method for reproducing an audio signal |
| DE10254404B4 (en) | 2002-11-21 | 2004-11-18 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Audio reproduction system and method for reproducing an audio signal |
| DE10328335B4 (en) | 2003-06-24 | 2005-07-21 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Wavefield syntactic device and method for driving an array of loud speakers |
| FR2858512A1 (en) | 2003-07-30 | 2005-02-04 | France Telecom | METHOD AND DEVICE FOR PROCESSING AUDIBLE DATA IN AN AMBIOPHONIC CONTEXT |
| DE10355146A1 (en) * | 2003-11-26 | 2005-07-07 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Apparatus and method for generating a bass channel |
| DE102004002532A1 (en) * | 2004-01-17 | 2005-09-22 | Helmut Oellers | Audio sound reproduction system used a frontal matrix wave field sythesis process to generate a realistic output |
| DE102006010212A1 (en) * | 2006-03-06 | 2007-09-20 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Apparatus and method for the simulation of WFS systems and compensation of sound-influencing WFS properties |
| DE102006053919A1 (en) | 2006-10-11 | 2008-04-17 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Apparatus and method for generating a number of speaker signals for a speaker array defining a playback space |
-
2006
- 2006-11-15 DE DE102006053919A patent/DE102006053919A1/en not_active Ceased
-
2007
- 2007-10-10 JP JP2009531771A patent/JP5111511B2/en active Active
- 2007-10-10 AT AT07818894T patent/ATE555618T1/en active
- 2007-10-10 WO PCT/EP2007/008823 patent/WO2008043549A1/en not_active Ceased
- 2007-10-10 EP EP07818894A patent/EP2080411B1/en active Active
- 2007-10-10 US US12/445,150 patent/US8358091B2/en active Active
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109362025A (en) * | 2018-11-23 | 2019-02-19 | 武汉轻工大学 | Non-central point-based sound field reconstruction method, device, storage medium and device |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2008043549A1 (en) | 2008-04-17 |
| DE102006053919A1 (en) | 2008-04-17 |
| JP2010506521A (en) | 2010-02-25 |
| EP2080411A1 (en) | 2009-07-22 |
| US8358091B2 (en) | 2013-01-22 |
| US20100092014A1 (en) | 2010-04-15 |
| JP5111511B2 (en) | 2013-01-09 |
| ATE555618T1 (en) | 2012-05-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP2080411B1 (en) | Device and method for generating a number of loudspeaker signals for a loudspeaker array which defines a reproduction area | |
| DE10254404B4 (en) | Audio reproduction system and method for reproducing an audio signal | |
| EP1671516B1 (en) | Device and method for producing a low-frequency channel | |
| EP1637012B1 (en) | Wave field synthesis device and method for driving an array of loudspeakers | |
| DE60304358T2 (en) | METHOD FOR PROCESSING AUDIO FILES AND DETECTION DEVICE FOR THE APPLICATION THEREOF | |
| DE60225806T2 (en) | SOUNDTRACK TRANSLATION | |
| EP3756363B1 (en) | Apparatus and method for object-based spatial audio-mastering | |
| EP1854334B1 (en) | Device and method for generating an encoded stereo signal of an audio piece or audio data stream | |
| EP3069530B1 (en) | Method and device for compressing and decompressing sound field data of an area | |
| EP1525776B1 (en) | Device for correcting the level in a wave field synthesis system | |
| EP1972181B1 (en) | Device and method for simulating wfs systems and compensating sound-influencing wfs characteristics | |
| EP2754151B1 (en) | Device, method and electro-acoustic system for prolonging a reverberation period | |
| DE10254470A1 (en) | Apparatus and method for determining an impulse response and apparatus and method for presenting an audio piece | |
| DE10321980A1 (en) | Device and method for calculating a discrete value of a component in a loudspeaker signal | |
| EP1880577B1 (en) | Device and method for generating a loudspeaker signal based on a randomly occurring audio source | |
| EP2373054B1 (en) | Playback into a mobile target sound area using virtual loudspeakers | |
| EP3090575A2 (en) | Method for audio reproduction in a multi-channel sound system | |
| EP2503799B1 (en) | Method and system for calculating synthetic head related transfer functions by means of virtual local sound field synthesis | |
| DE102017121876A1 (en) | METHOD AND DEVICE FOR FORMATTING A MULTI-CHANNEL AUDIO SIGNAL |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| 17P | Request for examination filed |
Effective date: 20080225 |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC MT NL PL PT RO SE SI SK TR |
|
| 17Q | First examination report despatched |
Effective date: 20091116 |
|
| GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
| RTI1 | Title (correction) |
Free format text: DEVICE AND METHOD FOR GENERATING A NUMBER OF LOUDSPEAKER SIGNALS FOR A LOUDSPEAKER ARRAY WHICH DEFINES A REPRODUCTION AREA |
|
| DAX | Request for extension of the european patent (deleted) | ||
| GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
| GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
| AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC MT NL PL PT RO SE SI SK TR |
|
| REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
| REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
| REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 555618 Country of ref document: AT Kind code of ref document: T Effective date: 20120515 |
|
| REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D Free format text: LANGUAGE OF EP DOCUMENT: GERMAN |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 502007009785 Country of ref document: DE Effective date: 20120621 |
|
| REG | Reference to a national code |
Ref country code: NL Ref legal event code: VDEP Effective date: 20120425 |
|
| LTIE | Lt: invalidation of european patent or patent extension |
Effective date: 20120425 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120425 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120425 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120425 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120425 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120425 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120825 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120726 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120425 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120827 Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120425 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120425 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120425 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120425 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120425 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120425 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120425 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120425 |
|
| PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
| 26N | No opposition filed |
Effective date: 20130128 |
|
| BERE | Be: lapsed |
Owner name: FRAUNHOFER-GESELLSCHAFT ZUR FORDERUNG DER ANGEWAN Effective date: 20121031 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120805 |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 502007009785 Country of ref document: DE Effective date: 20130128 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20121031 |
|
| REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
| REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20121010 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20121031 Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20121031 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20121031 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120725 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120425 |
|
| REG | Reference to a national code |
Ref country code: AT Ref legal event code: MM01 Ref document number: 555618 Country of ref document: AT Kind code of ref document: T Effective date: 20121031 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20121031 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120425 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20121010 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20071010 |
|
| REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 9 |
|
| REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 10 |
|
| REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 11 |
|
| REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 12 |
|
| P01 | Opt-out of the competence of the unified patent court (upc) registered |
Effective date: 20230524 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20251020 Year of fee payment: 19 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20251024 Year of fee payment: 19 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20251022 Year of fee payment: 19 |