WO2024068868A1 - Processing device, in particular headphones or hearing aid, for processing microphone signals into an audio data stream - Google Patents

Abstract

The invention relates to a processing device (2, 3), in particular headphones or a hearing aid, - wherein the processing device (2, 3) has a signal processing chain (30) that is designed to process microphone signals (MS1 – MS4), in accordance with values or settings of signal processing parameters of a profile, into an audio data stream, wherein a first profile and a second profile are provided, and - wherein the processing device (2, 3) is designed, taking into consideration interaction data (ID), to change the values or settings of the signal processing parameters of the first profile to such values or settings of the signal processing parameters of the second profile, or vice versa, wherein the interaction data represent a user interaction detected as a movement, in particular a movement known as "hold and swipe".

Description

Title

Processing device, in particular headphones or hearing aid, for processing microphone signals into an audio data stream

Description

Technical field

The invention relates to processing devices, in particular headphones or hearing aids, for processing microphone signals into an audio data stream.

Background

US 2009/0123013 A1 discloses a hearing aid device as a processing device. The hearing aid includes a housing; a plurality of electrical components disposed within the housing; and an actuator that modifies a setting value of at least one of the electrical components, the actuator being a non-mechanical actuator. The setting element distinguishes between several movement patterns of a detected finger or an object and modifies the associated setting values of the hearing aid device.

The condition of this hearing aid is extremely complicated because the user has to remember the associated movement pattern for each setting of the relevant setting value. Ultimately, the hearing aid only provides a very limited range of functions that can actually be controlled with the help of its low-performance user interface, namely switching the hearing aid on or off and increasing or reducing the volume of the hearing aid.

The invention therefore has the object of providing a processing device with a more powerful user interface.

Summary of the invention This object is achieved by a processing device according to claim 1. The subject matter of the invention is therefore a processing device, in particular headphones or hearing aid, wherein the processing device has a signal processing chain which is designed to process microphone signals according to values or settings of signal processing parameters of a profile into an audio data stream, wherein a first profile and a second profile are provided, and wherein the processing device is designed to change the values or settings of the signal processing parameters of the first profile to those values or settings of the signal processing parameters of the second profile or vice versa, taking interaction data into account, wherein the interaction data represents a user interaction recorded as a movement, such as a "swipe", "tap", "hold" or combination thereof, in particular a movement known as "hold and swipe".

This object is further achieved by a system according to claim 14. The invention therefore relates to a system, preferably a hearing aid system, particularly preferably a binaural hearing aid system, wherein the system has two processing devices according to the invention, wherein the first processing device is intended for the left ear and the second processing device for the right ear of a person.

The measures according to the invention have the advantage that, with a single movement, a large number of the settings of the signal processing parameters of the signal processing chain can be intervened at the same time, without the user actually having to know the individual settings, because these are stored in the respective profile or are summarized. It is therefore sufficient that the user of the processing device is aware of the two profiles that are intended for use via the user interface.

The processing device thus has an innovative user interface, in particular for a hearing aid.

Further, particularly advantageous refinements and developments of the invention result from the dependent claims and the following description. Regarding the origin of the interaction data, it can be provided that the processing device is designed to receive and use the interaction data from an external interaction source by means of a radio connection.

This measure makes it possible for the interaction data to be generated using the external interaction source, such as a smartphone, a tablet computer or even a cloud-based software solution, and transmitted via a radio connection to one of the processing devices or to both processing devices in order to use it there for further processing to use processing.

Regarding the origin of the interaction data, it can further be provided that the processing device has an input module with a planar interaction area, wherein the input module is designed to detect a movement, in particular a swiping movement, in the interaction area as a user interaction and to provide the interaction data representing this user interaction.

The areal interaction area can be provided by a touch-sensitive surface.

This also allows operation independent of an external source of interaction.

In order to make optimal use of the area interaction area, it can be provided that the processing device is designed to define at least two different menu areas in the area interaction area, with one of the two profiles being assigned to the respective menu area.

The input module can have a camera or be designed as a camera. Such an input module can, for example, record a hand gesture as a user interaction. For this purpose, the processing device can be designed to recognize objects, in particular the hand or its movement or the position or combination of the finger orientations, in captured image data using pattern recognition.

It has proven to be advantageous that the input module is designed to allow user interactions within the auricle capture or capture in front of the auricle or capture along the front edge of the auricle, especially towards the upper edge.

This allows the user of the system to trigger user interaction with movements that are as natural as possible.

However, it has proven to be particularly advantageous if the input module has at least one touchbar or is implemented as a touchbar.

This means that, unlike buttons, switches or keys, a touch bar does not require a fixed actuator to be moved. Rather, a simple touch of the touch-sensitive surface of the touch bar is sufficient because the touch bar is designed to detect touch capacitively.

This allows a wide range of user interactions in a very small space, whereby the user interaction is felt or sensed by the interacting person because they have to touch the touch bar. The user interactions can be different sequences of taps and swipes in different directions at different points on the touch bar. So only a minimal amount of space is needed to enable the user to make many different inputs.

Within the touch-sensitive surface, touch zones on the touch bar can be defined using hardware or software, or can be adjusted or changed during operation, creating virtual, individually definable buttons that are assigned functions of the processing device, e.g. switching between predefined profiles (for controlling microphone signal processing). This makes it possible to select profiles quickly and specifically, or to automatically adjust the selection of profiles (for a signal processing chain for processing microphone signals) depending on the situation.

In connection with the touch bar, it has proven to be particularly advantageous if the processing device is configured in such a way that the touch bar is positioned at the front edge of the auricle when worn on the head.

This measure has the effect that an uncomplicated and intuitive touch from the side is possible. The arm The touch bar does not have to be lifted as far and the fingers of the hand do not have to be bent as much as would be the case if the outer part of the touch bar were positioned along the back of the ear and could only be touched from behind. This is particularly important for older people, whose mobility is usually limited.

With regard to the change in values and settings due to user interaction, it can be provided that in the case of continuously or quasi-continuously changeable values or settings, the processing device is designed to continuously or quasi-continuously change the values or settings, wherein the degree of change scales with the extent of the detected movement.

With regard to the change in values and settings due to user interaction, it can further be provided that in the case of values or settings that can only be changed step by step or only abruptly, the processing device is designed to change the values or settings step by step or abruptly when a threshold value of the detected movement occurs.

With regard to the change in values and settings due to user interaction, it can further be provided that the processing device is designed to change the values or settings even in the case that a profile has a mixture of continuously or quasi-continuously changeable values or settings and values or settings that can be changed step by step or only in jumps.

In the processing device, when the change discussed occurs, the signal processing according to the first profile is converted into signal processing according to the changed values or settings that are now present. The values and settings can assume intermediate states between the limits of the values or settings defined by the two profiles. Only if the detected movement uses the entire available length/width/diagonal etc. of the areal interaction area or corresponds to a predefined movement range or shape switched one hundred percent from the first profile to the second profile. Otherwise, the intermediate states mentioned are used.

With regard to the user interaction-related change in the values and settings, it can further be provided that if there is no corresponding parameter of the second profile for a signal processing parameter of the first profile or vice versa, the processing device is designed to leave the relevant signal processing parameter unchanged for as long as

- until a complete change from the first profile to the second profile has occurred or

- until a percentage threshold, such as 25%, 50% or 75%, of the maximum movement has been detected or

- until the essentially continuously changing values or settings have been changed according to a threshold value, such as 25%, 50% or 75%.

This measure can be used to prevent the relevant effect of the parameter, which is only available in the first profile, from starting too abruptly. You can also proceed analogously with a signal processing parameter of the second profile for which there is no corresponding parameter in the first profile.

It has also proven to be particularly advantageous that the processing device is designed to implement the change in the signal processing parameters to be made in accordance with the detected movement in real time in the signal processing chain.

This measure has the effect that the result of this change in the signal processing parameters is immediately perceptible.

The processing device therefore allows - as already mentioned at the beginning - a "hold and swipe" functionality, which in technical jargon is referred to as a "swipe" functionality, which is advantageously used in the context of the system to mix profiles with each other. The person first touches one of the profile zones 53 - 55, leaves the finger on it and then pulls the finger into the adjacent profile zone before the finger is lifted from the touch-sensitive element. This is interpreted by the software in such a way that the the profiles assigned to both profile zones swept by the fingers are to be mixed. According to another variant, it should be mentioned that it is not absolutely necessary to leave the finger somewhere for a certain period of time in order to trigger the mentioned functionality.

The degree of mixing (or in other words the mixing ratio) of the two profiles to be mixed can be adjusted by the width of the wiping movement (defacto between 0 and 100%).

This means that the mixing ratio can be controlled by the width of the finger movement, meaning it can be dynamically adjusted in real time.

With the help of the "wiping movement" functionality, the user can dynamically switch back and forth between the two profiles or dynamically change the degree of mixing, for example, to find out which mixing ratio is best for him, as long as his finger is in contact with the touch-sensitive element but is moved there best fits or, for example, to consciously switch back and forth between two mixing ratios in order to temporarily optimize his acoustic perception according to the first profile or the second profile at short intervals. Only when he lifts his finger from the touch-sensitive element is this point in time set mixing ratio fixed.

It has therefore proven to be advantageous that the processing device is designed to fix the change in the signal processing parameters according to the detected movement only when the user interaction, such as a "swipe", "tap", "hold" or combination thereof, in particular a movement known as "hold and swipe", which in technical jargon is also referred to as a "swipe movement", ends.

According to a further aspect, the processing device is designed to respond to a predefined user interaction, such as a particularly rapid swipe movement that differs from that with which the profiles are mixed, or a user interaction recorded as a “tap & hold”. Activate home profile.

The user, i.e. the person wearing the system, always returns to the original position with a "swipe" gesture up or down, i.e. with a quick stroking movement of the finger across the two zones touching the touch-sensitive element. stable listening mode (the "Home" profile), regardless of whether this "swipe" gesture is performed on the first processing device or the second processing device.

This makes it easy to control a complex command chain without an external device, such as a smartphone or tablet computer, etc., which can intervene in every element of the signal processing chain as necessary.

This means the entire system can be made controllable in a tangible way. As mentioned, the touchbar is freely assignable and can control practically all system parameters, i.e. the settings of the signal processing chain. This allows the user to intervene in their sound reality in real time. It can also be used to generate dynamic profiles, whereby the profiles placed on the touchbar are mixed with each other as discussed. This makes it easy to control complex DSP functions, for example, and the user has the feeling that he is interacting with the sound. The user's feeling that he would only change programs with a plastic button, which is often perceived as a disadvantage with known systems, is thus completely avoided.

With the help of these measures, the user can intervene deeply in the function of the signal processing chain even during operation. In addition, a hearing test can be carried out and evaluated and deficits can be identified because the input module allows a wide variety of interactions.

The system equipped with the technical measures described can also enable an audio data stream generated from the microphone signals to be shared in real time with another external device. This can be done, for example, using a radio connection to the external device or a wired connection via the (magnetically holding) connection. This functionality allows another person to experience the underlying audio experience of the person wearing the system live using the other device. This functionality can also be used to analyze the audio experience, i.e. the audio data stream, on the other device in real time.

The system, in particular the processing devices, can also each have a data storage device with the help of which the generated microphone signals in raw data format or also pre-processed can be continuously or limited to a time range of the occurrence of an audio event. Correspondingly, the settings or parameters that were used in the signal processing chain to create the audio data stream from the microphone signals are also saved. If the user of the system now has problems with audio perception, it can be determined by targeted, systematic adjustment or change of the settings or parameters which values for the setting or parameter improve the user's audio perception. The stored data allows incremental and repetitive adjustment of the settings and parameters in particular in order to determine the appropriate parameters for one and the same audio experience. This is particularly important because personal audio perception is often based on subjectivity, which makes it difficult for the person to communicate this in an objective form to an audiologist, for example. Furthermore, the audio data streams corresponding to the respective audio experience, which were created using a wide variety of settings and parameters or changes to them, can also be saved. This allows the user to narrow down the settings and parameters that are suitable for him by comparative listening (i.e. sequential playback of the audio data streams), which in turn gives the audiologist or a software-based audiological application the opportunity to find the optimized set of settings or parameters.

The two processing devices of the system can be set independently of each other with regard to the use of the profiles available there or the mix ratio of the profiles there, which allows the two processing devices to be operated as flexibly and independently of each other as possible. In this configuration, with a touch bar assignment of two profiles per touch bar, a maximum of four profiles in total can be used, whereby two profiles per processing device can be smoothly converted into one another according to the movement in question. This operating mode is referred to as "independent mode", whereby each of the two processing devices interprets the movement independently of the other and carries out the movement resulting values and settings of the signal processing parameters.

However, it has proven to be particularly advantageous if the two processing devices are designed for radio-based transmission of the interaction data from the first processing device to the second processing device or vice versa, and the processing device receiving the interaction data from the other processing device is designed to transmit the received interaction data analogously to that the processing device that sends out interaction data must be taken into account. This makes it possible to establish highly symmetrical operation of the two processing devices, which is only influenced by a one-sided user interaction on one of the two processing devices. In this case, we are talking about a “linked mode”. This linked mode is of particular interest if the same profile pairs are used in both processing devices and it should be unimportant for the user on which processing device he uses the touch bar to merge the profiles into one another.

However, the system can be configured in an asynchronously linked mode such that there is a radio connection between the processing devices for sending their own interaction data to the other processing device and for receiving the interaction data from the other processing device. Gestures executed synchronously on both processing devices (i.e. to the left and right sides of the head) can be interpreted as one gesture and both processing devices can perform synchronous execution based on different inputs on both sides. It can also be provided that individual interactions on both sides carry out different functions that can be synchronized with the other processing device. For example, a user defines swiping up as increasing the volume on the left side, but swiping up on the right as muting the sound. If the user then swipes up on the right side, both devices will be muted while Swiping up on the left side increases the volume on both devices.

Furthermore, an asynchronously unlinked mode can be provided. In this mode, too, there is the radio connection mentioned above in the asynchronously linked mode for exchanging the respective interaction data so that each side is informed about the respective user interaction. However, this radio connection is not absolutely necessary. However, in this mode, the processing devices behave in such a way that changes are only carried out on that side of the head or by the processing devices positioned there, where the user interaction happens or takes place.

With regard to the radio functionality, it should be mentioned that common radio modules for radio communication can be used in the two processing devices. This can be, for example, Near Field Communication, NFC for short, ZigBee, Wi-Fi, or a proprietary protocol can also be used. The radio modules are designed according to the respective radio technology, whereby special software (driver software) that provides the respective protocol is used if necessary.

It has proven to be particularly advantageous if the radio connections are Bluetooth radio connections. For this purpose, the radio modules are designed as Bluetooth radio modules.

Each of the processing devices has at least two microphones, which provide individual microphone signals that are exchanged between the two processing devices.

With regard to the processing of the microphone signals, it should be mentioned that different fundamentally known procedures or methods or algorithms can be used to process the microphone signals. For example, the microphone signals can be further processed according to “Dolby Atmos” technology or Aureal 3-Dimensional technology, or A3D technology for short, or the Auro 3D format.

It has proven to be particularly advantageous that each of the processing devices is designed to process the two groups of microphone signals according to the Ambisonics format.

The big advantage is that this format is widespread and therefore widely accepted. This makes it easy to use because there are already defined procedures for signal processing. Ambisonics is therefore a fully spherical audio format that is generally known to experts and is used in particular in the B format.

The use of the Ambisonics format also allows for a simple and familiar use of the recorded microphone signals. For example, they can be recorded and saved as recording data. This recording data can then be further processed within the system or by other devices. For example, the recording data can be used by so-called "(e.g. video and/or audio) content creators" to use the recorded recording data in their own (proprietary) processing environment.

Advantageously, in the context of the invention, the Ambisonics format is used in the further system-internal processing chain to enable the use of one or more virtual microphones, so that with the help of the system, the directivity of the respective virtual microphone is tailored to individual users in a purely software-based manner, i.e. without any additional external aids Sound sources (e.g. devices, vehicles or people) can be focused in the sound detection area. This has proven to be particularly advantageous when using the system as a binaural hearing aid system to support people with hearing impairments.

The basic configuration mentioned above, consisting of the two microphones per processing device, already forms the basis for audio signal processing in accordance with the generally known Ambisonics format in the first order. It may be necessary to transform the microphone signals from one coordinate system to another in order to make the preferred arrangement and/or orientation of the microphones accessible for use in the Ambisonics format in accordance with the convention. If there are more microphones than in the basic configuration, and if there are corresponding orientations or directional characteristics, higher orders of the Ambisonics format can also be processed. It should be noted that even when using other formats, the use of multiple microphones allows a description of a higher order of the spherical harmonics. The fully automatic or user-interaction-based three-dimensional interpretation of the microphone signals makes it possible to identify a specific sound source and the direction of the sound source in relation to the respective orientation of the processing device. The sounds from this sound source can now be amplified or muted for the person depending on the specification or properties of the sounds.

The direction of the sound source can be determined fully automatically using the process of “beamforming” (known in the context of Ambisonics). Beamforming is generally understood to mean the orienting of a directional characteristic (of a virtual microphone known in the context of Ambisonics), if necessary modeling the directivity (of this virtual microphone).

If the sound source or the system is moved through the room, the change in the position of the sound source relative to the system or its orientation, which in the case of a hearing aid results from the orientation of the head, must be taken into account in order to continue to focus on the previously focused sound source stay and amplify or block out their sound. The aforementioned “beamforming” can also be used with a virtual microphone for this - possibly automated - process. In this way, the sound field can be permanently scanned and the position of the “traveling” sound source can be tracked.

Finally, it should be mentioned in general that the electronic devices discussed (ESLs, smartphones, tablet computers, video shelf rails, etc.) naturally have electronics. The electronics can be constructed discretely or through integrated electronics or a combination of both. Microcomputers, micro controllers, application specific integrated circuits (ASICs), possibly in combination with analog or digital electronic peripheral components, can also be used. Many of the mentioned functionalities of the devices are implemented - possibly in conjunction with hardware components - with the help of software that is executed on an electronics processor. Devices designed for radio communication usually have an antenna configuration for sending and receiving radio signals as part of a transceiver module. The electronic devices can also have an internal electrical power supply, for example can be realized with a replaceable or rechargeable battery. The devices can also be powered by wires, either through an external power supply or via “Power over LAN”.

These and other aspects of the invention will become apparent from the figures discussed below.

Character description

The invention is explained in more detail below with reference to the attached figures using exemplary embodiments, to which the invention is, however, not limited. The same components are provided with identical reference numbers in the various figures. It shows in a schematic way:

1 shows a head of a person with a binaural hearing aid system with a processing device on each ear of the head;

Fig. 2 direction information for the binaural hearing aid system in the horizontal plane relative to the head;

Fig. 3 Directional characteristics of the microphones used in the binaural hearing aid system;

Fig. 4 is a block diagram of a binaural hearing aid system;

Fig. 5 shows a signal processing chain used in the processing devices;

Fig. 6 structural details of the processing devices in an exploded view;

7 shows the processing device with electronic components or assemblies accommodated in its housing and additional expansion modules that can be connected to it;

Fig. 8 shows a dynamic interface of the processing devices realized with the help of two touch bars;

Fig. 9 shows a typical wearing position of the processing device on the right ear with a user interaction by a finger on a surface interaction area of the processing device;

Fig. 10 shows user interaction in a zoom view;

Fig. 11 the areal interaction area with profiles assigned to its end areas for controlling the signal processing chain; Fig. 12 a movement of the finger along the areal interaction area and the resulting change of the values and settings for the signal processing chain;

13 shows a reverse movement compared to FIG. 12 and the associated change in the values or settings for the signal processing chain;

14 shows an example of an interaction-related change in the values and settings used in the signal processing chain;

Fig. 15 to 20 a user interface of a smartphone application for configuring various settings of the processing device(s);

Fig. 21 shows a further embodiment of the areal interaction area; Fig. 22 shows a first two-finger user interaction and its effect;

Fig. 23 a second two-finger user interaction and its effect; Fig. 24 a visualization of the mixing of two profiles for audio signal processing;

Fig. 25 an influence of a finger position on a touch bar on the profile mixture;

Fig. 26 shows an effect of the mix based on two profiles, each with three audio effects;

Fig. 27 an exemplary parameter collection of a profile;

Fig. 28 shows an individualization of a profile using a smartphone.

Description of the exemplary embodiments

1 shows a head 101 of a person 100 who is wearing a binaural hearing aid system 1, hereinafter referred to as system 1, which has a first processing device 2 worn on the left ear 102 and a second processing device 3 worn on the right ear 103 to enable the person 100 to have an improved, in particular natural, hearing experience with both ears 102, 103. The designations front V, back H, left L, and right R correspond to the natural direction information in relation to the head 101 of the (standing or sitting) person 100, so that the face faces forward V, the left ear 102 faces left L and that right ear 103 is aligned to right R. The same applies to the usual directions above O and below U. Between them Processing devices 2 and 3 also indicate a radio connection, which will be discussed in detail below.

Figure 2 shows the four directions V, H, R and L based on the head 101 of the person 100, which is viewed from above, with the face of the person 100 looking forward V, which corresponds to the degree 90°. The degree is given in the horizontal plane, which is positioned essentially at the level of the ears 102, 103. The head 101 is indicated on the circumference and marked with a cross 200, the longest section of the cross 201 being oriented from the center of the head 101 towards the nose. This is mentioned at this point because this type of representation is also used in the following figures.

Each of the processing devices 2 and 3 shown in Figure 1 has two microphones 10 and 11 or 12 and 13 (not shown, but see e.g. Figures 3 and 4), so that sound can be recorded in all four directions V, H, L and R, as shown in Figure 2. The main recording directions of the four microphones 10-13 shown in Figure 2 are indicated here by the direction information "left-front" LV, "right-front" RV, "left-back" LH and "right-back" RH.

The directional characteristics LVC, LHC, RVC and RHC of the microphones 10-13 shown in Figure 3 are (three-dimensionally) kidney-shaped and essentially symmetrical about these main detection directions LV, RV, LH, RH. The directional characteristics LVC, LHC, RVC and RHC are defined by the type of microphone 10-13 and the positioning or orientation of the microphone 10-13. The directional characteristics LVC, LHC, RVC and RHC essentially cover the entire area around the head 101 of the person 100 and thus allow all-round detection of the sound hitting the head 101. It should only be mentioned at this point that the microphones 10-13 are shown detached from the head 101 in order to make them visible at all. In fact, they are integrated in the processing devices 2 and 3, which can be seen in Figures 4, 6, 7, 8.

In Figure 4, the two processing devices 2 and 3 are discussed below using a block diagram. The two processing devices 2 and 3 are battery-operated and therefore have each have a rechargeable battery 25 which provides a supply voltage VCC relative to a reference potential GND.

The first processing device 2 has a first processing stage 4. The processing stage 4 is connected to a first Bluetooth radio module 6, in short first radio module 6, and a fourth Bluetooth radio module 9, in short fourth radio module 9, via a UART connection 17 for setting or programming the radio modules 6 and 9, respectively, and via an I ² S connection 18 for the separate transmission of audio data.

Under the abbreviation UART, the expert understands a “Universal Asynchronous Receiver Transmitter”. Under the abbreviation I ² S, the expert understands a serial interface for audio transmission developed by Phillips, which is also known under the term “Inter-IC Sound”.

The first radio module 6 is connected by wire (in this exemplary embodiment via its analog microphone signal inputs) to a first microphone 10 and a second microphone 11. An individual microphone signal MSI or MS2 is generated with the first microphone 10 and the second microphone 11. The two microphone signals MSI and MS2 together form a first group Gl of microphone signals. The microphone signals MSI and MS2 arriving at the first radio module 6 are digitized for further processing using the first radio module 6.

The second processing device 3 has a second processing stage 5. The second processing stage 5 is with a third Bluetooth radio module 8, short third radio module 8, and a second Bluetooth radio module 7, short second radio module 7, each via a UART connection 17 for setting or programming the radio modules 6 and 9 and each connected via an I ² S connection 18 for the separate transmission of audio data.

The third radio module 8 is connected via a cable (in this embodiment via its analog microphone signal inputs) to a third microphone 12 and a fourth microphone 13. The third microphone 12 and the fourth microphone 13 each generate an individual microphone signal MS3 or MS4. The two microphone signals MS3 and MS4 together form a second group G2 of microphone signals. The The microphone signals MS3 and MS4 arriving at the third radio module 8 are digitized for further processing using the third radio module 8.

At this point it should be mentioned that the respective group Gl or G2 of the microphone signals can also be fed to the radio modules 6 or 7 as a digitized audio data stream if appropriately designed microphones are used which support such a creation of the audio data stream.

Each of the radio modules 6 to 9 has an antenna configuration 14 and the usual transceiver electronics (not shown in detail) for Bluetooth radio communication.

During operation, a first radio connection 15 is established between the first radio module 6 and the second radio module 7 and the first group G1 of the microphone signals is transmitted from the first radio module 6 to the second radio module 7. For this radio signal transmission, the first radio module 6 is used exclusively as a transmitter and the second radio module 7 is used exclusively as a receiver.

During operation, a second radio connection 16 is also established between the third radio module 8 and the fourth radio module 9, and the second group G2 of microphone signals is transmitted from the third radio module 8 to the fourth radio module 9. For this radio signal transmission, the third radio module 8 is used exclusively as a transmitter and the fourth radio module 9 is used exclusively as a receiver.

Furthermore, in this operating configuration, audio data representing the first group Gl of the microphone signals are transmitted from the first radio module 6 and audio data representing the second group G2 of the microphone signals are transmitted from the fourth radio module 9, each via the separate I ² S connections 18, to the first processing stage 4. Furthermore, in this operating configuration, audio data representing the first group Gl of the microphone signals are transmitted from the second radio module 7 and audio data representing the second group G2 of the microphone signals are transmitted from the third radio module 8, each via the separate I ² S connections 18, to the second processing stage 5. Thus, both the first processing device 2 and the second processing device 3 have both groups Gl and G2 of the microphone signals, i.e. all microphone signals MSI to MS4, available for further Signal processing is available, whereby the individual, unidirectional transmission via two separate radio links 15 and 16 - as discussed in the general part of the description - forms the basis for the further phase-synchronous signal processing of all microphone signals MSI to MS4 in each of the processing devices 2 and 3 in real time.

In this exemplary embodiment, the four radio modules 6 to 9 are each implemented by a component from “MICROCHIP” called “BM83 Bluetooth® Stereo Audio Module”. The two processing stages 4 and 5 are implemented in this exemplary embodiment by a component from “NXP Semiconductors” called “i.MX RT1160”. For reasons of clarity, a discussion of any additional (analog) components that are to be provided in the context of the digital components mentioned is omitted. The expert can find this out from the relevant data sheets.

Each of the processing devices 2 and 3 has a gyroscope 21a and 21b, respectively, with which position data LD are generated, which represent the position or the change in the position of the respective processing devices 2 and 3, respectively. Each of the processing stages 4 and 5 is connected to the respective gyroscope 21a and 21b and takes the respective position data LD into account during the further processing of the two groups G1 and G2 of the microphone signals, so that position changes can be compensated for in this further processing.

Each of the processing devices 2 and 3 further comprises a touch-sensitive input module 20, which is divided into a first input module controller 19a (implemented with the aid of a microcontroller) and a first so-called "touch strip" 20a connected to it, and a second input module controller 19b (also implemented with the aid of a microcontroller) and a second touch strip 20b connected to it. The two touch strips 20a and 20b form external features of two touch bars, each of which has a touch-sensitive surface. The input module 20 can define freely assignable zones on the touch strips 20a and 20b and thus divide the area available there into menu items, for example into an upper and lower half, so that the functions assigned to the menu items can be triggered by touching with a finger. The assignment of the menu items to the zones can be predefined, changed or adapted depending on the operating state, or configured via an external app. The respective processing levels 4 and 5 are connected to the respective input module 20. The input module 20 is designed to capacitively detect the position of a finger of the person 100 on the respective touch strip 20a or 20b and to interpret it using the respective touch module controller 19a or 19b and to generate interaction data ID and to provide it for the respective processing levels 4 or 5, where this interaction data ID is processed according to the currently valid menu assignment of the respective touch strip 20a and 20b. With the help of this menu assignment, for example, areas can be defined on the touch strip 20a and 20b that are used to directly activate profiles, or areas can be defined that are used to control the volume, or areas can be defined that are used to align a virtual microphone, etc. It should also be mentioned at this point that the interaction data ID can also be generated by means of an external interaction source, such as a smartphone, a tablet computer or a cloud-based software solution, and transmitted via a radio connection to one of the processing devices 2 or 3 or to both processing devices 2 and 3 in order to use them there for further processing.

The interaction data ID as well as the position data LD can be transmitted together with the microphone signals MSI and MS2 or MS3 and MS4 via the corresponding radio connections 15 and 16 to the other processing device 2 or 3, so that both processing devices 2 and 3 are synchronous with one another can be operated or simply keep each other informed about the respective interaction or situation.

The two processing devices 2 and 3 each have a visual signaling stage 26, which is essentially formed by an LED that is controlled by the respective radio module 6 or 8 to which it is connected. The visual signaling stage 26 serves, for example, to display a transmission activity or to display a charge status of the battery 25 of the respective processing device 2 or 3. Furthermore, each of the processing devices 2 and 3 has an output module 22, which is divided into an amplifier 22a or 22b and a loudspeaker 23a or 23b coupled thereto. The amplifiers 22a, 22b are an I2C Class D amplifier which is connected to the respective processing stage 4 or 5 via an I ² C connection and is designed to be supplied with digital audio data from there and from this to generate a correspondingly amplified output audio signal with which the loudspeaker 22a or 22b is controlled.

Furthermore, each of the processing devices 2 and 3 has a removable storage medium read/write stage 24, with the aid of which a removable storage medium can be written with data or data can be read from the removable storage medium. This can be setting data, user data, audio data or even application data, etc., which are made accessible to the system or the respective processing device 2 or 3 or are retrieved from there. This can also provide a memory extension for processing activities that require a lot of computing or data. This also allows executable applications to be made available in the system 1 in a physical way, possibly even encrypted.

The reference numerals 27 to 29 are not used.

Below, with the help of Figure 5, the signal processing chain 30 used in each of the processing devices 2 and 3 with the help of the processing stages 4 and 5 will be discussed.

In this signal processing chain 30, the two groups Gl and G2 of the microphone signals MSI - MS4 are fed into a first signal processing stage 31 on the input side. In the first signal processing stage 31, all functions for ambisonics-related signal processing are combined, taking into account the position data LD and/or the interaction data ID that relate to the ambisonics-related signal processing. Here, for example, an audio data stream structured according to the Ambisonics format is generated, the position data LD of the gyroscope 21a or 21b is taken into account, one or more virtual microphones are defined or controlled, etc. With this functionality, the first signal processing stage 31 generates from the four microphone signals MS1-MS4 a first audio data stream ADI, which is fed into a second signal processing stage 32.

In the second signal processing stage 32, all functions for hearing curve adaptation-related signal processing are summarized, including or taking into account the interaction data ID, which relate to the hearing curve adaptation. A hearing curve adjustment works by correcting the hearing curve of an impaired ear to approximate that of a healthy ear. This essentially uses a static equalizer. With this functionality, the second signal processing stage 32 generates a second audio data stream AD2 from the first audio data stream ADI, which is fed into a third signal processing stage 33.

In the third signal processing stage 32, all functions for hearing profile-related signal processing are summarized, including or taking into account the interaction data ID, which relate to the hearing profile settings. A hearing profile includes those audio signal processing parameters that are tailored to the ear or person in question and which improve or positively influence the intelligibility of speech, participation in a group discussion, listening to music, etc. If the respective hearing profile is activated, i.e. used in the signal processing chain, the intelligibility of individual speech is improved, participation in a group discussion is made easier, the natural perceptibility of music is promoted, etc. With this functionality, the third signal processing stage generates 32 from the second audio data stream AD2 a third audio data stream AD3, which is fed into a fourth signal processing stage 34.

In the fourth signal processing stage 34, all functions for hearing aid function-related signal processing are summarized, including or taking into account the interaction data ID, which relate to the hearing aid function settings. This can be, for example, "Quality-Of-Life Improvements" such as additional noise filtering, echo/reverb filtering, etc. Plugins can also be integrated here that can be defined/downloaded by yourself. The fourth signal processing stage generates this functionality 32 from the third audio data stream AD3 a fourth audio data stream AD4, which is delivered to the ear 102, 103 of the person 35 wearing the system 1 by means of the aforementioned output module 22.

Finally, for reasons of clarity, it should be mentioned that the signal processing stages 31 to 34 shown as structural blocks can essentially be based on software modules, although of course hardware optioned for the respective function, possibly programmable in combination with software, can also be used .

The structure of the physical structure of the processing device 2 or 3 is discussed below with the help of Figure 6. The two processing devices 2 and 3 are structured as follows.

They have a loudspeaker capsule 36 which is designed for use in the external auditory canal and accommodates the loudspeaker 23a or 23b in a housing.

They also have a first flexibly deformable connecting element 37, which is essentially formed from a body consisting of deformable plastic, in particular polyurethane plastic or silicone.

They also have a rigid first housing 38, which shows a first touch-sensitive part 39 of the first touch strip 20a, so that the touch-sensitive part 39 is oriented laterally or forwards or oriented obliquely forwards as unhindered as possible when the processing device 2 or 3 is worn on the head the ear cup is accessible or touchable on the first housing part.

They also have a second flexibly deformable connecting element 40, which is essentially formed from a body consisting of deformable plastic, in particular polyurethane plastic or silicone.

They further comprise a rigid second housing 41 which, on the one hand, is shaped to fit the shape of the outer ear from its front to its rear area in order to be accommodated between the ear and the skull, and which, on the other hand, is designed to be large enough to accommodate the loudspeaker 23a or 23b and the first touch-sensitive part 39 of the touch strips 20a. remaining electronic components of the processing device 2 or 3. These electronic components are connected by cable to the first touch-sensitive part 39 of the touch strips 20a and the loudspeaker 23a or 23b, which is not shown for reasons of clarity.

The second housing part 41 therefore contains a processing module of the corresponding processing device 2 or 3. In this embodiment, the processing module has the respective processing stage 4 or 5, the two radio modules 6 and 9 or 8 and 7, two microphones 10 and 11 or 12 and 13, the respective gyroscope 21a or 21b and the respective visual signaling stage (not shown here). Externally visible on the second housing 41 are a second touch-sensitive part 42 of the second touch strip 20b, the second touch-sensitive part 42 being used primarily for volume adjustment, and a magnetically held connection 43 or its contact field, which shows six contact elements.

In the first processing device 2, the first microphone 10 or its sound inlet opening(s) is present on the second housing 41 at its front end, although this is not visible in the selected perspective of Figure 6. Furthermore, the second microphone 11 or its sound inlet opening(s) is visible on the second housing 41 of the first processing device 2.

Analogously, in the second processing device 3, the third microphone 12 or its sound inlet opening(s) is present on the second housing 41 at its front end, which, however, is not visible in the selected perspective of FIG. Furthermore, the fourth microphone 13 or its sound inlet opening(s) is visible on the second housing 41 of the first processing device 2.

Figure 7 will be discussed further, in which the processing device 2 or 3 is shown assembled in contrast to Figure 6. The areas of the rigid second housing part 41 are shown here as transparent or cut free in some areas in order to reveal the assemblies or electronic components arranged therein. In this illustration, the integrated circuits mentioned are in an upper area 44A Analog electronic components are arranged for the radio modules 6 and 9 or 8 and 7, for the input module 20 and for the processing stages 4 and 5. In a rear area 44B there is an electrical supply, which in the present case is implemented with two rechargeable button cell-like batteries 25, and a haptic module 45, not yet shown, which can be controlled with the aid of the respective processing stage 4 or 5.

Furthermore, an optional expansion module 51 connected to the magnetically holding connection 43 is shown in FIG. In a non-exhaustive list, these can be the following types of modules: a battery charging module 46, a microphone cube (not shown), a jack plug adapter 47, a USB adapter 48, a radio device 49 that can be logically linked to the system 1, with its help Audio or settings data from another device, to which the radio device 49 is then connected, for example via a USB port, can be transmitted via radio to the system 1 or vice versa, a microphone extension 50, etc.

The rechargeable batteries 25 can thus be charged using the battery charging module. A docking station can also be provided, into which the two processing devices 2 and 3 can be coupled using the connection 43, so that the batteries 25 can be charged in the docking station.

In principle, the system 1 can be designed to process Ambisonics according to a higher order than that provided by the microphones 1 to 13 permanently installed in the system 1 (in the present case, this is the first order). This circumstance allows further microphones to be connected to the connection 43 and thus to use the higher order, without any change to the basic design of the system 1 being necessary.

Below, with reference to Figure 8, the user interface integrated in the system 1 with an exemplary menu assignment of the first touch-sensitive part 39 of the touch bar 20 for both of the processing devices 2 and 3 and the functions of the system 1 that can be controlled with it are discussed. In the present case, the menu assignment is defined such that in the second processing device 3 the upper half of the first touch-sensitive part 39 defines a first profile zone 53 for selecting a first profile for the signal processing chain 30 and the lower half of the first touch-sensitive part 39 defines a third profile zone 55 for selecting a third profile for the signal processing chain 30. Furthermore, the menu assignment is defined such that in the first processing device 2 the upper half of the first touch-sensitive part 39 defines a second profile zone 54 for selecting a second profile for the signal processing chain 30 and the lower half of the first touch-sensitive part 39 also defines the third profile zone 55 Selection of the third profile for the signal processing chain 30 is defined.

The three profiles for the signal processing chain 30 summarize the respective signal processing settings or signal processing parameters that are to be used in the signal processing chain 30 depending on the activated menu.

Touching one of the profile zones 53 - 55 (upper or lower half) of the relevant touch-sensitive part 39 selects the respective associated profile in order to use it in the signal processing of the microphone signals MSI - MS4. This takes place in real time, while the person 100 is wearing the system 1 and the signal processing chain 30 is being run through. The profile transition between the currently active profile and the profile selected by touching the respective zone is preferably smooth, which is also referred to as "fading" and is planned to take a certain amount of time, for example one to three seconds, preferably around 2 seconds, so that a smooth transition to the selected profile and therefore to be used is created. Abrupt signal processing changes, which could sometimes be interpreted as disruptive or a malfunction, are thus reliably avoided.

However, the software of system 1, i.e. of each processing device 2 or 3, also allows a "hold and swipe" functionality, which is referred to in technical jargon as a "swipe" functionality, which is advantageously used in the context of system 1 to mix profiles with one another. The person first touches one of the profile zones 53 - 55, leaves the finger on it and then drags the finger into the adjacent profile zone before the finger is lifted from the touch-sensitive element. This is interpreted by the software in such a way that the profiles assigned to the two profile zones swept by the fingers are to be mixed. For example, if the right, second If the finger is started on the first profile in the processing device 3 and swiped or stroked downwards to the third profile, then the signal processing settings applicable to the signal processing chain 30 according to the first profile are mixed with those of the third profile. If the same is done on the left, first processing device 2, the signal processing settings of the second profile are mixed with those of the third profile. In addition, the degree of mixing (or in other words the mixing ratio) of the two profiles to be mixed can be adjusted by the width of the swiping movement (defacto between 0 and 100%). As an example, let us assume in this context that the first profile of the signal processing chain 30 was designed for natural hearing (home setting) and the third profile of the signal processing chain 30 was programmed as an autofocus on speech signals, so that the beamformer in the first signal processing stage 31 always selects a speech vector and the DSP (DSP stands for "digital signal processor") of the third signal processing stage 33 is set to speech. If you now touch the first profile zone 53, hold it and then swipe downwards, the stable "home" profile approaches the uncompromising speech autofocus. However, the mixing ratio can advantageously be controlled by the width of the finger movement, i.e. dynamically adjusted in real time. As a result, an audio signal optimized for normal hearing is mixed with an audio signal optioned for speech according to the selected mixing ratio.

Using the "swipe" functionality, the user can also dynamically switch back and forth between the two profiles or dynamically change the mixing level as long as his finger is resting on the touch-sensitive element but is being moved there, for example to find out which mixing ratio suits him best or to consciously switch back and forth between two mixing ratios in order to temporarily optimize his acoustic perception according to the first profile or the second profile at short intervals. Only when he lifts his finger from the touch-sensitive element is the mixing ratio set at that time fixed. Furthermore, the user, i.e. the person 100 wearing the system 1, always returns to the original, stable listening mode (the "home" profile) with a "swipe" gesture up or down, i.e. with a quick swipe of the finger across the two zones touching the touch-sensitive element, regardless of whether this "swipe" gesture is carried out on the first processing device 2 or the second processing device 3.

This makes it easy to control a complex command chain without an external device, such as a smartphone or a tablet computer, etc., which can intervene in every element of the signal processing chain 30 as necessary.

This means that the entire system 1 can be controlled in a touchable way. As mentioned, the touch bar 20 is freely assignable and can control practically all system parameters, i.e. the settings of the signal processing chain 30. This allows the user to intervene in their sound reality in real time. As mentioned, dynamic profiles can also be generated with it, whereby the profiles placed on the touch bar 20 are mixed with each other as discussed. This makes it easy to control complex DSP functions, for example, and gives the user the feeling that they are interacting with the sound. The feeling of the user, often perceived as a disadvantage with known systems, that they are only changing programs with a plastic button, is thus completely avoided.

In addition, the user interface can adapt dynamically to the user, e.g. as a result of an interaction that has just been carried out or due to external circumstances that were determined, for example, through the evaluation of the incoming sound.

The user interface can also change its state briefly and, for example, provide the function of a call acceptance button when a call is received via a smartphone, which is communicated to System 1 via a Bluetooth connection with the smartphone, for example. However, the short-term change can also be caused by the evaluation of the incoming sound if this appears necessary based on the evaluation.

Likewise, a zone (eg the upper half) of the touch strip 20a or 20b can be assigned to the "Speech Autofocus" function. Tapping in the upper area of the touch strip 20a or 20b assigned to this menu item then executes a special plug-in (i.e. a software component) in processing stages 4 and 5, with the help of which the sound field is searched for speakers and one or more virtual microphones are aimed at these sound sources or spatial areas or directional areas in which the sound sources were identified.

Similarly, a "just listen" function can be activated via the touch bar 20. This can be a completely stable hearing program that is, however, adapted to the hearing curve of the user of System 1 and is therefore suitable for or leads to a natural hearing sensation. This function would consist of a mix of omnidirectional and/or, for example, cardioid directionally recorded audio signals (vector to the front, front of user). The mix of the individual microphone signals MSI - MS4 is determined, which is determined by binaural (localization) hearing tests. The frequency response (including compressor values) results from a binaural (frequency) hearing test. The polar pattern, i.e. the directional characteristic used, is generated by the mix of several virtual microphones. This applies to all programs of this System 1. The only difference here is that the mix is absolutely static. The fact that the mix is stable means that no automatic mechanisms intervene during operation. The localization ability is restored by binaural mixdown, which is known in the context of Ambisonics.

This "just listen" profile also forms the basis of all other profiles, with the difference that other profiles can create and freely mix freely definable virtual microphones of any type and number (limited to the order of the microphone array 10 - 13; in the present embodiment it is First Order Ambisonics). An example of this is a "noise cancelling" function that can be called up on the touch strip 20a or 20b, which has a dynamic behavior. When the "noise cancellation" profile is active, the environment is continuously analyzed and noise in the sound field is selectively removed fully automatically. This function searches for and suppresses permanent (interference) noise, while at the same time music, ambient noise to be observed and speech remain consistently perceptible for the user. The Signal processing chain 30 therefore adapts dynamically to the spatial and temporal dynamics of the noise.

In general, it should be noted that with an increasing number of microphones (and thus axes) the complexity/depth of the sound field scanning can be increased. Of course, you can then make more precise calculations (narrower funnel of the virtual microphone, more accurate 3D field representation in the mixdown, more accurate energy distribution information / sound pressure vectors, etc.). The higher the Ambisonics order, the finer the content and spatial resolution of System 1. This order increases with the number of microphones. From a number of 4 microphones per device, i.e. per processing device 2 or 3 (2x4 / 1x8 matrix), each individual processing device 2 or 3 (i.e. both hearables) would enter the first order of spherical harmonics.

The haptic module 45, which can also be referred to as a feedback module, gives the user, i.e. the person who wears or uses the system 1, feedback under a wide variety of operating conditions, for example when the touch bar 20 or the respective touch strips 20 a or 20b were touched or the system 1 wants to communicate something during normal operation. This feedback module serves to enable uninterrupted “notifications”, i.e. messages, to the user. The sound image, which is generated for the user by the system 1, is never disturbed by the tactile feedback when the volume or program changes, etc , because this provides feedback without acoustic interruption or acoustic overlay.

The operation of the device 2 or 3 using the movements carried out by the person 100 is described below with the help of the other figures. In general, we would like to point out again the ease of use, which is achieved by the special position of the touch strip 20a or 20b along the front edge of the ear and its linear design, which extends approximately from top to bottom when the head 101 is oriented straight and facing forwards. This is visualized in Figure 9 with the help of the person 100 shown diagonally from the back right, who wears the second processing device 3 on his right ear and touches the second touch strip 20b with his right index finger 104. touched in order to influence the signal processing chain 30. Figure 10 shows the detail of the touch of the second touch strip 20b with the first link of the right index finger 104 in order to visualize the size relationships. The following explanations also apply analogously to the operation of the first touch bar 20a for the first processing device 2 worn on the left ear, which is operated analogously with the left index finger of the left hand.

With reference to Figure 11, it is now assumed that a first area, such as a head area 90, of the second touchbar 20b has a first profile PI and a second area, such as a foot area 91, of the first touchbar 20a has a second one Profile P2 is assigned. The data structure DS of the profiles PI and P2 is constructed identically in order to easily enable the "mixing" of the values or settings of the two profiles as a result of user interaction.

This data structure DS is visualized by a first matrix M1 and a second matrix M2 with “boxes” that represent data elements, with each box of the first profile PI being assigned exactly one box of the second profile P2. The columns here contain the ones for the respective one The signal processing parameters used in signal processing stages 31 to 34 come together, with a line entry for storing the relevant value or the relevant setting of a signal processing parameter being provided for each signal processing parameter. Those boxes that are filled with the number “1” indicate that it is these are the values or settings for the respective signal processing parameters according to the first profile PI. Those boxes filled with the number “3” indicate that they are the values or settings for the signal processing parameters according to the second profile P2.

The operation of the user interface and the associated changes to the values or settings of the signal processing parameters are further visualized using Figures 12 to 13.

12 shows, with three images along the time axis t, a temporal sequence of movements during the condition of the user interface, whereby the finger 104 is first placed in the head area 90 and is subsequently moved to the foot area 91, while the finger remains in contact with the touchstrip 20b. The finger 104 is in an intermediate position between the head area 90 and the foot area 91, as shown in the middle figure. Only when the foot area 91 is reached is the finger 104 lifted off the touch strip 20b. This sequence of finger movement - i.e. the initial placement of the finger on the touch strip 20b in the head area 90 and the movement along the touch strip 20b and the final lifting of the finger from the touch strip 20b in the foot area 91 - is controlled by the input module controller 19a continuously digitally recorded and represented with the help of the interaction data ID, which is processed by the second processing stage 5. The interaction data ID describes the detected movement of the finger 104 as a "hold and swipe" movement and also provides the respective position of the finger 104 along the touch strip 20b in real time as long as the finger is held on the touch strip 20b. Provided with this information, the second processing stage 5 in real time the values or settings of the signal processing parameters of the first profile 1 - scaled according to the respective position of the finger 104 between the two outermost ends of the first touch strip 20a - to the values or settings of the signal processing parameters of the second profile P2 The fundamentally dynamic process is visualized in a snapshot for the intermediate position by a third matrix M3, the boxes of which contain the number "2", which indicates that it is an intermediate profile P3 generated dynamically in real time, which is used in real time in the signal processing chain 30 is applied. The values and settings of the respective signal processing parameter of the intermediate profile P3 result from a (for example linear) interpolation, which is dependent on the position of the finger 104, between the value or the setting of the signal processing parameter of the first profile PI and the value or the setting of the latter corresponding signal processing parameter of the second profile P2. This interpolation is performed for each signal processing parameter. The listening experience that is conveyed by the intermediate profile P3 therefore represents a mixture of the respective listening experience conveyed by the first profile 1 and the second profile P2, the mixing ratio being given by the finger position. So the position of finger 104 essentially affects everyone Signal processing parameters, unless they are intended to be constant or are not listed as identical in the two profiles PI and PI.

In comparison to Figure 12, Figure 13 shows the reverse process, i.e. that the starting point of the "hold and swipe" movement is the foot area 91, to which the second profile P2 is assigned, and that the movement runs via an intermediate position, where a dynamically generated intermediate profile P3 is created and applied, to the head area 90, to which the first profile PI is assigned.

The finger 104 can also remain on the touch strip 20b for a longer period of time while it is moved up and down, i.e. a back and forth "swipe" movement is carried out in order to continuously generate an intermediate profile P3 corresponding to the respective finger position. The person 100 can use this process as a type of fine adjustment of the intermediate profile P3 in order to find the ideal setting of the signal processing parameters of the intermediate profile P3 for the listening experience. As soon as the interaction is ended, i.e. the finger is lifted from the touch strip 20b at any intermediate position, the processing stage 3 ends the interpolation of the values or settings of the signal processing parameters between the first profile PI and the second profile P2 for the intermediate profile P3 and the intermediate profile P3 present at this time is retained from then on for the signal processing chain until the next "hold and swipe" movement is detected or the person directly taps the head area 90 or the foot area 91 to select the profile Pl assigned there. or P2 is activated immediately.

As a concrete example of the dynamic, real-time creation of the intermediate profile P3, please refer to Figure 14. It shows the first profile PI, the second profile P2 and the third profile P3 in a meta-description of its signal processing parameters.

The meta description characterizes here in an exemplary manner: noise suppression 93; an orientation 94 of the virtual microphones, i.e. an ambisonic focus; a gain or volume 95; a compressor ratio 96; a bandpass frequency range 97. The first profile PI is optimized for the pure perception of speech that comes from a direction corresponding to the direction in which the person is looking.

The second profile P2 is optimized for general all-round hearing or in other words “everything hearing”.

The intermediate profile P3, which results from detecting a "hold and wipe" movement of the finger of the person 100 when the finger 104 is positioned exactly in the middle between the head area 91 and the foot area 92, forms an interpolated one in real time Compromise for the listening experience of the person 100 between the two listening experience extremes of the predefined profiles PI and P2.

In the following, with the aid of Figures 15 to 20, a configuration application is discussed which is executed on a mobile phone 98, wherein the mobile phone 98 is in (radio) connection with at least one of the processing devices 2 or 3 in order to transmit the settings made by the person 100 to the latter.

As can be seen in Figure 15, the application shows one of the two touch stripes 20a or 20b and a list of profiles Pn, Pm, Po, ... that can be assigned to the head area 90 or the foot area 91. In the present case, the profile Pn was assigned to the head area 90 by manual selection and the profile Pm was assigned to the foot area.

As can be seen in Figure 16, the person can select 100 different movements or gestures from a list and associate these movements or gestures with profiles for both the left and right processing devices 2 and 3, respectively. This allows actions to be triggered in relation to the applications of individual profiles without having to do the aforementioned interpolation between two profiles. The gestures listed here are, for example, touch & hold (marked as "T&H") or, in plain text, "TAP" and "SWIPE" upwards, where the direction of the swipe is indicated by an upward arrow.

Figure 17 shows movements or gestures that must be performed essentially simultaneously on both touch strips 20a and 20b in order to activate the profile Pn - Pp shown next to it. The symbols shown are to be understood as follows. An arrow pointing upwards as well as an arrow pointing downwards represents a swiping movement, where the direction of the swipe is indicated by the respective arrow direction. A closed ring represents a single short-term touch (one tap). A dotted ring represents a double short-term touch (double tap).

Figure 18 also shows setting options that affect the function and operation of the touch strips 20a and 20b. The two touch strips 20a and 20b can be operated in a coupled or uncoupled (individual) state. The sensitivity can also be adjusted. It can also be specified that haptic feedback should be provided, etc.

Figure 19 shows settings of how the detected movement or gesture Eq. G7 can be used to (media) control an external device, such as a smartphone. You can use movements or gestures to accept calls, mute calls, increase or decrease the volume of the external device or mute the device. The playback of songs, messages or other multimedia sources can also be controlled, such as starting playback, pausing playback, stopping playback or even basic control of an external device - in this case a PC - etc.

Figure 20 shows an interface for learning movements or gestures, so that the person can define 100 self-developed movements or gestures or can also adapt the characteristics of given movements or gestures to their own needs or circumstances. The movement or gestures learned by the application can then be associated with the respective profile (here e.g. bottom).

The areal interaction area of the input module 20 is discussed below. The areal interaction area can, for example, be designed as a continuous area between the head area 90 and the foot area 91. However, according to a special form of training, the area of interaction can also be structured. Such a structured, area-wide interaction area is shown, for example, in FIG. 21. In this embodiment, the touch strip 20a or 20b has three separate touch-sensitive detection zones, namely a first detection zone 110, a second detection zone 111 and a third Detection zone 112, with which a touch or a movement can be actively detected electronically, in particular capacitively. Each of the detection zones 110 - 112 of the relevant touch strip 20a or 20b is connected to an input module controller (each with a separate or all with a common input module controller) so that touches and movements that occur in one of the detection zones Zones 110 -

112 or extend from one of the detection zones 110 - 112 to the other detection zone 110 - 112. The detection zones 110 - 112 can be directly adjacent to each other or connected to passive zones

113 and 114, as shown in Figure 21, must be separated from each other. The passive zones 113 and 114 do not allow direct detection of a touch or movement and only serve as a distance between the detection zones 110 - 112. The passive zones 113 - 114 can be straight, curved or - as shown in Figure 21 - wedge-shaped be trained.

Using the three-part touch strips 20a and 20b, menu areas or menu items can be assigned to the respective detection zone in a physically separate manner. In analogy to the previous discussions, for example, a first profile can be assigned to the head area 90 (here the first detection zone 110) and a second profile to the foot area 91 (here the third detection zone 112). Interpolation can be carried out between the profile settings (values or settings of the signal processing parameters) of the two profiles when a hold and swipe movement is present, as discussed, in order to generate the dynamic intermediate profile.

The middle detection zone 111 can be placed as a predefined third profile between the other two profiles, i.e. the first and the second profile. This means that intermediate profiles can now be created dynamically along the touch strip 20a or 20b, namely one between the listening experience extremes of the first profile and the third profile as well as one between the listening experience extremes of the third profile and the second profile.

However, the middle detection zone 111 can also be used only to quickly activate another profile or even just a single function, whereas the intermediate profile can only be set between the first and the second profile. As mentioned, the dynamic transfer - in other words a smooth change - of the settings of one profile to the settings of another profile can be carried out by user interaction, generating the dynamic intermediate profile. This can be used by the person 100 when they switch between different environments and consciously perform the hold and swipe movement. However, it can also be provided that the processing device 2 or 3 uses machine learning algorithms to make settings for the processing devices and to assign the profiles available there to the touch strips 20a or 20b. These automatisms can run on the basis of real-time recordings of signals or physical parameters using sensors and/or the microphones of the processing devices 2 or 3. It can also be provided that automatic interpolation takes place between these automatically assigned profiles. For this purpose, for example, previously recorded and evaluated user behavior can be used, which was taken into account in the machine learning.

Regardless of whether the manual or fully automatic variant is used, the concept of the flowing mixing of parameters includes the ability to seamlessly combine different profiles or parameter sets to achieve a better user experience. This makes it possible for the first time to mix several profiles, such as transparency, voice amplification, music settings, etc., seamlessly. Profiles can no longer be activated or deactivated in the sense of either/or. Rather, these defined profiles only define the corner points between which interpolation takes place depending on the respective four positions. Thus, when using one touch strip 20a and 20b each, at least four profiles can be available. Depending on whether the two processing devices 2 and 3 are operated independently of one another or in a coupled mode, on the one hand - in independent operating mode - two profiles can be mixed together on the left and right side, or on the other hand - in coupled operating mode - even three or up to four profiles can be mixed together. Since the processing devices 2 and 3 are naturally located at a position on the head that is inaccessible to the user's own visual perception, it can be advantageous to design the housing parts in such a way that it is clear where the finger is just by touching it. For example, the parts of the processing devices 2 and 3 that are connected to the touch strips 20a and 20b can be made of a different material than the touch strips 20a and 20b themselves. The edge of the touch strip 20a and 20b can also be designed differently along its length, such as being corrugated, grooved, etc., in order to provide the user with haptically perceptible position information.

The description so far has dealt very generally with the mixing or merging of profiles, which, as discussed, can be implemented as simply as possible by moving a single finger along the respective touch strip 20a or 20b. However, the touch strip 20a or 20b can also be used to control the alignment of virtual microphones of the Ambisonic signal processing stage. In this context, the processing device can also be configured (programmed) to detect that the person 100 places two fingers on the touch strip 20a or 20b.

Below is reference to Figure 22. The placing can be done with fingers spread out in a V-shape (e.g. index finger and middle finger of one hand), with one finger being placed on the head area 90 and another finger on the foot area 91 and then the fingers (i.e. both) facing each other towards the middle of the touch strip 20a or 20b can be moved. This movement, represented by the interaction data ID generated in the process, can be interpreted by the processing device 2 or 3 to the effect that a profile is set that enables all-round sound detection as a listening experience. Based on the previously set profile or generally the values and settings of the signal processing parameters used in the signal processing chain, when a two-finger movement is detected, a smooth transition of the values and settings is made in order to maintain all-round sound detection. Below is reference to Figure 23. However, the placement can also occur approximately in the middle of the touch strip 20a or 20b, after which both fingers (e.g. the index finger and the middle finger of one hand) are moved away from each other, i.e. one of the two fingers towards the head area 90 and the other both fingers are moved towards the foot area 91. This movement, represented by the interaction data ID generated in the process, can be interpreted by the processing device 2 or 3 in such a way that a profile is set that enables frontally oriented sound detection as a listening experience. Based on the previously set profile or generally the values and settings of the signal processing parameters used in the signal processing chain, when a two-finger movement is detected, a smooth transition of the values and settings is made in order to obtain the frontally oriented sound detection.

The touch stripe 20a or 20b can also be used to simply prevent the acoustically perceptible output of the audio data stream. Simply placing your finger on it for a longer period of time can be interpreted as muting the sound. When the processing device 2 or 3 is muted, the same gesture can be interpreted again to activate the sound emission.

It should also be mentioned that simply touching and holding (leaving your finger on) the touch strip 20a or 20b can also be used to activate the home profile mentioned above. It can also be provided that if this movement is performed on both ears at the same time, the device is muted.

Furthermore, the touch stripe 20a or 20b can also be used for the step-by-step selection of speakers in the person 100's surroundings. For example, the Ambisonic system may have preliminarily analyzed the environment of the person 100 and identified the existence of different speakers in different directions. This analysis can of course also be carried out continuously in real time. A relatively slow swipe movement from top to bottom can now be interpreted as changing the focus of the virtual microphones from a first to a second speaker in a clockwise direction. Such a movement from below upwards can be interpreted to mean that the focus of the virtual microphones is changed counterclockwise from a first to a second person.

The movements discussed above can of course also be interpreted the other way around.

Figure 24 is discussed below, which shows a further visualization of the mixing of two profiles PI and P2 into a final third profile P3 used in the signal processing chain 30. The first profile PI has a parameter collection A and the second profile P2 has a parameter collection B. The head area 90 of the touch bar 20b is 100% assigned to the PI profile, so that when the finger is positioned there, only the parameter collection A is used in the signal processing chain 30. The foot area 91 of the touch bar 20b is 100% assigned to the second profile P2, so that when the finger is positioned there, only the parameter collection B is used in the signal processing chain 30. When the finger is positioned between these two extremes, depending on the finger position FP, the proportion of parameter collection A (decreasing from the head area 90 to the foot area 91) is mixed linearly with the proportion of parameter collection B (decreasing from the foot area 91 to the head area 90), so that the proportions of the respective parameter collections A and B always add up to 100%. The result of this mixing is manifested in the third profile P3, which has the parameter collection C. The arrows pointing up and down visualize the scope for finger positioning on the touch bar 20b between their tips.

In addition to Figure 24, Figure 25 shows how the finger position FP is specifically used to mix the profiles PI and P2. In the present case, it is assumed that the recorded finger position FP is specified with a position detection value PEW in percent between 0% at the foot area 91 and 100% at the head area 90. For example, the finger is now positioned exactly in the middle between the foot area 91 and the head area 90, so that the finger position FP is specified with a position detection value of 50%. Accordingly, the parameter collection A of the first profile and the parameter collection B of the second Profiles weighted at only 50% each are used to generate the third profile P3.

This system is visualized as an example in Figure 26. Here, the three profiles PI to P3 are defined by parameter collections A to C. Each parameter collection A - C describes three (audio) effects, namely a first EFFECT X, a second EFFECT Y and a third EFFECT Z, which are used with different weights or with different intensities (VALUE = 100, VALUE = 50 and VALUE = 0) depending on the profile PI to P3. According to the central finger position FP defined in connection with Figure 25, the third profile P3 for the parameter collection C results in a VALUE=50 for all three EFFECTs X - Z, because the EFFECT X - Y of the respective profile 1 or 2 is rated at 50% and then combined summarily.

In further detail on this general description, an exemplary parameter collection for one of the profiles that contains different audio effects is shown in FIG. 27. In the table listed there, the audio effect in question is listed as "EFFECT" in the first column S1, and the value description is listed as "VALUE DESC" in the second column S2. and the relevant value is listed in the third column S3 with “VALUE”.

Figure 28 shows the process of personalizing a profile, here the first profile PI, using a smartphone SP. An app (software application) is running on the smartphone SP, which provides the necessary user interface. The user can first select the particular profile he/she wants to customize. In the present case, the profile for the parameter collection A is selected, assigned to the head area 90 of the touchbar (selection "ASSIGN TO TOP") and the audio effect A (selection "EFFECT A") with a value of 100 (selection "VALUE A 100") is selected. The selection of the audio effect can be completed for the available audio effects (EFFECT B to C). This results in the parameter collection A, which is summarized in a data block DB. This parameter collection A is then to the hearing device 2 or 3 or the hearing devices 2 and 3 (previously referred to as processing device 2 and 3), for example via Bluetooth transmitted and is available there for further audio signal processing.

Finally, it should be pointed out once again that the figures described in detail above are only exemplary embodiments which can be modified in a variety of ways by a person skilled in the art without departing from the scope of the invention. For the sake of completeness, it should also be pointed out that the use of the indefinite articles "a" or "an" does not exclude the possibility that the features in question may be present multiple times.

Claims

Expectations 1. Processing device (2, 3), in particular headphones or hearing aid, wherein the processing device (2, 3) has a signal processing chain (30) which is designed to process microphone signals (MSI - MS4) according to values or settings of signal processing parameters of a profile into an audio data stream, wherein a first profile and a second profile are provided, and wherein the processing device (2, 3) is designed to change the values or settings of the signal processing parameters of the first profile to those values or settings of the signal processing parameters of the second profile or vice versa, taking interaction data (ID) into account, wherein the interaction data represents a user interaction recorded as a movement, in particular a movement known as "hold and swipe". 2. Processing device (2, 3) according to claim 1, which is designed to receive and use the interaction data (ID) from an external interaction source by means of a radio connection. 3. Processing device (2, 3) according to claim 1, which has an input module (20) with a flat interaction area, the input module (20) being designed to detect a movement, in particular a wiping movement, as a user interaction in the interaction area and the To provide interaction data (ID) representing this user interaction. 4. Processing device (2, 3) according to claim 3, which is designed to define at least two different menu areas in the areal interaction area, wherein one of the two profiles is assigned to the respective menu area. 5. Processing device (2, 3) according to claim 3, wherein the input module (20) has at least one touch bar or is implemented as a touch bar. 6. Processing device (2, 3) according to claim 5, which is configured such that the touch bar is positioned at the front edge of the auricle when worn on the head. 7. Processing device (2, 3) according to claim 1, wherein in the case of continuously or quasi-continuously changeable values or settings, the processing device (2, 3) is designed to continuously or quasi-continuously change the values or settings, the degree of change scaling with the width of the detected movement. 8. Processing device (2, 3) according to claim 1, wherein in the case of values or settings that can only be changed step by step or only abruptly, the processing device (2, 3) is used to change the values or settings step by step or abruptly when a threshold value of the detected movement occurs is trained. 9. Processing device (2, 3) according to claim 1, which is designed to change the values or settings even in the case that a profile is a mixture of continuously or quasi-continuously changeable values or settings and gradually or only abruptly changeable values or .Settings. 10. Processing device (2, 3) according to claim 1, wherein in the event that there is no corresponding parameter of the second profile for a signal processing parameter of the first profile or vice versa, the processing device (2, 3) is designed to keep the relevant signal processing parameter unchanged for as long to leave, - until a complete change from the first profile to the second profile has occurred or - up to a percentage threshold, such as 25%, 50% or 75% maximum movement was detected or - until the essentially continuously changing values or settings have been changed according to a threshold value (e.g. 25% 50% or 75%). 11. Processing device (2, 3) according to claim 1, which is designed to implement the change in the signal processing parameters to be made in accordance with the detected movement in real time in the signal processing chain. 12. Processing device (2, 3) according to claim 11, which is designed to only fix the changing of the signal processing parameters according to the detected movement when the user interaction ends. 13. Processing device (2, 3) according to claim 1, wherein the processing device (2, 3) is designed to activate a home profile in the event of a predefined user interaction or a user interaction recorded as "tap and hold", which signal processing parameters for a stable Listening mode includes. 14. System (1), preferably a hearing aid system, particularly preferably a binaural hearing aid system, wherein the system (1) has two processing devices (2, 3) according to one of claims 1 - 13, wherein the first processing device (2) is intended for the left ear and the second processing device (3) for the right ear of a person. 15. System according to claim 14, wherein the two processing devices (2, 3) are designed for radio-based transmission of the interaction data (ID) from the first processing device to the second processing device or vice versa and the processing device receiving the interaction data (ID) from the other processing device is designed to take the received interaction data (ID) into account analogously to the processing device transmitting the interaction data (ID).