AU2013205695A1 - Automatic microphone muting of undesired noises - Google Patents

Abstract

Methods and systems for cancelation of table noise in a speaker system used for video or audio conferencing are disclosed. Table noise is cancelled in one embodiment by providing a signal or a message whenever a key is depressed on a keyboard or a mouse is clicked. When the key depression signal or message is received, the system evaluates whether speech is occurring. If speech is not occurring, then the microphone in the system is muted. However, if speech is occurring, the microphone is not muted for a period of time to allow the speech to be transmitted to the far end. This allows the conference to be continued in the presence of keyboard sounds if speech is occurring at the same time but also silences the keyboard sounds if speech is not occurring. 102 106 100 PC KEYBOARD/ PC USER MOUSE EVENT APPLICATION KEYBOARD/ WIRELESS MOUSE EVENT NETWORK LOGGER/ CONNECTION SOFTWARE BEEP SOUND PC ON PC GENERATOR LOUDSPEAKER MICROPHONE CONFERENClNG 1057--APPLICATION Fig. 1 WIRELESS 208 CONNECTION KEYBOARD/ MOUSE EVENT 204 IDENTIFICATION BEEP SOUND DISCRIMINATOR DETECTOR MICROPHONE 206 202 Fig. 2 200

Description

P/00/011 Regulation 3.2 AUSTRALIA Patents Act 1990 ORIGINAL COMPLETE SPECIFICATION STANDARD PATENT Invention Title: "AUTOMATIC MICROPHONE MUTING OF UNDESIRED NOISES" The following statement is a full description of this invention, including the best method of performing it known to me/us: AUTOMATIC MICROPHONE MUTING OF UNDESIRED NOISES FIELD OF THE INVENTION [oooi] The invention relates to speakerphones and other desk or table-located microphone systems. BACKGROUND OF THE INVENTION [ooo2] There are often undesirable noises occurring continuously during an audio or video conference. Examples of these noises include keyboard sounds and paper rustling. These noises can be distracting, particularly during audio or video conferences with a large group of people when one person's keyboard can disrupt another person's speech. Thus, it is highly desirable to automatically mute the microphone when these sounds are present and no one is talking. However, there is no reliable method to discriminate between speech sounds and noises. [00031 One example of a prior method of dealing with this issue is disclosed in U.S. Patent Application Pub. No. 2008/0279366 which addressed this problem by providing a signal from the user's keyboard to the conferencing application such that the user's computer provides a signal when a key is depressed on the keyboard. The conferencing application, either executing on the computer or on a separate device, mutes the microphone for a period of time upon receiving the key depression signal. While this method is helpful in eliminating keyboard noises, it is problematic because while the keyboard sound is muted, so is any speech occurring at the same time. This can cause gaps in speech and result in confusion and disruption of the conference. SUMMARY OF THE INVENTION [0004] In one embodiment according to the present invention, a signal is provided by the computer whenever a key is depressed. The signal is a message to the conferencing application executing on the computer. The signal may be either a high frequency audible tone, a radio frequency signal, such as WiFi or Bluetooth, or a wired signal, such as an Ethernet packet. The conferencing application is performing speech detection on signals received from the conferencing microphone. When the conferencing application receives the key depression signal or message, it evaluates whether speech is occurring. If speech is not occurring, then the microphone is muted. However, if speech is occurring, the microphone is not muted for a period of time to allow the speech to be transmitted to the far end. This allows the conference to be continued in the presence of keyboard sounds if speech is occurring at the same time but also silences the keyboard sounds if speech is not occurring. BRIEF DESCRIPTION OF THE FIGURES [0005] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate an implementation of apparatus and methods consistent with the present invention and, together with the detailed description, serve to explain advantages and principles consistent with the invention. [0006] Figure 1 is a block diagram of a computer according to one embodiment of the present invention. 10007] Figure 2 is a block diagram of a conferencing device according to one embodiment of the present invention. [ooo8] Figure 3 is a block diagram of a speech detector according to one embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS [0009] Fig. i illustrates portions of a computer ioo which implements one embodiment of the present invention. The computer ioo monitors depressions of the keyboard keys and/or mouse buttons, referred to here as events, shown in block 102. The computer ioo monitors these depressions either through a logging software running in the background or by receiving messages from the keyboard or mouse handlers as shown in block 104. The keyboard or mouse events 102 are provided to both a user application 1o6, such as a 2 web browser or a word processing program as part of the normal operations of the computer ioo. The logging or messaging software of block 104 provides a signal of these events to one of three locations, depending on the conferencing system location and its capabilities. If the conferencing system is a desktop conferencing application, the block 104 sends a message to a conferencing application io8, which could be either video or audio, running on the same computer ioo. A microphone 105 is coupled to the conferencing application io8 to allow receipt of speech. [ooiol If the conferencing device is a group conferencing system, again either video or audio, in the same room as the computer 1oo, the keyboard/mouse event triggers the generation of a short beep (e.g., a 20 kHz beep) in block no, which is provided over the computer loudspeakers in block 112. The short beep is generally inaudible, and is not disturbing to people in the room. While a short beep is preferred, an ultrasonic signal or any signal within the normal audio spectrum but above the normal speech range and having a specific pattern could be used. In an alternative embodiment, the keyboard/mouse event triggers a muting of the microphone. [oon] As a third alternative, the event notification signal can be provided to a network connection, either wired or wireless, in block 114. The wireless network can be WiFi or Bluetooth or other acceptable wireless network. The wired network is preferably Ethernet, but can be over any of the various mediums, such as shielded, twisted pair, powerline, phone line and the like. An event notification network communication is sent to the conferencing device. This embodiment may be necessary if the computer and the conferencing device are physically separate and either in different rooms or if the computer does not have a speaker, but the embodiment can also be used if the computer and the conferencing device are in the same room or the computer has a speaker. The network address of the conferencing device can be done in various ways, such as user input or other methods well known to those skilled in the art. [0012] Fig. 2 illustrates a group conferencing system 200 over a network connection. A microphone 202 on the group conferencing system 200 receives the sounds in the room. The microphone 202 signal is provided to a beep detector 204 and a speech detector 206, 3 as well as the normal conferencing input (not shown). The beep detector 204 is monitoring for the short beep from the computer loudspeaker. If a beep is detected, a signal is provided to a keyboard/mouse event identification block 208. A wired/wireless network connection 210 is provided to receive the event notification network communications signal from the computer. If a communications signal is received, a signal is provided to the identification block 208. [0013] The identification block 208 provides a signal to a discriminator block 212 when a key or button event is received. Although keyboard and mouse noise clicks can be distracting during video or audio conferences, it is preferable to hear these noises if they are being generated simultaneously as a speech by the same participant, than to remove the speech. Thus, a speech detector 2o6 is used to continuously monitoring the microphone 202 output for speech. If speech is detected, a signal is provided to the discriminator 212. [0o14] The discriminator 212 is monitoring for both the key or button event signal from the identification block 208 and the speech signal from the speech detector 206. If a mouse/keyboard event is indicated but there is no speech signal, then the microphone is muted so that the mouse or keyboard noise is not transmitted to the far end. If speech is detected simultaneously during the mouse/keyboard event, the microphone is not muted for a period of time, 1/2 a second for example, since it is desired that all speech should be heard during the conference. Thus, keyboard or mouse clicks are muted except when a speaker is speaking. This allows removal of noise from keyboard or mouse clicks except when speech is occurring, when the provision of the speech, even with the noise, is preferable to allow the conference to proceed smoothly. [0015] In one embodiment, the desktop conferencing application io8 also includes modules similar to the speech detector 206 and the discriminator 212 to allow for detection of speech while keyboard or mouse noise is present and thus avoid removal of speech. [oo16] In an alternative embodiment, instead of using the beep generator no or the wired/wireless network connection 114, the computer keyboard could directly emit the 4 short beep or transmit the wired or wireless network communication. For example, Bluetooth or RF wireless keyboards and mice are common and could connect to both the computer and to the conferencing device, providing the keyboard or mouse operation to the computer in a normal fashion and a key or button depression communication to the conferencing device directly. [0017] The speech detector 206 may be implemented as shown in Fig. 3, by comparing the low frequency energy with the high frequency energy. A low pass filter 302, preferably between 150 and 70o Hz monitors the signal received by the microphone 202. A low noise energy analyzer block 304 analyzes the output from the low pass filter 302. A high pass filter 306, preferably between 6,ooo and ii,ooo Hz, also monitors the signal received from the microphone. A high noise energy analyzer block 308 analyzes the high pass filter 306 output. An energy comparison block 310 then receives the outputs of the low and high noise analyzers 304 and 308. If the low frequency energy is greater than the high frequency energy, the block 31o declares speech is present and provides a speech signal. [oo18] Thus, while removing disrupting keyboard and mouse noises, the system also determines when speech is present and prevents removal of speech because of keyboard or mouse noise in the presence of speech from the same participant. [0019] It should be emphasized that the previously described embodiments of the present invention, particularly any preferred embodiments, are merely possible examples of implementations, set forth for a clear understanding of the principles of the invention. Many variations and modifications may be made to the previously described embodiments of the invention without departing substantially from the spirit and principles of the invention. All such modifications and variations are intended to be included herein within the scope of this disclosure and the present invention and protected by the following claims. 5 [0020] In this specification, the terms "comprise", "comprises", "comprising" or similar terms are intended to mean a non-exclusive inclusion, such that a system, method or apparatus that comprises a list of elements does not include those elements solely, but may well include other elements not listed. [0021] The reference to any prior art in this specification is not, and should not be taken as, an acknowledgement or any form of suggestion that the prior art forms part of the common general knowledge. 6

Claims (14)

1. A system comprising: a computer providing a signal when a click event occurs; and a conferencing device which includes a microphone and a speech detector and is coupled to the computer to receive the click event signal, wherein the conferencing device mutes the microphone if a click event signal is received and speech is not detected but does not mute the microphone if a click event signal is received and speech is detected.

2. The system of claim 1, wherein the conferencing device is an application executing on the computer and the signal is a message inside the computer.

3. The system of claim i, wherein the computer includes a loudspeaker and the click event signal is a high frequency beep audio signal provided from the loudspeaker.

4. The system of claim 3, wherein the conferencing device includes a beep detector for detecting the high frequency beep audio signal.

5. The system of claim 1, wherein the computer includes a network interface and the click event signal is provided over the network interface, and wherein the conferencing device includes a network interface for receiving the click event signal.

6. The system of claim i, wherein the conferencing device includes a speech detector for detecting when speech is occurring.

7. The system of claim 6, wherein the conferencing device further includes a discriminator for monitoring for the click event and for speech and determining if the click event and the speech occur at the same time. 7

8. The system of claim i, wherein the microphone is not muted for a predetermined period of time if the click event signal is received and speech is detected at the same time.

9. The system of claim i, further comprising a keyboard wherein the keyboard provides the click event signal.

10. A noise cancellation method comprising: receiving a signal when a click event occurs; receiving sounds by a microphone; detecting when speech occurs; and muting the microphone if the click event signal is received and speech is not detected and not muting the microphone if the click event signal is received and speech is detected at the same time. n1. The method of claim io, wherein the click event signal is a high frequency beep audio signal provided from a loudspeaker.

12. The method of claim ii, further comprising detecting the high frequency beep audio signal by using a beep detector.

13. The method of claim io, further comprising receiving the click event signal over a network interface.

14. The method of claim io, further comprising monitoring for the click event and for speech and determining if the click event and the speech occur at the same time.

15. The method of claim 1o, wherein the microphone is not muted for a predetermined period of time if the click event signal is received and speech is detected at the same time. 8