JP2001175300A - Speech synthesizer for telephone terminal device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a speech synthesizer for a telephone terminal device capable of making user's speech clear even if background sound is set. SOLUTION: When recording of a message on an answering machine is indicated, a mixing ratio control circuit 33 sets the coefficient of a coefficient multiplier 34 to 0, and that of a coefficient multiplier 35 to a prescribed value. Then, a musical sound signal of a melody reproduced by a music reproduction part 37 is supplied to a coder/decoder part 14 via the coefficient multiplier 35 set to the prescribed coefficient and a mixer 36, and stored in a recording/ reproducing part 51 after compression-coded. When user's voice is inputted from a microphone 21, the mixing ratio control circuit 33 sets the coefficient of the coefficient multiplier 34 to a certain value from 0, and reduces the coefficient of the coefficient multiplier 35. When the voice input from the microphone 21 is decreased, the mixing ratio control circuit 33 further reduces the coefficient of the coefficient multiplier 35.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a voice synthesizing device for a telephone terminal device for synthesizing an input voice and a reproduced music.

[0002]

2. Description of the Related Art In a conventional mobile phone, an answering machine message or a hold message to be played back when an incoming call is received is a message set in the mobile phone in advance or a message in which a user's own voice message is stored. It had been. In addition, there have been songs in which a tune serving as a voice and a background sound is recorded in advance as an answering machine message or a hold message.

[0003]

However, when a user himself creates an answering machine message or a hold message that combines a user's voice message and a background sound, the volume of the background sound is constant even when the user's voice is low. there were. For this reason, the user's voice may be lower than the background sound, which makes it difficult to record clearly, and that when the answering machine message played back to the other party's telephone is emitted, it is difficult to hear it. There was a problem. The present invention has been made in view of such circumstances, and an object of the present invention is to provide a voice synthesizer of a telephone terminal device that can make a user's voice clear even when a background sound is set. .

[0004]

In order to achieve the above object, according to the present invention, the invention according to claim 1 comprises a conversion means for converting an externally input voice into a voice signal; Volume detection means for detecting a volume based on the output, music reproduction means for reproducing music data to generate a musical tone signal, and sound generation when the volume detection means detects an audio signal from the conversion means. Large signal synthesis coefficient,
The synthesis coefficient of the tone signal is set to be small, and when the sound volume detection means does not detect the audio signal from the conversion means, the synthesis coefficient of the audio signal is reduced and the synthesis coefficient of the tone signal is increased. A synthesizing ratio control unit for setting, a synthesizing unit for synthesizing the audio signal and the tone signal based on a synthesizing coefficient set by the synthesizing ratio control unit, and a storage unit for storing the signal synthesized by the synthesizing unit. It is characterized by becoming.

According to a second aspect of the present invention, in a telephone terminal device connected to a public line network by wireless or wired and performing communication, a conversion means for converting an externally input voice into a voice signal, and reproducing music data. Music reproducing means for generating a musical tone signal, a sound volume detecting means for detecting a sound volume based on an output of the converting means, and an audio signal when the sound volume detecting means detects an audio signal from the converting means. A signal synthesis coefficient is set to be large, a synthesis coefficient of the tone signal is set to be small, and when the sound volume detection means does not detect an audio signal from the conversion means, the synthesis coefficient of the audio signal is set to be small. A synthesizing ratio control means for setting a large synthesizing coefficient of the signal; a synthesizing means for synthesizing the audio signal and the musical tone signal based on the synthesizing coefficient set by the synthesizing ratio control means; And characterized by being provided with a communication unit for transmitting the signals to the other party terminal.

According to a third aspect of the present invention, in the voice synthesizer for a telephone terminal device according to the first or second aspect, the synthesis ratio control means relates to a level of a voice signal detected by the volume detection means. And setting a synthesis coefficient of the tone signal. According to a fourth aspect of the present invention, in the voice synthesizing device for a telephone terminal device according to the first to third aspects, a sound is output to the outside from the music reproducing means based on a musical sound signal output from the music reproducing means, An echo canceling unit for removing a tone signal input through the conversion unit and outputting the signal as an audio signal to the synthesizing unit.

[0007]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS A speech synthesizer for a telephone terminal according to an embodiment of the present invention will be described below with reference to the drawings. FIG. 1 shows a mobile phone 1 according to an embodiment of the present invention.
1 is a schematic block diagram illustrating a configuration of a speech synthesis device of FIG. In this figure, a mobile phone 1 generally includes a retractable antenna 1a.
It is connected to a communication unit 13 having a demodulation function. Central processing unit for the system (Central Process)
ing Unit: CPU) is a ROM (Read 0).
The system control unit controls the operation of each unit of the mobile phone 1 by executing a telephone function program stored in the memory 12 (details will be described later).

[0008] The communication unit 13 demodulates a signal received by the antenna 1a, modulates a signal to be transmitted, and transmits the modulated signal from the antenna 1a. The reception signal demodulated by the communication unit 13 is a coder / decoder having a coder / decoder.
The audio signal for transmission, which is decoded in the DER unit 14 and input from the microphone 21, is subjected to audio processing in an audio processing unit 30, which will be described later, and is compression-coded in the CODER / DECODER unit 14. CODER / DECO
The DER unit 14 compresses and encodes a voice signal for transmission with high efficiency, and decodes a received voice signal.
ELP (Code Excited LPC) system and AD
It has a coder / decoder of the PCM (adaptive differential PCM coding) system.

The audio processing unit 30 includes an ADC 31, a volume detection circuit 32, a mixing ratio control circuit 33, coefficient multipliers 34, 35, 38, 39, mixers 36 and 40, a music reproduction unit 37, a DAC 41 And an echo canceling circuit 42. The music reproducing section 37 sequentially reads out the music data stored in the RAM 11, generates a musical sound signal, and supplies it to the coefficient multipliers 35 and 38 and the echo canceling circuit 42. The mixer 40 mixes the audio signal input from the coefficient multiplier 39 and the tone signal input from the coefficient multiplier 38 in accordance with the coefficients set in the coefficient multipliers 39 and 38, and outputs the result to the DAC 41. I do.

[0010] DAC (Digital-to-Analog Converter) 41
Is converted into an analog signal based on the digital audio signal and the digital tone signal mixed by the mixer 40, and is emitted from the speaker 22. ADC
The (analog-to-digital converter) 31 converts an analog audio signal input from the microphone 21 into a digital audio signal. The mixer 36 performs mixing (synthesis) of the audio signal input from the coefficient multiplier 34 and the tone signal input from the coefficient multiplier 35 according to the coefficients set in the coefficient multipliers 34 and 35. CODER / DECOD
Output to the ER unit 14.

The volume detection circuit 32 detects the magnitude of the audio signal input from the microphone 21 based on the audio signal output from the ADC 31, that is, the level of the audio signal.
The detection result is output to the mixing ratio control circuit 33. The mixing ratio control circuit 33 includes a coefficient multiplier 34 according to the level of the audio signal detected by the volume detection circuit 32.
And the combined coefficient of the coefficient multiplier 35 (hereinafter, referred to as “coefficient”)
Is set (details will be described later). Echo cancellation circuit 42
Is output from the speaker 22 based on the tone signal output from the tone reproduction unit 37,
The tone signal input to the DC 31 is removed.

The message recording / reproducing section 50 includes a recording / reproducing section 51 and a SEL (selector) 52.
When recording is instructed, the recording / playback unit 51
The compression-encoded sound signal output from the R / DECODER unit 14 is stored as an answering machine message, and when reproduction is instructed, the stored answering machine message is output to the SEL 52 as a sounding signal. SEL52 is
When a sound signal for transmission is instructed from the CPU 10,
The compression-encoded transmission sound signal input from the CODER / DECODER unit 14 is selected, and when the reproduction of the answering machine message or the hold message is instructed, the output from the recording / reproduction unit 51 is selected. Communication unit 13
Output to

The vibrator 19 notifies the user of an incoming call by vibrating the main body of the mobile phone 1 in place of a ring tone at the time of an incoming call. The display unit 18 displays the image information stored in the image storage unit 20. The display unit 18
Display according to the operation of the menu of the telephone function and buttons such as a numeric keypad and a jog dial. The input unit 17 is an input unit that includes numeric keys of “0” to “9” provided on the mobile phone 1 and numeric keys and code keys, a jog dial, and the like. The ROM 12 stores programs such as various telephone function programs for transmission and reception executed by the CPU 10, processing for assisting audio reproduction processing, and various data. The RAM 11 stores a music data storage area, a user setting data storage area, and a CPU 1.
A work area of 0 is set. Each functional block transmits and receives data and instructions via the bus 24.

Next, the operation of the apparatus having the above configuration will be described with reference to the time chart of FIG. First,
When recording of an answering machine message or a hold message is instructed by the CPU 10 after the power is turned on, the mixing ratio control circuit 33 sets the coefficient of the coefficient multiplier 34 to 0 and the coefficient of the coefficient multiplier 35 to b (FIG. 2 (c)).

A tone signal output from the music reproducing section 37 for recording an answering machine message or a hold message is supplied to a mixer 36 via a coefficient multiplier 35 having a coefficient "b". Since the coefficient of the coefficient multiplier 34 is set to “0”, only the tone signal is supplied to the mixer 36. For this reason, only the tone signal is output from the mixer 36, and this output is output to the CODER / DECODER unit 14.
Recording / reproducing section 5 which is compression-encoded by the
1 is supplied. The recording / reproducing unit 51 has a CODER / D
The sound signal that is compression-encoded and input from the ECODER unit 14 is stored.

Next, at time t1, when the user's voice is input as an analog voice signal by the microphone 21 ((a) in FIG. 2), the ADC 31 converts the analog voice signal into a digital voice signal. Then, the signal is output to the volume detection circuit 32 and the echo detection circuit 42. Volume detector 32
Detects the level of the audio signal based on the audio signal input from the ADC 31, and outputs the detection result to the mixing ratio control circuit 33. The mixing ratio control circuit 33 sets the coefficients of the coefficient multipliers 34 and 35 according to the level of the audio signal detected by the volume detection circuit 32. That is, the coefficient of the coefficient multiplier 34 is set to “a”, and the setting of the coefficient of the coefficient multiplier 35 is updated from “b” to “c” (here, b> c) ((FIG. C)).

The audio signal output from the ADC 31 is output to the echo canceling circuit 42. The echo canceling circuit 42 removes the tone signal output from the speaker 22 and input to the ADC 31 via the microphone 21 based on the tone signal output from the tone reproduction unit 37, and the coefficient is set to “a”. The signal is supplied to a mixer 36 via a coefficient multiplier 34. Since the tone signal output from the music reproducing unit 37 is input to the mixer 36 via the coefficient multiplier 35 whose coefficient is set to “c”, the coefficient is set to “a” in the mixer 36. The mixed audio signal and the musical tone signal having the coefficient “c” are mixed, and the coder / decoder is mixed.
It is supplied to the unit 14. The signal output from the mixer 36 is compression-encoded by the coder / decoder unit 14 and supplied to the recording / reproducing unit 51 as a sound signal. Then, the recording / reproducing unit 51 stores the supplied sound signal.

Next, the sound input from the microphone 21 is reduced (at time t2 in FIG. 2A), and the volume detection circuit 32
When the level of the audio signal detected by the above decreases, the mixing ratio control circuit 33 changes the coefficient of the coefficient multiplier 35 from “c” to “d” (here,
The setting is updated to (c> d) ((c) in FIG. 2).

The tone signal output from the music reproducing section 37 is supplied to a mixer 36 via a coefficient multiplier 35 having a coefficient "d". The mixer 36 has A
The audio signal output from the DC 31 is input. For this reason, the mixer 36 mixes the tone signal with the coefficient “d” and the audio signal with the coefficient “a”, and
Output to ODER / DECODER unit 14. CODE
The R / DECODER unit 14 compression-encodes the input signal and outputs it to the recording / reproducing unit 51 as a sound signal. The recording / reproducing unit 51 includes a coder / decoder.
The sound signal input from the unit 14 is stored.

Next, the sound input from the microphone 21 becomes loud (at time t3 in FIG. 2A), and the volume detection circuit 32
When the level of the audio signal detected by the above increases, the mixing ratio control circuit 33 updates the setting of the coefficient of the coefficient multiplier 35 from “d” to “c” with the increase of the level (FIG. 2 ( C)).

The tone signal output from the music reproducing section 37 is supplied to a mixer 36 via a coefficient multiplier 35 having a coefficient "c". The mixer 36 has A
An audio signal whose coefficient is “a” is input from the DC 31. For this reason, the mixer 36 mixes the tone signal with the coefficient “c” and the audio signal with the coefficient “a”, and outputs the resulting signal to the CODER / DECODER unit 14.
The CODER / DECODER unit 14 compresses and encodes the input signal and outputs it to the recording / reproducing unit 51 as a sound signal. The recording / reproducing unit 51 has a CODER / DECOD
The sound signal input from the ER unit 14 is stored.

Next, the utterance of the user stops, and the microphone 2
The input of the voice from the input 1 stops (at time t in FIG. 2A).
4) When the level of the audio signal detected by the volume detection circuit 32 becomes 0, the mixing ratio control circuit 33 changes the coefficient of the coefficient multiplier 34 from “a” to “0” and changes the coefficient of the coefficient multiplier 35 to “0”. The setting is updated from "c" to "b" (FIG. 2 (c)).

The tone signal output from the music reproducing section 37 is supplied to the mixer 36 via the coefficient multiplier 35 having the coefficient "b", and the coefficient of the coefficient multiplier 34 is "0". Therefore, only the tone signal whose coefficient is “b” is supplied to the mixer 36. For this reason, only the tone signal whose coefficient is “b” is output from the mixer 36, and this tone signal is compression-encoded by the CODER / DECODER unit 14 and supplied to the recording / reproducing unit 51 as a sound signal. Then, the recording / reproducing unit 51 stores the supplied sound signal.

When the answering button is pressed by the other party's telephone while the portable telephone 1 is set to the answering machine response or the hold response, the line is connected.
The PU 10 instructs the recording / playback unit 51 to play the answering machine message. Upon receiving a reproduction instruction from the CPU 10, the recording / reproducing unit 51 reproduces the stored sound signal.
Output to the communication unit 13 via the SEL 52. As a result, an answering machine message or a hold message in which the volume of the music is set according to the sound volume is transmitted to the telephone of the other party.

On the other hand, when recording an answering machine message or a hold message, if the background sound is not set (the tone signal is not synthesized by the mixer 36 from the music reproducing section 37), the mixing ratio control circuit 33 is controlled by the CPU.
Based on the instruction from 10, the coefficient of the coefficient multiplier 35 is set to “0”. Further, the CPU 10 may output an instruction to stop the generation of the musical sound signal to the music reproducing unit 37. As a result, only the voice of the user is recorded as an answering machine message or a hold message.

Next, a case where a line is connected between the mobile phone 1 and the other party's phone and a normal conversation is performed will be described. First, when the mobile phone 1 receives an incoming call from the base station,
The CPU 10 notifies the user of the incoming call by driving the vibrator 19 or emitting a ringtone.
In the case of setting to notify an incoming call by a ring tone, the CPU 10
Gives an instruction to generate a musical sound signal to the music reproducing section 37 to reproduce the music. At this time, the CPU 10 sets the output of the music reproduction section 37 to be emitted from the speaker 22. For example, the mixing ratio control circuit 33 sets the coefficients of the coefficient multipliers 35 and 39 to “0” and sets the coefficient of the coefficient multiplier 38 to a coefficient corresponding to the sound volume set by the user. As a result, a ringtone can be emitted from the speaker 22 and a notification of an incoming call can be given.

On the other hand, when notifying an incoming call by vibrating the vibrator 19, the CPU 10 instructs the vibrator 19 to drive. Vibrator 19 receives an instruction from CPU 10 and vibrates the main body of mobile phone 1. In addition, the notification operation of the incoming call may be performed by simultaneously driving the vibrator 19 and emitting the ringtone.

Next, after the portable telephone 1 receives a call, a predetermined button of the input unit 17 is operated by the user to start talking with the telephone of the other party, and then the background sound is mixed with the user's voice. When transmitting to the telephone on the side of the
A sound signal output from the R unit 14 is selected. Then, at the time of a conversation with the other party's telephone, the music is reproduced together with the reproduction instruction of the music, and when the sound is input from the microphone 21, the sound processing unit 30 generates the musical sound signal and the sound signal in the same manner as the operation described above. Mixed, coder
/ DECODER unit 14. CODER / D
The ECODER unit 14 compresses and encodes the supplied signal, and outputs the signal to the communication unit 13 via the SEL 52 as a sound signal. The communication unit 13 transmits the compression-encoded sound signal to the telephone of the other party via the communication network. As a result, it is possible to set the loudness of the musical tone in accordance with the fluctuation in the loudness of the voice input to the mobile phone 1 and transmit the loudness to the other party's telephone.

If the sound obtained by mixing the background sound is not transmitted to the telephone of the other party, the mixing ratio control circuit 3
3 is a coefficient multiplier 35 based on an instruction from the CPU 10.
Is set to “0”. Alternatively, the CPU 10
An instruction to stop the generation of the musical sound signal may be output to the music reproduction unit 37.

Next, a case where a background sound is set for the received voice from the telephone of the other party will be described. In this case, the music reproducing unit 37 generates a musical sound signal based on an instruction from the CPU 10. The mixing ratio control circuit 33 includes a coefficient multiplier 38 and a CORDER / DEC.
The mixing ratio of the coefficient multiplier 39 to which the other party's audio signal output from the ORDER unit 14 is input is set. On the other hand, when the background sound is not set for the received voice from the other party's telephone, the coefficient of the coefficient multiplier 38 is “0”.
Is set to Further, based on an instruction from the CPU 10, the generation of the musical sound signal of the music reproducing section 37 may be stopped.

Next, the case where the viewing mode is set will be described. The appreciation mode is an operation in which the mobile phone 1 reproduces a music and emits a sound from the speaker 22 irrespective of an incoming / outgoing call, a call, etc. with the other party's telephone when the user instructs the reproduction of the music. It is. When the user presses a predetermined button of the input unit 17 in the state where the viewing mode is set and instructs the reproduction of the music, the CPU
10 gives an instruction to generate a musical sound signal to the music reproducing section 37 to reproduce the music. At this time, the CPU 10 sets the output of the music reproduction unit 37 to be emitted from the speaker 22. For example, the mixing ratio control circuit 33 sets the coefficients of the coefficient multipliers 35 and 39 to “0” and sets the coefficient of the coefficient multiplier 38 to a coefficient corresponding to the sound volume set by the user.

In the above-described embodiment, the description has been given of the case where the telephone terminal device is a portable telephone. However, the same applies to a stationary telephone or the like connected to a public line network by wire or wireless and wire. It is possible to apply the speech synthesizer of the terminal device.

[0033]

As described above, according to the present invention,
The sound input from the outside is converted into a sound signal, and the sound volume of the sound signal is detected by sound volume detecting means. And
When the music data is reproduced to generate a tone signal and the detecting means detects the audio signal, the synthesis coefficient of the audio signal is increased,
The synthesis coefficient of the tone signal is set to a small value, and the voice signal and the tone signal are synthesized based on the set synthesis coefficient and stored. Further, when the volume detecting means does not detect the audio signal, the synthesis coefficient of the audio signal is set to be small and the synthesis coefficient of the tone signal is set to be large, and the audio signal and the tone signal are set based on the set synthesis coefficient. Was synthesized and memorized. Therefore, it is possible to set and store the size of the musical sound to be stored according to the input of the voice, so that even if the background sound is set, it is possible to prevent the voice from being difficult to hear due to the musical sound and to make the voice clear. The effect that can be memorized is obtained.

According to the second aspect of the present invention, in a portable telephone which is connected to a public line network by wireless or wired and performs communication, an externally input voice is converted into a voice signal, and the volume of the voice signal is reduced. Detected by the volume detection means. Then, the music data is reproduced to generate a tone signal, and when the detecting means detects the audio signal, the synthesis coefficient of the audio signal is set to be large and the synthesis coefficient of the tone signal is set to be small. Based on this, the voice signal and the tone signal are combined and transmitted by the communication unit. Further, when the volume detecting means does not detect the audio signal, the synthesis coefficient of the audio signal is set to be small and the synthesis coefficient of the tone signal is set to be large, and the audio signal and the tone signal are set based on the set synthesis coefficient. Was synthesized and sent. Therefore, the size of the musical sound to be transmitted can be set and transmitted according to the input of the voice, so that even if the background sound is set, it is possible to prevent the voice from being difficult to hear due to the musical sound, and to keep the voice clear. The effect that can be transmitted is obtained.

According to the third aspect of the present invention, in addition to the first or second aspect of the present invention, the tone signal synthesizing coefficient is set in relation to the level of the audio signal detected by the volume detecting means. Therefore, even when the input voice becomes smaller, the background sound can be reduced and synthesized, and thus, even when the volume of the voice changes, the voice can be heard clearly. The effect is obtained.

According to a fourth aspect of the present invention, after the sound is emitted to the outside, the tone signal input together with the voice is deleted based on the tone signal output from the music reproducing means. As a result, it is possible to prevent the sound quality from deteriorating, and to obtain an effect of making it easier to hear the voice more clearly.

[Brief description of the drawings]

FIG. 1 is a schematic block diagram showing a configuration of a speech synthesizer of a telephone terminal device according to an embodiment of the present invention.

FIG. 2 is a timing chart for explaining the operation of the device in the configuration of FIG.

[Explanation of symbols]

1 mobile phone, 1a antenna, 10 CPU, 11
RAM, 12 ROM, 13 communication unit, 14 COD
ER / DECODER section, 17 input section, 18 display section, 19 vibrator, 21 microphone, 22 speaker, 24 bus, 30 audio processing section, 31 ADC,
32 volume detection circuit, 33 mixing ratio control circuit, 3
4 coefficient multiplier, 35 coefficient multiplier, 36 mixer, 3
7 Music playback unit, 38 coefficient multiplier, 39 coefficient multiplier, 40 mixer, 41 DAC, 42 echo cancellation circuit, 50 message recording / reproduction unit, 51 recording / reproduction unit, 52 SEL

Claims (4)

[Claims] 1. A converting means for converting a sound inputted from the outside into an audio signal, a sound volume detecting means for detecting a sound volume based on an output of the converting means, and reproducing a music data to generate a musical sound signal. When the music reproduction means and the sound volume detection means detect the sound signal from the conversion means, the synthesis coefficient of the sound signal is set to be large, and the synthesis coefficient of the musical tone signal is set to be small. A synthesis ratio control unit for setting the synthesis coefficient of the audio signal to be small and the synthesis coefficient of the tone signal to be large when the audio signal from the conversion unit is not detected; A synthesizing unit for synthesizing the audio signal and the musical tone signal, and a storage unit for storing the signal synthesized by the synthesizing unit. 2. A telephone terminal device which is connected to a public line network by radio or wire and performs communication, a conversion means for converting an externally input voice into a voice signal, and reproducing a music data to generate a music signal. A music reproducing means for causing the sound signal to be detected; a sound volume detecting means for detecting a sound volume based on an output of the converting means; and a synthesis coefficient of the sound signal when the sound volume detecting means detects the sound signal from the converting means. ,
The synthesis coefficient of the tone signal is set to be small, and when the sound volume detection means does not detect the audio signal from the conversion means, the synthesis coefficient of the audio signal is reduced and the synthesis coefficient of the tone signal is increased. Composing ratio control means to be set, combining means for combining the audio signal and the musical tone signal based on a combining coefficient set by the combining ratio control means, and communication for transmitting a signal combined by the combining means to a partner terminal. A voice synthesizing device for a telephone terminal device, comprising: 3. The synthesizing ratio control unit according to claim 1, wherein said synthesis ratio control unit sets a synthesis coefficient of said tone signal in association with a level of the audio signal detected by said volume detection unit. A speech synthesizer for a telephone terminal device. 4. A music signal output from said music reproducing means, a sound signal emitted from said music reproducing means to the outside, and inputted via said converting means is removed, and said synthesizing means is output as an audio signal. Echo canceling means for outputting to
4. A speech synthesizer for a telephone terminal device according to claim 1, comprising: