WO2007040302A1

WO2007040302A1 - Method for reading mobile communication phone having the multi-language reading program

Info

Publication number: WO2007040302A1
Application number: PCT/KR2006/000862
Authority: WO
Inventors: Seok-Yong Moon
Original assignee: INFINITY TELECOM CO Ltd
Current assignee: INFINITY TELECOM CO Ltd
Priority date: 2005-10-05
Filing date: 2006-03-10
Publication date: 2007-04-12
Anticipated expiration: 2008-04-05

Abstract

The present invention relates to a reading method using a mobile communication terminal, which enables by reproducing read content produced in a plurality of languages, and enables the user to make answers to questions through the recognition of voice, thus greatly increasing the user' s ability to read, and increasing the efficiency when learning foreign languages. The mobile communication terminal is characterized in that graphics and captions are displayed on a display unit, the captions are output in voice form, answer voice signals, which correspond to the text or graphics displayed on the display unit, are received from a user, whether the text or number and the answer voice signals are correct is determined, and the results of the determination are displayed for the user.

Description

[DESCRIPTION]

[invention Title]

METHOD FOR READING MOBILE COMMUNICATION PHONE HAVING THE MULTI-LANGUAGE READING PROGRAM

[Technical Field]

The present invention relates, in general, to a mobile communication terminal and, more particularly, to a mobile communication terminal having a reading function and a reading method using the same, which allow a user to listen to a text document in voice form using a mobile communication terminal having a voice recognition function and a Text-To-Speech (TTS) function, and which allow the user to conduct learning using voice information that he or she has input.

[Background Art]

Generally, mobile communication terminals have been popularized due to the advantages of the convenience of use thereof and the portability thereof.

The purpose of use of such mobile communication terminals was mostly to perform 1:1 bidirectional communication at the initial stage of the popularization of the terminal. However, as the terminals have become popularized and various types of content on a wireless communication network have been developed and popularized, the mobile communication terminals are being widely used for the purpose of various types of communication, for example, l:n communication and communication between corresponding terminals, and entertainment, such as the bidirectional transmission and reception of text/graphics, searching through Internet/Personal Computer (PC) communication, checking e-mail, on-line games, the management of users' information, and the transmission and reception of various types of data services, other than bidirectional communication, and thus the evolution of mobile communication is being further accelerated.

[Disclosure] [Technical Problem] In the development of the mobile communication terminals, the mobile communication terminals are additionally provided with a voice recognition function and a TTS function so as to enable the user of the mobile communication terminal to more conveniently conduct the manipulation thereof.

However, up to now, the voice recognition function or the TTS function is merely implemented as a function for the manipulation of keys, the transmission and reception of text/graphics, and the indication of current time in the mobile communication terminals for specific persons, such as handicapped persons, or provides only a function of convenience, like a hotkey function.

[Technical Solution]

Accordingly, an object of the present invention is to provide a mobile communication terminal having a reading function and a reading method using the same, which enable a user to conduct reading using a TTS function.

Another object of the present invention is to provide a reading method using a mobile communication terminal that enables the user to review read content and remind the user of the read content using a voice recognition function, thus creating a learning effect.

A further object of the present invention is to provide a reading method using a mobile communication terminal in which read content for which a plurality of languages is supported is provided, which can increase the efficiency when learning foreign languages.

In order to accomplish the above objects, the present invention provides a mobile communication terminal having a reading function, the mobile communication terminal having circuitry so as to execute stored application programs, the mobile communication terminal including a display unit for outputting a graphic image or a moving image to display the execution status of a reading program; a voice processing unit connected with a microphone to receive a user' s voice, and connected with a speaker to output voice from the mobile communication terminal; a keypad unit provided with a switching key for switching the mobile communication terminal to a reading mode; memory for storing the reading program, including graphic files, moving image files, voice files, and text files for which a plurality of languages is supported; a control unit connected with the display unit, the voice processing unit, the keypad unit and the memory to control the overall operation of the mobile communication terminal, thus converting the user's answer voice signal, which is transferred from the voice processing unit, into command data, performing operations for the reading program, extracting data, which is already stored in the memory, according to the results of the operations, and outputting the extracted data through the speaker or the display unit; a TTS engine unit connected to one side of the control unit to convert a text sentence, which has been input in a specific language and is transferred from the control unit, into audio wave data; and an audio processing unit connected to one side of the TTS engine unit to convert the audio wave data, which is obtained through the conversion in the TTS engine unit, to an analog voice signal and transfer the analog voice signal to the speaker. Furthermore, in accordance with the present invention, it is preferred that the mobile communication terminal further include a wireless processing unit that is connected to one side of the control unit, and accesses a mobile communication base station through an antenna, receives reading program data, and transfers the received reading program data to the control unit, under the control of the control unit.

Furthermore, in accordance with the present invention, it is preferred that the operations for the reading program be performed in such a way that the answer voice signal, which is transferred from the voice processing unit, is compared with answers in the program, and whether a corresponding answer is correct is determined.

In addition, the present invention provides a reading method using a mobile communication terminal having a reading function, the method executing application programs provided in the mobile communication terminal, the method includes a first step of detecting a user' s manipulation of a keypad unit, accessing a reading program, and setting the function of the mobile communication terminal to a reading function; a second step of executing the reading program by accessing the reading program, and then prompting the user to set options through a display unit/ a third step, that is, a program reproduction step of starting a reading operation in response to guidance on a screen after the user' s option selection has been completed; and a fourth step of causing the user to make answers to questions, which are created by the program, according to the options that have been designated by the user after the reproduction of the program has been completed.

Furthermore, in accordance with the present invention, it is preferred that, at the second step, the options of the reading program, which are selected by the user, be provided such that at least one of ^λgenre of reading' , ^learning after reading' , ^Λcaption during reproduction' , and ^background music' is selected. Furthermore, in accordance with the present invention, it is preferred that, at second step, the options of the reading program, which are selected by the user, include language selection that allows reproduction to be performed in a language selected from among a plurality of languages .

Furthermore, in accordance with the present invention, it is preferred that, at the third step, that is, at a program reproduction step, graphics corresponding to content be output onto the display unit in an illustration form.

Furthermore, in accordance with the present invention, it is preferred that, at the third step, that is, at a program reproduction step, a text caption be displayed in a lower portion of the display unit. Furthermore, in accordance with the present invention, it is preferred that, at the third step, that is, at a program reproduction step, the user listen to voice corresponding to the text caption through a speaker.

Furthermore, in accordance with the present invention, it is preferred that, at the fourth step, the user's voice answers to yes or no questions, created by the program, be evaluated and scored.

Furthermore, in accordance with the present invention, it is preferred that the application programs further comprise compressed moving image files that are downloaded to the mobile communication terminal over a wireless Internet, and provides graphics, text for captions, and voice corresponding to the text, without requiring driving of a TTS engine unit.

[Advantageous Effects] As described above, in accordance with to an embodiment of the present invention, the mobile communication terminal having a reading function, and- the reading method using the mobile communication terminal, enable a user to conduct reading by executing a reading program stored in memory through the recognition of voice, thus greatly increasing the user's ability to read.

Furthermore, the present invention allows a reading function to be provided in a portable mobile communication terminal, and causes the user to review read content through the recognition of voice, thus enabling the user to conduct reading regardless of time and place.

From the above-described details, those skilled in the art will appreciate that various modifications and additions are possible without departing from the technical spirit of the present invention. Accordingly, the technical scope of the present invention is not limited to the detailed description of the specification, but should be defined by the accompanying claims.

[Description of Drawings] FIG. 1 is a diagram schematically showing a mobile communication terminal having a reading function, according to an embodiment of the present invention;

FIG. 2 is a block diagram schematically showing the construction of the mobile communication terminal shown in FIG. 1; and

FIG. 3 is a flowchart schematically illustrating a reading method using the mobile communication terminal according to the embodiment of the present invention.

[Best Mode] Objects and features, other than the above objects, will be more clearly understood from the following description of the embodiments, which is to be taken in conjunction with the accompanying drawings.

Preferred embodiments of the present invention are described with reference to FIGS. 1 to 3 below.

[Mode for Invention]

FIG. 1 is a diagram showing a mobile communication terminal having a reading function, according to an embodiment of the present invention.

Referring to FIG. 1, the mobile communication terminal 200 having a reading function according to the present invention displays text (captions) or graphics on a display unit 210 and performs a reading function of receiving the voice signals of a user, which correspond to the text or the graphics displayed on the display unit 210, according to a reading program stored in the terminal .

Although the reading program provides various genres, the embodiment of the present invention is described with reference to the example of an orally narrated fairy tale.

For this purpose, the mobile communication terminal

200, as shown in FIG. 2, a display unit 210 for displaying text or graphics, memory 260 for storing read content for which the user' s voice and a plurality of text or graphics and a plurality of language, a control unit 220 for displaying either one or both of the text and the graphics, which are stored in the memory 260, on the display unit

210, receiving the answer voice signals of the user for the text or the graphics, determining whether corresponding answers are correct by performing comparison on the input answer voice signals of the user, and issuing a command such that the read content is reproduced in an optionally selected language, a microphone 241 for transferring the answer voice signals of the user, a speaker 281 for outputting answer messages so that the user can listen to them and reproducing the user's voice, a voice processing unit 240 for transferring the answer voice signals, which are transferred from the microphone 241, to the control unit 220, a wireless processing unit 230 for transmitting various types of data to a mobile communication base station through an antenna 232 and, at the same time, receiving various types of data from the mobile communication base station through the antenna 232 and transferring the received data to the control unit 220, under the control of the control unit 220, a TTS engine unit 270 for converting the text into audio wave data, and an audio processing unit 280 for converting the audio wave data, which is obtained through the conversion, into an analog voice signal. The display unit 210 is connected to one side of the control unit 220, and may be constructed using a display device, such as a Liquid Crystal Display (LCD) .

Under the control of the control unit 220, the above- described display unit 210 displays the state of the mobile communication terminal 200 and the execution status of the program. The display unit 210 may provide a graphic screen or a screen that includes both a graphic screen and a caption, according to the user's initial setting of options.

Under the control of the control unit 220, the wireless processing unit 230 transmits various types of data to the mobile communication base station through the antenna 232 and, at the same time, receives various types of data from the mobile communication base station through the antenna 232, and transfers the received data to the control unit 220.

In this case, the wireless processing unit 230 accesses the mobile communication base station to download and upload the reading program and to download a read content file for which a plurality of languages is supported.

The microphone 241 is connected to one side of the voice processing unit 240 to directly receive a voice signal and an answer voice signal from the user and transfer the received signals to the voice processing unit 240 under the control of the control unit 220.

The speaker 281 is connected to one side of each of the audio processing unit 280 and the voice processing unit 240 to convert the analog voice signal, which is transferred from the audio processing unit 280, into an answer signal that the user can listen to, and output the answer signal to the outside, or receive and reproduce the user's voice signal, which is already stored in the memory, from the voice processing unit, under the control of the control unit 220.

The voice processing unit 240 is configured such that one side thereof is connected to one side of each of the speaker 281 and the microphone 241 and the other side thereof is connected to the control unit 220, and supplies the voice signal and the answer voice signal, which are transferred from the microphone 241, to the control unit 220.

A keypad unit 250 is connected with the control unit 220, and is provided with a plurality of numeric keys, functional keys for performing various functions, and voice recognition keys . The memory 260 is connected with the control unit 220, and may include Read-Only Memory (ROM) for storing an operating program, Electrically Erasable and programmable Read-Only Memory (EEPROM) , and Random Access Memory (RAM) .

Meanwhile, the reading program for causing the user to conduct reading is already stored in the memory 260. In this case, the reading program includes a plurality of text and graphic files.

Furthermore, the voice signal and the answer voice signal, which are input through the microphone 241, are converted into the user' s voice data and are then stored in the memory 260 under the control of the control unit 220. The control unit 220 controls the overall operation of the mobile communication terminal 200. Particularly, in the case where the reading function is set through the manipulation of the user, the control unit 220 operates the mobile communication terminal in a reading function mode by executing the reading program stored in the memory 260.

The TTS engine unit 270 is connected to one side of the control unit 220 to convert a text sentence, which has been input in a specific language and is transferred from the control unit 220, into audio wave data. Furthermore, in the embodiment of the present invention, various types of languages are additionally supported, so that TTS engines for languages desired to be supported can be additionally provided without limit. The audio processing unit 280 is connected to one side of the TTS engine unit 270 to convert the audio wave data, which is obtained through the conversion in the TTS engine 270, into the analog voice signal.

The audio processing unit 280 includes an audio driver, which is a typical software module, and an audio card, which is a hardware block.

Each of the voice signal and the answer signal, which corresponds to the user's voice, is input to the microphone 241, and is then transferred to the control unit 220 via the voice processing unit 240.

Each of the transferred voice signal and answer signal is converted into the user' s voice data and is then stored in the memory 260.

Furthermore, a corresponding text file that is already stored in the memory is transferred to the TTS engine unit 270 through the control unit 220, and is converted into audio wave data. The audio wave data, which is obtained through the conversion, is transferred to the audio processing unit 280, is converted into an analog voice signal, and is reproduced through the speaker 281. FIG. 3 is a flowchart illustrating a reading method using the mobile communication terminal according to the embodiment of the present invention.

The reading method using the mobile communication terminal according to the embodiment of the present invention is described with reference to FIG. 3 in conjunction with FIG. 2 below.

A first step SlO of detecting the user' s manipulation of the keypad unit 250, and setting the function of the mobile communication terminal 200 to a reading function is first performed. Accordingly, the control unit 220 executes the reading program, which is stored in the memory 260, in response to the user's setting of the reading function, thus switching the mobile communication terminal 200 to a reading function mode. That is, the first step is a process of searching the menu of the mobile communication terminal 200 and accessing the reading program.

In this case, the reading program may be one that has been stored in the memory 260 of the mobile communication terminal, and may be one that is downloaded via a connection to the wireless Internet.

The application program may include compressed moving image files that are downloaded to the mobile communication terminal over the wireless Internet, and provides graphics, text for captions, and voice corresponding to the text, without requiring driving of the TTS engine unit.

When the reading program is executed by accessing the reading program, a second step S20, at which the control unit 220 provides graphics or pieces of text data, which are stored in the memory 260, so as to be displayed on the display unit 210, and the graphics or the pieces of text data are responsible for providing guidance so as to prompt the user to set options, is performed.

Accordingly, the user selects the various options of the reading program, in response to the text or the graphics displayed on the display unit 210.

The options of the reading program include a novel, a fairy tale, a poem and the like according to reading genre, and are provided such that at least one of ^learning after reading' , ^Λcaption during reproduction' , ^recording of user's voice', and ^background music' is selected.

The option ^learning after reading' is performed in such as way that, after the story of the reading program has finished being output, simple yes or not questions about content, which are provided in the reading program, are transferred to the user through the speaker or the display unit 210.

As answers to the yes or no questions, the user inputs answer voice signals through the microphone 241.

Furthermore, the option ^λcaption during reproduction' is an option that, during narration of the story, can be selected to display a graphic screen on the display unit

210 and, at the same time, display a caption in the lower portion of the screen.

Furthermore, the option ^recording of user's voice' is an option for allowing the user to record his or her voice so as to coincide with the graphic screen and the flow of the story thereof in a state in which no caption is displayed on the display unit 210 and no voice is output through the speaker while a graphic screen is reproduced.

In the option ^Λrecording of user's voice,' described above, when the recording of the user's voice is finished, the graphic screen and the caption are displayed again on the display unit 210 and, at the same time, the user's recorded voice signal is reproduced through the speaker.

Furthermore, when the user's selection of the options for reproduction is completed, a third step S30, that is, the program reproduction step of starting to display an orally narrated fairy tale according to the guidance on the screen, is performed.

At the third step, the corresponding graphics stored in the memory 260 are output on the display unit 210 so as to coincide with illustrations that correspond to the content of the orally narrated fairy tale.

In this case, the control unit 220 transfers the text, which is transferred from the memory 260, to the display unit 210 such that the text is output as a caption displayed in the lower portion of the screen and, at the same time, transfers the text to the TTS engine unit 270.

Thereafter, the TTS engine 270 converts the transferred text data into audio wave data and transfers the audio wave data to the audio processing unit 280. The transferred audio wave data is converted into an analog voice signal and is output through the speaker.

Accordingly, the user can view a caption describing the content of an orally narrated fairy tale and, at the same time, can listen to voice corresponding to the text of the caption.

When the reproduction of the program is completed, that is, when the story of the fairy tale is finished being output, a fourth step S40, that is, an question answering step performed according to the options designated by the user, is performed.

The question answering step is performed such that, after the story of the fairy tale has finished being output, simple yes or no questions for determining whether the story has been understood are displayed on the screen of the display unit 210, and the user makes answers to the questions.

The answers to the questions are input to the mobile communication terminal 200 through the microphone as answer voice signals, and the input voice signals are transferred to the control unit 220 through the voice processing unit 240.

The control unit 220 compares the transferred answer voice signals with the correct answers provided in the program, and provides notification of whether correct answers exist through the display unit 210 or the speaker. Furthermore, the answers made by the user are evaluated and scored, and^' the notification of the results of the evaluation is provided through the display unit 210 or the speaker 281.

Accordingly, the mobile communication terminal having a reading function according to the embodiment of the present invention, and the method using the mobile communication terminal, execute the reading program stored in the memory 260 through voice recognition, and enable the user to conduct reading, thus greatly improving the reading capability of the user.

Furthermore, the program may be terminated after the third step S30 in the case where the user does not select a fourth step S40 as an option, whereas the program is terminated after the question answering has been performed in the case where the user does not select the fourth step S40 as described above.

When the above-described question answering step is completed, a review process is performed according to another option selected by the user.

As previously described for the option setting step S20, the review process is performed so as to reproduce the same graphics again from the beginning to the end on the display unit 210 and, at the same time, allow the user record the details of a corresponding story using voice signals . After the review process of recording the user' s voice signals has been performed, a screen reproduction process of simultaneously reproducing a graphic screen, which is displayed along with a caption, and the user' s voice signals, comparing the details of the story with the content of the user's voice, and determining the extent to which the user has understood the details of the story, is performed. Thereafter, the program is terminated.

[Sequence List Text]

None

Claims

[CLAIMS]

[Claim l]

A mobile communication terminal having a reading function, the mobile communication terminal having circuitry so as to execute stored application programs, the mobile communication terminal comprising: a display unit (210) for outputting a graphic image or a moving image to display execution status of a reading program; a voice processing unit (240) connected with a microphone (241) to receive a user's voice, and connected with a speaker (281) to output voice from the mobile communication terminal (200) ; a keypad unit (250) provided with a switching key for switching the mobile communication terminal (200) to a reading mode; memory (260) for storing the reading program, including graphic files, moving image files, voice files, and text files for which a plurality of languages is supported; a control unit (220) connected with the display unit (210), the voice processing unit (240), the keypad unit (250) and the memory (260) to control overall operation of the mobile communication terminal (200) , thus converting the user' s answer voice signal, which is transferred from the voice processing unit (240), into command data, performing operations for the reading program, extracting data, which is already stored in the memory (260) , according to results of the operations, and outputting the extracted data through the speaker (281) or the display unit (210); a Text-To-Speech (TTS) engine unit (270) connected to one side of the control unit (220) to convert a text sentence, which has been input in a specific language and is transferred from the control unit (220) , into audio wave data; and an audio processing unit (280) connected to one side of the TTS engine unit (270) to convert the audio wave data, which is obtained through the conversion in the TTS engine unit (270) , to an analog voice signal and transfer the analog voice signal to the speaker (281) .

[Claim 2]

The mobile communication terminal according to claim 1, further comprising a wireless processing unit (230) that is connected to one side of the control unit (220) , and accesses a mobile communication base station through an antenna (232), receives reading program data, and transfers the received reading program data to the control unit (220), under control of the control unit (220).

[Claim 3] The mobile communication terminal according to claim 1, wherein the operations for the reading program are performed in such a way that the answer voice signal, which is transferred from the voice processing unit (240) , is compared with answers in the program, and whether a corresponding answer is correct is determined.

[Claim 4]

A reading method using a mobile communication terminal having a reading function, the method executing application programs provided in the mobile communication terminal, the method comprising: a first step (SlO) of detecting a user's manipulation of a keypad unit (250), accessing a reading program, and setting a function of the mobile communication terminal (200) to a reading function; a second step (S20) of executing the reading program by accessing the reading program, and then prompting the user to set options through a display unit 210; a third step (S30), that is, a program reproduction step of starting a reading operation in response to guidance on a screen after the user' s option selection has been completed; and a fourth step (S40) of causing the user to make answers to questions, which are created by the program, according to the options that have been designated by the user after the reproduction of the program has been completed .

[Claim 5]

The reading method according to claim 4, wherein, at the second step (S20), the options of the reading program, which are selected by the user, are provided such that at least one of ^λgenre of reading' , *learning after reading' , ^λcaption during reproduction' , and ^background music' is selected.

[Claim 6]

The reading method according to claim 4, wherein, at second step (S20), the options of the reading program, which are selected by the user, include language selection that allows reproduction to be performed in a language selected from among a plurality of languages.

[Claim 7]

The reading method according to claim 4, wherein, at the third step (S30), that is, at a program reproduction step, graphics corresponding to content are output onto the display unit (210) in an illustration form.

[Claim 8]

The reading method according to claim 4, wherein, at the third step (S30) , that is, at a program reproduction step, a text caption is displayed in a lower portion of the display unit (210) .

[Claim 9] The reading method according to claim 8, wherein, at the third step (S30) , that is, at a program reproduction step, the user listens to voice corresponding to the text caption through a speaker.

[Claim 10] The reading method according to claim 4, wherein, at the fourth step (S40), the user's voice answers to yes or no questions, created by the program, are evaluated and scored.

[Claim 11] The reading method according to claim 4, wherein the application programs further comprise compressed moving image files that are downloaded to the mobile communication terminal over a wireless Internet, and provides graphics, text for captions, and voice corresponding to the text, without requiring driving of a TTS engine unit.