TWI238379B - System and method for language reiterating and correcting pronunciation in a portable electronic device - Google Patents

Abstract

The present invention provides a system and method for reiterating and correcting pronunciation in a portable electronic device, using a reiteration unit to perform and activate a reiterating and learning process. When a user operates the reiteration unit of this invention, the system first activates the pre-recorded pronunciation data of the language message selected by the user according to the reiteration command issued by the reiteration unit. The system then records the sound made by the user. The system then playbacks the pre-recorded language message followed by the user's sound recording, and decodes the sound recorded by the user to decode the audio sound recorded into a corresponding language message. A signal representing the degree of sounding similarity is then issued based on a determination process for the user's reference.

Description

1238379 V. Description of the invention α) [Application field of the invention] The present invention relates to a language reading and pronunciation correction system and method for a portable electronic device, particularly a follow-up reading system applied to a portable electronic device. The system and method can be used by the user to find the key points of the user's pronunciation error and improve it to improve the standard of the user's pronunciation. BACKGROUND OF THE INVENTION Currently, many portable electronic devices on the market, such as PDAs and electronic dictionaries, are equipped with language learning functions. The function of language learning is nothing more than pre-recording voice pronunciation, and these pre-recording voice pronunciation is nothing more than recording sentences or words in advance, and then making a sound after the user presses the pronunciation function key, so that the user can Hear the correct pronunciation; or, for some electronic devices with recording function, as long as the user presses the record button, the user can record their own voice, as long as the user presses the playback button, they can hear their own voice, In this mode, users can correct their own pronunciation. However, this operation mode is not convenient to use. The first point is that when the user wants to hear the difference between his own pronunciation and that of the electronic device, he must operate separately, that is, the pronunciation of the same word. After listening to the pronunciation of the system, he wants To listen to your own pronunciation, you must first find your own recorded sound file before you can play it. Because the two sounds cannot be played continuously, users can only rely on their own memory and judgment to correct their own pronunciation, which is time-consuming and time-consuming. trouble. The above-mentioned problems have been solved in the specific implementation of the advanced technology. According to the diagram of the system for learning the pronunciation of the portable electronic device of the advanced technology in Figure 1 and reading the system architecture diagram, the advanced technology system includes at least one following technology.

Page 4 1238379 V. Description of the invention (2) A reading unit 110, a micro-processing unit 120, a read-only memory unit 130, an accessible memory unit 140, and a timing single heart. , A broadcasting unit 160, a display unit 170, a stopping unit ΐδ〇 and a = list: 190, etc., which are mainly units that pull the pre-recorded voice information of speech information through the follow-up unit ιι〇 After that, the caller f reverses the recording of the user ’s pronunciation of the language information; after recording, the language information of the language information is played first; the recorded voice data of the user; bee = play later Trouble and time consuming. The user does not use the art as before, and still finds that there is room for improvement in the sound of the sound. The standard two for pronunciation: and the user's subsequent recording of non-objective judgment standards, add =: ^ Vertically to the user in a single word or sentence h if the user 4: =:,:-Straight to limit the question, the question is limited to a single word or sentence:: Do n’t, the pronunciation originally has the standard of asking pronunciation How about it? Can thousands of voices improve the user ’s elementary cost? 27. _Need_on the system architecture of the ^ period skill, and then add a score sheet role for ^ code early 275, and use the decoding unit 275 to translate The code message, ===, is converted into-the corresponding language consumer's ρ: as early as 70 7 negative shells-an objective role, for the making of the sound -4: 2 its corresponding language information, the language information and the pre-recorded In addition, the re-force = 1, the results of the judgment are for users' reference. . Afl with Jing method and a new contrast unit 2 9 5

$ 5 pages 1238379 -------------------------- _____ 5. Description of the invention (3) Application (as shown in Figure 2), so that users can Through the review of contrast units and strong language learning, the user's pronunciation ability is strengthened. In addition, users can learn from the most basic pronunciation and then learn the pronunciation of single words or sentences in an advanced way. In this way, users can find out the blind spot of their pronunciation through this more objective learning mode, and improve the blind spot to achieve the goal of making their pronunciation standard. [Objective and Summary of the Invention] In view of the problems of the above-mentioned conventional technology, the present invention is to provide a language reading and pronunciation correction system and method for a portable electronic device. The follow-up unit of the system performs the actions of sound comparison and judgment scoring to achieve the purpose of correcting the correct pronunciation of the voice itself. The invention is a language reading and pronunciation correction system applied to a portable electronic device. The system includes at least a following reading unit, a reading-only memory unit, an accessible memory unit, a recording unit, and a Twelve units including a broadcasting unit, a decoding unit, a micro-processing unit, a display unit, a timing unit, a stop unit, a comparison unit and a scoring unit. (1) Follow " I buy early yuan 'to provide users to enter a follow-up buy instruction, (2) Read-only memory unit, which is used to record language information, graphic messages and pre-recorded voice messages, and to record follow-up Read the control program; (3) Accessible memory unit to record the recorded voice information recorded by the user; (4) Recording unit to receive the recording instructions and execute the recording user

1238379 V. Description of the invention (5) Zunyi " ~ ^ For the features and implementation of the present invention, the best embodiment with the illustration is described in detail below: [Detailed description of the invention] A portable electronic device The language follow-up and pronunciation correction system and method. When the sigma follow-up read system and method are applied, we can use this system to explain how to pronounce correctly, and we can use the system to correct our existing $ tone situation. To achieve the ultimate goal of user pronunciation. So let's understand how the entire system and method work. First, we will use the following figure 2 of the portable electronic device of the present invention to read and pronounce the system architecture diagram to illustrate the basic architecture of the entire system. The system includes / follows a reading unit 2 丨 〇, a read-only memory unit 2 2 0, an accessible memory unit 2 50, a recording unit 240, a broadcasting unit 2σσ3〇, and a decoding unit 2 75. There are twelve units including a micro processing unit 2000, a display list = 26 °, a timing unit 290, a stop unit 280, a comparison unit 295 and a scoring unit 2 70. In Figure 2, the following reading unit 2 丨 〇, read-only memory unit 2 2 0, broadcast unit 230, recording unit 24o, accessible memory unit 25o, display unit 2-60, translation The code unit 2 75, the stop unit 28, the timing unit 29, the comparison unit 2 95, and the ping sub-unit 2 70 are all connected to the micro processing unit 200, which is the main processing unit 2GG. Control and message transfer process—Heian Zaoyuan 210 is responsible for sending follow-up instructions when the user operates, followed by :: is a follow-up key set on the touch screen or a voice input of a single language The read-only memory unit 22 records the available 1238379 V. Description of the invention (6) = the language information in the electronic type, including the text ... The audio information unit 23 is responsible for the speech information m Λ '' Follow the control program; broadcast, force to play, open the recording list? 4 〇 mesh chubby recorded the voice of the user,-a kind of accessible memory, shell, 丨 two interest 'accessible memory unit 2 50 is or, can also follow the control program :; Narrator :: What you want to record. :: So, follow the control program to update. In addition :: 2f early yuan 2 50 can also be used as a data storage area for expanding language information to display unit 260 responsible for displaying language information. Π Li Li Jiuyi ~ again in σΐ1 heart 'sweat points early Wu 2 7 0 The information is compared with the recorded voice information, and the voice information is divided into rr system. The second language stop unit 28 ° sends "for" to stop the recording properly when the user operates; the comparison unit 295 is responsible for the 音 sound at least-pronunciation Similar phonetic symbols, provide users with pronunciation practice of similar phonetic symbols = the user wants to do phonology on the portable electronic device; Λ; 1, the sentence under the word ^ (At this time, the text Λ information is prepared on the display unit) is known as the follower Zhuo Yuan 210, Micro processing unit 200 = Start the follow-up control program in single 7 ^ and start the follow-up control program in accordance with the program instructions of t :. Ten = follow-up unit 21 is the touch of the touch screen When the key is controlled, the user only needs to read M ′ under the key to carry out the whole language learning process without further reading.

Page 9 1238379

V. Description of the invention (7) The process begins: two ί JJ: 2: 2 Read the control program's stream to pre-record the voice from ,,,: After Tanaka's sentence, word or phonetic symbol, micro-processing: -9 sent to broadcast sound Tsui It will be played at RMB 23 0; at the same time, it will be used :: m to control the recording unit "ο to record and connect; at this time, user 2: f ΐ When the poor information is stored in the accessible memory unit 250, you can use the key like, % 9 After finishing or not recording the personal recording voice information touch key, follow the reading: make one key ^ is the touch screen stop recording element 280 and play Λ finger work order = for stop recording instruction to stop order this pre While recording the voice information and ㈣Λ'νηZ stop recording and start playing the processing order S2GG ^ pre-recorded shell SfL and the recorded voice information, the micro will send a decoded message to the decoding unit, and the text ::; ::: ΐΓ = Information information, and the recorded voice information "Send the score sheet with, the information information-from the speech similarity information represented by the delivery rate value.刀 比 ί ΐ Ϊ When the recording is started, the micro processing unit 2000 will also send out; ί: Γ = 2 9 0 'and record the time consumption, G is used; Stop recording touch: key: use: ㈡ Ren Er When the key or touch screen is touched, it will be sent immediately; one stop == f recording time is exhausted W 〇Π π This time Λ heart, Qi 嘁 processing early Yuan 2 0, the material will be accessed immediately Read-only notes; pre-recorded voice messages of s δ δ tongues, sentences, or early words of Tian γ, and page 10 1238379 V. Description of the invention (9) ^ r 一 " 一 ^ 一 ^ ----- Ϊ, (Second step 3′〇) Junzheng processing unit 200 will deduct from the read-only memory unit 2 20 ~ the pre-recorded voice information of the sentence, word or phonetic symbol, and hand it to the broadcast early Wu 2 3 0 to pre-record Speech is issued [After the cow is finished, the micro-processing unit 2 0 0:; (/.= ,, when the coffee is finished, use it and go to 袒 — ^ ^ β said that a flood message will be displayed to the display unit 2 6 0 to remind the user k If recording is not started (step 32), the display method such as "n 仏 μ * is displayed, and Yuantubu may be displayed in the" Recording "& text message; or," ... " Recording "t audio message The sound (Niu Su's same system) will continue to record and prompt the user to stop recording "/ stop two". The system prompts can be displayed on the display as a text message on the disk: two. Month ::: key. Use The user can use the key-stop: Touch the touch screen to stop recording the touch key. After sending it out, tie it together: 7 § The user operates the stop unit 280 (step 33 0) to stop recording and play the pre-recorded voice first, After playback, if the user has no operation, stop: ί ;;: After the number is limited to 7 (step 335), it will automatically stop 3 4 0). Pre-record 5 voices, and then play the user's recording (step access See Figure 3-B

At the same time when the user's recording is played, the pre-recorded voice message will be played at 20, and a pre-recorded voice of 2 Z ze code early 75 will be acted on the recorded voice 1, π code (step 3 5 〇), the button Newly owned capital order-corresponding voice information (step 35 ': Bei Chengze recorded voice information, Xi Xiang 廍 · ^ Shan 所有 Lu Po poor news, the sub-unit 270, 隹 δ ° Bei Bei Xun and the recorded voice The information is first submitted for each comparison action, and i is broadcasted by the broadcasting unit 23 at the same time.

1238379 V. Description of the invention (10) ~ The voice information and the corresponding voice information (step 36), then compare and judge in the scoring unit 27 (), and send a pronunciation similarity message (after the step, the user can This pronunciation similarity message is used as a reference basis for judging whether or not your own voice is standard. After the similarity message is displayed, the system: asks the user whether to save (step 38) the record of the follow-up program ^ 彔, 3 when the user selects If yes, the system will store the follow-up record in the desirable memory unit 2 50 (step 3 9 0) and end the follow-up procedure. If # = send No, the system will end the follow-up directly. In addition, in FIG. 4, in the flowchart of the comparison unit of the language follow-up and pronunciation correction method of the portable electronic device of the present invention, a phonetic symbol is taken as an example. When reviewing the saved follow-up records, the system will list the use of the follow-up system list (step 40 0) for the user to select a review. When the user clicks the record in the list (step 410), he clicks the audio. (Step 42) Afterwards, the system will start the comparison unit (Step 43 0). At this time, the micro processing unit 200 will display the comparison information mainly based on the phonetic symbol, that is, display the phonetic symbol and other pronunciation similar phonetic symbols for ^ User identification / When the user clicks the phonetic symbol again on the touch screen (step 440), the system will provide the user with the option to start the follow-up reading process or directly pronounce (step 45). Step 46 0), the system will guide the user to enter the 3-digit diagram of the portable electronic device of the present invention and the method for correcting the pronunciation and pronunciation of the portable electronic device according to the present invention, and execute the reading process; if the user selects Direct pronunciation (step 470), the system will play the pre-recorded voice message. Of course, the above embodiment is described by phonetic transcription, but if it is applied to the pronunciation of a single word or the pronunciation of a sentence, it can also be performed in the same mode.

Page 13 1238379 V. Description of the invention (11) Implementation, learning pronunciation and reading of information in other languages. Although the present invention is disclosed in the foregoing preferred embodiments as above, it is not intended to limit the present invention. Any person skilled in the relevant arts can make some changes and decorations without departing from the spirit and scope of the present invention. The patent protection scope of the invention shall be determined by the scope of the patent application scope attached to this specification.

1238379 on page 14 Brief description of the diagram. The first diagram is the architecture diagram of the language learning pronunciation and reading system of the portable electronic device of the prior art. The second diagram is the language reading and pronunciation system of the portable electronic device of the present invention. Le Tong architecture diagram, Fig. 3-A is a flowchart of the operation of the language reading and pronunciation correction method of the portable electronic device of the present invention; Fig. 3-B is the language following of the portable electronic device of the present invention. Reading and pronunciation correction method operation and reading flow chart for debugging and recording; and

FIG. 4 is a flowchart of an application comparison unit of the language reading and pronunciation correction method of the portable electronic device of the present invention. [Illustration of Symbols]

110 Follow-up unit 120 Micro-processing unit 130 Read-only memory unit 140 Accessible memory χ3Ό — · Early Wu 150 Timing Early Yuan 160 Broadcast Early 170 Display Unit 180 Stop Unit 190 Recording σσ Early Yuan 200 Micro Processing Unit 210 Follow-up Unit 220 read-only memory unit 230 broadcast early page 151238379 240 .coherent early Wu 250 accessible memory 9 r η y y 10 mouth Yi Ran Bei Wu Wu 2 70 scoring unit 275 decoding early unit 280 stop unit 290 timing unit 295 comparison unit step 3 0 0 start copying step 3 1 0 pre-recorded voice transmission step 3 2 0 prompt recording start step 3 2 5 record and prompt step 3 3 0 user operation step 3 3 5 timing T step 3 4 0 Stop recording and the user's recording step 3 5 0 Translate the corresponding recording step 3 5 5 into a corresponding step 3 6 0 Display the voice step 3 7 0 Compare and determine the interest step 3 8 0 Save step 3 9 0 Stored in the storable step 4 0 0 List using the follower c? — Read the system list from the memory unit early Phonetic user stops the recording unit to stop the pre-recorded speech, so that after playing the voice information to voice information for a decoding operation corresponding to the voice information and other information, and sends the pronunciation similarity information a

Page 16 1238379

Page 17

Claims (1)

90128410 t 一 ^ ♦ 二 车 锖 寺 _ li 1 · A portable recording of a note on Shikoukou a contains at least! Yo. Audio information recorded by the electronic device information recorded in the language correction and pronunciation correction The system is a system for pre-recording voice information to perform a comparison operation with a user. The system makes a follow-up reading unit for providing the user to input a pre-recording voice message storage with a finger reading memory unit. Fetch the memory list information; audio unit, use the input processing unit to access the memory list and read the pre-recorded voice data information by the picture command, one translation, one unique message, and the-recordable voice one recording user A micro unit, a follow-up instruction to control the language and a broadcast instruction; a decoding unit and the decoding instruction, for the recording voice information, a scoring unit, and a scoring instruction, It is aimed at 'to record a graphic information of the language information and the follow-up control program; Yuan is used to record the user's recording to receive a voice message and the follow-up And a code instruction of the recording memory unit message and the recorded message, the micro-processing recording voice into a corresponding processing of the pre-recorded voice recording instruction; the unit and the voice unit take out the voice display and a grading unit phase information into the language The information unit phase information command 'performs the recording of the read-only memory single phase connection, accepts the follow-up control program, plays the information and controls the sending of the recording instruction command and a stop recording connection for receiving a decoding operation. Message; link for receiving and recording the voice Page 17! 238379 The information is compared, and the similarity of the two is analyzed, and a similarity message is given. An broadcasting unit is connected to the micro processing unit to receive the broadcasting instruction and continuously play the transmission of the micro processing unit. The pre-recorded voice information and the recorded voice information; a display unit connected to the micro-processing unit for displaying the graphic information of the language information and the corresponding language information-a timing unit, which corresponds to the micro-processing unit A link for providing a time parameter to send the stop recording instruction and the broadcast instruction after waiting for a time; and a stop unit connected to the micro processing unit for receiving the stop recording instruction and performing a recording stop action . 2 · The language reading and pronunciation bridge system of the portable electronic device as described in item 1 of the scope of patent application, the graphic information is a single word, a sentence, a single phonetic symbol, / phonetic Any combination of a mouth icon of a sound, a mouth icon of a phonetic pronunciation, and a Chinese commentary. 3. The language reading and pronunciation correction system of the portable electronic device as described in item 2 of the scope of patent application, the word and the sentence can be at least in the form of English, French, German, Japanese or other national languages . 4 · If the language reading and pronunciation correction system of the portable electronic device described in item 1 of the scope of the patent application, the system further includes a comparison unit connected to the micro processing unit to display the phonetic symbol and at least A pronunciation similar to phonetic transcription. 5 If the patent application scope item 1 < language reading of portable electronic devices and Page 18 1238379 _Case No. 90124410_Year Month and Date__ VI. Patent Application Range Pronunciation correction system, the pronunciation similarity information is a numerical representation of the percentage ratio. 6. —A method for language reading and pronunciation correction of a portable electronic device, which is a method for comparing a pre-recorded voice information recorded by a language information with a recorded voice information recorded by a user. The method includes at least the following steps: starting a follow-up reading unit and sending a follow-up instruction; playing a pre-recorded voice message pre-recorded in the follow-up learning system according to the follow-up instruction and sending a recording prompt instruction; according to the recording The prompt instruction provides a start recording message; records the recorded voice information provided by the user and provides a stop recording message and sends a time parameter; according to the time parameter, waits for a time to send a stop recording instruction and a broadcast instruction; according to The stop recording instruction stops recording and plays the pre-recorded voice information first and then the recorded voice information according to the broadcast instruction; performs a decoding action on the recorded voice information and translates it into a corresponding language information; and displays the language Information and the corresponding language information, and compare the sound and font form and send it A pronunciation similarity message. 7. According to the language reading and pronunciation correction method of the portable electronic device described in item 6 of the scope of the patent application, the following reading unit is a following key or a speech input unit for speech input. 8. Language of portable electronic device as described in item 6 of the scope of patent application Page 19 1238379 ------ Case No. 90128410 VI. Scope of Patent Application Reading and pronunciation correction method, the recording start message is a text message on the display to start recording. The method of language reading and pronunciation correction of the portable electronic device described in item 9 of the scope of patent application of 9 · j, the start recording message is a sound message at the beginning of a speaker. I 〇 According to the language reading and pronunciation correction method of the portable electronic device described in item 6 of the scope of patent application, the stop recording message is a text message that stops recording on one of the displays ^ /. II. The method for language reading and pronunciation correction of the portable electronic device as described in item 6 of the scope of the patent application, the stop recording message is an audio message to stop recording one by one. It may be an ear. 2. According to the language reading and pronunciation correction method of the portable electronic device described in item 6 of the scope of the patent application, the step of waiting for a time further includes when the σ causes the user to operate a stop unit and Steps of sending the stop recording instruction and the playback instruction, stopping the recording according to the stop recording instruction, and first playing the pre-recorded voice information and then playing the recorded voice resource according to the playback instruction. The stop unit may be the portable Any one of the keys on the keyboard of the electronic device or one of the voice input units by voice input. 1 3 · According to the method of ancient Chinese reading and pronunciation correction of the portable electronic device described in item 6 of the scope of patent application, the pronunciation similarity information is a numerical representation of a percentage ratio. 1 4 · According to the language reading and pronunciation correction method of the portable electronic device described in item 6 of the scope of patent application, the language information is a record of the reading unit and can be stored in an accessible memory unit. 1238379 Case No. 90128410 \ 、 Scope of patent application ___ 1 5 · The portable electronic device + reading and pronunciation correction method described in item 6 of the scope of patent application, wherein the method further provides a use / following list to indicate the previous List of stored language information records for any ^ applied. As early as in the application of the scope of patent application No. 5 of the portable electronic reading and pronunciation correction method, the use of reading 糸 Λ. ° in the system list of muddy: two can be selected from a sentence pronunciation intonation Records, — monophonic records and a phonetic pronunciation pronunciation group into Mao Yue's j 7 § self-recording can be provided for users to click. Can be 'the': The record of the portable electronic-information described in item 16 of the scope of the patent application is clicked by the user, and the comparison information of the language in the list with at least-the corresponding language information; The language information is as described in the portable electronic mentoring method described in item 17 of the scope of the patent application. The language information and at least the corresponding response are: Beam can follow the user ’s point of view and follow the procedure. . Sat 16 18