KR20120109243A - Apparatus and method for studying foreign languages - Google Patents

Abstract

The present invention relates to a language learning method associated with an interpreter using a language learning device associated with an interpreter, comprising: (a) selecting a learning list to add a recent conversation content of an interpreter to a language, and searching for 'recent conversation content'; If selected (S71, S83), outputting a list of recent conversation contents in chronological order (S84); (b) selecting conversation contents of a desired time zone (S85), so that a series of conversation contents of a corresponding time zone are loaded into the language; And (c) the dialogue content loaded into the language in step (b), in accordance with one or more learning modes of "basic learning" mode, "listening learning" mode, "sentence learning" mode, and "speaking learning" mode. Characterized by executing learning.

Description

Language Learning Device and Method Associated with Interpretation Device {APPARATUS AND METHOD FOR STUDYING FOREIGN LANGUAGES}

The present invention relates to a language learning apparatus and method associated with an interpreter, and more particularly, to store a series of interpretation contents previously used by a user, and later load the same into a learning apparatus so that the learner can repeatedly learn. The present invention relates to a realistic language learning apparatus and method.

Recently, with the development of transportation and the economic level, the overseas travel is frequently made, and the visit of foreign tourists is increasing rapidly. However, when they travel abroad or talk with foreign tourists, they are not good at communicating with each other.

As a method for resolving such language barriers, a method of directly acquiring a foreign language of the other party, a method of bringing an interpretable travel guide, and a method of using a conversational book may be used.

However, there is a problem in that a method of directly acquiring a foreign language, which is the language of the other party, takes a long time and requires early study abroad.

In addition, the method of bringing an interpretable travel guide is expensive, and multilingual interpretation is in fact difficult.

In addition, the method of using a conversational book has a problem that it is difficult to adequately communicate in real time because it provides the user with only standardized sentences, and it takes a long time to find the sentence.

On the other hand, there is a method having a device for interpreting the input voice in addition to the above method, the related art is related to the image file database automatically linked by the Republic of Korea Patent No. 553075 (name: bidirectional response interworking information database) Multilingual automatic interpretation system for personal portable terminal using voice file database).

However, the related art sets various situations, selects question images that have been previously created and stored according to the situation, and simply outputs an image written in a counterpart language corresponding to the situation. It stores the response images that are stored in advance and simply outputs the image written in its own language that matches them, and it is impossible to ask various questions in various situations, and it is impossible to answer various questions. And there was a problem that can only answer.

On the other hand, the conventional language learner for conversation was only a degree of simply repeating the contents that fit the fixed framework assuming a predetermined scenario.

In order to solve the above problems, the present inventors, in consultation with the patent holder (the heir of the inventors) of the prior art, was devised to invent a two-way translator that is highly useful as a next-generation product. The 'object' of the sentence can be transformed in various ways to suit the situation, so that the question can be asked according to the situation, and also the answer can be given a specific answer to the situation. Furthermore, the input method can be selected from the stored examples. It goes a step further to make it possible to enter text directly using the keypad, and to input text by hand instead of inputting other text directly into text, and to input voice information from voice or photo information. Or converting image information into text That allows selection of the paper type manner, one entitled & patent application the invention is "bi-directional translator apparatus and method having various dialogue function" bar.

In addition, the inventors further noted that if they re-learn what they had interpreted in such special circumstances, it would be an extremely effective language learning in language learning, and would be a truly customized language learning. Inventive language learning apparatus and method for storing a series of interpretation contents previously used by a user and later loading the information into a learning apparatus so that the user can repeat and learn again.

In addition, the translator users can register their frequently asked questions or answers as favorites, and also load the questions or answers from the favorite menu into the language.

In order to achieve the above object, a language learning apparatus associated with an interpreter according to an aspect of the present invention includes an input unit 110 to which a textual object or handwritten data object and various selection signals that a user wishes to interpret are input. ); A language converter 140 for converting data of a user language into data of a counterpart language or vice versa; A storage unit 150 for storing the operation information and the multilingual interpreter related program for operating the bidirectional interpreter; A voice output unit 170 for interpreting the object input through the input unit 110 with reference to the data of the storage unit 150 and then outputting the interpreted question / answer through voice; A screen output unit 180 for displaying an input window for inputting an object desired by the user, or an interpreter function window for interpreting an object desired by the user and a finally translated question / answer; A language driving unit 220 for outputting language learning items stored in the language list unit 155 of the storage unit 150; A language unit loading unit 230 for loading contents of a favorite unit such as a bookmark related to an interpreter into the language list unit 155; And controls the functions of the input unit 110, the language converter 140, the storage unit 150, the voice output unit 170, the screen output unit 180, the language driver 220, and the language loader 230. And a controller 190 for converting the object input from the user as it is or converting the language accurately to the other's language, and storing the latest interpretation contents and controlling the language to be output by the driver. It is done.

Preferably, the microphone 130 for receiving voice information; And a recording unit 210 for temporarily storing a voice of a user input through the microphone 130 as it is or converting it into a digital value. The language driving unit 220 outputs a pre-stored voice signal. After (S24), after recording the voice of the user to record (S25), it is characterized in that the output of the comparison of the pre-stored voice signal and the user's recorded voice signal (S26).

On the other hand, the language learning method associated with the interpreter using the language learning device associated with the interpreter according to another aspect of the present invention, (a) select the learning list to add the recent conversation content of the interpreter to the language, ' If the recent conversation contents search 'is selected (S71, S83), outputting the recent conversation contents list in chronological order (S84); (b) selecting conversation contents of a desired time zone (S85), so that a series of conversation contents of a corresponding time zone are loaded into the language; And (c) the dialogue content loaded into the language in step (b), in accordance with one or more learning modes of "basic learning" mode, "listening learning" mode, "sentence learning" mode, and "speaking learning" mode. Characterized by executing learning.

Preferably, the learning mode of step (c) necessarily includes at least a "speaking learning" mode, the "speaking learning" process, (c1) determining whether the 'learning learning' mode is selected in the active window Step S21; (c2) if the 'learning to speak' mode is selected, displaying a 'speaking to learn' window (S22); (c3) checking the click of the play button (S23), and if the play button is clicked, outputting a pre-stored voice signal in a desired language and repeating the selected number of repetitions (S24); (c4) instructing the user to follow the foreign language pronunciation, and then recording the voice of the user (S25); And (c5) outputting the pre-stored voice signal and subsequently comparing and outputting the user's recorded voice signal (S26). . ≪ / RTI >

Also, preferably, the step (a) further includes a method of adding a learning list through 'favorite content search', and when the favorite content search of the interpreter is selected (S93), the items listed in the favorite of the interpreter To output in order (S94), and select the desired favorite content (S95), characterized in that the favorite content is loaded into the language.

More preferably, the interpreter of the interpreter, (A) step of selecting a user language (S501); (B) selecting a counterpart language (S503); (C) outputting a classification list and a question list in the selected user language or directly outputting a question list (S505 to S515 and S601); (D) selecting a specific object from the question list and immediately asking a question or processing the selected object and transforming the question and then asking a question; (F) interpreting and outputting the user's question in the language of the counterpart (S607, S609); And (G) if it is determined that the answer is a necessary question (S517), outputs a list of answers (S101), and if it is determined that it is not, terminating; And a control unit.

According to the language learning apparatus and method according to the present invention, it is possible to easily re-learn and re-learn by loading the interpreted content or frequently used contents into a language in a special situation experienced by the user, so that the customized language learning is certainly true. Will be

Other objects and advantages of the present invention in addition to the above object will be apparent from the detailed description of the embodiments with reference to the accompanying drawings.

1 is a view showing the configuration of a language learning apparatus associated with a bidirectional interpretation apparatus according to the present invention.
2A and 2B are flowcharts illustrating a language learning method according to a language learning type according to the present invention;
3 is a flowchart illustrating a flow for selecting a learning list for language learning according to the present invention.
4 is a flowchart illustrating a flow for adding a learning list from an interpreter for language learning to a learning list according to the present invention.
5 is a main flowchart of a bidirectional interpretation method associated with the present invention.
6 is a flowchart of a subroutine illustrating a method of asking a question after sentence reconstruction among two-way interpretation methods related to the present invention.
FIG. 7 is a flowchart of a subroutine illustrating a method of asking a question after searching a keyword among two-way interpretation methods related to the present invention. FIG.
8 is a flowchart of a subroutine for explaining a question after inserting a sentence in the bidirectional interpretation method according to the present invention.
9 is a flowchart of a subroutine illustrating a method of asking questions with visual information in the bidirectional interpretation method according to the present invention.
10 is a flowchart of a subroutine illustrating a method of answering a question in a bidirectional interpretation method related to the present invention.
11 is a flowchart of a subroutine illustrating a method of asking or answering a question according to a favorite menu in a bidirectional interpretation method related to the present invention.
12 is a bidirectional interpretation function window associated with the present invention, showing an example for language selection in FIG.
FIG. 13 is a bi-directional interpretation function window related to the present invention, showing an example for outputting and selecting a large classification list in FIG. 5; FIG.
14 is a bidirectional interpretation function window associated with the present invention, showing an example for outputting and selecting the classification list in FIG.
15 is a bidirectional interpretation function window associated with the present invention, showing an example for outputting and selecting a small classification list in FIG.
FIG. 16 is a diagram illustrating an example for outputting and selecting a simple question list in FIG. 6 as a bidirectional interpretation function window related to the present invention; FIG.
FIG. 17 is a two-way interpretation function window related to the present invention. When one of the simple question lists in FIG. 6 is selected and an interpreter is desired, the question is output in the other language and the simple answer list in FIG. 10 is output. Drawing showing an example for selecting.
FIG. 18 is a diagram illustrating an example of outputting a question in a counterpart language and outputting an answer request guide message in FIG. 10 in a bidirectional interpretation function window related to the present invention; FIG.
FIG. 19 is a diagram illustrating an example of outputting and selecting a list of states and material statements for outputting an answer in a user language in a bidirectional interpretation function window related to the present invention; FIG.
FIG. 20 is a bidirectional interpretation function window related to the present invention, in which an example for outputting and selecting a state and a reply list is displayed when a material statement is selected and an interpreter is desired. drawing.
Fig. 21 is a bidirectional interpretation function window related to the present invention, which shows an example of a state in which a reply is output in a user language when one of the reply lists is selected and an interpreter is desired;
FIG. 22 is a bidirectional interpretation function window related to the present invention, in which a counterpart of FIG. 10 outputs a graphic keypad window for directly typing and responding in a counterpart language and waits for input of a reply;
FIG. 23 is a bidirectional interpretation function window related to the present invention, in which a counterpart of FIG. 10 shows a state in which an input is directly inputted in a counterpart language;
FIG. 24 is a diagram illustrating a state of outputting an answer to a user after directly inputting an answer in a counterpart language by a counterpart as a bidirectional interpretation function window related to the present invention; FIG.
FIG. 25 is an interpreter function window corresponding to FIG. 14 applied to the second embodiment of the bidirectional interpreter according to the present invention, illustrating an example for outputting and selecting another classification list in FIG. 5; FIG.
FIG. 26 is a bidirectional interpretation function window corresponding to FIG. 15 for bidirectional interpretation applied to the second embodiment of the bidirectional interpretation apparatus according to the present invention, showing an example for outputting and selecting another sub-categorization list in FIG. 5; FIG.
FIG. 27 is an interpreter function window corresponding to FIG. 16 applied to the second embodiment of the bidirectional interpreter according to the present invention, illustrating an example for outputting and selecting another simple question list in FIG. 6; FIG.
FIG. 28 is an interpreter function window applied to the second embodiment of the bidirectional interpreter according to the present invention. When any one of the simple question lists in FIG. 6 is selected, FIG. Drawing showing an example.
FIG. 29 is an interpreter function window applied to the second embodiment of the bidirectional interpreter according to the present invention, and selects one of the other simple question lists in FIG. 6 to replace the selected question in the activated state; The figure which shows the example of the state which deleted the word.
30 is an interpretation function window applied to the second embodiment of the bidirectional interpretation apparatus related to the present invention, and selects any one of another simple question list in FIG. The figure which shows the example of the state which inputs a word on a keypad.
31 is an interpreter function window applied to the second embodiment of the bidirectional interpreter related to the present invention. The final question is completed by selecting any one of the other simple question lists in FIG. A diagram showing an example of a state.
32 is an interpreter function window applied to the second embodiment of the bidirectional interpreter related to the present invention, in which a simple question list in FIG. The figure which shows the example of the state interpreted later.
FIG. 33 is a view illustrating an example of a state of inputting 'keyword 1' in FIG. 7 as an interpretation function window applied to a third embodiment of a bidirectional interpretation apparatus according to the present invention; FIG.
FIG. 34 is an interpretation function window applied to the third embodiment of the bidirectional interpreter according to the present invention. When 'Keyword 1' in FIG. 7 is input, a list of example sentences including 'Keyword 1' is output and specific ' A diagram showing an example of a state where question 1 'is selected.
FIG. 35 is a view illustrating an example of a state in which 'keyword 2' is input in FIG. 7 as an interpreter function window applied to the third embodiment of the bidirectional interpreter according to the present invention; FIG.
FIG. 36 is an interpretation function window applied to the third embodiment of the bidirectional interpreter according to the present invention. When 'Keyword 2' in FIG. 7 is input, a list of example sentences including 'Keyword 2' is output and specific ' A diagram showing an example of a state where question 2 'is selected.
FIG. 37 is an interpretation function window applied to a third embodiment of a bidirectional interpreter according to the present invention, in which a final question in which a specific 'question 1' and a specific 'question 2' in FIG. 7 are combined is interpreted; FIG. Drawing showing an example.
38 is an interpretation function window applied to the fourth embodiment of the bidirectional interpreter according to the present invention. As a previous step for outputting the blank list of questions in FIG. 8, the keyword 'price' is entered. Drawing showing an example.
FIG. 39 is a view illustrating an example of a state of outputting a blank question list in FIG. 8 including the keyword 'price' as an interpretation function window applied to the fourth embodiment of a bidirectional interpretation apparatus according to the present invention; FIG.
FIG. 40 is a view illustrating an example of a state in which a number '20000' is input as an object to be input to a blank in FIG. 8 as an interpreter function window applied to the fourth embodiment of the bidirectional interpreter according to the present invention; FIG.
41 is an interpretation function window applied to the fourth embodiment of the bidirectional interpreter according to the present invention. After inputting the number '20000' as an object to be input to the blank in FIG. Indicative drawing.
FIG. 42 is an interpretation function window applied to the first modification of the fourth embodiment of the bidirectional interpretation apparatus according to the present invention, showing an example of a state in which an object to be input to the blank in FIG. 8 is entered as handwriting; FIG.
FIG. 43 is an interpretation function window applied to the first modification of the fourth embodiment of the bidirectional interpretation apparatus according to the present invention, showing an example of a state in which an object input by hand to a blank in FIG. 8 is replaced with text; FIG.
FIG. 44 is an interpretation function window applied to a fifth embodiment of a bidirectional interpretation apparatus according to the present invention, showing an example of a state in which an image picture of a sign is input as visual data in FIG. 9; FIG.
45 is an interpretation function window applied to the fifth embodiment of the bidirectional interpretation apparatus according to the present invention. As the visual data in FIG. 9, an image picture of a sign is input and other components of the question are added to complete the final question. The figure which shows the example of the state from which the last question is interpreted later.
46 is an interpreter function window applied to the sixth embodiment of a bidirectional interpreter according to the present invention, illustrating an example for adding a question to a favorite menu in FIG.
FIG. 47 is an interpretation function window applied to a sixth embodiment of a bidirectional interpretation apparatus according to the present invention, showing an example of a pop-up window for adding a question to a favorite menu in FIG.
48 is an interpreter function window applied to the sixth embodiment of a bidirectional interpreter according to the present invention, illustrating an example for interpreting a question using a favorite menu in FIG.
49 is a view for explaining an active window of a language learning method according to the present invention.
50 is a view for explaining an example of basic learning of a language learning method according to the present invention;
51 to 53 are diagrams for explaining an example of listening learning of a language learning method according to the present invention.
54 and 55 are views for explaining an example of sentence learning of a language learning method according to the present invention.
56 and 57 are diagrams for explaining an example of speaking learning of a language learning method according to the present invention;
58 is a view to explain an example for outputting a learning list list and selecting a learning item of a language learning method according to the present invention;
59 is a view showing an example of outputting a learning list of a language learning method according to the present invention;
60 is a view for explaining an example of adding an item through category search in the learning item adding method of the language learning method according to the present invention;
61 is a view for explaining an example of adding an item by searching conversation contents among the learning item adding method of the language learning method according to the present invention;
62 is a view showing an example of outputting a conversation content search list of a language learning method according to the present invention;
63 is a view for explaining an example of adding an item through a favorite search among the learning item adding method of the language learning method according to the present invention;

Hereinafter, the language learning apparatus and method according to the present invention will be described in detail with reference to FIGS. 1 to 4 and 49 to 63.

1 is a view showing the configuration of a bidirectional interpretation device and a language learning apparatus according to the present invention, Figure 49 is a view for explaining the active window of the language learning method according to the present invention, Figure 50 is a language learning according to the present invention 51 to 53 are views for explaining an example of listening learning of a language learning method according to the present invention, and FIGS. 54 and 55 are language learning according to the present invention. 56 and 57 are diagrams for explaining an example of a speech learning method of a language learning method according to the present invention, and FIG. 58 is a diagram for explaining a language learning method according to the present invention. FIG. 59 is a diagram illustrating an example of outputting a list list and selecting a learning item, and FIG. 59 is a view illustrating an example of outputting a learning list list of a language learning method according to the present invention; 60 is a view for explaining an example of adding an item through category search among the learning item adding method of the language learning method according to the present invention, and FIG. 61 is a dialogue content search among the learning item adding method of the language learning method according to the present invention. FIG. 62 is a view illustrating an example of adding an item through a dialog, and FIG. 62 is a view showing an example of outputting a conversation content search list of a language learning method according to the present invention. A diagram for describing an example of adding an item through a favorite search among methods.

First, Figure 1 is a view showing the configuration of the bidirectional interpreter and language learning apparatus related to the present invention, the language learning apparatus 100 associated with the bidirectional interpreter according to the present invention, as shown in Figure 1, the input unit 110 ), Camera 120, microphone 130, language conversion unit 140, storage unit 150, voice output unit 170, screen output unit 180, control unit 190, recording unit 210, The language driver 220 and the language rod unit 230 are included.

The input unit 110 may be a GUI environment using a touch pen and a touch panel or may use a separate keyboard.

In detail, the input unit 110 inputs a word that a user wants to interpret using a keyboard or a keypad, or a signal for selecting various icons is input. However, the input unit 110 uses a keypad under a touch pad of a GUI environment rather than a keyboard. In this case, a handwritten data text converter 105 for converting a handwritten input signal using a touch pen into text is added.

For example, the input unit 110 receives a selection signal for a word through the keypad 112 of the bidirectional interpreter as shown in FIGS. 13 to 16 to be described later, and presses the enter key 113. The input word is displayed on the input window 111, and as shown in FIG. 46, the selection signal for the word or sentence is received through the example sentence display window 117 displayed through the interpretation function window of the bidirectional interpreter. At the same time, the counterpart language and the user language are displayed on the counterpart language display window 114 and the user language display window 115, or the word or sentence previously input through the bookmark input window 116 is added to the bookmark window 119. Alternatively, the dictionary function window is displayed through the keypad switch window 118.

Similarly, visual data and voice data input through the camera 120 and the microphone 130 also include a visual information text converter 125 and a voice information text converter 135, respectively.

The language conversion unit 140 converts the data of the user language into the data of the other language or vice versa according to the user language selected in FIG. 12 (Korean in FIG. 12) and the other language (English in FIG. 12). .

In particular, in the present specification, by selecting the language with the flag of each country, it is possible to select a language quickly and easily, such as Korean, English, Chinese, Japanese, Russian, German, French, Spanish, Portuguese , Which supports multilingual translations in 16 countries including Arabic, Vietnamese (South / North), Thai, Mongolian, Indonesian (Indonesia), and Filipino, but can be applied to all multilingual languages in the world such as Czech and Malaysia Of course.

The storage unit 150 is a means for storing the operation information and the multilingual interpreter related programs for operating the bidirectional interpreter, a word DB 151 storing objects of hundreds of thousands of words or sentences that the user wishes to interpret And a foreign language database in which foreign languages such as English, Chinese, Japanese, Russian, German, French, Spanish, Portuguese, Arabic, Vietnamese (South / North), Thai, Mongolian, Indonesian, and Filipino are stored. 152), an example DB (153) storing similar words related to a word selected by the user, or a descriptive sentence such as a written sentence, question, exclamation sentence, and statement, a word and sentence previously selected by the user, or a frequently used word And a favorite DB 154 in which the sentence is stored.

The voice output unit 170 interprets the object input through the input unit 110 and then outputs the interpreted question / answer through voice.

The screen output unit 180 displays an input window for inputting words and sentences desired by the user, or displays an interpreter function window for interpreting words and sentences desired by the user and a finally interpreted question / answer.

The recording unit 210 performs a function of temporarily storing a user's voice input through the microphone 130 as it is or converting it into a digital value.

The language driving unit 220 performs a function of outputting language learning items stored in the language list unit 155 of the storage unit 150 of the apparatus of the present invention, and the language loading unit 230 is a bookmark associated with an interpreter. The content in the storage unit such as the above is loaded into the language list unit 155.

The controller 190 may include the input unit 110, the camera 120, the microphone 130, the language converter 140, the storage unit 150, the voice output unit 170, the screen output unit 180, and handwritten data. By controlling the functions of the text converter 105, the visual information text converter 125, the voice information text converter 135, the recording unit 210, the language driving unit 220 and the language loading unit 230, Words or sentences that are input from the language are translated or translated into the language of the other party, so that the interpreted contents can be saved and used for language learning.

Subsequently, the language learning method of the present invention will be described. As shown in FIGS. 2A and 2B, the language learning method will be described. In the language learning apparatus of the present invention, for example, the "basic learning" mode and the "listening learning" mode Four language learning methods are implemented: "sentence learning" mode and "speaking learning" mode.

Among them, the most important learning method is the "speaking learning method" as described with reference to Figs. 2A and 49, 56 and 57.

First, a part of the active window of the language learning method according to the present invention displayed when the user selects a language function is described with reference to each member number of FIG. 49 as an example.

absence
number function One Select and display four language learning modes: "learning", "listening", "sentence learning", "speaking learning" 2 Choose your language 3 Output window that displays sentences in the opposite language 4 Drive to display sentences in the other language 5 Drives voice output of sentences in other languages 6 Choose your language 7 Output window that displays sentences in your language 8 Drive to display text in your language 9 Drive speech output in your language 10 Choose to output the full list stored in the learning list 11 Select to transition to the first list stored in the learning list 12 Choosing to move to the previous learning list 13 Run learning methods such as voice output 14 Choosing to move to the next learning list 15 Select to transition to the last list stored in the learning list 16 Window for specifying and displaying the number of repetitions of the learning sentence 17 Select the type of audio output among the other language and the user language 18 Indicates that you are recording your voice 19 Run recording 20 Display and select the list of currently saved lessons 21 Choice to 'load' (load) the learning list from the interpreter 22 Output window showing the location of the learning list currently being printed 23 Displays the total number of items in the currently saved learning list and the location of the learning list currently being output.

Referring to the flowchart of FIG. 2A in more detail, first, it is determined whether the 'learning to speak' mode is selected in the active window as shown in FIG. 49 (S21), and if it is not selected to 'learning to speak' mode, FIG. 2B. When performing the general other learning mode as in, and select the 'speaking learning' mode to display the 'speaking learning' window (S22), as shown in Figure 56, the user outputs the text more than once.

Next, by checking the click of the play button (S23), if the play button is clicked and outputs the pre-stored voice signal (in this case, the American pronunciation of the English pronunciation of the already stored American) in the desired number of repetitions and the desired language (S24). ,

Thereafter, the user is instructed to follow the pronunciation of the foreign language, and then the voice of the user is recorded (S25). FIG. 57 is a diagram of capturing a screen in such a state, and the display LED of the 'REC' display unit (see '18' in FIG. 49) indicating that recording is being emitted in red.

Finally, it outputs the pre-stored voice signal and then compares and outputs the recorded voice signal of the user (S26). Standard inventions can be compared and calibrated on the fly. In some cases, if desired by the user, the user may press the recording execution button (19 in FIG. 49) to correct the pronunciation while additionally performing recording and pronunciation comparison.

Next, the other learning execution mode of FIG. 2B will be described. First, it is determined whether the user has selected a learning mode (S31), and if it is determined that the basic learning mode is selected (S32), the basic as shown in FIG. The bar that displays the learning window (S33), and outputs the text more than once to the user.

Next, by checking the user's click of the play button (S34), if the play button is clicked, it outputs the pre-stored voice signal (in this case, the American pronunciation of the English pronunciation of the already stored American) in the desired number of repetitions and the desired language. S25).

On the other hand, if it is determined in step S31 that the listening learning mode is selected (S42), the basic learning window as shown in FIG. 51 is displayed (S43). In this case, the text is not displayed because it is listening learning.

Next, by checking the user's click of the play button (S44), if the play button is clicked, it outputs a pre-stored voice signal (in this case, the American pronunciation of the English pronunciation of the already stored American) as many times as the selected repetition number and the desired repetition language ( S45).

Now, the user will be able to record the foreign language they hear or draw in their head, so that the user can see whether it was heard correctly or which part was not heard well, as shown in FIG. (S46).

Subsequently, the voice signal output in step S45 is performed once more to complete the meaning of the foreign language (S47). This time, as shown in FIG. 53, text corresponding to the interpretation in the native language (here, Korean) is displayed. (S48).

Finally, in the case of determining that the sentence learning mode is selected (S52), the basic learning window as shown in FIG. 54 is displayed (S53). In this case, since the sentence learning, only the native language text is displayed and the relative language text is displayed. Do not display.

Next, by checking the user's click of the play button (S54), if the play button is clicked, it outputs the pre-stored voice signal (in this case, the American pronunciation of the American pronunciation), which is already selected as many times as the repetition number selected and the desired repetition language ( S55).

Now, the user will recognize the foreign language he hears as a sentence, so that the relative (foreign language) language is also displayed, as shown in FIG. 55, so that the sentence is correctly composed or which part is not well. (S56).

Meanwhile, with reference to FIGS. 3, 58, and 59, an example for outputting a learning list list of a language learning method according to the present invention and selecting a learning item will be described.

First, when the learning 'list' button (actually an icon in the GUI environment) of the part number '20' of FIG. 49 is clicked (S61), the current language learning list unit (155 of FIG. 1) as shown in FIG. 59 is stored. The learning list is displayed (S62), and the specific screen configuration of this output window is summarized in the following <Table 2> with reference to FIG.

absence
number function One Category of learning list currently output 2 List of all learning list 3 Learning List Output Order 4 Learning list of the learning list 5 Selection voice output 6 Scroll bar 7 return 8 Language switching between output user language and relative language

Thereafter, when a specific item is selected from the learning list of FIG. 59 or 60 (S63), the learning window of the selected item is displayed (S64). This may be the output window of any one of FIGS. 50, 51, 54, and 56 in more detail according to a predetermined learning mode.

Now, the learning item addition of the language learning method of the present invention will be described with reference to FIGS. 60 to 63.

First, when the 'load (load)' button (actually an icon in the GUI environment) of the member '21' of FIG. 49 is clicked (S71), as shown in FIG. 60, it is learned from an interpreter (FIG. 1 110-190). An additional learning list search window for 'loading' (loading) the list is displayed (S72). The detailed screen configuration of this output window is summarized in the following <Table 3> with reference to FIG.

absence
number function One Search button to bring the contents of a fixed category of interpreters into the learning list 2 Currently selected category 3 Search button to bring an interpreter's previous conversations into the learning list 4 The currently selected chat file name 5 Search button to bring the interpreter's bookmarked content into the learning list 6 Search button to bring the bookmarked contents of the dictionary into the learning list 7 Search button for randomly importing the contents of a fixed category of interpreters into the learning list 8 Action button to bring the contents of a specific fixed category of the interpreter into the learning list 9 Action button to bring an interpreter's previous conversation to the learning list 10 Return button 11 Cancel button

Now, in order to 'load (load) the specific contents of the translator into the learner, as described above,' load the fixed specific category contents of the translator into the learning list ',' the previous conversation contents of the translator into the learning list In the case of selecting one of the three methods of “Importing” and “Importing bookmarked contents of the translator into the learning list”, in case of selecting 'Fixed category search' (S73), FIGS. 13 to 15 As shown in the list of classifications (S74), if a small category of the desired classification content is selected (S75), the questions corresponding to the classification are loaded into the language. This will most likely be appropriate to put a list of questions in the dictionary in practice.

Next, in case of selecting 'Recent conversation contents search' as shown in FIG. 61 (S83), the list of recent conversation contents as shown in FIG. 62 is output in chronological order (S84), and when the conversation contents of a desired time zone are selected (S85). In this case, a series of conversations in the corresponding time zone are loaded into the language. It will be suitable for the learning method to acquire the language knowledge completely by learning the dialogue contents after the fact.

Subsequently, when the 'favorite content search' is selected as shown in FIG. 63 (S93), the items listed in the favorites as shown in FIG. 48 are output in order (S94), and the desired favorite content is selected (S95). ), The favorite content will be loaded into the language. This will be a good way to learn how to acquire your own language knowledge by frequently repeating frequently asked questions or answers.

Since the core of the learning method of the present invention is to learn with the contents of the interpreter to the last, with reference to the accompanying drawings Figure 4 and Figures 5 to 48 which is now another patent application filed by the present inventor The bidirectional interpretation apparatus and method related to the present invention will be further described.

(First embodiment of two-way interpreter and method)

First, a first embodiment of a bidirectional interpreter according to the present invention will be described with reference to FIGS. 4 to 6, 10, and 12 to 24.

Meanwhile, the bidirectional interpretation method having various question-and-answer functions according to the preferred embodiment of the present invention will be described with reference to FIGS. 5, 6 and 10, and FIGS. 12 to 24.

5 is a main flowchart of a bidirectional interpretation method according to the present invention, FIG. 6 is a flowchart of a subroutine for explaining a question after sentence reconstruction among the bidirectional interpretation methods related to the present invention, and FIG. 10 is a present invention. Among the two-way interpretation method associated with the flow chart of a subroutine for explaining how to answer questions, Figure 12 is an interpretation function window applied to the two-way interpretation device related to the present invention, the language selection in Figure 5 FIG. 13 is a view illustrating an example for outputting and selecting a large classification list in FIG. 5 as an interpretation function window applied to a bidirectional interpretation apparatus according to the present invention, and FIG. 14 is related to the present invention. An interpreter function window applied to a bidirectional interpreter, which shows an example for outputting and selecting the classification list in FIG. 5, and FIG. 15. Is an interpreter function window applied to the bidirectional interpreter according to the present invention, which shows an example for outputting and selecting a small classification list in FIG. 5, and FIG. 16 is an interpreter function window applied to the bidirectional interpreter according to the present invention. 6 is a diagram illustrating an example for outputting and selecting a simple question list in FIG. 6, and FIG. 17 is an interpreter function window applied to a bidirectional interpreter according to the present invention. Fig. 18 is a view showing an example for outputting and selecting a simple answer list in Fig. 10 when a question is selected and an interpreter is desired, and Fig. 18 is an interpreter applied to a bidirectional interpreter according to the present invention. As a function window, an example of outputting an answer request guide message shown in FIG. 10 in a state of outputting a question in a counterpart language is shown. 19 is a view showing an example for outputting and selecting a list of states and material statements for outputting an answer in a user language, which is an interpretation function window applied to a bidirectional interpreter according to the present invention, and FIG. Interpretation function window applied to the bidirectional interpreter related to the related text. When selecting any one of the material statement list and wanting to interpret, it shows an example for outputting and selecting the status and reply list. 21 is a view showing an example of a state of outputting a reply in a user language as an interpreter function window applied to the bidirectional interpreter according to the present invention, and FIG. 22 is applied to the bidirectional interpreter according to the present invention. In the interpreter function window, a graphic keypad window for responding by directly typing in the partner language of FIG. 23 is a view showing a state waiting for the output, Figure 23 is a translation function window applied to the two-way interpreter associated with the present invention, a view showing a state in which the opponent of Figure 10 entered directly by typing the answer in the other language, FIG. 24 is a view illustrating a state in which an interpreter function window applied to a bidirectional interpreter according to the present invention outputs an interpreted answer in a user's language after the other party directly inputs and inputs an answer in a counterpart language.

First, as shown in FIG. 12, the user selects a user language and a counterpart language using a touch pen or the like from the dictionary function window of the bidirectional interpreter displayed through the screen output unit 180 (S501 of FIG. 5). , S503). In this example, as shown in the lower flag of FIG. 12, Korean (see lower left) is selected as the user language and English (see lower right) as the other language.

For reference, both the user language and the counterpart language may be selected as Korean. In this case, the user language and the counterpart language may be used as a device for communicating with the visually and hearing impaired person.

In this case, the controller 190 displays all user environments displayed in Korean as an example, and recognizes information about a question to be input later in Korean, and displays information about a later displayed answer in Korean. For example, information about an answer is recognized in English, and information about a later displayed question is displayed in English.

Next, the bidirectional interpreter related to the present invention, for example, classifies all about 6,000 questions and answers into, for example, eight major categories, and then, in each of these major categories, for example, several subclasses, and again in each middle class. After dividing the information into several subclasses, a few dozen typical questions are pre-set as an example in each subclass. First, as shown in FIG. ).

Next, when the user makes a large category selection (S507) (in this case, selecting 'restaurant'), as shown in FIG. 14, the middle classification list corresponding to the 'restaurant' is output (S509).

Again, when the user selects the middle classification (S511) (in this case, selects the 'order'), as shown in FIG. 15, the small category list corresponding to the 'order' is output (S513).

Subsequently, the user makes a small category selection (S515) (in this case, selects 'recommended'), and finally asks a question regarding 'recommended' (S600). Will be (S100), if necessary will be repeated questions and answers.

Regardless of the contents of the intention for convenience, the intention that the user conveys to the other party is called a 'question', and the intention that the other party conveys to the user is called an 'answer'. Therefore, even if there is a question, if the content does not require an answer (S517), it may be terminated without an answer.

Conversely, after answering, if it is determined that a material statement is necessary (S519), the process may proceed to step S600 again so that the material statement and the answer may be repeated.

First, a question S600 (a sentence reconstruction question) according to the first embodiment of a typical bidirectional interpreter related to the present invention will be described with reference to FIGS. 6 and 13 to 17.

That is, when the user selects the 'recommended' subclassification selection from the subcategory list (S515 of FIG. 5), as shown in FIG. 16, the user outputs a question list corresponding to 'restaurant'-'order'-'recommendation'. (S601).

At this time, if the user checks whether there is a desired question list from the question list, the user selects a desired question (S603) (in this case, the question 'what is the best thing?') Is selected. And if you want a 'question' (S605), the interpreter 100 according to the present invention accesses a foreign language database in the other language, and converts it to an English question matching the corresponding question (S607), the interpreted question ('What do you do best?') Is displayed on the screen output unit 180 and at the same time outputs a voice called 'Chicken nipple best' to the voice output unit 170 (S609) (see the top of FIG. 17). ). The voice output unit 170 may include a known speaker (not shown), an amplifier for this, a voice signal converter, and a voice data signal generator (not shown).

However, the question selection step, the question step, the question interpretation step and the interpreted question output step (S603 ~ S609), and the answer list output step (S101 of FIG. 10) to be described later to be made almost simultaneously, the question selection step ( S603) and the question step S605 may be used to select different buttons (icons) to distinguish them, but they may be set to be completed by double clicking when both are performed simultaneously and by single clicking when only the former is desired.

Next, the answer S100 according to the embodiment of the bidirectional interpreter related to the present invention will be described with reference to FIGS. 10 and 17 to 21.

That is, referring to FIG. 10 and as shown in the middle part of FIG. 17, while the user's question is output in the other language (English), an answer list in the other language (English) is output at the same time (S101).

Thus, the other party may select the desired answer from the list of answers (S105), but the other party may not be familiar with the present interpreter, as shown in FIG. 18, the English guide to select the answer from the list that is output The message is output (S103).

Then, when the other party selects the desired answer ('I am good at the following') (S105), an interpreter ('well doing the following') is searched for a user language (Korean) matching the selected answer. As shown in the upper part of FIG. 19, the interpreted answer is simultaneously output in text and voice (S109). In fact, if the other party points to a menu that is good at the menu, for example, and selects 'I am good at the following', it will print 'what it does well'.

Subsequently, if there is a list of material statements for answers, as shown in the middle of FIG. 19, the material statement list is output (S111), in which case it will be generally a simple greeting (in this case, 'yes I know') I'm thankful.)

As described above, if the material statement is required to return to FIG. 5 (S519 of FIG. 5), as shown in FIG. 5, the step S600 for questioning is repeated.

That is, as shown in the upper part of FIG. 20, an interpreter ('Okay, I understand') corresponding to a material sentence ('Yes, I understand') is output. As shown in the middle part of FIG. 20, 'Please be happy everyone' is output. Is selected, and as shown in Fig. 21, the answer is 'happy all' is output in text and voice.

According to the first embodiment of the bidirectional interpreter according to the present invention, the user's questions are classified into a hierarchical structure, so that the user can use them appropriately according to the current situation, and an answer corresponding to the current situation is automatically given. Since the questions and answers are easy and convenient, and in some cases, as shown in the modified example, the texts can be answered, and there are advantages in that various questions / answers can be easily made in various ways.

(First modification of the first embodiment of the bidirectional interpreter and method)

Meanwhile, referring to steps S121 to S123 of FIG. 10, as shown in FIGS. 22 to 24, when the answer desired by the counterpart is not in the pre-stored answer list, the interpreter becomes useless in the conventional apparatus, but the present invention In the translator of the other party, the answer can be entered by typing directly.

That is, as shown in FIG. 22, after the keypad is displayed (S121 of FIG. 10) (it is preferable to automatically display the English keyboard if there is no answer for a certain time), as shown in FIG. Typing and typing the answer (here 'beefsteak') directly from the keypad of this GUI environment (S123), as shown in Figure 24, the answer is translated into Korean (here 'beef steak') and is output almost simultaneously ( S107-S109).

(2nd modification of 1st Embodiment of a bidirectional interpreter and method)

On the other hand, referring to the step S130 ~ S141 of FIG. 10, if the answer that the other party wants does not exist in the pre-stored answer list, the translator of the present invention may input the answer by writing the answer by hand.

However, unlike the first modified example, because of the recognition rate in handwriting, it is desired to be written in sperm, and even handwritten characters vary depending on the person, as shown in FIGS. 42 and 43 to be described later. In the process of textification, attempts to raise the recognition rate are necessary. Since this is similar to the fourth embodiment of the bidirectional interpreter associated with the present invention, details will be described later.

(Third Modification of First Embodiment of Bidirectional Interpreter and Method)

On the other hand, referring to the step S150 ~ S153 of FIG. 10, if the answer that the other party wants is not in the pre-stored answer list, the interpreter of the present invention, it is also possible for the other party to directly input the answer by voice.

Also, as in the second modified example, in the case of speech recognition, since the recognition rate is required, accurate pronunciation is desired, and even though the voice, intonation and dialect vary according to the person, the text recognition process is to increase the recognition rate somewhat. If an attempt is needed, this is similar to the fifth embodiment of the bidirectional interpreter associated with the present invention, details will be described later.

(Second Embodiment of Bidirectional Interpreter and Method)

Now, a second preferred embodiment of the present invention will be described with reference to FIGS. 6 and 25 to 32.

FIG. 25 is an interpreter function window corresponding to FIG. 14 applied to the second embodiment of the bidirectional interpreter according to the present invention. FIG. 26 is a diagram illustrating an example for outputting and selecting another classification list in FIG. FIG. 15 is an interpreter function window corresponding to FIG. 15 applied to the second embodiment of the bidirectional interpreter according to the present invention, and shows an example for outputting and selecting another sub-categories list in FIG. An interpretation function window corresponding to FIG. 16 applied to the second embodiment of the bidirectional interpretation apparatus related to the present invention is a view showing an example for outputting and selecting another simple question list in FIG. 6, and FIG. 28 is an embodiment of the present invention. An interpreter function window applied to the second embodiment of the bidirectional interpreter related to the present invention. When any one of the simple question lists in FIG. 6 is selected, the display window of the selected question is activated. FIG. 29 is an interpreter function window applied to the second embodiment of the bidirectional interpreter according to the present invention, and selects one of the other simple question lists in FIG. FIG. 30 is a view illustrating an example of a state in which a word to be replaced is deleted while the display window of the selected question is activated, and FIG. 30 is an interpreter function window applied to the second embodiment of the bidirectional interpreter according to the present invention. FIG. 31 is a view illustrating an example of a state in which a word to be inserted is input by using a keypad while any one of the simple question lists of the user is selected and the word to be replaced is deleted, and FIG. In the interpretation function window applied to the second embodiment, one of the other simple question lists in FIG. 6 is selected and a word to be substituted is input. Is a diagram showing an example of a state in which a final question is completed and FIG. 32 is an interpreter function window applied to the second embodiment of the bidirectional interpreter according to the present invention. After completing the final question by selecting and inputting a word to be replaced, the figure shows an example of an interpreted state.

For reference, for the sake of a smooth description of the present embodiment, in the present embodiment, as shown in FIGS. 25 to 27, 'shopping'-'bargain payment'-'bargaining' was selected, and the user specified up to '20000'. I want to ask you the question, but suppose that there is no such question in the question list, and there is a question, 'How far can you cut it?' As the closest question among the questions (see the top question in FIG. 27). ).

That is, if there are no questions desired by the user among the questions displayed in S601 of FIG. 5, the conventional interpreter also becomes obsolete, but in the interpreter of the present invention, the nearest question ('how much can be cut off) Is there? ') Is selected (S603).

Then, as shown in the upper part of FIG. 28, once the selected question is displayed and activated in the active text processing window, the activated question is changed so that each word or each letter can be changed in the text active window. In order to select a character to be substituted in the existing standardized question (S611).

Thereafter, as shown in the upper part of FIG. 29, the selected character to be replaced is deleted, and as shown in FIG. 30, the keypad of the user language is output (S613), and the desired character to be replaced (in this example, 20000). Thus, as shown in the upper part of FIG. 31, the letter to be replaced (here 20000) is inserted in place of the letter to be replaced in FIG. 29, thereby reducing the desired complete question (here, to 20,000). Can you? ')

Thereafter, as in the case of the first embodiment, it is interpreted and outputted in the language of the other party (S607, S609), that is, the process proceeds to step S607 of FIG. 6, and as shown in FIG. 32, 'Could you lower the price by 20000? 'Is interpreted and output (S607, S609).

In the second embodiment of the bidirectional interpreter according to the present invention and the third to fifth embodiments to be described later, in particular, objects such as words or sentences can be reconfigured and used, such as by converting, partially replacing or combining objects, so that they are suitable for the site. The added advantage is that accurate questions / answers are possible.

(Third Embodiment of Bidirectional Interpreter and Method)

Referring now to FIGS. 7 and 33-37, a third embodiment of a bidirectional interpreter associated with the present invention will be described, which may be searched for a keyword to select one of the questions containing the keyword, or 2 When a question is asked by combining two or more questions corresponding to more than one keyword.

FIG. 7 is a flowchart related to a subroutine illustrating a method of asking a question after searching a keyword among two-way interpretation methods related to the present invention, and FIG. 33 is an interpretation function window applied to the third embodiment of the two-way interpretation device according to the present invention. 7 is a diagram illustrating an example of a state of inputting 'keyword 1' in FIG. 7, and FIG. 34 is an interpretation function window applied to a third embodiment of a bidirectional interpreter according to the present invention. 1 is a diagram showing an example of a state of outputting a list of example sentences including 'keyword 1' and selecting a specific 'question 1', and FIG. 35 shows a third embodiment of the bidirectional interpreter according to the present invention. As an interpreter function window to be applied, a diagram showing an example of a state of inputting 'keyword 2' in FIG. 7, and FIG. 36 is an interpreter function window applied to the third embodiment of the bidirectional interpreter according to the present invention. 7 is a diagram illustrating an example of a state in which a list of example sentences including 'keyword 2' is output when 'keyword 2' is input and a specific 'question 2' is selected, and FIG. 37 is a bidirectional interpretation apparatus according to the present invention. An interpreter function window applied to the third embodiment of FIG. 7 is a diagram illustrating an example of a state in which a final question of a combination of a specific 'question 1' and a specific 'question 2' in FIG. 7 is interpreted.

First, when the user selects a dictionary function (S701), the device outputs a keypad of a user language (Korean) (S703), where the user inputs a desired keyword 1 ('apple' in the embodiment of FIG. 33). (S705).

Next, the bidirectional interpreter displays the keyword 1 input through the step S705 on the input window 111, and displays an interpreter function window as shown in FIG. 33 according to the switching signal input through the enter key 113. FIG. Simultaneously with the display, questions including words identical or similar to the input keyword 1 are displayed through the example sentence display window 117 (S707).

For example, when the user touches the keypad 112 using the touch pen to input 'apple' and clicks the enter key 113, as shown in FIG. 34, a similar word or sentence related to 'apple' ( Objects), such as 'apple', 'apple (fruit)', 'apple tree', 'apple door' and the like are listed through the example sentence display window (117).

Thereafter, the user selects 'question 1', for example, 'apple (fruit)' which is desired to be interpreted by touching the touch pen 120 through the touch pen 120 (S705), and the selected 'apple' question. If you want to immediately (No of S711), the word is displayed on the user language display window 115, and at the same time, the translation (English word) of the question 1 'apple' is displayed on the other language display window 114 (Fig. 34). Reference).

However, if the user wants a word combination in step S711, such as by selecting the keypad switch window 118 (Yes in S711), the bidirectional interpreter is a dictionary function window as shown in FIG. To display again, the user enters 'keyword 2' (here 'how') (S713).

Next, the bidirectional interpreter displays the keyword 2 input through the step S713 on the input window 111, and displays an interpreter function window according to the switching signal input through the enter key 113. As shown in FIG. 5, the same or similar words as the input keyword 2 or questions (objects) including the same are displayed through the example sentence display window 117 (S715).

For example, when the user enters 'how much' and clicks the enter key 113, similar words related to 'how much', 'how long is it?', 'How long is it delayed', as shown in FIG. 'How much is it?' Questions are listed through the example display window 117.

Thereafter, when the user selects the question 2, for example, 'how long?', Which the user wishes to interpret (S717), the control unit selects the question 1 selected through the step S709 as shown in FIG. Or 'apple') and the question 2 ('How much is it?') Selected in step S717, are displayed on the user language display window 115 or the counterpart language display window 114 in combination. (S719).

In this case, when the user touches the user language display window 115 or the counterpart language display window 114 with the touch pen 120, the selected 'how much is the apple?' Or the voice 'apple how much is it' is output through the voice output unit 180 (S240).

In the third embodiment of the bidirectional interpreter according to the present invention, in particular, it is possible to search for questions / answers only with keywords, so that a quick question / answer is possible.

Fourth Embodiment of Bidirectional Interpreter and Method

Subsequently, with reference to FIGS. 8 and 38-43, a fourth embodiment of a bidirectional interpreter in accordance with the present invention will be described, which allows a question to insert a sentence into a question containing a blank, thereby allowing a question to be asked. This is the case to have diversity.

8 is a flowchart relating to a subroutine for explaining a question after inserting a sentence among the bidirectional interpretation methods related to the present invention, and FIG. 38 is an interpretation function window applied to the fourth embodiment of the bidirectional interpretation device according to the present invention. 8 is a view showing an example of a state of inputting a keyword 'price' as a previous step for outputting a blank question list in FIG. 8, and FIG. 39 is a fourth embodiment of a bidirectional interpreter according to the present invention. Fig. 8 is a view showing an example of a state of outputting a blank question list in FIG. 8 including the keyword 'price' as an interpreter function window applied to the present invention. An interpreter function window to be applied to an example, a diagram showing an example of a state in which the number '20000' is input as an object to be input to the blank in FIG. 8, and FIG. Fig. 42 is a view showing an example of a state where a final question is completed after inputting the number '20000' as an object to be input to the blank in Fig. 8 as an interpreter function window applied to the fourth embodiment of the related bidirectional interpreter. FIG. 14 is an interpretation function window applied to the first modified example of the fourth embodiment of the bidirectional interpretation apparatus according to the present invention, and is a view showing an example of a state in which an object to be input to the blank in FIG. An interpretation function window applied to the first modification of the fourth embodiment of the bidirectional interpretation apparatus according to the present invention, which shows an example of a state in which an object input by hand to a blank in FIG. 8 is replaced with text.

First, the user selects a dictionary function, and the device outputs a keypad of a user language (Korean), in which the user inputs a desired keyword ('price' in the embodiment of FIG. 38), and the device generates the keyword. A list of questions corresponding to ('price') is output, wherein each question has a form of an unfinished question containing blanks for inserting words or sentences as shown in FIG. 39 (S801). ).

Now, the user selects one of them (S803) (in the case of FIG. 40, selects 'Can you reduce the price to (?)'), And displays the user keypad again to insert a word to be inserted in (). To select a number (S805, S807).

In the present embodiment, assuming that the number '20000' is to be inserted into (), as shown in FIG. 30 of the second embodiment, the number '20000' is input through the keypad, and as shown in FIG. 41, ' Can you reduce the price to 20000? ', And then the process proceeds to step S607 of FIG. 6, and the question' Could you lower the price by 20000? 'Is interpreted as in FIG. 6, S607, 609).

In the fourth embodiment of the bidirectional interpreter according to the present invention, in particular, by preparing a question / answer for blanking a part which is expected to be highly deformed, a quick question / answer is possible, but the question / answer is one circuit. The advantage is that it can be compressed.

(First modification of the fourth embodiment of the bidirectional interpreter and method)

Meanwhile, referring to steps S810 to S820 of FIG. 8, a modified example of directly inputting by hand instead of using a keyboard or a keypad to insert a question in the form of a blank is inserted into the blank to complete the question. Lose.

That is, it is also possible to input an object to be inserted into the blank of the question of the blank form of FIG. 39 by handwriting it in the handwriting input window of the keypad using, for example, an electronic pen.

First, when the user selects a handwriting input window (S810), as shown in FIG. 42, the handwriting input window is activated, and the user writes an object (herein, 'price' in this example) that is to be manually inserted into the handwriting input window. It becomes possible (S813).

Thereafter, the input handwriting is textified by the text converter (105 in FIG. 4) for processing the signal data (S815). However, as in the second modification of the first embodiment, in the case of handwriting, the recognition rate Because of this, it is desirable to be written in sperm, and even handwritten characters vary depending on the person, as shown in Figure 43, in addition to the 'price' in the process of text, 'gap', 'shag' or 'cheat' It may be recognized as a text such as, etc., all of them are enumerated as an attempt to increase the recognition rate (S817), and the user may make a confirmation selection (S819).

(2nd modified example of 4th Example of a bidirectional interpreter and method)

Meanwhile, as described with reference to steps S831 to S833 of FIG. 8, in the present modified example, the user may directly input a word, a number, or the like into a blank in a blank question.

Also, similarly to the first modification, in the case of speech recognition, because of the recognition rate, the correct pronunciation is desired, even if the voice or intonation and dialect vary depending on the person, so to increase the recognition rate in the process of textification I need to try.

That is, when the user selects the voice input window (S831), for example, inputs a voice of 'Iman' (S833), the process proceeds to step S815 and the text is converted into text in the voice information text converting unit (135 in FIG. 4). In step S815, all words or numbers having a possibility of being misrecognized in the process of texting may be enumerated (S817), and the user may make a confirmation selection among them (S819).

(Fifth Embodiment of Bidirectional Interpreter and Method)

Subsequently, with reference to Figs. 9 and 44 to 45, a fifth embodiment of the bidirectional interpreter according to the present invention will be described, which is an interpreter in a language zone in which it is not possible to input by itself, such as Arabic or a rare language. This can be useful when using.

9 is a flowchart relating to a subroutine for explaining a question with visual information in the bidirectional interpretation method according to the present invention, and FIG. 44 is an interpretation function applied to the fifth embodiment of the bidirectional interpretation device according to the present invention. It is a figure which shows the example of the state into which the image image of the sign is input as visual data in FIG. 9, FIG. 45 is an interpreter function window applied to the 5th Example of the bidirectional interpreter which concerns on this invention, FIG. It is a figure which shows the example of the state in which the final question is interpreted after the image image of the signage is input as the visual data in and the other components of the question are added to complete the final question.

That is, when a user wants to inquire about a place to be introduced or advertised in a signboard, an advertising catalog or a travel guide, that is, to ask a question using visual information of an image file photographed by a camera or scanned by a scanner.

First, as shown in FIG. 44, the visual data input window is activated (S901), and the visual data is input (S903). In this example, the photograph of the street display panel 'broadway' is taken as an example, but the present invention is not limited thereto, and any type of visual data may be used. In addition, although English is an example, most of the English will be able to input using the English keypad keypad, but in the case of Arabic or Japanese hiragana, it may be difficult to input by keyboard, in this case This is a necessary feature.

Thereafter, similarly to the first modification of the fourth embodiment, the input visual data is textified by the visual information text converter (125 in FIG. 4) for signal processing (S905), except that the recognition rate is increased. In the process of textification, all cases are enumerated as much as possible (S907), and the user may make a confirmation selection (S909).

The following procedure prints out a list of common questions (S911), and selects one of the desired questions (for example, 'Where should I go?'), And the final question (for example, 'What do I do') to get Broadway 42st? ') is interpreted and output as shown in FIG. 45 (S913).

In the modified example of the fifth embodiment and the fourth embodiment of the bidirectional interpretation apparatus related to the present invention, in particular, even in languages of countries where a keyboard is not available, the question / answer can be answered using only visual / audio information. More is added. In particular, simple questions can be made with only voice information, which is more convenient for the night or visually impaired.

(Sixth Embodiment of Bidirectional Interpreter and Method)

Finally, with reference to Figs. 11 and 46 to 48, a sixth embodiment of a bidirectional interpreter related to the present invention will be described, which registers a commonly used question or answer as a bookmark and the contents of the question. Question method (S200) using a bookmark menu that allows you to promptly prompt questions without the need for a classification or keyword search process.

11 is a flowchart related to a subroutine for explaining a question or answer method according to a favorite menu among two-way interpretation methods related to the present invention, and FIG. 46 is applied to a sixth embodiment of the bi-directional interpretation device according to the present invention. 11 is a view for explaining an example for adding a question to a favorite menu in FIG. 11, and FIG. 47 is an interpretation function window applied to a sixth embodiment of a bidirectional interpretation device according to the present invention. 11 is a diagram illustrating an example of a pop-up window for adding a question to a favorite menu in FIG. 11, and FIG. 48 is an interpretation function window applied to a sixth embodiment of a bidirectional interpreter according to the present invention. It is a figure which shows an example for interpreting a question using a menu.

For example, as shown in FIG. 46, when the user wants to save the selected question (for example, 'apple') as an frequently used object, the user may touch the bookmark input window 116 with a touch pen as shown in FIG. 47. After being stored in the favorite DB 154 through the pop-up window that is displayed together, it can be utilized at any time through the bookmark window 119 menu.

Or, if the user wants to save the selected word 'How much?' As a frequently used word and requests it, the bookmark DB 154 is displayed through a pop-up window displayed by touching the bookmark input window 116 with a touch pen. After saving in the), it can be utilized from time to time through the favorites window (119) menu.

Thereafter, as shown in FIG. 48, the user selects a favorite (bookmark) display (S201), outputs a list of favorite selected questions or answers (S203), and selects one of them (S205). If the question / answer is to be interpreted and output (S207), and if you want to delete the corresponding question or answer after the bookmark, for example, if you click the delete favorite button on the left side of Figure 48 to request the deletion (S209) The question / answer requested to be deleted is deleted from the favorite menu (S211).

Therefore, according to the bidirectional interpreter and method related to the present invention, even if not fluent in a foreign language, it is possible to quickly and accurately deliver a variety of expressions desired by a user to foreigners by utilizing various question-and-answer functions according to the present invention.

Although the present invention has been described above according to an embodiment of the present invention, a person skilled in the art to which the present invention belongs has changed and modified within the scope without departing from the technical spirit of the present invention. Of course.

100: bidirectional interpretation device and language learning device 110: input unit
105: handwritten data text conversion unit 120: camera
125: time information text converter 130: microphone
135: voice information text converter 140: language converter
150: storage unit 155: language learning list DB
151: word DB 152: foreign language DB
153: Example DB 154: Favorites DB
170: audio output unit 180: screen output unit
190:
210: recorder 220: language driving unit
230: language unit

Claims (6)

As a language learning device linked with an interpreter,
An input unit 110 for inputting text selection objects or objects of handwritten data and various selection signals to be interpreted by the user;
A language converter 140 for converting data of a user language into data of a counterpart language or vice versa;
A storage unit 150 for storing the operation information and the multilingual interpreter related program for operating the bidirectional interpreter;
A voice output unit 170 for interpreting the object input through the input unit 110 with reference to the data of the storage unit 150 and then outputting the interpreted question / answer through voice;
A screen output unit 180 for displaying an input window for inputting an object desired by the user, or an interpreter function window for interpreting an object desired by the user and a finally translated question / answer;
A language driving unit 220 for outputting language learning items stored in the language list unit 155 of the storage unit 150;
A language unit loading unit 230 for loading contents of a favorite unit such as a bookmark related to an interpreter into the language list unit 155; And
It controls the functions of the input unit 110, language conversion unit 140, storage unit 150, voice output unit 170, the screen output unit 180, language unit driver 220 and language unit load unit 230 And a controller 190 for converting the object input from the user as it is or converting the language accurately to the other party's language, and storing the latest interpretation contents and controlling the language to be output by the driver. A language learning device associated with an interpreter. The method of claim 1,
A microphone 130 for receiving voice information; And
The recording unit 210 further includes a function of temporarily storing a voice of a user input through the microphone 130 as it is or converting it into a digital value.
The language driving unit 220 outputs a pre-stored voice signal (S24), and after recording the user's follow-up voice (S25), and compares and outputs the pre-stored voice signal and the user's recorded voice signal again Language learning apparatus associated with the interpreter, characterized in that (S26). In the language learning method associated with the interpretation device using the language learning device associated with the interpreter,
(a) selecting the learning list to add the recent conversation contents of the interpreter to the language, and selecting 'search recent conversation contents' (S71, S83), outputting the recent conversation contents list in chronological order (S84);
(b) selecting conversation contents of a desired time zone (S85), so that a series of conversation contents of a corresponding time zone are loaded into the language;
(c) the dialogue contents loaded into the language in step (b), wherein the learning is performed according to any one or more of the following modes: "basic learning" mode, "listening learning" mode, "sentence learning" mode, and "speaking learning" mode. Language learning method associated with the interpreter, characterized in that for executing. The method of claim 3, wherein
The learning mode of step (c) necessarily includes at least a "speaking learning" mode, the "speaking learning" process,
(c1) determining whether the 'learning to speak' mode is selected in the active window (S21);
(c2) if the 'learning to speak' mode is selected, displaying a 'speaking to learn' window (S22);
(c3) checking the click of the play button (S23), and if the play button is clicked, outputting a pre-stored voice signal in a desired language and repeating the selected number of repetitions (S24);
(c4) instructing the user to follow the foreign language pronunciation, and then recording the voice of the user (S25); And
(c5) outputting the pre-stored voice signal and subsequently comparing and outputting the user's recorded voice signal (S26); Language learning method associated with the interpreter, characterized in that consisting of. The method of claim 3, wherein
The step (a) further includes a method of adding a learning list through 'favorite content search', and when selecting a favorite content search of the interpreter (S93), the items listed in the favorite of the interpreter are output in order. (S94), if the desired favorite content is selected (S95), the language learning method associated with the interpreter, characterized in that the favorite content is loaded into the language. The method of claim 3, wherein
Interpretation method of the interpreter,
(A) selecting a user language (S501);
(B) selecting a counterpart language (S503);
(C) outputting a classification list and a question list in the selected user language or directly outputting a question list (S505 to S515 and S601);
(D) selecting a specific object from the question list and immediately asking a question or processing the selected object and transforming the question and then asking a question;
(F) interpreting and outputting the user's question in the language of the counterpart (S607, S609); And
(G) if it is determined that the answer is a necessary question (S517), outputting a list of answers (S101), and if not, terminating;
Language learning method associated with the interpreter characterized in that it comprises a.

Images