JP2010085790A - Conversation learning support system, conversation learning support method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a conversation learning support system, a conversation learning support method, and a program, to enable interactive conversation learning (support) by one person (unattended). <P>SOLUTION: This conversation learning support device 1 includes a voice storage part 2, a voice output part 3, a voice input part 4, a display part 5, an input part 6, a control part 7, a speaker 8, a microphone 9, a display device 10, and an input device 11. The operations of the conversation learning support device 1 are controlled as instructed by the control part 7. The voice storage part 2 memorizes and stores a plurality of data tailored to learning contents. The data include listening contents, speaking setting, question contents and their choices. The data which should be learned next is determined by the option selected by a user, and learning is proceeded. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a conversation learning support system, a conversation learning support method, and a program.

  There are technologies that support learning foreign languages using computers. For example, Patent Document 1 describes a foreign language learning method in which pronunciation and listening practice of a foreign language can be practiced at your own pace and without choosing a place. The technology of Patent Document 1 is such that a foreign language supplier side terminal storing foreign language word data and foreign language sentence data and a learner side terminal capable of outputting speech are connected via the Internet, A foreign language learning homepage is established on the Internet via the supplier's terminal, and when the learner's terminal accesses the homepage, the learner's terminal sends the foreign language word sent from the supplier's terminal. Output audio based on data or foreign language text data.

  Patent Document 2 describes a remote education system that uses a terminal device connected to a server via a communication circuit. In the technique of Patent Document 2, the terminal device reproduces the assignment data transmitted from the server, transmits the repetition data that the user has read back to the server based on the assignment data, and evaluates the repetition data transmitted from the server. Configured to obtain results. The server is configured to transmit task data to the terminal device, receive repetitive data for the task data from the terminal device, evaluate the repetitive data, and transmit the evaluation result to the terminal device.

  Patent Document 3 describes a technique for supporting a learner who learns pronunciation of a foreign language. According to the technique of Patent Literature 3, in the pronunciation evaluation service, when each student transmits his / her voice information from the student terminal to the DSP server apparatus, the proficiency level specified based on the voice information is stored in the DSP server apparatus. In the practice partner introduction service, the DSP server device matches student terminals having the same proficiency level and controls the exchange of voice information between the two terminals.

  Patent Document 4 describes a technology that makes it possible to provide learning content according to a user's learning level and avoid uniformization of the provided content. When a transmission request is made without specifying a learning content to be returned to a learning support device that stores a plurality of learning contents for language learning and returns any learning content in response to a request from a learner Returns one learning content narrowed down according to the difficulty of the learning content most recently learned by the learner and the frequency of use by other learners.

  Patent Document 5 describes a language educational device that objectively and automatically sets a learner's proficiency level. The technique of Patent Document 5 stores voice data for comparison determination criteria and non-voice data that is an instruction to the learner, displays the non-voice data, and gives an instruction to the learner. The learner's voice input by the voice input device is stored as data, and compared with voice data for comparison criteria. Then, the difficulty level and / or tempo level suitable for the learner's proficiency level is automatically set.

JP 2003-98944 A JP 2004-191528 A JP 2006-195094 A JP 2007-193093 A Japanese Patent Laid-Open No. 07-168520

  In an unattended conversation learning support system with voice, only teaching materials that provide repeating and shadowing mainly for listening are provided. In an interactive conversation learning support system, an instructor responds directly or via a communication network.

  In an unattended conversation learning support system that performs listening, repeating or shadowing, or recording a response voice alone, interactive conversation learning cannot be performed. For interactive conversation learning support, the instructor is restricted in time, and only a small number of people can learn about one instructor at the same time. For this reason, interactive conversation learning is generally expensive, and the learning time is limited.

  The present invention has been made in view of the above-described circumstances, and an object thereof is to provide a conversation learning support system, a conversation learning support method, and a program that enable one person (unmanned) and interactive conversation learning (support). To do.

A conversation learning support system according to a first aspect of the present invention includes:
Voice storage means for storing voice data constituting at least one sentence;
Audio output means for reproducing and outputting predetermined audio from the audio data stored in the audio storage means;
A voice input means for inputting a voice of a speaker after outputting the voice by the voice output means;
Display means for displaying a sentence asking the content of the voice of the speaker after inputting the voice by the voice input means;
Input means for accepting an input to answer the question displayed by the display means;
Response voice storage means for classifying possible answers to a sentence asking the content of the speech of the speaker, and storing voice data that responds to each of the classified answers,
In response to the answer input by the input means, response output means for selecting and reproducing the voice data stored in the response voice storage means;
It is characterized by providing.

The conversation learning support method according to the second aspect of the present invention includes:
A voice output step of reproducing and outputting a predetermined voice from voice data stored in voice storage means for storing voice data constituting at least one sentence;
A voice input step of inputting a voice of a speaker after outputting the voice in the voice output step;
A display step for displaying a sentence asking the content of the voice of the speaker after inputting the voice in the voice input step;
An input step for accepting an input to answer the question displayed in the display step;
From the voice data stored in the response voice storage means for classifying possible answers to the sentence asking the content of the voice of the speaker and storing voice data responding to each of the classified answers , A response output step of selecting and reproducing audio data corresponding to the answer input in the input step;
It is characterized by providing.

A program according to a third aspect of the present invention is stored in a computer.
An audio output step of reproducing and outputting a predetermined audio from audio data stored in audio storage means for storing audio data constituting at least one sentence;
A voice input step of inputting a voice of a speaker after outputting the voice in the voice output step;
A display step for displaying a sentence asking the content of the voice of the speaker after inputting the voice in the voice input step;
An input step for accepting an input to answer the question displayed in the display step;
From the voice data stored in the response voice storage means for classifying possible answers to the sentence asking the content of the voice of the speaker and storing voice data responding to each of the classified answers A response output step of selecting and outputting voice data corresponding to the answer input in the input step;
Is executed.

  According to the present invention, one person (unmanned) and interactive conversation learning (support) can be performed.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In the drawings, the same or corresponding parts are denoted by the same reference numerals.

(Embodiment 1)
FIG. 1 is a block diagram showing a configuration example of a conversation learning support apparatus according to Embodiment 1 of the present invention. The conversation learning support apparatus 1 includes an audio storage unit 2, an audio output unit 3, an audio input unit 4, a display unit 5, an input unit 6, a control unit 7, a speaker 8, a microphone 9, a display device 10, and an input device such as a keyboard. 11. The voice output unit 3, the voice input unit 4, the display unit 5, and the input unit 6 are controlled based on the data in the voice storage unit 2 in accordance with an instruction from the control unit 7. In addition, the speaker 8, the microphone 9, the display device 10, and the input device 11 corresponding to each are controlled.

  The voice storage unit 2 stores and saves data including listening contents composed of data reproduced by voice.

  In response to an instruction from the control unit 7, the audio output unit 3 performs digital / analog conversion on the data stored in the audio storage unit 2 and outputs the listening content from the speaker 8. The voice input unit 4 performs analog / digital conversion according to an instruction from the control unit 7 and inputs a voice signal from the microphone 9. The control unit 7 also controls the start and stop of input to the voice input unit 4.

  The display unit 5 displays the data stored in the voice storage unit 2 on the display device 10 with characters, pictures, and the like according to an instruction from the control unit 7. The input unit 6 transmits data input from the input device 11 such as a keyboard or a mouse to the control unit 7 according to an instruction from the control unit 7.

  A learner who learns using the conversation learning support apparatus 1 is referred to as a user. FIG. 2 is a block diagram showing a menu for selecting the learning content of the user. FIG. 2 shows an example in which the learning content is selected from a menu hierarchically organized into language (file f1), field (file f2), item (file f3), and content (file f4). The user selects a favorite language from the file f1. A field is selected from the file f2 at the lower level, an item is selected from the file f3 at the lower level, and the contents to be learned from the file f4 are selected. In the first embodiment, an example is given in which a user selects a file in order of English, general, travel, and shopping in order from the file f1 for the purpose of learning travel English conversation. As for the user level, for example, the beginner / intermediate / advanced level can be selected before and after selecting the contents of the file f3.

  The file f4 in the lowest hierarchy and classified into a plurality of learning contents and levels is a plurality of data d1, d2, d3,..., Dn (hereinafter collectively referred to as data d). ). FIG. 3 is a block diagram showing one of a plurality of data d stored / stored in the voice storage unit 2.

  Data d is composed of listening content p1, speech setting p2, question content p3, and option p4. An example of the listening content p1 which is audio data is shown in FIG. 4 to 7, the contents are described in Japanese. Actually, it is assumed that the language used for learning the conversation, for example, English, is used. It is preferable that the data d sets the listening content p1, the question content p3, and the option p4 so that the user speaks after the listening content p1 and the story develops in a format close to the conversation.

  The listening content p1 is composed of a plurality of sentences and is in a form such as a narrative form or a conversation form, and the sentences are composed based on audio data. The listening content p <b> 1 is reproduced as audio from the speaker 8 via the audio output unit 3 according to an instruction from the control unit 7. The voice data is stored in the form of the sentence shown in the example of FIG. 5A or the word shown in the example of FIG. 5B, and the number of the data d in the file f classified by the same learning content. Even if they are different, the original audio data may be common. The listening content p1 may be a pointer indicating the storage location of the audio data, not the audio data. In addition, it is desirable that the listening content p <b> 1 includes the sound of the content prompting the user to speak at the last part.

  The utterance setting p2 defines a time for inputting a user's utterance (an example is shown in FIG. 6) after outputting the listening content p1. Specifically, according to the content that the user who listened to the listening content p1 will utter, the time required for inputting the utterance is set in the utterance setting p2. The prompt for prompting the utterance regarding the listening content p1 may be included in the utterance setting p2. The prompt is output after the audio content of the listening content p1 is reproduced.

  Various settings may be added to the utterance setting p2 in addition to the utterance input time. After outputting the prompt, the display device 10 may be set to display an operation for making the speech input time longer than the setting or an operation method for repeatedly listening to the listening content p1.

  The question content p3 is related to the listening content p1, and is a sentence for asking the content of the user's utterance. The question content p3 and the option p4 correspond to each other, and the option p4 is an item assuming content that the user will utter. FIG. 7 shows an example of the question content p3 and the option p4. Corresponding to each item of the choice p4, the number of data d including the listening content p1 to be output next is set. When the user selects any item of the option p4, data d to be learned next corresponding to the item is determined.

  The control unit 7 refers to the data d in the voice storage unit 2 and controls the voice output unit 3, the voice input unit 4, the display unit 5 and the input unit 6 according to the data d.

  At the beginning of the learning support process, the file f in FIG. 2 is output from the display unit 5, and a selection input by the user is received by the input unit 6. For example, as shown in FIG. 2, the learning content selection menu has a hierarchical structure and displays language, field, item, and content in the selected order. When the menu of each hierarchy is selected and the content is determined, the control unit 7 selects the first data d predetermined for the content.

  When the first data d is determined, the control unit 7 reads the data d from the storage unit 2 and outputs the listening content p1 (or the audio data specified by the listening content p1) to the audio output unit 3. Command. The listening content p1 desirably includes content that prompts the user to speak. Alternatively, content that prompts the user to speak is added after the listening content p1. At this time, following the output of the listening content p1 of the data d, a prompt for prompting the user to speak may be output. The prompt display may be a voice display on the speaker 8 or a character display on the display device 10.

  When the output of the listening content p1 and the prompt is completed, the control unit 7 next instructs the voice input unit 4 to input the user's utterance. The control unit 7 refers to the utterance setting p <b> 2 and instructs the voice input unit 4 regarding the input time. After inputting the utterance, the control unit 7 instructs the voice output unit 3 or the display unit 5 to output the question content p3 and the option p4. Then, the control unit 7 instructs the input unit 6 to accept the option p4 input by the input device 11. Upon receiving the input option p4, the control unit 7 instructs the voice storage unit 2 on the next data d.

  A plurality of data d is stored in the file f4. For example, it is assumed that the data d is the data d selected by the option pi of the data di. In the data d, the next data number is determined from the options 1, 2, 3,..., N selected by the option p4. In the example of FIG. 3, when option 1 is selected, data dk, option 2 is data dl, option 3 is data dm, and option n is data dn. Depending on the item of the selected option p4, the next conversation content is expanded to different data d in the same file f4. The user may select to end learning of the file f4, or may end when learning a predetermined amount of data d in the file f4.

  Although FIG. 7 shows an example in which both the question content p3 and the option p4 are displayed on the display device 10 from the display unit 5, they may be output from the speaker 8 by voice. In addition, any one of the question content p3 and the option p4 may be displayed on the speaker 8.

  FIG. 8 is a flowchart showing an example of the operation of the conversation learning support apparatus according to the first embodiment. The user activates the conversation learning support device 1 and starts learning. First, the control unit 7 instructs the display unit 5 to display the level and content of the content to be learned on the display device 10 (step S11). For example, a hierarchical menu is displayed with the files f1 to f4 shown in FIG. The user inputs data with the input device 11 while viewing the display device 10 and selects the data d. For example, the menu items displayed in the files f1 to f4 shown in FIG. 2 are selected, and finally the data d is selected. Alternatively, personal information may be registered in advance and the data d may be called by logging in. Alternatively, a mechanism for selecting the data d from the file f by other methods is provided.

  The control unit 7 refers to the data d stored / saved in the voice storage unit 2 (step S12). The audio output unit 3 receives the instruction from the control unit 7 and reproduces the listening content p1 from the speaker 8 (step S13). The listening content p1 is a portion composed of audio data of the data d referred to in step S12. It is desirable for the last part of the listening content p1 to include content that allows the user to continue speaking about the continuation of the content and things related to the content. After the listening content p1 ends, the control unit 7 displays a prompt to utter (step S14). The prompt for utterance is reproduced by voice from the speaker 8 or displayed on the display device 10. At this time, in response to an instruction from the control unit 7, the speech input time is determined with reference to the utterance setting p2. At the start and end of voice input, a mechanism may be provided that issues an instruction from the control unit 7 to the voice output unit 3 to sound a buzzer sound. The start and end of the voice input is equal to the start and end time of the user's utterance, and the user can know the time to speak by the buzzer sounding. The control unit 7 may instruct the display unit 5 to display the start and end of voice input on the display device 10.

  The control unit 7 inputs the audio signal of the microphone 9 from the audio input unit 4 according to the utterance setting p2 (step S15). This voice signal includes voice uttered by the user toward the microphone 9.

  Next, the control unit 7 refers to the question content p3 and the option p4 in the data d, and presents a selection question in a format for selecting the option p4 for the content uttered by the user (step S16). The instruction of the control unit 7 is given to the voice output unit 3 when outputting by voice, and to the display unit 5 when displaying on the screen. The user inputs the choice p4 using the input device 11 in consideration of the question content p3, the choice p4, and the uttered content.

  The control unit 7 receives the result input by the input device 11, that is, the option p4, via the input unit 6 (step S17). The control unit 7 determines the data d number to be referred to next from the number of the accepted option p4 (step S18).

  In step S18, a series of flows of the conversation learning support 1 is completed. The control unit 7 instructs the display unit 5 to display on the display device 10 the content for inquiring about continuation of learning (step S19). If learning is continued (step S19; YES), the control unit 7 refers to the data d determined in step S18, returns to step S12, and repeats the conversation learning support 1. If the learning is not continued (step S19; NO), the process ends.

  As described above, according to the conversation learning support apparatus 1 according to the first embodiment, the content selected by the user is selected as the content related to the learned content and suitable for the level. Proceed to learning. As a result, learning tailored to each of the learning users is developed. By using this conversation learning support apparatus 1, interactive conversation learning can be performed alone. Furthermore, since learning is performed by an individual, it is possible not only to learn at a favorite place at any time but also at a lower cost than interactive conversation learning.

(Embodiment 2)
FIG. 9 is a block diagram showing a configuration example of the conversation learning support apparatus according to Embodiment 2 of the present invention. The conversation learning support device 100 according to the second embodiment has the same basic structure as the conversation learning support device 1 according to the first embodiment, but includes a recognition unit 7a and a determination unit 7b in the control unit 7. A recording data storage unit 12 and a communication unit 13 are added. Further, it is possible to communicate with the server 51 via the network 50 and exchange data.

  The recorded data storage unit 12 stores the content uttered by the user. More specifically, the voice input to the voice input unit 4 by the user via the microphone 9 according to an instruction from the control unit 7 is converted from analog to digital and then stored in the form of recorded data. The communication unit 13 mainly communicates the data d stored in the voice storage unit 2 and the recording data stored in the recording data storage unit 12 via the network 50 and exchanges various data with the server 51. Communicate.

  The recognition unit 7 a provided in the control unit 7 recognizes the uttered voice input by the user to the voice input unit 4 via the microphone 9. For example, when a certain predetermined loudness / sound pressure is exceeded, it is recognized that an utterance has been made. At that time, the length of time from the voice input start time until the sound (speech) is recognized is measured, or the time during the utterance is measured. Short time to start speaking often means understanding the content or getting used to speaking. Also, the speaking time is proportional to the length of the sentence, and the length of the sentence often increases as the level increases.

  The determination unit 7b determines the degree of understanding of the user from data based on the sound pressure recognized by the recognition unit 7a, the measured utterance time, and the like. Alternatively, the sound waveform may be measured by the recognition unit 7a, and the word of the voice data in the voice storage unit 2 may be compared with the measured sound waveform by the determination unit 7b. If there are similar sound waveforms, it can be seen that the content of data d and words related to data d are duplicated in the user's utterance. By combining these plurality of determination criteria, the accuracy of determination becomes higher.

  FIG. 10 is a block diagram illustrating the relationship between the conversation learning support apparatus and the correction system according to the second embodiment. The conversation learning support apparatus 100 includes a communication unit 13 and can exchange various data with the server 51 via the network 50. Here, the server 51 is assumed to be the system unit 60, and a mechanism by which correction by a third party (corrector 70) can be received will also be described.

  A system unit 60 is provided in advance of communication via the network 50. The system unit 60 includes an correction data management unit 61 and a personal information management unit 62. The correction data management unit 61 manages data scored / corrected by the corrector 70, recorded data before scoring / correcting, and the like. The personal information management unit 62 manages the registered user information, for example, the learning course content and level, the learned data d, and the results thereof, in addition to the user name and ID as basic information. .

  The recorded data storage unit 12 of the conversation learning support apparatus 100 stores the content uttered by the user as recorded data. The communication unit 13 receives an instruction from the control unit 7 and transmits recording data via the network 50. The system unit 60 receives the recording data and stores it in the correction data management unit 61. The third person, the correction person 70, scores and corrects the recorded data in the correction data management part 61 and stores it in the correction data management part 61 as corrected data.

  When reviewing, the user must first receive corrected data. According to the command selected by the user, the control unit 7 instructs the communication unit 13 to receive the corrected data. The communication unit 13 receives the corrected data from the correction data management unit 61 of the system 60 via the network 50. The control unit 7 instructs the recording data storage unit 12 to store the received corrected data.

  Regarding the scoring / correcting system on the network 50 side, the correcting person 70 on the system unit 60 side performs scoring / correcting work. For example, scoring and correction are performed in the order in which received recording data is received, such as inbound work at a call center. The corrector 70 receives the data d number and the recorded data, that is, the contents spoken by the user, and only needs to score and correct the contents, and the time required is small. Therefore, a large number of users can be handled by a small number of correctors 70.

  The corrected data may be, for example, data in which a user's utterance is uttered in a sentence and then corrected with a red pen, or a sentence corrected according to the user's utterance may be converted into voice data. There may also be examples of answers.

  The data transmission may be performed for each data d to be learned or may be collected. The reception of the corrected data may be performed for each data d or may be summarized. Transmission / reception timing is arbitrary. Alternatively, the corrected data may be stored in the correction data management unit 61 without being stored in the recording data storage unit 12 and data communication may be performed when necessary.

  When performing a scoring / correcting system, the user can confirm the utterance without using conversational learning as in the conventional interactive type. It is possible to score utterances in various forms such as utterances based on free ideas in a form close to conversation, such as opinions and hopes, questions and expressions. In addition, since the system unit 60 side of the network 50 can score a large number of users by one person, it is not always necessary to deal with the conventional conversation learning. Users can also learn freely without worrying about the time and place that were restricted in interactive conversation learning.

  Even when communication via the network 50 is not possible, recording data stored in the recording data storage unit 12 of the conversation learning support device 100 is recorded on a recording medium such as a flexible disk and directly sent to the corrector 70. It is possible to use a scoring and correction system. In this case, the corrected data is also sent using the recording medium.

  FIG. 11 is a flowchart illustrating an example of the operation of the conversation learning support apparatus according to the second embodiment. FIG. 11A shows the conversation learning support 2 and FIG. 11B shows the review support. The review support may operate by being incorporated into the conversation learning support 2 or may operate independently.

  The user activates the conversation learning support apparatus 100 and starts learning. First, the control unit 7 instructs the display unit 5 to display the level and content of the content to be learned on the display device 10 (step S31). The user inputs data with the input device 11 while viewing the display device 10 and selects the data d. For example, in response to a user input, the control unit 7 communicates with the network 50 via the communication unit 13 and calls the user personal information stored in the personal information management unit 62. Then, data d that is a continuation of the previous learning may be referred to. Alternatively, a mechanism for selecting the data d from the file f by other methods is provided.

  The control unit 7 refers to the data d stored / saved in the voice storage unit 2 (step S32). The audio output unit 3 receives the instruction from the control unit 7 and reproduces the listening content p1 from the speaker 8 (step S33). The listening content p1 is a portion composed of audio data of the data d referred to in step S12. It is desirable for the last part of the listening content p1 to include content that allows the user to continue speaking about the continuation of the content and things related to the content. After the listening content p1 is completed, the control unit 7 displays a prompt for urging to speak (step S34). The prompt for utterance is reproduced by voice from the speaker 8 or displayed on the display device 10. At this time, in response to an instruction from the control unit 7, the speech input time is determined with reference to the utterance setting p2. At the start and end of voice input, a mechanism may be provided that issues an instruction from the control unit 7 to the voice output unit 3 to sound a buzzer sound. The start and end of the voice input is equal to the start and end time of the user's utterance, and the user can know the time to speak by the buzzer sounding. The control unit 7 may instruct the display unit 5 to display the start and end of voice input on the display device 10.

  The control unit 7 inputs the audio signal of the microphone 9 from the audio input unit 4 in accordance with the utterance setting p2. The control unit 7 instructs the recording data storage unit 12 to store the input utterance, and the recognition unit 7a measures the time taken for the utterance and the time spent speaking (step S35).

  Next, the control unit 7 refers to the question content p3 and the option p4 in the data d, and presents a selection question in a format for selecting the option p4 for the content uttered by the user (step S36). The instruction of the control unit 7 is given to the voice output unit 3 when outputting by voice, and to the display unit 5 when displaying on the screen. The user inputs the choice p4 using the input device 11 in consideration of the question content p3, the choice p4, and the uttered content.

  The control unit 7 receives the result input by the input device 11, that is, the option p4 via the input unit 6 (step S37). Next, the control unit 7 performs determination by the determination unit 7b based on the result recognized by the recognition unit 7a (step S38). Here, the term “determination” refers to simple determination of the user's level of understanding. The data used as a criterion for determination is data such as the measurement result of the utterance time measured in step S35, the volume of the voice, and the speed of the voice. In addition, the speech waveform of an utterance is collated with speech data, and how many important words are duplicated may be a criterion. Based on one or a plurality of data, the determination unit 7b determines the degree of understanding of the user.

  The result of determination in step S38 may be displayed on the display device 10 according to an instruction from the control unit 7. The user can check the determination result and use it for checking his / her own understanding level. At this time, an outline of the listening content p <b> 1 may be displayed together by an instruction from the control unit 7 to the display unit 5.

  The control unit 7 determines the data d number to be referred to next from the number of the option p4 received in step S37 (step S39).

  In step S39, a series of flows of the conversation learning support 2 is completed. The control unit 7 instructs the display unit 5 to display on the display device 10 the content for inquiring about continuation of learning (step S40). If the learning is continued (step S40; YES), the control unit 7 refers to the data d determined in step S39, returns to step S32, and repeats the conversation learning support 2. If the learning is not continued (step S40; NO), the process ends.

  Based on the result determined by the determination unit 7b of the control unit 7, it may be determined whether or not the user level and the learning level match, and may be reflected in the selection of the data d. The result of determination in step S38 is programmed so as to be digitized as the degree of understanding of the user, and a threshold value is given. When the level of understanding of the user exceeds the threshold, the level of the data d is low, or the control unit 7 presents the level / content (step S31) without determining the data d (step S39) as a learned field. The display unit 5 is instructed to perform If the user's level of understanding is lower than the threshold, the level of the data d is high and the control unit 7 similarly presents the level / contents without instructing the determination of the data d (step S39) (step S31). The instructions are given. By incorporating this operation into the conversation learning support 2, it becomes easier to support learning suitable for the user's level.

  Although the result of the determination (step S38) is not described in the flowchart, communication by the network 50 may be performed via the communication unit 13 according to an instruction from the control unit 7. The system unit 60 stores information in the personal information management unit 62 as personal information data. For example, when the amount of personal data (such as data indicating the degree of understanding of the user) sent from the communication unit 13 reaches a certain amount, the control unit 7 issues an instruction to analyze personal information. In response to an instruction from the control unit 7, the learning progress is displayed on the display device 10. The user can know the level of improvement and the areas of strength and weakness, and can compare with other users, which is useful for improving learning motivation and creating a more efficient learning plan.

  As described above, according to the conversation learning support device 100 according to the second embodiment, the content selected by the user is selected as the content related to the learned content and suitable for the level. Proceed to learning. As a result, learning tailored to each of the learning users is developed. By using this conversation learning support apparatus 100, interactive conversation learning can be performed alone. Furthermore, since learning is performed by an individual, it is possible not only to learn at a favorite place at any time but also at a lower cost than interactive conversation learning.

  Before entering the review support operation, the user learns with the conversation learning support 2 and stores the utterance as recorded data in the conversation learning support apparatus 100. Hereinafter, the conversation learning support apparatus 100 when reviewing will be described. FIG. 11B is a flowchart illustrating an example of the review support operation.

  First, the control unit 7 refers to the recorded data stored in the recorded data storage unit 12 (step S51). When there are a plurality of recording data, for example, the recording data with the oldest data creation date may be referred to among the recording data that have not been reviewed. Further, the control unit 7 may instruct the display unit 5 to display a list of recorded data on the display device 10 and accept a selection instruction by a user input.

  The communication unit 13 transmits the recording data via the network 50 according to an instruction from the control unit 7 (step S52). The recorded data transmitted to the server 51 (here, the system unit 60) via the network 50 is scored / corrected by a third person, the correction person 70, and becomes corrected data. The communication unit 13 receives the corrected data again via the network 50 according to the instruction from the control unit 7 (step S53).

  Next, the control unit 7 instructs the audio output unit 3 to output the recording data referred to in step S51, that is, the user's utterance, and reproduces the sound from the speaker 8 (step S54). Subsequently, the display unit 5 is instructed to output the received corrected data. Upon receiving the instruction, the display unit 5 displays it on the display device 10 (step S55). The reproduction of the recorded data may be repeated several times, and the corrected data may be displayed during that time. Further, the listening content p1 of the data d may be displayed according to an instruction from the control unit 7.

  Although the corrected data is assumed to be recorded data (user's utterance) in a sentence and corrected, it may be audio-only data. In that case, the control unit 7 instructs the audio output unit 3 to reproduce the corrected data through the speaker 8 (step S55).

  In step S55, the review support flow is completed. The control unit 7 instructs the display unit 5 to display on the display device 10 contents for inquiring about continuation of review (step S56). If review is continued (step S56; YES), the control unit 7 returns to step S51 and repeats review support. If the review is not continued (step S56; NO), the process ends.

  The conversation learning support 2 and the review support may be reviewed as they are after the learning without being independent. In this case, steps S51 to S55 of the review support in FIG. 11B are incorporated between steps S39 and S40 of the conversation learning support 2 in FIG. Further, a review may be performed for each data d to be learned, or a plurality of data d may be learned and then the review may be performed collectively.

  Furthermore, in the second embodiment, the data d recorded by the conversation learning support 2 is communicated each time when review support is provided. The communication of the recording data may be performed when the user's utterance is stored by the conversation learning support 2, and the corrected data may be stored in the recording data storage unit 12.

  Various personal information managed by the personal information management unit 62 and data communication and storage of recorded data and corrected data are not limited to the above example. In particular, it is possible to review the correction result of the data d learned by the conversation learning support 2 in advance in the recorded data storage unit 12 of the conversation learning support apparatus 100, so that it can be reviewed immediately.

  The conversation learning support apparatus 100 can use a mobile phone. A speaker, a microphone, a screen, a keyboard (operation buttons) are already provided, and communication is also possible. It is an indispensable part of daily life, and many people always carry it. Speaking and listening is a natural action, and it can be easily learned anywhere. The conversation learning support device may be a small mobile personal computer. Even if there is no microphone for speaking, the response voice can be stored by using, for example, a headset type microphone. Furthermore, even in the case of a portable game machine without a communication function, it is only necessary that the uttered content that has been answered can be recorded in a storage medium such as an SD card (Secure Digital Memory Card). For example, data recorded on the go is communicated to a network system using a personal computer after returning home. The scored data is captured and stored in a game machine using a storage medium. In this case, the utterance cannot be confirmed immediately after being uttered, but the part of the utterance confirmation can be learned and reviewed even when away from home.

  Here, the server 51 is described as the system unit 60, but can be arbitrarily changed and modified. In addition, the timing for exchanging data using the network 50, a device for storing data, a server, and the like can be arbitrarily set. When it is difficult to perform data communication, data may be captured in advance by data communication and stored in the conversation learning support apparatus 100. In addition, when the amount of data is enormous, or when it is desired to constantly check the user's learning level and learning content, it is possible to learn while the network is connected.

  As described above, according to the conversation learning support apparatus 100 according to the second embodiment, it is possible to confirm the uttered content, and it is possible to perform conversation learning (support) in a form closer to practice, not according to the manual. In addition, it is possible to make a learning plan tailored to the user by accumulating personal information or the like, so that learning can be performed more efficiently. Furthermore, since it is interactive learning, one person can deal with a plurality of users, so that conversation learning (support) can be performed at a lower cost than before.

  FIG. 12 is a block diagram illustrating an example of a hardware configuration of the conversation learning support devices 1 and 100 illustrated in FIG. 1 or 9. As shown in FIG. 12, the conversation learning support apparatuses 1 and 100 include a control unit 21, a main storage unit 22, an external storage unit 23, an operation unit 24, a display unit 25, and a transmission / reception unit 26. The main storage unit 22, the external storage unit 23, the operation unit 24, the display unit 25, and the transmission / reception unit 26 are all connected to the control unit 21 via the internal bus 20.

  The control unit 21 includes a CPU (Central Processing Unit) and the like, and executes processing according to data d stored in the external storage unit 23.

  The main storage unit 22 is configured by a RAM (Random-Access Memory) or the like, loads data d stored in the external storage unit 23, and is used as a work area of the control unit 21.

  The external storage unit 23 includes a non-volatile memory such as a flash memory, a hard disk, a DVD-RAM (Digital Versatile Disc Random Access Memory), a DVD-RW (Digital Versatile Disc ReWritable), and the above processing is performed by the control unit 21. A program to be executed is stored in advance, and data stored in the program is supplied to the control unit 21 according to an instruction from the control unit 21, and the data supplied from the control unit 21 is stored.

  The operation unit 24 includes a pointing device such as a keyboard and mouse, and an interface device that connects the keyboard and pointing device to the internal bus 20. Data such as option p4 is input via the operation unit 24 and supplied to the control unit 21. Further, it receives an instruction input and supplies it to the control unit 21.

  The display unit 25 includes a CRT (Cathode Ray Tube) or an LCD (Liquid Crystal Display), and displays the question content p3 and the like.

  The transmission / reception unit 26 includes a wireless transmitter / receiver, a wireless modem or a network termination device, and a serial interface or a LAN (Local Area Network) interface connected thereto. Data d, personal information, and the like are exchanged via the transmission / reception unit 26.

  Other suitable modifications of the present invention include the following configurations.

About the conversation learning support system according to the first aspect of the present invention,
Preferably, a determination unit that determines the level of the utterance of the speaker by a predetermined method from the voice input by the voice input unit,
The response output means selects voice data corresponding to the answer input by the input means from the voice data stored in the response voice storage means according to the level of utterance determined by the determination means. Output,
It is characterized by that.

  Preferably, a recording means for recording the voice input by the voice input means is provided.

  Preferably, there is provided a recognition means for recognizing a voice from a voice recorded by the recording means with reference to an answer to the question displayed by the display means inputted by the input means.

A server device comprising at least the voice storage means and the response voice storage means;
A terminal comprising the voice output means, the voice input means, the display means, the input means and the response output means;
It communicates via a network.

Regarding the conversation learning support method according to the second aspect of the present invention,
Preferably, the method includes a determination step of determining a level of the utterance of the speaker by a predetermined method from the voice input in the voice input step,
In the response output step, voice data corresponding to the answer input in the input step is selected from the voice data stored in the response voice storage means according to the utterance level determined in the determination step. Output,
It is characterized by that.

  Preferably, a recording step of recording the voice input in the voice input step is provided.

  Preferably, the method further comprises a recognition step of recognizing the voice recorded in the recording step with reference to an answer to the question displayed in the display step input in the input step.

  In addition, the above-described hardware configuration and flowchart are examples, and can be arbitrarily changed and modified.

  The central part of conversation learning can be realized using a normal computer system, not a dedicated system. For example, a computer program for executing the above operation is stored and distributed in a computer-readable recording medium (flexible disk, CD-ROM, DVD-ROM, etc.), and the computer program is installed in the computer. Thus, a conversation learning support device that executes the above-described processing may be configured. Further, the computer program may be stored in a storage device included in a server device on a communication network such as the Internet, and the conversation learning support device may be configured by being downloaded by a normal computer system.

  Further, when the conversation learning support device is realized by sharing an OS (operating system) and an application program or by cooperation between the OS and the application program, only the application program portion is stored in a recording medium or a storage device. Also good.

  It is also possible to superimpose a computer program on a carrier wave and distribute it via a communication network. For example, the computer program may be posted on a bulletin board (BBS, Bulletin Board System) on a communication network, and the computer program distributed via the network. The computer program may be started and executed in the same manner as other application programs under the control of the OS, so that the above-described processing may be executed.

It is a block diagram which shows the structural example of the conversation learning assistance apparatus which concerns on Embodiment 1 of this invention. It is a block diagram which shows the selection menu of a user's learning content. It is a block diagram which shows one of the some data memorize | stored in the audio | voice memory | storage part. It is an example of data listening content, and is actually played back by voice. It is an example of the audio | voice data which comprise the listening content. It is an example of a user's utterance content. This is an example of question contents and options (contents), which are displayed on the screen. 4 is a flowchart illustrating an example of an operation of the conversation learning support device according to the first embodiment. It is a block diagram which shows the structural example of the conversation learning assistance apparatus which concerns on Embodiment 2 of this invention. It is a block diagram which shows the relationship between the conversation learning assistance apparatus which concerns on Embodiment 2, and a correction system. 6 is a flowchart illustrating an example of the operation of the conversation learning support apparatus according to the second embodiment. (A) shows the operation of conversation learning support, and (b) shows the operation of review support. It is a block diagram which shows an example of the hardware constitutions of the conversation learning assistance apparatus which concerns on embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Conversation learning support device 2 Voice storage part 3 Voice output part 4 Voice input part 5 Display part 6 Input part 7 Control part 8 Speaker 9 Microphone 12 Recording data storage part 13 Communication part 50 Network 100 Conversation learning support apparatus

Claims (10)

Voice storage means for storing voice data constituting at least one sentence;
Audio output means for reproducing and outputting predetermined audio from the audio data stored in the audio storage means;
A voice input means for inputting a voice of a speaker after outputting the voice by the voice output means;
Display means for displaying a sentence asking the content of the voice of the speaker after inputting the voice by the voice input means;
Input means for accepting an input to answer the question displayed by the display means;
Response voice storage means for classifying possible answers to a sentence asking the content of the speech of the speaker, and storing voice data that responds to each of the classified answers,
In response to the answer input by the input means, response output means for selecting and reproducing the voice data stored in the response voice storage means;
Conversation learning support system characterized by comprising. Determination means for determining the level of the utterance of the speaker by a predetermined method from the voice input by the voice input means;
The response output means selects voice data corresponding to the answer input by the input means from the voice data stored in the response voice storage means according to the level of utterance determined by the determination means. Output,
The conversation learning support system according to claim 1.   The conversation learning support system according to claim 1, further comprising a recording unit configured to record a voice input by the voice input unit.   4. The conversation learning support according to claim 3, further comprising a recognizing means for recognizing a voice from a voice recorded by the recording means with reference to an answer to the question displayed by the display means inputted by the input means. system. A server device comprising at least the voice storage means and the response voice storage means;
A terminal comprising the voice output means, the voice input means, the display means, the input means and the response output means;
The conversation learning support system according to any one of claims 1 to 4, wherein communication is performed via a network. A voice output step of reproducing and outputting a predetermined voice from voice data stored in voice storage means for storing voice data constituting at least one sentence;
A voice input step of inputting a voice of a speaker after outputting the voice in the voice output step;
A display step for displaying a sentence asking the content of the voice of the speaker after inputting the voice in the voice input step;
An input step for accepting an input to answer the question displayed in the display step;
From the voice data stored in the response voice storage means for classifying possible answers to the sentence asking the content of the voice of the speaker and storing voice data responding to each of the classified answers , A response output step of selecting and reproducing audio data corresponding to the answer input in the input step;
A conversation learning support method characterized by comprising: A determination step of determining a level of the utterance of the speaker by a predetermined method from the voice input in the voice input step;
In the response output step, voice data corresponding to the answer input in the input step is selected from the voice data stored in the response voice storage means according to the utterance level determined in the determination step. Output,
The conversation learning support method according to claim 6.   The conversation learning support method according to claim 6, further comprising a recording step of recording the voice input in the voice input step.   The conversation learning according to claim 8, further comprising a recognition step of recognizing speech from the voice recorded in the recording step with reference to an answer to the question displayed in the display step input in the input step. Support method. On the computer,
An audio output step of reproducing and outputting a predetermined audio from audio data stored in audio storage means for storing audio data constituting at least one sentence;
A voice input step of inputting a voice of a speaker after outputting the voice in the voice output step;
A display step for displaying a sentence asking the content of the voice of the speaker after inputting the voice in the voice input step;
An input step for accepting an input to answer the question displayed in the display step;
From the voice data stored in the response voice storage means for classifying possible answers to the sentence asking the content of the voice of the speaker and storing voice data responding to each of the classified answers A response output step of selecting and outputting voice data corresponding to the answer input in the input step;
A program characterized by having executed.

Images