CN111026837B - Learning content searching method and family education equipment - Google Patents
Learning content searching method and family education equipment Download PDFInfo
- Publication number
- CN111026837B CN111026837B CN201910119150.7A CN201910119150A CN111026837B CN 111026837 B CN111026837 B CN 111026837B CN 201910119150 A CN201910119150 A CN 201910119150A CN 111026837 B CN111026837 B CN 111026837B
- Authority
- CN
- China
- Prior art keywords
- user
- tutoring
- virtual object
- target image
- designated
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/06—Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Physics & Mathematics (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- User Interface Of Digital Computer (AREA)
- Electrically Operated Instructional Devices (AREA)
Abstract
本发明实施例涉及家教设备技术领域,公开了一种学习内容搜索方法及家教设备,该方法包括:根据用户输入的语音识别出用户意图;若用户意图为识字,从拍摄得到的目标图像中确定出该图像中的被指定位置;从目标图像中识别出被指定位置附近的若干个候选字;在显示屏上显示包含该若干个候选字的候选字列表;根据输入的选择信息,调整候选字列表中的光标位置;当检测到输入的确认信息时,将光标位置当前所选的候选字作为目标候选字;搜索与目标候选字相关的学习内容;输出该学习内容。本发明实施例,能够精确的识别出用户所指示的某一字,提高与该字相关的学习内容搜索的精确性。
The embodiment of the present invention relates to the technical field of tutoring equipment, and discloses a learning content search method and tutoring equipment. The method includes: identifying a user's intention according to a voice input by a user; if the user's intention is literacy, determining from a target image obtained by shooting Identify the designated position in the image; identify several candidate characters near the designated position from the target image; display a list of candidate characters containing the several candidate characters on the display screen; adjust the candidate characters according to the input selection information The cursor position in the list; when the input confirmation information is detected, the candidate word currently selected by the cursor position is used as the target candidate word; the learning content related to the target candidate word is searched; the learning content is output. In the embodiment of the present invention, a certain word indicated by the user can be accurately identified, and the accuracy of searching for the learning content related to the word can be improved.
Description
技术领域technical field
本发明涉及教育技术领域,尤其涉及一种学习内容搜索方法及家教设备。The invention relates to the technical field of education, and in particular, to a learning content search method and a family teaching device.
背景技术Background technique
随着家教机的不断普及,越来越多的用户(如学生)使用家教机进行学习。而目前,用户利用家教机来识字的方式一般为:市面上的家教机识字的方式一般为:家教机识别出用户通过扫描笔在课本上获得的扫描区域,并从扫描区域中提取出待搜索字,搜索与该待搜索字相关的学习内容(如字义)。With the continuous popularization of tutoring machines, more and more users (such as students) use tutoring machines for learning. At present, the way that users use the tutoring machine to read words is generally: The tutoring machine on the market generally uses the following method: the tutoring machine recognizes the scanning area obtained by the user on the textbook through the scanning pen, and extracts from the scanning area to be searched. word, search for the learning content (such as word meaning) related to the word to be searched.
但在实践中发现,当扫描区域内的字体或者字距较小时,上述方式很难精确的识别出用户所指示的某一字,从而降低与该字相关的学习内容搜索的精确性。However, it is found in practice that when the font or kerning in the scanning area is small, it is difficult to accurately identify a word indicated by the user in the above manner, thereby reducing the accuracy of searching for learning content related to the word.
发明内容SUMMARY OF THE INVENTION
本发明实施例公开一种学习内容搜索方法及家教设备,能够精确的识别出用户所指示的某一字,提高与该字相关的学习内容搜索的精确性。Embodiments of the present invention disclose a learning content search method and a family education device, which can accurately identify a word indicated by a user and improve the accuracy of learning content search related to the word.
本发明实施例第一方面公开一种习内容搜索方法,所述方法包括:A first aspect of the embodiments of the present invention discloses a method for searching content, the method comprising:
根据用户输入的语音识别出用户意图;Identify the user intent according to the voice input by the user;
若所述用户意图为识字,从拍摄得到的目标图像中确定出所述图像中的被指定位置;If the user intends to be literate, determining the designated position in the image from the captured target image;
从所述目标图像中识别出所述被指定位置附近的若干个候选字;Identify several candidate words near the designated position from the target image;
在显示屏上显示包含所述若干个候选字的候选字列表;Displaying a candidate word list containing the several candidate words on the display screen;
根据输入的选择信息,调整所述候选字列表中的光标位置;Adjust the cursor position in the candidate word list according to the input selection information;
当检测到输入的确认信息时,将所述光标位置当前所选的候选字作为目标候选字;When the input confirmation information is detected, the candidate word currently selected by the cursor position is used as the target candidate word;
搜索与目标候选字相关的学习内容;Search for learning content related to the target candidate word;
输出所述学习内容。The learning content is output.
本发明实施例第二方面公开一种家教设备,所述家教设备包括:A second aspect of the embodiments of the present invention discloses a family education device, and the family education device includes:
存储有可执行程序代码的存储器;a memory in which executable program code is stored;
与所述存储器耦合的处理器;a processor coupled to the memory;
所述处理器调用所述存储器中存储的所述可执行程序代码,执行本发明实施例第一方面公开的一种学习内容搜索方法。The processor invokes the executable program code stored in the memory to execute the learning content search method disclosed in the first aspect of the embodiment of the present invention.
本发明实施例第三方面公开一种计算机可读存储介质,其存储计算机程序,其中,所述计算机程序使得计算机执行本发明实施例第一方面公开的一种学习内容搜索方法。A third aspect of the embodiments of the present invention discloses a computer-readable storage medium storing a computer program, wherein the computer program causes a computer to execute the learning content search method disclosed in the first aspect of the embodiments of the present invention.
本发明实施例第四方面公开一种计算机程序产品,当所述计算机程序产品在计算机上运行时,使得所述计算机执行第一方面的任意一种学习内容搜索方法的部分或全部步骤。A fourth aspect of the embodiments of the present invention discloses a computer program product, which, when the computer program product runs on a computer, causes the computer to execute part or all of the steps of any one of the learning content search methods of the first aspect.
本发明实施例第五方面公开一种应用发布平台,所述应用发布平台用于发布计算机程序产品,其中,当所述计算机程序产品在计算机上运行时,使得所述计算机执行第一方面的任意一种学习内容搜索方法的部分或全部步骤。A fifth aspect of the embodiments of the present invention discloses an application publishing platform, where the application publishing platform is used for publishing a computer program product, wherein when the computer program product runs on a computer, the computer is made to execute any one of the first aspect. Some or all of the steps of a learning content search method.
与现有技术相比,本发明实施例具有以下有益效果:Compared with the prior art, the embodiments of the present invention have the following beneficial effects:
本发明实施例中,当家教设备根据用户输入的语音识别出用户的意图为识字时,则从拍摄的图像中获得被指定位置,并搜索该被指定位置附近的若干个候选字,显示包含上述若干个候选字的候选字列表在显示屏上,再根据用户输入的语音选择信息,调整候选字列表中的光标位置,当家教设备检测到用户输入的语音确认信息时,将当前光标位置所选的候选字作为目标候选字,并将搜索到的与该目标候选字相关的学习内容推送给用户。可见,本发明实施例,能够精确的识别出用户所指示的某一字,提高与该字相关的学习内容搜索的精确性。In the embodiment of the present invention, when the tutoring device recognizes that the user's intention is literacy according to the voice input by the user, the designated position is obtained from the captured image, and several candidate words near the designated position are searched, and the display contains the above-mentioned The candidate word list of several candidate words is displayed on the display screen, and then the cursor position in the candidate word list is adjusted according to the voice selection information input by the user. When the tutoring device detects the voice confirmation information input by the user, the current cursor position is selected. The candidate word is used as the target candidate word, and the searched learning content related to the target candidate word is pushed to the user. It can be seen that, in the embodiment of the present invention, a certain word indicated by the user can be accurately identified, and the accuracy of searching for the learning content related to the word can be improved.
附图说明Description of drawings
为了更清楚地说明本发明实施例中的技术方案,下面将对实施例中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to illustrate the technical solutions in the embodiments of the present invention more clearly, the following briefly introduces the drawings required in the embodiments. Obviously, the drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, other drawings can also be obtained from these drawings without any creative effort.
图1是本发明实施例公开的一种学习内容搜索方法的流程示意图;1 is a schematic flowchart of a learning content search method disclosed in an embodiment of the present invention;
图2是本发明实施例公开的另一种学习内容搜索方法的流程示意图;2 is a schematic flowchart of another learning content search method disclosed in an embodiment of the present invention;
图3是本发明实施例公开的另一种学习内容搜索方法的流程示意图;3 is a schematic flowchart of another learning content search method disclosed in an embodiment of the present invention;
图4是本发明实施例公开的一种家教设备的结构示意图;4 is a schematic structural diagram of a family education device disclosed in an embodiment of the present invention;
图5是本发明实施例公开的另一种家教设备的结构示意图;FIG. 5 is a schematic structural diagram of another kind of tutoring device disclosed in an embodiment of the present invention;
图6是本发明实施例公开的另一种家教设备的结构示意图;6 is a schematic structural diagram of another kind of tutoring device disclosed in an embodiment of the present invention;
图7是本发明实施例公开的另一种家教设备的结构示意图。FIG. 7 is a schematic structural diagram of another tutoring device disclosed in an embodiment of the present invention.
具体实施方式Detailed ways
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.
需要说明的是,本发明的说明书和权利要求书中的术语“第一”、“第二”、“第三”“第四”等是用于区别不同的对象,而不是用于描述特定顺序。本发明实施例的术语“包括”和“具有”以及他们的任何变形,意图在于覆盖不排他的包含,例如,包含了一系列步骤或单元的过程、方法、系统、产品或设备不必限于清楚地列出的那些步骤或单元,而是可包括没有清楚地列出的或对于这些过程、方法、产品或设备固有的其它步骤或单元。It should be noted that the terms "first", "second", "third" and "fourth" in the description and claims of the present invention are used to distinguish different objects, rather than to describe a specific order. . The terms "comprising" and "having" and any variations thereof in the embodiments of the present invention are intended to cover non-exclusive inclusion, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to the explicit Instead, those steps or elements listed may include other steps or elements not expressly listed or inherent to the process, method, product or apparatus.
本发明实施例公开一种学习内容搜索方法及家教设备,能够精确的识别出用户所指示的某一字,提高与该字相关的学习内容搜索的精确性。以下结合附图进行详细描述。Embodiments of the present invention disclose a learning content search method and a family education device, which can accurately identify a word indicated by a user and improve the accuracy of learning content search related to the word. A detailed description is given below in conjunction with the accompanying drawings.
实施例一Example 1
请参阅图1,图1是本发明实施例公开的一种学习内容搜索方法的流程示意图。如图1所示,该学习内容搜索方法可以包括以下步骤。Please refer to FIG. 1. FIG. 1 is a schematic flowchart of a learning content search method disclosed in an embodiment of the present invention. As shown in FIG. 1 , the learning content search method may include the following steps.
101、家教设备根据用户输入的语音识别出用户意图。101. The tutoring device recognizes the user's intention according to the voice input by the user.
本发明实施例中,家教设备可以是供学生使用的学习平板、学习机、家教机、点读机等电子设备,本发明实施例中不做限定。In the embodiment of the present invention, the home teaching device may be an electronic device such as a learning tablet, a learning machine, a home teaching machine, and a point-reading machine for students to use, which is not limited in the embodiment of the present invention.
作为一种可选的实施方式,本发明实施例中,家教设备可以识别用户输入的语音中是否存在与识字意图相关的预设关键词,例如“什么字”、“怎么写”“怎么读”、“怎么念”或“什么意思”等,若存在,则判断出该用户意图为识字。As an optional implementation manner, in this embodiment of the present invention, the tutoring device can identify whether there are preset keywords related to the literacy intention in the speech input by the user, such as "what word", "how to write", "how to read" , "how to read" or "what does it mean", etc., if it exists, it is determined that the user's intention is literacy.
举例来说,在家教设备当前已进入学习模式之后,用户可以通过语音方式唤醒家教设备的用户意图识别功能,在家教设备的用户意图识别功能被唤醒之后,家教设备即可接收用户输入的语音,执行步骤101。For example, after the tutoring device has entered the learning mode, the user can wake up the user intent recognition function of the tutoring device by voice.
又举例来说,在家教设备当前已进入学习模式之后,用户可以通过触屏方式手动唤醒家教设备的用户意图识别功能,在家教设备的用户意图识别功能被唤醒之后,家教设备即可接收用户输入的语音,执行步骤101。For another example, after the tutoring device has entered the learning mode, the user can manually wake up the user intent recognition function of the tutoring device by touching the screen. After the user intent recognition function of the tutoring device is awakened, the tutoring device can receive user input. voice, go to
又举例来说,在家教设备当前已进入学习模式之后,用户可以通过手动开启设置在家教设备上的物理按键开关唤醒家教设备的用户意图识别功能,在家教设备的用户意图识别功能被唤醒之后,家教设备即可接收用户输入的语音,执行步骤101。For another example, after the tutoring device has entered the learning mode, the user can manually turn on the physical key switch set on the tutoring device to wake up the user intent recognition function of the tutoring device. After the user intent recognition function of the tutoring device is awakened, The tutoring device can receive the voice input by the user, and step 101 is executed.
102、当用户意图为识字时,家教设备从拍摄得到的目标图像中确定出该图像中的被指定位置。102. When the user's intention is to read words, the tutoring device determines the designated position in the image from the captured target image.
作为一种可选的实施方式,本发明实施例中,被指定位置可以由棍状物体(如手指、笔)在目标图像中指定。家教设备可以先从拍摄到的目标图像中识别出棍状物物体的轮廓,并将该棍状物体的轮廓作为识别被指定位置的依据。在家教设备从拍摄得到的目标图像中确定出该图像中的被指定位置时,家教设备可以根据目标图像中棍状物体的轮廓分别出该目标图像中棍状物体的轮廓的指向性,并根据该轮廓的指向性确定出该轮廓指向的位置,并将该轮廓指向的位置作为该目标图像中确定出该图像中的被指定位置。As an optional implementation manner, in this embodiment of the present invention, the designated position may be designated in the target image by a stick-shaped object (eg, a finger, a pen). The tutoring device can first identify the contour of the stick-shaped object from the captured target image, and use the contour of the stick-shaped object as the basis for identifying the designated position. When the tutoring device determines the designated position in the image from the captured target image, the tutoring device can determine the directivity of the contour of the stick-shaped object in the target image according to the contour of the stick-shaped object in the target image, and according to the contour of the stick-shaped object in the target image The directivity of the contour determines the position pointed by the contour, and uses the position pointed by the contour as the designated position in the image in the target image.
103、家教设备从目标图像中识别出上述被指定位置附近的若干个候选字。103. The tutoring device identifies several candidate words near the designated position from the target image.
作为一种可选的实施方式,本发明实施例中,家教设备从目标图像中识别出上述被指定位置附近的若干个候选字,包括:As an optional implementation manner, in this embodiment of the present invention, the tutoring device recognizes several candidate words near the designated position from the target image, including:
家教设备从目标图像中确定出以上述指定位置设为圆心以及以预设数量的字排列时所占的区域长度为半径的圆形区域,并识别出位于圆形区域内的若干个字,作为上述被指定位置附近的若干个候选字。The tutoring device determines from the target image a circular area with the above-mentioned designated position as the center of the circle and the length of the area occupied by the preset number of words as the radius, and recognizes several words located in the circular area as Several candidate words near the designated position above.
或者,家教设备从目标图像中识别出上述被指定位置附近的若干个候选字,包括:Or, the tutoring device recognizes several candidate words near the designated position from the target image, including:
家教设备从目标图像中确定出以上述指定位置设为对角线交叉点以及以预设数量的字排列时所占的区域长度为对角线长度的矩形区域,并识别出位于矩形区域内的若干个字,作为被指定位置附近的若干个候选字。The tutoring device determines from the target image a rectangular area with the above-mentioned designated position as the diagonal intersection and the area occupied by the preset number of words arranged as the diagonal length, and identifies the rectangular area located in the rectangular area. Several words are used as several candidate words near the designated position.
或者,家教设备从目标图像中识别出上述被指定位置附近的若干个候选字,包括:Or, the tutoring device recognizes several candidate words near the designated position from the target image, including:
家教设备从目标图像中确定出以上述指定位置设为中点以及以预设数量的字排列时所占的区域长度为长方形边长长度,以单个字所占的区域宽度为长方形边长宽度的长方形区域,并识别出位于长方形区域内的若干个字,作为被指定位置附近的若干个候选字。The tutoring device determines from the target image that the length of the area occupied by the above specified position as the midpoint and the arrangement of the preset number of words is the length of the side of the rectangle, and the width of the area occupied by a single word is the length of the side of the rectangle. A rectangular area is identified, and several characters located in the rectangular area are identified as several candidate characters near the designated position.
104、家教设备在显示屏上显示包含上述若干个候选字的候选字列表。104. The tutoring device displays a candidate character list including the above-mentioned several candidate characters on the display screen.
举例来说,家教设备可以将上述被指定位置设为圆心以及以预设数量的字排列时所占的区域长度为半径的圆形区域作为候选字列表显示在家教设备的显示屏上。For example, the tutoring device can display the above-mentioned designated position as the center of the circle and a circular area with the length of the area occupied by the preset number of characters arranged as the radius as the candidate character list displayed on the display screen of the tutoring device.
又举例来说,家教设备可以将上述指定位置设为对角线交叉点以及以预设数量的字排列时所占的区域长度为对角线长度的矩形区域作为候选字列表显示在家教设备的显示屏上。For another example, the tutoring device can set the above-mentioned specified position as the intersection of the diagonal lines and a rectangular area whose length is the diagonal length of the area occupied by the preset number of characters when arranged as a list of candidate characters displayed on the tutoring device. on the display.
又举例来说,家教设备可以将上述指定位置以及被指定位置附近的若干个候选字有顺序的放置在矩形区域内作为候选字列表显示在家教设备的显示屏上。For another example, the tutoring device may place the specified position and several candidate characters near the designated position in sequence in a rectangular area as a list of candidate characters to display on the display screen of the tutoring device.
又举例来说,家教设备可以将上述若干个候选字按照候选字的笔画数量从高到底的顺序进行排序,并排序好的上述若干个候选字显示在家教设备的显示屏上。For another example, the tutoring device can sort the above-mentioned several candidate characters according to the order of the number of strokes of the candidate characters from high to bottom, and display the above-mentioned several candidate characters on the display screen of the tutoring device.
又举例来说,家教设备可以将上述若干个候选字按照候选字的相关的学习内容的被搜索次数从高到底的顺序进行排序,并排序好的上述若干个候选字显示在家教设备的显示屏上。For another example, the tutoring device can sort the above-mentioned several candidate words according to the search times of the relevant learning content of the candidate words in descending order, and display the above-mentioned several candidate words after sorting on the display screen of the tutoring device. superior.
105、家教设备根据输入的选择信息,调整候选字列表中的光标位置。105. The tutoring device adjusts the cursor position in the candidate word list according to the input selection information.
本发明实施例中,候选字列表中的光标位置可以在家教设备的显示屏上静态显示;或候选字列表中的光标位置可以在家教设备的显示屏上动态显示。In this embodiment of the present invention, the cursor position in the candidate word list may be statically displayed on the display screen of the home teaching device; or the cursor position in the candidate word list may be dynamically displayed on the display screen of the home teaching device.
作为一种可选的实施方式,本发明实施例中,家教设备可以通过用户输入的语音选择信息,例如“向左”、“向右”、“向上”或“向下”等,对候选字列表中的光标位置进行移动,直到用户选择出目标候选字为止。As an optional implementation manner, in this embodiment of the present invention, the tutoring device may select information, such as "leftward", "rightward", "upward" or "downward", through the voice input by the user, and select the information for the candidate word. The cursor position in the list moves until the user selects the target candidate word.
106、当检测到输入的确认信息时,家教设备将光标位置当前所选的候选字作为目标候选字。106. When detecting the input confirmation information, the tutoring device takes the candidate word currently selected by the cursor position as the target candidate word.
本发明实施例中,家教设备可以检测用户输入的语音中是否存在与语音确认信息相关的预设关键词,例如“是”,若用户输入的语音中存在与语音确认信息相关的预设关键词,则将光标当前所选的候选字作为目标候选字。In the embodiment of the present invention, the tutoring device can detect whether there is a preset keyword related to the voice confirmation information in the voice input by the user, such as "Yes", if there is a preset keyword related to the voice confirmation information in the voice input by the user , the candidate word currently selected by the cursor is used as the target candidate word.
作为一种可选的实施方式,本发明实施例中,在用户输入的语音确认信息之前,家教设备可以通过发出选择确认提示信息,例如“是这个字吗”、“是要学习这个字吗”或“是要了解这个字吗”等。As an optional implementation manner, in this embodiment of the present invention, before the voice confirmation information input by the user, the tutoring device can send out selection confirmation prompt information, such as "is this word", "do you want to learn this word?" Or "Do you want to understand this word?" etc.
作为一种可选的实施方式,本发明实施例中,家教设备发出的选择确认提示信息包括:As an optional implementation manner, in this embodiment of the present invention, the selection confirmation prompt information sent by the tutoring device includes:
家教设备显示屏的显示信息提示;Display information prompts on the display screen of the tutoring equipment;
和/或,家教设备发出的语音信息提示。And/or, voice message prompts sent by tutoring equipment.
107、家教设备搜索与目标候选字相关的学习内容。107. The tutoring device searches for learning content related to the target candidate word.
作为一种可选的实施方式,本发明实施例中,在家教设备搜索与目标候选字相关的学习内容之后,家教设备的显示屏上将会出现与目标候选字相关的不同学习内容的选项,用户可以根据自身需求选择学习内容。As an optional implementation manner, in this embodiment of the present invention, after the home teaching device searches for learning content related to the target candidate word, options for different learning content related to the target candidate word will appear on the display screen of the home teaching device, Users can choose the learning content according to their own needs.
108、家教设备输出上述学习内容。108. The tutoring device outputs the above learning content.
本发明实施例中,用户可以采用账号(如社交账号)登陆家教设备,并且在家教设备输出上述学习内容之后,用户可以通过该账号实现与他人进行学习交流,从而提高用户学习的积极性和学习效率。In this embodiment of the present invention, the user can log in to the tutoring device using an account (such as a social account), and after the tutoring device outputs the above learning content, the user can use the account to communicate with others in learning, thereby improving the user's enthusiasm for learning and learning efficiency .
作为一种可选的实施方式,本发明实施例中,家教设备在输出上述学习内容给用户之后,还可以将该目标候选字和用户的身份信息上报给该用户对应的教师终端,让教师终端所属教师获悉用户哪一些字对于用户而言是陌生的或者是尚未掌握的,以便于教师可以对该用户进行针对性的加以辅导。As an optional implementation manner, in this embodiment of the present invention, after outputting the above learning content to the user, the tutoring device may also report the target candidate word and the user's identity information to the teacher's terminal corresponding to the user, so that the teacher's terminal The affiliated teacher learns which words of the user are unfamiliar or unfamiliar to the user, so that the teacher can provide targeted guidance to the user.
作为一种可选的实施方式,本发明实施例中,家教设备在输出上述学习内容给用户之后,还可以将该目标候选字和与目标候选字相关的学习内容通过中间服务器(如社交服务器)发送给用户选择的好友账号,以增加用户与好友之间在学习上的交流,以便提高用户学习的积极性。其中,家教设备可以向用户提供用户用于登陆家教设备的账号的关系用户链,以便于用户可以从该关系用户链中选择好友账号。As an optional implementation manner, in this embodiment of the present invention, after outputting the above learning content to the user, the tutoring device may also pass the target candidate word and the learning content related to the target candidate word through an intermediate server (such as a social server) It is sent to the friend account selected by the user to increase the communication between the user and his friend in learning, so as to improve the user's enthusiasm for learning. The tutoring device may provide the user with a relational user chain of the account that the user uses to log in to the tutoring appliance, so that the user can select a friend account from the relational user chain.
作为一种可选的实施方式,本发明实施例中,家教设备在输出上述学习内容给用户之后,还可以将该目标候选字上报给中间服务器(如社交服务器),而中间服务器(如社交服务器)可以根据该目标候选字,查询已上报过该目标候选字的其他用户的账号,并将其他用户的账号推荐给家教设备,这样用户不仅可以结识更多的好友,还能与其他用户进行学习方法经验的交流,这有助于提高用户学习的积极性。As an optional implementation manner, in this embodiment of the present invention, after outputting the above learning content to the user, the tutoring device may also report the target candidate word to an intermediate server (such as a social server), and the intermediate server (such as a social server) ) can query the accounts of other users who have reported the target candidate word according to the target candidate word, and recommend the accounts of other users to the tutoring device, so that the user can not only make more friends, but also learn with other users The exchange of method experience, which helps to improve the enthusiasm of users to learn.
作为一种可选的实施方式,本发明实施例中,家教设备在输出上述学习内容给用户之后,用户可以通过游戏的方式加深对不认识的字对应的学习内容的掌握程度,以便提高用户学习的积极性。As an optional implementation manner, in this embodiment of the present invention, after the tutoring device outputs the above learning content to the user, the user can deepen the mastery of the learning content corresponding to the unknown words through games, so as to improve the user's learning positivity.
在图1所示的学习内容搜索方法中,以家教设备作为执行主体为例进行描述。需要说明的是,图1所示的学习内容搜索方法的执行主体还可以是与家教设备相关联的独立设备,本发明实施例不作限定。In the learning content search method shown in FIG. 1 , the description is given by taking a tutoring device as an execution subject as an example. It should be noted that, the execution subject of the learning content search method shown in FIG. 1 may also be an independent device associated with the tutoring device, which is not limited in the embodiment of the present invention.
可见,实施图1所描述的学习内容搜索方法,该方法能够精确的识别出用户所指示的某一字,提高与该字相关的学习内容搜索的精确性。It can be seen that, by implementing the learning content search method described in FIG. 1 , the method can accurately identify a certain word indicated by the user, and improve the accuracy of the learning content search related to the word.
实施例二Embodiment 2
请参阅图2,图2是本发明实施例公开的另一种学习内容搜索方法的流程示意图。如图2所示,该学习内容搜索方法可以包括以下步骤:Please refer to FIG. 2 , which is a schematic flowchart of another learning content search method disclosed in an embodiment of the present invention. As shown in Figure 2, the learning content search method may include the following steps:
201、家教设备检测家教设备当前是否进入学习模式,若是,则执行步骤202,若否,则结束本次流程。201. The tutoring device detects whether the tutoring device currently enters the learning mode, and if so, executes
本发明实施例中,家教设备可以检测家教设备的应用程序当前是否进入学习模式,若是,则执行步骤202,若否,则结束本次流程。In the embodiment of the present invention, the tutoring device may detect whether the application program of the tutoring device currently enters the learning mode, and if so, execute
其中,家教设备的应用程序可以包括学习类应用程序和娱乐类应用程序。其中,学习类应用程序可以包括语文类应用程序、数学类应用程序和英语类应用程序等;而娱乐类应用程序可以包括音乐类应用程序、视频类应用程序、游戏类应用程序、社交类应用程序等。Among them, the applications of the tutoring device may include learning applications and entertainment applications. Among them, learning applications may include language applications, mathematics applications, and English applications; and entertainment applications may include music applications, video applications, game applications, and social applications. Wait.
作为一种可选的实施方式,家教设备通过对当前家教设备的应用程序进行检测,当检测到家教设备的应用程序当前已进入学习模式时,才判断家教设备的用户意图识别功能是否被唤醒。As an optional implementation manner, the tutoring device determines whether the user intent recognition function of the tutoring device is awakened only when it detects that the application of the tutoring device currently enters the learning mode by detecting the application of the tutoring device.
202、家教设备判断用户意图识别功能是否被唤醒,若是,则执行步骤203~步骤205,若否,则结束本次流程。202. The tutoring device determines whether the user's intent recognition function is awakened, and if so, executes
作为一种可选的实施方式,本发明实施例中,家教设备设有一个智能家教设备语音助手,该智能家教设备语音助手都会有一个对应的名称,该名称可以是家教设备已经预设好的称号,也可以是用户自己设置的名称,本发明实施例中不做限定。As an optional implementation manner, in this embodiment of the present invention, the tutoring device is provided with an intelligent tutoring device voice assistant, and the intelligent tutoring device voice assistant will have a corresponding name, and the name may be preset by the tutoring device The title may also be a name set by the user, which is not limited in this embodiment of the present invention.
举例来说,在执行步骤201之后,用户可以通过语音呼叫该智能家教设备语音助手的名称,来唤醒家教设备的用户意图识别功能,在家教设备的用户意图识别功能被唤醒之后,即可执行步骤203。For example, after performing
又举例来说,在执行步骤201之后,用户可以通过触屏方式手动唤醒家教设备的用户意图识别功能,在家教设备的用户意图识别功能被唤醒之后,即可执行步骤203。For another example, after
又举例来说,在执行步骤201之后,用户可以通过手动开启设置在家教设备上的物理按键开关唤醒家教设备的用户意图识别功能,在家教设备的用户意图识别功能被唤醒之后,即可执行步骤203。For another example, after performing
203、家教设备获取用户输入的语音。203. The tutoring device acquires the voice input by the user.
204、家教设备根据用户输入的语音识别出用户意图。204. The tutoring device recognizes the user's intention according to the voice input by the user.
205、家教设备判断识别出的用户意图是否为识字,若是,则执行步骤206~步骤207,若否,则结束本次流程。205. The tutoring device determines whether the identified user's intention is literacy, and if so, executes
作为一种可选的实施方式,本发明实施例中,家教设备可以识别用户输入的语音中是否存在与识字意图相关的预设关键词,例如“什么字”、“怎么写”“怎么读”、“怎么念”或“什么意思”等,若存在,则判断出该用户意图为识字,执行步骤206~步骤207。As an optional implementation manner, in this embodiment of the present invention, the tutoring device can identify whether there are preset keywords related to the literacy intention in the speech input by the user, such as "what word", "how to write", "how to read" , "how to read" or "what does it mean", etc., if it exists, it is determined that the user's intention is literacy, and steps 206 to 207 are executed.
206、家教设备根据上述语音识别出上述语音对应的语音特征。206. The tutoring device recognizes the voice feature corresponding to the voice according to the voice.
207、家教设备判断是否预存储有与上述语音特征相关联的指定卡通人物形象,若是,则执行步骤208~步骤220,若否,则结束本次流程。207. The tutoring device determines whether a designated cartoon character image associated with the above-mentioned voice feature is pre-stored, and if so, executes
作为一种可选的实施方式,本发明实施例中,当家教设备检测到用户意图为识字之后,可以将识别到的语音特征与预先存储在家教设备的与指定卡通人物形象相关联的语音特征进行匹配,若匹配成功,则判断出预存储有与上述语音特征相关联的指定卡通人物形象,并执行步骤208~步骤220,若否,则结束本次流程。As an optional implementation manner, in this embodiment of the present invention, after the tutoring device detects that the user's intention is literacy, the recognized voice feature may be matched with the voice feature that is pre-stored in the tutoring device and is associated with the specified cartoon character. Matching is performed, and if the matching is successful, it is determined that the designated cartoon character image associated with the above-mentioned voice feature is pre-stored, and steps 208 to 220 are executed, and if not, the process ends.
208、家教设备输出与上述语音特征相关联的指定卡通人物形象。208. The tutoring device outputs a designated cartoon character image associated with the above-mentioned voice feature.
作为一种可选的实施方式,本发明实施例中,家教设备可以输出与上述语音特征相关联的指定卡通人物形象,且该指定卡通人物形象可以伴随着其经典的出场方式显示在家教设备显示屏上。As an optional implementation manner, in this embodiment of the present invention, the tutoring device may output a designated cartoon character associated with the above-mentioned voice feature, and the designated cartoon character may be displayed on the tutoring device along with its classic appearance. on the screen.
和/或,家教设备可以输出与上述语音特征相关联的指定卡通人物形象的经典台词,使上述指定卡通人物形象伴随着其经典的台词出现在家教设备的显示屏上。And/or, the tutoring device may output the classic lines of the designated cartoon character associated with the above-mentioned voice feature, so that the designated cartoon character appears on the display screen of the tutoring device along with the classic lines.
作为一种可选的实施方式,本发明实施例中,家教设备通过输出与上述语音特征相关联的指定卡通人物形象,使整个家教设备的识字学习变得更加的生动、有趣和精彩,从而提高了用户学习的积极性和学习效率。As an optional implementation manner, in this embodiment of the present invention, the tutoring device outputs a designated cartoon character image associated with the above-mentioned voice feature, so that the literacy learning of the entire tutoring device becomes more vivid, interesting and exciting, thereby improving the It improves the enthusiasm and learning efficiency of users.
209、家教设备将第一虚拟物加载至已输出的指定卡通人物形象的一个手掌。209. The tutoring device loads the first virtual object into one palm of the output designated cartoon character image.
作为一种可选的实施方式,本发明实施例中,家教设备加载的第一虚拟物可以是指定卡通人物形象的经典必备物品,例如,指定卡通人物形象如果为“《喜羊羊与灰太狼》中的红太狼”,则第一虚拟物可以显示为“红太狼的平底锅”。As an optional implementation manner, in this embodiment of the present invention, the first virtual object loaded by the tutoring device may be a classic necessary item for a designated cartoon character. For example, if the designated cartoon character is "Pleasant Goat and Big Big Wolf" The Red Wolf", the first virtual object can be displayed as "Red Wolf's Pan".
210、家教设备将第二虚拟物加载至已输出的上述指定卡通人物形象的另一手掌。210. The tutoring device loads the second virtual object into the other palm of the outputted designated cartoon character image.
作为一种可选的实施方式,本发明实施例中,家教设备加载的第二虚拟物可以是指定卡通人物形象除了作为第一虚拟物的其他经典必备物品,例如,指定卡通人物形象如果为“《喜羊羊与灰太狼》中的红太狼”,而“红太狼的平底锅”已经作为第一虚拟物,则第二虚拟物可以显示为“红太狼佩戴的皇冠”。As an optional implementation manner, in this embodiment of the present invention, the second virtual object loaded by the tutoring device may be a designated cartoon character image in addition to other classic necessary items as the first virtual object. For example, if the designated cartoon character image is "The Red Wolf in "Pleasant Goat and Big Big Wolf", and "Red Wolf's Pan" has been used as the first virtual object, the second virtual object can be displayed as "the crown worn by the Red Wolf".
211、家教设备将第一提示信息加载至第一虚拟物,其中,第一提示信息用于提示从相册中选择目标图像。211. The tutoring device loads first prompt information to the first virtual object, where the first prompt information is used to prompt to select a target image from an album.
作为一种可选的实施方式,本发明实施例中,家教设备可以将第一提示信息以文字方式直接显示在第一虚拟物上面,使用户可以直接通过第一虚拟物上面的提示信息内容进行选择。As an optional implementation manner, in this embodiment of the present invention, the tutoring device may directly display the first prompt information on the first virtual object in text, so that the user can directly use the prompt information content on the first virtual object to choose.
或者,家教设备可以将第一提示信息以隐藏方式隐藏在第一虚拟物上面,只有用户在触及第一虚拟物时,第一提示信息才会浮现在第一虚拟物上面。Alternatively, the tutoring device may hide the first prompt information on the first virtual object in a hidden manner, and only when the user touches the first virtual object, the first prompt information will appear on the first virtual object.
或者,家教设备可以在用户触及第一虚拟物时,将第一提示信息的内容以指定卡通人物形象的经典语调播放出来。Alternatively, when the user touches the first virtual object, the tutoring device may play the content of the first prompt information in a classic tone of a designated cartoon character.
212、家教设备将第二提示信息加载至第二虚拟物,其中,第二提示信息用于提示调用相机拍摄目标图像。212. The tutoring device loads the second prompt information to the second virtual object, where the second prompt information is used to prompt invoking the camera to capture the target image.
作为一种可选的实施方式,本发明实施例中,家教设备可以将第二提示信息以文字方式直接显示在第二虚拟物上面,使用户可以直接通过第二虚拟物上面的提示信息内容进行选择。As an optional implementation manner, in this embodiment of the present invention, the tutoring device may directly display the second prompt information on the second virtual object in text form, so that the user can directly use the prompt information content on the second virtual object to choose.
或者,家教设备可以将第二提示信息以隐藏方式隐藏在第二虚拟物上面,只有用户在触及第二虚拟物时,第二提示信息才会浮现在第二虚拟物上面。Alternatively, the tutoring device may hide the second prompt information on the second virtual object in a hidden manner, and only when the user touches the second virtual object, the second prompt information will appear on the second virtual object.
或者,家教设备可以在用户触及第二虚拟物时,将第二提示信息的内容以指定卡通人物形象的经典语调播放出来。Alternatively, when the user touches the second virtual object, the tutoring device may play the content of the second prompt information in a classic tone of a designated cartoon character.
213、当检测出第一虚拟物被用户触及时,家教设备开启相册;检测从已开启的相册中被选择的至少一张图像,作为目标图像;或者,当检测出第二虚拟物被用户触及时,家教设备调用摄像头执行拍摄,并将摄像头执行拍摄获得的图像,作为目标图像。213. When detecting that the first virtual object is touched by the user, the tutoring device opens the album; detects at least one image selected from the opened album as the target image; or, when detecting that the second virtual object is touched by the user , the tutoring device calls the camera to perform shooting, and uses the image obtained by the camera to perform shooting as the target image.
214、家教设备从目标图像中确定出目标图像中的被指定位置。214. The tutoring device determines the designated position in the target image from the target image.
本发明实施例中,实施上述步骤206~步骤214,家教设备可以在用户意图为识字时,从拍摄得到的目标图像中确定出目标图像中的被指定位置。In this embodiment of the present invention, by implementing the
215、家教设备从目标图像中识别出上述被指定位置附近的若干个候选字。215. The tutoring device identifies several candidate words near the designated position from the target image.
216、家教设备在显示屏上显示包含上述若干个候选字的候选字列表。216. The tutoring device displays a candidate character list including the above-mentioned several candidate characters on the display screen.
217、家教设备根据输入的选择信息,调整候选字列表中的光标位置。217. The tutoring device adjusts the cursor position in the candidate word list according to the input selection information.
作为一种可选的实施方式,本发明实施例中,家教设备可以通过用户输入的语音选择信息,例如“向左”、“向右”、“向上”或“向下”等,对候选字列表中的光标位置进行移动,直到用户选择出目标候选字为止。As an optional implementation manner, in this embodiment of the present invention, the tutoring device may select information, such as "leftward", "rightward", "upward" or "downward", through the voice input by the user, and select the information for the candidate word. The cursor position in the list moves until the user selects the target candidate word.
218、当检测到输入的确认信息时,家教设备将光标位置当前所选的候选字作为目标候选字。218. When the input confirmation information is detected, the tutoring device takes the candidate character currently selected by the cursor position as the target candidate character.
本发明实施例中,家教设备可以检测用户输入的语音中是否存在与语音确认信息相关的预设关键词,例如“是”,若用户输入的语音中存在与语音确认信息相关的预设关键词,则将光标当前所选的候选字作为目标候选字。In the embodiment of the present invention, the tutoring device can detect whether there is a preset keyword related to the voice confirmation information in the voice input by the user, such as "Yes", if there is a preset keyword related to the voice confirmation information in the voice input by the user , the candidate word currently selected by the cursor is used as the target candidate word.
作为一种可选的实施方式,本发明实施例中,在用户输入的语音确认信息之前,家教设备可以通过发出选择确认提示信息,例如“是这个字吗”、“是要学习这个字吗”或“是要了解这个字吗”等。As an optional implementation manner, in this embodiment of the present invention, before the voice confirmation information input by the user, the tutoring device can send out selection confirmation prompt information, such as "is this word", "do you want to learn this word?" Or "Do you want to understand this word?" etc.
作为一种可选的实施方式,本发明实施例中,家教设备发出的选择确认提示信息包括:As an optional implementation manner, in this embodiment of the present invention, the selection confirmation prompt information sent by the tutoring device includes:
家教设备显示屏的显示信息提示;Display information prompts on the display screen of the tutoring equipment;
和/或,家教设备发出的语音信息提示。And/or, voice message prompts sent by tutoring equipment.
219、家教设备搜索与目标候选字相关的学习内容。219. The tutoring device searches for learning content related to the target candidate word.
作为一种可选的实施方式,本发明实施例中,在家教设备搜索与目标候选字相关的学习内容之后,家教设备的显示屏上将会出现与目标候选字相关的不同学习内容的选项,用户可以根据自身需求选择学习内容。As an optional implementation manner, in this embodiment of the present invention, after the home teaching device searches for learning content related to the target candidate word, options for different learning content related to the target candidate word will appear on the display screen of the home teaching device, Users can choose the learning content according to their own needs.
220、家教设备输出上述学习内容。220. The tutoring device outputs the above learning content.
本发明实施例中,用户可以采用账号(如社交账号)登陆家教设备,并且在家教设备输出上述学习内容之后,用户可以通过该账号实现与他人进行学习交流,从而提高用户学习的积极性和学习效率。In this embodiment of the present invention, the user can log in to the tutoring device using an account (such as a social account), and after the tutoring device outputs the above learning content, the user can use the account to communicate with others in learning, thereby improving the user's enthusiasm for learning and learning efficiency .
作为一种可选的实施方式,本发明实施例中,家教设备在输出上述学习内容给用户之后,还可以将该目标候选字和用户的身份信息上报给该用户对应的教师终端,让教师终端所属教师获悉用户哪一些字对于用户而言是陌生的或者是尚未掌握的,以便于教师可以对该用户进行针对性的加以辅导。As an optional implementation manner, in this embodiment of the present invention, after outputting the above learning content to the user, the tutoring device may also report the target candidate word and the user's identity information to the teacher's terminal corresponding to the user, so that the teacher's terminal The affiliated teacher learns which words of the user are unfamiliar or unfamiliar to the user, so that the teacher can provide targeted guidance to the user.
作为一种可选的实施方式,本发明实施例中,家教设备在输出上述学习内容给用户之后,还可以将该目标候选字和与目标候选字相关的学习内容通过中间服务器(如社交服务器)发送给用户选择的好友账号,以增加用户与好友之间在学习上的交流,以便提高用户学习的积极性。其中,家教设备可以向用户提供用户用于登陆家教设备的账号的关系用户链,以便于用户可以从该关系用户链中选择好友账号。As an optional implementation manner, in this embodiment of the present invention, after outputting the above learning content to the user, the tutoring device may also pass the target candidate word and the learning content related to the target candidate word through an intermediate server (such as a social server) It is sent to the friend account selected by the user to increase the communication between the user and his friend in learning, so as to improve the user's enthusiasm for learning. The tutoring device may provide the user with a relational user chain of the account that the user uses to log in to the tutoring appliance, so that the user can select a friend account from the relational user chain.
作为一种可选的实施方式,本发明实施例中,家教设备在输出上述学习内容给用户之后,还可以将该目标候选字上报给中间服务器(如社交服务器),而中间服务器(如社交服务器)可以根据该目标候选字,查询已上报过该目标候选字的其他用户的账号,并将其他用户的账号推荐给家教设备,这样用户不仅可以结识更多的好友,还能与其他用户进行学习方法经验的交流,这有助于提高用户学习的积极性。As an optional implementation manner, in this embodiment of the present invention, after outputting the above learning content to the user, the tutoring device may also report the target candidate word to an intermediate server (such as a social server), and the intermediate server (such as a social server) ) can query the accounts of other users who have reported the target candidate word according to the target candidate word, and recommend the accounts of other users to the tutoring device, so that the user can not only make more friends, but also learn with other users The exchange of method experience, which helps to improve the enthusiasm of users to learn.
作为一种可选的实施方式,本发明实施例中,家教设备在输出上述学习内容给用户之后,用户可以通过游戏的方式加深对不认识的字对应的学习内容的掌握程度,以便提高用户学习的积极性。As an optional implementation manner, in this embodiment of the present invention, after the tutoring device outputs the above learning content to the user, the user can deepen the mastery of the learning content corresponding to the unknown words through games, so as to improve the user's learning positivity.
可见,实施图2所描述的另一种学习内容搜索方法,当家教设备判断出用户意图为识字时,家教设备通过识别用户输入的语音得到该语音对应的语音特征,在家教设备中存在有上述语音特征相关联的指定卡通人物形象时,家教设备则会输出与上述语音特征相关联的指定卡通人物形象,并将第一虚拟物和第一提示信息以及第二虚拟物和第二提示信息加载至用户手掌中,其中,第一提示信息用于提示从相册中选择目标图像,第二提示信息用于提示调用相机拍摄目标图像。当检测出第一虚拟物被用户触及时,家教设备开启相册;检测从已开启的相册中被选择的至少一张图像,作为目标图像;或者,当检测出第二虚拟物被用户触及时,家教设备调用摄像头执行拍摄,并将摄像头执行拍摄获得的图像,作为目标图像。这一过程不仅可以在家教设备上输出指定卡通人物形象,使家教设备的识字学习过程变得更加生动、有趣和精彩,从而提高用户学习的积极性和学习效率,还可以精确的识别出用户所指示的某一字,提高与该字相关的学习内容搜索的精确性。It can be seen that, implementing another learning content search method described in FIG. 2, when the tutoring device judges that the user's intention is literacy, the tutoring device obtains the corresponding voice feature of the voice by recognizing the voice input by the user, and there is the above-mentioned voice in the tutoring device. When there is a designated cartoon character associated with the voice feature, the tutoring device will output the designated cartoon character associated with the above voice feature, and load the first virtual object and the first prompt information, as well as the second virtual object and the second prompt information. into the palm of the user, wherein the first prompt information is used to prompt the selection of the target image from the album, and the second prompt information is used to prompt to call the camera to shoot the target image. When detecting that the first virtual object is touched by the user, the tutoring device opens the album; detects at least one image selected from the opened album as the target image; or, when detecting that the second virtual object is touched by the user, The tutoring device calls the camera to perform shooting, and uses the image obtained by the camera to perform the shooting as the target image. This process can not only output the specified cartoon character image on the home teaching device, make the literacy learning process of the home teaching device more vivid, interesting and exciting, thereby improving the user's enthusiasm for learning and learning efficiency, but also can accurately identify the user's instruction. to improve the search accuracy of learning content related to the word.
实施例三Embodiment 3
请参阅图3,图3是本发明实施例公开的另一种学习内容搜索方法的流程示意图。如图3所示,该学习内容搜索方法可以包括以下步骤:Please refer to FIG. 3 , which is a schematic flowchart of another learning content search method disclosed in an embodiment of the present invention. As shown in Figure 3, the learning content search method may include the following steps:
301、家教设备获取用户输入的语音。301. The tutoring device acquires the voice input by the user.
相应地,家教设备可以在家教设备当前已进入学习模式且家教设备的用户意图识别功能被唤醒之后,才执行步骤301。Correspondingly, the tutoring device may perform step 301 only after the tutoring device has entered the learning mode and the user intention recognition function of the tutoring device is awakened.
302、家教设备根据用户输入的语音识别出用户意图。302. The tutoring device recognizes the user's intention according to the voice input by the user.
303、家教设备判断识别出的用户意图是否为识字,若是,则执行步骤304-步骤305,若否,则结束本次流程。303. The tutoring device determines whether the identified user intention is literacy, and if so, executes
作为一种可选的实施方式,本发明实施例中,家教设备可以识别用户输入的语音中是否存在与识字意图相关的预设关键词,例如“什么字”、“怎么写”“怎么读”、“怎么念”或“什么意思”等,若存在,则判断出该用户意图为识字,执行步骤304~步骤305。As an optional implementation manner, in this embodiment of the present invention, the tutoring device can identify whether there are preset keywords related to the literacy intention in the speech input by the user, such as "what word", "how to write", "how to read" , "how to pronounce" or "what does it mean", etc., if it exists, it is determined that the user's intention is literacy, and steps 304 to 305 are executed.
304、家教设备根据上述语音识别出上述语音对应的语音特征。304. The tutoring device recognizes the voice feature corresponding to the voice according to the voice.
305、家教设备判断是否预存储有与上述语音特征相关联的指定卡通人物形象,若是,则执行步骤306~步骤321,若否,则结束本次流程。305. The tutoring device determines whether a designated cartoon character image associated with the above-mentioned voice feature is pre-stored, and if so, executes
306、家教设备获取指定卡通人物形象匹配的指定卡通人物语音特征。306. The tutoring device acquires the voice feature of the specified cartoon character whose image matches the specified cartoon character.
作为一种可选的实施方式,本发明实施例中,家教设备获取的与上述指定卡通人物形象匹配的指定卡通人物语音特征,包括:As an optional implementation manner, in this embodiment of the present invention, the voice features of the designated cartoon characters that are acquired by the tutoring device and match the above-mentioned designated cartoon characters include:
作为一种可选的实施方式,家教设备可以通过上述指定卡通人物形象发出的卡通经典台词来获取与上述指定卡通人物形象匹配的指定卡通人物语音特征。As an optional implementation manner, the tutoring device may acquire the voice features of the designated cartoon characters that match the designated cartoon characters through the cartoon classic lines uttered by the designated cartoon characters.
作为另一种可选的实施方式,家教设备可以通过上述指定卡通人物形象发出的卡通经典台词来获取与上述指定卡通人物形象匹配的指定卡通人物语音特征。As another optional implementation manner, the tutoring device may acquire the voice features of the designated cartoon characters that match the designated cartoon characters through the cartoon classic lines uttered by the designated cartoon characters.
307、家教设备输出与上述语音特征相关联的指定卡通人物形象。307. The tutoring device outputs a designated cartoon character image associated with the above-mentioned voice feature.
308、家教设备将第一虚拟物加载至已输出的指定卡通人物形象的一个手掌。308. The tutoring device loads the first virtual object into one palm of the outputted designated cartoon character image.
309、家教设备将第二虚拟物加载至已输出的上述指定卡通人物形象的另一手掌。309. The tutoring device loads the second virtual object into the other palm of the outputted designated cartoon character image.
310、家教设备将第一提示信息加载至第一虚拟物,其中,第一提示信息用于提示从相册中选择目标图像。310. The tutoring device loads the first prompt information to the first virtual object, where the first prompt information is used to prompt the selection of the target image from the album.
311、家教设备采用指定卡通人物语音特征对应的卡通语调播放第一提示信息。311. The tutoring device uses the cartoon tone corresponding to the voice feature of the specified cartoon character to play the first prompt message.
作为一种可选的实施方式,本发明实施例中,家教设备可以在用户触及第一虚拟物时,采用指定卡通人物语音特征对应的卡通语调播放第一提示信息。As an optional implementation manner, in this embodiment of the present invention, when the user touches the first virtual object, the tutoring device may play the first prompt information in a cartoon tone corresponding to the voice feature of the specified cartoon character.
或者,家教设备可以在第一提示信息加载完毕至第一虚拟物时,采用指定卡通人物语音特征对应的卡通语调播放第一提示信息。Alternatively, the tutoring device may play the first prompt information in a cartoon tone corresponding to the voice feature of the specified cartoon character when the first prompt information is loaded into the first virtual object.
其中,家教设备通过采用指定卡通人物语音特征对应的卡通语调播放第一提示信息可以使得家教设备的识字学习过程变得更加生动、有趣和精彩,从而提高用户学习的积极性和学习效率。Among them, by using the cartoon tone corresponding to the voice characteristics of the designated cartoon characters to play the first prompt information, the tutoring device can make the literacy learning process of the tutoring device more vivid, interesting and exciting, thereby improving the user's enthusiasm for learning and learning efficiency.
312、家教设备将第二提示信息加载至第二虚拟物,其中,第二提示信息用于提示调用相机拍摄目标图像。312. The tutoring device loads the second prompt information to the second virtual object, where the second prompt information is used to prompt invoking the camera to capture the target image.
313、家教设备采用指定卡通人物语音特征对应的卡通语调播放第二提示信息。313. The tutoring device uses the cartoon intonation corresponding to the voice feature of the specified cartoon character to play the second prompt information.
作为一种可选的实施方式,本发明实施例中,家教设备可以在用户触及第二虚拟物时,采用指定卡通人物语音特征对应的卡通语调播放第二提示信息。As an optional implementation manner, in the embodiment of the present invention, when the user touches the second virtual object, the tutoring device may play the second prompt information in a cartoon tone corresponding to the voice feature of the specified cartoon character.
或者,家教设备可以在第二提示信息加载完毕至第二虚拟物时,采用指定卡通人物语音特征对应的卡通语调播放第二提示信息。Alternatively, the tutoring device may play the second prompt information in a cartoon tone corresponding to the voice feature of the specified cartoon character when the second prompt information is loaded into the second virtual object.
其中,家教设备通过采用指定卡通人物语音特征对应的卡通语调播放第二提示信息可以使得家教设备的识字学习过程变得更加生动、有趣和精彩,从而提高用户学习的积极性和学习效率。Among them, by using the cartoon tone corresponding to the voice feature of the designated cartoon character to play the second prompt information, the tutoring device can make the literacy learning process of the tutoring device more vivid, interesting and exciting, thereby improving the user's learning enthusiasm and learning efficiency.
314、当检测出第一虚拟物被用户触及时,家教设备开启相册;检测从已开启的相册中被选择的至少一张图像,作为目标图像;或者,当检测出第二虚拟物被用户触及时,家教设备调用摄像头执行拍摄,并将摄像头执行拍摄获得的图像,作为目标图像。314. When detecting that the first virtual object is touched by the user, the tutoring device opens the album; detects at least one image selected from the opened album as the target image; or, when detecting that the second virtual object is touched by the user , the tutoring device calls the camera to perform shooting, and uses the image obtained by the camera to perform shooting as the target image.
315、家教设备从目标图像中确定出目标图像中的被指定位置。315. The tutoring device determines the designated position in the target image from the target image.
316、家教设备从目标图像中识别出上述被指定位置附近的若干个候选字。316. The tutoring device identifies several candidate characters near the designated position from the target image.
317、家教设备在显示屏上显示包含上述若干个候选字的候选字列表。317. The tutoring device displays a candidate character list including the above-mentioned several candidate characters on the display screen.
318、家教设备根据输入的选择信息,调整候选字列表中的光标位置。318. The tutoring device adjusts the cursor position in the candidate word list according to the input selection information.
319、当检测到输入的确认信息时,家教设备将光标位置当前所选的候选字作为目标候选字。319. When the input confirmation information is detected, the tutoring device takes the candidate character currently selected by the cursor position as the target candidate character.
320、家教设备搜索与目标候选字相关的学习内容。320. The tutoring device searches for learning content related to the target candidate word.
作为一种可选的实施方式,与目标候选字相关的学习内容可以包括:As an optional implementation manner, the learning content related to the target candidate word may include:
目标候选字的拼音、偏旁部首、笔画和意思解释;Pinyin, radicals, strokes and meaning explanation of the target candidate word;
和/或,目标候选字的近义词、反义词、同义词、例句和用法;and/or, synonyms, antonyms, synonyms, example sentences and usages of the target candidate word;
和/或,目标候选字所对应的英文翻译、例句和用法;And/or, the English translation, example sentences and usage corresponding to the target candidate word;
和/或,所述目标候选字所对应的练习题。and/or, exercises corresponding to the target candidate words.
321、家教设备输出上述学习内容。321. The tutoring device outputs the above learning content.
作为一种可选的实施方式,上述步骤301中,家教设备可以通过有线耳机获取用户输入的语音,即用户可以在佩戴有线耳机时,通过有线耳机配置的麦克风向家教设备输入语音。As an optional implementation manner, in the
相应地,上述步骤321中,家教设备可以通过有线耳机输出上述学习内容对应的音频信号。Correspondingly, in the
更进一步的,家教设备通过有线耳机输出上述学习内容对应的音频信号的过程中,可以通过有线耳机的耳机线上设置的振动传感器监测有线耳机的耳机线是否产生振动信号,若是,判断有线耳机的耳振动信号的强度是否大于预设数值,若大于预设数值,对有线耳机播放的音频信号进行处理。Furthermore, in the process of outputting the audio signal corresponding to the above-mentioned learning content through the wired earphone, the tutoring device can monitor whether the earphone line of the wired earphone generates a vibration signal through the vibration sensor set on the earphone line of the wired earphone. Whether the intensity of the ear vibration signal is greater than the preset value, if it is greater than the preset value, the audio signal played by the wired earphone is processed.
举例来说,家教设备对有线耳机播放的音频信号进行处理可以包括:For example, the processing of the audio signal played by the wired earphone by the tutoring device may include:
计算振动信号的强度占有线耳机播放的音频信号的强度的比例,并按照该比例放大该音频信号。Calculate the ratio of the intensity of the vibration signal to the intensity of the audio signal played by the wired earphone, and amplify the audio signal according to the ratio.
又举例来说,家教设备对有线耳机播放的音频信号进行处理可以包括:For another example, the processing of the audio signal played by the wired headset by the tutoring device may include:
采集由有线耳机播放的音频信号以及振动信号在用户耳道内产生的回声信号;Collect audio signals played by wired headphones and echo signals generated by vibration signals in the user's ear canal;
根据音频信号、振动信号以及回声信号计算脉冲响应;Calculate impulse response from audio signal, vibration signal and echo signal;
判断在预设的时间段内(例如10秒内)的脉冲响应出现的次数是否大于预设数值(例如预设数值为3),如果大于,则计算每相邻两个脉冲响应之间的时间差;判断每相邻两个脉冲响应之间的时间差是否相同例如是否均为1秒),若是,说明振动信号与音频信号在相位上是匹配的,此时用户可能是在打拍子或是随着音频信号一起运动,此时无需放大音频信号,只需要继续播放音频信号即可;若否(例如第一次和第二次间隔3秒,第二次和第三次间隔0.5秒),说明音频信号中有噪声影响,则在音频信号中加入与振动信号相位相反、强度相同的反向噪声信号,从而实现噪声消除。Determine whether the number of impulse responses in a preset time period (for example, within 10 seconds) is greater than the preset value (for example, the preset value is 3), if it is greater, then calculate the time difference between every two adjacent impulse responses ; judge whether the time difference between two adjacent impulse responses is the same, for example, whether they are both 1 second), if so, it means that the vibration signal and the audio signal are matched in phase, and the user may be hitting the beat or following the If the audio signal moves together, there is no need to amplify the audio signal at this time, just continue to play the audio signal; If there is noise in the signal, a reverse noise signal with the opposite phase and the same intensity as the vibration signal is added to the audio signal to eliminate noise.
作为一种可选的实施方式,根据音频信号、振动信号以及回声信号计算脉冲响应,包括:As an optional implementation manner, the impulse response is calculated according to the audio signal, the vibration signal and the echo signal, including:
根据音频信号、振动信号、回声信号以及如下公式,计算脉冲响应:Calculate the impulse response from the audio signal, vibration signal, echo signal, and the following formula:
w(t)=(r(t)-e(t))/(s(t)+z(t));w(t)=(r(t)-e(t))/(s(t)+z(t));
其中,w(t)为脉冲响应,r(t)为回声信号,s(t)为音频信号,z(t)为振动信号;e(t)为噪声参数,包括环境噪声和电路噪声,环境噪声为不播放音频信号时,录音过程中产生的噪声;电路噪声与耳机固有属性相关。Among them, w(t) is the impulse response, r(t) is the echo signal, s(t) is the audio signal, z(t) is the vibration signal; e(t) is the noise parameter, including environmental noise and circuit noise. Noise is the noise generated during the recording process when no audio signal is played; circuit noise is related to the inherent properties of headphones.
本发明实施例中,当用户佩戴有线耳机收听家教设备播放的音频信号时,通常会存在有“听诊器效应”,即有线耳机的耳机线发生晃动和/或摩擦时产生的振动会通过耳机线直接传递到用户耳道内,从而产生让用户很不愉快的声音。因此,实施上述方式可以减少用户佩戴有线耳机收听家教设备播放的音频信号时“听诊器效应”对音频信号的影响,提升用户佩戴有线耳机收听家教设备播放的音频信号时的体验感。In this embodiment of the present invention, when a user wears a wired earphone to listen to the audio signal played by the tutoring device, there is usually a "stethoscope effect", that is, the vibration generated when the earphone cable of the wired earphone shakes and/or rubs will directly pass through the earphone cable. It is transmitted into the user's ear canal, resulting in a very unpleasant sound for the user. Therefore, implementing the above manner can reduce the influence of the "stethoscope effect" on the audio signal when the user wears wired earphones to listen to the audio signal played by the tutoring device, and improves the user's experience when wearing the wired earphone to listen to the audio signal played by the tutoring device.
可见,实施图3所描述的另一种学习内容搜索方法,当家教设备中存在有预存储的与上述语音特征相关联的指定卡通人物形象时,家教设备则会获取该指定卡通人物形象匹配的指定卡通人物语音特征,且在家教设备将提示信息加载至虚拟物之后,家教设备则会采用指定卡通人物语音特征对应的卡通语调播放提示信息,而这一过程不仅可以有效的避免家教设备获取错误的卡通人物的语音特征的情况发生,且让家教设备的识字学习过程变得更加生动、有趣和精彩,从而提高用户学习的积极性和学习效率,还能够精确的识别出用户所指示的某一字,提高与该字相关的学习内容搜索的精确性。Visible, implement another kind of learning content search method described in Figure 3, when there is a pre-stored designated cartoon character image associated with the above-mentioned voice feature in the tutoring equipment, the tutoring equipment will obtain the matching of the designated cartoon character image. Specify the voice characteristics of cartoon characters, and after the home teaching device loads the prompt information into the virtual object, the home teaching device will play the prompt information in the cartoon tone corresponding to the voice characteristics of the specified cartoon characters, and this process can not only effectively prevent the home teaching device from obtaining errors It makes the literacy learning process of the tutoring equipment more vivid, interesting and exciting, so as to improve the user's enthusiasm and learning efficiency, and can accurately identify a word indicated by the user. , to improve the accuracy of learning content searches related to the word.
实施例四Embodiment 4
请参阅图4,图4是本发明实施例公开的一种家教设备的结构示意图。如图1所示,该家教设备400可以包括第一识别单元401、第一确定单元402、第二识别单元403、显示单元404、调整单元405、第二确定单元406、搜索单元407、输出单元408,其中:Please refer to FIG. 4 , which is a schematic structural diagram of a family education device disclosed in an embodiment of the present invention. As shown in FIG. 1 , the
第一识别单元401,用于根据用户输入的语音识别出用户意图。The
第一确定单元402,用于在用户意图为识字时,从拍摄得到的目标图像中确定图像中的被指定位置。The first determining
第二识别单元403,用于从目标图像中识别出被指定位置附近的若干个候选字。The second identifying
显示单元404,用于在显示屏上显示包含若干个候选字的候选字列表。The
调整单元405,用于根据输入的选择信息,调整候选字列表中的光标位置。The
第二确定单元406,用于当检测到输入的确认信息时,将光标位置当前所选的候选字作为目标候选字。The second determining
搜索单元407,用于搜索与目标候选字相关的学习内容。The
输出单元408,用于输出上述学习内容。The
可见,实施图4所描述的家教设备,该设备能够精确的识别出用户所指示的某一字,提高与该字相关的学习内容搜索的精确性。It can be seen that, by implementing the tutoring device described in FIG. 4 , the device can accurately identify a certain word indicated by the user, and improve the accuracy of searching for the learning content related to the word.
实施例五Embodiment 5
请参阅图5,图5是本发明实施例公开的另一种家教设备的结构示意图。其中,图5所示的家教设备是由图4所示的家教设备进行优化得到的。与图4所示的家教设备相比较,图5所示的家教设备还可以包括:Please refer to FIG. 5. FIG. 5 is a schematic structural diagram of another tutoring device disclosed in an embodiment of the present invention. The home teaching device shown in FIG. 5 is obtained by optimizing the home teaching device shown in FIG. 4 . Compared with the tutoring device shown in FIG. 4 , the tutoring device illustrated in FIG. 5 may further include:
检测单元409,用于检测家教设备当前是否进入学习模式。The
第一判断单元410,用于判断用户意图识别功能是否被唤醒。The
第一获取单元411,用于获取用户输入的语音。The first obtaining
相应地,家教设备可以在家教设备当前已进入学习模式且家教设备的用户意图识别功能被唤醒之后,通过第一识别单元401对由第一获取单元411获取到的语音进行识别,从而识别出该用户的意图。Correspondingly, the tutoring device can recognize the voice acquired by the first acquiring
第二判断单元412,用于判断识别出的用户意图是否为识字。The
作为一种可选的实施方式,在图5所示的家教设备中,家教设备可以通过第二判断单元412识别用户输入的语音中是否存在与识字意图相关的预设关键词,例如“什么字”、“怎么写”“怎么读”、“怎么念”或“什么意思”等,若存在,则判断出该用户意图为识字。As an optional implementation manner, in the tutoring device shown in FIG. 5 , the tutoring device can use the
作为一种可选的实施方式,在图5所示的家教设备中,第一确定单元402包括:As an optional implementation manner, in the tutoring device shown in FIG. 5 , the first determining
第一识别子单元4021,用于根据语音识别出语音对应的语音特征。The
作为一种可选的实施方式,在图5所示的家教设备中,家教设备通过第一识别子单元4021根据上述语音识别出上述语音对应的语音特征,包括:As an optional implementation manner, in the tutoring device shown in FIG. 5 , the tutoring device recognizes the voice feature corresponding to the above-mentioned voice according to the above-mentioned voice through the
用户发出的对卡通人物名称的称呼方式;The way the user calls the cartoon character's name;
和/或,用户发出的与卡通人物有关的经典台词;and/or, classic lines related to cartoon characters uttered by users;
和/或,用户发出的与卡通人物有关的语气词;and/or, mood words related to cartoon characters uttered by users;
和/或,用户发出的与卡通人物有关的语调。And/or, the tone of voice spoken by the user in relation to the cartoon character.
判断子单元4022,用于判断是否预存储有与语音特征相关联的指定卡通人物形象。The
输出子单元4023,用于在判断子单元判断出预存储有与语音特征相关联的指定卡通人物形象时,输出指定卡通人物形象。The
作为一种可选的实施方式,在图5所示的家教设备中,家教设备可以通过输出子单元4023输出与上述语音特征相关联的指定卡通人物形象,且该指定卡通人物形象伴随着其经典的出场方式显示在家教设备显示屏上,使上述指定卡通人物形象伴随着其经典的出场方式出现在家教设备的显示屏上。As an optional implementation manner, in the tutoring device shown in FIG. 5 , the tutoring device can output a designated cartoon character image associated with the above-mentioned voice feature through the
和/或,家教设备可以通过输出子单元4023输出与上述语音特征相关联的指定卡通人物形象的经典台词,使上述指定卡通人物形象伴随着其经典的台词出现在家教设备的显示屏上。And/or, the tutoring device can output the classic lines of the designated cartoon character associated with the above-mentioned voice feature through the
和/或,家教设备可以通过输出子单元4023输出与上述语音特征相关联的指定卡通人物形象的经典语调,使上述指定卡通人物形象伴随着其经典的台词出现在家教设备的显示屏上。And/or, the tutoring device can output the classic intonation of the designated cartoon character associated with the above-mentioned voice feature through the
和/或,家教设备可以通过输出子单元4023输出与上述语音特征相关联的指定卡通人物形象的经典语气词,使上述指定卡通人物形象伴随着其经典的台词出现在家教设备的显示屏上。And/or, the tutoring device can output the classical modal particles of the designated cartoon character associated with the above-mentioned voice feature through the
作为一种可选的实施方式,在图5所示的家教设备中,家教设备通过输出子单元4023输出与上述语音特征相关联的指定卡通人物形象,使整个家教设备的识字学习变得更加的生动、有趣和精彩,从而提高了用户学习的积极性和学习效率。As an optional implementation manner, in the tutoring device shown in FIG. 5 , the tutoring device outputs the specified cartoon characters associated with the above-mentioned voice features through the
第一加载子单元4024,用于将第一虚拟物加载至已输出的指定卡通人物形象的一个手掌,以及将第二虚拟物加载至已输出的指定卡通人物形象的另一手掌。The
作为一种可选的实施方式,在图5所示的家教设备中,家教设备加载的第一虚拟物和第二虚拟物可以是指定卡通人物形象的经典必备物品,例如,指定卡通人物形象如果为“《喜羊羊与灰太狼》中的红太狼”,则第一虚拟物可以显示为“红太狼的平底锅”,第二虚拟物可以显示为“红太狼的皇冠”。As an optional implementation manner, in the tutoring device shown in FIG. 5 , the first virtual object and the second virtual object loaded by the tutoring device may be classic necessary items for specifying cartoon characters, for example, specifying cartoon characters If it is "Red Wolf in "Pleasant Goat and Big Big Wolf", the first virtual object can be displayed as "Red Wolf's pan", and the second virtual object can be displayed as "Red Wolf's crown".
或者,家教设备加载的第一虚拟物可以是相册图案标志,第二虚拟物可以是相机图案标志,该相册和相机图案标志可以直接作为一个提示信息,该提示信息是用户选择触及的虚拟物信息,以便用户作出选择。Alternatively, the first virtual object loaded by the tutoring device may be an album pattern mark, and the second virtual object may be a camera pattern mark. The album and camera pattern mark may be directly used as prompt information, and the prompt information is the virtual object information that the user chooses to touch. , so that the user can make a choice.
第二加载子单元4025,用于将第一提示信息加载至第一虚拟物,第一提示信息用于提示从相册中选择目标图像;将第二提示信息加载至第二虚拟物,第二提示信息用于提示调用相机拍摄目标图像。The
作为一种可选的实施方式,在图5所示的家教设备中,家教设备可以将提示信息以文字方式直接把提示信息内容显示在虚拟物上面,使用户可以直接通过虚拟物上面的提示信息内容进行选择。As an optional implementation, in the tutoring device shown in FIG. 5 , the tutoring device can directly display the prompt information on the virtual object in the form of text, so that the user can directly pass the prompt information on the virtual object. content to select.
和/或,家教设备可以将提示信息以隐藏方式隐藏在虚拟物上面,只有用户在触及虚拟物时,提示信息才会浮现在虚拟物上面。And/or, the tutoring device can hide the prompt information on the virtual object in a hidden manner, and the prompt information will appear on the virtual object only when the user touches the virtual object.
和/或,家教设备可以在用户触及虚拟物时,将提示信息的内容以指定卡通人物形象的经典语调播放出来。And/or, when the user touches the virtual object, the tutoring device can play the content of the prompt information in a classic tone of a designated cartoon character.
第一确定子单元4026,用于当检测出第一虚拟物被用户触及时,开启相册,并检测从已开启的相册中被选择的至少一张图像,作为目标图像;或者,用于当检测出第二虚拟物被用户触及时,调用摄像头执行拍摄,并将摄像头执行拍摄获得的图像,作为目标图像。The
第二确定子单元4027,用于从目标图像中确定出目标图像中的被指定位置。The
作为一种可选的实施方式,在图5所示的家教设备中,第二识别单元403包括:As an optional implementation manner, in the tutoring device shown in FIG. 5 , the
第三确定子单元4031,用于从目标图像中确定出以指定位置设为圆心以及以预设数量的字排列时所占的区域长度为半径的圆形区域;或者,用于从目标图像中确定出以指定位置设为对角线交叉点以及以预设数量的字排列时所占的区域长度为对角线长度的矩形区域。The
第二识别子单元4032,用于识别出位于圆形区域内的若干个字,作为被指定位置附近的若干个候选字;或者,用于识别出位于矩形区域内的若干个字,作为被指定位置附近的若干个候选字。The
作为一种可选的实施方式,在图5所示的家教设备中,用户可以采用账号(如社交账号)登陆家教设备,并且在家教设备输出上述学习内容之后,用户可以通过该账号实现与他人进行学习交流,从而提高用户学习的积极性和学习效率。As an optional embodiment, in the tutoring device shown in FIG. 5 , the user can log in to the tutoring device with an account (such as a social account), and after the tutoring device outputs the above learning content, the user can communicate with others through the account. Carry out learning exchanges, thereby improving users' enthusiasm for learning and learning efficiency.
作为一种可选的实施方式,在图5所示的家教设备中,家教设备在输出上述学习内容给用户之后,还可以将该目标候选字和用户的身份信息上报给该用户对应的教师终端,让教师终端所属教师获悉用户哪一些字对于用户而言是陌生的或者是尚未掌握的,以便于教师可以对该用户进行针对性的加以辅导。As an optional implementation manner, in the tutoring device shown in FIG. 5 , after outputting the above learning content to the user, the tutoring device can also report the target candidate word and the user's identity information to the teacher terminal corresponding to the user , so that the teacher to which the teacher terminal belongs can learn which words of the user are unfamiliar or unfamiliar to the user, so that the teacher can provide targeted guidance to the user.
作为一种可选的实施方式,在图5所示的家教设备中,家教设备在输出上述学习内容给用户之后,还可以将该目标候选字和与目标候选字相关的学习内容通过中间服务器(如社交服务器)发送给用户选择的好友账号,以增加用户与好友之间在学习上的交流,以便提高用户学习的积极性。其中,家教设备可以向用户提供用户用于登陆家教设备的账号的关系用户链,以便于用户可以从该关系用户链中选择好友账号。As an optional implementation manner, in the tutoring device shown in FIG. 5 , after outputting the above learning content to the user, the tutoring device can also pass the target candidate word and the learning content related to the target candidate word through an intermediate server ( Such as a social server) sent to the user's selected friend account, in order to increase the communication between the user and the friend in learning, so as to improve the user's enthusiasm for learning. The tutoring device may provide the user with a relational user chain of the account that the user uses to log in to the tutoring appliance, so that the user can select a friend account from the relational user chain.
作为一种可选的实施方式,在图5所示的家教设备中,家教设备在输出上述学习内容给用户之后,还可以将该目标候选字上报给中间服务器(如社交服务器),而中间服务器(如社交服务器)可以根据该目标候选字,查询已上报过该目标候选字的其他用户的账号,并将其他用户的账号推荐给家教设备,这样用户不仅可以结识更多的好友,还能与其他用户进行学习方法经验的交流,这有助于提高用户学习的积极性。As an optional implementation, in the tutoring device shown in FIG. 5 , after outputting the above learning content to the user, the tutoring device can also report the target candidate word to an intermediate server (such as a social server), and the intermediate server can (such as a social server) can query the accounts of other users who have reported the target candidate word according to the target candidate word, and recommend the accounts of other users to the tutoring device, so that the user can not only meet more friends, but also communicate with Other users exchange learning methods and experiences, which helps to improve users' enthusiasm for learning.
作为一种可选的实施方式,在图5所示的家教设备中,家教设备在输出上述学习内容给用户之后,用户可以通过游戏的方式加深对不认识的字对应的学习内容的掌握程度,以便提高用户学习的积极性。As an optional embodiment, in the tutoring device shown in FIG. 5 , after the tutoring device outputs the above-mentioned learning content to the user, the user can deepen the degree of mastery of the learning content corresponding to the unknown word through games, In order to improve the enthusiasm of users to learn.
可见,实施图5所描述的家教设备,当家教设备判断出用户意图为识字时,家教设备通过识别用户输入的语音得到该语音对应的语音特征,在家教设备中存在有上述语音特征相关联的指定卡通人物形象时,家教设备则会输出与上述语音特征相关联的指定卡通人物形象,并将第一虚拟物和第一提示信息以及第二虚拟物和第二提示信息加载至用户手掌中,其中,第一提示信息用于提示从相册中选择目标图像,第二提示信息用于提示调用相机拍摄目标图像。当检测出第一虚拟物被用户触及时,家教设备开启相册;检测从已开启的相册中被选择的至少一张图像,作为目标图像;或者,当检测出第二虚拟物被用户触及时,家教设备调用摄像头执行拍摄,并将摄像头执行拍摄获得的图像,作为目标图像。这一过程不仅可以在家教设备上输出指定卡通人物形象,使家教设备的识字学习过程变得更加生动、有趣和精彩,从而提高用户学习的积极性和学习效率,还可以精确的识别出用户所指示的某一字,提高与该字相关的学习内容搜索的精确性。It can be seen that, implementing the tutoring device described in Fig. 5, when the tutoring device judges that the user's intention is literacy, the tutoring device obtains the corresponding voice feature of the voice by recognizing the voice input by the user, and the tutoring device has the associated voice feature in the tutoring device. When specifying a cartoon character, the tutoring device will output the specified cartoon character associated with the above-mentioned voice feature, and load the first virtual object and the first prompt information and the second virtual object and the second prompt information into the palm of the user, Wherein, the first prompt information is used for prompting to select the target image from the album, and the second prompt information is used for prompting calling the camera to shoot the target image. When detecting that the first virtual object is touched by the user, the tutoring device opens the album; detects at least one image selected from the opened album as the target image; or, when detecting that the second virtual object is touched by the user, The tutoring device calls the camera to perform shooting, and uses the image obtained by the camera to perform the shooting as the target image. This process can not only output the specified cartoon character image on the home teaching device, make the literacy learning process of the home teaching device more vivid, interesting and exciting, thereby improving the user's enthusiasm for learning and learning efficiency, but also can accurately identify the user's instruction. to improve the search accuracy of learning content related to the word.
实施例六Embodiment 6
请参阅图6,图6是本发明实施例公开的另一种家教设备的结构示意图。其中,图6所示的家教设备是由图5所示的家教设备进行优化得到的。与图5所示的家教设备相比较,图6所示的家教设备还可以包括:Please refer to FIG. 6. FIG. 6 is a schematic structural diagram of another tutoring device disclosed in an embodiment of the present invention. The home teaching device shown in FIG. 6 is obtained by optimizing the home teaching device shown in FIG. 5 . Compared with the tutoring device shown in FIG. 5 , the tutoring device illustrated in FIG. 6 may further include:
第二获取单元413,用于在判断子单元4022判断出预存储有与语音特征相关联的指定卡通人物形象之后,获取指定卡通人物形象匹配的指定卡通人物语音特征。The second obtaining
作为一种可选的实施方式,在图6所示的家教设备中,家教设备通过第二获取单元413获取的与上述指定卡通人物形象匹配的指定卡通人物语音特征,包括:As an optional implementation manner, in the tutoring device shown in FIG. 6 , the voice features of the designated cartoon characters that are acquired by the tutoring device through the second obtaining
该指定卡通人物对应的卡通语调;The cartoon intonation corresponding to the designated cartoon character;
和/或,该指定卡通人物对应的卡通语气词;And/or, the cartoon modal particle corresponding to the designated cartoon character;
和/或,该指定卡通人物对应的卡通经典台词。And/or, the cartoon classic lines corresponding to the designated cartoon character.
作为一种可选的实施方式,家教设备所获取的语音特征是家教设备中与用户的语音特征匹配的预存储的指定卡通人物的语音特征,这一过程可以有效的避免家教设备获取错误的卡通人物的语音特征的情况发生。As an optional implementation manner, the voice feature acquired by the tutoring device is the voice feature of a pre-stored designated cartoon character matching the voice feature of the user in the tutoring device. This process can effectively prevent the tutoring device from acquiring wrong cartoon characters. This happens in the case of the character's voice characteristics.
播放单元414,用于在第二加载子单元4025将第一提示信息加载至第一虚拟物之后,采用指定卡通人物语音特征对应的卡通语调播放第一提示信息。The
作为一种可选的实施方式,在图6所示的家教设备,播放单元414还用于在第二加载子单元4025将第二提示信息加载至第二虚拟物之后,采用指定卡通人物语音特征对应的卡通语调播放第二提示信息。As an optional implementation manner, in the tutoring device shown in FIG. 6 , the
作为一种可选的实施方式,在图6所示的家教设备,家教设备可以在用户触及虚拟物时,将提示信息的内容以指定卡通人物语音特征对应的卡通语调播放出来。As an optional embodiment, in the tutoring device shown in FIG. 6 , the tutoring device can play the content of the prompt information in a cartoon tone corresponding to the voice characteristics of the designated cartoon characters when the user touches the virtual object.
和/或,家教设备可以在提示信息加载至虚拟物时,将提示信息的内容以指定卡通人物语音特征对应的卡通语调播放出来。And/or, when the prompt information is loaded into the virtual object, the tutoring device may play the content of the prompt information in a cartoon tone corresponding to the voice feature of the specified cartoon character.
作为一种可选的实施方式,家教设备通过采用指定卡通人物语音特征对应的卡通语调播放提示信息,这一过程可以使得家教设备的识字学习过程变得更加生动、有趣和精彩,从而提高用户学习的积极性和学习效率。As an optional implementation, the tutoring device plays the prompt information by using the cartoon tone corresponding to the voice characteristics of the designated cartoon characters. This process can make the literacy learning process of the tutoring device more vivid, interesting and exciting, thereby improving user learning. motivation and learning efficiency.
可见,实施图6所描述的家教设备,当家教设备中存在有预存储的与上述语音特征相关联的指定卡通人物形象时,家教设备则会获取该指定卡通人物形象匹配的指定卡通人物语音特征,且在家教设备将提示信息加载至虚拟物之后,家教设备则会采用指定卡通人物语音特征对应的卡通语调播放提示信息,而这一过程不仅可以有效的避免家教设备获取错误的卡通人物的语音特征的情况发生,且让家教设备的识字学习过程变得更加生动、有趣和精彩,从而提高用户学习的积极性和学习效率,还能够精确的识别出用户所指示的某一字,提高与该字相关的学习内容搜索的精确性。As can be seen, implement the tutoring equipment described in Figure 6, when there is a pre-stored designated cartoon character image associated with the above-mentioned voice feature in the tutoring equipment, the tutoring equipment will obtain the designated cartoon character voice feature that the designated cartoon character image matches. , and after the home teaching device loads the prompt information into the virtual object, the home teaching device will use the cartoon tone corresponding to the voice characteristics of the specified cartoon characters to play the prompt information, and this process can not only effectively prevent the home teaching device from obtaining the wrong cartoon characters' voices It makes the literacy learning process of the tutoring equipment more vivid, interesting and exciting, thereby improving the user's enthusiasm for learning and learning efficiency, and can also accurately identify a word indicated by the user, improve the relationship with the word. The accuracy of relevant learning content searches.
实施例七Embodiment 7
请参阅图7,图7是本发明实施例公开的另一种家教设备的结构示意图。如图7所示,该家教设备可以包括:Please refer to FIG. 7. FIG. 7 is a schematic structural diagram of another tutoring device disclosed in an embodiment of the present invention. As shown in Figure 7, the tutoring equipment may include:
存储有可执行程序代码的存储器701;a
与存储器701耦合的处理器702;a
其中,处理器702调用存储器701中存储的可执行程序代码,执行图1~图3任意一种学习内容搜索方法方法。The
本发明实施例公开一种计算机可读存储介质,其存储计算机程序,其中,该计算机程序使得计算机执行图1~图3任意一种学习内容搜索方法。An embodiment of the present invention discloses a computer-readable storage medium, which stores a computer program, wherein the computer program causes a computer to execute any one of the learning content search methods shown in FIGS. 1 to 3 .
本发明实施例还公开一种计算机程序产品,其中,当计算机程序产品在计算机上运行时,使得计算机执行如以上各方法实施例中的学习内容搜索方法的部分或全部步骤。The embodiment of the present invention also discloses a computer program product, wherein when the computer program product runs on the computer, the computer is made to execute some or all of the steps of the learning content search method in the above method embodiments.
本领域普通技术人员可以理解上述实施例的各种方法中的全部或部分步骤是可以通过程序来指令相关的硬件来完成,该程序可以存储于一计算机可读存储介质中,存储介质包括只读存储器(Read-Only Memory,ROM)、随机存储器(Random Access Memory,RAM)、可编程只读存储器(Programmable Read-only Memory,PROM)、可擦除可编程只读存储器(Erasable Programmable Read Only Memory,EPROM)、一次可编程只读存储器(One-time Programmable Read-Only Memory,OTPROM)、电子抹除式可复写只读存储器(Electrically-Erasable Programmable Read-Only Memory,EEPROM)、只读光盘(CompactDisc Read-Only Memory,CD-ROM)或其他光盘存储器、磁盘存储器、磁带存储器、或者能够用于携带或存储数据的计算机可读的任何其他介质。Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing relevant hardware through a program, and the program can be stored in a computer-readable storage medium, and the storage medium includes a read-only storage medium. Memory (Read-Only Memory, ROM), Random Access Memory (Random Access Memory, RAM), Programmable Read-only Memory (PROM), Erasable Programmable Read Only Memory (Erasable Programmable Read Only Memory, EPROM), One-time Programmable Read-Only Memory (OTPROM), Electronically-Erasable Programmable Read-Only Memory (EEPROM), CompactDisc Read -Only Memory, CD-ROM) or other optical disk storage, magnetic disk storage, magnetic tape storage, or any other computer-readable medium that can be used to carry or store data.
以上对本发明实施例公开的一种学习内容搜索方法及家教设备进行了详细介绍,本文中应用了具体个例对本发明的原理及实施方式进行了阐述,以上实施例的说明只是用于帮助理解本发明的方法及其核心思想;同时,对于本领域的一般技术人员,依据本发明的思想,在具体实施方式及应用范围上均会有改变之处,综所述上,本说明书内容不应理解为对本发明的限制。A learning content search method and a tutoring device disclosed in the embodiments of the present invention are described above in detail. The principles and implementations of the present invention are described with specific examples in this paper. The method of the invention and its core idea; at the same time, for those of ordinary skill in the art, according to the idea of the present invention, there will be changes in the specific implementation and application scope. To sum up, the content of this description should not be understood to limit the present invention.
Claims (10)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910119150.7A CN111026837B (en) | 2019-02-18 | 2019-02-18 | Learning content searching method and family education equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910119150.7A CN111026837B (en) | 2019-02-18 | 2019-02-18 | Learning content searching method and family education equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111026837A CN111026837A (en) | 2020-04-17 |
| CN111026837B true CN111026837B (en) | 2022-08-26 |
Family
ID=70203441
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910119150.7A Active CN111026837B (en) | 2019-02-18 | 2019-02-18 | Learning content searching method and family education equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111026837B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114973804B (en) * | 2022-03-30 | 2025-07-08 | 黎本佳 | Text learning method based on scanning pen |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104253904A (en) * | 2014-09-04 | 2014-12-31 | 广东小天才科技有限公司 | Method for realizing point-reading learning and smart phone |
| CN108038485A (en) * | 2017-11-30 | 2018-05-15 | 广东小天才科技有限公司 | Learning content searching method and electronic equipment |
| CN108121790A (en) * | 2017-12-19 | 2018-06-05 | 百度在线网络技术(北京)有限公司 | Chinese character by words querying method, device, server, equipment and storage medium |
| CN108763552A (en) * | 2018-06-01 | 2018-11-06 | 广东小天才科技有限公司 | Family education machine and learning method based on same |
| CN108874469A (en) * | 2018-07-16 | 2018-11-23 | 广东小天才科技有限公司 | Application control method of family education equipment and family education equipment |
| CN109035919A (en) * | 2018-08-31 | 2018-12-18 | 广东小天才科技有限公司 | Intelligent device and system for assisting user in solving problems |
| CN109241244A (en) * | 2018-08-31 | 2019-01-18 | 广东小天才科技有限公司 | Interaction method, intelligent device and system for assisting user in solving problems |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107210036B (en) * | 2015-02-03 | 2021-02-26 | 杜比实验室特许公司 | Meeting word cloud |
-
2019
- 2019-02-18 CN CN201910119150.7A patent/CN111026837B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104253904A (en) * | 2014-09-04 | 2014-12-31 | 广东小天才科技有限公司 | Method for realizing point-reading learning and smart phone |
| CN108038485A (en) * | 2017-11-30 | 2018-05-15 | 广东小天才科技有限公司 | Learning content searching method and electronic equipment |
| CN108121790A (en) * | 2017-12-19 | 2018-06-05 | 百度在线网络技术(北京)有限公司 | Chinese character by words querying method, device, server, equipment and storage medium |
| CN108763552A (en) * | 2018-06-01 | 2018-11-06 | 广东小天才科技有限公司 | Family education machine and learning method based on same |
| CN108874469A (en) * | 2018-07-16 | 2018-11-23 | 广东小天才科技有限公司 | Application control method of family education equipment and family education equipment |
| CN109035919A (en) * | 2018-08-31 | 2018-12-18 | 广东小天才科技有限公司 | Intelligent device and system for assisting user in solving problems |
| CN109241244A (en) * | 2018-08-31 | 2019-01-18 | 广东小天才科技有限公司 | Interaction method, intelligent device and system for assisting user in solving problems |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111026837A (en) | 2020-04-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109635096B (en) | Dictation prompting method and electronic equipment | |
| US20200175890A1 (en) | Device, method, and graphical user interface for a group reading environment | |
| US8203528B2 (en) | Motion activated user interface for mobile communications device | |
| TWI554984B (en) | Electronic device | |
| US20140315163A1 (en) | Device, method, and graphical user interface for a group reading environment | |
| CN108763552B (en) | Family education machine and learning method based on same | |
| CN111128254B (en) | Audio playing method, electronic equipment and storage medium | |
| CN111899576A (en) | Control method and device for pronunciation test application, storage medium and electronic equipment | |
| JP5586754B1 (en) | Information processing apparatus, control method therefor, and computer program | |
| CN108039180B (en) | A method and microphone device for learning the results of children's language expression practice | |
| CN111077996A (en) | A point-based information recommendation method and learning device | |
| WO2017020593A1 (en) | Input method and apparatus | |
| CN111026837B (en) | Learning content searching method and family education equipment | |
| CN112165627A (en) | Information processing method, device, storage medium, terminal and system | |
| CN108986796A (en) | Voice search method and device | |
| CN109712443A (en) | A kind of content is with reading method, apparatus, storage medium and electronic equipment | |
| CN110992928A (en) | Audio processing method and terminal device | |
| KR20010000156A (en) | Method for studying english by constituent using internet | |
| CN111091821B (en) | Control method based on voice recognition and terminal equipment | |
| JP2023136688A (en) | Correctness determination method, information processing device, and program | |
| JP7581696B2 (en) | Information processing device, control method, and program | |
| CN108962218A (en) | A kind of word pronunciation method and apparatus | |
| Fang et al. | Knock knock: A children-oriented vocabulary learning tangible user interaction system | |
| CN111081227A (en) | Recognition method of dictation content and electronic equipment | |
| CN112541651B (en) | Electronic device, pronunciation learning method, server device, pronunciation learning processing system and recording medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |