CN109800297A - Learning auxiliary method based on learning equipment and learning equipment - Google Patents
Learning auxiliary method based on learning equipment and learning equipment Download PDFInfo
- Publication number
- CN109800297A CN109800297A CN201910061523.XA CN201910061523A CN109800297A CN 109800297 A CN109800297 A CN 109800297A CN 201910061523 A CN201910061523 A CN 201910061523A CN 109800297 A CN109800297 A CN 109800297A
- Authority
- CN
- China
- Prior art keywords
- content
- study
- user
- facility
- page
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The embodiment of the invention discloses a learning auxiliary method based on learning equipment and the learning equipment, wherein the method comprises the following steps: detecting voice search messages input by student users, and identifying search intentions of the student users from the voice search messages; shooting a current page of the exercise book to obtain a page image, and identifying the designated coordinates of the student user on the current page from the page image; detecting whether a writing trace exists in a specific range of a specified coordinate from a page image; if the search intention exists, identifying the content corresponding to the specified coordinates in the page image by taking the search intention as a basis to obtain the content to be searched; searching and outputting the push content matched with the content to be searched; the content to be searched can be acquired by combining voice and photographing, and the content to be searched is searched after the student user independently thinks about the content to be searched, so that good learning habits of the student user are developed, and the learning effect is improved.
Description
Technical field
The present invention relates to facility for study technical fields, and in particular to a kind of study householder method and based on facility for study
Practise equipment.
Background technique
Facility for study on the market can provide many booster actions for the study of User, especially in User
When encountering problems, Most students user selection gets answer by way of searching topic online.Wherein, existing to search topic mode
It mainly by voice input mode, input mode of taking pictures or is manually entered mode problem is input to facility for study, then
Corresponding answer is searched for by facility for study.However, for fraction User, it is possible they autonomous control ability compared with
Weak, sometimes in order to go out to play after fulfiling assignment as early as possible, there are no the thinking of oneself is carried out to operation topic with regard to direct
Answer is obtained by searching for, positive effect is not played not only to the study raising of User, instead they are formed
Undesirable study habit influences itself study development.
Summary of the invention
The embodiment of the invention discloses a kind of study householder method and facility for study based on facility for study, can help to learn
Raw user picks up good habits of study, and improves learning effect.
First aspect present invention discloses a kind of study householder method based on facility for study, it may include:
The phonetic search message of User input is detected, and identifies the User from the phonetic search message
Search intention；And
The current page of exercise-book is shot to obtain page-images, and identifies the User from the page-images
Specified coordinate on the current page；
It whether there is written trace out of particular range that detect the specified coordinate in the page-images；
If it does, being intended to foundation with described search, identify that specified coordinate described in the page-images is corresponding interior
Hold to obtain content to be searched；
It searches for the push content to match with the content to be searched and exports.
As an alternative embodiment, in first aspect present invention, the method also includes:
When the written trace being not present in the particular range of the specified coordinate, prompting message, the prompt are exported
Message is for prompting the User first to be answered.
As an alternative embodiment, in first aspect present invention, the current page of the shooting exercise-book with
Page-images are obtained, and from specified coordinate of the User on the current page is identified in the page-images, are wrapped
It includes:
By being set to the facility for study and being equipped with the camera of reflective mirror to being placed in the specific of the camera outside
The current page of the exercise-book in shooting area carries out shooting preview, and is detecting that the User existed by finger
When specified operation on the current page, controls the camera and shoot the current page and obtain page-images, and according to
The specified operation identifies specified coordinate of the User on the current page in the page-images.
As an alternative embodiment, in first aspect present invention, described search and the content phase to be searched
Before matched push content and output, the method also includes:
Vocal print feature is extracted from the phonetic search message；
The age information of the User is identified according to the vocal print feature；
Grade's information of the User is determined according to the age information；
Push content that described search matches with the content to be searched simultaneously exports, comprising:
Based on grade's information, searches for the push content to match with the content to be searched and export.
As an alternative embodiment, in first aspect present invention, the method also includes:
If there are the written traces in the particular range of the specified coordinate, from the page-images described in identification
The corresponding written contents of written trace；
Push content that described search matches with the content to be searched simultaneously exports, comprising:
The push content that search matches with the content to be searched；
Judge whether the written contents match with the push content；
If it does, exporting prompt information in the facility for study, the prompt information is for prompting the User
The written contents are correct content and ask whether to need further to export the push content；And receiving the student
When the confirmation that user inputs in the facility for study needs to export the push content the facility for study output described in push away
Send content；
If mismatched, the push content is exported in the facility for study.
Second aspect of the present invention discloses a kind of facility for study, it may include:
Speech detection unit, for detecting the phonetic search message of User input, and from the phonetic search message
The search intention of the middle identification User；
Shooting unit for shooting the current page of exercise-book to obtain page-images, and is known from the page-images
Specified coordinate of the not described User on the current page；
Write detection unit, for whether there is out of particular range that detect the specified coordinate in the page-images
Written trace；
Content recognition unit, for existing in the particular range that the write detection unit detects the specified coordinate
When written trace, foundation is intended to described search, identifies the corresponding content of specified coordinate described in the page-images to obtain
Obtain content to be searched；
Search unit, for searching for the push content to match with the content to be searched and exporting.
As an alternative embodiment, in second aspect of the present invention, the facility for study further include:
Reminding unit, for institute to be not present in the particular range that the write detection unit detects the specified coordinate
When stating written trace, prompting message is exported, the prompting message is for prompting the User first to be answered.
As an alternative embodiment, in second aspect of the present invention, the shooting unit, specifically for by setting
It is placed in the facility for study and is equipped with the camera of reflective mirror to the institute in the specific shooting area for being placed in the camera outside
The current page for stating exercise-book carries out shooting preview, and is detecting the User by finger on the current page
Specified operation when, control the camera and shoot the current page and obtain page-images, and existed according to the specified operation
Specified coordinate of the User on the current page is identified in the page-images.
As an alternative embodiment, in second aspect of the present invention, the facility for study further include:
User identification unit, the push content for matching in described search unit searches and the content to be searched is simultaneously
Before output, vocal print feature is extracted from the phonetic search message；And identify that the student uses according to the vocal print feature
The age information at family；And grade's information of the User is determined according to the age information；
The mode that described search unit is used to search for the push content to match with the content to be searched and export is specific
Are as follows:
Described search unit is searched in the push to match with the content to be searched for being based on grade's information
Hold and exports.
As an alternative embodiment, in second aspect of the present invention, the content recognition unit is also used in institute
Write detection unit is stated to detect in the particular range of the specified coordinate there are when the written trace, from the page-images
It is middle to identify the corresponding written contents of the written trace；
The mode that described search unit is used to search for the push content to match with the content to be searched and export is specific
Are as follows:
Described search unit, for searching for the push content to match with the content to be searched；And judge the book
Write whether content matches with the push content；And in matching, prompt information is exported in the facility for study, it is described
Prompt information is for prompting written contents described in the User as correct content and asking whether to need further to export institute
State push content；And it needs to export in the push receiving the confirmation that the User inputs in the facility for study
The push content is exported in the facility for study when appearance；And when mismatching, the push is exported in the facility for study
Content.
Third aspect present invention discloses a kind of facility for study, it may include:
It is stored with the memory of executable program code；
The processor coupled with the memory；
The processor calls the executable program code stored in the memory, executes the embodiment of the present invention the
A kind of study householder method based on facility for study disclosed in one side.
Fourth aspect present invention discloses a kind of computer readable storage medium, stores computer program, wherein the meter
Calculation machine program makes computer execute a kind of study auxiliary square based on facility for study disclosed in first aspect of the embodiment of the present invention
Method.
Fifth aspect present invention discloses a kind of computer program product, when the computer program product is transported on computers
When row, so that the computer executes some or all of any one method of first aspect step.
Sixth aspect present invention discloses a kind of using distribution platform, and the application distribution platform is used to issue computer program
Product, wherein when the computer program product is run on computers, so that the computer executes appointing for first aspect
A kind of some or all of the method for anticipating step.
Compared with prior art, the embodiment of the present invention has the advantages that
In embodiments of the present invention, the phonetic search message that facility for study is inputted by detection User, then from language
Identify the search intention of the User in sound search message, and shooting exercise-book current page to obtain page-images,
Then from specified coordinate of the User in this prior on the page is identified in the page-images, this is detected from page-images and is referred to
It whether there is handwriting trace in the particular range of position fixing, if there is handwriting trace, using the search intention as foundation, identify page
The corresponding content of specified coordinate is in the image of face to obtain content to be searched, the push content that search matches with the content to be searched
And export, through the embodiment of the present invention, in conjunction with voice and it can take pictures and obtain content to be searched, and further judge User
Whether thought independently to content to be searched, only have passed through just will do it content search after thinking independently, with
Training student user picks up good habits of study, and improves learning effect.
Detailed description of the invention
It to describe the technical solutions in the embodiments of the present invention more clearly, below will be to needed in the embodiment
Attached drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the invention, for ability
For the those of ordinary skill of domain, without creative efforts, it can also be obtained according to these attached drawings other attached
Figure.
Fig. 1 is the application schematic diagram of facility for study disclosed by the embodiments of the present invention；
Fig. 2 is the flow diagram of the study householder method based on facility for study disclosed in one embodiment of the invention；
Fig. 3 is the flow diagram of the study householder method based on facility for study disclosed in another embodiment of the present invention；
Fig. 4 is the structural schematic diagram of facility for study disclosed in one embodiment of the invention；
Fig. 5 is the structural schematic diagram of facility for study disclosed in another embodiment of the present invention；
Fig. 6 is the structural schematic diagram of facility for study disclosed in further embodiment of this invention.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation description, it is clear that the described embodiment is only a part of the embodiment of the present invention, instead of all the embodiments.Based on this
Embodiment in invention, every other reality obtained by those of ordinary skill in the art without making creative efforts
Example is applied, shall fall within the protection scope of the present invention.
It should be noted that the term " includes " of the embodiment of the present invention and " having " and their any deformation, it is intended that
Be to cover it is non-exclusive include, for example, containing the process, method, system, product or equipment of a series of steps or units not
Those of be necessarily limited to be clearly listed step or unit, but may include be not clearly listed or for these processes, side
The intrinsic other step or units of method, product or equipment.
The study householder method based on facility for study that the embodiment of the invention discloses a kind of, is used to help User and forms
Good study habit improves learning effect.The embodiment of the present invention also accordingly discloses a kind of facility for study.
Referring to Fig. 1, Fig. 1 is the application schematic diagram of facility for study disclosed by the embodiments of the present invention, it will be understood that Fig. 1 is only
For an application schematic diagram of facility for study disclosed by the embodiments of the present invention, it is other it is any it is shown in Fig. 1 on the basis of optimize
Or the obtained application schematic diagram of deformation, and be implemented for technical solution of the present invention belongs to the scope of the present invention,
It is not specifically limited in this embodiment.In Fig. 1, facility for study 10 is placed on base support 20, facility for study 10 is provided with preposition
Camera 30, and facility for study 10 (is disposed vertically in the horizontal plane or is placed in base support shown in FIG. 1 with predetermined manner
It is first-class) place when camera 30 be corresponding with specific shooting area (as shown in Figure 1), specific shooting area be used for place exercise-book
(being also possible to any paper material such as teaching material textbook), wherein specific shooting area is not fixation, refers to camera 30
The region of visual angle intersection, can change with the placement of facility for study 10, the white silk being placed in the specific shooting area
Practising originally can be by clearly shooting and the identification of facility for study 10.In order to more clearly from take specific shooting area, can incite somebody to action
Facility for study 10 is placed in base support 20, so that facility for study 10 and horizontal plane be at 75 ° of angles, so as to obtain better bat
Take the photograph angle.
Facility for study provided in an embodiment of the present invention includes but are not limited to private tutor's machine, tablet computer etc., facility for study
Operating system may include but be not limited to Android operation system, IOS operating system, Symbian (Saipan) operating system, Black
Berry (blackberry, blueberry) operating system, Windows Phone8 operating system etc., the embodiment of the present invention is without limitation.It below will be from
Facility for study angle is set out, and is described in detail by specific embodiment to technical solution of the present invention.
Embodiment one
Referring to Fig. 2, the process that Fig. 2 is the study householder method based on facility for study disclosed in one embodiment of the invention is shown
It is intended to；As shown in Fig. 2, being somebody's turn to do the study householder method based on facility for study can include:
201, the phonetic search message of facility for study detection User input, and the cognometrics from the phonetic search message
The search intention of raw user.
In embodiments of the present invention, User uses facility for study as study auxiliary tool, learns carrying out operation etc.
During habit, facility for study can be opened, facility for study is placed in front.It is further appreciated that study is set in conjunction with Fig. 1
Standby to provide intelligence learning mode, User opens facility for study, and enters intelligence learning mode, in intelligence learning mode
Under, facility for study opens camera and phonetic function, real-time perfoming shooting preview and speech detection.
Wherein, the phonetic search message of facility for study detection User input, the phonetic search message are User
It is used to indicate out its search intention.For example, exercise-book is placed in specific shooting area by study user, when by finger or
Person's lettering pen etc. points to some position on exercise-book and inputs phonetic search message simultaneously, which carries
Such as " what meaning this Chinese idiom is? ", facility for study is after detecting the phonetic search message, from phonetic search message point
It is precipitated its search intention, i.e. the confirmation User meaning that needs to search for the Chinese idiom specified by it.In addition, User input
Phonetic search message expression it is ambiguous or be the local dialect, facility for study possibly can not succeed from phonetic search message
In identify search intention, cause identify search intention failure.
As an alternative embodiment, when facility for study identifies search intention failure from phonetic search message,
Voice plays the first prompting message, and for prompting User, it fails clearly to learn search intention simultaneously first prompting message
Please User re-enter；When detecting the phonetic search message that User inputs again, disappear again from phonetic search
Search intention is identified in breath, if continuing recognition failures, the frequency of failure of continuous recognition failures is obtained, when the frequency of failure is greater than
Or being equal to failure threshold value, then voice plays the second prompting message, and second prompting message is for prompting User failure time
Number has been more than failure threshold value and has again attempted to after asking User to wait preset duration；When the frequency of failure is less than the failure threshold
Value, then voice plays the first prompting message again, until turning to step 202 when successfully recognizing search intention, or failure time
Number, which is more than or equal to failure threshold value, terminates process.
202, the current page of facility for study shooting exercise-book is to obtain page-images, and is identified from page-images
Specified coordinate of the raw user on current page.
It is appreciated that step 201 and 202 may be performed simultaneously, step 202 is executed after step 201 can also be first carried out, or
Person executes step 201 after first carrying out step 202, and the embodiment of the present invention is not specifically limited in this embodiment.
As an alternative embodiment, facility for study when detecting phonetic search message, passes through camera preview
The current page of exercise-book in specific shooting area, and shoot the current page and obtain page-images, then by shooting
To specified coordinate of the page-images analytic learning user on current page.In this embodiment, study user speech is defeated
Enter phonetic search message, and some position on exercise-book current page is pointed to by finger or lettering pen simultaneously, study is set
It is standby the finger or lettering pen of User to be analyzed from page-images, then by shooting obtained page-images
The coordinate of finger fingertip or lettering pen pen tip on current page is obtained, to obtain specified coordinate.
203, facility for study whether there is written trace out of particular range that detect specified coordinate in page-images.Its
In, if there are written traces in the particular range of specified coordinate, turn to step 204；If in the particular range of specified coordinate
There is no written trace, terminate the process.
In step 203, if detecting the phonetic search message of User input, and determine that User exists
Specified coordinate on current page, further by judging to whether there is written trace around the specified coordinate in page-images,
If there is written trace, illustrates that User has been directed to the content of its specified coordinate position and has been thought deeply, allow
It is scanned for.
Wherein, the particular range of specified coordinate may be set according to actual conditions, for example, specified coordinate position is corresponding
Exercise and other exercises between the corresponding exercise of white space or specified coordinate position answer region
Deng for example, illustrating User if the answer region of the corresponding exercise in specified coordinate position, which has been known about, is answered information
It has been completed to think independently and carry out to understand and answer, can permit User at this time and scan for.
Wherein, as an alternative embodiment, the particular range when specified coordinate includes specified coordinate position
When the answer region of corresponding exercise, facility for study identifies whether the answer region records answer information, if so, turning to
Step 204.
Still optionally further, when answer region do not record answer information, further identify specified coordinate position pair
The white space between exercise and other exercises answered whether there is written trace, and if it exists, turn to step 204.Pass through
Whether the embodiment can carry out the accurate User that analyze to being searched for by detection answer region and white space
Content is thought independently.
As an alternative embodiment, output mentions when written trace being not present in the particular range of specified coordinate
Show message, the prompting message is for prompting User first to be answered.It, can be in the spy of specified coordinate by the embodiment
Determine there is no when written trace, first reminding User think independently after completion is answered to scan for again in range, with side
User is helped to foster a good habit of studying, to improve learning effect.
Further, it when written trace being not present in the particular range of specified coordinate, identifies to remove in page-images and be somebody's turn to do
Place except specified coordinate position and particular range whether there is written trace, if it does, identifying the written trace
Corresponding written contents judge the matching degree of the stem content of the exercise of the written contents and specified coordinate position, such as
The fruit matching degree is more than or equal to preset matching value, then turns to step 204, if the matching degree is less than preset matching value,
Export prompting message.By the embodiment, also can accurately be examined when User carries out answer calculation by foul papers
It measures and, to improve the accuracy rate for judging whether User is thought independently.
204, facility for study is using search intention as foundation, identify in page-images the corresponding content of specified coordinate with obtain to
Search for content.
For example, phonetic search message is " what meaning this Chinese idiom is? ", facility for study detecting that the voice searches
After rope message, the search intention of its meaning that search for the corresponding Chinese idiom of specified coordinate is analyzed from phonetic search message, is learned
Practise equipment and extract corresponding Chinese idiom from the corresponding content of specified coordinate, then obtain one " xxx be what the meaning " to
Search for content, wherein xxx is the corresponding Chinese idiom in specified coordinate position.
205, facility for study is searched for the push content to match with content to be searched and is exported.
Facility for study can search push content after, in current display interface pop up wicket carry out display or
Person is not construed as limiting with page format loaded and displayed, to this.
Implement above-described embodiment, the phonetic search message that facility for study is inputted by detection User, then from voice
Identify the search intention of the User in search message, and shooting exercise-book current page to obtain page-images, so
Afterwards from specified coordinate of the User in this prior on the page is identified in the page-images, it is specified that this is detected from page-images
It whether there is handwriting trace in the particular range of coordinate, if there is handwriting trace, using the search intention as foundation, identify the page
The corresponding content of specified coordinate is in image to obtain content to be searched, and the push content that search matches with the content to be searched is simultaneously
Output in conjunction with voice and can take pictures through the embodiment of the present invention and obtain content to be searched, and further judge that User is
No to be thought independently to content to be searched, only have passed through just will do it content search after thinking independently, with training
Feeding User picks up good habits of study, and improves learning effect.
Embodiment two
Referring to Fig. 3, Fig. 3 is the process of the study householder method based on facility for study disclosed in another embodiment of the present invention
Schematic diagram；As shown in figure 3, being somebody's turn to do the study householder method based on facility for study can include:
301, the phonetic search message of facility for study detection User input, and the cognometrics from the phonetic search message
The search intention of raw user.
302, facility for study passes through the camera for being equipped with reflective mirror outside in the specific shooting area for being placed in camera
The current page of exercise-book carries out shooting preview, and is detecting that User passes through specified operation of the finger on current page
When, control camera shooting current page obtains page-images, and the student is identified in page-images according to specified operation
Specified coordinate of the user on current page.
In embodiments of the present invention, outer on camera to be equipped with reflective mirror, specific shooting area can be made by reflective mirror
The reflected light of the current page of interior exercise-book enhances, so that current page that camera takes is clearer, furthermore it is possible to
Facility for study is placed on base support in conjunction with Fig. 1, to reach the tilt angle of adjustment reflective mirror, is able to solve because of light
Unclear problem is shot caused by when too strong or too bright.
As an alternative embodiment, study tablet is placed on specific shooting area, in study tablet
Exercise-book is placed on upper surface, which is electrically connected with facility for study, and User can match by learning tablet
The talking pen of set is operated on exercise-book, and in step 302, facility for study shoots current page by control camera and obtains
After obtaining page-images, also pressure value will be touched from study tablet reception and touch coordinate value, it is student that this, which touches pressure value,
User passes through talking pen when carrying out specified coordinate positioning on current page, pressure value detected by the study tablet, and
Touching coordinate value is the coordinate position for sensing the pressure value.In turn, facility for study is analyzed exercise-book by page-images and is learned
The positional relationship of tablet is practised, then according to the positional relationship and coordinate value is touched, User is analyzed and is existed by talking pen
Specified coordinate on the current page.
Still optionally further, facility for study pressure value and touches coordinate value receiving touching for study tablet feedback
Afterwards, judge that this touches whether pressure value is greater than preset threshold, if it is greater than preset threshold, execute facility for study and pass through page-images
It analyzes exercise-book and learns the positional relationship of tablet, then according to the positional relationship and coordinate value is touched, analyze student's use
Family by talking pen in this prior specified coordinate on the page the step of, by the embodiment, can be avoided maloperation.
303, facility for study whether there is written trace out of particular range that detect specified coordinate in page-images.Its
In, if there are written traces in the particular range of specified coordinate, turn to step 304；If in the particular range of specified coordinate
There is no written trace, terminate the process.
304, facility for study is using search intention as foundation, identify in page-images the corresponding content of specified coordinate with obtain to
Search for content.
305, facility for study extracts vocal print feature from phonetic search message.
306, facility for study identifies the age information of the User according to vocal print feature.
307, facility for study determines grade's information of User according to age information.
Since same exercise may have different answer processes or different answers in different grades, because
This, in embodiments of the present invention, facility for study further extracts vocal print feature from phonetic search message, is known by vocal print feature
Not Chu User age information and grade's information, then can be directed to User grade's information search recommendation,
Matched recommendation is obtained so as to match the personal considerations of User, to improve the accuracy rate of search.
308, facility for study is based on grade's information, searches for the push content to match with the content to be searched and exports.
As an alternative embodiment, if determining exist in the particular range of specified coordinate in step 303
When written trace, the corresponding written contents of written trace are identified from page-images；In turn, search matches with content to be searched
Push content and export may include:
The push content that search matches with content to be searched；Judge whether the written contents match with push content；
If it does, facility for study export prompt information, the prompt information for prompt User written contents be correct content simultaneously
It asks whether to need further to export push content；And it is defeated receiving the confirmation needs that User inputs in facility for study
The push content is exported in facility for study when pushing content out；If mismatched, facility for study output push content.In the implementation
In mode, if written contents and push description of contents User answer are correct, further whether User can be inquired
Need to continue to output the push content, if it does not match, directly exporting the push content.
By the embodiment, the age information and grade's information of User are identified by vocal print feature, then can
It is enough directed to the grade information search recommendation of User, is matched so as to match the personal considerations of User
Recommendation, with improve search accuracy rate.
Embodiment three
Referring to Fig. 4, Fig. 4 is the structural schematic diagram of facility for study disclosed in one embodiment of the invention；As shown in figure 4, should
Facility for study can include:
Speech detection unit 410, for detecting the phonetic search message of User input, and from phonetic search message
Identify the search intention of the User；
Shooting unit 420 for shooting the current page of exercise-book to obtain page-images, and is identified from page-images
Specified coordinate of the User on current page；
Write detection unit 430 is write for whether there is out of particular range that detect specified coordinate in page-images
Trace；
Content recognition unit 440, for detecting the particular range memory of specified coordinate in above-mentioned write detection unit 430
In written trace, using search intention as foundation, identify that the corresponding content of specified coordinate is in page-images to obtain in be searched
Hold；
Search unit 450, for searching for the push content to match with content to be searched and exporting.
As an alternative embodiment, if speech detection unit 410 identifies search meaning from phonetic search message
When figure failure, voice plays the first prompting message, and for prompting User, it fails clearly to learn first prompting message
Search intention simultaneously asks User to re-enter；When detecting the phonetic search message that User inputs again, again from
Search intention is identified in phonetic search message, if continuing recognition failures, the frequency of failure of continuous recognition failures is obtained, when the mistake
It loses number and is more than or equal to failure threshold value, then voice plays the second prompting message, and second prompting message is for prompting student
User's frequency of failure is more than unsuccessfully threshold value and again attempts to after asking User to wait preset duration；When the frequency of failure is less than
The failure threshold value, then voice plays the first prompting message again, until triggering shooting unit 420 when successfully recognizing search intention
It executes corresponding operating or the frequency of failure is more than or equal to failure threshold value and terminates process.
As an alternative embodiment, speech detection unit 410 is when detecting phonetic search message, shooting unit
420 pass through the current page of the exercise-book in the specific shooting area of camera preview, and shoot the current page and obtain page figure
Picture, specified coordinate of the page-images analytic learning user then obtained by shooting on current page.Preferably
In, study user speech inputs phonetic search message, and is pointed on exercise-book current page by finger or lettering pen simultaneously
Some position, facility for study can analyze the hand of User by shooting obtained page-images from page-images
Refer to that perhaps then lettering pen obtains the coordinate of finger fingertip or lettering pen pen tip on current page, to obtain specified sit
Mark.
As another optional embodiment, above-mentioned shooting unit 420 is used for by being set to facility for study and external
There is the camera of reflective mirror to carry out shooting preview to the current page of the exercise-book in the specific shooting area for being placed in camera,
And detect User by finger in the specified operation on current page, control camera shooting current page obtain
Page-images, and specified coordinate of the User on current page is identified in page-images according to specified operation.Pass through
It is outer on camera to be equipped with reflective mirror, the reflection of the current page of the exercise-book in specific shooting area can be made by reflective mirror
Light enhancing, so that current page that camera takes is clearer, furthermore it is possible to which facility for study is placed in bottom in conjunction with Fig. 1
On seat support, to reach the tilt angle of adjustment reflective mirror, it is able to solve because shooting not caused by when light is too strong or too bright
Clear problem.
Still optionally further, it is placed with study tablet on specific shooting area, is put on the upper surface of study tablet
Exercise-book is set, which is electrically connected with facility for study, and User can pass through the matched talking pen of study tablet
It is operated on exercise-book, after shooting unit 420 shoots current page acquisition page-images by control camera, will also
Pressure value is touched from study tablet reception and touches coordinate value, and it is that User passes through talking pen current that this, which touches pressure value,
When carrying out specified coordinate positioning on the page, pressure value detected by the study tablet, and touching coordinate value is to sense this
The coordinate position of pressure value.In turn, shooting unit 420 is closed by the position that page-images analyze exercise-book and learn tablet
System analyzes User and passes through the finger on the talking pen in this prior page then according to the positional relationship and coordinate value is touched
Position fixing.
Still optionally further, shooting unit 420 pressure value and touches coordinate receiving touching for study tablet feedback
After value, judge that this touches whether pressure value is greater than preset threshold, if it is greater than preset threshold, executes facility for study and pass through page figure
As analysis exercise-book and learns the positional relationship of tablet and analyze student then according to the positional relationship and coordinate value is touched
User by talking pen in this prior specified coordinate on the page the step of, by the embodiment, can be avoided maloperation.
Implement above-mentioned facility for study, then can be searched from voice by the phonetic search message of detection User input
Identify the search intention of the User in rope message, and shooting exercise-book current page to obtain page-images, then
From specified coordinate of the User in this prior on the page is identified in the page-images, this is detected from page-images and specified is sat
It whether there is handwriting trace in target particular range, if there is handwriting trace, using the search intention as foundation, identify page figure
The corresponding content of specified coordinate to be as in obtain content to be searched, searches for the push content to match with the content to be searched and defeated
Out, through the embodiment of the present invention, voice can be combined and taken pictures and obtain content to be searched, and further whether judge User
Thought independently to content to be searched, only have passed through just will do it content search after thinking independently, with culture
User picks up good habits of study, and improves learning effect.
Example IV
Referring to Fig. 5, Fig. 5 is the structural schematic diagram of facility for study disclosed in another embodiment of the present invention；Shown in fig. 5
Practising equipment is to optimize to obtain on the basis of facility for study shown in Fig. 4, as shown in figure 5, the facility for study further include:
Reminding unit 510 and user identification unit 520.
Wherein, above-mentioned reminding unit 510, in the particular range that write detection unit 430 detects specified coordinate
There is no prompting message when written trace, is exported, the prompting message is for prompting User first to be answered.
As an alternative embodiment, the particular range when specified coordinate includes that specified coordinate position is corresponding
When the answer region of exercise, write detection unit 430 identifies whether the answer region records answer information, if so, touching
It sends out content recognition unit 440 and executes corresponding steps.
Still optionally further, when answer region does not record answer information, further identification is specified for write detection unit 430
White space between the corresponding exercise in coordinate position and other exercises whether there is written trace, and if it exists, touching
It sends out content recognition unit 440 and executes corresponding steps.By the embodiment, can by detection answer region and white space come
Accurately analyze whether User thinks independently to the content to be searched for.
Further, when written trace being not present in the particular range of specified coordinate, write detection unit 430 identifies page
The place except the specified coordinate position and particular range is removed in the image of face with the presence or absence of written trace, if it does,
The corresponding written contents of the written trace are identified, in the stem for judging the exercise of the written contents and specified coordinate position
The matching degree of appearance triggers content recognition unit 440 and executes corresponding step if the matching degree is more than or equal to preset matching value
Suddenly, if the matching degree is less than preset matching value, prompting message is exported.It, can be logical in User by the embodiment
Cross foul papers carry out answer calculation when, also can accurately detected, judge whether User has carried out independent think of to improve
The accuracy rate examined.
Above-mentioned user identification unit 520, the push content for matching in the search of search unit 450 with content to be searched
And before exporting, vocal print feature is extracted from phonetic search message；And identify that the age of User believes according to vocal print feature
Breath；And grade's information of User is determined according to age information.
And then above-mentioned search unit 450 is used to search for the push content to match with content to be searched and the mode exported has
Body are as follows: above-mentioned search unit 450, for being based on grade's information, searching for the push content to match with content to be searched and exporting.
In embodiments of the present invention, facility for study further extracts vocal print feature from phonetic search message, passes through vocal print
Feature identifies the age information and grade's information of User, then can recommend for grade's information search of User
Content obtains matched recommendation so as to match the personal considerations of User, to improve the accuracy rate of search.
As an alternative embodiment, above content recognition unit 440, is also used to examine in write detection unit 430
Measure in the particular range of specified coordinate that there are the corresponding writing of the written trace when written trace, is identified from page-images
Content；
In turn, above-mentioned search unit 450 is used to search for the push content to match with content to be searched and the mode of output
Specifically:
Above-mentioned search unit 450, for searching for the push content to match with content to be searched；And judge in writing
Hold with whether push content matches；And in matching, prompt information is exported in facility for study, the prompt information is for mentioning
Show that User written contents are correct content and ask whether to need further to export push content；And receiving the student
Push content is exported in facility for study when the confirmation that user inputs in facility for study needs to export push content；And not
When matching, push content is exported in facility for study.
Embodiment five
Referring to Fig. 6, Fig. 6 is the structural schematic diagram of facility for study disclosed in further embodiment of this invention；Shown in fig. 6
Practise equipment can include: at least one processor 610, such as CPU, communication bus 630 is for realizing the communication between these components
Connection.Memory 620 can be high speed RAM memory, be also possible to non-labile memory (non-volatile
Memory), a for example, at least magnetic disk storage.Memory 620 optionally can also be that at least one is located remotely from aforementioned place
Manage the storage device of device 610.Wherein, processor 610 can be in conjunction with facility for study described in Fig. 4 to Fig. 5, in memory 610
Batch processing code is stored, and processor 610 calls the program code stored in memory 620, for performing the following operations:
The phonetic search message of User input is detected, and identifies the User from the phonetic search message
Search intention；And shooting exercise-book current page to obtain page-images, and from the page-images identification described in
Specified coordinate of the User on the current page；The particular range of the specified coordinate is detected from the page-images
It is interior to whether there is written trace；If it does, being intended to foundation with described search, identifies and specify seat described in the page-images
Corresponding content is marked to obtain content to be searched；It searches for the push content to match with the content to be searched and exports.
As an alternative embodiment, above-mentioned processor 610 is also used to execute following steps:
When the written trace being not present in the particular range of the specified coordinate, prompting message, the prompt are exported
Message is for prompting the User first to be answered.
As an alternative embodiment, above-mentioned processor 610 is also used to execute following steps:
By being set to the facility for study and being equipped with the camera of reflective mirror to being placed in the specific of the camera outside
The current page of the exercise-book in shooting area carries out shooting preview, and is detecting that the User existed by finger
When specified operation on the current page, controls the camera and shoot the current page and obtain page-images, and according to
The specified operation identifies specified coordinate of the User on the current page in the page-images.
As an alternative embodiment, above-mentioned processor 610 is also used to execute following steps:
Push content that described search and the content to be searched match and before exporting, from the phonetic search message
Middle extraction vocal print feature；The age information of the User is identified according to the vocal print feature；It is true according to the age information
Make grade's information of the User；The push to be matched based on grade's information, search with the content to be searched
Content simultaneously exports.
As an alternative embodiment, above-mentioned processor 610 is also used to execute following steps:
If there are the written traces in the particular range of the specified coordinate, from the page-images described in identification
The corresponding written contents of written trace；The push content that search matches with the content to be searched；Judge the written contents
Whether match with the push content；If it does, exporting prompt information in the facility for study, the prompt information is used for
Written contents described in the User are prompted to be correct content and ask whether to need further to export the push content；And
When receiving the confirmation that the User inputs in the facility for study and needing to export the push content in
It practises equipment and exports the push content；If mismatched, the push content is exported in the facility for study.
A kind of computer readable storage medium is also disclosed in the embodiment of the present invention, stores computer program, wherein the meter
Calculation machine program makes computer execute a kind of study householder method based on facility for study disclosed in Fig. 2 to Fig. 3.
A kind of computer program product is also disclosed in the embodiment of the present invention, when the computer program product is transported on computers
When row, so that the computer executes some or all of any one method step disclosed in Fig. 2 to Fig. 3.
The embodiment of the present invention is also disclosed a kind of using distribution platform, and the application distribution platform is used to issue computer program
Product, wherein when the computer program product is run on computers, so that the computer executes Fig. 2 to Fig. 3 and discloses
Some or all of any one method step.
Those of ordinary skill in the art will appreciate that all or part of the steps in the various methods of above-described embodiment is can
It is completed with instructing relevant hardware by program, which can be stored in a computer readable storage medium, storage
Medium include read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory,
RAM), programmable read only memory (Programmable Read-only Memory, PROM), erasable programmable is read-only deposits
Reservoir (Erasable Programmable Read Only Memory, EPROM), disposable programmable read-only memory (One-
Time Programmable Read-Only Memory, OTPROM), the electronics formula of erasing can make carbon copies read-only memory
(Electrically-Erasable Programmable Read-Only Memory, EEPROM), CD-ROM (Compact
Disc Read-Only Memory, CD-ROM) or other disc memories, magnetic disk storage, magnetic tape storage or can
For carrying or any other computer-readable medium of storing data.
Above to a kind of study householder method and facility for study progress based on facility for study disclosed by the embodiments of the present invention
It is discussed in detail, used herein a specific example illustrates the principle and implementation of the invention, above embodiments
Explanation be merely used to help understand method and its core concept of the invention；At the same time, for those skilled in the art,
According to the thought of the present invention, there will be changes in the specific implementation manner and application range, in conclusion in this specification
Appearance should not be construed as limiting the invention.
Claims (12)
1. a kind of study householder method based on facility for study characterized by comprising
The phonetic search message of User input is detected, and identifies searching for the User from the phonetic search message
Suo Yitu；And
The current page of exercise-book is shot to obtain page-images, and identifies the User in institute from the page-images
State the specified coordinate on current page；
It whether there is written trace out of particular range that detect the specified coordinate in the page-images；
If it does, be intended to foundation with described search, identify the corresponding content of specified coordinate described in the page-images with
Obtain content to be searched；
It searches for the push content to match with the content to be searched and exports.
2. the method according to claim 1, wherein the method also includes:
When the written trace being not present in the particular range of the specified coordinate, prompting message, the prompting message are exported
For prompting the User first to be answered.
3. method according to claim 1 or 2, which is characterized in that the current page of the shooting exercise-book is to obtain page
Face image, and from identifying specified coordinate of the User on the current page in the page-images, comprising:
By being set to the facility for study and being equipped with specific shooting of the camera of reflective mirror to the camera is placed in outside
The current page of the exercise-book in region carries out shooting preview, and is detecting the User by finger described
It when specified operation on current page, controls the camera and shoots the current page and obtain page-images, and according to described
Specified operation identifies specified coordinate of the User on the current page in the page-images.
4. the method according to claim 1, wherein the push that described search and the content to be searched match
Before content and output, the method also includes:
Vocal print feature is extracted from the phonetic search message；
The age information of the User is identified according to the vocal print feature；
Grade's information of the User is determined according to the age information；
Push content that described search matches with the content to be searched simultaneously exports, comprising:
Based on grade's information, searches for the push content to match with the content to be searched and export.
5. the method according to claim 1, wherein the method also includes:
If there are the written traces in the particular range of the specified coordinate, the writing is identified from the page-images
The corresponding written contents of trace；
Push content that described search matches with the content to be searched simultaneously exports, comprising:
The push content that search matches with the content to be searched；
Judge whether the written contents match with the push content；
If it does, exporting prompt information in the facility for study, the prompt information is for prompting described in the User
Written contents are correct content and ask whether to need further to export the push content；And receiving the User
It is exported in the push when confirmation inputted in the facility for study needs to export the push content in the facility for study
Hold；
If mismatched, the push content is exported in the facility for study.
6. a kind of facility for study characterized by comprising
Speech detection unit for detecting the phonetic search message of User input, and is known from the phonetic search message
The search intention of the not described User；
Shooting unit for shooting the current page of exercise-book to obtain page-images, and identifies institute from the page-images
State specified coordinate of the User on the current page；
Write detection unit is write for whether there is out of particular range that detect the specified coordinate in the page-images
Trace；
Content recognition unit is write for existing in the particular range that the write detection unit detects the specified coordinate
When trace, foundation is intended to described search, identify the corresponding content of specified coordinate described in the page-images with obtain to
Search for content；
Search unit, for searching for the push content to match with the content to be searched and exporting.
7. facility for study according to claim 1, which is characterized in that the facility for study further include:
Reminding unit, for the book to be not present in the particular range that the write detection unit detects the specified coordinate
When writing trace, prompting message is exported, the prompting message is for prompting the User first to be answered.
8. facility for study according to claim 6 or 7, it is characterised in that:
The shooting unit, specifically for by being set to the facility for study and being equipped with the camera of reflective mirror to being placed in outside
The current page of the exercise-book in the specific shooting area of the camera carries out shooting preview, and is detecting
Raw user, in the specified operation on the current page, is controlled the camera and shoots the current page acquisition by finger
Page-images, and identify the User on the current page in the page-images according to the specified operation
Specified coordinate.
9. facility for study according to claim 6, which is characterized in that the facility for study further include:
User identification unit, push content for matching in described search unit searches with the content to be searched simultaneously export
Before, vocal print feature is extracted from the phonetic search message；And the User is identified according to the vocal print feature
Age information；And grade's information of the User is determined according to the age information；
Described search unit is used to search for the push content to match with the content to be searched and the mode of output specifically:
Described search unit, for being based on grade's information, the push content that search matches with the content to be searched is simultaneously
Output.
10. facility for study according to claim 6, it is characterised in that:
The content recognition unit is also used to detect the particular range memory of the specified coordinate in the write detection unit
In the written trace, the corresponding written contents of the written trace are identified from the page-images；
Described search unit is used to search for the push content to match with the content to be searched and the mode of output specifically:
Described search unit, for searching for the push content to match with the content to be searched；And judge in the writing
Hold and whether matches with the push content；And in matching, prompt information, the prompt are exported in the facility for study
Information is for prompting written contents described in the User to be correct content and ask whether to need to push away described in further output
Send content；And when receiving the confirmation that the User inputs in the facility for study and needing to export the push content
The push content is exported in the facility for study；And when mismatching, exported in the push in the facility for study
Hold.
11. a kind of facility for study characterized by comprising
It is stored with the memory of executable program code；
The processor coupled with the memory；
The processor calls the executable program code stored in the memory, and perform claim requires any one of 1-5
A kind of study householder method based on facility for study.
12. a kind of computer readable storage medium, which is characterized in that the computer-readable recording medium storage computer journey
Sequence, wherein the computer program makes a kind of study based on facility for study of any one of computer perform claim requirement 1-5
Householder method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910061523.XA CN109800297A (en) | 2019-01-23 | 2019-01-23 | Learning auxiliary method based on learning equipment and learning equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910061523.XA CN109800297A (en) | 2019-01-23 | 2019-01-23 | Learning auxiliary method based on learning equipment and learning equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109800297A true CN109800297A (en) | 2019-05-24 |
Family
ID=66560145
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910061523.XA Pending CN109800297A (en) | 2019-01-23 | 2019-01-23 | Learning auxiliary method based on learning equipment and learning equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109800297A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111078099A (en) * | 2019-05-29 | 2020-04-28 | 广东小天才科技有限公司 | A learning function switching method and learning device based on gesture recognition |
| CN111711757A (en) * | 2020-06-29 | 2020-09-25 | 广东小天才科技有限公司 | Test question shooting method, device, electronic device and storage medium for preventing finger occlusion |
| CN112883152A (en) * | 2021-01-25 | 2021-06-01 | 广东小天才科技有限公司 | Content query method and device, electronic equipment and storage medium |
| CN115761767A (en) * | 2021-08-31 | 2023-03-07 | 广东艾檬电子科技有限公司 | Handwriting position determining method and device, terminal device and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160124970A1 (en) * | 2014-10-30 | 2016-05-05 | Fluenty Korea Inc. | Method and system for providing adaptive keyboard interface, and method for inputting reply using adaptive keyboard based on content of conversation |
| CN106156310A (en) * | 2016-06-30 | 2016-11-23 | 努比亚技术有限公司 | A kind of picture processing apparatus and method |
| CN106695826A (en) * | 2016-12-26 | 2017-05-24 | 深圳前海勇艺达机器人有限公司 | Robot device with scanning and reading functions |
| CN108735021A (en) * | 2018-05-23 | 2018-11-02 | 郭金荣 | A kind of intelligent tutoring system for students' work |
-
2019
- 2019-01-23 CN CN201910061523.XA patent/CN109800297A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160124970A1 (en) * | 2014-10-30 | 2016-05-05 | Fluenty Korea Inc. | Method and system for providing adaptive keyboard interface, and method for inputting reply using adaptive keyboard based on content of conversation |
| CN106156310A (en) * | 2016-06-30 | 2016-11-23 | 努比亚技术有限公司 | A kind of picture processing apparatus and method |
| CN106695826A (en) * | 2016-12-26 | 2017-05-24 | 深圳前海勇艺达机器人有限公司 | Robot device with scanning and reading functions |
| CN108735021A (en) * | 2018-05-23 | 2018-11-02 | 郭金荣 | A kind of intelligent tutoring system for students' work |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111078099A (en) * | 2019-05-29 | 2020-04-28 | 广东小天才科技有限公司 | A learning function switching method and learning device based on gesture recognition |
| CN111711757A (en) * | 2020-06-29 | 2020-09-25 | 广东小天才科技有限公司 | Test question shooting method, device, electronic device and storage medium for preventing finger occlusion |
| CN111711757B (en) * | 2020-06-29 | 2022-03-08 | 广东小天才科技有限公司 | Test question shooting method and device capable of preventing finger from being blocked, electronic equipment and storage medium |
| CN112883152A (en) * | 2021-01-25 | 2021-06-01 | 广东小天才科技有限公司 | Content query method and device, electronic equipment and storage medium |
| CN115761767A (en) * | 2021-08-31 | 2023-03-07 | 广东艾檬电子科技有限公司 | Handwriting position determining method and device, terminal device and storage medium |
| WO2023029125A1 (en) * | 2021-08-31 | 2023-03-09 | 广东艾檬电子科技有限公司 | Method and apparatus for determining handwriting position, and terminal device and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110348400B (en) | Score obtaining method and device and electronic equipment | |
| CN109817046B (en) | A kind of learning assistance method based on home teaching equipment and home teaching equipment | |
| CN109637286A (en) | Spoken language training method based on image recognition and family education equipment | |
| CN109800297A (en) | Learning auxiliary method based on learning equipment and learning equipment | |
| CN109656465B (en) | A content acquisition method applied to home education equipment and home education equipment | |
| CN105786316B (en) | A kind of Computer Identification that evaluation software operation is horizontal | |
| CN110353622A (en) | A kind of vision testing method and eyesight testing apparatus | |
| CN103632169A (en) | Method and equipment for automatic character writing error correction | |
| CN109753583A (en) | Question searching method and electronic equipment | |
| CN109669661A (en) | Control method of dictation progress and electronic equipment | |
| CN109597943A (en) | Learning content recommendation method based on scene and learning equipment | |
| CN111899581A (en) | Word spelling and reading exercise device and method for English teaching | |
| CN109635196A (en) | Intelligent search method based on polysemous words and family education equipment | |
| CN112163513A (en) | Information selection method, system, device, electronic device and storage medium | |
| Sanches et al. | Using the eye gaze to predict document reading subjective understanding | |
| CN109753941A (en) | Learning content searching method based on family education equipment and family education equipment | |
| CN109783613A (en) | Question searching method and system | |
| CN109634416A (en) | Intelligent control method for dictation, newspaper and reading and terminal equipment | |
| JP2016045723A (en) | Electronics | |
| US20230266826A1 (en) | Gesture Simulated Interactive Environment | |
| CN114140282A (en) | Method and device for quickly reviewing answers of general teaching classroom based on deep learning | |
| JP2016045724A (en) | Electronics | |
| CN111079486B (en) | A method and electronic device for enabling dictation detection | |
| CN109783679A (en) | Learning auxiliary method and learning equipment | |
| JP5927777B2 (en) | Display control apparatus and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190524 |
|
| RJ01 | Rejection of invention patent application after publication |