CN111914821A - A dictation detection method and electronic device - Google Patents

Abstract

The embodiment of the present invention relates to the field of education technology, and discloses a dictation detection method and an electronic device. The method includes: acquiring, through a camera device on the electronic device, a target formed between the top edge of the handwritten book and the bottom edge of the electronic device touching the desktop angle; determine whether the target angle is greater than the preset angle; if so, output the first voice prompt information, the first voice prompt information is used to prompt the user to adjust the placement position of the handwritten book, so that the target angle is adjusted to be less than or equal to the preset angle Set the angle; wherein, when the target angle is adjusted to be less than or equal to the preset angle, the writing content on the handwritten notebook is completely captured by the camera device. Implementing the embodiments of the present invention is conducive to photographing complete written content, and can improve the effect of dictation detection.

Description

A dictation detection method and electronic device

technical field

The invention relates to the field of education technology, and in particular, to a dictation detection method and an electronic device.

Background technique

At present, when a user uses an electronic device (such as a tutor) for dictation, the electronic device can use the camera of the electronic device to photograph the written content in the handwritten book of the user during dictation, and then detect the written content to obtain a dictation result. In practice, it is found that if the handwritten book is placed within the shooting range of the camera of the electronic device, the camera can capture the writing content. However, if the handwritten book is not placed in a standard way, it is easy for the camera to fail to capture the complete writing content, which will affect the Test results.

SUMMARY OF THE INVENTION

The embodiment of the invention discloses a dictation detection method and an electronic device, which are conducive to photographing complete written content and improve the effect of dictation detection.

A first aspect of the embodiments of the present invention discloses a dictation detection method. An electronic device is placed on a desktop, and a handwriting book is placed horizontally on the desktop. The method includes:

Acquire the target angle formed between the top edge of the handwritten notebook and the bottom edge of the electronic device contacting the desktop through the camera device on the electronic device;

judging whether the target angle is greater than a preset angle;

If yes, output first voice prompt information, the first voice prompt information is used to prompt the user to adjust the placement position of the handwritten notebook, so that the target angle is adjusted to be less than or equal to the preset angle; wherein , when the target angle is adjusted to be less than or equal to the preset angle, the writing content on the handwriting notebook is completely captured by the camera device.

As an optional implementation manner, in the first aspect of the embodiment of the present invention, after judging that the target angle is less than or equal to a preset angle, the method further includes:

Acquiring, by the camera device, a target distance between the center of the top edge of the handwritten notebook and the center of the bottom edge of the electronic device touching the desktop;

Determine whether the target distance is greater than a specified distance; wherein, the specified distance is calculated from the target angle, the preset angle and the preset distance;

If yes, output second voice prompt information, the second voice prompt information is used to prompt the user to adjust the placement position of the handwritten notebook, so that the target distance is adjusted to be less than or equal to the specified distance; Wherein, when the target distance is adjusted to be less than or equal to the specified distance, the writing content on the handwritten notebook is completely captured by the camera device.

As an optional implementation manner, in the first aspect of the embodiment of the present invention, the top edge of the handwritten book acquired by the camera device on the electronic device and the bottom edge of the desktop that the electronic device contacts After the target angle formed between the two, and before the judging whether the target angle is greater than the preset angle, the method further includes:

Display the degree of the target angle on the display screen of the electronic device;

And, when it is determined that the target angle is greater than the preset angle, the color of the degree of the target angle displayed on the display screen is adjusted to a specified color, and the step of outputting the first voice prompt information is performed.

As an optional implementation manner, in the first aspect of the embodiment of the present invention, the handwritten book is a music score; after the outputting the first voice prompt information, the method further includes:

Photograph the image of the user's writing on the music score by using the camera device;

Identifying the user's writing on the music score from the writing image;

Detect the written content according to the dictation content played by the electronic device, and obtain a dictation detection result; wherein the dictation content is a number of musical notes;

The dictation detection result is output.

As an optional implementation manner, in the first aspect of the embodiment of the present invention, the detection of the written content according to the dictation content played by the electronic device to obtain a dictation detection result includes:

Acquiring the writing information of the user on the music score recorded by the camera device; the writing information includes writing order and writing note interval;

Divide the written content according to the written information and the number of notes included in the dictation content to obtain several notes;

The several notes are detected according to the notes in the dictation content to obtain a dictation detection result.

As an optional implementation manner, in the first aspect of the embodiment of the present invention, after the outputting the dictation detection result, the method further includes:

Output and display the simulated musical keyboard on the display screen of the electronic device, and output third voice prompt information; the third voice prompt information is used to prompt the user to play the dictation content on the simulated musical keyboard;

A target note clicked by the user on the simulated musical keyboard is detected, and a sound effect corresponding to the target note is output.

A second aspect of the embodiments of the present invention discloses an electronic device, the electronic device is standing on a desktop, and a handwriting book is placed horizontally on the desktop, and the electronic device includes:

an angle obtaining unit, configured to obtain the target angle formed between the top edge of the handwritten notebook and the bottom edge of the electronic device contacting the desktop through the camera device on the electronic device;

a first judging unit for judging whether the target angle is greater than a preset angle;

The first output unit is configured to output first voice prompt information when the judgment result of the first judgment unit is yes, and the first voice prompt information is used to prompt the user to adjust the placement position of the handwritten book, so as to Adjusting the target angle to be less than or equal to the preset angle; wherein, when the target angle is adjusted to be less than or equal to the preset angle, the writing content on the handwritten book is captured by the camera device Completely photographed.

As an optional implementation manner, in the second aspect of the embodiment of the present invention, the electronic device further includes:

The distance acquisition unit is configured to acquire, through the camera device, the center of the top edge of the handwritten notebook and the center of the bottom edge of the desktop contacting the electronic device when the determination result of the first determination unit is no. target distance between

a second judging unit, configured to judge whether the target distance is greater than a specified distance; wherein, the specified distance is calculated from the target angle, the preset angle and the preset distance;

a second output unit, configured to output second voice prompt information when the judgment result of the second judgment unit is yes, where the second voice prompt information is used to prompt the user to adjust the placement position of the handwritten notebook , so that the target distance is adjusted to be less than or equal to the specified distance; wherein, when the target distance is adjusted to be less than or equal to the specified distance, the writing content on the handwritten book is captured by the camera device Completely photographed.

As an optional implementation manner, in the second aspect of the embodiment of the present invention, the electronic device further includes:

A degree display unit for, after the angle acquisition unit acquires the target angle formed between the top edge of the handwritten notebook and the bottom edge of the electronic device touching the desktop through the camera device on the electronic device, and Before the first judging unit judges whether the target angle is greater than a preset angle, the display screen of the electronic device displays the degree of the target angle;

The first output unit is further configured to adjust the color of the degree of the target angle displayed on the display screen to a specified color when the judgment result of the first judgment unit is yes, and output the first voice prompt information .

As an optional implementation manner, in the second aspect of the embodiment of the present invention, the handwritten book is a music score; the electronic device further includes:

an image capturing unit, configured to capture an image of the user's writing on the music score by using the camera device after the first output unit outputs the first voice prompt information;

a content recognition unit for recognizing the user's writing content on the music score from the writing image;

a dictation detection unit, configured to detect the written content according to the dictation content played by the electronic device, and obtain a dictation detection result; wherein the dictation content is a number of musical notes;

A result output unit, configured to output the dictation detection result.

As an optional implementation manner, in the second aspect of the embodiment of the present invention, the dictation detection unit includes:

an acquisition subunit, used for acquiring the writing information of the user on the music score recorded by the camera device; the writing information includes writing order and writing note interval;

A dividing subunit, for dividing the writing content according to the writing information and the number of notes included in the dictation content to obtain several notes;

A detection subunit, configured to detect the several notes according to the notes in the dictation content to obtain a dictation detection result.

As an optional implementation manner, in the second aspect of the embodiment of the present invention, the electronic device further includes:

The output display unit is used for outputting and displaying the simulated music keyboard on the display screen of the electronic device after the result output unit outputs the dictation detection result, and outputting third voice prompt information; the third voice prompt information uses for prompting the user to play the dictation content on the simulated musical keyboard;

A detection and output unit, configured to detect the target note clicked by the user on the simulated musical keyboard, and output the sound effect corresponding to the target note.

A third aspect of the embodiments of the present invention discloses an electronic device, including:

a memory in which executable program code is stored;

a processor coupled to the memory;

The processor invokes the executable program code stored in the memory to execute the dictation detection method disclosed in the first aspect of the embodiment of the present invention.

A fourth aspect of the embodiments of the present invention discloses a computer-readable storage medium storing a computer program, wherein the computer program causes a computer to execute the dictation detection method disclosed in the first aspect of the embodiments of the present invention.

A fifth aspect of the embodiments of the present invention discloses a computer program product, which, when the computer program product runs on a computer, causes the computer to execute part or all of the steps of any one of the methods of the first aspect.

A sixth aspect of the embodiments of the present invention discloses an application publishing platform, where the application publishing platform is used for publishing a computer program product, wherein when the computer program product runs on a computer, the computer is made to execute any of the first aspect. Some or all of the steps of a method.

Compared with the prior art, the embodiments of the present invention have the following beneficial effects:

In this embodiment of the present invention, the target angle formed between the top edge of the handwritten book and the bottom edge of the electronic device touching the desktop is obtained through the camera device on the electronic device. If the target angle is less than or equal to the preset angle, no The position of the handwritten book affects the shooting effect; if the target angle is greater than the preset angle, the shooting effect will be affected due to the large position deviation of the handwritten book, so a voice prompt message is output to prompt the user to adjust the placement of the handwritten book, so that the The target angle is adjusted to be less than or equal to the preset angle, so that the handwritten notebook is placed within the shooting range of the camera equipment, which is conducive to shooting the complete writing content and improves the effect of dictation detection.

Description of drawings

In order to illustrate the technical solutions in the embodiments of the present invention more clearly, the following briefly introduces the drawings required in the embodiments. Obviously, the drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, other drawings can also be obtained from these drawings without any creative effort.

1 is a schematic flowchart of a dictation detection method disclosed in an embodiment of the present invention;

Fig. 2 is the schematic diagram that electronic equipment and handwriting are placed on the desktop;

3 is a schematic flowchart of another dictation detection method disclosed in an embodiment of the present invention;

4 is a schematic flowchart of another dictation detection method disclosed in an embodiment of the present invention;

5 is a schematic structural diagram of an electronic device disclosed in an embodiment of the present invention;

6 is a schematic structural diagram of another electronic device disclosed in an embodiment of the present invention;

FIG. 7 is a schematic structural diagram of another electronic device disclosed in an embodiment of the present invention.

Detailed ways

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

It should be noted that the terms "first", "second", "third" and the like in the description and claims of the present invention are used to distinguish different objects, rather than to describe a specific order. The terms "comprising" and "having" and any variations thereof in the embodiments of the present invention are intended to cover non-exclusive inclusion, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to the explicit Instead, those steps or elements listed may include other steps or elements not expressly listed or inherent to the process, method, product or apparatus.

The embodiment of the invention discloses a dictation detection method and an electronic device, which are conducive to photographing complete written content and improve the effect of dictation detection. The following describes in detail from the perspective of electronic devices with reference to the accompanying drawings.

Example 1

Please refer to FIG. 1. FIG. 1 is a schematic flowchart of a dictation detection method disclosed in an embodiment of the present invention. As shown in FIG. 1 , the dictation detection method may include the following steps.

101. The electronic device acquires, through a camera device on the electronic device, a target angle formed between the top edge of the handwritten notebook and the bottom edge of the electronic device contacting the desktop.

In the embodiment of the present invention, the electronic device may be a tutoring machine, a learning machine, a learning tablet, etc., which is not limited in the embodiment of the present invention. The camera device on the electronic device can be combined with a reflector, so that the camera device can capture the field of view in different directions, and thus can capture between the top edge of the handwriting notebook and the bottom edge of the electronic device touching the desktop. After receiving the dictation detection instruction triggered by the user through voice or touch screen, the electronic device enters the dictation detection mode, turns on the camera device, and monitors the space between the top edge of the handwritten notebook and the bottom edge of the electronic device touching the desktop through the camera device in real time. Obtains the target angle formed between the top edge of the handwriting and the bottom edge of the electronic device touching the desktop.

As an optional implementation manner, the electronic device can obtain the inclination of the electronic device when it stands on the desktop and the shooting angle of the camera device on the electronic device, and obtain the top edge of the handwriting and the bottom edge of the electronic device contacting the desktop through the camera device. The initial angle formed between the two is calibrated according to the inclination of the electronic device and the shooting angle of the camera device to obtain the target angle formed between the top edge of the handwritten notebook and the bottom edge of the electronic device touching the desktop. Implementing this embodiment can make the acquired target angle more closely fit the real angle formed between the top edge of the handwritten notebook and the bottom edge of the electronic device contacting the desktop, thereby improving the accuracy of the target angle.

102. The electronic device determines whether the target angle is greater than the preset angle; if so, execute step 103; if not, end the process.

Specifically, assuming that the preset angle is 20°, the electronic device determines whether the target angle formed between the top edge of the handwritten notebook and the bottom edge of the electronic device touching the desktop is greater than 20°; if the target angle is greater than 20°, execute step 103; If the target angle is less than or equal to 20°, the process ends. As shown in Figure 2, the electronic device is standing on the desktop, and the handwriting book is placed horizontally on the desktop. As shown in 201 in Figure 2, the angle between the top edge of the handwriting book and the bottom edge of the electronic device touching the desktop is smaller than the preset At this time, the handwritten notebook is within the shooting range of the camera device, and the writing content on the handwritten notebook can be completely captured by the shooting device; as shown by 202 in Figure 2, between the top edge of the handwritten notebook and the bottom edge of the electronic device touching the desktop The angle is greater than the preset angle. At this time, part of the handwritten notebook is not within the shooting range of the camera equipment, and the writing content on the handwritten notebook cannot be completely captured by the shooting device. Therefore, it is necessary to adjust the placement of the handwritten notebook.

As an optional implementation manner, the electronic device may obtain the size of the handwritten book through the photographing device, determine a preset angle according to the size of the handwriting book, and determine the angle between the top edge of the handwritten book obtained through the photographing device and the bottom edge of the electronic device touching the desktop. After the target angle formed between the two, it is determined whether the target angle is greater than the preset angle. By implementing this embodiment, the preset angle can be adjusted according to different sizes of the handwritten book, thereby making the position adjustment of the handwritten book more accurate.

103. The electronic device outputs first voice prompt information, and the first voice prompt information is used to prompt the user to adjust the placement position of the handwritten book, so that the target angle is adjusted to be less than or equal to the preset angle; wherein, when the target angle is adjusted When the angle is less than or equal to the preset angle, the writing content on the handwritten notebook is completely captured by the camera device.

It can be seen that the dictation detection method described in Fig. 1 is implemented, and the target angle formed between the top edge of the handwritten book and the bottom edge of the electronic device contacting the desktop is obtained by the camera device on the electronic device, if the target angle is less than or equal to the preset angle. , at this time, the shooting effect will not be affected by the position of the handwriting; if the target angle is greater than the preset angle, the shooting effect will be affected due to the large position deviation of the handwriting, so a voice prompt message is output to prompt the user to adjust the handwriting. The placement position of the device allows the target angle to be adjusted to be less than or equal to the preset angle, so that the handwritten notebook is placed within the shooting range of the camera equipment, which is conducive to shooting the complete writing content and improves the effect of dictation detection.

Embodiment 2

Please refer to FIG. 3 , which is a schematic flowchart of another dictation detection method disclosed in an embodiment of the present invention. As shown in FIG. 3 , the dictation detection method may include the following steps.

301. The electronic device acquires, through a camera device on the electronic device, a target angle formed between the top edge of the handwritten notebook and the bottom edge of the electronic device contacting the desktop.

Wherein, the electronic device stands on the desktop, and the handwriting is placed horizontally on the desktop.

302. The electronic device displays the degree of the target angle on the display screen of the electronic device.

303. The electronic device determines whether the target angle is greater than the preset angle; if so, go to step 304; if not, go to step 305-step 307.

304. The electronic device adjusts the color of the degree of the target angle displayed on the display screen to a specified color, and outputs first voice prompt information, where the first voice prompt information is used to prompt the user to adjust the placement position of the handwriting so that the target The angle is adjusted to be less than or equal to the preset angle; wherein, when the target angle is adjusted to be less than or equal to the preset angle, the writing content on the handwritten book is completely captured by the camera device.

Specifically, the specified color may be red, and the electronic device adjusts the color of the degree of the target angle displayed on the display screen to red, which is used to warn the user that the angle formed between the top edge of the handwriting and the bottom edge of the electronic device touching the desktop is too high. large, allowing users to adjust in time.

305. The electronic device acquires, by using the camera device, the target distance between the center of the top edge of the handwritten notebook and the center of the bottom edge of the electronic device touching the desktop.

306. The electronic device determines whether the target distance is greater than the specified distance; wherein, the specified distance is calculated from the target angle, the preset angle and the preset distance; if so, go to step 307; if not, end the process.

In the embodiment of the present invention, the preset distance A is the distance between the bottom edge of the handwritten notebook and the edge of the shooting range of the camera device when the top edge of the handwritten notebook is attached to the bottom edge of the electronic device in contact with the desktop. It is assumed that the target angle is B, the preset angle is C, then the specified distance D=A/cos(C-B).

Specifically, assuming that the specified distance is 3 cm, the electronic device determines whether the target distance between the center of the top edge of the handwritten notebook and the center of the bottom edge of the electronic device touching the desktop is greater than 3 cm, and if the target distance is greater than 3 cm, execute step 307 ; If the target distance is less than or equal to 3 cm, end this process. As shown at 203 in FIG. 2, the angle between the top edge of the handwriting notebook and the bottom edge of the electronic device touching the desktop is smaller than the preset angle, but the angle between the center of the top edge of the handwriting notebook and the center of the bottom edge of the electronic device touching the desktop The distance of the handwritten book is far and larger than the specified distance. At this time, part of the handwritten notebook is not within the shooting range of the camera equipment, and the writing content on the handwritten notebook cannot be completely captured by the shooting device. Therefore, it is necessary to adjust the placement of the handwritten notebook.

As an optional implementation manner, the electronic device can obtain the size of the handwritten book through the photographing device, determine the preset distance according to the size of the handwritten book, and calculate the specified distance according to the preset distance, the target angle and the preset angle; After the device obtains the target distance between the center of the top edge of the handwriting and the center of the bottom edge of the electronic device touching the desktop, it determines whether the target distance is greater than the specified distance. By implementing this embodiment, the preset distance can be adjusted according to different sizes of the handwritten book, thereby making the position adjustment of the handwritten book more accurate.

307. The electronic device outputs second voice prompt information, and the second voice prompt information is used to prompt the user to adjust the placement position of the handwritten book, so that the target distance is adjusted to be less than or equal to the specified distance; wherein, when the target distance is adjusted to When the distance is less than or equal to the specified distance, the writing content on the handwritten notebook is completely captured by the camera device.

Visible, implement the dictation detection method described in Fig. 3, through the target angle formed between the top edge of the handwritten book and the bottom edge of the electronic device contacting the desktop, the center of the top edge of the handwritten book and the center of the bottom edge of the electronic device contacting the desktop The distance between the targets to determine whether the handwritten book is within the shooting range of the camera equipment, if not, prompt the user to adjust the position of the handwritten book, so that the handwritten book is placed within the shooting range of the camera equipment, which is conducive to shooting a complete picture. Write content to improve the effect of dictation detection.

Embodiment 3

Please refer to FIG. 4 , which is a schematic flowchart of another dictation detection method disclosed in an embodiment of the present invention. As shown in FIG. 4 , the dictation detection method may include the following steps.

401. The electronic device acquires, through a camera device on the electronic device, a target angle formed between the top edge of the handwritten notebook and the bottom edge of the electronic device contacting the desktop.

Wherein, the electronic device stands on the desktop, the handwriting book is placed horizontally on the table top, and the handwriting book is a music score.

402. The electronic device determines whether the target angle is greater than the preset angle; if so, perform steps 403 to 411; if not, end the process.

403. The electronic device outputs first voice prompt information, and the first voice prompt information is used to prompt the user to adjust the placement position of the handwritten book, so that the target angle is adjusted to be less than or equal to the preset angle; wherein, when the target angle is adjusted When the angle is less than or equal to the preset angle, the writing content on the handwritten notebook is completely captured by the camera device.

404. The electronic device captures an image of the user's writing on the music score by using a camera device.

In the embodiment of the present invention, the musical score can be a digital notation, and the notes 1, 2, 3, 4, 5, 6, and 7 are used to represent the 7 basic sound levels in the scale, and the pronunciations are do, re, mi, fa, sol, la, si, and rest are represented by 0. The image of the user's writing on the music score captured by the electronic device through the camera device may include one or more of the notes 1, 2, 3, 4, 5, 6, and 7, and can be repeated. When the voice played by the electronic device corresponds to one note, there may be one note in the written image; when the voice played by the electronic device corresponds to multiple notes or a short piece, there may be multiple notes in the written image.

405. The electronic device recognizes the user's writing content on the music score from the writing image.

In the embodiment of the present invention, the electronic device recognizes the content written by the user on the music score from the writing image, that is, recognizes the notes written by the user on the music score.

406. The electronic device acquires the writing information of the user on the music score recorded by the camera device; the writing information includes the writing sequence and the writing note interval.

407. The electronic device divides the written content according to the written information and the number of notes included in the dictation content to obtain several notes.

In this embodiment of the present invention, the electronic device may segment the notes included in the written content according to the writing order of the notes, the interval between the written notes and the number of notes included in the dictation content, and obtain several notes, so that the notes in the dictation content and the written content are different from each other. The notes are in one-to-one correspondence to avoid confusing the uncorresponding notes during detection and reduce the error rate during detection.

408. The electronic device detects several notes according to the notes in the dictation content to obtain a dictation detection result.

In the embodiment of the present invention, the electronic device uses each note in the dictation content to detect each note after the division of the notes included in the written content according to the corresponding relationship of each note after division, and obtains the dictation detection structure, which can improve the accuracy of dictation detection. Accuracy.

It can be seen that by implementing the above method, when the dictation content is a music piece, the notes included in the user's writing content on the music score can be detected, and the corresponding relationship between the dictation content and each note in the writing content can be detected, improving the dictation detection efficiency. Accuracy.

409. The electronic device outputs the dictation detection result.

410. The electronic device outputs and displays the simulated musical keyboard on the display screen of the electronic device, and outputs third voice prompt information; the third voice prompt information is used to prompt the user to play the dictation content on the simulated musical keyboard.

411. The electronic device detects a target note clicked by the user on the simulated musical keyboard, and outputs a sound effect corresponding to the target note.

In the embodiment of the present invention, the above method is implemented, the simulated music keyboard is output and displayed on the display screen, the user is allowed to play the dictation content, and the sound effect played by the user is output, so that the dictation music can be consolidated and trained, and it is also convenient for the user to check his own music. Level.

As an optional embodiment, after outputting the dictation detection result, when the dictation detection result indicates that a certain note is wrong, the electronic device selects a target note group corresponding to a piece of music that includes the note in the written content, and extracts the target note group from the dictation content. The correct note group corresponding to the target note group; play the sound effects corresponding to the target note group and the correct note group. Implementing this embodiment allows the user to compare the sound effects of the wrong notes and the sound effects of the correct notes to further test his own music level.

It can be seen that the implementation of the dictation detection method described in FIG. 4 is conducive to photographing the complete writing content and improves the effect of dictation detection. In addition, when the dictation content is a music piece, the notes included in the user's writing content on the music score can be detected, and the detection can be performed according to the correspondence between the dictation content and each note in the writing content, so as to improve the accuracy of the dictation detection, and also improve the accuracy of the dictation detection. It can output and display the simulated music keyboard on the display screen, let the user play the dictation content, and output the sound effect played by the user, and consolidate and train the dictation music, which is convenient for the user to test his own music level.

Embodiment 4

Please refer to FIG. 5 , which is a schematic structural diagram of an electronic device disclosed in an embodiment of the present invention. As shown in Figure 5, the electronic device may include:

The angle obtaining unit 501 is configured to obtain the target angle formed between the top edge of the handwritten notebook and the bottom edge of the electronic device touching the desktop through the camera device on the electronic device.

Wherein, the electronic device stands on the desktop, and the handwriting is placed horizontally on the desktop.

In the embodiment of the present invention, the electronic device may be a tutoring machine, a learning machine, a learning tablet, etc., which is not limited in the embodiment of the present invention. The camera device on the electronic device can be combined with a reflector, so that the camera device can capture the field of view in different directions, and thus can capture between the top edge of the handwriting notebook and the bottom edge of the electronic device touching the desktop. After receiving the dictation detection instruction triggered by the user through voice or touch screen, the electronic device enters the dictation detection mode, turns on the camera device, and the angle acquisition unit 501 monitors the bottom edge of the handwritten notebook in real time through the camera device to contact the bottom of the desktop with the electronic device. Between edges, obtains the target angle formed between the top edge of the tablet and the bottom edge of the electronic device touching the desktop.

As an optional implementation manner, the angle obtaining unit 501 can obtain the inclination of the electronic device when it stands on the desktop and the shooting angle of the camera device on the electronic device, and obtain the angle between the top edge of the handwriting and the electronic device touching the desktop through the camera device. The initial angle formed between the bottom edges is calibrated according to the inclination of the electronic device and the shooting angle of the camera device to obtain the target angle formed between the top edge of the handwritten notebook and the bottom edge of the electronic device touching the desktop. Implementing this embodiment can make the acquired target angle more closely fit the real angle formed between the top edge of the handwritten notebook and the bottom edge of the electronic device contacting the desktop, thereby improving the accuracy of the target angle.

The first judging unit 502 is used for judging whether the target angle is greater than a preset angle.

Specifically, assuming that the preset angle is 20°, the first determination unit 502 determines whether the target angle formed between the top edge of the handwritten notebook and the bottom edge of the electronic device touching the desktop is greater than 20°; if the target angle is greater than 20°, execute The first output unit 503; if the target angle is less than or equal to 20°, end the process. As shown in Figure 2, the electronic device is standing on the desktop, and the handwriting book is placed horizontally on the desktop. As shown in 201 in Figure 2, the angle between the top edge of the handwriting book and the bottom edge of the electronic device touching the desktop is smaller than the preset At this time, the handwritten notebook is within the shooting range of the camera device, and the writing content on the handwritten notebook can be completely captured by the shooting device; as shown by 202 in Figure 2, between the top edge of the handwritten notebook and the bottom edge of the electronic device touching the desktop The angle is greater than the preset angle. At this time, part of the handwritten notebook is not within the shooting range of the camera equipment, and the writing content on the handwritten notebook cannot be completely captured by the shooting device. Therefore, it is necessary to adjust the placement of the handwritten notebook.

As an optional implementation manner, the first judgment unit 502 can obtain the size of the handwritten book through the photographing device, determine a preset angle according to the size of the handwriting book, and obtain the top edge of the handwritten book through the photographing device and the electronic device touching the desktop. After the target angle formed between the bottom edges, it is determined whether the target angle is greater than the preset angle. By implementing this embodiment, the preset angle can be adjusted according to different sizes of the handwritten book, thereby making the position adjustment of the handwritten book more accurate.

The first output unit 503 is used to output first voice prompt information when the judgment result of the first judgment unit 502 is yes, and the first voice prompt information is used to prompt the user to adjust the placement position of the handwritten book so that the target angle is adjusted to be less than or equal to the preset angle; wherein, when the target angle is adjusted to be less than or equal to the preset angle, the writing content on the handwritten notebook is completely captured by the camera device.

As can be seen, the electronic equipment described in Fig. 5 is implemented, and the target angle formed between the top edge of the handwritten book and the bottom edge of the electronic equipment contacting the desktop is obtained by the camera device on the electronic equipment, if the target angle is less than or equal to the preset angle, At this time, the shooting effect will not be affected by the position of the handwriting; if the target angle is greater than the preset angle, the shooting effect will be affected due to the large position deviation of the handwriting, so a voice prompt is output to prompt the user to adjust the handwriting. The placement position allows the target angle to be adjusted to be less than or equal to the preset angle, so that the handwritten notebook is placed within the shooting range of the camera equipment, which is conducive to shooting the complete writing content and improves the effect of dictation detection.

Embodiment 5

Please refer to FIG. 6 , which is a schematic structural diagram of another electronic device disclosed in an embodiment of the present invention. As shown in FIG. 6 , the electronic device shown in FIG. 6 is obtained by optimizing the electronic device shown in FIG. 5 . Compared with the electronic device shown in FIG. 5 , the electronic device shown in FIG. 6 may further include:

The distance obtaining unit 504 is used to obtain the target distance between the center of the top edge of the handwritten book and the center of the bottom edge of the electronic device contacting the desktop by the camera device when the judgment result of the first judgment unit 502 is no;

The second judging unit 505 is configured to judge whether the target distance is greater than the specified distance; wherein, the specified distance is calculated from the target angle, the preset angle and the preset distance.

In the embodiment of the present invention, the preset distance A is the distance between the bottom edge of the handwritten notebook and the edge of the shooting range of the camera device when the top edge of the handwritten notebook is attached to the bottom edge of the electronic device in contact with the desktop. It is assumed that the target angle is B, the preset angle is C, then the specified distance D=A/cos(C-B).

Specifically, assuming that the specified distance is 3 centimeters, the second judgment unit 505 judges whether the target distance between the center of the top edge of the handwritten notebook and the center of the bottom edge of the electronic device touching the desktop is greater than 3 centimeters, and if the target distance is greater than 3 centimeters, Execute the second output unit 506; if the target distance is less than or equal to 3 cm, the process ends. As shown at 203 in FIG. 2, the angle between the top edge of the handwriting notebook and the bottom edge of the electronic device touching the desktop is smaller than the preset angle, but the angle between the center of the top edge of the handwriting notebook and the center of the bottom edge of the electronic device touching the desktop The distance of the handwritten book is far and larger than the specified distance. At this time, part of the handwritten notebook is not within the shooting range of the camera equipment, and the writing content on the handwritten notebook cannot be completely captured by the shooting device. Therefore, it is necessary to adjust the placement of the handwritten notebook.

As an optional implementation manner, the second judgment unit 505 can obtain the size of the handwritten book through the photographing device, determine the preset distance according to the size of the handwritten book, and calculate the specified distance according to the preset distance, the target angle and the preset angle; After acquiring the target distance between the center of the top edge of the handwritten notebook and the center of the bottom edge of the electronic device touching the desktop through the camera device, it is determined whether the target distance is greater than the specified distance. By implementing this embodiment, the preset distance can be adjusted according to different sizes of the handwritten book, thereby making the position adjustment of the handwritten book more accurate.

The second output unit 506 is configured to output second voice prompt information when the judgment result of the second judgment unit 505 is yes, and the second voice prompt information is used to prompt the user to adjust the placement position of the handwritten book so that the target distance is adjusted to be less than or equal to the specified distance; wherein, when the target distance is adjusted to be less than or equal to the specified distance, the writing content on the handwritten book is completely captured by the camera device.

The degree display unit 507 is used for after the angle obtaining unit 501 obtains the target angle formed between the top edge of the handwritten book and the bottom edge of the electronic device contacting the desktop through the camera device on the electronic device, and the first judgment unit 502 judges the target angle. Whether the degree of the target angle is displayed on the display screen of the electronic device before it is greater than the preset angle;

The first output unit 503 is further configured to adjust the color of the degree of the target angle displayed on the display screen to a specified color when the judgment result of the first judgment unit 502 is yes, and output the first voice prompt information.

Specifically, the specified color can be red, and the first output unit 503 adjusts the color of the degree of the target angle displayed on the display screen to red, which is used to warn the user that the top edge of the handwritten notebook and the bottom edge of the electronic device contacting the desktop form a The angle is too large, so that the user can adjust it in time.

The image capturing unit 508 is configured to capture an image of the user's writing on the music score by using a camera device after the first output unit 503 outputs the first voice prompt information.

In the embodiment of the present invention, the musical score can be a digital notation, and the notes 1, 2, 3, 4, 5, 6, and 7 are used to represent the 7 basic sound levels in the scale, and the pronunciations are do, re, mi, fa, sol, la, si, and rest are represented by 0. The image of the user's writing on the music score captured by the image capturing unit 508 through the camera device may include one or more of notes 1, 2, 3, 4, 5, 6, and 7, and may be repeated. When the voice played by the electronic device corresponds to one note, there may be one note in the written image; when the voice played by the electronic device corresponds to multiple notes or a short piece, there may be multiple notes in the written image.

The content recognition unit 509 is configured to recognize the user's writing content on the music score from the writing image.

In this embodiment of the present invention, the content recognition unit 509 recognizes the content written by the user on the music score from the writing image, that is, recognizes the notes written by the user on the music score.

The dictation detection unit 510 is used to detect the written content according to the dictation content played by the electronic device, and obtain the dictation detection result; wherein, the dictation content is several musical notes;

The result output unit 511 is used for outputting the dictation detection result.

The dictation detection unit 510 detects the written content according to the dictation content played by the electronic device, and the manner of obtaining the dictation detection result is specifically:

Obtain the writing information of the user on the music score recorded by the camera device; the writing information includes the writing sequence and the interval of writing notes; and divide the writing content according to the writing information and the number of notes included in the dictation content to obtain several notes; and according to the dictation The notes in the content are detected for several notes to obtain dictation detection results.

In the embodiment of the present invention, the dictation detection unit 510 may segment the notes included in the written content according to the writing order of the notes, the interval of the written notes, and the number of notes included in the dictation content, and obtain several notes, so that the notes in the dictation content and the written The notes of the content are in one-to-one correspondence, so as to avoid confusing the uncorresponding notes during detection and reduce the error rate during detection.

In the embodiment of the present invention, the dictation detection unit 510 uses each note in the dictation content to detect each note after the division of the notes included in the written content according to the corresponding relationship of each divided note, and obtains a dictation detection structure, which can improve the dictation. detection accuracy.

It can be seen that by executing the above unit, when the dictation content is a music piece, the notes included in the user's writing content on the music score can be detected, and the corresponding relationship between the dictation content and each note in the writing content can be detected, improving the dictation detection. Accuracy.

The output display unit 512 is used to output and display the simulated music keyboard on the display screen of the electronic device after the result output unit outputs the dictation detection result, and output the third voice prompt information; the third voice prompt information is used to prompt the user to simulate the music keyboard playing dictation content;

The detection and output unit 513 is configured to detect the target note clicked by the user on the simulated musical keyboard, and output the sound effect corresponding to the target note.

In the embodiment of the present invention, executing the above unit, outputting and displaying a simulated musical keyboard on the display screen, allowing the user to play the dictation content, and outputting the sound effect played by the user, can consolidate and train the dictation music, and is also convenient for the user to check his own music. Level.

As an optional embodiment, after outputting the dictation detection result, when the dictation detection result indicates that a certain note is wrong, the detection output unit 513 selects a target note group corresponding to a piece of music including the note in the written content, and extracts the dictation The correct note group corresponding to the target note group in the content; play the sound effects corresponding to the target note group and the correct note group. Implementing this embodiment allows the user to compare the sound effects of the wrong notes and the sound effects of the correct notes to further test his own music level.

It can be seen that, by implementing the electronic device described in FIG. 6, when the handwritten book is not within the shooting range of the camera equipment, the user is prompted to adjust the placement position of the handwritten book, so that the handwritten book is placed within the shooting range of the camera equipment, which is conducive to shooting To complete written content, improve the effect of dictation detection. In addition, when the dictation content is a music piece, the notes included in the user's writing content on the music score can be detected, and the detection can be performed according to the correspondence between the dictation content and each note in the writing content, so as to improve the accuracy of the dictation detection, and also improve the accuracy of the dictation detection. It can output and display the simulated music keyboard on the display screen, let the user play the dictation content, and output the sound effect played by the user, and consolidate and train the dictation music, which is convenient for the user to test his own music level.

Embodiment 6

Please refer to FIG. 7 , which is a schematic structural diagram of another electronic device disclosed in an embodiment of the present invention. As shown in Figure 7, the electronic device may include:

a memory 701 storing executable program code;

a processor 702 coupled to the memory 701;

The processor 702 invokes the executable program code stored in the memory 701 to execute any one of the dictation detection methods in FIG. 1 , FIG. 3 or FIG. 4 .

An embodiment of the present invention discloses a computer-readable storage medium, which stores a computer program, wherein the computer program causes a computer to execute any one of the dictation detection methods in FIG. 1 , FIG. 3 or FIG. 4 .

The embodiment of the present invention also discloses a computer program product, wherein when the computer program product runs on the computer, the computer is caused to execute some or all of the steps of the methods in the above method embodiments.

Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing relevant hardware through a program, and the program can be stored in a computer-readable storage medium, and the storage medium includes a read-only storage medium. Memory (Read-Only Memory, ROM), Random Access Memory (Random Access Memory, RAM), Programmable Read-only Memory (PROM), Erasable Programmable Read Only Memory (Erasable Programmable Read Only Memory, EPROM), One-time Programmable Read-Only Memory (OTPROM), Electronically-Erasable Programmable Read-Only Memory (EEPROM), CompactDisc Read -Only Memory, CD-ROM) or other optical disk storage, magnetic disk storage, magnetic tape storage, or any other computer-readable medium that can be used to carry or store data.

A dictation detection method and an electronic device disclosed in the embodiments of the present invention are described above in detail. The principles and implementations of the present invention are described in this paper by using specific examples. The descriptions of the above embodiments are only used to help understand the present invention. At the same time, for those skilled in the art, according to the idea of the present invention, there will be changes in the specific implementation and application scope. In summary, the content of this specification should not be construed as Limitations of the present invention.

Claims (12)

1. a dictation detection method, is characterized in that, electronic equipment stands on the desktop, and handwriting is placed horizontally on the described desktop, and the method comprises: Acquire the target angle formed between the top edge of the handwritten notebook and the bottom edge of the electronic device contacting the desktop through the camera device on the electronic device; judging whether the target angle is greater than a preset angle; If yes, output first voice prompt information, the first voice prompt information is used to prompt the user to adjust the placement position of the handwritten notebook, so that the target angle is adjusted to be less than or equal to the preset angle; wherein , when the target angle is adjusted to be less than or equal to the preset angle, the writing content on the handwriting notebook is completely captured by the camera device. 2. The method according to claim 1, wherein after judging that the target angle is less than or equal to a preset angle, the method further comprises: Acquiring, by the camera device, a target distance between the center of the top edge of the handwritten notebook and the center of the bottom edge of the electronic device touching the desktop; Determine whether the target distance is greater than a specified distance; wherein, the specified distance is calculated from the target angle, the preset angle and the preset distance; If yes, output second voice prompt information, the second voice prompt information is used to prompt the user to adjust the placement position of the handwritten notebook, so that the target distance is adjusted to be less than or equal to the specified distance; Wherein, when the target distance is adjusted to be less than or equal to the specified distance, the writing content on the handwritten notebook is completely captured by the camera device. 3 . The method according to claim 2 , wherein the image obtained between the top edge of the handwritten book obtained by the camera device on the electronic device and the bottom edge of the electronic device contacting the desktop is formed. 4 . After the target angle, and before the judging whether the target angle is greater than the preset angle, the method further includes: Display the degree of the target angle on the display screen of the electronic device; And, when it is determined that the target angle is greater than the preset angle, the color of the degree of the target angle displayed on the display screen is adjusted to a specified color, and the step of outputting the first voice prompt information is performed. 4. method according to claim 1, is characterized in that, described handwritten book is music score; After described outputting first voice prompt information, described method also comprises: Photograph the image of the user's writing on the music score by using the camera device; Identifying the user's writing on the music score from the writing image; Detect the written content according to the dictation content played by the electronic device, and obtain a dictation detection result; wherein the dictation content is a number of musical notes; The dictation detection result is output. 5. The method according to claim 4, wherein the detecting the written content according to the dictation content played by the electronic device, and obtaining the dictation detection result, comprises: Acquiring the writing information of the user on the music score recorded by the camera device; the writing information includes writing order and writing note interval; Divide the written content according to the written information and the number of notes included in the dictation content to obtain several notes; The several notes are detected according to the notes in the dictation content to obtain a dictation detection result. 6. The method according to claim 5, wherein after the outputting the dictation detection result, the method further comprises: Output and display the simulated musical keyboard on the display screen of the electronic device, and output third voice prompt information; the third voice prompt information is used to prompt the user to play the dictation content on the simulated musical keyboard; A target note clicked by the user on the simulated musical keyboard is detected, and a sound effect corresponding to the target note is output. 7. An electronic device, characterized in that the electronic device stands on a desktop, and a handwriting book is placed horizontally on the desktop, and the electronic device comprises: an angle obtaining unit, configured to obtain the target angle formed between the top edge of the handwritten notebook and the bottom edge of the electronic device contacting the desktop through the camera device on the electronic device; a first judging unit for judging whether the target angle is greater than a preset angle; The first output unit is configured to output first voice prompt information when the judgment result of the first judgment unit is yes, and the first voice prompt information is used to prompt the user to adjust the placement position of the handwritten book, so as to Adjusting the target angle to be less than or equal to the preset angle; wherein, when the target angle is adjusted to be less than or equal to the preset angle, the writing content on the handwritten book is captured by the camera device Completely photographed. 8. The electronic device according to claim 7, wherein the electronic device further comprises: The distance acquisition unit is configured to acquire, through the camera device, the center of the top edge of the handwritten notebook and the center of the bottom edge of the desktop contacting the electronic device when the determination result of the first determination unit is no. target distance between a second judging unit, configured to judge whether the target distance is greater than a specified distance; wherein, the specified distance is calculated from the target angle, the preset angle and the preset distance; a second output unit, configured to output second voice prompt information when the judgment result of the second judgment unit is yes, where the second voice prompt information is used to prompt the user to adjust the placement position of the handwritten notebook , so that the target distance is adjusted to be less than or equal to the specified distance; wherein, when the target distance is adjusted to be less than or equal to the specified distance, the writing content on the handwritten book is captured by the camera device Completely photographed. 9. The electronic device according to claim 8, wherein the electronic device further comprises: A degree display unit for, after the angle acquisition unit acquires the target angle formed between the top edge of the handwritten notebook and the bottom edge of the electronic device touching the desktop through the camera device on the electronic device, and Before the first judging unit judges whether the target angle is greater than a preset angle, the display screen of the electronic device displays the degree of the target angle; The first output unit is further configured to adjust the color of the degree of the target angle displayed on the display screen to a specified color when the judgment result of the first judgment unit is yes, and output the first voice prompt information . 10. The electronic device according to claim 7, wherein the handwritten book is a music score; the electronic device further comprises: an image capturing unit, configured to capture an image of the user's writing on the music score by using the camera device after the first output unit outputs the first voice prompt information; a content recognition unit for recognizing the user's writing content on the music score from the writing image; a dictation detection unit, configured to detect the written content according to the dictation content played by the electronic device, and obtain a dictation detection result; wherein the dictation content is a number of musical notes; A result output unit, configured to output the dictation detection result. 11. The electronic device according to claim 10, wherein the dictation detection unit comprises: an acquisition subunit, used for acquiring the writing information of the user on the music score recorded by the camera device; the writing information includes writing order and writing note interval; A dividing subunit, for dividing the writing content according to the writing information and the number of notes included in the dictation content to obtain several notes; A detection subunit, configured to detect the several notes according to the notes in the dictation content to obtain a dictation detection result. 12. The electronic device according to claim 11, wherein the electronic device further comprises: The output display unit is used for outputting and displaying the simulated music keyboard on the display screen of the electronic device after the result output unit outputs the dictation detection result, and outputting third voice prompt information; the third voice prompt information uses for prompting the user to play the dictation content on the simulated musical keyboard; A detection and output unit, configured to detect the target note clicked by the user on the simulated musical keyboard, and output the sound effect corresponding to the target note.

Images