CN115607978A - Control method and device of intelligent interactive equipment and intelligent interactive flat panel - Google Patents

Abstract

The invention discloses a control method and device of intelligent interaction equipment and an intelligent interaction panel. Wherein, the method comprises the following steps: displaying interaction prompt information, wherein the interaction prompt information is used for indicating an interaction subject to complete preset operation on an interaction object; receiving a completion instruction, and acquiring a first image of the interactive object; extracting operation result information of the interaction subject for executing the preset operation from the first image of the interaction object, and determining an evaluation parameter for executing the preset operation on the interaction subject based on the operation result information, wherein the evaluation parameter is used for representing the accuracy of the interaction subject for executing the preset operation. The invention solves the technical problem of single playing method caused by lack of interaction of building blocks in the prior art.

Description

Control method and device of intelligent interactive equipment and intelligent interactive flat panel

technical field

The present invention relates to the field of Internet technologies, in particular to a control method and device for an intelligent interactive device and an intelligent interactive panel.

Background technique

Children's building block toys are an important part of early childhood education. It can effectively help children develop intelligence, train children's hand-eye coordination, and help children develop their imagination. Comprehensive use of various types of building blocks to build objects is convenient for imagination. and the development of creativity.

However, the current children's building block toys lack interaction and need to be built by children themselves or with the assistance of adults. It is difficult to effectively cultivate children's cognitive abilities of shape, color, and size , as well as children's hand-eye coordination, attention cognition and other related thinking abilities.

For the above problems, no effective solution has been proposed yet.

Contents of the invention

Embodiments of the present invention provide a control method and device for an intelligent interactive device, and an intelligent interactive tablet, so as to at least solve the technical problem of a single playing method due to the lack of interaction of building blocks in the prior art.

According to an aspect of an embodiment of the present invention, there is provided a control method for an intelligent interactive device, including: displaying interactive prompt information, wherein the interactive prompt information is used to instruct the interactive subject to complete a preset operation on the interactive object; receiving a completion instruction, and Collecting the first image of the interactive object; extracting the operation result information of the interactive subject performing the preset operation from the first image of the interactive object, and determining the evaluation parameters for performing the preset operation on the interactive subject based on the operation result information, wherein the evaluation parameter is used It is used to characterize the accuracy of the interaction subject to perform the preset operation.

According to another aspect of the embodiments of the present invention, there is also provided a control device for an intelligent interactive device, including: a display module, configured to display interaction prompt information, wherein the interaction prompt information is used to instruct the interaction subject to complete the preset of the interaction object Operation; a receiving module, configured to receive a completion instruction, and collect the first image of the interactive object; a determining module, configured to extract the operation result information of the interactive subject performing a preset operation from the first image of the interactive object, and based on the operation result information An evaluation parameter for performing a preset operation on the interaction subject is determined, wherein the evaluation parameter is used to characterize the accuracy of the interaction subject performing the preset operation.

According to another aspect of the embodiments of the present invention, there is also provided a computer storage medium. The above computer storage medium stores a plurality of instructions, and the instructions are suitable for being loaded by a processor to execute any one of the above method steps.

According to another aspect of the embodiments of the present invention, there is also provided an intelligent interactive tablet, including: a processor and a memory; wherein, the memory stores a computer program, and the computer program is suitable for being loaded by the processor and executing any one of the above methods step.

In the embodiment of the present invention, the control method of the intelligent interactive device includes: displaying interactive prompt information, wherein the interactive prompt information is used to instruct the interactive subject to complete the preset operation on the interactive object; receiving the completion instruction, and collecting the first image of the interactive object ; Extract the operation result information of the interactive subject performing the preset operation from the first image of the interactive object, and determine the evaluation parameters for performing the preset operation on the interactive subject based on the operation result information, wherein the evaluation parameters are used to represent the interactive subject's execution of the preset operation the accuracy of the operation. In the above solution, the intelligent interactive device displays interactive prompt information to the interactive subject through voice, image, animation, and picture. The operation video is set, and the accuracy of the interactive subject's execution of the preset operation is evaluated in real time according to the evaluation parameters, which solves the technical problem of single gameplay due to the lack of interaction of building blocks in the prior art.

Description of drawings

The accompanying drawings described here are used to provide a further understanding of the present invention and constitute a part of the application. The schematic embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute improper limitations to the present invention. In the attached picture:

FIG. 1 is a flow chart of a control method for an intelligent interactive device according to an embodiment of the present invention;

Fig. 2 is a schematic diagram of a first optional interaction with building blocks according to an embodiment of the present invention;

Fig. 3a is a schematic diagram of a second optional interaction with building blocks according to an embodiment of the present invention;

Fig. 3b is a schematic diagram of a third optional interaction with building blocks according to an embodiment of the present invention;

Fig. 4 is a schematic diagram of a fourth optional building block interaction according to an embodiment of the present invention;

Fig. 5 is a schematic diagram of a fifth optional building block interaction according to an embodiment of the present invention;

Fig. 6 is a schematic diagram of a second image of an interactive object according to an embodiment of the present invention;

Fig. 7a is a schematic diagram of the first part of interactive objects obtained according to Fig. 6;

Fig. 7b is a schematic diagram of the second part of interactive objects obtained according to Fig. 6;

Fig. 7c is a schematic diagram of a third part of interactive objects obtained according to Fig. 6;

Fig. 7d is a schematic diagram of the fourth part of interactive objects obtained according to Fig. 6;

Fig. 8a is a schematic diagram of expansion and erosion of an interactive object according to Fig. 7c;

Fig. 8b is a schematic diagram of an outline of an interactive object according to Fig. 8a;

FIG. 9 is a schematic diagram of a camera range of a camera device of an intelligent interactive device according to an embodiment of the present invention;

Fig. 10 is a flowchart of another intelligent interactive device according to an embodiment of the present invention;

Fig. 11 is a schematic diagram of a control device of an intelligent interactive device according to an embodiment of the present invention;

Fig. 12 is a schematic diagram of an intelligent interactive tablet provided according to an embodiment of the present invention.

detailed description

In order to enable those skilled in the art to better understand the solutions of the present invention, the following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only It is an embodiment of a part of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts shall fall within the protection scope of the present invention.

It should be noted that the terms "first" and "second" in the description and claims of the present invention and the above drawings are used to distinguish similar objects, but not necessarily used to describe a specific sequence or sequence. It is to be understood that the data so used are interchangeable under appropriate circumstances such that the embodiments of the invention described herein can be practiced in sequences other than those illustrated or described herein. Furthermore, the terms "comprising" and "having", as well as any variations thereof, are intended to cover a non-exclusive inclusion, for example, a process, method, system, product or device comprising a sequence of steps or elements is not necessarily limited to the expressly listed instead, may include other steps or elements not explicitly listed or inherent to the process, method, product or apparatus.

Example 1

According to an embodiment of the present invention, an embodiment of a control method for an intelligent interactive device is provided. It should be noted that the steps shown in the flow chart of the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions, and , although a logical order is shown in the flowcharts, in some cases the steps shown or described may be performed in an order different from that shown or described herein.

Fig. 1 is a flowchart of a method for controlling an intelligent interactive device according to an embodiment of the present invention. As shown in Fig. 1, the method includes the following steps:

Step S102, displaying interaction prompt information, wherein the interaction prompt information is used to instruct the interaction subject to complete a preset operation on the interaction object.

The above-mentioned intelligent interactive device may be an intelligent terminal device with a camera device, such as a tablet computer, a mobile phone, an intelligent interactive tablet, and the like. The above-mentioned interactive objects may be educational toys such as building blocks and jigsaw puzzles. The above interactive prompt information can be displayed to the interacting subject through the screen of the intelligent interactive device, and the interactive prompt information can be played in the form of voice broadcast. The content of the interactive prompt information can include text, pictures, animation or the fusion of multiple contents. The above-mentioned interaction subject may be a user who operates the interaction object, such as a young child. In the embodiments of the present application, the interaction subject is all taken as an example for illustration.

In an optional implementation manner, in a classroom or family setting, the above-mentioned intelligent interactive device is a tablet computer, the above-mentioned interactive object can be a set of building blocks, and the above-mentioned interactive prompt information can be used to prompt children to continue to use the set of building blocks. Certain operations, for example: the interactive prompt information can be: ask the children to find all the building blocks that are triangular in shape; it can also be: ask the children to find the building blocks of X color; it can also be: ask the children to build the blocks into the picture shape etc.

In another optional implementation manner, the above-mentioned interactive prompt information may be continuous, that is, after the user performs an operation according to the current interactive prompt, the next prompt information is given based on the user's operation result. For example: after the user prompts the information "Please find all the building blocks whose shapes are triangles" according to the current interactive prompt information, according to the current user's operation result, give the next interactive prompt information "Please find the color in the triangle you found They are all red triangular building blocks".

It should be noted that the above interactive prompt information is displayed on the interactive interface of the interactive smart device. The interactive interface may be provided by a designated application program installed on the smart interactive device, or may be provided by a designated web page accessed by the smart interactive device.

Step S104, receiving a completion instruction, and collecting a first image of the interactive object.

The above-mentioned completion instruction can be issued by the interactive subject operating on the intelligent interactive device. For example, the screen of the above-mentioned intelligent interactive device is provided with controls such as "the game has been completed", and the interactive subject can end the game by touching the control and complete the command. Send to smart interactive devices. The above completion instructions can also be obtained by recognizing voice instructions. For example, the user can send voice instructions such as "I have completed the game" to the smart interactive device, and the smart interactive device receives the completion instruction by recognizing the voice, and collects the interactive object first image. The above-mentioned completion instruction can also be determined according to the time preset on the intelligent interactive device. For example, the operation time of "10 minutes" is preset on the intelligent interactive device. When the operation time ends, it is determined that the intelligent interactive device receives the completion instruction. And a first image of the interactive object is collected.

Step S106, extracting the operation result information of the preset operation performed by the interactive subject from the first image of the interactive object, and determining evaluation parameters for performing the preset operation on the interactive subject based on the operation result information.

Wherein, the evaluation parameter is used to characterize the accuracy of the interaction subject to perform the preset operation.

The operation result information of the above-mentioned preset operation is used to indicate the information extracted from the first image that can represent the operation result, and this operation result information matches the interactive prompt information. For example, the interactive prompt information is used to prompt the operation of "ask the children to find all the building blocks whose shapes are triangles", and the extracted operation result information is an image in which all the building blocks whose shapes are triangles can be extracted from the first image.

The above evaluation parameters may represent the accuracy of the preset operation performed by the interacting subject through multiple grades, or may be represented by a score. The higher the grade or score, the higher the accuracy of the preset operation performed by the interacting subject.

It should be noted that the above intelligent interactive device is preset with standard operation result information corresponding to the interactive prompt information, and the standard operation result information represents the information that the interactive subject completes the correct preset operation result on the interactive object according to the interactive prompt information. It is used for comparing with the operation result information extracted from the first image of the interactive object, so as to determine evaluation parameters between the operation result information of the preset operation and the standard operation result information.

In an optional implementation manner, the above-mentioned interactive objects are building blocks, and the operation result information of the above-mentioned preset operation may include the operation result information of all triangular building blocks that are placed at a specified position, are black in color, and have the same size, and the above-mentioned evaluation parameters are passed score to represent. Specifically, by comparing the operation result information with the standard operation result information, the evaluation parameters for the interaction subject to perform the preset operation can be determined. When the score of the evaluation parameter is 100 points, it means that the interactive subject has correctly completed the preset operation of the interactive object according to the interactive prompt information; when the score of the evaluation parameter is within 0-100 points, it means that the interactive subject has completed the interaction according to the interactive prompt information Partial preset operations on the interactive object; when the score of the evaluation parameter is 0, it means that the interactive subject has not completed any preset operation on the interactive object according to the interactive prompt information.

It can be seen from the above that in the above embodiments of the present application, the control method of the intelligent interactive device includes: displaying interactive prompt information, wherein the interactive prompt information is used to instruct the interactive subject to complete the preset operation on the interactive object; receiving the completion instruction, and collecting the interactive object The first image of the interactive object; extract the operation result information of the interactive subject performing the preset operation from the first image of the interactive object, and determine the evaluation parameters for the interactive subject to perform the preset operation based on the operation result information, wherein the evaluation parameters are used to characterize the interaction The degree to which a subject performs a predetermined action accurately. In the above solution, the intelligent interactive device displays interactive prompt information to the interactive subject through voice, image, animation, and picture. The first image of the operation result, and determine the evaluation parameters used to represent the accuracy of the operation according to the operation result information in the first image, which not only enriches the interaction mode of building block interaction, but also improves the user's interest in building blocks, and solves the problem caused by the current situation. In some technologies, the lack of interaction of building blocks leads to a single technical problem in the gameplay.

As an optional embodiment, the above-mentioned interactive object is a building block, and the above-mentioned interactive prompt information includes at least one of the following types: interactive prompt information for distinguishing the shape of the building block; interactive prompt information for distinguishing the size of the building block; Interactive tooltip for block color.

Fig. 2 is a schematic diagram of the first optional building block interaction according to an embodiment of the present invention. In an optional implementation, children's shape recognition ability can be cultivated through interactive prompt information for distinguishing building block shapes . As shown in Figure 2, the interactive prompt message "Please find all the rectangular building blocks in the building blocks" displayed on the smart interactive device can guide children to accurately find building blocks of a specific shape among building blocks of different shapes.

Fig. 3a is a schematic diagram of a second optional building block interaction according to an embodiment of the present invention. In an optional implementation, children's size cognition ability can be cultivated through interactive prompt information for distinguishing the size of building blocks . As shown in Figure 3a, through the interactive prompt message "Please find the building blocks shown on the screen" displayed on the smart interactive device, children can be guided to accurately find images of the same size as the building blocks shown on the screen among different sizes of building blocks .

Fig. 3b is a schematic diagram of a third optional building block interaction according to an embodiment of the present invention. In another optional implementation manner, as shown in Fig. 3b, the interactive information "please Find the small triangle in the building blocks and put them on the left, and the big triangles on the right", and then guide the children to distinguish the size.

Fig. 4 is a schematic diagram of a fourth optional building block interaction according to an embodiment of the present invention. In an optional implementation, children's color recognition ability can be cultivated through interactive prompt information for distinguishing the colors of building blocks . As shown in Figure 4, the interactive prompt message "Please find all the black blocks among the blocks" displayed on the smart interactive device can guide children to accurately find all the blocks of the same color among the blocks of different colors.

Fig. 5 is a schematic diagram of a fifth optional building block interaction according to an embodiment of the present invention. In an optional implementation manner, in combination with what is shown in Fig. 5, the interactive information "Please put together Show the building block graphics shown on the screen", and then guide children to accurately find the corresponding building blocks among different building blocks, and spell out the corresponding building block shapes according to the building block shape prompts on the screen.

It should be noted that the above-mentioned first image is obtained by an image acquisition device communicating with the intelligent interactive device. The image acquisition device can be a built-in camera or an external camera of the device. Figures 2-5 are all illustrated with an external camera as an example. The middle dotted line area is the image acquisition area of the intelligent interactive device.

As an optional embodiment, the above method further includes: collecting a second image, where the second image includes a plurality of interactive objects to be operated; and identifying attribute information of the interactive objects to be operated based on the second image.

The interactive objects to be operated in the above-mentioned second image are all interactive objects, for example, when the interactive objects are building blocks, the above-mentioned interactive objects to be operated are a whole set of building blocks.

The collection of the above second image may be obtained by a camera device of the intelligent interactive device. For example, as shown in Figure 6, before the building block game process starts, all building blocks are photographed through the camera of the intelligent interactive device, and the attribute information of all building blocks in Figure 6 is obtained to realize the registration and identification of all building blocks.

The above attribute information of the interactive object may include color information, outline information and shape information of the interactive object. Referring again to FIG. 6 , in an optional implementation manner, based on the second image, the color, contour and shape of each building block can be recognized.

As an optional embodiment, the attribute information of the interactive object includes color information of the interactive object, and identifying the attribute information of the interactive object to be operated based on the second image includes: color-segmenting the second image to obtain each The sub-image corresponding to the interactive object to be operated; convert the sub-image to HSV space to obtain the first parameter of the sub-image in the hue channel and the second parameter of the saturation channel; determine the interaction to be operated based on the first parameter and the second parameter The color information of the object.

Since the image collected by the camera is an RGB three-channel image, the RGB value indicates the color intensity of the corresponding channel, which cannot reflect the color range of the picture. The sub-image is converted to the HSV (hue, saturation, lightness) space, and the H component of the HSV image space can be used. Clearly express the color characteristics of an image. The first parameter of the hue channel is used to represent the hue of the sub-image, and the second parameter of the saturation channel is used to represent the saturation of the sub-image.

In an optional implementation, when the sub-image is converted to HSV space, the hue channel H is set to a preset value of H _color , and the saturation channel S is set to a preset value of S _color , by converting each sub-image The value of the pixel in the sub-image is judged by the color interval, and then the final color area of the sub-image is obtained, wherein, the formula for judging the color interval of the value of each pixel in the sub-image is:

If the values h _i and _si of the hue channel H and saturation channel S of a certain sub-image pixel value satisfy the above judgment formula, it is considered that the color of a certain sub-image of the interactive object is a preset color. As shown in Figures 7a, 7b, 7c, and 7d, the areas of all blue, green, yellow, and orange building blocks in Figure 6 are obtained, respectively.

At the same time, in order to deal with the color deviation problem caused by lighting in different environments, when determining the first parameter of the hue channel and the second parameter of the saturation channel of a sub-image pixel, the color value of the interactive object to be operated is calibrated, specifically The method is to calculate the quadratic average of the first parameter and the second parameter of all pixel values in each sub-image, and then obtain the final color information of the interactive object to be operated.

It should be noted that when performing color segmentation on the second image, the second image is automatically color segmented according to the color information of the interactive object.

As an optional embodiment, the attribute information of the interactive object includes the outline information of the interactive object. Based on the second image, identifying the attribute information of the interactive object to be operated further includes: performing expansion processing on the sub-image to obtain the expanded the sub-image of the sub-image; corroding the expanded sub-image to obtain the corroded sub-image; performing contour detection on the corroded sub-image to obtain the contour information of the interactive object to be operated.

After performing color segmentation on the second image, it is necessary to further extract the shape of the interactive object to obtain the outline information of the interactive object to be operated.

In an optional implementation manner, when performing dilation processing on the sub-image, it can be completed in the following manner, using an expansion structure element to scan each element in the sub-image, and using each pixel in the expansion structure element to The "AND" operation is performed on the pixels covered by it. If they are all 0, the pixel is 0, otherwise it is 1; through this expansion operation, the expanded sub-image can be obtained.

In an optional implementation, when performing erosion processing on the expanded sub-image, the corroded kernel can choose a larger value, as shown in Figure 7c, after expansion and erosion processing, the image in Figure 8a is obtained . Wherein, the above corrosion processing can be completed in the following manner, using a corrosion structure element to scan each element in the expanded sub-image, and performing an "AND" operation with each pixel in the corrosion structure element and the pixel covered by it, If they are all 1, the pixel is 1, otherwise it is 0; through this erosion operation, the sub-image after erosion processing can be obtained.

In an optional implementation manner, when performing contour detection on the corroded sub-image, one of the sobel operator, Prewitt operator, Canny operator and Laplacian operator can be used to analyze the corroded sub-image Perform contour detection to obtain the contour of the building block as shown in Figure 8b.

As an optional embodiment, the attribute information of the interactive object includes shape information of the interactive object, and the attribute information of the interactive object to be operated is identified based on the second image, and further includes: performing geometrical analysis on the contour information of the interactive object to be operated The detection of the characteristics obtains the shape information of the interactive object to be operated.

The above-mentioned geometric characteristics may include features such as volume, geometric center, and surface area of the interactive object, and the shape information of the interactive object to be operated in the second image is determined by performing corresponding geometric characteristic detection on the above-mentioned contour information.

As an optional embodiment, the interaction prompt information is also used to indicate the operation area, and extracting the operation result information of the interactive subject performing the preset operation from the first image of the interactive object includes: obtaining the information corresponding to the operation area in the first image Area image: identify the attribute information of the interactive object in the area image, and obtain the operation result information.

The above indication operation area indicates the area where the interaction subject needs to place the interaction object according to the interaction prompt information. In this scheme, in addition to displaying the interactive prompt information, the interaction also displays the image collected by the image acquisition device in real time. The interactive prompt information can indicate a part of the area in the image collected by the image acquisition device as the operation area, so as to perform operations from this area. Identification of the result of the operation.

Fig. 9 is a schematic diagram of a sixth optional building block interaction according to an embodiment of the present invention. In an optional implementation manner, in combination with Fig. 9 , the interactive prompt message is: Please put the found black building In the dotted line box on the screen, that is, the interactive prompt information instructs the interactive subject to put the black building blocks in the designated area. When the intelligent interactive device interacts with the interactive subject under the interactive prompt information, it will extract the operation result information from the indicated operation area . Still taking FIG. 9 as an example, only the attribute information of the interactive objects in the frame shown on the screen can be obtained, and then the operation result information can be obtained.

As an optional embodiment, determining the evaluation parameters for performing preset operations on the interaction subject based on the operation result information includes: obtaining standard operation result information corresponding to the interaction prompt information; obtaining the operation extracted from the first image of the interaction object The matching degree parameter between the result information and the standard operation result information; determine the matching degree parameter as an evaluation parameter.

The above-mentioned standard operation result information can be set on the intelligent interactive device in a preset manner, and can be obtained from the intelligent interactive device when determining evaluation parameters for performing preset operations on the interactive subject based on the operation result information. The above-mentioned standard operation result information is the information of the result of the interaction subject completing the correct preset operation on the interaction object according to the interaction prompt information.

The above-mentioned matching degree parameter is used to characterize the accuracy of the interaction subject to perform the preset operation.

In an optional implementation manner, the above-mentioned interactive objects are building blocks, and the operation result information of the above-mentioned preset operation may include the operation result information of all rectangular building blocks that are placed at a specified position, are black in color, and have the same size, and the above-mentioned matching degree parameter Multiple grades are used to indicate the degree of accuracy with which the interactive subject performs preset operations. Specifically, a matching degree parameter between the operation result information extracted from the first image of the interactive object and the standard operation result information may be acquired. And the three grades of "excellent", "good" and "poor" as an example, when the matching degree parameter is "excellent", it means that the interactive subject has correctly completed all the preset operations on the interactive object according to the interactive prompt information; when the matching When the degree parameter is "good", it means that the interactive subject has completed some preset operations on the interactive object according to the interactive prompt information; when the matching degree parameter is "poor", it means that the interactive subject has completed the interactive object according to the interactive prompt information. A small number of preset operations. Wherein the above-mentioned all preset operations, some preset operations and a small part of preset operations are relative terms.

As an optional embodiment, after extracting the operation result information of the preset operation performed by the interactive subject from the first image of the interactive object, and determining the evaluation parameters for performing the preset operation on the interactive subject based on the operation result information, the above method It also includes: judging whether the evaluation parameters meet the preset conditions; if the evaluation parameters meet the preset conditions, sending at least one of the following information to the designated terminal: interactive prompt information, the first image, evaluation parameters, and the interactive subject operating the interactive object video information, wherein the video information is collected during the process of the interactive subject operating the interactive object.

The foregoing preset conditions may be determined according to actual requirements. For example, it may be that the evaluation parameter is higher than the first preset value, the evaluation parameter is lower than the second preset value, and so on. The above designated terminal can be a smart device of the parents of the child, so that the parents of the child can understand the game situation of the child.

In an optional implementation manner, the above-mentioned interactive object is a building block, and the above-mentioned interactive subject is a student, then the designated terminal may be an intelligent terminal held by a teacher, or an intelligent terminal held by a parent of the child. Taking the designated terminal as the smart terminal held by the teacher as an example, there can be a student client on the smart interactive device, and a teacher client on the smart terminal. When the evaluation parameters meet the preset conditions, the student client can follow the interactive prompt information, the first image, evaluation parameters, and video information of the interactive subject operating the interactive object to evaluate and give feedback on the interactive object. At the same time, the student client sends the interactive prompt information, the first image, evaluation parameters, and the video information of the interactive subject operating the interactive object to the teacher client, and the teacher can assist in judging the student's specific ability learning situation based on the information obtained by the teacher client .

In another optional implementation manner, it is possible to set the degree of accuracy for an interactive subject to perform a preset operation according to the interactive prompt information, that is, the above-mentioned second preset value. When the evaluation parameter is lower than the second preset value In the case of , the smart interactive device can send the child's current operation to its parents.

Fig. 10 is a flow chart of an optional intelligent interactive device according to an embodiment of the present invention. In this example, the interactive object is still a building block. As shown in Figure 10, the application program of the building block game is installed on the smart interactive device. The property information of all building blocks, such as color information, contour information and shape information, can be obtained by processing, contour detection and calculating the geometric characteristics of contour information. After one registration, in the case of using this set of building blocks, you can directly use the first registration result to play the game without having to register every time; when you need to add new building blocks, you can add new records to register.

After the registration and matching of building blocks, the intelligent interactive device plays specific interactive prompt information on the screen according to the preset interactive program, and the children start to build the building blocks according to the interactive prompt information. During the process of building blocks for children, the intelligent interactive device records the children's construction of building blocks After the children build the building blocks, evaluate the building blocks built by the children, and feed back the interactive prompt information, the first image, the evaluation parameters and the video information of the children operating the building blocks to the parents or teachers for auxiliary judgment.

Example 2

Fig. 11 is a schematic diagram of a control device of an intelligent interactive device according to an embodiment of the present invention. In combination with Fig. 11 , the device can perform related steps in the embodiment of the present invention, and the device includes:

The display module 1100 is configured to display interaction prompt information, wherein the interaction prompt information is used to instruct the interaction subject to complete a preset operation on the interaction object;

A receiving module 1102, configured to receive a completion instruction, and collect the first image of the interactive object;

A determining module 1104, configured to extract the operation result information of the preset operation performed by the interactive subject from the first image of the interactive object, and determine an evaluation parameter for performing the preset operation on the interactive subject based on the operation result information, wherein the evaluation parameter is used to represent How accurately an interacting agent performs a preset action.

As an optional embodiment, the interactive objects are building blocks, and the interactive prompt information includes at least one of the following types: interactive prompt information for distinguishing building block shapes; interactive prompt information for distinguishing building block sizes; and interactive prompt information for distinguishing building block colors interactive prompt information.

As an optional embodiment, the above-mentioned device also includes:

An acquisition module, configured to acquire a second image, where the second image includes a plurality of interactive objects to be operated;

The first identification module is configured to identify attribute information of the interactive object to be operated based on the second image.

As an optional embodiment, the attribute information of the interactive object includes color information of the interactive object, and the above-mentioned first identification module includes:

A segmentation module, configured to perform color segmentation on the second image to obtain sub-images corresponding to each interactive object to be operated;

Conversion module, for converting the sub-image to HSV space, obtain the first parameter of the sub-image in the hue channel and the second parameter of the saturation channel;

A determining module, configured to determine the color information of the interactive object to be operated based on the first parameter and the second parameter.

As an optional embodiment, the attribute information of the interactive object includes outline information of the interactive object, and the above-mentioned first identification module further includes:

The expansion module is used to expand the sub-image to obtain the expanded sub-image;

The corrosion module is used to corrode the expanded sub-image to obtain the corroded sub-image;

The first detection module is configured to perform contour detection on the corroded sub-image to obtain contour information of the interactive object to be operated.

As an optional embodiment, the attribute information of the interactive object includes shape information of the interactive object, and the above-mentioned first recognition module further includes:

The second detection module is configured to detect the geometric characteristics of the contour information of the interactive object to be operated, and obtain the shape information of the interactive object to be operated.

As an optional embodiment, the interaction prompt information is also used to indicate the operation area, and the operation result information of the preset operation performed by the interactive subject is extracted from the first image of the interactive object, including:

A first acquisition module, configured to acquire an area image corresponding to the operation area in the first image;

The second identification module is used to identify the attribute information of the interactive object in the area image, and obtain the operation result information.

The first determination sub-module is configured to determine evaluation parameters for performing preset operations on the interaction subject based on the operation result information, including;

The second obtaining module is used to obtain the standard operation result information corresponding to the interactive prompt information;

A third acquisition module, configured to acquire a matching degree parameter between the operation result information extracted from the first image of the interactive object and the standard operation result information;

The second parameter for determining the degree of matching is an evaluation parameter.

In an optional embodiment, after the module is determined, the above device further includes:

A judging module, configured to judge whether the evaluation parameter meets a preset condition;

The sending module is used to send at least one of the following information to the designated terminal when the evaluation parameters meet the preset conditions: interaction prompt information, the first image, evaluation parameters and video information of the interaction subject operating the interaction object, wherein the video The information is collected during the process of the interaction subject operating the interaction object.

Example 3

According to an embodiment of the present application, an embodiment of a computer storage medium is provided. The computer storage medium stores a plurality of instructions, and the instructions are adapted to be loaded by a processor and execute the method steps in any one of Embodiment 1 or Embodiment 2.

Example 4

According to an embodiment of the present application, an intelligent interactive tablet is provided, including: a processor and a memory; wherein, the memory stores a computer program, and the computer program is suitable for being loaded by the processor and executing any one of Embodiment 1 or Embodiment 2 method steps.

Fig. 12 is a schematic diagram of an intelligent interactive panel provided by an embodiment of the present application. The intelligent interactive panel includes the above-mentioned interactive device body and a touch frame. As shown in FIG. 12, the intelligent interactive panel 1300 may include: at least one processor 1301, At least one network interface 1304 , user interface 1303 , memory 1305 , at least one communication bus 1302 .

Wherein, the communication bus 1302 is used to realize connection and communication between these components.

Wherein, the user interface 1303 may include a display screen (Display) and a camera (Camera), and the optional user interface 1303 may also include a standard wired interface and a wireless interface.

Wherein, the network interface 1304 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface).

Wherein, the processor 1301 may include one or more processing cores. The processor 1301 uses various interfaces and lines to connect various parts in the entire intelligent interactive panel 1300, and by running or executing instructions, programs, code sets or instruction sets stored in the memory 1305, and calling data stored in the memory 1305, Execute various functions of the intelligent interactive panel 1300 and process data. Optionally, the processor 1301 may use at least one of Digital Signal Processing (Digital Signal Processing, DSP), Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA), and Programmable Logic Array (Programmable Logic Array, PLA). implemented in the form of hardware. The processor 1301 may integrate one or a combination of a central processing unit (Central Processing Unit, CPU), an image processor (Graphics Processing Unit, GPU), a modem, and the like. Among them, the CPU mainly handles the operating system, user interface and application programs, etc.; the GPU is used to render and draw the content that needs to be displayed on the display screen; the modem is used to handle wireless communication. It can be understood that the foregoing modem may also not be integrated into the processor 1301, but implemented by a single chip.

Wherein, the memory 1305 may include a random access memory (Random Access Memory, RAM), or may include a read-only memory (Read-Only Memory). Optionally, the memory 1305 includes a non-transitory computer-readable storage medium (non-transitory computer-readable storage medium). The memory 1305 may be used to store instructions, programs, codes, sets of codes, or sets of instructions. The memory 1305 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), Instructions and the like for implementing the above method embodiments; the storage data area can store the data and the like involved in the above method embodiments. Optionally, the memory 1305 may also be at least one storage device located away from the aforementioned processor 1301 . As shown in FIG. 12 , the memory 1305 as a computer storage medium may include an operating system, a network communication module, a user interface module, and an operating application program of an intelligent interactive tablet.

In the intelligent interactive panel 1300 shown in FIG. 12 , the user interface 1303 is mainly used to provide the user with an input interface and obtain the data input by the user; and the processor 1301 can be used to call the operation application of the intelligent interactive panel stored in the memory 1305 program, and specifically execute any one of the operations in Embodiment 1 or Embodiment 2.

The serial numbers of the above embodiments of the present invention are for description only, and do not represent the advantages and disadvantages of the embodiments.

In the above-mentioned embodiments of the present invention, the descriptions of each embodiment have their own emphases, and for parts not described in detail in a certain embodiment, reference may be made to relevant descriptions of other embodiments.

In the several embodiments provided in this application, it should be understood that the disclosed technical content can be realized in other ways. Wherein, the device embodiments described above are only illustrative. For example, the division of the units may be a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined or may be Integrate into another system, or some features may be ignored, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of units or modules may be in electrical or other forms.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.

If the integrated unit is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the essence of the technical solution of the present invention or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium , including several instructions to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the methods described in various embodiments of the present invention. The aforementioned storage media include: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, magnetic disk or optical disk and other media that can store program codes. .

The above is only a preferred embodiment of the present invention, it should be pointed out that, for those of ordinary skill in the art, without departing from the principle of the present invention, some improvements and modifications can also be made, and these improvements and modifications can also be made. It should be regarded as the protection scope of the present invention.

Claims (12)

1. A control method for an intelligent interactive device, comprising: Displaying interactive prompt information, wherein the interactive prompt information is used to instruct the interactive subject to complete a preset operation on the interactive object; receiving a completion instruction, and capturing a first image of the interactive object; Extracting the operation result information of the preset operation performed by the interactive subject from the first image of the interactive object, and determining evaluation parameters for performing the preset operation on the interactive subject based on the operation result information, wherein , the evaluation parameter is used to characterize the accuracy of the interaction subject performing the preset operation. 2. The method according to claim 1, wherein the interactive object is a building block, and the interactive prompt information includes at least one of the following types: Interactive prompt information for distinguishing the shapes of the building blocks; an interactive prompt for distinguishing the size of said building blocks; and Interactive prompt information used to distinguish the color of the building block. 3. The method according to claim 2, wherein the method further comprises: acquiring a second image, wherein the second image includes a plurality of interactive objects to be operated; Based on the second image, attribute information of the interactive object to be operated is identified. 4. The method according to claim 3, wherein the attribute information of the interactive object includes color information of the interactive object, and based on the second image, identifying the attribute information of the interactive object to be operated includes : performing color segmentation on the second image to obtain sub-images corresponding to each of the interactive objects to be operated; Converting the sub-image to HSV space to obtain the first parameter of the sub-image in the hue channel and the second parameter of the saturation channel; Determine the color information of the interactive object to be operated based on the first parameter and the second parameter. 5. The method according to claim 4, wherein the attribute information of the interactive object includes outline information of the interactive object, and the attribute information of the interactive object to be operated is identified based on the second image, and further include: performing expansion processing on the sub-image to obtain the expanded sub-image; performing erosion processing on the expanded sub-image to obtain the etched sub-image; Contour detection is performed on the etched sub-image to obtain contour information of the interactive object to be operated. 6. The method according to claim 4, wherein the attribute information of the interactive object includes shape information of the interactive object, and the attribute information of the interactive object to be operated is identified based on the second image, and further include: Geometric characteristics are detected on the contour information of the interactive object to be operated to obtain shape information of the interactive object to be operated. 7. The method according to claim 1, wherein the interaction prompt information is also used to indicate an operation area, and the operation of performing the preset operation by the interaction subject is extracted from the first image of the interaction object Results information, including: acquiring an area image corresponding to the operation area in the first image; The attribute information of the interactive object in the area image is identified to obtain the operation result information. 8. The method according to claim 1, wherein determining evaluation parameters for performing the preset operation on the interaction subject based on the operation result information comprises; Obtaining standard operation result information corresponding to the interactive prompt information; acquiring a matching degree parameter between the operation result information extracted from the first image of the interactive object and the standard operation result information; The matching degree parameter is determined as the evaluation parameter. 9. The method according to claim 1, characterized in that, extracting the operation result information of the preset operation performed by the interactive subject from the first image of the interactive object, and determining based on the operation result information After performing the evaluation parameter of the preset operation on the interaction subject, the method further includes: judging whether the evaluation parameter satisfies a preset condition; When the evaluation parameter meets the preset condition, at least one of the following items of information is sent to the designated terminal: the interaction prompt information, the first image, the evaluation parameter, and the interaction subject operating the Video information of the interactive object, wherein the video information is collected during the process of the interactive subject operating the interactive object. 10. A control device for an intelligent interactive device, comprising: A display module, configured to display interaction prompt information, wherein the interaction prompt information is used to instruct the interaction subject to complete a preset operation on the interaction object; a receiving module, configured to receive a completion instruction, and collect the first image of the interactive object; A determining module, configured to extract from the first image of the interactive object the operation result information that the interactive subject performs the preset operation, and determine to perform the preset operation on the interactive subject based on the operation result information evaluation parameters, wherein the evaluation parameters are used to characterize the accuracy of the interaction subject performing the preset operation. 11. A computer storage medium, characterized in that the computer storage medium stores a plurality of instructions, and the instructions are suitable for being loaded by a processor and executing the method steps according to any one of claims 1 to 9. 12. An intelligent interactive flat panel, characterized in that it comprises: a processor and a memory; wherein, the memory stores a computer program, and the computer program is suitable for being loaded and executed by the processor as claimed in claims 1 to 9 Any one of the method steps.

Images