WO2018032627A1 - Teaching toy kit and marine mold identification method thereof - Google Patents

Abstract

The present invention relates to the technical field of computer vision detection and processing, and provides a teaching toy kit and a marine mold identification method thereof. The teaching toy kit comprises a support, a helmet detector, and a bottom plate. The bottom plate is placed on a plane. A marine mold is placed on the bottom plate. A marine organism recess is provided at the middle position of the marine mold. An organism identifier is provided on an edge position of the marine mold. The helmet detector is mounted on the support and further comprises a body, a third recess, two fan-shaped blocks, and a convex mirror. The third recess is positioned inside the body. The convex mirror is provided at an end point, where the screen of a tablet computer is held, of the third recess. The other end of the convex mirror is mounted on an edge of the helmet detector. An angle between the convex mirror and the horizontal plane is an acute angle. The two fan-shaped blocks are positioned on two edges of the convex mirror. According to the present invention, information of a marine mold is acquired by means of a camera to determine the used mold and determine whether the mold matches a mold required by a program. A game player can be guided to change a mold, and it is funnier to play the game.

Description

Educational toy kit and marine mold recognition method thereof Technical field

The invention relates to the technical field of computer vision detection and processing, in particular to an educational toy kit and a marine mold recognition method thereof.

Background technique

There are many interesting preschool game apps or children's games on the tablet, but often just let the children point finger on the screen, the interaction is lacking, and watching the screen for a long time is easy to cause damage to the eyes; and now some interactive Traditional game toys have been separated from the development of the times, and the form cannot meet the needs of children to learn and play, and it is not convenient for children and parents to interact.

In order to solve the above problems, an educational toy kit has been successfully developed in the field of computer vision and image processing technology, including: a bracket, a helmet detector, a bottom plate, a game program installed in a tablet computer, and being placed on a plane through a camera of a tablet computer. The image of the bottom plate.

technical problem

Although the above educational toy kit solves the problem of lack of interaction of the game in the tablet computer, the position of the bottom plate may be deviated, resulting in the camera not being able to capture a complete image, the image is easy to collect errors, and the analysis result is inaccurate. appear.

Therefore, there is an urgent need in the field of computer vision and image processing technology for an educational toy kit and a marine mold recognition method thereof, which collects marine mold information through a camera of a tablet computer, determines a mold used according to a color and an identification area, and extracts a graphic in a groove on the mold. If the identified mold does not match the mold required by the program, the child is instructed to change the mold to enhance the game's interest, children's hands-on ability and interactivity; and can quickly and correctly detect the marine bio mold used, improve image acquisition and Analyze the accuracy of the structure.

Technical solution

In order to solve the above problems, the present invention provides an educational toy kit and a marine mold identifying method thereof, and the technical solutions are as follows:

An educational toy kit comprising: a bracket, a helmet detector, a bottom plate and a marine mold, and the helmet detector is mounted on the bracket, the bottom plate is placed on a plane, the marine mold is placed on the bottom plate, and the ocean is disposed in the middle of the marine mold. Bio-groove with a bio-identifier at the edge; a bump at the bottom and a first recess at the top a groove and a second groove, the first groove is for placing a tablet computer, the tablet computer collects marine mold information; the helmet detector is installed in the second groove;

The helmet detector further includes a body, a third groove, two segments and a convex mirror, and the third groove is located in the body for holding different types of tablets, and holding the tablet screen in the third groove The end of the convex mirror is provided with a convex mirror, the other end of the convex mirror is mounted on the edge of the helmet detector, the convex mirror is at an acute angle with the horizontal plane, and the third groove holds the end of the tablet screen higher than the camera position of the tablet, 2 The segments are located on the two edges of the convex mirror to hold the convex mirror and hold the tablet.

Preferably, an educational toy kit, marine molds include: starfish, octopus, seahorse, dolphins and fish.

Preferably, an educational toy kit, the biological identifier is a number or a corresponding creature.

An ocean mold recognition method for an educational toy kit, comprising the following steps:

Step 1: Install the game program on the tablet, and then place the bottom plate on the plane. The bottom end of the tablet is installed in the first groove, and the helmet detector is installed on the top of the tablet through the second groove, and then The marine mold is placed on the bottom of the marine game;

Step 2: After the fixed installation, the color image is collected in real time through the front camera of the tablet computer;

Step 3: Detect the identifier and color of the marine mold in the image to determine whether the position of the marine mold is accurate.

Preferably, in the marine mold recognition method of the above educational toy kit, the color image acquired by the front camera in step 2 is I _xy , I _xy =f(x, y)=(R _xy , G _xy , B _Xy ), where (x, y) represents the position coordinates of the pixel points of the color image, f(x, y) represents the pixel value of the image at the pixel point coordinate position, and R _xy represents the color value of the image pixel point in the red channel, G _xy represents the color value of the image pixel in the green channel, and B _xy represents the color value of the image pixel in the blue channel.

Preferably, in the marine mold recognition method of the above educational toy kit, the specific steps of step three are:

Step 1), for the color image I _xy in the second step, detecting the position and angle of the bottom plate, and extracting the ocean mold image from the color image I _xy ;

a) using a perspective transformation principle, converting the color image I _xy into a front view image viewed from top to bottom;

b) extracting, according to a priori knowledge, an image of the region of interest of the bottom plate in the positive view image, that is, an effective recognition region where the marine mold is placed;

Step 2), detecting the coding of the current region of interest, and comparing with the marine bio-mold coding table to determine whether the position of the marine mold is accurate;

First, in the extracted region of interest, the region of interest is divided into nine parts according to the nine squares, and the sub-images of the lower left corner, the upper left corner and the upper right corner are cut out;

Further, each sub-image is scanned separately, and if the pixel value of the sub-image color exceeds the color threshold, the sub-image is considered to have a bio-marker, otherwise it is considered not;

Further, compared with the marine bio-mold coding table, if the tablet computer displays the position of the ocean mold accurately, the tablet computer tells the upper-layer client that the current marine mold placement position is accurate, and the client will be in the region of interest. According to the current game scene and the a priori information of the mold used by the user, the pixels of the area where the marine organism is located are extracted, and the corresponding texture is on the pre-made 3D marine biological model; otherwise, the tablet computer displays the position of the marine mold placement error, and Give guidance to choose the right mold, that is, the client plays a pre-set prompt or animation on the game interface to guide the customer.

Preferably, in the marine mold identification method of the educational toy kit described above, the marine bio-mold coding table in step 2) is based on whether there are no identifiers on the lower left, upper left and upper right sides of the mold, and is marked as 1 and is not recorded as 0. , the code of 12 molds can be completed, and then combined with the color of the marker, the current placement mold can be uniquely determined. The specific marine bio-mold coding table is:

Beneficial effect

1. The invention intelligently combines the application of computer vision graphic recognition technology with a color coding scheme, and can accurately detect whether the marine fish mold is a correct mold and is placed in the correct position, and has a fast calculation speed. The positioning is accurate, the hardware and software technology are well unified, the game interaction design is ingenious; the appearance is simple, the judgment is faster, and the fun and the intuitiveness are enhanced.

2. The detection algorithm of the invention is more scientific and mature, and the combination of image perspective transformation and image cutting algorithm can quickly determine the marine biological mold placed.

3. The calculation speed of the invention is fast; each positioning detection takes about 30ms, which provides a smooth experience for the player.

4. The performance of the invention is stable. When different tablet computers are installed in the educational toy kit, the collection and test are performed on 3,000 pictures, and the false recognition rate and the missed detection rate are below 0.2%.

DRAWINGS

The present invention will be described in detail below with reference to the accompanying drawings and specific embodiments.

BRIEF DESCRIPTION OF THE DRAWINGS Figure 1 is a schematic view showing the structure of an educational toy kit of the present invention.

2 is a schematic view showing the structure of a helmet detector in an educational toy kit of the present invention.

3 is a flow chart of a method for identifying a marine mold of an educational toy kit of the present invention.

The correspondence between the reference numerals in Figure 1-3 and the part names is:

Bracket 1, first groove 102, second groove 103, helmet detector 2, body 201, third groove 202, sector block 203, mirror 204, bottom plate 3, marine mold 4. marine biological groove 401, Biological identifier 402.

BEST MODE FOR CARRYING OUT THE INVENTION

As shown in FIG. 3, a method for identifying a marine mold of an educational toy kit includes the following steps:

Step 1: Install the game program on the tablet, and then place the bottom plate on the plane. The bottom end of the tablet is installed in the first groove, and the helmet detector is installed on the top of the tablet through the second groove, and then The marine mold is placed on the bottom of the marine game;

Step 2: After the fixed installation, the color image is collected in real time through the front camera of the tablet computer;

The color image acquired by the front camera is I _xy , I _xy =f(x,y)=(R _xy , G _xy , B _xy ), where (x, y) represents the position coordinate of the pixel of the color image, f( x, y) represents the pixel value of the image at the pixel point coordinate position, R _xy represents the color value of the image pixel point in the red channel, G _xy represents the color value of the image pixel point in the green channel, and B _xy represents the image pixel point in the blue The color value of the color channel;

Step 3: detecting the identifier and color of the marine mold in the image, and judging whether the position of the marine mold is accurate;

Step 1), for the color image I _xy in the second step, detecting the position and angle of the bottom plate, and extracting the ocean mold image from the color image I _xy ;

b) using a perspective transformation principle, converting the color image I _xy into a front view image viewed from top to bottom;

b) extracting, according to a priori knowledge, an image of the region of interest of the bottom plate in the positive view image, that is, an effective recognition region where the marine mold is placed;

Step 2), detecting the coding of the current region of interest, and comparing with the biometric table to determine whether the position of the marine mold is accurate;

First, in the extracted region of interest, the region of interest is divided into nine parts according to the nine squares, and the sub-images of the lower left corner, the upper left corner and the upper right corner are cut out;

Further, each sub-image is scanned separately, and if the pixel value of the sub-image color exceeds the color threshold, the sub-image is considered to have a bio-marker, otherwise it is considered not;

Further, compared with the marine bio-mold coding table, if the tablet computer displays the position of the ocean mold accurately, the tablet computer tells the upper-layer client that the current marine mold placement position is accurate, and the client will be in the region of interest. According to the current game scene and the a priori information of the mold used by the user, the pixels of the area where the marine organism is located are extracted, and the corresponding texture is on the pre-made 3D marine biological model; otherwise, the tablet computer displays the position of the marine mold placement error, and Give guidance to select the correct mold, that is, the client plays a pre-set prompt or animation on the game interface to guide the customer;

According to the lower left, upper left and upper right of the mold, there is no identifier, which is marked as 1 and not recorded as 0. You can encode 12 molds as shown in the following table, and then combine with the color of the marker to uniquely determine the mold currently placed. The customer can pre-set the corresponding marine bio-mold according to the mold code, as shown in the following table:

Marine bio mold coding table

Embodiments of the invention

The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. The described embodiments are only a part of the embodiments of the invention, and not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

Example 1:

BRIEF DESCRIPTION OF THE DRAWINGS Figure 1 is a schematic view showing the structure of an educational toy kit of the present invention.

2 is a schematic view showing the structure of a helmet detector in an educational toy kit of the present invention.

As shown in FIG. 1-2, a marine mold recognition method for an educational toy kit includes a bracket 1, a helmet detector 2, a bottom plate 3, and a marine mold 4, and the helmet detector 2 is mounted on the bracket 1; the bottom plate 3 is placed on In the plane, the marine mold 4 is placed on the bottom plate 3, and a marine biological groove 401 is disposed at an intermediate position of the marine mold 4, the edge position is provided with a biological identifier 402, and the support 1 has a first groove 102 and a second concave portion at the top. a slot 103, the first groove 102 is used for placing a tablet computer, and the tablet computer collects marine mold information; the helmet detector 2 is installed in the second groove 103; the helmet detector 2 further includes: a body 201 and a third groove 202. 2 sectors 203 and convex mirror 204, and a third groove 202 is located in the body 201 for clamping different types of tablets, and a convex mirror is arranged at the end of the third groove 202 holding the tablet screen. 204, the other end of the convex mirror 204 is mounted on the edge of the helmet detector 2, the convex mirror 204 is at an acute angle with the horizontal plane, and the third recess 202 holds the end of the tablet screen higher than the camera position of the tablet, 2 sectors Block 203 is located The two edges of the convex mirror 204 are used to fix the convex mirror 204 and hold the tablet.

In this embodiment, the marine mold 4 includes: starfish, octopus, seahorse, dolphins, and fish. ,

In this embodiment, the biological identifier 402 is a number or a corresponding creature.

3 is a flow chart of a method for identifying a marine mold of an educational toy kit of the present invention.

As shown in FIG. 3, a method for identifying a marine mold of an educational toy kit includes the following steps:

Step 1: Install the game program on the tablet, and then place the bottom plate on the plane. The bottom end of the tablet is installed in the first groove, and the helmet detector is installed on the top of the tablet through the second groove, and then The marine mold is placed on the bottom of the marine game;

Step 2: After the fixed installation, the color image is collected in real time through the front camera of the tablet computer;

The color image acquired by the front camera is I _xy , I _xy =f(x,y)=(R _xy , G _xy , B _xy ), where (x, y) represents the position coordinate of the pixel of the color image, f( x, y) represents the pixel value of the image at the pixel coordinate position, R _xy represents the color value of the image pixel in the red channel, G _xy represents the color value of the image pixel in the green channel, and B _xy represents the image pixel in the blue The color value of the color channel;

Step 3: detecting the identifier and color of the marine mold in the image, and judging whether the position of the marine mold is accurate;

Step 1), for the color image I _xy in the second step, detecting the position and angle of the bottom plate, and extracting the ocean mold image from the color image I _xy ;

c) using a perspective transformation principle, converting the color image I _xy into a front view image viewed from top to bottom;

b) extracting, according to a priori knowledge, an image of the region of interest of the bottom plate in the positive view image, that is, an effective recognition region where the marine mold is placed;

Step 2), detecting the coding of the current region of interest, and comparing with the biometric table to determine whether the position of the marine mold is accurate;

First, in the extracted region of interest, the region of interest is divided into nine parts according to the nine squares, and the sub-images of the lower left corner, the upper left corner and the upper right corner are cut out;

Further, each sub-image is scanned separately, and if the pixel value of the sub-image color exceeds the color threshold, the sub-image is considered to have a bio-marker, otherwise it is considered not;

Further, compared with the marine bio-mold coding table, if the tablet computer displays the position of the ocean mold accurately, the tablet computer tells the upper-layer client that the current marine mold placement position is accurate, and the client will be in the region of interest. According to the current game scene and the a priori information of the mold used by the user, the pixels of the area where the marine organism is located are extracted, and the corresponding texture is on the pre-made 3D marine biological model; otherwise, the tablet computer displays the position of the marine mold placement error, and Give guidance to select the correct mold, that is, the client plays a pre-set prompt or animation on the game interface to guide the customer;

According to the lower left, upper left and upper right of the mold, there is no identifier, which is marked as 1 and not recorded as 0. You can encode 12 molds as shown in the following table, and then combine with the color of the marker to uniquely determine the mold currently placed. The customer can pre-set the corresponding marine bio-mold according to the mold code, as shown in the following table:

Marine bio mold coding table

The invention intelligently combines the application of computer vision graphic recognition technology with a color coding scheme, can accurately detect whether the marine fish mold is a correct mold and is placed in the correct position, has a fast calculation speed, accurate positioning, and hardware and The software technology is well unified, the game interaction design is ingenious; the appearance is simple, the judgment is faster, and the fun and the intuitiveness are enhanced.

The detection algorithm of the invention is more scientific and mature, and combines the algorithms of perspective transformation and image cutting of the image, and can quickly determine the marine biological mold placed.

The calculation speed of the invention is fast; each positioning detection takes about 30ms, which provides a smooth experience for the player.

The performance of the invention is stable. When different tablet computers are installed in the educational toy kit, the collection and test are performed on 3,000 pictures, and the false recognition rate and the missed detection rate are below 0.2%.

The basic principles, main features, and advantages of the present invention are shown and described above. It should be understood by those skilled in the art that the present invention is not limited by the foregoing embodiments, and that the present invention is described in the foregoing description and the description of the present invention. Such changes and modifications are intended to fall within the scope of the invention as claimed. The scope of the invention is defined by the appended claims and their equivalents.

Industrial applicability

It is easily known to those skilled in the art from the above description that the technical solution of the present invention is suitable for industrial production and is used in production and life, and therefore the present invention has industrial applicability.

Claims (5)

An educational toy kit, comprising: a bracket, a helmet detector, a bottom plate and a marine mold, and the helmet detector is mounted on a bracket, the bottom plate is placed on a plane, and the marine mold is placed on the bottom plate, a marine bio-groove is disposed at an intermediate position of the marine mold, the edge position is provided with a biological identifier; the bottom of the bracket has a protrusion, and the top has a first groove and a second groove, and the first groove is used for Placing a tablet computer, the tablet computer collects marine mold information; the helmet detector is installed in the second groove; The helmet detector further includes: a body, a third groove, two segments and a convex mirror, and the third groove is located in the body for clamping different types of tablets, in the third concave A convex mirror is disposed at an end of the slot holding tablet screen, and the other end of the convex mirror is mounted on an edge of the helmet detector, the convex mirror is at an acute angle with the horizontal plane, and the third recess holds the tablet The end of the screen is higher than the camera position of the tablet, and the two sectors are located on the two edges of the convex mirror for fixing the convex mirror and holding the tablet. A marine mold recognition method for an educational toy kit, comprising the steps of: Step 1: Install the game program on the tablet, and then place the bottom plate on the plane. The bottom end of the tablet is installed in the first groove, and the helmet detector is installed on the top of the tablet through the second groove, and then The marine mold is placed on the bottom of the marine game; Step 2: After the fixed installation, the color image is collected in real time through the front camera of the tablet computer; Step 3: Detect the identifier and color of the marine mold in the image to determine whether the position of the marine mold is accurate. The marine mold recognition method of an educational toy kit according to claim 1, wherein the color image acquired by the front camera in the second step is I _xy , I _xy =f(x, y)=(R _Xy , G _xy , B _xy ), where (x, y) represents the position coordinates of the pixel points of the color image, f(x, y) represents the pixel value of the image at the pixel coordinate position, and R _xy represents the image pixel point The color value of the red channel, G _xy represents the color value of the image pixel in the green channel, and B _xy represents the color value of the image pixel in the blue channel. The method for identifying a marine mold of an educational toy kit according to claim 3, wherein the specific steps of the third step are: Step 1), for the color image I _xy in the second step, detecting the position and angle of the bottom plate, and extracting the ocean mold image from the color image I _xy ; a) using a perspective transformation principle, converting the color image I _xy into a front view image viewed from top to bottom; b) extracting, according to a priori knowledge, an image of the region of interest of the bottom plate in the positive view image, that is, an effective recognition region where the marine mold is placed; Step 2), detecting the coding of the current region of interest, and comparing with the marine bio-mold coding table to determine whether the position of the marine mold is accurate; First, in the extracted region of interest, the region of interest is divided into nine parts according to the nine squares, and the sub-images of the lower left corner, the upper left corner and the upper right corner are cut out; Further, each sub-image is scanned separately, and if the pixel value of the sub-image color exceeds the color threshold, the sub-image is considered to have a bio-marker, otherwise it is considered not; Further, compared with the marine bio-mold coding table, if the tablet computer displays the position of the ocean mold accurately, the tablet computer tells the upper-layer client that the current marine mold placement position is accurate, and the client will be in the region of interest. According to the current game scene and the a priori information of the mold used by the user, the pixels of the area where the marine organism is located are extracted, and the corresponding texture is on the pre-made 3D marine biological model; otherwise, the tablet computer displays the position of the marine mold placement error, and Give guidance to choose the right mold, that is, the client plays a pre-set prompt or animation on the game interface to guide the customer. The marine mold recognition method of an educational toy kit according to claim 4, wherein the marine bio-mold coding table has an identifier according to the lower left, upper left, and upper right of the mold, and is marked as 1 and is not recorded as 0, you can complete the coding of 12 molds, and then combined with the color of the marker, you can uniquely determine the current placement of the mold, as shown in the following table:

Images