A kit and method for developing left and right brains of children based on image recognition

Abstract

The invention discloses a kit and method for developing left and right brains of infants based on image recognition, comprising a building block base, a plurality of building blocks, a mobile terminal, an image recognition server, and a development board. A placement slot for separately placing the plurality of building blocks is provided on the front of the building block base, a command two-dimensional code is printed on the front of the building block, an APP or a small program is provided on the mobile terminal for photographing the building block base, the mobile terminal and the image recognition server complete uploading of photographed pictures and issuing of control codes through wireless data transmission, the image recognition server automatically recognizes the photographed pictures and completes control code compilation, the mobile terminal writes the code into the development board through Bluetooth transmission, the development board is connected to a teaching performance medium through a wire to realize control, not only can the physical programming protect the eyesight of infants, but also the open-type building block programming can be achieved, and the machine is used to judge whether the final building block programming work is correct or not, so that programming returns to "infinite possibilities".

Description

Technical Field

[0001] The invention relates to the technical field of early childhood education, and in particular to a kit and method for developing the left and right brains of children based on image recognition. Background Art

[0002] Technology and artificial intelligence have entered thousands of households, and more and more parents are beginning to pay attention to their children's STEAM education, early childhood programming education, etc. However, this type of education is often inseparable from electronic devices, such as tablets or computers. It is often necessary to perform a series of small building block splicing operations on the electronic screen, and finally the electronic device drives the physical object, such as "unmanned car / small tank"; in addition, there is another product on the market that is a physical modular splicing, and then uses an "image recognition device" to scan and identify the modules, scan one piece (graphic) and analyze it, and directly match it with the "correct answer" on the server. Finally, they are matched correctly, and the product effect is presented.

[0003] The above two existing technologies both have corresponding disadvantages, which are as follows:

[0004] 1. Currently, most of the children's logic training kits / children's programming learning and training courseware on the market rely on tablet computers to complete the building block splicing operation. Once the operation and debugging are started, time always passes unknowingly; however, parents are very worried that their children's eyes will be exposed to electronic screens for too long, which will affect their eyesight;

[0005] 2. There is a children's programming kit on the market now. It is independent of electronic devices and is also physical modular programming. It uses graphic analysis technology, but a big problem is that one module is analyzed at a time. If a work requires 3-5 blocks, it is okay, but once more building blocks are needed, it becomes a bit cumbersome. Scan one block, analyze one block and match one block, and the answer to the work is often stored on the server. The analysis process is to match the client and server. Programming should be very open and allow children to create unlimited things. The answers should not be limited, and there should not be only one answer, which limits the possibility of editing. Summary of the invention

[0006] In view of the shortcomings of the prior art, the purpose of the present invention is to provide a left and right brain development kit and method for children based on image recognition. It is not only hoped that physical programming can protect children's eyesight, but also hoped to achieve open-ended building block programming, using a machine to judge whether the final building block programming work is correct or not, so that programming returns to "infinite possibilities".

[0007] The above technical objectives of the present invention are achieved through the following technical solutions:

[0008] A toddler left and right brain development kit based on image recognition comprises a building block base, a plurality of building blocks, a mobile terminal, an image recognition server, and a development board. A placement slot for separately placing a plurality of building blocks is provided on the front of the building block base. Instruction icons, instruction texts, and instruction QR codes are printed on the front of the building blocks. An APP or a small program is provided on the mobile terminal for photographing the building block base. The mobile terminal and the image recognition server complete the upload of photographed pictures and the issuance of control codes through wireless data transmission. The image recognition server automatically recognizes the photographed pictures and completes the compilation of control codes. The mobile terminal writes the codes into the development board through Bluetooth transmission. The development board is connected to a teaching performance medium through a wire to realize control.

[0009] Further preferably, the teaching performance medium includes drawing paper, indicating teaching aids, conductive tape and crocodile clips, the drawing paper is for children to doodle and draw, the indicator lights are installed on the drawing paper, different indicating teaching aids are connected by conductive tape, and the development board and the indicating teaching aids are connected by crocodile clips.

[0010] Another object of the present invention is to provide a method for developing the left and right brains of children based on image recognition based on the above-mentioned left and right brain development kit for children, comprising a building block base, a plurality of building blocks, a mobile terminal, an image recognition server, a development board, and a teaching performance medium, and the specific steps include:

[0011] Students first complete the production of teaching performance media, including painting, handicrafts, and circuit connection;

[0012] Select a building block containing the required instructions from a number of building blocks and place it on the building block base at will;

[0013] Parents take photos of the building block base through the mobile app or mini program, and the photos will be uploaded to the image recognition server;

[0014] The image recognition server automatically recognizes the captured image and completes the control code compilation, which is finally sent to the mobile APP or applet;

[0015] The mobile APP or applet writes the code to the development board via Bluetooth transmission. The development board is connected to the teaching performance medium through wires for control. If the required performance form is achieved, it means success. Otherwise, reselect the required building blocks and repeat the subsequent steps.

[0016] More preferably, the image recognition and code compilation of the image recognition server specifically includes the following steps:

[0017] Adjust and enhance the relevant dimensions of the uploaded original image data, and on this basis, perform morphological operations on the image data;

[0018] Perform contour detection on the processed image data, further filter and process the detected contour set based on the image design, and finally infer the black outer border in the image design;

[0019] Based on the obtained relevant parameter data of the black outer frame, affine transformation correction is performed on the original image data to obtain standard image data;

[0020] Based on the standard image data, image cropping is applied according to the designed pixel distance to independently crop all the image areas of the building blocks at one time;

[0021] Based on the single building block image area obtained in the previous step, the pixel values ​​within a certain range of the center of the building block image area are judged to identify whether a building block has been placed in the current building block image area;

[0022] Based on the single building block image area screened out in the previous step, two-dimensional code recognition or image recognition processing is applied to obtain the corresponding source code, and the obtained source code is parsed and compiled to obtain the intermediate machine code.

[0023] In summary, the beneficial effects of the present invention compared with the prior art are as follows:

[0024] Students first draw and doodle on the teaching medium to complete the painting part, and then connect the other parts of the teaching medium manually to complete the circuit construction, exercise the children's hands-on ability, and complete the simple circuit connection;

[0025] Users place the required building blocks on the building block base according to the instruction information displayed on the building blocks. Parents take photos of the building block base through the mobile terminal, and the photos are automatically uploaded to the image recognition server to complete the compilation of the control code and send it to the mobile terminal. During the image recognition process, the building blocks can be placed and combined at will; the mobile terminal then sends the control code to the development board via Bluetooth, and the development board then controls the instructing teaching aids. The whole process covers the two teaching purposes of painting and manual programming. At the same time, for parents, the operation takes no more than one minute. For children, there is no need to touch the screen of the electronic device, which provides good protection for their glasses. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Figure 1 It is a structural schematic diagram of an embodiment;

[0027] Figure 2 Schematic diagram of the structure of the building block base and the building block in the embodiment. DETAILED DESCRIPTION

[0028] The invention is further described in detail below with reference to the accompanying drawings.

[0029] A kit for developing left and right brains of children based on image recognition, Figure 1 and Figure 2 As shown, it includes a building block base, several building blocks, a mobile terminal, an image recognition server, and a development board. A placement slot for separately placing several building blocks is opened on the front of the building block base. Instruction icons, instruction texts, and instruction QR codes are printed on the front of the building blocks. The fronts of building blocks of different instruction types are printed with different background colors. An APP or mini-program is set on the mobile terminal for photographing the building block base. The mobile terminal and the image recognition server complete the upload of the photographed picture and the issuance of the control code through wireless data transmission. The image recognition server automatically recognizes the photographed picture and completes the compilation of the control code. The mobile terminal writes the code to the development board through Bluetooth transmission. The development board is connected to the teaching performance medium through a wire to realize control.

[0030] The teaching media include drawing paper, indicating teaching aids, conductive tape and crocodile clips. The drawing paper is for children to doodle and draw. The indicator lights are installed on the drawing paper. Different indicating teaching aids are connected by conductive tape. The development board and the indicating teaching aids are connected by crocodile clips.

[0031] Based on the above-mentioned children's left and right brain development kit, the present invention provides a children's left and right brain development method based on image recognition, comprising a building block base, a plurality of building blocks, a mobile terminal, an image recognition server, a development board, and a teaching performance medium, and the specific steps include:

[0032] Students first complete the production of teaching performance media, including painting, handicrafts, and circuit connection;

[0033] Select a building block containing the required instructions from a number of building blocks and place it on the building block base at will;

[0034] Parents take photos of the building block base through the mobile app or mini program, and the photos will be uploaded to the image recognition server;

[0035] The image recognition server automatically recognizes the captured image and completes the control code compilation, which is finally sent to the mobile APP or applet;

[0036] The mobile APP or applet writes the code to the development board via Bluetooth transmission. The development board is connected to the teaching performance medium through wires for control. If the required performance form is achieved, it means success. Otherwise, reselect the required building blocks and repeat the subsequent steps.

[0037] The image recognition and code compilation of the above-mentioned image recognition server specifically includes the following steps:

[0038] Adjust and enhance the relevant dimensions of the uploaded original image data, such as contrast and saturation. On this basis, perform morphological operations on the image data, including grayscale image data and binary image data.

[0039] Perform contour detection on the processed image data (based on the OpenCV library), further filter and process the detected contour set based on the image design, and finally infer the black outer border in the image design;

[0040] Based on the obtained relevant parameter data of the black outer frame, affine transformation correction is performed on the original image data to obtain standard image data;

[0041] Based on the standard image data, image cropping is applied according to the designed pixel distance to independently crop all the image areas of the building blocks at one time;

[0042] Based on the single building block image area obtained in the previous step, the pixel values ​​within a certain range of the center of the building block image area are judged to identify whether a building block has been placed in the current building block image area;

[0043] Based on the single building block image area screened out in the previous step, two-dimensional code recognition or image recognition processing is applied to obtain the corresponding source code, and the obtained source code is parsed and compiled to obtain the intermediate machine code.

[0044] Finally, the development board obtains the intermediate machine code formed above through Bluetooth transmission, executes the intermediate machine code and outputs corresponding control information, and finally realizes the display of the work effect.

[0045] The above description is merely an exemplary embodiment of the present invention and is not intended to limit the protection scope of the present invention. The protection scope of the present invention is determined by the appended claims.

Claims

1. A kit for developing left and right brains of children based on image recognition, characterized in that: It includes a building block base, a plurality of building blocks, a mobile terminal, an image recognition server, and a development board. The building block base is provided with a placement slot for separately placing a plurality of building blocks on the front side. A command QR code is printed on the front side of the building block. An APP or a small program is provided on the mobile terminal for photographing the building block base. The mobile terminal and the image recognition server complete the upload of photographed pictures and the issuance of control codes through wireless data transmission. The image recognition server automatically recognizes the photographed pictures and completes the compilation of control codes. The mobile terminal writes the codes into the development board through Bluetooth transmission. The development board is connected to the teaching performance medium through a wire to realize control. The image recognition and code compilation of the image recognition server specifically include: Adjust and enhance the relevant dimensions of the uploaded original image data, and perform morphological operations on the image data on this basis; then perform contour detection on the processed image data, and further filter and process the detected contour set based on the image design to infer the black outer border in the image design; Based on the relevant parameter data of the outer frame, affine transformation correction is performed on the original image data to obtain standard image data; according to the designed pixel distance, image cropping is applied to independently crop all the building block image areas at one time; the pixel values ​​within a certain range of the center of the building block image area are judged to identify whether the current building block image area has been placed with a building block; Based on the single building block image area screened out in the previous step, two-dimensional code recognition or image recognition processing is applied to obtain the corresponding source code, and the obtained source code is parsed and compiled to obtain the intermediate machine code.

2. A kit for developing left and right brains of children based on image recognition according to claim 1, characterized in that: The front side of the building blocks is printed with instruction icons and instruction texts, and the front sides of building blocks of different instruction types are printed with different background colors.

3. The image recognition-based left and right brain development kit for children according to claim 1, characterized in that: The teaching performance medium includes drawing paper, indicating teaching aids, conductive tape and crocodile clips. The drawing paper is for children to doodle and draw, the indicating lamps are installed on the drawing paper, different indicating teaching aids are connected by conductive tape, and the development board and the indicating teaching aids are connected by crocodile clips.

4. A method for developing the left and right brains of young children based on image recognition, characterized in that: It includes a building block base, several building blocks, a mobile terminal, an image recognition server, a development board, and a teaching performance medium. The specific steps include: Students first complete the production of teaching performance media, including painting, handicrafts, and circuit connection; Select a building block containing the required instructions from a number of building blocks and place it on the building block base at will; Parents use the mobile app or mini program to take photos of the building block base, and the photos will be uploaded to the image recognition server; The image recognition server automatically recognizes the captured image and completes the control code compilation; The image recognition and code compilation of the image recognition server specifically includes the following steps: Adjust and enhance the relevant dimensions of the uploaded original image data, and on this basis, perform morphological operations on the image data; Perform contour detection on the processed image data, further filter and process the detected contour set based on the image design, and finally infer the black outer border in the image design; Based on the obtained relevant parameter data of the black outer frame, affine transformation correction is performed on the original image data to obtain standard image data; Based on the standard image data, image cropping is applied according to the designed pixel distance to independently crop all the image areas of the building blocks at one time; Based on the single building block image area obtained in the previous step, the pixel values ​​within a certain range of the center of the building block image area are judged to identify whether a building block has been placed in the current building block image area; Based on the single building block image area screened in the previous step, two-dimensional code recognition or image recognition processing is applied to obtain the corresponding source code, and the obtained source code is parsed and compiled to obtain the intermediate machine code; Finally, it is sent to the mobile app or mini program; The mobile APP or applet writes the code to the development board via Bluetooth transmission. The development board is connected to the teaching performance medium through wires for control. If the required performance form is achieved, it means success. Otherwise, reselect the required building blocks and repeat the subsequent steps.

5. A method for developing the left and right brains of infants based on image recognition according to claim 4, characterized in that: Morphological operations include grayscale image data and binarization image data.

Images