AI (Artificial Intelligence) enlightenment screen drawing equipment with virtual paintbrush, system and control method

Abstract

The invention discloses AI enlightenment painting screen equipment with a virtual paintbrush, an AI enlightenment painting screen system with a virtual paintbrush and a control method. The equipment comprises a shell, a system control panel, a display screen and a communication unit, wherein the system control panel, the display screen and the communication unit are arranged in the shell; a touch substrate is arranged on the surface of the display screen; at least one camera and at least one loudspeaker are arranged on a frame, corresponding to the periphery of the display screen, of the shell; the camera collects images and tracks facial expressions and gestures of a user in real time to generate capture data; the loudspeaker is used for playing audio information; the communication unit is in communication connection with the cloud server, the cloud server provides remote AI application service, the AI application service analyzes and captures user handwriting tracks in data in real time, and the system control panel converts the user handwriting tracks into structured images and completes image generation and development processes of different article types; the AI application service performs face AI recognition to determine a user emotional state in order to optimize an interaction policy. According to the invention, the interestingness, educational property and technicality of children enlightenment education are improved.

Description

Technical Field

[0001] The present invention relates to the technical field of touch products, and particularly to an AI enlightenment drawing screen device, system and control method with a virtual paintbrush. Background Art

[0002] The current application of touch display devices in the field of children's education is mostly limited to basic writing and painting functions, lacking intelligent interaction and scene derivation capabilities. In the prior art, traditional drawing screen products usually rely on preset templates or static images for display, and cannot dynamically generate creative content that matches the scene according to the user's real-time input. For example, when children are scribbling, they can only complete simple line drawing, and the system cannot recognize their intentions and transform them into concrete images (such as recognizing a circular trajectory as an "apple"), nor can it enhance the interactive experience through voice or animation feedback. In addition, the prior art lacks the capture and analysis of the user's emotional state (such as facial expression recognition), resulting in a single product interaction and being unable to provide personalized guidance for users of different age groups.

[0003] The existing touch products have the following disadvantages: (1) Insufficient intelligence, lacking AI-based image recognition and generation capabilities, and unable to transform scribbles into structured images or dynamic scenes. (2) The modules such as voice interaction and facial expression recognition are not integrated, making it difficult to stimulate children's interest or achieve educational goals (such as counting and recognizing objects); (3) It is impossible to realize the continuous optimization and content derivation of images (such as the growth of trees and the hatching process of eggs) through cloud AI application services; (4) Lack of virtual image: The traditional paintbrush lacks vivid cartoon images, reducing the user stickiness, especially for children. Summary of the Invention

[0004] The purpose of the present invention is to provide an AI enlightenment drawing screen device, system and control method with a virtual paintbrush. Through AI-driven dynamic image generation, multi-modal interaction design and cloud collaborative architecture, it not only solves the problems of insufficient intelligence and rigid interaction in the prior art, but also realizes the deep integration of fun, education and technology in the field of children's enlightenment education, providing a new application paradigm for intelligent display devices.

[0005] The technical solution adopted by the present invention is as follows: An AI enlightenment drawing screen device with a virtual paintbrush, which includes a housing and a system control board and a display screen arranged in the housing. A touch substrate connected to the system control board is configured on the surface of the display screen; a display window is provided on the housing corresponding to the display screen, and at least one camera and at least one speaker electrically connected to the system control board are provided on the frame of the housing around the display window; the camera collects image pictures; the speaker is used for playing audio information; a communication unit connected to the system control board is also provided in the housing; the communication unit is communicatively connected to a cloud server, and the cloud server provides remote AI application services.

[0006] Specifically, as a feasible implementation, the camera is used to track the user's facial expressions and gesture movements in real time to generate capture data; the system control board identifies the user's gestures based on the capture data, and at the same time performs AI recognition on the capture data based on the AI application service of the cloud server to obtain the AI recognition result, and generates and recognizes pictures based on the AI recognition result for the user's drawing, and completes the image generation and development process of different item types; Specifically, as a feasible implementation, the speaker is used to play voice reminders, and the device guides user interaction through voice prompts; Further, the touch substrate collects and obtains the user's touch trajectory.

[0007] Further, the display screen is not limited to the LCD display screen, and can also be other display screens such as EPD display screens.

[0008] Further, there are two cameras. One of the cameras is a binocular camera, which collects face images; the other camera collects full-scene images.

[0009] Further, the communication unit includes a WiFi chipset and a Bluetooth communication group.

[0010] Further, the system control board is connected to the speaker through an audio processing unit, and the audio processing unit is used to perform processing operations on the audio. The processing of the audio includes volume adjustment, sound quality optimization, and sound effect enhancement.

[0011] Further, a power management unit is provided on the system control board. The power management unit is respectively connected to the battery, the communication unit, and the system control board, and supplies power to each component of the device.

[0012] An AI enlightenment drawing screen system with a virtual pen. The system includes a cartoon virtual pen drawing module, an AI image recognition and generation module, a Camera image capture module, a voice interaction module, and a data communication module configured on the system control board, as well as an AI expression recognition module and a cloud database module configured on the cloud server; wherein: Cartoon virtual pen drawing module: Adopts embodied cartoon images (such as Nezha, Sun Wukong) as virtual pens, and has the functions of air gestures or touch screen operations; at the same time, it is used for dynamic rendering of the pen tip and the pen body, and guides user interaction through voice prompts (such as "Let's draw together") when starting up; AI image recognition and generation module: Connects to the cloud server, and based on the AI application service provided by the cloud server, analyzes the user's handwriting trajectory in real time, and converts the user's handwriting trajectory collected by the touch substrate into a structured image (such as a circular trajectory generates an "apple"); Furthermore, the AI ​​image recognition and generation module provides multi-stage scene derivation (such as the growth process of a tree from seeding to fruiting) and generates animation effects simultaneously; Camera image capture module: Uses the configured high-sensitivity camera to track the user's facial expressions and gestures in real time to generate capture data; the captured data is used to dynamically adjust system feedback (such as updating the screen saver based on the "happy" expression); AI expression recognition module: Analyzes user expressions collected by the camera through machine learning algorithms, identifies the user's emotional state (such as excitement, concentration) to form emotional data; feeds emotional data back to the screen device to optimize interaction strategies (such as adjusting the frequency of voice encouragement); Voice interaction module: Integrates natural language processing (NLP) technology to provide real-time voice guidance through speakers (such as "This is a tree and 5 apples"); supports multi-scenario voice interaction (such as error operation warnings and knowledge popularization); Data communication module: used to access the public network and establish a connection with the cloud server through the public network to update the AI ​​application service model and synchronize multi-user data; Cloud database module: configured on the cloud server, and stores preset image templates (such as the growth process of plants and animals), voice libraries and user creation records; Furthermore, as another feasible implementation method, the voice library and user creation records can also be stored locally on the screen device.

[0013] Furthermore, the user draws the initial handwriting with a virtual brush → the Camera module captures movements and expressions → the AI ​​image recognition module generates structured images → the voice module synchronously outputs educational content → the expression recognition module optimizes the interaction strategy → the cloud database updates user data → and finally outputs dynamic animation and voice feedback.

[0014] A control method of an AI enlightenment painting screen with a virtual paintbrush adopts the AI ​​enlightenment painting screen system with a virtual paintbrush, and the method comprises the following steps: Step 1, when the device is turned on for the first time, set the user's favorite virtual pen cartoon character image; Step 2, inviting the user to draw through voice prompts, and determining whether the user has triggered the drawing mode; if so, obtaining the user's current touch track and executing step 3; otherwise, executing step 2; Step 3, querying the first stroke rule based on the current touch trajectory of the user to confirm and obtain the proposed drawing object information, and reporting the proposed drawing object information through voice prompts; Step 4: The device sequentially displays the growth process diagrams of different stages of the growth cycle of the proposed drawing object, and guides the user to complete the graffiti drawing of each stage of the growth process diagram through voice broadcast until the final image of the proposed drawing object is completed; Step 5: Record the proposed drawing object as the current user's favorite item, then complete the final image of the drawing. At the same time, generate a corresponding dynamic animation effect based on the final image and display it; Step 6: Capture the user's expression through the camera, and then determine whether the user likes the corresponding dynamic animation effect through AI recognition; if so, save the current user's expression picture as the screensaver picture and inform the user through voice broadcast that the corresponding user's expression picture is the screensaver picture, and execute Step 7; otherwise, clear the current image screen and execute Step 2; Step 7: Associate the current user's favorite item with the corresponding user, record and update it in the cloud database, and then complete the drawing.

[0015] Further, Step 1 specifically includes the following steps: Step 1-1: When the device is powered on for the first time, display any one of the preset virtual pen cartoon character images; Step 1-2: Track the user's expression through the camera, and judge whether the user is satisfied with the current virtual pen cartoon character image through AI recognition of the user's expression; if so, save the current virtual pen cartoon character image as the default startup screen and execute Step 2; otherwise, automatically select the next unshown virtual pen cartoon character image and execute Step 1-2.

[0016] Further, in Step 2, the drawing mode is triggered when the user touches the touch panel of the device.

[0017] Further, Step 4 specifically includes the following steps: Step 4-1: Obtain the growth process diagrams of different stages of the growth cycle of the proposed drawing object, and enter the progressive drawing mode of the proposed drawing object while initializing the current growth stage; Step 4-2: Display the growth process diagram of the corresponding stage of the proposed drawing object, and guide the user to complete the graffiti drawing of the current stage through voice broadcast of the proposed drawing object and the current growth stage; Step 4-3: Judge whether the number of completed growth process diagrams is equal to the total number of growth process diagrams of the proposed drawing object; if so, display the final image screen and complete the growth cycle of the proposed drawing object through voice broadcast, and execute Step 5; otherwise, obtain the growth process diagram of the next stage and execute Step 4-2.

[0018] Further, in step 4-1, growth process diagrams of different stages of the growth cycle are obtained from the cloud server, and the cloud server stores image templates of the growth processes of different drawing objects and a supporting voice library preset.

[0019] Further, the specific steps of AI recognition are as follows: S1, Obtain the user's facial expression image collected by the camera and upload it to the cloud server, save it to the object storage service OSS, and initiate an AI image recognition request to the application service; S2, The application service obtains the target image from the object storage service OSS through the visual intelligence AI application service and performs image recognition to obtain the image AI recognition result; S3, The application service returns the image AI recognition result to the terminal display device.

[0020] The present invention adopts the above technical solutions, based on the AI image recognition module, to real-time convert the user's random graffiti into a structured image, with an identification accuracy rate of over 90%, significantly reducing the ineffective operation rate. Through the preset growth logic of the cloud AI model, a dynamic scene is gradually derived according to the user's stroke order, achieving the enlightenment education effect of "one stroke triggers multi-stage evolution", enabling children to intuitively understand the laws of nature and scientific knowledge. The voice interaction module combines NLP technology to synchronously output guiding prompts, knowledge popularization, and interesting encouragement during the user's drawing process, enhancing the interactive immersion and improving the user participation. The AI facial expression recognition module analyzes the user's emotions in real time and dynamically adjusts the feedback strategy to make the interaction more targeted, improving the learning efficiency of children. Using classic IP images such as Nezha and Sun Wukong as virtual brushes, attracting children's attention through dynamic rendering and anthropomorphic voices, the average user usage time increases. After completing the painting, the system automatically generates a scene animation with sound effects and voice summary to help children consolidate their counting and object recognition abilities, improving the knowledge retention rate. The cloud database supports real-time updating of the preset templates, voice library, and AI model, expanding the educational content without hardware upgrade and reducing the maintenance cost. By storing the user's creation records and facial expression data in the cloud, it supports cross-device synchronization of the learning progress and provides a visual report for parents, enhancing the practicality of the product.

[0021] The modular architecture of the present invention can be adapted to various touch display screens (such as tablets, smart drawing boards), and is quickly integrated through a standardized interface, shortening the commercialization implementation cycle. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] The following further describes the present invention in detail with reference to the drawings and specific embodiments; Figure 1 It is a schematic diagram of the principle structure of an AI enlightenment drawing screen device with a virtual brush according to the present invention; Figure 2Schematic flowchart of the control method for an AI enlightenment drawing screen device with a virtual brush according to the present invention; Figure 3 Schematic flowchart of AI recognition according to the present invention; Figure 4 Exploded structural view of an AI enlightenment drawing screen device with a virtual brush according to the present invention.

[0023] Figure 5 Schematic structural view of virtual pen cartoon image example 1 according to the present invention; Figure 6 Schematic structural view of virtual pen cartoon image example 2 according to the present invention; Figure 7 Asymptotic generation schematic diagram of the growth process of a tree according to the present invention; Figure 8 Asymptotic generation schematic diagram of the process of an egg turning into a chick according to the present invention. Detailed implementation manners

[0024] To make the objectives, technical solutions, and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application.

[0025] As Figures 1 to 8 As shown in one of the figures, the present invention discloses an AI enlightenment drawing screen device with a virtual brush, which includes a housing and a system control board 2 and a display screen 3 disposed inside the housing. A touch control substrate 7 connected to the system control board 2 is disposed on the surface of the display screen 3; the housing is provided with a display window corresponding to the display screen 3, and at least one camera 4 and at least one speaker 5 electrically connected to the system control board 2 are disposed on the frame around the display window of the housing; the camera 4 collects image pictures; the speaker 5 is used for playing audio information; a communication unit connected to the system control board 2 is further disposed inside the housing; the communication unit is communicatively connected to a cloud server, and the cloud server provides remote AI application services.

[0026] Further, the housing includes a rear cover 1 and a front cover 6, and the rear cover 1 and the front cover 6 are closed to form a receiving cavity.

[0027] Specifically, as a feasible implementation manner, the camera 4 is used for real-time tracking of the user's facial expressions and gesture actions to generate capture data; the system control board 2 recognizes the user's gestures based on the capture data, and at the same time performs AI recognition on the capture data based on the AI application services of the cloud server to obtain an AI recognition result, and generates and recognizes a drawing based on the AI recognition result for the user's painting, and completes the image generation and development process of different item types; Specifically, as a feasible implementation manner, the speaker 5 is used for playing voice reminders, and the device guides user interaction through voice prompts; Further, the touch control substrate 7 acquires the touch trajectory of the user.

[0028] Further, the display screen 3 is not limited to an LCD display screen, and may also be other display screens such as an EPD display screen.

[0029] Further, there are two cameras 4. One of the cameras 4 is a binocular camera 4, and the binocular camera 4 acquires a face image; the other camera 4 acquires a full-scene image.

[0030] Further, the communication unit includes a WiFi chipset and a Bluetooth communication group.

[0031] Further, the system control board 2 is connected to the speaker 5 through an audio processing unit. The audio processing unit is used for processing operations on audio. The processing of audio includes volume adjustment, sound quality optimization, and sound effect enhancement.

[0032] Further, a power management unit is provided on the system control board 2. The power management unit is respectively connected to the battery 8, the communication unit, and the system control board 2, and supplies power to each component of the device.

[0033] An AI enlightenment drawing screen system with a virtual paintbrush. The system includes a cartoon virtual pen drawing module, an AI image recognition and generation module, a Camera image capture module, a voice interaction module, and a data communication module configured on the system control board, as well as an AI expression recognition module and a cloud database module configured on the cloud server; wherein: Cartoon virtual pen drawing module: Uses a visualized cartoon image (such as Nezha, Sun Wukong) as a virtual paintbrush, and has an air gesture or touch screen operation function; at the same time, it is used for dynamic rendering of the pen tip and the pen body, and guides user interaction through a voice prompt (such as "Let's draw together") when starting up. AI image recognition and generation module: Connects to the cloud server, and based on the AI application services provided by the cloud server, analyzes the user's handwriting trajectory in real time, and converts the user's handwriting trajectory collected by the touch control substrate 7 into a structured image (such as generating an "apple" from a circular trajectory). Further, the AI image recognition and generation module provides multi-stage scene derivation (such as the growth process of a tree from sowing to fruiting), and synchronously generates an animation effect. Camera image capture module: Utilizes the configured high-sensitivity camera 4 to track the user's facial expressions and gesture movements in real time to generate capture data; the capture data is used for dynamically adjusting system feedback (such as updating the screensaver image according to the "happy" expression). AI expression recognition module: Analyzes the user's expressions collected by the camera 4 through machine learning algorithms, recognizes the user's emotional state (such as excitement, concentration) to form emotional data; feeds the emotional data back to the drawing screen device to optimize the interaction strategy (such as adjusting the frequency of voice encouragement). Voice interaction module: Integrates natural language processing (NLP) technology to provide real-time voice guidance through the speaker 5 (such as "This is 1 tree and 5 apples"); supports multi-scenario voice interaction (such as error operation warnings, knowledge popularization); Data communication module: Used to access the public network and establish a connection with the cloud server through the public network to achieve the update of the AI application service model and the synchronization of multi-user data; Cloud database module: Configured on the cloud server and stores preset image templates (such as the growth process of animals and plants), voice libraries, and user creation records; Furthermore, as another feasible implementation, the voice library and user creation records can also be stored locally on the painting screen device.

[0034] Furthermore, the user draws an initial handwriting with a virtual pen → the Camera module captures actions and expressions → the AI image recognition module generates a structured image → the voice module synchronously outputs educational content → the expression recognition module optimizes the interaction strategy → the cloud database updates user data → finally outputs a dynamic animation and voice feedback.

[0035] A control method for an AI enlightenment painting screen with a virtual pen adopts the described AI enlightenment painting screen system with a virtual pen. The method includes the following steps: Step 1, set the virtual pen cartoon character image favored by the user when the device is powered on for the first time; Step 2, invite the user to draw through voice prompts and determine whether the user triggers the drawing mode; if so, obtain the user's current touch trajectory and execute Step 3; otherwise, execute Step 2; Step 3, query the first stroke rule based on the user's current touch trajectory to confirm and obtain the information of the proposed drawing object, and report the information of the proposed drawing object through voice prompts; Step 4, the device sequentially displays the growth process diagrams of different stages of the growth cycle of the proposed drawing object, and guides the user to complete the graffiti painting of each stage of the growth process diagram through voice broadcasts until the final image of the proposed drawing object is completed; Step 5, record the proposed drawing object as the current user's favorite item and then complete the final image of the drawing. At the same time, generate a corresponding dynamic animation effect based on the final image and display it; Step 6, capture the user's expression through the camera 4, and then determine whether the user likes the corresponding dynamic animation effect through AI recognition; if so, save the current user's expression picture as the screensaver picture and report to the user through voice broadcast that the corresponding user's expression picture is the screensaver picture, and execute Step 7; otherwise, clear the current image and execute Step 2; Step 7: Associate the current user's favorite item with the corresponding user, record and update it in the cloud database, and then finish drawing.

[0036] Further, Step 1 specifically includes the following steps: Step 1-1: When the device is powered on for the first time, display any one of the preset virtual pen cartoon character images. Step 1-2: Track the user's expression through the camera 4, and use AI to recognize the user's expression to determine whether the user is satisfied with the current virtual pen cartoon character image; if so, save the current virtual pen cartoon character image as the default startup screen and execute Step 2; otherwise, automatically select the next unshown virtual pen cartoon character image and execute Step 1-2.

[0037] Further, in Step 2, the drawing mode is triggered by the user touching the touch panel of the device.

[0038] Further, Step 4 specifically includes the following steps: Step 4-1: Obtain the growth process diagrams of different stages of the growth cycle of the proposed drawing object, enter the progressive drawing mode of the proposed drawing object, and initialize the current growth stage. Step 4-2: Display the growth process diagram of the corresponding stage of the proposed drawing object, and guide the user to complete the graffiti drawing of the current stage by playing the voice of the proposed drawing object and the current growth stage. Step 4-3: Determine whether the number of completed growth process diagrams is equal to the total number of growth process diagrams of the proposed drawing object; if so, display the final image and play the voice to complete the growth cycle of the proposed drawing object and execute Step 5; otherwise, obtain the growth process diagram of the next stage and execute Step 4-2.

[0039] Further, in Step 4-1, obtain the growth process diagrams of different stages of the growth cycle from the cloud server, and the cloud server stores the image templates of the growth processes of different preset drawing objects and the supporting voice libraries.

[0040] Further, the specific steps of AI recognition are as follows: S1: Obtain the user expression image collected by the camera 4, upload it to the cloud server, save it in the object storage service OSS, and send an AI image recognition request to the application service. S2: The application service obtains the target image from the object storage service OSS through the visual intelligence AI application service and performs image recognition to obtain the image AI recognition result. S3: The application service returns the image AI recognition result to the terminal display device.

[0041] Furthermore, the visual intelligent AI application service is used for face and body recognition, scene recognition, IPC picture target detection and picture recognition, white background picture detection, color recognition, dish recognition, style recognition, etc.

[0042] The following is a detailed description of the specific working principle of the present invention: An AI enlightenment painting screen device with a virtual brush of the present invention has: Cartoon virtual pen: The vivid cartoon virtual pen can be composed of a pen tip and a pen body. For example, the pen tip is the pointed part of Nezha's thin spear, and the pen body is composed of Nezha's body and head image. The following is an example schematic diagram ( Figure 6 ) as shown. Boot screen: Little Nezha holds the virtual brush and gives a voice reminder: "Let's draw together."

[0043] Intelligent screen display: 1. When starting up, confirm the expression of the little painter, a cute child, and determine which cartoon virtual pen character the boot screen will be; 2. According to the expression of each painting result, if it is happy, save and update it as the screensaver screen.

[0044] The rule of the first stroke of drawing: Generate the corresponding object according to the defined first stroke rule, and then gradually generate a developable image according to the strokes.

[0045] Example 1: A brief description of the growth process of a tree from sowing to blooming and bearing fruit, and there will be a voice prompt for each process.

[0046] 1) [The first stroke is drawn upward, indicating a tree] - [Show the picture of a tree]; 2) Start scribbling, and the picture shows the sowing picture of the tree; 3) Continue scribbling, and the tree seed germinates; 4) Continue scribbling, and it grows into a small sapling; 5) Continue scribbling, and it grows into a small tree; 6) Continue scribbling, and a big tree is generated; 7) Continue scribbling, and the big tree blooms; 8) Continue scribbling, and the big tree starts to bear fruit; 9) Voice prompt: This is 1 tree and 5 apples, and the number "1" tree is shown (next to the tree); The drawing of the tree growth process is completed; 10) The software produces an animation effect, such as the tree swaying in the wind; Voice prompt: What a beautiful tree.

[0047] It should be noted that: For slightly older children (such as 5 - 8 years old), it can be upgraded to a new mode, the little painter mode that guides intelligent drawing, such as adding voice prompts for leaves, branches, flowers, and fruits.

[0048] Example 2: A brief description of the growth process from an egg to a chick, and there will be a voice prompt for each process.

[0049] 1) [The first stroke is a dot, representing an egg]; [Begin to doodle,] the hen begins to hatch the eggs; 2) [Begin to doodle,] after 21 days the eggs begin to break out of their shells; 3) [Begin to doodle,] the chicks poke their heads out; 4) [Begin to doodle,] the chicks are completely out of their shells; 5) [Begin to doodle,] the hen leads 5 chicks; 6) Voice prompt: This is a hen leading 5 chicks (and the numbers are displayed next to the hen and chicks respectively). The process of hatching eggs into chicks is complete; 7) The software creates animation effects, such as a hen leading chicks to forage; Voice prompt: What cute chicks!

[0050] The device of the present invention breaks the single function of painting on existing display devices. It is a flexible intelligent display screen that can be suitable for different groups of people, especially children's enlightenment education, including casual graffiti, children's fun drawing and AI-derived new image solutions. It mainly includes cartoon virtual pen drawing module, AI image recognition generation module, Camera image capture module, AI expression recognition module, voice interaction and other modules. This process is a cute baby painting mode, and the system mainly assists in completing the painting (if there are children aged 5-8, you can choose the little painter mode, and you can add voice prompts of leaves, branches, flowers, fruits, etc. on the basis of the first draft painting). The system equipped with the present invention has the following technical features: Cartoon virtual pen drawing module: mainly used for the painter-little painter to draw manually in the air or touch the display panel to draw manually; AI image recognition generation module: It needs to use cloud AI application services to generate and recognize pictures of the little painters, and complete the image generation and development process of different types of objects; Camera module: mainly used to track the expression of the painter, the little painter, and record and save the expression photos of the little painter; AI expression recognition module: AI recognizes the expressions captured by the camera and transmits the AI-recognized expressions back to the host; The interactive voice module is mainly used to interact with the young painter to increase the fun, such as reminding the young painter of the growth process of the object, praising the performance of the young painter, and guiding the deviation of the drawing to complete the drawing; it is also used to warn against the violent use of the display product, such as "You hurt me!" and so on.

[0051] The present invention provides the creation of cartoon virtual pen, the AI ​​image generation module and the voice recognition module communicate and interact, and present vividly; the camera image capture module and the AI ​​expression recognition module communicate and interact, and record accurately; establish the connection communication of the cartoon virtual pen drawing module, the AI ​​image recognition generation module, the camera image capture module, the AI ​​expression recognition module, the voice interaction module and other modules, and at the same time need to be linked and communicated through the database of the cloud AI application server; vivid and lovely cartoon character brush voice broadcast; define the first stroke painting rule intelligent young painter painting enlightenment method; The present invention provides an enlightenment painting method for intelligent guided asymptotic mapping; during the enlightenment painting process, it simultaneously achieves the purpose of an enlightenment painting for recognizing objects by looking at pictures and counting, and popularizes daily knowledge, such as the enlightenment education process from eggs to chicks; after the little painter completes the picture, an animation effect is generated for fun.

[0052] The present invention adopts the above technical solutions. Based on the AI image recognition module, it can instantly convert the user's random doodles into structured images, with an identification accuracy rate of over 90%, significantly reducing the ineffective operation rate. According to the preset growth logic of the cloud AI model, it gradually derives dynamic scenes according to the user's stroke order, achieving the enlightenment education effect of "one stroke triggers multi-stage evolution", enabling children to intuitively understand natural laws and scientific knowledge. The voice interaction module combines NLP technology to synchronously output guiding prompts, knowledge popularization, and interesting encouragement during the user's painting process, enhancing the interactive immersion and improving the user participation rate. The AI facial expression recognition module analyzes the user's emotions in real time and dynamically adjusts the feedback strategy to make the interaction more targeted, improving the learning efficiency of children. Using classic IP images such as Nezha and Sun Wukong as virtual paintbrushes, it attracts children's attention through dynamic rendering and anthropomorphic voices, and the average usage duration of users increases. After completing the painting, the system automatically generates a scene animation with sound effects and voice summary to help children consolidate their counting and object recognition abilities, and the knowledge retention rate is improved. The cloud database supports real-time updating of preset templates, voice libraries, and AI models, and can expand educational content without hardware upgrade, reducing the maintenance cost. By storing the user's creation records and facial expression data in the cloud, it supports cross-device synchronization of the learning progress and provides a visual report for parents, enhancing the practicality of the product.

[0053] The present invention supports the switching between the "cute baby mode" and the "little painter mode", provides differential guidance for different age groups, and covers the educational needs of children aged 3 - 10. The modular architecture of the present invention can be adapted to various touch display screens (such as tablets and smart drawing boards), and can be quickly integrated through standardized interfaces, shortening the commercialization implementation cycle.

[0054] Obviously, the described embodiments are some, but not all, of the embodiments of the present application. Without conflict, the embodiments and features in the present application can be combined with each other. Usually, the components of the embodiments of the present application described and illustrated in the accompanying drawings here can be arranged and designed in various different configurations. Therefore, the detailed description of the embodiments of the present application is not intended to limit the scope of the present application claimed, but merely represents the selected embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts belong to the scope of protection of the present application.

Claims

1. An AI enlightenment painting screen device with a virtual paintbrush, characterized in that: It includes a housing, a system control board and a display screen arranged inside the housing. A touch control substrate connected to the system control board is configured on the surface of the display screen; a display window is provided on the housing corresponding to the display screen, and at least one camera and at least one speaker electrically connected to the system control board are provided on the frame around the display window corresponding to the housing; the camera captures an image screen and real-time tracks the user's facial expressions and gesture movements to generate capture data; the speaker is used to play audio information; a communication unit connected to the system control board is also provided inside the housing; the communication unit is communicatively connected to a cloud server, and the cloud server provides remote AI application services; the system control board analyzes the user's handwriting trajectory in the capture data in real time based on the AI application services provided by the cloud server, converts the user's handwriting trajectory collected by the touch control substrate into a structured image, and completes the image generation and development process of different item types; at the same time, face AI recognition is performed on the capture data based on the AI application services of the cloud server to obtain a face AI recognition result, and the user's emotional state is judged based on the face AI recognition result to optimize the interaction strategy.

2. The AI enlightenment painting screen device with a virtual paintbrush according to claim 1, wherein: The system control board is connected to the speaker through an audio processing unit, and the audio processing unit is used to perform processing operations on the audio. The processing of the audio includes volume adjustment, sound quality optimization, and sound effect enhancement.

3. An AI enlightenment painting screen device with a virtual paintbrush according to claim 1, characterized in that: A power management unit is provided on the system control board. The power management unit is respectively connected to the battery, the communication unit and the system control board, and supplies power to each component of the device.

4. An AI enlightenment painting screen system with a virtual paintbrush, which adopts an AI enlightenment painting screen device described in claim 1, is characterized in that: The system includes a cartoon virtual pen drawing module, an AI image recognition and generation module, a Camera image capture module, a voice interaction module and a data communication module configured on the system control board, and an AI expression recognition module and a cloud database module configured on the cloud server; wherein: Cartoon virtual pen drawing module: uses a figurative cartoon image as a virtual pen, and has the functions of air gesture or touch screen operation; at the same time, it is used for dynamic rendering of the pen tip and the pen body, and guides user interaction through voice prompts when starting up; AI image recognition and generation module: is connected to the cloud server, and analyzes the user's handwriting trajectory in real time based on the AI application services provided by the cloud server, and converts the user's handwriting trajectory collected by the touch control substrate into a structured image; provides multi-stage scene derivation and synchronously generates animation effects; Camera image capture module: uses the configured high-sensitivity camera to real-time track the user's facial expressions and gesture movements to generate capture data; the capture data is used for dynamic adjustment of system feedback; AI expression recognition module: analyzes the user's expressions captured by the camera through machine learning algorithms, recognizes the user's emotional state to form emotional data; feeds back the emotional data to the drawing screen device to optimize the interaction strategy; Voice interaction module: integrates natural language processing technology to provide real-time voice guidance through the speaker; supports multi-scene voice interaction; Data communication module: is used to access the public network, and establishes a connection with the cloud server through the public network to realize the update of the AI application service model and the synchronization of multi-user data; Cloud database module: is configured on the cloud server and stores preset image templates, voice libraries and user creation records.

5. A control method for an AI enlightenment painting screen with a virtual paintbrush, which adopts an AI enlightenment painting screen system with a virtual paintbrush described in claim 4, and is characterized in that: The method includes the following steps: Step 1, set the virtual pen cartoon character image favored by the user when the device is powered on for the first time; Step 2, invite the user to draw pictures through voice prompts, and determine whether the user triggers the drawing mode; If so, obtain the user's current touch trajectory and execute Step 3; Otherwise, execute Step 2; Step 3, query the first stroke rule based on the user's current touch trajectory to confirm the obtained information of the proposed drawing object, and report the information of the proposed drawing object through voice prompts; Step 4, the device sequentially displays the growth process diagrams of different stages of the growth cycle of the proposed drawing object, and guides the user to complete the graffiti painting of each stage of the growth process diagram through voice broadcast until the final image of the proposed drawing object is completed; Step 5, record the proposed drawing object as the current user's favorite item, then complete the final image of the drawing, and at the same time generate a corresponding dynamic animation effect based on the final image and display it; Step 6, capture the user's expression through the camera, and then determine whether the user likes the corresponding dynamic animation effect through AI recognition; if so, save the current user's expression picture as the screensaver picture and report it to the user through voice broadcast that the corresponding user's expression picture is the screensaver picture, and execute Step 7; otherwise, clear the current image screen and execute Step 2; Step 7, associate the current user's favorite item with the corresponding user, record and update it to the cloud database, and then complete the drawing.

6. The control method of an AI enlightenment system with a virtual paintbrush according to claim 5, characterized in that: Step 1 specifically includes the following steps: Step 1-1, display any one of the preset virtual pen cartoon character images when the device is powered on for the first time; Step 1-2, track the user's expression through the camera, and judge whether the user is satisfied with the current virtual pen cartoon character image through AI recognition; if so, save the current virtual pen cartoon character image as the default startup screen and execute Step 2; otherwise, automatically select the next un-displayed virtual pen cartoon character image and execute Step 1-2.

7. The control method of an AI enlightenment system with a virtual paintbrush according to claim 5, characterized in that: In Step 2, the drawing mode is triggered when the user touches the touch panel of the device.

8. The control method of an AI enlightenment system with a virtual paintbrush according to claim 5, characterized in that: Step 4 specifically includes the following steps: Step 4-1, obtain the growth process diagrams of different stages of the growth cycle of the proposed drawing object, and enter the progressive drawing mode of the proposed drawing object and initialize the current growth stage; Step 4-2, display the growth process diagram of the corresponding stage of the proposed drawing object, and guide the user to complete the graffiti painting of the current stage by playing the proposed drawing object and the current growth stage through voice; Step 4-3, judge whether the number of completed growth process diagrams is equal to the total number of growth process diagrams of the proposed drawing object; if so, display the final image screen and play through voice that the growth cycle of the proposed drawing object is completed and execute Step 5; otherwise, obtain the growth process diagram of the next stage and execute Step 4-2.

9. The control method of an AI enlightenment system with a virtual paintbrush according to claim 8, characterized in that: In Step 4-1, obtain the growth process diagrams of different stages of the growth cycle from the cloud server. The cloud server stores the image templates of the growth processes of different drawing objects and the supporting voice libraries.

10. The control method of an AI enlightenment system with a virtual paintbrush according to claim 5, characterized in that: The specific steps of AI recognition are as follows: S1, obtain the user's expression image collected by the camera, upload it to the cloud server, save it to the object storage service OSS, and send an AI image recognition request to the application service; S2, The application service obtains the target picture from the object storage service OSS through the visual intelligence AI application service and performs picture recognition to obtain the picture AI recognition result; S3, The application service returns the picture AI recognition result to the terminal display device.

Images