METHOD AND SYSTEM FOR MANAGING AN EDUCATIONAL ROBOT

Description

1 / 11 METHOD AND SYSTEM FOR MANAGING AN EDUCATIONAL ROBOT

[001] Certificate of Addition of Invention to patent application BR 10 2021 006034-4 filed on 03 / 29 / 2021. Technological sector of invention

[002] This invention addition certificate pertains to the technological sector of data processing and programming logic, and refers more specifically to the method that manages the educational device in the form of a toy robot. Matter initially revealed

[003] The initially revealed material presents an educational robot that operates the functions of an educational device designed to offer a playful and educational experience for children from 4 years of age, under the supervision of educators. The educational robot's main objective is to introduce basic notions of programming logic in an intuitive and didactic way while the student interacts with the device; the activities utilize the school curriculum based on the BNCC (National Common Curricular Base). The BNCC provides fundamental guidelines and parameters for school curriculum activities, ensuring that the content is aligned with the planned educational objectives.

[004] This interaction stimulates the development of logical reasoning and creativity by enabling the creation of interactive narratives through programs designed in a practical and fun way.

[005] The educational robot comprises a chassis-like structure with four motorized wheels driven by drivers and powered by a rechargeable battery, and an upper part with four holes for attaching accessories, allowing for customization and the use of narrative elements such as banners. The electronic system comprises a circuit board connected to an LCD display, a camera for capturing images and reading QR codes, an ultrasonic sensor for obstacle detection, a line reader for following trajectories, a built-in microphone for audio capture, and a speaker for sound emission. Petition 870250014471, dated 21 / 02 / 2025, page 5 / 27 2 / 11 and a pencil for drawing geometric shapes.

[006] Complementing the educational robot, the system includes a kit of boards with corresponding QR Codes with their respective logical commands, captured by the robot's camera to integrate the programming logic, and boards with character figures, which can be used in the creation of stories and in the configuration of programmable routines. Object of addition

[007] This invention addition certificate details the management method of the educational robot. The method comprises the steps of receiving, processing, and executing commands given to the device, detailing how the robot processes the received instructions and responds to the interactions made by the student. This detail includes a description of the activities performed by the robot in response to the programmed commands, explaining the mechanisms that enable its operation in a clear and functional way.

[008] The information presented in this addendum certificate complements the technical specifications of the educational robot described in the main invention, identified by document no. BR 10 2021 006034-4, expanding the understanding of the device's operation by providing a detailed view of the steps involved in managing and executing commands. List of attached drawings

[009] In order that the object of this invention addition certificate may be fully understood and put into practice by any technician in this technological sector, it is described in a clear, precise and sufficient manner, based on the attached drawings listed below: Figure 1 - Diagram of the educational robot's management system; Figure 2 - Flowchart of the educational robot management method; Figure 3 - Flowchart of the management method for the educational robot with gamified activity comprised of multiple questions. Petition 870250014471, dated 21 / 02 / 2025, page 6 / 27 3 / 11 Detailed description of the addition

[010] To ensure the implementation and achievement of the technical effect proposed by the invention, and to enable its reproduction by technicians in the field, Figure 1 illustrates the system that manages the educational robot, comprising an interactive educational robot (1) equipped with a touch-sensitive display (11) that allows direct interaction between the student and the educational robot (1), a microphone (12) to capture audio commands or interactions, at least one speaker (13) to reproduce audio messages or verbal feedback, a camera (14) that enables visual recognition, such as reading plates with QR Codes (3), a pencil (24) that allows the drawing of geometric shapes, and wheels (15) that allow its movement in response to the interactions and commands received, configured to manage the electronic components of the system.This controller controls the wheel motors (15), responsible for the robot's mobility, and the sensors, such as proximity sensors (18) and RFID receiver unit (19) and the mechanism that supports the pencil (24). The function of the electronic controller (16) is to ensure the integrated operation of the motors and sensors, allowing the robot to function according to the programmed commands.

[011] For this certificate of addition, a Single Board Computer (SBC), commonly used in automation and robotics projects, was employed, which is referred to here as a compact computer (17), equipped with a temporary memory (17'). The compact computer (17) is responsible for executing the essential functions of the system, including the processing, management, and transient storage of data generated during interactions between the student and the educational robot (1). This device controls the integrated peripherals, such as the touch-sensitive display (11), the microphone (12), the speaker (13), capable of verbalizing errors and providing immediate and interactive feedback, and the camera (14), ensuring a dynamic and efficient experience. In addition, the compact computer (17) displays interactive menus that allow navigation through programming options, including game-oriented activities, and performs the execution of these activities. The temporary memory Petition 870250014471, dated 21 / 02 / 2025, page 7 / 27 4 / 11 (17') ensures the temporary storage of information necessary for the execution of programs and commands, allowing the educational robot (1) to operate efficiently and continuously.

[012] The educational robot (1) is equipped with a pencil (24) that can be controlled through programming with QR codes or RFID cards or by voice command or mobile device (1'), for example when given the commands to lower pencil (24) and then the command to draw a polygon to the right or left with the number of sides and the size, the educational robot (1) draws the design on a sheet fixed to the floor so that it can draw the requested polygon, after the end the command is given to raise the pencil (24).

[013] Optionally, interactions between the student and the educational robot (1) can be carried out through a mobile device (1'), which can be a cell phone or tablet. This mobile device (1') establishes communication with the educational robot (1) through pairing via wireless network, using technologies such as Bluetooth, Wi-Fi, or other equivalent and widely used in the state of the art. The aforementioned mobile device (1') has the function of receiving and transmitting the commands made directly by the student on the mobile device (1'), enabling the actions to be carried out through the touch screen, microphone or camera, specific to the mobile device (1').

[014] Optionally, the educational robot (1) can also be equipped with proximity sensors (18), designed to detect the presence of obstacles, such as various objects or walls, during the execution of programs involving movement. When an obstacle is identified by the proximity sensors (18), they send a signal to the electronic controller (16), which processes the information, immediately interrupting the movement of the educational robot (1) and, in parallel, the educational robot (1) uses its audio system to emit a verbal message informing of the impossibility of continuing the programmed route due to the obstacle detected by the proximity sensor (18).

[015] And optionally, the educational robot (1) can be equipped with a Petition 870250014471, dated 21 / 02 / 2025, page 8 / 27 5 / 11 RFID receiver unit (19), which allows the reception of summarized instructions through RFID signal emitting cards. These cards must be positioned close to the RFID reader unit (19) so that their information can be captured. This functionality enables the educational robot (1) to process a sequence of commands in a summarized manner, eliminating the need to perform individual readings of the QR Code plates (3), thus optimizing the programming process.

[016] The educational robot (1) has wireless network communication via the internet (23) with a data manager (2) that is operated in a virtual cloud environment. Said data manager (2) has data communication with a continuous memory unit (21) and also with a user interface (22).

[017] For the present application, a server designed to process signals sent by the sensors of the educational robot (1) was used, applied in Internet of Things (IoT) contexts. These sensors, such as presence, pressure and water sensors, among others, transmit data in real time or at programmed intervals, allowing the monitoring and control of specific activities. The server management system performs functions such as receiving, decoding, validating, storing and sending commands to IoT devices. Additionally, the server supports communication protocols such as MQTT, HTTP and CoAP, ensuring interoperability with different types of sensors and devices connected to the system.

[018] The data manager (2) comprises a system that communicates with the educational robot (1) via the internet (wifi network). This communication allows the compact computer (17) of the educational robot (1) to send, via the internet (23), data relating to the student who is previously registered in the data manager (2) and also data from sensors used in the activities, such as light detection sensors, buzzer, humidity, inclination, etc. (IoT). Said data manager (2) also includes integration with an artificial neural network previously trained to perform analyses based on Petition 870250014471, dated 21 / 02 / 2025, page 9 / 27 6 / 11 behavior and facial expressions to detect engagement in activities. Furthermore, it uses a database of responses provided by the student in an initial assessment questionnaire, from which it is possible to identify cognitive difficulties. Based on the assessment generated by the data manager (2), the compact computer (17) of the educational robot (1) will perform gamified activities, adapted to the level and specific needs of each student, promoting personalized learning. The results obtained are managed and stored associatively in the continuous memory unit (21), located in a cloud environment, linked to each student's registration. Subsequently, this information is sent again by the data manager (2) to the compact computer (17) of the educational robot (1), which will adjust the educational activities according to performance and continuous interaction.

[019] For the application of this additional certificate, artificial neural networks are employed, using computer vision techniques based on convolutional neural networks (CNNs). The student's emotional reactions are analyzed through facial expressions captured by the camera (14) integrated into the educational robot (1). The images recorded by the camera (14) are sent, via the compact computer (17), to the data manager (2), which processes them and forwards them to a previously trained artificial neural network.

[020] The artificial neural network identifies facial patterns, such as smiles, raised eyebrows, or expressions of displeasure, extracting relevant features and classifying the images into different emotional states. This interpretation is performed in real time and is then sent back by the data manager (2) to the compact computer (17) of the educational robot (1), which in turn adjusts the activities and interactions according to the identified emotional state. Based on this analysis, the educational robot (1) can offer verbal feedback or perform specific actions, ensuring an interaction adapted to the student's emotional state and promoting greater effectiveness in the educational process. Petition 870250014471, dated 21 / 02 / 2025, page 10 / 27 7 / 11

[021] The artificial neural network used by the data manager (2) comprises prior training performed with information available in public databases specifically for emotion recognition, such as RAF-DB, AffectNet and FER-2013. RAF-DB (Real-world Affective Faces Database) comprises a collection of labeled images of facial expressions captured in real-life situations, covering seven basic emotions and emotional combinations. AffectNet comprises one of the largest databases for the study of facial expressions, containing millions of images classified by emotional valence and activation level. FER-2013 (Facial Expression Recognition 2013) comprises a balanced and standardized dataset, widely used to categorize facial expressions into seven main emotions.For the assessment database, ready-made tests such as FDT, WCST, and trail making tests were used, compiled, and reduced to key questions that can define cognitive points that need to be worked on.

[022] The continuous memory unit (21) operates as a long-term repository responsible for storing data and content used by the temporary memory (17') of the compact computer (17) that is operated in the educational robot device (1) during its activities. The continuous memory (21) contains essential information, such as cognitive assessment questionnaires, answer grids, game questionnaires, as well as student and their respective educational robot (1) registrations. Each personal registration includes data related to cognitive, learning, and performance assessments obtained throughout the use of the educational robot (1).

[023] During the execution of the activities, the compact computer (17) of the educational robot (1) accesses the data stored in the continuous memory unit (21) through the data manager (2), to enable the personalization of tasks and interaction with students. During the classes, the information generated by the compact computer (17) of the educational robot (1) is stored in the temporary memory (17'). After the completion of the activities, this data is Petition 870250014471, dated 21 / 02 / 2025, page 11 / 27 8 / 11 transferred to the continuous memory unit (21) of the data manager (2), ensuring the updating and preservation of information for future use, whether in adjusting activities or in generating reports that assist educators in monitoring student progress.

[024] The user interface (22) constitutes the means of interaction between the educator responsible for the students and the educational robot system (1) and data manager (2), being accessible through electronic devices, such as computers or mobile devices, that have an internet connection (23) and a web browser. Through the user interface (22), the responsible educator can access the records of at least one student or all students linked to the data manager, under their responsibility (2) and whose data are stored in continuous memory (21).

[025] In addition to viewing registration information, the user interface (22) allows managing information already obtained, including cognitive diagnoses, performance and progress in activities. The responsible educator can also use the user interface (22) to select or configure the activities that will be performed or executed by each student in their respective educational robot (1), ensuring that the tasks are personalized according to the needs and educational objectives of each student.

[026] Figure 2 presents a flowchart that illustrates the steps of the educational robot management method (1): a) Through the user interface unit (22), the responsible educator selects the activity to be worked on with the student; b) In the virtual cloud environment, the data manager (2) receives the activity configuration selected by the responsible educator; c) The data manager (2) sends the configuration of the selected activity to the compact computer (17) of the educational robot (1); d) The educational robot (1) receives, on its compact computer (17), the student's login, provided through the communication resources characteristic of the mobile device (1'); Petition 870250014471, dated 21 / 02 / 2025, page 12 / 27 9 / 11 e) The compact computer (17) of the educational robot (1), executes the student's cognitive assessment questionnaire through questions that can be transmitted by: - display (11) or via speaker (13) of the educational robot itself (1) or - Audiovisual features characteristic of the mobile device (1'); f) The compact computer (17) of the educational robot (1) receives the student's answers to the questionnaire by means of: - via voice captured by the microphone (12) of the educational robot itself (1) or - Through the communication resources of the mobile device (1'); g) The compact computer (17) records the answers to the questionnaire questions in the temporary memory (17') of the educational robot (1), associating them with the user login informed in step d); h) The compact computer (17) sends the recorded responses to the data manager (2) in the virtual cloud environment; i) The data manager (2) configures the activity according to the student's level; j) The data manager (2) evaluates the student and generates a data package; k) The data manager (2) configures the activity selected in step (a) according to the cognitive level assessed about the student; l) The data manager (2) transfers the configured activity to the compact computer (17), which subsequently stores this package in temporary memory (17'); m) The compact computer (17) executes the activity selected in step a), gamified according to the data package generated in j), which includes at least one request for a response or action to be performed by the student, which can be transmitted: - Visually via the display (11) or through the speaker (13) of Petition 870250014471, dated 21 / 02 / 2025, page 13 / 27 10 / 11 own educational robot (1) or - Due to the audiovisual resources characteristic of the mobile device (1'); n) The compact computer (17) of the educational robot (1) receives the student's answers regarding the selected activity, by means of: - Voice capture via the microphone (12) of the educational robot itself (1); - By presenting plates with QR Codes (3) to the camera (14) of the educational robot (1); - Through the use of cards emitting RFID signals or - Due to the communication features characteristic of the child mobile device (1'); o) The educational robot (1) executes the sequence of actions programmed into the compact computer (17) according to the answers provided by the student in step n), performing at least one of the following actions: - Verbalization through the speaker (13) of the educational robot (1) about the actions performed by the educational robot (1) or - Sending information from the compact computer (17) to the electronic controller (16) which in turn drives the wheels (15) that will move the educational robot according to the programming, and the commands to lower or raise the pencil (24); p) The compact computer (17) sends the recorded responses to the data manager (2) in the virtual cloud environment; q) Data manager (2) sends the obtained responses and student performance to the previously trained artificial neural network; r) The previously trained artificial neural network evaluates the student's engagement in the activity and generates a data package; s) The data packet generated in step r) is sent to the data manager (2) which sends it to continuous memory (21); Petition 870250014471, dated 21 / 02 / 2025, page 14 / 27 11 / 11 t) The educational robot (1) receives the command to complete the activity by means of: - Voice capture via the microphone (12) of the educational robot itself (1) or - By presenting the plate with QR Code (3) corresponding to the completion command, to the camera (14) of the educational robot (1) or - Through the use of RFID communication cards corresponding to the termination command or - Due to the communication features characteristic of the child mobile device (1'); u) The compact computer (17) and data manager (2) complete the activities.

[027] Figure 3 illustrates the steps performed by the management method, in which the gamified activity is comprised of multiple questions conducted by the educational robot (1). In this configuration of the method, after the completion of step t), the compact computer (17) can return to step m) and execute it again sequentially until step t), according to the configuration previously defined for the activity selected in step a). This cycle will be repeated according to the parameters established in the configuration of the selected activity, before the execution of the command associated with step u), responsible for finalizing the activities. Petition 870250014471, dated 21 / 02 / 2025, page 15 / 27

Claims

1 / 5 CLAIMS 1. EDUCATIONAL ROBOT MANAGEMENT METHOD characterized by comprising the following steps: a) Select the activity to be worked on with the student through the user interface unit (22); b) Receive the configuration of the selected activity in the data manager (2) of the cloud virtual environment; c) Send the configuration of the selected activity to the compact computer (17) of the educational robot (1); d) Receive the student's login on the compact computer (17) of the educational robot (1), informed through the communication resources of the mobile device (1'); e) Execute the student's cognitive assessment questionnaire on the compact computer (17) of the educational robot (1) through - questions displayed on the display (11) or transmitted through the speaker (13) or - audiovisual resources of the mobile device (1');f) Receive the student's answers to the questionnaire on the compact computer (17) of the educational robot (1) by means of - voice captured by the microphone (12) or - by the communication resources of the mobile device (1'). g) Record the answers to the questionnaire questions in the temporary memory (17') of the educational robot (1), associating them with the user login informed in step d); h) Send the recorded answers from the compact computer (17) to the data manager (2) in the virtual cloud environment; i) Configure the activity in the data manager (2) according to the student's level; j) Evaluate the student and generate a data package in the data manager (2); Petition 870250014471, of 21 / 02 / 2025, page 16 / 27 2 / 5 k) Configure the activity selected in step (a) in the data manager (2) according to the evaluated cognitive level;l) Transfer the configured activity from the data manager (2) to the compact computer (17), which stores the data package generated in step j) in temporary memory (17'); m) Execute the activity selected in step a) on the compact computer (17), gamified according to the data package generated in step j), in the educational robot (1) which includes at least one request for a response or action to be performed by the student, which can be transmitted: - Visually through the display (11) or through the speaker (13) of the educational robot itself (1) or - Through the audiovisual resources characteristic of the mobile device (1'); n) Receive the student's responses regarding the activity selected on the compact computer (17) of the educational robot (1) via - voice through the microphone (12) of the educational robot itself (1); - presentation of plates with QR Codes (3) to the camera (14) of the educational robot (1);- use of cards with RFID signal emission or - communication resources characteristic of the child mobile device (1'); o) Execute the sequence of actions programmed in the compact computer (17) of the educational robot (1) according to the answers provided by the student in step n), performing at least one of the following actions: - Verbalization through the speaker (13) of the educational robot (1) about the actions performed by the educational robot (1) or - Sending information from the compact computer (17) to the electronic controller (16) which in turn activates the wheels (15) that will move the educational robot according to the programming, and the commands to lower or raise the pencil (24); p) Send the recorded answers from the compact computer (17) of the educational robot (1) to the data manager (2) in the virtual cloud environment;Petition 870250014471, dated 21 / 02 / 2025, page 17 / 27 3 / 5 q) Send the obtained responses and student performance from the data manager (2) to the previously trained artificial neural network; r) Evaluate student engagement in the activity through the artificial neural network and generate a data packet; s) Send the data packet generated in step r) to the data manager (2), which stores it in continuous memory (21). t) Receive the command to end the activity on the educational robot (1) by means of: - Voice capture through the microphone (12) of the educational robot (1) itself or - By presenting the board with QR Code (3) corresponding to the end command, to the camera (14) of the educational robot (1) or - By using RFID communication cards corresponding to the end command or - By the communication resources characteristic of the child mobile device (1') u) End the activities by the compact computer (17) and data manager (2).; 2. EDUCATIONAL ROBOT MANAGEMENT METHOD according to claim 1, characterized by the gamified activity being comprised of multiple questions conducted by the educational robot (1), where, after the completion of stage (t), the compact computer (17) returns to stage (m) and executes again sequentially up to stage (t), according to the configuration previously defined for the activity selected in stage (a), repeating the cycle according to the parameters established before the execution of the command associated with stage (u), responsible for finalizing the activities.

3. EDUCATIONAL ROBOT MANAGEMENT SYSTEM employing the method defined in claim 1, characterized by the system comprising an interactive educational robot (1) equipped with a display (11), microphone (12), speaker (13), camera (14), a pencil (24) and wheels (15); Petition 870250014471, dated 21 / 02 / 2025, page 18 / 27 4 / 5 an electronic controller (16) that controls the motors of the wheels (15) and the motors of the mechanism that supports the pencil (24); a compact computer (17) for controlling the touch-sensitive display (11), microphone (12), speaker (13) and camera (14) and a data manager (2) in a virtual cloud environment connected to a continuous memory unit (21), a previously trained artificial neural network and a user interface (22).

4. EDUCATIONAL ROBOT MANAGEMENT SYSTEM, according to claim 3, characterized in that the compact computer (17) is an SBC (Single Board Computer) equipped with a temporary memory (17').

5. EDUCATIONAL ROBOT MANAGEMENT SYSTEM, according to claim 3, characterized in that the educational robot (1) has wireless network communication with a mobile device (1') such as a cell phone or tablet.

6. EDUCATIONAL ROBOT MANAGEMENT SYSTEM, according to claim 3, characterized in that the educational robot (1) is equipped with at least one proximity sensor (18) and RFID receiver unit (19) monitored by the electronic controller (16).

7. EDUCATIONAL ROBOT MANAGEMENT SYSTEM, according to claim 3, characterized in that the data manager (2) has communication via the internet (23) with the educational robot (1).

8. EDUCATIONAL ROBOT MANAGEMENT SYSTEM, according to claim 3, characterized in that the artificial neural network of the data manager (2) comprises prior training performed with information available in public databases such as RAF-DB, AffectNet and FER-2013.

9. EDUCATIONAL ROBOT MANAGEMENT SYSTEM, according to claim 3, characterized in that the user interface (22) is accessible through electronic devices, such as computers or mobile devices, that have an internet connection and a web browser.] 10. EDUCATIONAL ROBOT MANAGEMENT SYSTEM, according to Petition 870250014471, dated 21 / 02 / 2025, p. 19 / 27 5 / 5 with claim 3, characterized in that it has at least one QR code (3) that is read by the camera (14). Petition 870250014471, dated 21 / 02 / 2025, p. 20 / 27

Images