A robotic system and interactive system to assist in the visual arts education of a user

Abstract

The application discloses a robot system and an interactive system for assisting visual art education of a user, and the robot system comprises a capability detection device, a control module, an interactive interface and a mechanical arm. The capability detection device is configured to detect the capability of the user. The control module is connected to the capability detection device and is configured to form an art creation task according to the capability detection result. The interactive interface is connected to the control module and is configured to display guide information corresponding to the art creation task. The mechanical arm is connected to the control module, and at least part of the mechanical arm is sleeved on the hand of the user. The mechanical arm assists the hand movement of the user through movement, so that the user performs art creation on the interactive interface. At least part of the mechanical arm can be sleeved on the hand of the user to assist the hand of the user.

Description

Technical Field

[0001] This application relates to the field of robotics technology, and in particular to a robotic system and interactive system that assists users in visual arts education. Background Technology

[0002] As people's living standards improve, various service robots have emerged to meet the diverse spiritual and cultural needs of users. However, current service robots are designed for the general public, and their functions and structures are not suitable for elderly or hand-impaired users. In other words, service robots on the market are not well-targeted for elderly or hand-impaired users and cannot meet the needs of this group. Utility Model Content

[0003] This application provides a robotic system and interactive system to assist users in visual arts education. At least a portion of a robotic arm can be fitted onto the user's hand to provide assistance. Furthermore, the robotic arm can provide assistance throughout the entire creative process, or it can provide assistance only when the user's movements are detected to be unstable. This method of providing assistance only when unstable reduces the difficulty of creation while preserving user autonomy, avoiding the dependency problem caused by full-process assistance. Based on the guidance information set in the art creation task, the art creation task can be simplified, enabling gradual guidance for the user's creation and reducing the difficulty of creation.

[0004] To address the aforementioned technical problems, this application provides a robotic system to assist users in visual arts education, comprising a capability detection device, a control module, an interactive interface, and a robotic arm. The capability detection device is configured to detect the user's capabilities; the control module, connected to the capability detection device, is configured to generate an art creation task based on the capability detection results; the interactive interface, connected to the control module, displays guidance information corresponding to the art creation task; the robotic arm, connected to the control module, is at least partially fitted onto the user's hand; the robotic arm assists the user's hand movements through motion, enabling the user to create art on the interactive interface.

[0005] In some embodiments, the robot system further includes an image acquisition device for acquiring images of the user. The robotic arm includes a first processing unit and a robotic arm body; the first processing unit is connected to the image acquisition device; the robotic arm body is connected to the first processing unit, and the robotic arm body is at least partially fitted onto the user's hand.

[0006] In some embodiments, the robotic system further includes a force detection module for detecting the force applied by the user on the interactive interface during the artistic creation process.

[0007] In some embodiments, the robotic system further includes a speed detection module for detecting the user's creative speed during the artistic creation process.

[0008] In some embodiments, the robot system further includes a physiological parameter detection module disposed on the robotic arm body, which detects the user's physiological parameters when the robotic arm body is at least partially fitted onto the user's hand.

[0009] In some embodiments, the physiological parameter detection module includes a blood oxygen detection unit, a heart rate detection unit, and / or a temperature detection unit.

[0010] In some embodiments, the robot system further includes a reminder module for generating a reminder message when physiological parameters do not meet preset conditions; the reminder module includes a voice reminder unit and / or an indicator light reminder unit.

[0011] In some embodiments, the robot system further includes a touch component held by a user for interacting with an interface.

[0012] In some embodiments, the robot system includes an interactive body, a control module, an interactive interface, and a robotic arm disposed on the interactive body.

[0013] To address the aforementioned technical problems, this application also provides an interactive system, which includes an interactive platform and the aforementioned robot system, with the robot system communicating with the interactive platform.

[0014] This application provides, in some embodiments, a robotic system and interactive system for assisting users in visual arts education, including a capability detection device, a control module, an interactive interface, and a robotic arm. The capability detection device is configured to detect the user's capabilities; the control module, connected to the capability detection device, is configured to generate an art creation task based on the capability detection results; the interactive interface, connected to the control module, displays guidance information corresponding to the art creation task; the robotic arm, connected to the control module, is at least partially fitted onto the user's hand; the robotic arm assists the user's hand movements through motion, enabling the user to create art on the interactive interface. At least a portion of the robotic arm can be fitted onto the user's hand to assist the user's hand; furthermore, the robotic arm can provide assistance throughout the creation process, or it can provide assistance only when the user's movements are detected to be unstable. Providing assistance only when unstable reduces the difficulty of creation while preserving user autonomy, avoiding the dependency problem caused by full-process assistance. Based on the guidance information set in the art creation task, the art creation task can be simplified, achieving gradual guidance for the user's creation and reducing the difficulty of creation. Attached Figure Description

[0015] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort. Wherein:

[0016] Figure 1 This is a schematic diagram of the structure of a robot system for assisting users in visual arts education provided in some embodiments of this application;

[0017] Figure 2 This is a schematic diagram of the structure of a robot system for assisting users in visual arts education provided in some embodiments of this application;

[0018] Figure 3 This is a schematic diagram of the structure of a robot system for assisting users in visual arts education provided in some embodiments of this application;

[0019] Figure 4 This is a schematic diagram of the structure of a robot system for assisting users in visual arts education provided in some embodiments of this application;

[0020] Figure 5 This is a schematic diagram of the structure of a robot system for assisting users in visual arts education provided in some embodiments of this application;

[0021] Figure 6 This is a schematic diagram of the structure of a robot system for assisting users in visual arts education provided in some embodiments of this application;

[0022] Figure 7 This is a schematic diagram of the structure of the interactive system provided in some embodiments of this application. Detailed Implementation

[0023] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of the embodiments. Based on the embodiments of this application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of this application.

[0024] According to some embodiments of this application, please refer to Figures 1 to 6 , Figures 1 to 6 These are schematic diagrams of the structure of a robot system that assists users in visual arts education, provided in some embodiments of this application.

[0025] Please see Figure 1 The robot system 10 includes a capability detection device 101, a control module 102, an interactive interface 103, and a robotic arm 104.

[0026] The system includes a capability detection device 101 configured to detect the user's capabilities and obtain capability detection results. A control module 102 connected to the capability detection device 101 is configured to generate an art creation task based on the capability detection results. An interactive interface 103 connected to the control module 102 displays guidance information corresponding to the art creation task. A robotic arm 104 connected to the control module 102 is at least partially fitted onto the user's hand; the robotic arm 104 assists the user's hand movements through motion, enabling the user to create art on the interactive interface 103 and obtain an artwork.

[0027] The competency tests involved in this application are related to a user's visual sensitivity, hearing, and hand dexterity. The competency test results can be directly used to create artistic creation tasks suitable for the user; alternatively, the competency test results can be stored in a memory, server, cloud, or other device, and the control module 102 can directly retrieve the competency test results from the memory, server, cloud, or other devices before creating artistic creation tasks suitable for the user.

[0028] The users involved in this application can be elderly users, young users, or teenagers. The robot system 10 is used to assist elderly users, young users, or teenagers in their visual arts education. It is understood that the ability test results of different users may differ. Therefore, a real-time ability test can be performed on each user before each use of the robot system 10 to ensure that the ability test results are updated in real time, avoiding errors in the assistance provided by the robotic arm 104, etc., within the robot system 10. Here, users may not be required to log in with an account, allowing different users to use the system at any time. Alternatively, when a user uses the robot system 10, based on the user information (account, username, etc.) entered by the user on the interactive interface, the control module 102 can directly retrieve the corresponding ability test results from the memory, server, cloud, or other devices, avoiding multiple repeated tests and saving time.

[0029] The control module 102 involved in this application may be referred to as a CPU (Central Processing Unit), which may be an integrated circuit chip, or a general-purpose processor, digital signal processor (DSP), application-specific integrated circuit (ASIC), field-programmable gate array (FPGA), or other programmable logic device, discrete gate or transistor logic device, or discrete hardware component.

[0030] The artistic creation tasks involved in the present application are related to the user's visual sensitivity, hearing, hand dexterity and the like. For example, when the user has poor visual sensitivity, an artistic creation task related to calligraphy may be generated; for another example, when the user has inflexible hands, an artistic creation task related to a painting target with fewer details and thicker lines may be generated.

[0031] In some embodiments, the artistic creation task suitable for the user may be obtained by targeted modification of a template creation task according to the ability test result, wherein the template creation task is preset in advance. For example, the template creation task is related to calligraphy, which is writing the Chinese character "Fu". When the user's ability test result shows that the user has inflexible hands, the writing target can be modified from writing the Chinese character "Fu" to writing the Chinese character "Da" with fewer strokes to reduce the difficulty.

[0032] In some embodiments, a plurality of template creation tasks are displayed on the interaction interface 103. After the user interacts with the interaction interface 103 to select a target template creation task, the robot system 10 may invoke the user's ability test result to perform targeted modification on the target template creation task, so as to obtain the artistic creation task suitable for the user.

[0033] In one application scenario, the capability detection apparatus 101 may perform a vision test, a hand dexterity test and the like when the robot system 10 is started, and the test results are used to initialize and set fixed parameters. For example, large-size fonts and high-contrast color schemes are automatically set for users with poor vision, the hand dexterity test result is used to determine the assistance force threshold of the mechanical arm 104, and the layout of the interaction interface 103 and font parameters remain static and unchanged in subsequent use.

[0034] In some embodiments of the present application, the display content of the interaction interface 103 may be adjusted according to the ability test result, and / or the display content of the interaction interface 103 may be adjusted according to the environment (for example, detecting the light intensity according to an environment perception sensor). For example, adjusting the lines of the display content (e.g., adjusting to thick lines), colors (e.g., adjusting to colors with significant contrast color schemes), fonts (e.g., adjusting to large fonts), layout (e.g., adjusting to the central position); for another example, when the light is weak, the display brightness of the interaction interface 103 is increased. The time point for adjusting the display content of the interaction interface 103 may be after the ability test result is obtained, before the user starts the creation operation, or before the artistic creation task is formed.

[0035] It can be understood that adjusting the display content of the interaction interface 103 can significantly improve visual readability, reduce operation fatigue, and avoid groups such as the elderly and people with poor vision from repeatedly adapting to the interaction interface 103. In addition, the adjustment of the display information of the interaction interface 103 before the user creates is a fixed adjustment, which can avoid the interference of subsequent real-time dynamic changes, and ensure that the interface always remains clear during the user's use process.

[0036] The ability test involved in this application can be related to the user's creative level. The user's creative level can be obtained directly from user information; or it can be determined by the user's answers to a questionnaire displayed on the interactive interface. The questionnaire may include information such as the user's gender, age, mood, art interests, whether they have basic drawing skills, and whether they have basic calligraphy skills.

[0037] Therefore, the art creation tasks involved in this application are related to the user's creative level. For example, when the user has basic painting skills, art creation tasks related to traditional Chinese painting, watercolor painting, etc. can be generated; when the user has basic calligraphy skills, art creation tasks related to calligraphy can be generated; when the user is female, art creation tasks that are of interest to women can be generated; and when the user is in a bad mood, art creation tasks with lower difficulty can be generated.

[0038] In some embodiments, an art creation task suitable for the user can be generated by combining the user's creative level with the user's visual sensitivity, hearing and hand dexterity (ability test results).

[0039] The robot system 10 of this application can also embed an AI (Artificial Intelligence) interaction module into the interaction interface 103. The AI ​​interaction module can generate guidance information corresponding to the artistic creation task and display the generated guidance information on the interaction interface 103. The guidance information can simplify complex artistic creation tasks into step-by-step operations to guide users to complete the work step by step.

[0040] The guidance information can be displayed gradually based on the user's real-time creation data on the interactive interface 103, so that the guidance information corresponds to the user's creation process; or, all the guidance information can be displayed on the interactive interface 103 by sliding left and right or up and down, so that the user can preview the guidance information for the next step of creation and make it easier for the user to adjust the creation layout on the interactive interface 103.

[0041] In one application scenario, the interactive interface 103 can display the creation steps based on the preset decomposition of the AI ​​interactive module. For example, a calligraphy work can be decomposed into fixed stroke steps such as dot, horizontal stroke, left-falling stroke, and right-falling stroke.

[0042] In some embodiments of this application, the step-by-step demonstration of preset creative steps, combined with the guidance of the robotic arm 104, can simplify complex artistic creation tasks into operable logical units.

[0043] The robotic arm 104 involved in this application is a multi-degree-of-freedom robotic arm (such as a 6-degree-of-freedom robotic arm or a 7-degree-of-freedom robotic arm). Each degree of freedom represents an independent joint that can produce an independent movement. The multi-degree-of-freedom robotic arm supports safe human-machine collaboration. The part of the robotic arm 104 that is fitted onto the user (i.e., the end of the robotic arm 104) is a wearable component (such as a wristband or other). It can be made of flexible materials such as silicone or plastic to avoid injury to the user's hands. In addition, it can have various sensors built in or integrated (such as a heart rate sensor), so that it can monitor the user's physiological state and posture in real time without relying on external wristbands or watches, and issue rest reminders or safety interventions in a timely manner, effectively ensuring the user's health and safety during the creative process.

[0044] The robotic arm 104 provided in this application can assist users throughout the entire creative process. Alternatively, the robotic arm 104 provided in this application can automatically provide precise and stable assistance only when it detects tremors or instability in the user's movements. The assistance force can be adjusted according to real-time data from tactile feedback sensors or force feedback sensors, for example, reducing the guiding force when the tremor amplitude increases, in order to improve the stability and smoothness of the artistic creation process such as calligraphy or painting.

[0045] Understandably, the approach of only responding when user movements are detected to be jerky or unstable not only reduces the difficulty of creation but also avoids dependency issues caused by excessive intervention and full-process assistance, thus preserving user autonomy.

[0046] Please see Figure 2 The robot system 10 includes a capability detection device 101, a control module 102, an interactive interface 103, a robotic arm 104, and an image acquisition device 105.

[0047] The image acquisition device 105 is used to acquire images of the user in real time. The robotic arm 104 includes a first processing unit 1041 and a robotic arm body 1042. The first processing unit 1041 is connected to the image acquisition device 105; the robotic arm body 1042 is connected to the first processing unit 1041, and the robotic arm body 1042 is at least partially fitted onto the user's hand.

[0048] In some embodiments, the image acquisition device 105 may include devices such as an RGB (Red, Green, Blue) camera, a depth camera, and / or a binocular camera.

[0049] In some embodiments, the images acquired by the image acquisition device 105 may include images of the user's hand. The first processing unit 1041 may be a processor, which is connected to the image acquisition device 105 to analyze image data and identify the user's motion state (such as shaking) and / or motion trajectory; the robotic arm body 1042 may be a flexible medical-grade silicone ring, at least partially fitted onto the user's wrist, forming a wearable design to achieve direct physical contact with the user's hand, ensuring effective transmission of assistive force without interference from external devices, avoiding discomfort caused by wearing additional devices, and significantly enhancing the operational comfort and creative safety of elderly users, etc.

[0050] Specifically, the first processing unit 1041 can process the user's hand image to obtain the user's hand trajectory information; further, the first processing unit 1041 can also process the hand trajectory information to generate a guidance path corresponding to the art creation task and / or guidance information based on the hand trajectory information. During the user's creation process, the robotic arm body 1042 can assist the user's hand movement according to the guidance path to obtain an artwork related to the art creation task on the interactive interface 103.

[0051] In some embodiments, the images acquired by the image acquisition device 105 may include user face images, which can be used for face recognition. When face recognition is successful, the user's account associated with the face can be logged in on the interactive interface 103.

[0052] In some embodiments, the robot system 10 includes a posture sensor and a depth camera. The posture sensor, combined with the camera, analyzes the user's sitting posture and hand movements, enabling the detection of incorrect postures and triggering safety prompts. Here, real-time monitoring of the user's hand and other postures allows for timely health alerts, adjusting the assistance mode of the robotic arm 104 for the user.

[0053] Please see Figure 3 The robot system 10 includes a capability detection device 101, a control module 102, an interactive interface 103, a robotic arm 104, an image acquisition device 105, and a force detection module 106.

[0054] The force detection module 106 is used to detect the force applied by the user on the interactive interface 103 during the artistic creation process in real time.

[0055] In some embodiments, the force detection module 106 includes a tactile feedback sensor or a force feedback sensor. The force detection module 106 can be integrated into the inner wall of a silicone ring at the end of the robotic arm 104; specifically, the tactile feedback sensor or force feedback sensor can be disposed on the inner surface of the silicone ring. When a user slips their wrist into the silicone ring for calligraphy or painting practice, the tactile feedback sensor or force feedback sensor can sense the pressure changes generated by the contact between the user's hand and the robotic arm 104.

[0056] The resistance of the user's hand can be determined based on the detection results (i.e., force data) of the force detection module 106, and the amplitude of the user's hand tremors can be dynamically analyzed to determine whether the assistance mode of the robotic arm 104 for the user's hand needs to be adjusted, thereby realizing the dynamic adjustment of the assistance force of the robotic arm 104. For example, when it is detected that the user's hand is applying too much force, the guiding force can be automatically reduced to avoid the user using excessive force and causing damage to the interactive interface 103, or when it is detected that the user is applying too little force, the assistance can be enhanced to support the user in completing the creative action and avoid the inability to leave any artistic creation-related marks on the interactive interface 103.

[0057] The force detection module 106 provided in this application can form a closed-loop feedback system with the robotic arm 104, eliminating the need for external devices such as wristbands or watches. Force detection is achieved directly through sensors integrated into the wearable component. Real-time monitoring of the force applied by the user and dynamic adjustment of the robotic arm 104's auxiliary force effectively solves the practice obstacles faced by elderly users or those with hand-eye coordination issues due to unstable hand strength or decreased coordination during artistic creation. It avoids excessive auxiliary force causing fatigue or insufficient auxiliary force leading to creative failure, significantly improving the safety and smoothness of the creative process. Simultaneously, this adaptive adjustment mechanism enhances the operational comfort and learning confidence of elderly users, reduces practice interruptions or health risks caused by discomfort, extends user practice time, and enhances learning motivation, thereby improving sustained participation and learning outcomes in artistic creation or art education.

[0058] Please see Figure 4 The robot system 10 includes a capability detection device 101, a control module 102, an interactive interface 103, a robotic arm 104, an image acquisition device 105, and a speed detection module 107.

[0059] The speed detection module 107 is used to detect the user's creation speed in real time during the artistic creation process.

[0060] In some embodiments, the speed detection module 107 includes an attitude sensor and a gyroscope sensor. Based on the detection results from the speed detection module 107, it can be determined whether the assistance mode of the robotic arm 104 for the user's hand needs to be adjusted, such as adjusting the speed at which the robotic arm 104 assists the user's hand movements, to prevent the user's creation speed from being too fast or too slow, which would cause the robotic arm 104 to be unable to assist the user's hand. The initial assistance mode of the robotic arm 104 can be determined based on the results of a capability test, or the user can select the initial assistance mode through interaction with the interactive interface 103.

[0061] Please see Figure 5The robot system 10 includes a capability detection device 101, a control module 102, an interactive interface 103, a robotic arm 104, an image acquisition device 105, and a physiological parameter detection module 108.

[0062] In some embodiments, the physiological parameter detection module 108 is disposed on the robotic arm 104 (such as the inner wall of the silicone ring at the end of the robotic arm 104 or the end effector of the robotic arm 104), without the need for additional external devices such as wristbands or watches. This avoids the discomfort and cumbersome operation caused by external wristbands, thereby improving the ease of use and comfort of the robot system 10.

[0063] In some embodiments, the physiological parameter detection module 108 is disposed on the robotic arm body 1042, without the need for additional external devices such as wristbands or watches, which can avoid the discomfort and cumbersome operation caused by external wristbands, and improve the ease of use and comfort of the robot system 10.

[0064] When at least a portion of the robotic arm 104 is fitted onto the user's hand, or when at least a portion of the robotic arm body 1042 is fitted onto the user's hand, the sensors included in the physiological parameter detection module 108 directly contact the user's skin to automatically detect the user's physiological parameters; here, the detection of physiological parameters can be continuous. It is understood that real-time monitoring of the user's physiological state can promptly issue health alerts, rest reminders, or safety interventions, effectively ensuring the user's health and safety during the creative process.

[0065] In some embodiments, the physiological parameter detection module 108 includes a blood oxygen detection unit, a heart rate detection unit, and / or a temperature detection unit.

[0066] The blood oxygen detection unit is used to detect the user's blood oxygen; the blood oxygen detection unit includes a blood oxygen sensor; for example, the blood oxygen detection unit can use a photoelectric sensor to detect blood oxygen and calculate the user's blood oxygen saturation by measuring the light absorption rate.

[0067] The heart rate detection unit is used to detect the user's heart rate. The heart rate detection unit includes a heart rate sensor. For example, the heart rate detection unit can use a photoplethysmographic (PPG) sensor to detect heart rate by monitoring changes in blood flow at the wrist to obtain the user's heart rate.

[0068] The temperature detection unit is used to detect the user's body temperature. The temperature detection unit includes a temperature sensor. For example, the temperature detection unit can use a thermistor or an infrared temperature sensor to detect temperature and directly measure the user's skin surface temperature.

[0069] In other embodiments, the physiological parameter detection module 108 may include a skin conductance detection unit for detecting the user's current skin conductance, and the skin conductance detection unit includes a skin conductance sensor.

[0070] When the physiological parameter detection module 108 includes at least two detection units (such as a blood oxygen detection unit and a heart rate detection unit, a blood oxygen detection unit and a temperature detection unit, a blood oxygen detection unit, a heart rate detection unit and a temperature detection unit), at least two detection units shall detect simultaneously to save detection time; or, at least two detection units shall detect sequentially to avoid obtaining detection results simultaneously, which could lead to missing some detection results when the user obtains multiple detection results, or the user obtaining the wrong detection results, etc.

[0071] Please see Figure 6 The robot system 10 includes a capability detection device 101, a control module 102, an interactive interface 103, a robotic arm 104, an image acquisition device 105, a physiological parameter detection module 108, and an alert module 109.

[0072] The reminder module 109 generates a reminder message when physiological parameters do not meet preset conditions; the reminder message is configured to remind the user to stop creating content. Since the physiological parameter detection module 108 includes a blood oxygen detection unit, a heart rate detection unit, and / or a temperature detection unit, the preset conditions for each detection unit are different. For example, the preset condition for the heart rate detection unit is 60 beats / min to 120 beats / min. If the heart rate is not within this range, the user's heart rate is determined to be outside the preset safety range and does not meet the preset conditions. Similarly, the preset condition for the blood oxygen detection unit is 95% to 100%. If the blood oxygen level is not within this range, the user's blood oxygen level is determined to be outside the preset safety range and does not meet the preset conditions.

[0073] In some embodiments, the reminder module 109 includes a voice reminder unit and / or an indicator light reminder unit.

[0074] The voice prompt unit is used to broadcast voice messages when physiological parameters do not meet preset conditions; or to broadcast guidance information during the user's artistic creation process; or to issue a prompt sound indicating completion of the artwork after the artwork is obtained.

[0075] It's worth noting that the voice reminder unit prioritizes voice broadcasts, giving priority to broadcasting alerts when physiological parameters do not meet preset conditions. The content of the voice broadcasts can be related to specific physiological parameters, such as "User's heart rate is abnormal, please rest," "User's heart rate is too low, please rest," or "User's heart rate is too high, please rest." In addition to broadcasting voice messages, the voice reminder unit can also record audio, which can be used for user account login, issuing commands, or other purposes.

[0076] The indicator light unit is used to illuminate a light when physiological parameters do not meet preset conditions; or, illuminate a target color light when physiological parameters do not meet preset conditions, with different target colors corresponding to different physiological parameters (heart rate, temperature, and blood oxygen); or, illuminate a light in a non-continuous manner when physiological parameters do not meet preset conditions; or, otherwise, no restrictions are imposed here.

[0077] In other embodiments, the reminder module 109 may also generate notification information when physiological parameters meet preset conditions. For the voice reminder unit, it may announce "User heart rate is normal" when the user's heart rate is normal, "User body temperature is normal" when the user's body temperature is normal, "User blood oxygen is normal" when the user's blood oxygen is normal, or other similar announcements. For the indicator light reminder unit, it may illuminate a color other than the target color light when physiological parameters meet preset conditions, or it may keep the light on continuously when physiological parameters meet preset conditions, or other similar announcements.

[0078] To emphasize the importance of information and avoid interference, notification information is typically not generated when physiological parameters meet preset conditions during the user's creative process on the interactive interface 103. Alternatively, the physiological parameter detection module 108 can be used to detect the user's physiological parameters before they begin creating on the interactive interface 103, during user ability testing, or before an art creation task is assigned, and a notification message can be generated when the physiological parameters meet preset conditions. This notification message is configured to indicate that the user's physical condition supports their ability to use or continue using the robot system 10 for art creation.

[0079] In some embodiments, since the physiological parameter detection module 108 includes a blood oxygen detection unit, a heart rate detection unit, and / or a temperature detection unit, etc., here:

[0080] When the physiological parameter detection module 108 includes only one detection unit, it can choose to use either a voice reminder unit or an indicator light reminder unit to alert the user that the physiological parameter does not meet the preset conditions, depending on the actual situation. The goal of this selection is to make the reminder information prominent and easier for the user to obtain accurately. For example, in a noisy environment, to avoid the user receiving incorrect or unreceived information, the indicator light reminder unit can be selected to alert the user that the physiological parameter does not meet the preset conditions. Similarly, in a complex or quiet environment, a voice reminder unit can be selected. In a relatively simple and quiet environment, either the indicator light reminder unit or the voice reminder unit can be selected. Furthermore, when the detected heart rate value is consistently higher than a set threshold, the robot system 10 can activate the voice reminder unit to broadcast the message and simultaneously activate the indicator light reminder unit to flash lights to warn the user, ensuring that the reminder information can be received by users with different sensory abilities.

[0081] When the physiological parameter detection module 108 includes at least two detection units, if the at least two detection units generate multiple reminder messages, the reminder messages can be issued sequentially using only one of the voice reminder unit and the indicator light reminder unit. The order in which the multiple reminder messages are issued is determined according to the degree of abnormality, or according to the detection order of different detection units. Alternatively, the voice reminder unit and the indicator light reminder unit can be used to issue multiple reminder messages respectively, and the reminder messages issued by the voice reminder unit and the indicator light reminder unit can be determined according to the actual situation (such as according to the environmental factors mentioned above). Or, the voice reminder unit and the indicator light reminder unit can be used to issue multiple reminder messages respectively. For example, the reminder message can be broadcast first using the voice reminder unit, then the reminder message can be issued using the indicator light reminder unit, and then the above order can be repeated.

[0082] For example, when blood oxygen levels do not meet the first preset condition and heart rate does not meet the second preset condition, the voice prompt unit sequentially announces "User's blood oxygen is abnormal" and "User's heart rate is abnormal." Alternatively, the indicator light unit first emits a red light to indicate "User's blood oxygen is abnormal," and then emits a green light to indicate "User's heart rate is abnormal." Or, when blood oxygen levels do not meet the first preset condition and heart rate does not meet the second preset condition, the voice prompt unit announces "User's blood oxygen is abnormal," and the indicator light unit emits a green light to indicate "User's heart rate is abnormal." Because two different prompt units are used, the announcements "User's blood oxygen is abnormal" and "User's heart rate is abnormal" are displayed. The "abnormal" alerts can be issued simultaneously or sequentially without interfering with each other. However, if the body temperature does not meet the third preset condition at the same time, and the voice alert unit or indicator light alert unit needs to issue the "user temperature abnormal" alert, the two alerts issued by the voice alert unit or indicator light alert unit have a specific order. For example, the voice alert unit may announce "user blood oxygen abnormal" and "user temperature abnormal". The two alerts are issued sequentially. If the blood oxygen abnormality is more severe, "user blood oxygen abnormal" will be announced first. If the temperature abnormality is more severe, "user temperature abnormal" will be announced first.

[0083] In some embodiments, the reminder information generated by the reminder module 109 can also be displayed on the interactive interface 103. Specifically, it can be displayed on the interactive interface 103 without affecting the user's artistic creation and guidance information display, and without affecting the position of the reminder information that the user pays attention to.

[0084] In some embodiments of this application, the reminder module 109 includes a voice reminder unit and / or an indicator light reminder unit. By monitoring the user's physiological state in real time and triggering multimodal reminders when abnormalities occur, the reminder module 109 can solve the problem of insufficient health and safety intervention in existing elderly-assistance robots, reducing the risk of fainting or discomfort caused by health abnormalities (such as high heart rate) during artistic creation by elderly users. The dual reminder method of voice and indicator lights can adapt to the sensory differences of elderly users, ensuring that users with hearing or vision limitations can receive timely warnings, avoiding safety hazards caused by continuing creation due to an inability to perceive health problems. Simultaneously, this mechanism requires no active user operation or external devices, being directly integrated into the physiological parameter detection module 108, which can improve the safety and age-friendliness of the robot system 10, extend the user's safe creation time, and enhance the user's dependence on and confidence in using the robot system 10.

[0085] In some embodiments, the control module 102 is connected to the physiological parameter detection module 108. When at least one physiological parameter does not meet a preset condition, the control module 102 automatically controls the robotic arm 104 to pause, thereby suspending the robotic arm 104's assistance to the user's hand. Alternatively, the control module 102 is connected to the reminder module 109. When the reminder module 109 generates a reminder message, the control module 102 can simultaneously control the robotic arm 104 to pause, thereby suspending the robotic arm 104's assistance to the user's hand. Suspending the robotic arm 104's assistance to the user's hand can prevent health risks caused by over-practice, while maintaining the continuity of the user's art learning. This integration of health monitoring and art education not only enhances the safety of the creative process but also strengthens the health awareness of elderly users through real-time data feedback. This allows the robot system 10 to truly realize health protection functions while providing art education services, addressing the pain point of lacking health monitoring in existing technologies.

[0086] Before controlling the robotic arm 104 to assist the user's hand movements to obtain an artwork related to the artistic creation task, the user's physiological parameters are detected. During the user's creation process, the user's physiological parameters are also detected. If any physiological parameter does not meet the preset conditions, the interactive interface 103 can be controlled to display a warning message, and / or the voice reminder unit can be controlled to broadcast a warning message, and / or the robotic arm 104 can be controlled to stop assisting the user's hand. This enables real-time health monitoring of the user throughout the entire creative process.

[0087] In other embodiments, the robot system 10 may include at least two of the following: a force detection module 106, a speed detection module 107, and a physiological parameter detection module 108. Specific details are not shown in the accompanying drawings.

[0088] The robot system 10 includes a capability detection device 101, a control module 102, an interactive interface 103, a robotic arm 104, an image acquisition device 105, a force detection module 106, and a speed detection module 107.

[0089] Alternatively, the robot system 10 may include a capability detection device 101, a control module 102, an interactive interface 103, a robotic arm 104, an image acquisition device 105, a force detection module 106, and a physiological parameter detection module 108.

[0090] Alternatively, the robot system 10 may include a capability detection device 101, a control module 102, an interactive interface 103, a robotic arm 104, an image acquisition device 105, a speed detection module 107, and a physiological parameter detection module 108.

[0091] Alternatively, the robot system 10 may include a capability detection device 101, a control module 102, an interactive interface 103, a robotic arm 104, an image acquisition device 105, a force detection module 106, a speed detection module 107, and a physiological parameter detection module 108.

[0092] Alternatively, the robot system 10 may include a capability detection device 101, a control module 102, an interactive interface 103, a robotic arm 104, an image acquisition device 105, a force detection module 106, a physiological parameter detection module 108, and an alert module 109.

[0093] Alternatively, the robot system 10 may include a capability detection device 101, a control module 102, an interactive interface 103, a robotic arm 104, an image acquisition device 105, a speed detection module 107, a physiological parameter detection module 108, and an alert module 109.

[0094] Alternatively, the robot system 10 may include a capability detection device 101, a control module 102, an interactive interface 103, a robotic arm 104, an image acquisition device 105, a force detection module 106, a speed detection module 107, a physiological parameter detection module 108, and an alert module 109.

[0095] According to some embodiments of this application, the robot system 10 of any of the above embodiments may further include a touch component, which is a handheld input device held by the user for executing operation commands through a touch interface 103. The touch component allows the user to interact with the robot system 10 in a direct and intuitive manner, such as selecting menus, entering text, logging into a user-related account, adjusting the displayed information on the interface 103, or controlling the creation process. The touch component is held by the user for interaction with the interface 103. The touch component may include a haptic feedback sensor or other sensors.

[0096] Understandably, the introduction of touch components can enhance the interactive experience for elderly users. By providing a grip-based touch operation, it can solve voice interaction barriers caused by hearing or vision deterioration and avoid interference from environmental noise on voice recognition. This makes the robot system 10 more adaptable to the physiological characteristics of elderly users, enhancing the accuracy and convenience of interaction, thereby increasing participation and completion rates in art creation and learning, allowing elderly users to focus more on art practice without worrying about the complexity of interaction.

[0097] In some embodiments of this application, the robot system 10 simultaneously supports voice input and touch input functions. There is no priority conflict between the two during interaction, and users can freely choose to use touch or voice input for interaction according to their own needs (such as hearing impairment or environmental noise interference), without the robot system 10 forcibly switching or restricting them. Alternatively, touch input may take priority.

[0098] According to some embodiments of this application, the robot system 10 of any of the above embodiments may further include an interactive body, with the control module 102, the interactive interface 103 and the robotic arm 104 disposed on the interactive body, so that the robot system 10 achieves a compact structure.

[0099] The interactive body serves as the physical support structure of the robot system 10, with the control module 102, interactive interface 103, and robotic arm 104 (robotic arm body 1042) all fixedly mounted on it. For example, the interactive body can be designed as a desktop base, with the control module 102 integrated into the internal electronic compartment, the interactive interface 103 such as a large-size, high-contrast touchscreen embedded in the front of the base, and the robotic arm 104 mounted on the top of the base via a rotary joint.

[0100] It is worth noting that the silicone ring at the end of the robotic arm 104 is a flexible wearable component, worn on the user's wrist to integrate health monitoring functions such as a heart rate sensor. However, as the end effector of the robotic arm 104, the silicone ring does not change the characteristic of the robotic arm body 1042 being set on the interactive main body. The interactive interface 103 initializes the font size, color contrast, and interface layout based on the capability test results, and remains static after setting, requiring no real-time adjustment. Health monitoring is directly achieved by the sensor embedded in the silicone ring, eliminating the need for an external wristband or watch. Heart rate data is automatically collected through the silicone ring, without priority conflict with voice input and touch input. The system supports both interaction methods simultaneously, allowing users to choose freely.

[0101] According to some embodiments of this application, the robot system 10 of any of the above embodiments may further include a touch component and an interactive subject, which will not be described in detail here.

[0102] According to some embodiments of this application, the robot system 10 of any of the above embodiments may further include a memory for storing computer programs, and the control module 102 may control the interactive interface 103, robotic arm 104, etc. in the robot system 10 based on the computer programs.

[0103] The memory used in this application includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), or optical discs.

[0104] Based on any of the above embodiments, the robot system 10 can also monitor data during the user's artistic creation process in real time. When the current data of the artwork differs from the current guidance data in the guidance information, a prompt message can be displayed on the interactive interface 103 to remind the user to adjust the artwork according to the current guidance data. These adjustments can include font adjustments (e.g., adjusting to a larger font), line adjustments (e.g., adjusting to thicker lines), layout adjustments (e.g., adjusting to the center position), and color adjustments (e.g., adjusting to a color with significant contrast).

[0105] It is understandable that adjusting artworks can significantly improve visual readability, reduce user fatigue, and prevent the elderly, people with poor eyesight, and other groups from repeatedly adapting to the interactive interface.

[0106] According to some embodiments of this application, please refer to Figure 7 , Figure 7 This is a schematic diagram of the structure of an interactive system provided in some embodiments of this application. The interactive system 100 includes an interactive platform 20 and a robot system 10 of any of the above embodiments, and the robot system 10 is communicatively connected to the interactive platform 20.

[0107] The interactive platform 20 can be one of the following: cloud, server, or client (such as laptop, smartphone, or smart wearable device).

[0108] In some embodiments, the artwork created by the user on the interactive interface 103 can be uploaded to the interactive platform 20; when the interactive platform 20 is a client, the artwork can be displayed to other users using the client.

[0109] After an artwork is uploaded to the interactive platform 20, the robot system 10 can receive feedback information sent by the interactive platform 20; the feedback information can be displayed on the interactive interface 103. Here, the feedback information can be comments on the artwork, or other information.

[0110] It is understandable that the mechanism of storing artworks in the cloud and sharing them on social media can promote interaction and comments within family communities, enhance the continuity of learning and the social incentive effect, and overall solve the problems of lack of personalization, security and social incentive in existing technologies, making art learning more convenient, safe and fun for users.

[0111] In summary, in one application scenario, the robot system 10 includes a core control module, an age-friendly interaction module, a creative assistance module, a multimodal perception module, an AI teaching and motion analysis module, a health monitoring module, and a network interaction module.

[0112] The UI (User Interface) display subunit in the age-friendly interaction module can fixedly adjust the font size, color contrast and interface layout according to the user's pre-performed eyesight test and hand dexterity test results. For example, the font for users with poor eyesight can be set to 24pt with a high-contrast color scheme.

[0113] The end of the mechanical arm 104 in the creation assistance module is equipped with a silicone ring that can be sleeved on the user's wrist, and integrates a heart rate sensor and the like for health monitoring; when user's motion jitter is detected, the mechanical arm 104 can provide stability assistance and adjust the force in real time according to the feedback from the tactile sensor.

[0114] The AI teaching and motion analysis module can preset and decompose the creation process of a target work into multiple steps. For example, the Chinese character "Yong" in calligraphy can be decomposed into dot, horizontal stroke, left-falling stroke, and right-falling stroke, which are demonstrated step by step in sequence.

[0115] The health monitoring module automatically collects heart rate and posture data through the sensors embedded in the silicone ring, and triggers a safety prompt and pauses the mechanical arm 104 when abnormality is detected.

[0116] The network interaction module can save the works to the cloud and realize family or community sharing through the interaction platform 20.

[0117] In summary, in one application scenario, based on the above-mentioned interaction system 100 or the robot system 10 according to any one of the above embodiments, the following method is provided:

[0118] S01: Start the system.

[0119] S02: User login.

[0120] The user login methods include face recognition (involving the image acquisition device 105 mentioned above) and voiceprint recognition (involving the voice reminder unit mentioned above).

[0121] S03: Capability test.

[0122] The capability test herein may be a visual and (hand) motion capability test.

[0123] S04: Generate a personalized interaction interface and course rhythm.

[0124] The personalized interaction interface herein can be automatically adjusted according to the results of the above visual and (hand) motion capability tests, such as adjusting the font, color contrast, layout, etc. The course rhythm herein relates to the guidance information mentioned above.

[0125] S05: AI demonstrates the creation steps.

[0126] Here, the guidance information can be displayed on the interaction interface 103.

[0127] S06: User creation (robotic arm assistance).

[0128] S07: Real-time motion analysis and error correction.

[0129] In some embodiments, the user's actions during creation can be compared with a standard model, and error correction prompts can be issued when there are inconsistencies.

[0130] S08: Health status monitoring and reminders.

[0131] Here, users' heart rate, body temperature, blood oxygen, etc. can be monitored in real time, and reminder messages can be issued when preset conditions are not met.

[0132] S09: Save and upload your work.

[0133] Here, the artwork created after completion can be saved and uploaded to the interactive platform 20.

[0134] S10: Family or community reviews and interactions.

[0135] Here, after an artwork is uploaded to the interactive platform 20, it can receive comments or interactive messages from family or community. The comments and interactive messages can be directed at the uploaded artwork or other things; there are no restrictions here.

[0136] The above description is merely an embodiment of this application and does not limit the patent scope of this application. Any equivalent structural or procedural transformations made using the content of this application's specification and drawings, or direct or indirect applications in other related technical fields, are similarly included within the patent protection scope of this application.

Claims

1. A robot system for assisting users in visual arts education, characterized in that, include: A capability detection device is configured to detect the user's capabilities; The control module, connected to the capability detection device, is configured to generate an artistic creation task based on the capability detection results; An interactive interface, connected to the control module, is used to display guidance information corresponding to the artistic creation task; A robotic arm, connected to the control module, wherein the robotic arm is at least partially fitted onto the user's hand; The robotic arm assists the user's hand movements through motion, enabling the user to create art on the interactive interface.

2. The robot system according to claim 1, characterized in that, The robot system also includes an image acquisition device for acquiring images of the user; The robotic arm includes: The first processing unit is connected to the image acquisition device; The robotic arm body is connected to the first processing unit, and the robotic arm body is at least partially fitted onto the user's hand.

3. The robot system according to claim 2, characterized in that, The robot system also includes a force detection module for detecting the force applied by the user on the interactive interface during the artistic creation process.

4. The robot system according to claim 2, characterized in that, The robot system also includes a speed detection module for detecting the user's creative speed during the artistic creation process.

5. The robot system according to claim 2, characterized in that, The robot system also includes a physiological parameter detection module, which is disposed on the robotic arm body and detects the user's physiological parameters when the robotic arm body is at least partially fitted onto the user's hand.

6. The robot system according to claim 5, characterized in that, The physiological parameter detection module includes a blood oxygen detection unit, a heart rate detection unit, and / or a temperature detection unit.

7. The robot system according to claim 5, characterized in that, The robot system also includes a reminder module, which generates a reminder message when the physiological parameters do not meet preset conditions; the reminder module includes a voice reminder unit and / or an indicator light reminder unit.

8. The robot system according to any one of claims 1-7, characterized in that, The robot system also includes a touch component, which is held by the user and used to interact with the interface.

9. The robot system according to any one of claims 1-7, characterized in that, The robot system includes an interactive body, and the control module, the interactive interface, and the robotic arm are disposed on the interactive body.

10. An interactive system, characterized in that, include: Interactive platform; The robot system according to any one of claims 1-9, wherein the robot system is communicatively connected to the interactive platform.

Images