Intelligent interaction robot and robot interaction system

Abstract

The invention relates to the technical field of man-machine interaction, in particular to an intelligent interaction robot and a robot interaction system. The intelligent interaction robot is applied to the robot interaction system, the robot interaction system comprises the intelligent interaction robot and at least one group of replaceable accessory components, and each group of accessory components comprises at least one wireless identification tag; the intelligent interaction robot comprises a robot body which is provided with a main control module, and an identification module, a storage module, a communication module, a voice interaction module and a display module which are connected with the main control module; the identification module can identify the identification information of the wireless identification tag of the accessory component currently worn by the robot body; the main control module is configured to obtain an interaction configuration file matched with the identification information according to the identification information, wherein the interaction configuration file comprises interaction expression data; and displaying the interactive expression based on the interactive expression data according to the driving display module. The emotional linkage between the user and the robot can be improved.

Description

Technical Field

[0001] This invention relates to the field of human-computer interaction technology, and in particular to an intelligent interactive robot and robot interaction system. Background Technology

[0002] With the rapid development of the smart toy industry, interactive toys with detachable and replaceable parts (such as plush pet toys and smart robot toys) are widely favored by the market due to their ability to personalize their appearance. In existing technologies, the detachable design of such toys mainly focuses on the diversity of appearance decoration. Usually, users can meet their personalized needs for the visual presentation of the toy and enhance the novelty and aesthetics of the product by changing different colored and patterned hats, clothes, decorations, and other parts.

[0003] The detachable parts of existing toys can only change their appearance; they cannot trigger differentiated interactive responses based on the type, theme, or touch operation of the parts. This limits the value of detachable parts to visual changes, failing to extend to upgrades in interactive experience or expansion of functionality. After replacing detachable parts, the core interaction method of the toy remains essentially unchanged, and interaction remains at a basic level. Prolonged use can easily lead to aesthetic fatigue and experience burnout, making it difficult to form a lasting emotional connection. Summary of the Invention

[0004] This invention provides an intelligent interactive robot and a robot interaction system to solve the problem that it is difficult for users to form a sustained emotional connection with the intelligent interactive robot.

[0005] This invention discloses an intelligent interactive robot applied to a robot interaction system. The robot interaction system includes the intelligent interactive robot and at least one set of replaceable accessory components, each set of accessory components including at least one wireless identification tag. The intelligent interactive robot includes: The robot body includes a main control module, as well as an identification module, a storage module, a communication module, a voice interaction module, and a display module connected to the main control module; The identification module is capable of identifying the identification information of the wireless identification tag corresponding to the accessory component currently worn by the robot body; The main control module is configured as follows: The interaction configuration file, which matches the identification information, is obtained from the storage module and / or through the communication module and connected to the cloud platform. The interaction configuration file includes interactive emoticon data. The display module is driven to display interactive expressions based on the interactive expressions.

[0006] Optionally, the interaction configuration file may also include interaction voice style data; The main control module is also configured to: The voice interaction module is driven to interact with the user via voice based on the interactive voice style data.

[0007] Optionally, the robot body further includes a visual perception module connected to the main control module; The visual perception module is configured as follows: Obtain a perceived image of the clothing / decoration currently displayed to the user; The main control module is also configured to: The matching evaluation algorithm of the cloud platform can be obtained from the storage module or invoked through the communication module; Visual features are obtained based on the perceived image, and the visual features are input into the matching evaluation algorithm to obtain evaluation data; The current state data of the robot body is obtained, and evaluation result data is generated based on the current state data and the evaluation data. The evaluation result data includes evaluation score and evaluation suggestions. The evaluation result data is output through the display module and / or the voice interaction module.

[0008] Optionally, the main control module is further configured as follows: The fusion recognition algorithm is executed to compare and verify the identification information with the visual features to obtain matching degree data. When the matching degree data exceeds a preset threshold, the steps of obtaining an interactive configuration file matching the identification information from the storage module and / or connecting to the cloud platform through the communication module are executed, as well as subsequent steps.

[0009] Optionally, the robot body further includes a touch sensing module connected to the main control module; The touch sensing module is configured as follows: Receive touch sensor information input by the user; The main control module connection is also configured as follows: Based on the user touch signal detected by the touch sensing module, the specific interactive function corresponding to the interactive configuration file is triggered or the interactive configuration file is adjusted.

[0010] Optionally, when the identification module detects that the identification information is empty, the main control module is further configured to: Obtain the user-provided custom interaction configuration file, and store the custom interaction configuration file in the storage module or send it to the cloud platform through the communication module; Add a custom identifier to the custom interaction configuration file and write the custom identifier into the identifier information.

[0011] Optionally, the display module is a flexible OLED screen or LCD screen that covers the robot's face or eye area; The interactive emoticons include basic emoticons, complex dynamic emoticon sequences, and micro-expressions.

[0012] Optionally, the accessory assembly has at least one first connector on the side facing the robot body; The robot body is provided with at least one second connector on the side facing the accessory component, and the second connector corresponds to the position of the first connector. The first connector and the second connector are positioned so that when the accessory component is worn on the robot body, the first connector can connect with the corresponding second connector, thereby fixing the accessory component to the robot body.

[0013] Optionally, the wireless identification tag includes an RFID or NFC tag, and the identification module includes an RFID or NFC reader.

[0014] The present invention also discloses a robot interaction system, comprising: The intelligent interactive robot described above; At least one set of replaceable accessory components, each set of said accessory components including at least one wireless identification tag, said accessory components being wearable on the robot body of said intelligent interactive robot.

[0015] The beneficial effects of the intelligent interactive robot and robot interaction system provided by this invention are as follows: by using the identification information of the wireless identification tag as the matching basis, each accessory component has a corresponding interaction configuration file. Through the association between the identification information and the interaction configuration file, the physical appearance of the accessory component is bound to the interactive content of the robot, making the interactive behavior more in line with user expectations. As long as the accessory component is worn, the identification module can automatically read the identification information, the main control module can synchronously match the interaction configuration file, and perform the corresponding interactive operation, thereby enhancing the emotional connection between the user and the robot. Attached Figure Description

[0016] The technical solution of the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. In the accompanying drawings: Figure 1 This is a structural schematic diagram of the intelligent interactive robot provided by the present invention; Figure 2 This is a schematic diagram of the robot interaction system provided by the present invention; Figure 3 This is a structural diagram illustrating the combination relationship between the accessory components and the intelligent interactive robot provided by the present invention.

[0017] The labels for the attached figures are as follows: 10. Intelligent interactive robot; 11. Robot body; 111. Second connector; 12. Recognition module; 13. Storage module; 14. Communication module; 15. Voice interaction module; 16. Display module; 17. Visual perception module; 18. Touch sensing module; 19. Main control module; 20. Robot interaction system; 21. Accessory component; 211. Wireless identification tag; 212. First connector. Detailed Implementation

[0018] It should be noted that, unless otherwise specified, the embodiments and features described in this application can be combined with each other. The preferred embodiments of the present invention will now be described in detail with reference to the accompanying drawings.

[0019] Please refer to the following: Figure 1 and Figure 2 , Figure 1 This is a structural schematic diagram of the intelligent interactive robot provided by the present invention. Figure 2 This is a schematic diagram of the robot interaction system provided by the present invention. The robot interaction system 20 includes an intelligent interactive robot 10 and at least one set of accessory components 21. Each set of accessory components 21 includes at least one piece of clothing and / or at least one piece of decoration. The accessory components 21 are detachably connected to the intelligent interactive robot 10, so that the intelligent interactive robot 10 can replace different accessory components 21.

[0020] Specifically, accessory components 21 can be clothing components, such as full-body clothing (e.g., bodysuits, suits) covering the torso and limbs of the intelligent interactive robot 10, or partial clothing designed for specific areas such as the head, chest, and arms (e.g., helmets, protective gear, sleeve covers). Accessory components 21 can also be decorative components, such as headwear (headbands, hats, horns) for embellishing the head, badges, pendants, capes attached to the torso, or independent decorative items such as wristbands and foot covers for decorating the limbs. Accessory components 21 can also be clothing + decorative components, i.e., a set consisting of one or more pieces of clothing and one or more pieces of decoration (e.g., the "Interstellar Explorer" themed accessory component 21 includes a full-body clothing in the style of a spacesuit, an astronaut helmet decoration, and a planet badge pendant). All accessory components 21 are customized according to the body structure dimensions and outline of the intelligent interactive robot 10, and at least one wireless identification tag 211 (e.g., RFID / NFC tag) is built into their inner side or hidden parts.

[0021] The identification information of the wireless identification tag 211 is used to identify the interaction style theme corresponding to the accessory component 21 it belongs to. The interaction style theme can be understood as the character personality and scene adaptation logic corresponding to the accessory component 21 (such as the bold style of a "superhero" or the lazy style of "pajamas"). Corresponding interaction configuration files can be set for each interaction style theme. Manufacturers can predefine and embed corresponding interaction style themes and matching interaction configuration files for different themes of accessory components 21 (such as the configuration parameters for a "pirate outfit" corresponding to a rough voice and flamboyant expressions). Alternatively, users can create personalized interaction style themes (such as a custom "exclusive holiday" theme) through a dedicated APP or local operation interface, and configure corresponding expressions, voices, interaction logic, and other parameters to generate a unique interaction configuration file. The unique identification information of the wireless identification tag 211 is bound to the corresponding interaction style theme and matching interaction configuration file.

[0022] During subsequent interactions, the intelligent interactive robot 10 identifies the wireless identification tag 211 of the accessory component 21 through its built-in reader. Based on the unique identification information of the wireless identification tag 211, it quickly queries the local or cloud binding relationship database, accurately retrieves the corresponding interaction configuration file, loads and executes it, and finally interacts with the user in an interactive form (expression, voice, action, etc.) that matches the theme of the accessory.

[0023] Please refer to the following: Figure 3 , Figure 3 This is a structural schematic diagram of the combination relationship between the accessory component and the intelligent interactive robot provided by the present invention. The accessory component 21, facing the body of the intelligent interactive robot 10, has at least one first connector 212 on its inner contact surface (i.e., the area directly in contact with the surface of the intelligent interactive robot 10). The number, specifications, and distribution of the first connectors 212 are precisely designed according to the type (clothing / decoration), size, and fixing requirements of the accessory component 21. For example, a full-body clothing accessory component 21 may have one first connector 212 at each of the key stress points such as the inside of the neckline, both sides of the waist, and the edge of the cuffs. Small decorative items (such as headdresses or badges) may have one first connector 212 symmetrically arranged at the center or edge of their contact surface to ensure stability and balanced stress after connection.

[0024] The intelligent interactive robot 10 has at least one second connector 111 on the corresponding contact surface (such as the front of the torso, the top of the head, the outside of the arm, etc.) facing the accessory component 21. The spatial position, quantity and specifications of all the second connectors 111 are precisely matched with the first connector 212 of the accessory component 21. Specifically, this includes planar coordinate alignment (lateral and longitudinal offset ≤ 2mm), height size adaptation (the protrusion / recess depth of the connector matches the corresponding component), and the adaptability of the connection method (such as buckle corresponding to slot, magnet corresponding to magnetic attraction area), to ensure that the two can be accurately aligned and connected.

[0025] When a user puts the accessory component 21 on the intelligent interactive robot 10, the first connector 212 on the inside of the accessory component 21 must be precisely aligned with the second connector 111 on the corresponding contact surface of the robot body 11. During the final stage of the wearing operation (such as light pressure or fastening), the first connector 212 and the corresponding second connector 111 will form a stable connection through a preset mechanical structure or physical action, thereby firmly fixing the accessory component 21 to the target position on the robot body 11. This connection structure effectively limits the displacement of the accessory component 21 on the robot body 11 (including horizontal sliding, vertical detachment, rotational offset, etc.). Even if the robot performs slight movements (such as head rotation or arm swing) or is subjected to slight external force, the accessory component 21 can still maintain relative fixation with the body, without affecting the normal operation of the robot's original functions, thus balancing fixation reliability and ease of use.

[0026] The first connector 212 and the second connector 111 can be mechanical clips, which are fixed by engaging with the slots. Disassembly can be achieved simply by pressing the clips lightly. Alternatively, the first connector 212 and the second connector 111 can be magnetic components, achieving quick and easy attachment and fixation through magnetic attraction, offering convenient installation and residue-free separation. The first connector 212 and the second connector 111 can be the hook and loop sides of Velcro, respectively, adapting to curved or irregular connection points, ensuring a secure connection and easy disassembly.

[0027] Through the aforementioned detachable connection design, the intelligent interactive robot 10 can flexibly replace accessory components 21 with different themes, styles, and functional positioning. Users can choose a single accessory for partial decoration or combine multiple accessories to form a complete themed set, depending on the usage scenario (such as daily interaction, holiday celebrations, role-playing games), personal preferences, or interaction needs, thus giving the intelligent interactive robot 10 a diverse visual appearance. More importantly, replacing the accessory component 21 is not merely a change in physical appearance; its built-in wireless identification tag 211 is sensed by the robot's reading module during the installation process, triggering corresponding expressions and interaction styles, greatly enriching the personalized dimensions and user engagement of the robot interaction system 20.

[0028] The intelligent interactive robot 10 includes a main control module 19, and an identification module 12, a storage module 13, a communication module 14, a voice interaction module 15, and a display module 16 connected to the main control module 19. The identification module 12 is used to identify the identification information of the wireless identification tag 211 corresponding to the accessory component 21 currently worn by the robot body 11; this can be an RFID / NFC reader. The storage module 13 is used to locally store key data, including a binding table between the identification information of the wireless identification tag 211 and the interaction style theme, preset interaction configuration files (including interaction expression data and interaction voice style data, etc.), user-defined personalized configuration data, and firmware programs required for system operation, ensuring rapid local retrieval of core data and improving response speed.

[0029] The communication module 14 adopts a tri-mode communication design encompassing Wi-Fi, Bluetooth, and mobile communication. The Wi-Fi module connects to the home wireless network, while the mobile communication module connects to 4G or 5G cellular networks. Both the Wi-Fi and mobile communication modules enable remote communication with the cloud platform. The Bluetooth module facilitates near-field data transmission with a dedicated app on the user's smartphone / tablet. The communication module 14 not only handles local data synchronization and configuration updates but also serves as a backup communication channel in case of cloud connection failures, ensuring system stability.

[0030] The voice interaction module 15 consists of a microphone array and a speaker. The microphone array is responsible for collecting user voice commands, converting audio signals into digital signals and transmitting them to the main control module 19. Then, it is uploaded to the cloud platform through the communication module 14 for speech recognition and natural language processing. The speaker is used to play voice feedback (such as responses with specific tones, stories, music, etc.) that match the interaction profile, so as to realize two-way voice interaction.

[0031] The display module 16 can be an OLED display or a small LCD touch screen, supporting the rendering and display of static images and dynamic animations. Its display brightness and refresh rate can be dynamically adjusted by the main control module 19 to adapt to different usage scenarios (such as automatically increasing brightness in strong light environments and automatically decreasing brightness at night).

[0032] The display module 16 serves as the core visual output carrier for the emotional expression of the intelligent interactive robot 10. Its installation position is precisely matched to the robot's face or eye area. It adopts a flexible OLED screen or a high-performance LCD screen that fits the curved surface of the robot's appearance to ensure the visual continuity and overall aesthetics of the expression display. The display module 16 is integrated into the pre-reserved installation slot in the robot's face / eye area through a fitting installation and / or edge snap-fit ​​fixing method. The screen surface is covered with a transparent scratch-resistant and wear-resistant coating (such as tempered glass film or polycarbonate protective film), which improves durability without affecting the display effect.

[0033] The interactive expressions displayed by the display module 16 include basic expressions, complex dynamic expression sequences, and micro-expressions. Basic expressions are core expression types based on cross-cultural universal emotional cognition, used to directly convey the robot's basic emotional state. They involve no complex movement changes and are primarily presented as static images. These include, but are not limited to, seven core emotional expressions: happiness (upturned corners of the mouth, curved eyes), sadness (downturned corners of the mouth, teardrop marks in the eyes), anger (frowned brows, downturned corners of the mouth), surprise (widened eyes, mouth in an "O" shape), fear (enlarged eyes, retracted corners of the mouth), disgust (frowned brows, corners of the mouth turned to one side), and calmness (smooth facial lines, soft eyes). Each basic expression corresponds to 1-2 high-resolution static image files (PNG format, supporting transparent backgrounds). The image size precisely matches the resolution of the display module 16 and is stored in the basic expression library directory of the storage module 13. The main control module 19 directly retrieves and displays these images according to the interaction scenario. The default display duration is 1-2 seconds, which can be adjusted through the interaction configuration file.

[0034] Complex dynamic expression sequences are dynamic expressions composed of multiple consecutive images, used to present the progression of emotions or vivid feedback in specific scenarios, possessing stronger visual impact and a sense of storytelling. These include emotion transition sequences (such as a progression from calm to smile to laughter, or a transition from surprise to calm to shyness), scenario response sequences (such as a "happy jump" animation when receiving praise, or a "victory cheer" sequence after completing a task), and theme-adaptive sequences (such as an "energy burst" animation for a "superhero" theme, or a "yawn + eye rubbing" sequence for a "pajamas" theme). They use GIF format dynamic files or frame sequence images (each frame is in PNG format, 8-15 frames), with a frame rate set to 10-15fps to ensure smooth, lag-free animation. The image files of the dynamic expressions are bound to the corresponding theme's interaction configuration file, and stored with associated "trigger conditions" (such as user praise, successful accessory change, or voice command response). After the main control module 19 triggers according to the scenario, it drives the display module 16 to play the expressions frame by frame for 2-5 seconds, supporting loop playback (such as a breathing dynamic expression in a "waiting state").

[0035] Micro-expressions are short-lived, subtle facial features used to enhance the realism and nuance of interactions, simulating subconscious emotional responses. They are not easily detected by users but can increase emotional resonance. Examples include, but are not limited to, slight twitching of the corners of the mouth (expressing nervousness or playfulness), rapid raising of eyebrows (expressing doubt or surprise), slow blinking of the eyes (expressing laziness or focus), slight blushing of the cheeks (expressing shyness), and fine beads of sweat on the forehead (expressing nervousness or effort). Each micro-expression consists of a sequence of 3-5 low frame rate images (5-8fps), with each frame lasting 50-100ms, and the overall presentation time not exceeding 300ms to avoid excessive system resource consumption. Micro-expressions are not triggered independently but serve as supplementary elements to basic or complex dynamic expressions. For example, a slight eyebrow raise can be superimposed on the basic "happy" expression, or a slow blink can be automatically played at 5-10 second intervals in a "calm" state, making the robot's emotional expression closer to a natural human state.

[0036] All three types of expressions are deeply tied to the theme style corresponding to the interaction configuration file. For example, the basic expressions for the "Pirate" theme will emphasize the ruggedness of the lines (such as angular eyebrows and wide mouth corners), and complex dynamic expression sequences will add character-like actions such as laughing, while micro-expressions will include details such as sharp, sweeping eyes. The basic expressions for the "Princess" theme will have softer lines (such as rounded mouth corners and curved eyelashes), and complex dynamic expression sequences will add nodding and smiling actions, while micro-expressions will include details such as blushing cheeks. By combining these three types of expressions with the hardware presentation capabilities of the display module 16, the robot's characterization and emotional connection with the user are further deepened.

[0037] After receiving the identification information of the wireless identification tag 211 transmitted by the identification module 12, the main control module 19 first triggers a local query process. It retrieves the binding relationship table in the storage module 13 using the identification information. If the storage module 13 stores a corresponding interaction configuration file, it directly retrieves the complete interaction configuration file from the storage module 13. If no matching data is found locally, the main control module 19 sends a data request to the cloud platform through the communication module 14. The cloud platform queries the cloud database based on the identification information and sends the corresponding preset interaction configuration file or the user's custom configuration file saved in the cloud to the communication module 14. The communication module 14 then forwards the request to the main control module 19. After receiving the request, the main control module 19 can synchronously store it in the local storage module 13 for subsequent quick retrieval. The interaction configuration file is the core data carrier for realizing themed interaction. In addition to the core interactive expression data, it can also include voice tone parameters (such as speech rate, pitch, and volume) matching the accessory theme, and the content of the responses to the user (such as "I'm very happy~" or "You did a good job"), and other related data.

[0038] After obtaining the interaction configuration file, the main control module 19 extracts the interactive expression data and selects the appropriate expression type (static / dynamic) based on the current interaction scenario (such as user voice emotion, touch events, standby state, etc.). It then generates corresponding display control instructions (including image data, display position, rendering frame rate, display duration, etc.) and transmits them to the display module 16 through the corresponding interface. Upon receiving the instructions, the display module 16 renders and displays the expression according to the preset parameters. For example, when the accessory component 21 is on a "superhero" theme, the display module 16 displays a confident and determined dynamic expression; when it is on a "pajamas" theme, it displays a lazy and sleepy static expression with a slow, looping blinking animation.

[0039] In addition to interactive facial expression data, the interactive configuration file also includes interactive voice style data, specifically including speech rate parameters (e.g., three adjustable levels: slow / medium / fast, corresponding to a value range of 80-160 words / minute), pitch parameters (e.g., low pitch 60-80Hz, mid pitch 100-120Hz, high pitch 140-160Hz), volume baseline values ​​(e.g., gentle 50-60dB, standard 70-80dB, loud 90-100dB), timbre processing parameters (e.g., adjusting the proportion of high / mid / low frequencies through an EQ equalizer to simulate different timbre characteristics such as rough, sweet, and firm), language style identifiers (e.g., the "positive and energetic" style corresponding to the "superhero" theme, and the "relaxed and lazy" style corresponding to the "pajamas" theme), as well as a voice response template library for different core semantics (each semantic corresponds to at least 3 sentence variations adapted to that style).

[0040] In the voice interaction driven process, after the main control module 19 obtains the interaction configuration file, it parses the interaction voice style data within it and forms precise control logic based on the current user interaction scenario. First, the microphone array of the voice interaction module 15 collects the user's voice input, converts the audio signal into a digital signal, and transmits it to the main control module 19. The main control module 19 then connects with the cloud platform through the communication module 14 to complete voice recognition and core semantic parsing (such as recognizing the user's core needs such as "requesting to play music," "expressing curiosity," and "seeking help"). Subsequently, based on the parsed core semantics, the main control module 19 selects suitable statements from the voice response template library in the interaction configuration file and calls the voice style parameters to process the statement in real time. For example, when a user says "I want to hear a story" (a request for the story function): the "Superhero" theme responds with "No problem! Next, I'll tell you an adventure story of a superhero saving the world. Are you ready to embark on an exciting journey?"; the "Pajamas" theme responds with "Okay~ Let's listen to a gentle bedtime story, and then drift off to sleep~"; the "Pirate" theme responds with "Want to hear a story? Then I'll tell you my legendary experience of crossing storms and searching for mysterious treasures. Buckle up!"; and the "Princess" theme responds with "Of course~ Here's a magical and wonderful princess story for you. I hope you'll like it~". Under the "Superhero" theme, the speech rate is adjusted to 150 words / minute, the pitch is increased to 150Hz, and the volume is set to 95dB, while the proportion of high-frequency timbre is enhanced to simulate a firm and powerful voice quality; under the "Pajamas" theme, the speech rate is reduced to 90 words / minute, the pitch is adjusted to 80Hz, and the volume is set to 55dB. By weakening high frequencies and enhancing mid-frequency processing, a soothing and relaxed voice effect is presented.

[0041] Based on the above steps, the main control module 19 finally generates control commands and transmits them to the voice interaction module 15. The voice interaction module 15 decodes and stylizes the voice data according to the control commands and drives the speaker to output voice responses at the set speech rate, tone and volume.

[0042] In another implementation scenario, after the identification module 12 identifies the currently worn accessory component 21, if no valid wireless identification tag 211 is detected (i.e., the tag is assumed to have no identification information written to it, or the read identification information is blank), it is determined that the identification information is empty. This state typically corresponds to the user using a custom blank accessory (without a preset tag) or a third-party adapted accessory (not bound to a system identifier). In this case, the main control module 19 will initiate the custom configuration file binding process.

[0043] The communication module 14 establishes a connection with the user's smartphone / tablet APP. Users can upload pre-edited custom interaction configuration files (supporting standardized formats such as JSON and XML, and the files must contain complete configuration items such as interactive expression data, voice style parameters, semantic response templates, and functional mode rules) through the APP, or create custom interaction configuration files in real time directly in the APP using visual editing tools (such as expression selector, voice parameter slider, and sentence input box).

[0044] Custom interactive configuration files can be stored in storage module 13, while simultaneously updating the configuration file index table in the local database to record metadata such as file storage path, creation time, and configuration type, ensuring quick retrieval via identifiers later. If the user enables cloud synchronization, the main control module 19 transmits the custom interactive configuration file to the cloud platform via communication module 14. The cloud platform associates the configuration file with the user account and the robot device's unique identifier, generates a cloud storage address, and synchronously writes it back to the local database.

[0045] Specifically, during storage, the main control module 19 automatically generates a unique and exclusive custom identifier corresponding to the custom interactive configuration file based on the principles of uniqueness and traceability, ensuring that there is no duplicate identifier information in the storage module 13 and the cloud platform. Key metadata (such as user account abbreviation, configuration file type identifier, and generation timestamp) can be embedded in the custom identifier to facilitate users and the system to identify the configuration file attributes.

[0046] If the accessory component 21 has a built-in erasable wireless identification tag 211 (such as a rewritable NFC tag or an erasable RFID tag), the main control module 19 sends a write command to the tag through the identification module 12 (RFID / NFC reader) to write the custom identifier into the tag's storage area in a preset encoding format (such as ASCII code or hexadecimal code), overwriting the original blank / invalid identifier information, and completing the physical binding of the identifier information and the custom interactive configuration file.

[0047] If the accessory component 21 does not have a built-in tag, the main control module 19 prompts the user through the display module 16 and the voice interaction module 15 to "please place the blank writable tag close to the recognition area". After the user places the wireless tag, the hardware ID of the wireless tag is read and a custom identifier is written. At the same time, the user is prompted in the APP that "the tag has been successfully written and the tag can be embedded into the accessory component 21", thus realizing the binding of the custom accessory and the tag.

[0048] After the custom identifier is written and bound to the custom interaction configuration file, when the user wears the accessory component 21 on the robot body 11 again, the recognition module 12 will successfully read the custom identifier stored in the tag. The main control module 19 will query the storage module 13 or the cloud platform through the identifier to quickly retrieve the corresponding custom interaction configuration file, and drive the display module 16, voice interaction module 15 and other modules to execute personalized interaction logic (such as user-defined exclusive expressions, unique voice styles and customized semantic responses). This greatly expands the adaptability of the system and the creativity of users, allowing unofficial accessories to be integrated into the robot's themed interaction system.

[0049] In other implementation scenarios, a wireless identification tag 211 can be set for each accessory item, and a unique corresponding identifier can be assigned to each wireless identification tag 211. Different identifiers can be freely combined by the user to form a new accessory component 21. For example, the user can freely combine any number (≥1) of accessory items to wear on the robot body 11 according to personal creativity and matching needs, forming a brand new set of personalized accessory components 21 (such as a combination of "astronaut helmet + spacesuit top + planet badge", "princess headband + lace cape + bow belt", etc.). During the combination process, the wearing order of the accessory items does not affect the identifier recognition result. The identifier information of multiple accessory items is processed in the form of an unordered set to ensure the flexibility of the combination logic.

[0050] Based on market demand or themed designs, manufacturers pre-release multiple sets of fixed accessory components 21 (i.e., sets with clearly defined individual item combinations) and assign a unique combination identifier to each fixed combination. Simultaneously, manufacturers pre-set exclusive interactive profiles for each fixed combination, which are designed based on the style characteristics of each item within the combination. For example, the fixed combination of "pirate hat + one-eyed patch + pirate cape" incorporates a "rough voice style + flamboyant dynamic expressions + pirate-specific semantic response template" in its interactive profile; the fixed combination of "Santa hat + reindeer scarf + bell pendant" corresponds to a "cheerful voice tone + festive dynamic expressions + holiday greeting responses."

[0051] After the user completes the wearing operation of at least one accessory item, the recognition module 12 of the intelligent interactive robot 10 initiates a multi-tag recognition process, reads the identification information of all accessory items, and generates a combination identifier to be recognized containing all the identifiers. After receiving the combination identifier to be recognized, the main control module 19 searches in the storage module 13 and the cloud platform for the existence of an interaction configuration file (including a manufacturer-preset configuration file or an interaction configuration file previously customized and stored by the user) corresponding to the combination identifier to be recognized. If it exists, the main control module 19 retrieves the interaction configuration file and drives the display module 16, voice interaction module 15, etc., to perform the corresponding interactive operations according to the interaction configuration file.

[0052] If the configuration does not exist, the user can be prompted to customize it through multimodal interaction. For example, the display module 16 can present a visual guidance interface (such as the text prompt "No corresponding interaction configuration found, do you want to create a custom configuration?"), and the voice interaction module 15 can simultaneously play a prompt voice (such as "Your combination is really creative! Do you want to set a unique expression and voice for it?"). Manufacturers can preset corresponding interaction configuration files based on fixed-match accessory components 21. When it detects that a user has dressed the robot body 11 with at least one accessory item, it obtains the identifier corresponding to that accessory item, checks whether a combination of these identifiers exists, and if so, directly calls the interaction configuration file corresponding to the identifier combination; otherwise, it prompts the user to enter a custom interaction configuration file. Users can confirm their customization needs by touching the operation buttons on the robot body 11 or through a dedicated APP. If the user chooses not to set, the basic general interaction configuration file (which can be preset by the manufacturer) is loaded by default; if the user chooses to set, the customization configuration process begins. The customization configuration process is similar to the steps for setting a custom interaction configuration file described above, and will not be repeated here.

[0053] This design retains the stability and thematic consistency of the manufacturer's preset configuration while fully unleashing the user's creative space. Through the full-chain logic of free combination of individual items, intelligent identification of logos, and flexible configuration adaptation, the personalization dimension of the robot interaction system 20 is greatly expanded, further enhancing the user's sense of participation and creative fun.

[0054] In other implementation scenarios, the complete set of accessory components 21 under the same theme (such as the "Interstellar Explorer" and "Forest Guardian" themes) is broken down into multiple independent accessory items (such as four items A, B, C, and D). Each item corresponds to a core element of the theme. The complete set of accessory components 21 is associated with a complete resource library (voice library + emoji library + function library). The more items a user wears and the closer the combination is to the complete set, the richer the resource content is unlocked, ultimately achieving a gradient experience of "partial wear - basic interaction, complete wear - full-dimensional immersion".

[0055] Each theme (such as "Interstellar Explorer") corresponds to a set of officially defined accessory components 21. Each component consists of 3-5 accessory items broken down by function / scene dimension (e.g., A=astronaut helmet, B=spacesuit jacket, C=planet badge, D=multi-functional tool kit). Each accessory item has a unique identification information, and the accessory items can be freely combined and worn (without a mandatory wearing order).

[0056] The complete resource library corresponding to this theme style is split into multiple gradients according to the single-item combination level, and is precisely bound to the number of accessory items worn / combination forms, ensuring the progression of the unlocking logic. For example, when wearing 1 core item, such as only wearing A = astronaut helmet, 30% of the complete resource library is unlocked, including: basic theme greetings (such as "I'm an interstellar explorer!"), simple touch responses (such as touching the helmet to trigger "Helmet is ready~"), with a total of ≥15 items; 3 categories of core basic expressions (happy, calm, surprised), 2 groups of simple dynamic expressions (such as "helmet lights flashing"), without exclusive micro-expressions; core basic functions (such as the "basic version of space knowledge quiz", simple head shaking and tail wagging interaction), with a total of ≥2 items.

[0057] When wearing 3 accessory items, such as wearing A + B + C = helmet + spacesuit + badge, 70% of the complete resource library is unlocked. New theme scenario-based dialogues (such as "Scanning the planet environment~"), exclusive lines for accessory interaction (such as touching the badge to trigger "Discover the mysterious planet badge!"), multi-round dialogue responses, with an increase of ≥20 items, cumulative ≥35 items; all 8 categories of basic expressions, 6 groups of complex dynamic expression sequences (such as "spacewalk", "energy burst"), 3 types of theme micro-expressions (such as "antenna slightly swaying", "visor reflection flashing"); core interaction functions (such as the simplified version of the "interstellar exploration" game, simulating space signal reception), introductory version of extended functions (such as generating a simple exploration log), with an increase of ≥3 items, cumulative ≥5 items.

[0058] When wearing a full set of 4 accessory items, such as A + B + C + D = helmet + spacesuit + badge + tool kit, 100% of the complete resource library is unlocked. Theme hidden lines (such as "Ultimate exploration mission started!"), multi-item linkage responses (such as touching the tool kit and the badge simultaneously to trigger "Using the mysterious tool to crack the planet password~"), personalized custom voice (such as responding with the user-named exploration code), with an increase of ≥15 items, cumulative ≥50 items; group of theme-exclusive hidden dynamic expressions (such as "space capsule docking successfully", "exploration victory cheer"), 2 types of rare micro-expressions (such as "victory gesture", "wink"), achieving full access to the expression library; advanced extended functions (such as the full version of the "interstellar exploration" game, in-depth space knowledge quiz, connecting smart home to simulate "planet base" light control), user-defined functions (such as creating a personalized exploration mission), with an increase of ≥3 items, cumulative ≥8 items.

[0059] When the user wears accessory items, the display module 16 visually presents the current unlocking progress. If the number of accessory items the user wears remains below the preset quantity threshold for a long time (for example, more than 30 interactions, or more than 1 month of interaction), the user can be guided to collect a full set of accessory items through multi-modal means.

[0060] By using the above approach, unlocking new resources as an incentive, the user experience period can be extended. Furthermore, by continuously unlocking new resources, the user experience of a single interaction mode can be avoided, allowing users to feel the growth of their character and deepening their emotional connection.

[0061] In other implementation scenarios, the robot body 11 also integrates a visual perception module 17 for visual information acquisition and analysis. The visual perception module 17 can employ a high-resolution image sensor and can also integrate an infrared fill light to adapt to image acquisition in low-light environments, avoiding feature extraction failure due to insufficient ambient light. The visual perception module 17 can be installed on the forehead area of ​​the robot's head or directly in front of its chest, with the lens facing the same visual direction as the user's interaction. The shooting angle can be adjusted to ensure complete capture of the entire appearance of the clothing / decoration displayed by the user.

[0062] When the visual perception module 17 detects a user approaching and holding clothing / decoration, it automatically activates the image acquisition function to obtain a perceived image of the clothing / decoration currently displayed by the user and sends the perceived image to the main control module 19. Upon receiving the perceived image, the main control module 19 retrieves a pre-stored lightweight matching evaluation algorithm (such as an SVM classifier + rule base model based on traditional machine learning) from the storage module 13. This algorithm is optimized for the robot's local hardware computing power and is suitable for basic matching evaluation scenarios. Furthermore, the main control module 19 connects to the cloud platform via a Wi-Fi module and calls a deep learning matching evaluation algorithm deployed on the cloud platform.

[0063] Multi-dimensional visual feature extraction is performed on the perceived image, including color features, texture features, contour features, as well as the type, style elements, and functional attributes of clothing / decoration. The recognition results are then converted into standardized semantic label features. After the structured visual features are input into the matching evaluation algorithm, the algorithm outputs multi-dimensional evaluation data based on a preset evaluation system. For example, color coordination (0-10 points, scored based on the complementary and adjacent color matching rules in color theory), style unity (0-10 points, assessing the consistency of the style elements of the clothing / decoration itself), theme fit (0-10 points, assessing the fit between the user's displayed clothing / decoration and the theme based on the theme style of the robot's current accessories), and visual aesthetics (0-10 points, scored based on the public aesthetic preferences in the training data).

[0064] The current state data of the robot body 11 is obtained. The current state data includes the identification information of the currently worn accessory component 21, the corresponding interactive theme style (such as "superhero" or "princess"), the current operating function mode (such as standby mode or interactive mode), the user's historical matching preferences (retrieving the user's past matching evaluation records and selection tendencies from the local database), the current interaction scene (detecting the environmental scene through the visual perception module 17, such as a family daily scene or a holiday party scene), and the user's age group (which can be input by the user when starting the robot, such as child or adult).

[0065] A weighted fusion algorithm is used to combine multi-dimensional evaluation data with current state data to generate the final evaluation result data. For example, a weighted summation formula is used to calculate the comprehensive score (e.g., color coordination × 0.3 + style consistency × 0.2 + theme suitability × 0.3 + visual aesthetics × 0.2). Based on the scores of each dimension and the state data, targeted suggestions are generated, including optimization directions (e.g., "pairing with white pants can improve color coordination" and "changing to a solid-color headband can enhance style consistency"), suitable scene recommendations (e.g., "this combination is suitable for holiday party scenes and highly matches the current 'Christmas theme' accessories"), and personalized prompts (e.g., "based on your historical preferences, you prefer bright color combinations, so this decoration can be kept").

[0066] If the user approves of the evaluation results, they can perform a binding operation via the APP or other means. The main control module 19 binds the visual features of the clothing / decoration with the robot's current accessory combination identifier, generating a new interaction configuration file. If the user disagrees with the evaluation results, they can adjust the evaluation dimension weights (such as increasing the weight of "theme suitability") via the APP. The main control module 19 simultaneously updates the algorithm parameters to optimize subsequent evaluation results. Through the collaborative design of the visual perception module 17 and the matching evaluation algorithm, users are provided with professional and personalized matching references. Furthermore, the deep matching of the evaluation results with the current interaction theme further enhances the robot's role shaping and user participation, enriching the scenario dimensions of human-computer interaction.

[0067] After acquiring the identification information of the wireless identification tag 211 and the visual features of the accessory component 21 extracted by the visual perception module 17, the main control module 19 will start the fusion recognition algorithm. The main control module 19 parses the identification information of the wireless identification tag 211 and retrieves the basic attributes and preset visual features of the accessory bound to the tag from the local / cloud platform, including accessory type, theme style keywords (such as "superhero" and "princess"), and factory preset features (such as the RGB value of the main color, the outline of the core pattern, and the size range).

[0068] The extraction of visual features has already been described above and will not be repeated here. The visual features extracted by the visual perception module 17 are cross-referenced with the labeling information. Sub-matching scores can be calculated for each dimension, and the final score is obtained by weighted summation. For example, to verify whether the accessory type identified by the visual features (such as "helmet decoration") matches the type bound to the labeling information, a match score of 100% is obtained if they match, and 0% otherwise. It can also be verified whether the style keywords extracted from the visual features overlap with the theme style corresponding to the labeling information. An overlap of ≥80% results in a sub-matching score of 100%, while <50% results in 0%. For example, if the clothing is a princess dress, the corresponding theme style is "princess," and the visual features include pink, lace trim, and a strapless dress, then the sub-matching score is 100%.

[0069] The preset threshold can be set by the user or by the manufacturer. When the comprehensive matching data is greater than or equal to the preset threshold, the main control module 19 determines that the identification information and visual features are effectively matched and immediately triggers the subsequent core process. Based on the identification information, the matching interaction configuration file is retrieved from the storage module 13 first. If there is no matching file locally, the cloud platform is connected through the communication module 14 to query and obtain the interaction configuration file stored in the cloud. Then, subsequent steps such as parsing the interaction configuration file and driving the display module 16 / voice interaction module 15 are executed.

[0070] When the overall matching score is less than the preset threshold, the main control module 19 determines that the matching is invalid. The user can manually confirm the accessory's identity (by entering the accessory's name, type, and compatible theme style through the APP). Based on the information manually entered by the user, the main control module 19 skips the fusion verification and directly retrieves the corresponding interaction configuration file.

[0071] By integrating multi-dimensional verification and threshold triggering logic with the recognition algorithm, the accuracy and reliability of accessory recognition are ensured. Manual adjustments are made through an exception handling mechanism to avoid interaction interruptions caused by a single recognition failure, thereby improving the robustness of the system and the user experience.

[0072] In another implementation scenario, the robot body 11 also includes a touch sensing module 18. The touch sensing module 18 includes touch sensing points and touch sensing surfaces. Based on the structure of the robot body 11 and the requirements of the interaction scenario, at least one touch sensing point (single-point touch scheme) or one touch sensing surface (multi-point touch scheme) is set in easily touched areas such as the robot's head (forehead, cheeks), torso (chest, back), and limbs (arms, legs); the sensing points / surfaces adopt a hidden design, and the surface is covered with a shell of the same material as the robot's appearance (such as ABS plastic, silicone, etc.).

[0073] The touch sensing module 18 receives user touch signals input by the user, such as short press, long press, multi-point simultaneous touch, swipe touch, etc., and sends the user touch signals to the main control module 19. The main control module 19 triggers the specific interactive function corresponding to the interactive configuration file or adjusts the interactive configuration file according to the currently loaded interactive configuration file of the user touch signal.

[0074] For example, in the interactive configuration file of the "Superhero" theme, a preset "long press on the head sensor point" triggers the "Energy Burst" dynamic expression + excited voice (such as "The power of justice awakens!"); in the interactive configuration file of the "Pajamas" theme, "short press on the chest sensor point repeatedly" triggers the "Bedtime Story" function (such as "Want to hear a story? Then I'll tell you a story slowly~").

[0075] For example, under the "Superhero" theme, pressing the chest sensor point adjusts the voice volume (the duration of the press corresponds to the volume gradient increase); under the "Princess" theme, short pressing the cheek sensor point switches the current expression style (such as switching from the "Happy" basic expression to the "Happy + Mischievous" micro-expression combination).

[0076] When touch signals and voice commands are present at the same time, users can preset trigger priorities (such as "touch operation priority", "voice command priority", "respond according to time sequence"). The main control module 19 executes the operation according to the preset priority to avoid functional conflicts.

[0077] The collaborative design of the touch sensing module 18 and the main control module 19 not only enriches the input methods of human-computer interaction, but also makes the interaction process more proactive and interesting, further strengthening the emotional connection between users and robots.

[0078] It should be understood that the above embodiments are only used to illustrate the technical solutions of the present invention, and are not intended to limit them. Those skilled in the art can modify the technical solutions described in the above embodiments, or make equivalent substitutions for some of the technical features; and all such modifications and substitutions should fall within the protection scope of the appended claims of the present invention.

Claims

1. An intelligent interactive robot, characterized in that, The application is applied to a robot interaction system, the robot interaction system comprises the intelligent interaction robot and at least one set of replaceable accessory components, each set of the accessory components comprises at least one wireless identification tag; The intelligent interaction robot comprises: A robot body, wherein a main control module is arranged, and an identification module, a storage module, a communication module, a voice interaction module and a display module connected with the main control module are arranged in the robot body; The identification module can identify identification information of the wireless identification tag corresponding to the accessory component currently worn by the robot body; The main control module is configured to: According to the identification information, an interaction configuration file matching the identification information is obtained from the storage module and / or through the communication module connecting with a cloud platform, and the interaction configuration file comprises interaction expression data; According to the driving of the display module, interaction expressions are displayed based on the interaction expression data.

2. The intelligent interactive robot system of claim 1, wherein, The interaction configuration file further comprises interaction voice style data; The main control module is further configured to: The voice interaction module is driven to perform voice interaction with the user based on the interaction voice style data.

3. The intelligent interactive robot system of claim 1, wherein, The robot body further comprises a visual perception module connected with the main control module; The visual perception module is configured to: Obtain a perception image of clothes / decoration currently displayed by the user; The main control module is further configured to: Obtain a matching evaluation algorithm of the cloud platform from the storage module or through the communication module; Based on the perception image, visual features are obtained, the visual features are input into the matching evaluation algorithm, and evaluation data are obtained; Current state data of the robot body are obtained, evaluation result data are generated based on the current state data and the evaluation data, the evaluation result data comprise evaluation scores and evaluation suggestions; The evaluation result data are output through the display module and / or the voice interaction module.

4. The intelligent interactive robot system of claim 3, wherein, The main control module is further configured to: A fusion identification algorithm is executed to compare and verify the identification information and the visual features, match degree data are obtained, when the match degree data exceed a preset threshold, the step of obtaining the interaction configuration file matching the identification information from the storage module and / or through the communication module connecting with the cloud platform according to the identification information, and subsequent steps are executed.

5. The intelligent interactive robot system of claim 1, wherein, The robot body further comprises a touch sensing module connected with the main control module; The touch sensing module is configured to: Receive touch sensing information input by the user; The main control module is further configured to: According to the touch signal of the user detected by the touch sensing module, a specific interaction function corresponding to the interaction configuration file is triggered or the interaction configuration file is adjusted.

6. The intelligent interactive robot system of claim 1, wherein, When the identification information detected by the identification module is empty, the main control module is further configured to: Obtain a custom interaction configuration file provided by the user, store the custom interaction configuration file in the storage module or send the custom interaction configuration file to the cloud platform through the communication module; Add a custom identification to the custom interaction configuration file, and write the custom identification into the identification information.

7. The intelligent interactive robot system of claim 1, wherein, The display module is a flexible OLED screen or LCD screen covering the face or eye area of the robot; The interactive expression includes a basic expression, a complex dynamic expression sequence, and a micro-expression.

8. The intelligent interactive robotic system of any one of claims 1-7, wherein, The accessory component is provided with at least one first connecting piece on one side of the robot body; The robot body is provided with at least one second connecting piece on one side of the accessory component, and the second connecting piece is in position correspondence with the first connecting piece; The first connecting piece and the second connecting piece are in position correspondence, so that when the accessory component is worn on the robot body, the first connecting piece can be connected with the corresponding second connecting piece, so that the accessory component can be fixed on the robot body.

9. The intelligent interactive robotic system of any one of claims 1-7, wherein, The wireless identification tag includes an RFID or NFC tag, and the identification module includes an RFID or NFC reader.

10. A robotic interaction system, characterized by, The application further provides a smart interactive robot comprising the accessory component. The application further provides a smart interactive robot comprising the accessory component. ​

Images