Desktop type accompanying interaction intelligent robot

By designing intelligent robots with head, neck and body mechanisms, the elderly have solved the problems of emotional loneliness and anxiety, inconvenience in drug management and health data monitoring, and efficient human-machine interaction and healthy elderly care assistance.

CN119458391APending Publication Date: 2025-02-18JIUJIU SHENGRONG (SHANGHAI) ROBOT TECH CO LTD

Patent Information

Application Number
CN202410769621.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2023-08-08
Filing Date
2024-06-14
Publication Date
2025-02-18

AI Technical Summary

Technical Problem

Existing intelligent interactive products cannot effectively alleviate the emotional loneliness and anxiety of the elderly. The elderly have inconveniences in drug management and health data monitoring, and the robot structure design lacks flexibility, which affects human-computer interaction.

Method used

Designed an intelligent robot including the head, neck and body mechanism to achieve complex movement of the head and neck through capacitive touch sensors, DC motors and gear sets, combining display screens, microphones and cameras to provide voice and expressions Interactive functions with actions.

Benefits of technology

It realizes vivid interaction with the elderly, relieves emotional loneliness and anxiety, improves the convenience of medication reminders and health data query, and enhances the flexibility of robot structure and the friendship of human-computer interaction.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119458391A_ABST
    Figure CN119458391A_ABST
Patent Text Reader

Abstract

The invention provides a desktop type accompanying interaction intelligent robot. The robot has the following functions of accompanying interaction, daily life information inquiry and broadcast, user health information inquiry and broadcast, medication information reminding inquiry and broadcast and remote interaction and conversation with family members. Wherein the accompanying interaction comprises scenes, voices, expressions and actions, and an interaction effect is generated by superimposing the scenes, the voices, the expressions and the actions; the daily life information query broadcasting is that the cloud platform is accessed through WIFI, and daily life information is broadcasted based on a user query demand; the user health information query broadcasting is that a robot exclusive cloud platform is accessed through WIFI, an application program APP is associated, and daily health condition information is broadcasted based on a user query demand; the medicine use information query broadcasting is that a robot exclusive cloud platform is accessed through WIFI, an application program APP is associated, and a user is reminded of medicine use through regular broadcasting; medication information is broadcasted based on user demands.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention belongs to the technical field of robots and relates to a desktop companion interactive intelligent robot. Background Art

[0002] China is currently in an aging society. How to help the elderly have a happy old age is a common concern of the government and society. At present, the problems that need to be solved in home care for the elderly include:

[0003] 1) With the progress of society, people are paying more and more attention to the emotions of the elderly. There is a need for smart products that can communicate and interact with the elderly vividly, accompany them, and relieve their loneliness and anxiety. Existing smart interactive products are mostly based on voice query functions, with simple expressions and movements or no expressions and movements.

[0004] 2) It is the primary issue for healthy aging for the elderly to take medicine on time and in the right amount. The elderly often suffer from various health problems due to taking the wrong medicine or missing medicine.

[0005] 3) Mastering the daily health data of the elderly is one of the important measures to ensure healthy aging. Many families have configured daily health monitoring equipment such as blood sugar, blood pressure, and blood oxygen, but since most devices come from different manufacturers, the scattered APP calls have caused great inconvenience to the elderly and their relatives.

[0006] 4) Developing humanoid robots, improving the flexibility of robot structures, and enhancing the friendliness of human-machine interaction are issues and directions that urgently need to be addressed and explored in current robot structure design. Summary of the invention

[0007] In order to solve the deficiencies of the above-mentioned technology, the present invention proposes a head mechanism for an intelligent robot, comprising: a head bracket, a head body, a head shell, a display screen and a head bottom shell; the head body, the head shell, the display screen and the head bottom shell are all fixed on the head bracket; wherein,

[0008] The head shell includes: a mask and a head back shell;

[0009] The head body includes: a main control board, a capacitive touch sensor, a head DC motor and its transmission structure; the capacitive touch sensor is fixed in the head shell;

[0010] The head DC motor and its transmission structure include: a head DC motor, a head motor frame, a head gear set and a bearing; the head DC motor drives the head gear set to rotate, and the head gear set is connected to the bearing; the bearing is arranged on the head bottom shell; the head DC motor controls the shaking motion of the head mechanism, and is fixed in the head motor frame; the head motor frame is fixed on the head bottom shell;

[0011] The capacitive touch sensor communicates with the main control board to transmit touch sensing signals, and the main control board controls the movement of the head DC motor;

[0012] The display screen is arranged inside the head body, and the main control board is fixed at the back thereof.

[0013] In the present invention, the head mechanism further includes: a microphone and a camera; the microphone and the camera are arranged on the head bracket, and are both communicatively connected with the main control board.

[0014] In the present invention, a microphone hole is provided on the mask.

[0015] In the present invention, the maximum rotation angle of the head mechanism to the left and right sides is 180 degrees.

[0016] In the present invention, the capacitive touch sensor senses the user touching the head shell, and one capacitive touch sensor is respectively provided on both sides and the top of the head shell.

[0017] In the present invention, the main control board is fixed on the main board frame; and the main board frame is fixed on the head bracket.

[0018] In the present invention, the head mechanism is connected to the robot neck mechanism via a bearing.

[0019] In the present invention, the head rear shell is provided with a positioning part adapted to the shape of the head bottom shell and the head DC motor and its transmission structure; the fixing part on the head bottom shell is fixed to the positioning part by screws.

[0020] The present invention also proposes a neck mechanism for an intelligent robot, comprising: a neck DC motor, a neck gear set, double-sided bearings, a neck bracket and upper and lower shells; wherein,

[0021] The neck DC motor controls the neck mechanism to roll up and down through the neck gear set and double-sided bearings;

[0022] The upper and lower shells are divided into an upper half and a lower half, and the upper half and the lower half are fixed by screws;

[0023] The double-sided bearings on both sides of the neck mechanism are connected to the neck bracket, and the neck bracket is provided with a fixing part that can be fixedly connected to the robot body mechanism;

[0024] Double-sided bearings are used to enhance the strength and stability of the mechanism, ensure smooth rotation and reduce noise;

[0025] The lower parts of the upper and lower shells are semicircular.

[0026] In the present invention, the maximum up and down nodding movement range of the neck mechanism is 90 degrees each.

[0027] In the present invention, the neck gear set includes: a motor gear and a transmission gear; the motor gear is driven by a neck DC motor and meshes with the transmission gear; the transmission gear drives the connected double-sided bearings, and the double-sided bearings are fixed on the upper and lower shells to drive the movement of the upper and lower shells.

[0028] Examples of nodding movements:

[0029] Starting state: First, determine whether the robot's head, neck, and body are in the starting position, that is, the head, neck, and body are on the same axis, and the position of the company's logo on the body shell is preset as the starting position. If not in the starting position, the motor control board drives the head, neck, and body motors to move, so that the head, neck, and body return to the starting position.

[0030] Nodding action:

[0031] 1. Trigger the nodding action.

[0032] 2. The head, neck and torso are in the starting position.

[0033] 3. According to the preset action duration and amplitude of the system, the motor control board adjusts the speed and angle of the DC motor of the neck to complete the up and down movement of the neck at the specified angle within the specified time. The time and angle values ​​can be adjusted as needed.

[0034] 4. The DC motor in the neck drives the motor gear, the motor gear drives the transmission gear, the transmission gear drives the connected double-sided bearings, and the double-sided bearings are fixed on the neck bracket, thereby driving the movement of the upper and lower shells.

[0035] 5. The top of the neck mechanism is fixedly connected to the bottom of the robot head mechanism, and the movement of the neck drives the head to follow the movement.

[0036] 6. Complete the nodding action.

[0037] In the present invention, the top of the neck mechanism is fixedly connected to the bottom of the robot head mechanism to realize the nodding action of the robot.

[0038] The present invention also proposes a body structure for an intelligent robot, comprising: a body shell, a turntable DC motor and its transmission structure, a speaker cavity, a turntable and a base body arranged in the body shell; wherein,

[0039] A body bearing assembly is fixed on the turntable;

[0040] The body shell is fixed on the turntable by screw connection, and it rotates with the turntable;

[0041] The turntable DC motor and its transmission structure include: a body bearing group, a body gear group and a turntable motor frame; wherein the turntable DC motor drives the body gear group to rotate, and the body gear group is connected to the body bearing group; the turntable DC motor controls the rotation of the body mechanism, and is fixed on the turntable motor frame; the turntable motor frame is fixed on the turntable;

[0042] The speaker cavity is fixed on the turntable.

[0043] In the present invention, the body bearing group includes: an inner bearing and an outer bearing; wherein,

[0044] The inner bearing is directly connected to the body gear set and is fixed on the turntable to drive the turntable to rotate;

[0045] The outer bearing is fixed in a groove close to the outer side of the turntable, and the outer bearing supports the outer shell of the body without deformation.

[0046] In the present invention, a speaker hole is arranged on the body shell, which corresponds to the position of the speaker cavity. The body shell rotates together with the turntable to ensure that the speaker cavity always corresponds to the speaker hole.

[0047] In the present invention, the top of the body shell is in an inwardly concave arc shape, which is used to place the robot neck mechanism.

[0048] In the present invention, the rotation range of the body mechanism is 345 degrees.

[0049] In the present invention, the body shell is connected to the turntable and rotates with the turntable, and the maximum rotation range is determined by the limit point.

[0050] In the present invention, neck shaft fixing frames are arranged on both sides of the inner wall of the body shell, which are used to connect the neck mechanism of the robot.

[0051] In the present invention, the base body comprises: a base frame, a power control board and a rechargeable battery; the power control board is installed on the base frame, and a power input interface and a power output interface are arranged on the power control board;

[0052] The power input interface, the power output interface and the rechargeable battery are connected to the power control board through wires.

[0053] The present invention is characterized in that the turntable is fixed on the base frame of the base body by fixing screws.

[0054] In the present invention, the power control panel is further provided with: a power switch and a network distribution button.

[0055] In the present invention, the turntable comprises: a turntable base and a motor control board.

[0056] Based on the head mechanism, neck mechanism, and body mechanism for an intelligent robot proposed above, the present invention further proposes an intelligent robot, comprising: a head mechanism, a neck mechanism, and a body mechanism; wherein:

[0057] The head structure includes: a head support, a head body, a head shell, a display screen and a head bottom shell; the head body, the head shell, the display screen and the head bottom shell are all fixed on the head support; wherein,

[0058] The head shell includes: a mask and a head back shell;

[0059] The head body includes: a main control board, a capacitive touch sensor, a head DC motor and its transmission structure; the capacitive touch sensor is fixed in the head shell;

[0060] The head DC motor and its transmission structure include: a head DC motor, a head motor frame, a head gear set and a bearing; the head DC motor drives the head gear set to rotate, and the head gear set is connected to the bearing; the bearing is arranged on the head bottom shell; the head DC motor controls the shaking motion of the head mechanism, and is fixed in the head motor frame; the head motor frame is fixed on the head bottom shell;

[0061] The capacitive touch sensor communicates with the main control board to transmit touch sensing signals, and the main control board controls the movement of the head DC motor;

[0062] The display screen is arranged inside the head body, and the main control panel is fixed at the back thereof;

[0063] The body mechanism is connected to the head mechanism through the neck mechanism.

[0064] In the intelligent robot of the present invention, the maximum rotation angle of the head mechanism to the left and right sides is 80 degrees. The maximum nodding movement range of the neck mechanism is 30 degrees up and down.

[0065] The present invention also proposes a desktop companion interactive intelligent robot, which includes the following functions:

[0066] Companionship interaction, daily life information query and broadcast, user health information query and broadcast, medication information reminder query and broadcast, and remote interactive calls with family members; among them,

[0067] The companion interaction includes: scenes, voices, expressions, and actions, which are superimposed to generate interactive effects;

[0068] The daily life information query and broadcast is: accessing the cloud platform through WIFI, broadcasting daily life information based on user query needs;

[0069] The user health information query and broadcast is: access the robot's exclusive cloud platform through WIFI, associate the application APP, and broadcast daily health information based on user query needs;

[0070] The medication information query and broadcast are as follows: access the robot's exclusive cloud platform via WIFI, associate the application APP, and regularly broadcast reminders for users to take medication; query medication at any time, and broadcast medication information based on user needs.

[0071] In the present invention, the companionship interaction also includes but is not limited to the following specific scene actions:

[0072] 1) Head shaking action: There is one capacitive touch sensor on the top of the robot's head and two on both sides of its cheeks. When the user touches the robot's head and cheeks, the robot turns on the motors of its head and neck and shakes its head;

[0073] 2) Emotional irritability: The speed and amplitude of various movements of the body, head, and neck are amplified; in scenarios where executive function fails, including speech recognition failure, etc.;

[0074] Examples of emotional outbursts:

[0075] Starting state: No need to determine whether it is at the starting position, take the current position as the starting state.

[0076] Violent Actions:

[0077] 1. Trigger emotional outburst actions.

[0078] 2. The motor drive board drives the head, neck, and body motors to move simultaneously. The head and body rotate rapidly left and right in opposite directions, while the neck moves rapidly up and down. The motor speed can be adjusted as needed.

[0079] 3. According to the system preset action duration, amplitude and number of repetitions, the motor drive board adjusts the motor speed and angle of the head, neck and torso to complete the specified angle movement within the specified time and repeat it according to the preset number of repetitions.

[0080] The time and angle value settings can be adjusted as needed.

[0081] 4. Complete the irritable action.

[0082] In the present invention, the robot, the application APP and the cloud platform are interconnected to complete the background data exchange; the information setting is completed on the application APP of the mobile terminal; the cloud platform is used as the information transfer center, the application setting information is synchronized with the cloud platform, and then sent to the intelligent robot by the cloud platform; the intelligent robot feeds back the user interaction information to the cloud platform, which is then synchronized to the application by the cloud platform; the intelligent robot needs to access the network through Bluetooth and is set in the application APP.

[0083] In the present invention, in the medication reminder broadcast,

[0084] The medication information of the intelligent robot is set on the APP side, and the instructions are sent to the intelligent robot through the cloud platform. When the intelligent robot reaches the medication time, it will announce the name of the medicine by voice to remind the user to take the medicine on time and in the right amount. The user will give feedback through voice whether to take the medicine and stop the voice announcement.

[0085] The intelligent robot only has the function of timing reminder and has no judgment function to prevent misleading users.

[0086] In the present invention, the medication reminder broadcast includes the following steps:

[0087] 1) The user sets medication information in the APP and synchronizes it to the cloud platform;

[0088] 2) The cloud platform issues instructions to inform the intelligent robot of the time and medication information to be broadcasted for each medication reminder set by the user;

[0089] 3) The intelligent robot determines the arrival time of medication based on the pre-stored medication time and system time calibration;

[0090] 4) The intelligent robot broadcasts medication information, i.e. medication reminders, drug names, and dosages; at the same time, the intelligent robot locally triggers the screen to display medication reminder expressions, and the robot performs medication reminder supporting actions;

[0091] 5) Play the medication reminder voice according to the preset number of repetitions and time intervals, turn off the screen after the broadcast, and wait for the user to feedback medication information;

[0092] If the medication is taken on time, the user will inform the intelligent robot by voice;

[0093] 6) Intelligent robots trigger “voice + action + expression to take medicine on time”;

[0094] 8) Turn off the screen;

[0095] If the user does not tell the robot whether to take the medicine on time;

[0096] 9) If the robot does not receive feedback from the user that the medication was taken on time after the preset time, it returns to step 4;

[0097] 10) After repeating step 4 for the preset number of times, the patient still does not receive the instruction from the cloud that the medication has been taken on time;

[0098] 11) Intelligent robot triggers “voice + action + expression for not taking medicine on time”;

[0099] 12) Stop the broadcast and turn off the screen.

[0100] In the present invention, in the health status query and broadcast, the daily health monitoring data of the intelligent robot is input on the application APP side, and the data is synchronized to the cloud platform. When the user inputs the query requirement through voice, the intelligent robot sends a query request to the cloud platform, and the cloud platform sends the health information to the intelligent robot, and the intelligent robot broadcasts the health status information through voice.

[0101] In the present invention, in the daily communication and interactive companionship,

[0102] The user's voice wakes up the intelligent robot, and the intelligent robot turns its body to face the user through sound source and visual positioning, and broadcasts the corresponding voice, expression, and action at the same time; the user sends voice to the intelligent robot, the intelligent robot receives the user's voice information and sends it to the cloud. The cloud parses the user's voice command, makes different responses according to the user's command, and sends commands to the robot to execute the corresponding voice, expression, and action.

[0103] In the present invention, the daily communication and interactive companionship includes the following steps:

[0104] 1) The user wakes up the intelligent robot through the wake-up word; the wake-up word is recognized locally and the corresponding wake-up operation is performed:

[0105] Action + expression + voice;

[0106] Calibration: local wake-up expression;

[0107] Voice: Local built-in voice;

[0108] Movement: The torso and head are on one axis, and the head returns to a 90-degree position with the main axis;

[0109] 2) After the intelligent robot receives the wake-up command locally, it uses sound source and visual positioning to turn its body to face the user, while broadcasting the corresponding voice, expression, and action;

[0110] 3) The user sends voice to the intelligent robot;

[0111] 4) The intelligent robot receives the user's voice and uploads it to the cloud platform;

[0112] 5) After analyzing the user's voice information, the cloud platform determines whether the user's voice is a query or daily communication;

[0113] 6) The cloud platform generates answers based on user query information and synthesizes corresponding voice feedback information;

[0114] 7) The cloud platform sends the answering voice to the intelligent robot, and the corresponding expressions and actions are triggered by the instructions;

[0115] 8) The intelligent robot plays the voice sent by the cloud platform and triggers corresponding expressions and actions;

[0116] If the user's voice is a query command;

[0117] 9) Turn off the screen after the announcement is completed;

[0118] If the user's voice is for daily communication;

[0119] 9) After the announcement is completed, wait for the user to continue to interact. If there is a new user interaction within the preset time, repeat step 9;

[0120] 10) After the announcement is completed, if there is no new interaction within the preset time, the intelligent robot will turn off the screen.

[0121] The innovative features of the intelligent robot of the present invention include:

[0122] 1. The neck has a hemispherical structure design. There is no similar structure used for desktop robots in the current domestic market. This design improves the load-bearing capacity and increases movement flexibility.

[0123] 2. The body rotation adopts an inner and outer bearing structure. The inner bearing is connected to the gear and motor, and the outer bearing is connected to the outer shell of the robot body. The outer bearing is also called a plane bearing, which can not only make the body rotate smoothly, but also support the outer shell to prevent deformation.

[0124] 3. Combine display, voice and motor motion functions to enable robots to interact with people, keep in touch with family members, and accompany daily life.

[0125] The beneficial effects of the intelligent robot proposed by the present invention are as follows:

[0126] The present invention provides a multifunctional intelligent robot device that can coordinate and interact with scenes, voices, movements and expressions and can talk with family members remotely.

[0127] The robot of the present invention obtains the medication information of the elderly through the associated APP, and reminds the elderly to take the medicine on time and in the prescribed amount by superimposing voice, expression and action. In daily life, the elderly can also check their medication information at any time by voice.

[0128] The robot application APP of the present invention uniformly records the daily health data of the elderly. The elderly and the intelligent robot can retrieve and understand their health conditions at any time through voice, and relatives can also remotely check the health data of the elderly through the application APP, providing assistance for healthy elderly care. BRIEF DESCRIPTION OF THE DRAWINGS

[0129] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without paying any creative work.

[0130] Figure 1-Figure 12 It is a schematic diagram of the structure of the head mechanism of the intelligent robot of the present invention.

[0131] Figure 13-Figure 19 It is a schematic diagram of the structure of the neck mechanism of the intelligent robot of the present invention.

[0132] Figure 20-Figure 30 It is a schematic diagram of the structure of the body structure of the intelligent robot of the present invention.

[0133] Fig.31 , 32 It is a structural schematic diagram of the intelligent robot of the present invention.

[0134] Fig.33 It is a flow chart of the medication reminder broadcast in the embodiment.

[0135] Fig.34 This is a flow chart of daily communication, interaction and companionship in the embodiments.

[0136] Fig.35 This is a flow chart of the nodding action of the intelligent robot of the present invention.

[0137] Fig.36 This is a flow chart of the intelligent robot companion interaction of the present invention.

[0138] Fig.37 This is a relationship diagram of the robot, cloud platform, and application program of the present invention.

[0139] Fig.38 , 39 It is a structural schematic diagram of the intelligent robot of the present invention.

[0140] Figure 1-Figure 32 middle:

[0141] A-head mechanism; B-neck mechanism; C-body mechanism;

[0142] 1-mask; 11-microphone; 111-microphone hole; 12-camera;

[0143] 2-Head support;

[0144] 31-main control board; 311-main board frame; 32-capacitive touch sensor; 33-head DC motor and its transmission structure; 331-head DC motor; 332-head motor frame; 333-head gear set; 334-bearing; 335-head bottom shell; 336-positioning part;

[0145] 4-head shell; 41-head rear shell;

[0146] 5- Display screen;

[0147] 61-neck DC motor; 62-neck gear set; 63-double-sided bearings; 64-neck bracket; 65-lower housing; 66-fixing part;

[0148] 71-body shell; 711-speaker hole; 72-turntable DC motor and its transmission structure; 73-speaker sound cavity; 74-body bearing group; 741-inner bearing; 742-outer bearing; 75-turntable; 751-turntable base; 752-groove; 753-upper turntable; 754-lower turntable; 76-body gear group; 77-neck shaft fixing frame; 78-turntable motor frame; 79-limit point;

[0149] 81-base body; 811-base frame; 812-power control board; 813-rechargeable battery; 814-power input interface; 815-power output interface; 816-power switch; 817-network distribution button; 822-motor control board. DETAILED DESCRIPTION

[0150] The invention is further described in detail with reference to the following specific embodiments and drawings. The process, conditions, experimental methods, etc. for implementing the present invention, except for the contents specifically mentioned below, are all common knowledge and common common sense in the art and are not particularly limited by the present invention.

[0151] The intelligent robot in this embodiment is a desktop type intelligent robot with functions such as companionship interaction, daily life information query and broadcast, user health information query and broadcast, medication information reminder query and broadcast, and remote interactive calls with family members.

[0152] Specific features include:

[0153] 1. Companionship interaction: scene + voice + expression + action, superposition to generate interactive effects, such as Fig.36 shown.

[0154] In addition to regular sports movements, there are also specific scene movements, such as the following two scenes.

[0155] 1) Head shaking action: There is one capacitive touch sensor on the top of the robot's head and two on both sides of its cheeks. Application scenario: When the user touches the robot's head and cheeks, the robot turns on the head and neck motors to shake its head in a cute manner.

[0156] 2) Emotional and irritable movements: The speed and amplitude of various movements of the body, head, and neck are amplified; Application scenarios: In scenarios where certain functions fail to execute, such as speech recognition failure.

[0157] 2. Daily life information query and broadcast: Access the cloud platform via WIFI and broadcast daily life information based on user query needs.

[0158] 3. Associated APP, user health information query and broadcast: Access the robot's exclusive cloud platform via WIFI, associate the robot's exclusive APP, and broadcast daily health status information based on user query needs.

[0159] 4. Associated APP, user medication information query and broadcast: Access the robot's exclusive cloud platform via WIFI, associate the robot's exclusive APP, and regularly broadcast reminders to users to take medication; you can also query medication at any time and broadcast medication information based on user needs.

[0160] The intelligent robot in this embodiment has a structure including: a head mechanism, a neck mechanism, and a body mechanism. The movement mode is that the head shakes left and right, the neck nods up and down, the body rotates, and the base remains stationary; the actions that can be realized include: wake-up action (the robot raises its head to a horizontal level, 90 degrees with the longitudinal axis), self-check action (the head moves left and right, the neck pitches, and the body rotates to the maximum), reset action (same as wake-up action), and cute action.

[0161] 1. Head: control shaking motor, integrated display screen and frame, camera, transmission gear, dual microphones, capacitive touch sensor, main control board, shell;

[0162] The head can shake left and right with an amplitude of 80 degrees each, for a total of 160 degrees;

[0163] 2. Neck: control nodding motor, gear structure, and housing;

[0164] The range of motion of the neck nodding up and down is 30 degrees up and down, for a total of 60 degrees;

[0165] 3. Body: controls the body swing motor, sound cavity, sound outlet, and shell;

[0166] The body rotation range starts from 0 degrees and rotates in one direction up to 345 degrees. It is controlled by a limit switch;

[0167] 4. Base: 1 power interface, multiple charging interfaces, network distribution button, machine switch button, rechargeable battery, power control board, motor control board, turntable base, base frame.

[0168] The intelligent robot in this embodiment includes: a head mechanism, a neck mechanism, and a body mechanism;

[0169] The head structure includes: a mask, a bracket, a head body, a head shell, a display screen, a microphone, and a camera, all of which are fixed on the bracket with screws;

[0170] The head body includes: a main control board, a capacitive touch sensor, a head DC motor and its transmission structure; the main control board is fixedly arranged at the back of the display screen inside the head body; the capacitive touch sensor is pasted and fixed in the head shell; the DC motor controls the robot's head shaking movement and is fixed in the motor frame by screws, and the motor frame is fixed to the head shell by screws.

[0171] The DC motor and its transmission structure of the head include: DC motor, motor frame, gear set, bearing; the DC motor drives the gear set to rotate, the gear set drives the bearing, the bearing is fixed on the motor head shell, and drives the head to shake left and right. Taking the position of the robot body LOGO as the center, the maximum rotation angle of the head to the left and right is 80 degrees.

[0172] The capacitive touch sensor senses when the user touches the outer shell, communicates with the main control board to transmit the touch sensing signal, and the main control board controls the movement of the head, neck, and body motors through the motor control board. At the same time, the main control board locally starts the corresponding cute expressions and sounds, displays the cute expressions on the display screen on the robot's head, and plays the preset cute sound effects through the speaker.

[0173] Specifically, in the head mechanism,

[0174] (1) Display screen:

[0175] a) Display device information: current time, battery level, charging mode, WIFI network status, Bluetooth connection status.

[0176] b) Display realistic expressions.

[0177] c) Talk to family members remotely.

[0178] (2). Camera: above the screen.

[0179] a) Tracking and locating the user's position. The robot always faces the user. When the user moves, the robot can track and locate the user's position through the camera.

[0180] b) Users can be filmed while talking to family members remotely.

[0181] c) Face recognition: You can recognize the user by face and directly call the other party by their nickname (or name) during voice communication.

[0182] d) Gesture recognition: set several commonly used gestures (e.g. waving twice or more means closing the video; a one-handed OK gesture means receiving a medication reminder and interrupting the medication broadcast).

[0183] e) Dressing interaction: When users chat with the robot (after connecting to the voice model, the robot will give today's clothing suggestions based on the weather forecast and the user's current clothing), or praise the red robe worn today for being festive and the navy blue shirt for being tasteful.

[0184] (3). Dual microphones: on both sides of the camera.

[0185] a) Voice interaction. Voice signals do not pass through Bluetooth. Voice signals are received normally and processed by the voice module. Bluetooth function: 1. Network configuration; 2. Determine whether the medicine box and the robot are in the same room. When the robot and Bluetooth are in the same room, the medicine box broadcast is the main one.

[0186] b) User positioning: First, the approximate direction is determined by voice, and then the specific location is tracked by the camera.

[0187] Motor and gear: Control the robot's shaking motion. The motor's motion range is 80 degrees to the left and right, for a total of 160 degrees.

[0188] (4) Main control panel: Behind the screen. Including voice, display, WIFI, Bluetooth Low Energy (Bluetooth LowEnergy,

[0189] BLE) and other modules, the wires are electrically connected to control the capacitive touch sensor, motor control board, power control board, and network distribution button.

[0190] The logic operation control of the motor is still completed on the main control board. The motor control board is the execution control of the motor movement.

[0191] (5). Bluetooth: used for network configuration.

[0192] (6). WiFi communication, access to cloud platform

[0193] a) Access the public cloud platform to query daily information: time, weather, temperature, playing songs, etc.;

[0194] b) Access the dedicated cloud platform, link the APP, and query the elderly’s daily health information: blood sugar, blood pressure, blood oxygen, etc.;

[0195] c) Access the dedicated cloud platform, link the APP, and query the elderly’s daily medication information: drug name, dosage, and time;

[0196] d) Access the dedicated cloud platform, link the APP, and query the elderly’s home safety information: smoke alarm, water overflow alarm, security alarm and other information.

[0197] e) Talk to relatives remotely.

[0198] (7) Voice interaction: realize voice recognition, analysis and synthesis on the cloud platform.

[0199] (8) Interaction: scene + voice + expression + action

[0200] Please refer to the documents sent earlier for details. In specific scenarios, perform voice, expression, and action.

[0201] (9). Capacitive touch sensor

[0202] a) One on the top of the head and one on each side of the cheek, a total of 3.

[0203] b) Two scenarios:

[0204] Scenario 1. Black screen, touch to wake up the robot;

[0205] Scenario 2: The screen is not black and the device is not in sleep mode. The user touches the housing to trigger the head shaking action.

[0206] The top of the neck mechanism is fixedly connected to the bottom of the head by screws, and the two sides of the neck are fixedly connected to the body by screws. The neck connects the head and body, improves the load-bearing capacity, and increases the movement dimension and flexibility.

[0207] The neck includes a DC motor, a gear set, double-sided bearings, a bracket and upper and lower shells; the DC motor controls the robot's nodding action through the gear set and bearings; the motor shell is divided into an upper half and a lower half, and the upper and lower shells are fixed by screws;

[0208] The movement of the neck is controlled by the motor connected with the gear set and bearings. The bearings on the left and right sides are for movement balance.

[0209] The lower part of the upper and lower shells is a semicircular design. The semicircular structure of the neck is an innovative structure, which has significant improvements in increasing dimensions, improving movement flexibility, and improving load-bearing capacity.

[0210] There are screw holes inside the body mechanism, which correspond to the positions of the screw holes in the neck, and the neck and body are fixed by screw connection.

[0211] The body includes a speaker hole and a shell. There is a product logo on the front of the robot body. With this as the front base point, there is a speaker hole at the back, which corresponds to the position of the speaker cavity. The top of the shell is an arc shape, corresponding to the shape of the lower half of the neck shell, which is used to place the robot neck and facilitate the rotation of the robot neck.

[0212] The body is fixedly connected to the base turntable by screws.

[0213] The base includes a base body and two layers of a turntable body, and the turntable body is fixed to the base frame by screws;

[0214] The base body includes a base frame, input and output power interfaces, a power switch, a network distribution button, a rechargeable battery, and a power control board; the turntable body includes a turntable base, a DC motor and its transmission structure, a motor control board, and a speaker cavity.

[0215] The base frame includes 1 power input interface, multiple power output interfaces (2 Type C interfaces, 1 Type A interface), 1 network distribution button, 1 machine power switch button, rechargeable battery, and power control board. The input and output power interfaces, machine power switch, and rechargeable battery are all connected to the power control board through wires, and the power control board is connected to the main control board of the robot head through wires. The network distribution button is electrically connected to the main control board of the head.

[0216] The turntable body includes a turntable base, a DC motor and its transmission structure, a motor control board, and a speaker cavity.

[0217] The turntable base is fixed on the base frame through screws; the DC motor and its transmission structure, the motor control board, and the speaker sound cavity are fixed on the turntable base through screws.

[0218] The DC motor and its transmission structure include a DC motor, a gear set, an inner bearing, an outer (plane) bearing, a motor frame, and a motor control board;

[0219] The inner bearing is connected to the gear and rotates with the gear; the outer bearing, also known as the plane bearing, is connected to the body shell, driving the robot body to rotate. The plane bearing also plays a role in supporting the body shell to prevent deformation.

[0220] The body shell is connected to the turntable and rotates with the turntable. The maximum rotation range is determined by the limit point (the actual maximum rotation angle is 345 degrees).

[0221] The head, neck and base motors are all connected to the motor control board through wires, and the motor control board is electrically connected to the main control board.

[0222] Specifically, in the present invention,

[0223] (1).Battery: rechargeable battery.

[0224] (2). Input power: Type C interface, provides power for the robot.

[0225] (3). Output power to charge other devices: 2 Type C interfaces and 1 Type A interface.

[0226] (4). Machine switch: Turn the machine power on and off.

[0227] (5) Power control board: The wires are used to electrically connect the battery, the machine switch, and the four USB ports. The power control board is electrically connected to the head main control board through wires.

[0228] (6) Network configuration button: connect to WIFI. Electrically connected to the head main control board through wires.

[0229] (7) Turntable base: Places the motor, supports the body shell, and rotates with the robot body.

[0230] (8) Motor control board: The three motors are electrically connected to the motor control board through wires. The motor control board is electrically connected to the head main control board through wires.

[0231] In this embodiment, the relationship between the robot, the cloud platform, and the application APP

[0232] like Fig.37 As shown, the intelligent robot in this embodiment is an intelligent terminal with voice input and voice+expression+action output.

[0233] The robot, application APP, and cloud platform are interconnected. After the background data exchange is completed, the information setting is mainly completed on the application APP of the mobile terminal. With the cloud platform as the information transfer center, the application setting information is synchronized with the cloud platform, and then sent to the intelligent robot by the cloud platform. Similarly, the intelligent robot will feedback the user interaction information to the cloud platform, and then the cloud platform will synchronize it to the application. The intelligent robot needs to access the network through Bluetooth and set up on the application side.

[0234] 2. Medication reminder broadcast

[0235] The intelligent robot's medication information is set on the application APP, and instructions are sent to the intelligent robot through the cloud platform. When the intelligent robot reaches the medication time, it will announce the name of the medicine by voice to remind the user to take the medicine on time and in the right amount. The user will give feedback through voice whether to take the medicine and stop the voice announcement.

[0236] The intelligent robot only has the function of timing reminder and has no judgment function to prevent misleading users.

[0237] Steps such as Fig.33 As shown:

[0238] 1) The user sets medication information on the APP and synchronizes it to the cloud platform;

[0239] 2) The cloud platform issues instructions to inform the intelligent robot of the time and medication information to be broadcasted for each medication reminder set by the user;

[0240] 3) The intelligent robot determines the arrival time of medication based on the pre-stored medication time and system time calibration;

[0241] 4) The intelligent robot broadcasts medication information, i.e. medication reminders, drug names, and dosages; at the same time, the intelligent robot locally triggers the screen to display medication reminder expressions, and the robot performs medication reminder supporting actions;

[0242] 5) Play the medication reminder voice according to the preset number of repetitions and time intervals, turn off the screen after the broadcast, and wait for the user to feedback medication information;

[0243] Case 1: Taking medicine on time, the user informs the intelligent robot by voice

[0244] 6) The user has taken the medicine on time, and the intelligent robot is informed by voice

[0245] 7) Intelligent robot triggers "take medicine on time voice + action + expression"

[0246] 8) Turn off the screen;

[0247] Case 2: The user does not tell the robot whether they took the medicine on time

[0248] 9) If the robot does not receive feedback from the user that the medication was taken on time after the preset time, it returns to step 4;

[0249] 10) After repeating step 4 for the preset number of times, the user still does not receive the instruction from the cloud that the medication has been taken on time.

[0250] 11) Intelligent robot triggers "not taking medicine on time" voice + action + expression

[0251] 12) Stop broadcasting and turn off the screen;

[0252] 3. Health status query and report

[0253] The daily health monitoring data of the intelligent robot is input into the application APP, and the data is synchronized to the cloud platform. When the user inputs the query demand through voice, the intelligent robot sends the query request to the cloud platform, and the cloud platform sends the health information to the intelligent robot. The intelligent robot broadcasts the health status information through voice.

[0254] 4. Daily communication and interaction

[0255] The user's voice wakes up the intelligent robot, which turns its body to face the user through sound source and visual positioning, and broadcasts the corresponding voice, expression, and action. The user sends a voice to the intelligent robot, which receives the user's voice information and sends it to the cloud. The cloud interprets the user's voice command, responds differently according to the user's command, and sends the command to the robot to execute the corresponding voice, expression, and action.

[0256] Steps such as Fig.34 :

[0257] 1) The user wakes up the intelligent robot through the wake-up word; the wake-up word is recognized locally and the corresponding wake-up operation is performed:

[0258] Action + Expression + Voice

[0259] Calibration: Local wake-up expression

[0260] Voice: Local built-in voice

[0261] Movement: The torso and head are on one axis, with the head returning to a 90-degree position with the main axis.

[0262] 2) After the intelligent robot receives the wake-up command locally, it uses sound source and visual positioning to turn its body to face the user, while broadcasting the corresponding voice, expression, and action;

[0263] 3) The user sends voice to the intelligent robot;

[0264] 4) The intelligent robot receives the user's voice and uploads it to the cloud platform;

[0265] 5) After analyzing the user's voice information, the cloud platform determines whether the user's voice is a query or daily communication;

[0266] 6) The cloud platform generates answers based on user query information and synthesizes corresponding voice feedback information;

[0267] 7) The cloud platform sends the answering voice to the intelligent robot, and the corresponding expressions and actions are triggered by the instructions;

[0268] 8) The intelligent robot plays the voice sent by the cloud platform and triggers corresponding expressions and actions;

[0269] Case 1: User voice is a query command

[0270] 9) Turn off the screen after the announcement is completed;

[0271] Case 2: User voice is for daily communication

[0272] 9) After the announcement is completed, wait for the user to continue to interact. If there is a new user interaction within the preset time, repeat step 9;

[0273] 10) After the announcement is completed, if there is no new interaction within the preset time, the intelligent robot will turn off the screen.

[0274] The protection content of the present invention is not limited to the above embodiments. Without departing from the spirit and scope of the inventive concept, changes and advantages that can be thought of by those skilled in the art are included in the present invention and are protected by the attached claims.

Claims

1. A desktop companion interactive intelligent robot, characterized in that: The robot includes the following functions: Companionship interaction, daily life information query and broadcast, user health information query and broadcast, medication information reminder query and broadcast, and remote interactive calls with family members; among them, The companion interaction includes: scenes, voices, expressions, and actions, which are superimposed to generate interactive effects; The daily life information query and broadcast is: accessing the cloud platform through WIFI, broadcasting daily life information based on user query needs; The user health information query and broadcast is: access the robot's exclusive cloud platform through WIFI, associate the application APP, and broadcast daily health information based on user query needs; The medication information query and broadcast are as follows: access the robot's exclusive cloud platform via WIFI, associate the application APP, and regularly broadcast reminders for users to take medication; query medication at any time, and broadcast medication information based on user needs.

2. The desktop companion interactive intelligent robot according to claim 1, characterized in that: The companion interaction also includes specific scene actions: 1) Head shaking action: There is one capacitive touch sensor on the top of the robot's head and two on both sides of its cheeks. When the user touches the robot's head and cheeks, the robot turns on the motors of its head and neck and shakes its head; 2) Emotional and irritable movements: The speed and amplitude of various movements of the body, head, and neck are amplified; in scenarios where executive function fails, including speech recognition failure.

3. The desktop companion interactive intelligent robot according to claim 1, characterized in that: The robot, the application APP and the cloud platform are interconnected to complete the background data exchange; the information setting is completed on the application APP of the mobile terminal; the cloud platform is used as the information transfer center, the application setting information is synchronized with the cloud platform, and then sent to the intelligent robot by the cloud platform; the intelligent robot feeds back the user interaction information to the cloud platform, which is then synchronized to the application by the cloud platform; the intelligent robot accesses the network via Bluetooth and is set in the application APP.

4. The desktop companion interactive intelligent robot according to claim 1, characterized in that: In the medication reminder broadcast, The medication information of the intelligent robot is set on the APP side, and the instructions are sent to the intelligent robot through the cloud platform. When the intelligent robot reaches the medication time, it will announce the name of the medicine by voice to remind the user to take the medicine on time and in the right amount. The user will give feedback through voice whether to take the medicine and stop the voice announcement. The intelligent robot only has the function of timing reminder and has no judgment function to prevent misleading users.

5. The desktop companion interactive intelligent robot according to claim 4, characterized in that: The medication reminder broadcast includes the following steps: 1) The user sets medication information in the APP and synchronizes it to the cloud platform; 2) The cloud platform issues instructions to inform the intelligent robot of the time and medication information to be broadcasted for each medication reminder set by the user; 3) The intelligent robot determines the arrival time of medication based on the pre-stored medication time and system time calibration; 4) The intelligent robot broadcasts medication information, i.e. medication reminders, drug names, and dosages; at the same time, the intelligent robot locally triggers the screen to display medication reminder expressions, and the robot performs medication reminder supporting actions; 5) Play the medication reminder voice according to the preset number of repetitions and time intervals, turn off the screen after the broadcast, and wait for the user to feedback medication information; If the medication is taken on time, the user will inform the intelligent robot by voice; 6) Intelligent robots trigger "voice + action + expression for taking medicine on time"; 8) Turn off the screen; If the user does not tell the robot whether to take the medicine on time; 9) If the robot does not receive feedback from the user that the medication was taken on time after the preset time, it returns to step 4; 10) After repeating step 4 for the preset number of times, the patient still does not receive the instruction from the cloud that the medication has been taken on time; 11) Intelligent robot triggers "voice + action + expression of not taking medicine on time"; 12) Stop the broadcast and turn off the screen.

6. The desktop companion interactive intelligent robot according to claim 1, characterized in that: In the health status query and broadcast, the daily health monitoring data of the intelligent robot is input on the application APP side, and the data is synchronized to the cloud platform. When the user inputs the query requirement through voice, the intelligent robot sends a query request to the cloud platform, and the cloud platform sends the health information to the intelligent robot, and the intelligent robot broadcasts the health status information through voice.

7. The desktop companion interactive intelligent robot according to claim 1, characterized in that: In the daily communication and interaction, The user's voice wakes up the intelligent robot, and the intelligent robot turns its body to face the user through sound source and visual positioning, and broadcasts the corresponding voice, expression, and action at the same time; the user sends voice to the intelligent robot, the intelligent robot receives the user's voice information and sends it to the cloud. The cloud parses the user's voice command, makes different responses according to the user's command, and sends commands to the robot to execute the corresponding voice, expression, and action.

8. The desktop companion interactive intelligent robot according to claim 7, characterized in that: The daily communication and interactive companionship includes the following steps: 1) The user wakes up the intelligent robot through the wake-up word; the wake-up word is recognized locally and the corresponding wake-up operation is performed: Action + expression + voice; Calibration: local wake-up expression; Voice: Local built-in voice; Movement: The torso and head are on one axis, and the head returns to a 90-degree position with the main axis; 2) After the intelligent robot receives the wake-up command locally, it uses sound source and visual positioning to turn its body to face the user, while broadcasting the corresponding voice, expression, and action; 3) The user sends voice to the intelligent robot; 4) The intelligent robot receives the user's voice and uploads it to the cloud platform; 5) After analyzing the user's voice information, the cloud platform determines whether the user's voice is a query or daily communication; 6) The cloud platform generates answers based on user query information and synthesizes corresponding voice feedback information; 7) The cloud platform sends the answering voice to the intelligent robot, and the corresponding expressions and actions are triggered by the instructions; 8) The intelligent robot plays the voice sent by the cloud platform and triggers corresponding expressions and actions; If the user's voice is a query command; 9) Turn off the screen after the announcement is completed; If the user's voice is for daily communication; 9) After the announcement is completed, wait for the user to continue to interact. If there is a new user interaction within the preset time, repeat step 9; 10) After the announcement is completed, if there is no new interaction within the preset time, the intelligent robot will turn off the screen.

9. The desktop companion interactive intelligent robot according to claim 1, characterized in that: include: Head mechanism (A), neck mechanism (B), body mechanism (C); among them, The head structure comprises: a head support (2), a head body, a head shell (4), a display screen (5) and a head bottom shell (335); the head body, the head shell (4), the display screen (5) and the head bottom shell (335) are all fixed on the head support (2); wherein, The head shell (4) comprises: a face mask (1) and a head rear shell (41); The head body comprises: a main control board (31), a capacitive touch sensor (32), a head DC motor and a transmission structure (33); the capacitive touch sensor (32) is fixed in the head shell (4); The head DC motor and its transmission structure (33) include: a head DC motor (331), a head motor frame (332), a head gear set (333) and a bearing (334); the head DC motor (331) drives the head gear set (333) to rotate, and the head gear set (333) is connected to the bearing (334); the bearing (334) is arranged on the head bottom shell (335); the head DC motor (331) controls the shaking action of the head mechanism, and is fixed in the head motor frame (332); the head motor frame (332) is fixed on the head bottom shell (335); The capacitive touch sensor (32) communicates with the main control board (31) to transmit touch sensing signals, and the main control board (31) controls the movement of the head DC motor (331); The display screen (5) is arranged inside the head body, and the main control board (31) is fixed at the back thereof; The body mechanism is connected to the head mechanism via the neck mechanism.

Citation Information

Patent Citations

  • Head and neck structure of service robot

    CN106976098A

  • Emotional accompanying intelligent robot based on intelligent interaction system

    CN112223318A

  • Robot that can be used to community and health supervision of family

    CN208289903U

  • Methods and systems for a companion robot

    US20200058387A1

  • Socially assistive robot

    US20200114521A1

Cited By

  • Sound-video composite positioning orientation control method and system for desktop accompanying robot

    CN122593432A