Action processing method and device, electronic equipment, storage medium and program product
Through the robot performing the action sequence in sequence, the elderly's position is gradually adjusted, from lying on their backs to lying on their side, lying on their side to sitting up, solving the safety and stability problems of autonomous transfer of elderly people in the existing technology, and realizing that the elderly's independent from bed to bed Convenient transfer of wheelchairs.
Patent Information
- Application Number
- CN202311306495.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-10-09
- Publication Date
- 2024-11-22
- Estimated Expiration
- 2043-10-09
AI Technical Summary
In the prior art, the solutions to assist the elderly from bed to wheelchair mainly rely on special equipment, have single functions and require manual operation, and cannot independently realize the transfer of the elderly, and there are problems of insufficient safety, stability and labor-saving ability.
By designing a robot's action processing method and device, using humanoid components to execute the action sequence in sequence, gradually adjust the position of the target object, from lying on your back to lying on your side, lying on your side to sitting up, sitting up to sitting up in a wheelchair, to realize the elderly autonomous transfer.
It improves the convenience and safety of the posture adjustment process, realizes the convenience and safety of the elderly's independent transfer, and reduces the dependence on manual operations.
Smart Images

Figure CN118990468A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to robotics technology, and in particular to a robot motion processing method, device, electronic device, computer-readable storage medium and computer program product. Background Art
[0002] In the related art, the solution of assisting the elderly from bed to wheelchair is mainly implemented through special equipment, such as a bed specially designed to assist turning over, or a lifting method is used to assist the elderly in transferring, or the elderly's transfer is achieved through walkers and smart wheelchairs.
[0003] However, the solutions provided in the related art belong to special equipment, which has a single function and usually requires manual operation, and cannot realize the transfer of the elderly autonomously. Summary of the invention
[0004] The embodiments of the present application provide a robot motion processing method, device, electronic device, computer-readable storage medium and computer program product, which can sequentially change the posture of a target object through a sequence of actions under the premise of autonomy, thereby ultimately completing the adjustment of the target object from a first posture to a second posture. Since the final posture adjustment is achieved based on multiple actions, the convenience and safety of the posture adjustment process can be improved.
[0005] The technical solution of the embodiment of the present application is implemented as follows:
[0006] The present application provides a robot motion processing method, including:
[0007] The robot moves to the action range of the target object, wherein the target object is supported by a target object, and the action range is the area in which the robot can perform actions on the target object;
[0008] autonomously and sequentially performing each action in the action sequence on a target object supported by the target object through the humanoid component of the robot, so as to adjust the target object on the target object from a first posture to a second posture;
[0009] Each of the actions corresponds to a posture change of the target object, and the posture change from the first posture to the second posture is obtained based on multiple posture changes of the action sequence.
[0010] The present application provides a robot motion processing device, comprising:
[0011] A moving module, used for moving the robot to within the action range of the target object, wherein the target object is supported by a target object, and the action range is an area range in which the robot can perform actions on the target object;
[0012] a fourth action module, configured to autonomously and sequentially perform each action in the action sequence on the target object supported by the target object through the humanoid component of the robot, so as to adjust the target object on the target object from the first posture to the second posture;
[0013] Each of the actions corresponds to a posture change of the target object, and the posture change from the first posture to the second posture is obtained based on multiple posture changes of the action sequence.
[0014] The present application provides a robot motion processing method, including:
[0015] By means of the humanoid component of the robot, each action in a first action sequence is autonomously and sequentially performed on a target object supported by a first target object, so as to adjust the target object from lying supinely on the first target object to lying sideways on the first target object;
[0016] By means of the humanoid component of the robot, each action in a second action sequence is autonomously performed in sequence on the target object supported by the first target object, so as to adjust the target object from lying sideways on the first target object to sitting up on the first target object;
[0017] By means of the humanoid component of the robot, each action in a third action sequence is autonomously and sequentially performed on the target object supported by the first target object, so as to adjust the target object from sitting up on the first target object to sitting up on the second target object;
[0018] Each of the actions corresponds to a posture change of the target object, and each adjustment of the target object is obtained based on multiple posture changes of the corresponding action sequence.
[0019] The present application provides a robot motion processing device, including:
[0020] a first action module, configured to autonomously and sequentially perform each action in a first action sequence on a target object supported by a first target object through a humanoid component of the robot, so as to adjust the target object from lying supinely on the first target object to lying sideways on the first target object;
[0021] a second action module, configured to autonomously and sequentially perform each action in a second action sequence on a target object supported by the first target object through the humanoid component of the robot, so as to adjust the target object from lying sideways on the first target object to sitting up on the first target object;
[0022] a third action module, configured to autonomously and sequentially perform each action in a third action sequence on a target object supported by the first target object through the humanoid component of the robot, so as to adjust the target object from sitting up on the first target object to sitting up on the second target object;
[0023] Each of the actions corresponds to a posture change of the target object, and each adjustment of the target object is obtained based on multiple posture changes of the corresponding action sequence.
[0024] An embodiment of the present application provides a robot, characterized in that the robot includes: a humanoid component and a controller; the controller is used to control the humanoid component to execute the robot action processing method provided by the embodiment of the present application.
[0025] An embodiment of the present application provides an electronic device for controlling a robot, including:
[0026] A memory for storing computer executable instructions;
[0027] The processor is used to control the robot to implement the robot action processing method provided by the embodiment of the present application when executing the computer executable instructions stored in the memory.
[0028] An embodiment of the present application provides a computer-readable storage medium storing computer-executable instructions for causing a processor to execute and implement the robot motion processing method provided by the embodiment of the present application.
[0029] An embodiment of the present application provides a computer program product, including computer executable instructions, which, when executed by a processor, implement the robot action processing method provided by the embodiment of the present application.
[0030] The embodiments of the present application have the following beneficial effects:
[0031] Through the humanoid component of the robot, the target object supported by the first target object autonomously performs each action in the first action sequence in sequence to adjust the target object from lying on its back on the first target object to lying on its side on the first target object; through the humanoid component of the robot, the target object supported by the first target object autonomously performs each action in the second action sequence in sequence to adjust the target object from lying on its side on the first target object to sitting up on the first target object; through the humanoid component of the robot, the target object supported by the first target object autonomously performs each action in the third action sequence in sequence to adjust the target object from sitting up on the first target object to sitting up on the second target object. Since the transfer is carried out in stages, and the posture change in each stage is achieved through the action sequence, the posture of the target object can be changed in sequence through the action sequence in a safe and stable manner to achieve the transfer of the target object. BRIEF DESCRIPTION OF THE DRAWINGS
[0032] Figure 1 is a schematic diagram of the structure of the action processing system of the robot provided in an embodiment of the present application;
[0033] Figure 2 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application;
[0034] Figure 3A-3E It is a flowchart of the action processing method of the robot provided in the embodiment of the present application;
[0035] Figure 4 It is a schematic diagram of the structure of a robot in the robot action processing method provided by an embodiment of the present application;
[0036] Figure 5A-5C is a schematic diagram of posture changes of the first action sequence provided in an embodiment of the present application;
[0037] Figure 6A-6B is a schematic diagram of posture changes of the second action sequence provided in an embodiment of the present application;
[0038] Figure 7A-7C is a schematic diagram of posture changes of the third action sequence provided in an embodiment of the present application;
[0039] Figure 8 It is a schematic diagram of posture changes of the fourth action sequence provided in an embodiment of the present application. DETAILED DESCRIPTION
[0040] In order to make the purpose, technical solutions and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings. The described embodiments should not be regarded as limiting the present application. All other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of this application.
[0041] In the following description, reference is made to “some embodiments”, which describe a subset of all possible embodiments, but it can be understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.
[0042] In the following description, the terms "first\second\third" involved are merely used to distinguish similar objects and do not represent a specific ordering of the objects. It can be understood that "first\second\third" can be interchanged with a specific order or sequence where permitted, so that the embodiments of the present application described here can be implemented in an order other than that illustrated or described here.
[0043] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein are only for the purpose of describing the embodiments of this application and are not intended to limit this application.
[0044] Before further describing the embodiments of the present application in detail, the nouns and terms involved in the embodiments of the present application are explained. The nouns and terms involved in the embodiments of the present application are subject to the following interpretations.
[0045] 1) A robot is an intelligent machine that can work semi-autonomously or fully autonomously. A robot can perform tasks such as work or movement through programming and automatic control.
[0046] 2) Pose, which describes the position and posture of an object (such as coordinates) in a specified coordinate system. Robots often use pose to describe their position and posture in a spatial coordinate system.
[0047] The robot provided in the embodiment of the present application is a robot that uses legs to move. It uses animals as bionic objects, and its purpose is to simulate the movement form of animals and replicate the movement ability of animals based on engineering technology and scientific research results. The robot has a strong adaptability to various environments (including structured environments (such as roads, railways, treated flat roads, etc.) and unstructured environments (such as mountains, swamps, rugged roads, etc.), and it can adapt to various changes in terrain, climb over higher obstacles, and can effectively reduce loads and improve the energy efficiency of the system. Robots can be divided into single-legged, bipedal, quadrupedal, hexapod, octapodal, etc. according to the number of legs. Among them, humanoid robots have super strong movement ability, which is better than bipedal robots in static stability, and simpler and more flexible than hexapod and octapodal robots. Therefore, humanoid robots are a common choice for studying robots. The gait of a humanoid robot is the coordination relationship of its four legs in time and space in order for the humanoid robot to be able to move continuously. The gait of a humanoid robot is derived from the gait of a quadrupedal mammal (eg, a puppy), which may include but is not limited to the following simplified three forms: walk, trot, and bound.
[0048] Figure 4 is a schematic diagram showing a robot according to an embodiment of the present application. Figure 4 As shown, the quadruped humanoid robot is an intelligent device that can approximately imitate animals. It has the ability to walk and move flexibly in complex terrains and environments, so it has a wide range of applications in many application scenarios. For example, in an emergency, the humanoid robot can be used for tasks such as search and rescue, detection, and demolition. It can work in places that are difficult for humans to reach, such as mountains, deserts, and forests. In daily life, the humanoid robot can be used as an intelligent companion. It can interact with humans in the home environment and can also adapt to different terrains of the home, such as slopes, steps, etc. The robot is not only highly intelligent and flexible, but also highly adaptable and practical.
[0049] The exemplary robot includes multiple components, such as a head component (optional), a body component, and a leg component, etc. Of course, the embodiments of the present application are not limited thereto.
[0050] The exemplary head assembly may be equipped with a visual camera, a voice interaction system and other perception components for environmental interaction and human-computer interaction. In some examples, the head assembly also includes a neck rotation assembly to perform pitch and left-right rotation of the head to obtain a wider field of view. Of course, the embodiments of the present application are not limited to this.
[0051] One end of the head component is connected to the body component of the robot. The exemplary body component may contain components such as a battery, a computing system, and a control system to provide energy and computing support for the robot's movement.
[0052] In addition, exemplary body components include but are not limited to upper limb components, waist components, and hip components. Of course, the present application embodiment is not limited to this.
[0053] The left and right ends of an exemplary torso assembly include symmetrical upper limb assemblies. An exemplary upper limb assembly includes a shoulder joint assembly, an arm assembly, and an end effector. The shoulder joint assembly has six degrees of freedom to enable complex movements of the arm assembly, such as rotation and lifting in all directions. One end of the arm assembly is connected to the shoulder joint assembly, and the other end is connected to the end effector. Optionally, the connection between the arm assembly and the end effector includes a motor to enable the end effector to move along four degrees of freedom. Among them, the optional end effector can be a manipulator of any form, which has a rich degree of freedom to imitate human movements such as grasping, pushing, and supporting objects of various shapes.
[0054] The waist component and the hip component are used to connect the leg component and the torso component. A motor is installed inside the waist component to enable the torso component to pitch and rotate so that the robot can imitate the human bending action. A motor is installed inside the hip component to rotate the leg component. The posture of the leg component can be changed by controlling the motor.
[0055] The leg assembly includes four mechanical legs, and the example robot can move based on the four mechanical legs. Wherein, the four mechanical legs are two inner legs (shown in gray) and two outer legs (shown in white). Each mechanical leg includes a retractable rigid assembly and a driving wheel, one end of the retractable rigid assembly of the inner leg is connected to the body assembly of the robot, such as being connected to the hip, and the other end is connected to the driving wheel. The optional inner leg and the outer leg are controlled by different motors respectively, so that the relative positions of the inner leg and the outer leg can be changed to be more suitable for the living environment. The retractable rigid assembly can be extended and shortened. The leg motor is used to drive the mechanical leg to walk, and when encountering an obstacle during walking, the retractable rigid assembly can cross the obstacle by extending or shortening. The driving wheel is used to carry out wheeled motion.
[0056] The telescopic rigid component includes a main leg segment, a telescopic leg segment and a telescopic drive mechanism. The main leg segment is connected to the leg motor. The telescopic leg segment is slidably connected to the main leg segment, and one end of the telescopic leg segment away from the leg motor is connected to the driving wheel assembly. The telescopic drive mechanism is connected to the main leg segment and the telescopic leg segment respectively, and the telescopic drive mechanism is used to drive the telescopic leg segment to slide. When the telescopic drive mechanism drives the telescopic leg segment to slide in a direction away from the leg motor, the mechanical leg is extended; when the telescopic drive mechanism drives the telescopic leg segment to slide in a direction close to the leg motor, the mechanical leg is shortened. The embodiments of the present application do not limit the relative positional relationship between the main leg segment and the telescopic leg segment. In some examples, one side of the main leg segment is slidably connected to one side of the telescopic leg segment. In other examples, the main leg segment has a receiving cavity, a part of the telescopic leg segment is located in the receiving cavity, and the telescopic leg segment can be telescoped relative to the receiving cavity. The embodiments of the present application do not limit the type of the telescopic drive mechanism. In some examples, the telescopic drive mechanism is a screw nut mechanism, a synchronous belt mechanism, a gear rack mechanism, a hydraulic rod mechanism or an electric push rod mechanism.
[0057] It should be noted that the robot can also be equipped with a variety of sensors, such as IMU (Inertial Measurement Unit) sensors and joint angle encoders, etc. Among them, the IMU sensor can provide the robot's acceleration and posture information in real time, and the joint angle encoder can provide the joint angle information of each joint of the robot in real time (such as the angle of the joint angle, angular velocity feedback value, etc.). Under the control of the multiple motors mentioned above, the example robot can already simulate real human actions such as running, jumping, climbing stairs, etc.
[0058] In the related art, the solution to assist the elderly from bed to wheelchair is mainly implemented through special equipment, specially designed beds to assist turning over, or using lifting methods to assist the elderly in transferring, or using walkers and smart wheelchairs to achieve the transfer of the elderly. However, the solution provided in the related art belongs to special equipment, which has a single function and usually requires manual operation, and cannot realize the transfer of the elderly autonomously. In addition, the transfer of the elderly in the related art has problems with safety, stability and labor-saving ability, which makes it difficult to apply to real scenarios.
[0059] The embodiments of the present application provide a robot motion processing method, device, electronic device, computer-readable storage medium and computer program product, which can safely and stably change the posture of a target object in sequence through a sequence of motions to achieve the transfer of the target object.
[0060] The following describes an exemplary application of the electronic device for controlling a robot provided in an embodiment of the present application. The electronic device for controlling a robot provided in an embodiment of the present application can be implemented as various types of user terminals such as laptop computers, tablet computers, desktop computers, set-top boxes, mobile devices (for example, mobile phones, portable music players, personal digital assistants, dedicated messaging devices, portable gaming devices), and can also be implemented as a server.
[0061] See also Figure 1 , Figure 1 It is a schematic diagram of the architecture of the robot motion processing system provided in an embodiment of the present application. The robot 400 is connected to the server 200 via a network 300. The network 300 can be a wide area network or a local area network, or a combination of the two.
[0062] When the robot 400 observes the target object, the robot 400 collects the state data of the target object and sends the state data to the server 200. The server 200 recognizes the intention of the target object, thereby sensing that the target object has the need to transfer from the first target object to the second target object. The server 200 sends the action execution instructions of the first action sequence, the second action sequence and the third action sequence to the robot 400, so that the robot 400 autonomously performs each action in the first action sequence on the target object supported by the first target object in sequence, so as to adjust the target object from lying on its back on the first target object to lying on its side on the first target object; the robot 400 autonomously performs each action in the second action sequence on the target object supported by the first target object in sequence, so as to adjust the target object from lying on its side on the first target object to sitting up on the first target object; the robot 400 autonomously performs each action in the third action sequence on the target object supported by the first target object in sequence, so as to adjust the target object from sitting up on the first target object to sitting up on the second target object.
[0063] In some embodiments, the server 200 may be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms. The terminal 400 may be a smart phone, a tablet computer, a laptop computer, a desktop computer, a smart speaker, a smart watch, etc., but is not limited thereto. The terminal and the server may be directly or indirectly connected via wired or wireless communication, which is not limited in the embodiments of the present invention.
[0064] The action processing method of the robot provided in the embodiment of the present application is applied to artificial intelligence technology. For example, artificial intelligence technology can be used to identify the needs of the object. Artificial intelligence (AI, Artificial Intelligence) is the theory, method, technology and application system of using digital computers or machines controlled by digital computers to simulate, extend and expand human intelligence, perceive the environment, acquire knowledge and use knowledge to obtain the best results. In other words, artificial intelligence is a comprehensive technology of computer science, which attempts to understand the essence of intelligence and produce a new intelligent machine that can respond in a similar way to human intelligence. Artificial intelligence is to study the design principles and implementation methods of various intelligent machines so that the machines have the functions of perception, reasoning and decision-making. Artificial intelligence technology is a comprehensive discipline involving a wide range of fields, including both hardware-level technology and software-level technology. Basic artificial intelligence technologies generally include sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, big data processing technology, pre-trained model technology, operation / interaction system, mechatronics, etc. Among them, the pre-trained model is also called a large model or a basic model. After fine-tuning, it can be widely used in downstream tasks in various major directions of artificial intelligence. Artificial intelligence software technology mainly includes computer vision technology, speech processing technology, natural language processing technology, machine learning / deep learning and other major directions.
[0065] See also Figure 2 , Figure 2 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application, and takes a server as an example for explanation. Figure 2 The server 200 shown includes: at least one processor 210, a memory 250, at least one network interface 220 and a user interface 230. The various components in the server 200 are coupled together via a bus system 240. It is understood that the bus system 240 is used to achieve connection and communication between these components. In addition to the data bus, the bus system 240 also includes a power bus, a control bus and a status signal bus. However, for the sake of clarity, the bus system 240 is not described in detail. Figure 2 Various buses are labeled as bus system 240 .
[0066] The processor 210 can be an integrated circuit chip with signal processing capabilities, such as a general-purpose processor, a digital signal processor (DSP), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc., where the general-purpose processor can be a microprocessor or any conventional processor, etc.
[0067] The user interface 230 includes one or more output devices 231 that enable presentation of media content, including one or more speakers and / or one or more visual display screens. The user interface 230 also includes one or more input devices 232, including user interface components that facilitate user input, such as a keyboard, mouse, microphone, touch screen display, camera, other input buttons and controls.
[0068] The memory 250 may be removable, non-removable, or a combination thereof. Exemplary hardware devices include solid-state memory, hard disk drives, optical disk drives, etc. The memory 250 may optionally include one or more storage devices that are physically remote from the processor 210.
[0069] The memory 250 includes a volatile memory or a non-volatile memory, and may also include both volatile and non-volatile memories. The non-volatile memory may be a read-only memory (ROM), and the volatile memory may be a random access memory (RAM). The memory 250 described in the embodiments of the present application is intended to include any suitable type of memory.
[0070] In some embodiments, memory 250 can store data to support various operations, examples of which include programs, modules, and data structures, or a subset or superset thereof, as exemplarily described below.
[0071] Operating system 251, including system programs for processing various basic system services and performing hardware-related tasks, such as a framework layer, a core library layer, a driver layer, etc., for implementing various basic services and processing hardware-based tasks;
[0072] A network communication module 252, used to reach other electronic devices via one or more (wired or wireless) network interfaces 220, exemplary network interfaces 220 include: Bluetooth, Wireless Compatibility Authentication (WiFi), and Universal Serial Bus (USB), etc.;
[0073] a presentation module 253 for enabling presentation of information via one or more output devices 231 (e.g., display screen, speaker, etc.) associated with the user interface 230 (e.g., a user interface for operating peripherals and displaying content and information);
[0074] The input processing module 254 is used to detect one or more user inputs or interactions from one of the one or more input devices 232 and translate the detected inputs or interactions.
[0075] In some embodiments, the robot motion processing device provided in the embodiments of the present application can be implemented in a software manner. Figure 2 The robot's motion processing device 255 stored in the memory 250 is shown, which can be software in the form of programs and plug-ins, including the following software modules: a first action module 2551, a second action module 2552 and a third action module 2553. These modules are logical, and therefore can be arbitrarily combined or further split according to the functions implemented. The functions of each module will be explained below.
[0076] The motion processing method of the robot provided in the embodiment of the present application will be explained in combination with the exemplary application and implementation of the robot provided in the embodiment of the present application.
[0077] See also Figure 3A , Figure 3A is a flowchart of the robot action processing method provided in the embodiment of the present application, which will be combined with Figure 3A Steps 101 to 103 are shown for illustration. Each of the actions involved in the embodiment of the present application corresponds to a posture change of the target object, and each adjustment of the target object is obtained based on multiple posture changes of the corresponding action sequence.
[0078] In step 101, the humanoid component of the robot autonomously and sequentially performs each action in a first action sequence on a target object supported by a first target object, so as to adjust the target object from lying supinely on the first target object to lying sideways on the first target object.
[0079] As an example, the target object here is an elderly person in need of help. The humanoid parts can be the head, waist, arms, etc. of the robot. The humanoid parts involved in step 101 are the humanoid parts related to the first action sequence, that is, the humanoid parts needed to perform the actions in the first action sequence. The first target object here can be a bed. The first action sequence is used to assist the elderly to adjust from lying on their back to lying on their side in bed. The initial position of the elderly is lying flat on the bed. By executing multiple actions in the first action sequence, the elderly is adjusted from lying flat on the bed to lying on their side in bed.
[0080] See also Figure 3B In step 101, the humanoid component of the robot autonomously and sequentially performs each action in the first action sequence on the target object supported by the first target object, so as to adjust the target object from lying on its back on the first target object to lying on its side on the first target object, which can be achieved by Figure 3B Steps 1011 to 1013 are implemented as shown.
[0081] In step 1011, the waist of the robot is tilted toward a direction corresponding to the target object so that the target object is within the action range of the robot.
[0082] As an example, the robot's waist 401 is tilted toward the elderly. To ensure stability, the tilt angle must be less than a first tilt angle threshold. The first tilt angle threshold is the maximum tilt angle obtained through experimental tests to maintain stable movement. If it is greater than the first tilt angle threshold, there is a greater probability of capsizing.
[0083] In step 1012, the first arm of the robot moves to the hip of the target object, and the second arm of the robot moves up to the shoulder of the target object.
[0084] As an example, if the first arm is the left arm, the second arm is the right arm; if the first arm is the right arm, the second arm is the left arm. Due to the need to save effort, the robot's two hands can work together to reduce the force of a single hand. The distance between the points of action of both hands is as large as possible to achieve the purpose of saving effort. Considering the body structure of the elderly, it is more appropriate to exert force on the shoulders and hips.
[0085] In step 1013, the buttocks of the target object are used as the force point of the first arm of the robot, and the shoulder of the target object is used as the force point of the second arm of the robot. The first arm and the second arm exert force on the target object to adjust the target object from lying on its back on the first target object to lying on its side on the first target object.
[0086] In some embodiments, in step 1013, the first arm and the second arm exert force on the target object to adjust the target object from lying on its back on the first target object to lying on its side on the first target object. This can be achieved through the following technical solutions: the first arm and the second arm apply a force away from the robot to the target object to adjust the target object from lying on its back to lying on its side with its back facing the robot; or the first arm and the second arm apply a force toward the robot to the target object to adjust the target object from lying on its back to lying on its side facing the robot.
[0087] There are two implementation methods here. The target object can be flipped away from the robot, and the target object can also be flipped toward the robot. This is because the elderly lying on their backs have two sides, the left side corresponding to the left arm and the right side corresponding to the right arm. When the second target object is on the left side corresponding to the elderly's left arm, the target object is flipped toward the left side. When the second target object is on the right side corresponding to the elderly's right arm, the target object is flipped toward the right side. In the later stage of the action, when approaching side-lying, both hands should cooperate to provide reverse force to maintain the stability of the elderly (relative to the robot, a smaller downward and forward force is provided, and the direction and value of the force here are obtained based on simulation tests), and then let go after the elderly are stable.
[0088] In some embodiments, the robot removes obstacles in the area where the target object is located before the robot's waist is tilted in a direction corresponding to the target object so that the target object is within the robot's range of motion; the robot places the target object's arms on the target object's chest; the robot adjusts the target object's legs from a straight state to a bent state; wherein the bent state, the support structure, and the placement of the arms are used to keep the target object stable during the process of adjusting from lying on its back on the first target object to lying on its side on the first target object.
[0089] As an example, the action design needs to take stability into consideration. The elderly's legs need to be kept in a bent state, otherwise they will be unstable when lying on their side. Therefore, when the elderly are in a supine position, the legs should be assisted to bend first. To maintain stability, the robot is required to resist the risk of tipping forward. Therefore, the robot's chassis is extended as far as possible under the bed, as close to the bed as possible, and can be supported against the edge of the bed to prevent tipping when necessary. The action design also needs to take into account spatial interference to avoid the elderly's hands being pressed when they switch from lying on their back to lying on their side. At the beginning (in the supine position), the elderly's hands are assisted to be placed on their chests. The robot's front legs are extended under the bed to increase the support surface and increase stability. Both hospital beds and nursing beds have lower space.
[0090] In step 102, the humanoid component of the robot autonomously and sequentially performs each action in the second action sequence on the target object supported by the first target object to adjust the target object from lying on its side on the first target object to sitting up on the first target object.
[0091] As an example, the second action sequence is used to assist an elderly person to sit up from lying on his side. The elderly person's legs are put down to the side of the bed. The robot supports the elderly person's upper hip with its left hand and the lower shoulder with its right hand. The left hand exerts force to the left and downward, and the right hand exerts force to the left and upward, to change the elderly person from lying on his side to sitting up.
[0092] In some embodiments, see Figure 3CIn step 102, the humanoid component of the robot autonomously and sequentially performs each action in the second action sequence on the target object supported by the first target object, so as to adjust the target object from lying on the first target object to sitting up on the first target object, which can be achieved by Figure 3C Steps 1021 to 1023 are implemented as shown.
[0093] In step 1021 , the first arm of the robot moves to the upper hip area of the target object.
[0094] As an example, when an elderly person is in a side-lying position, the left arm or the right arm of the robot is moved to the upper hip area, that is, the hip area away from the bed.
[0095] In step 1022, the second arm of the robot moves to the underside of the shoulder of the target object.
[0096] As an example, when the elderly is in a side-lying position, the left arm or right arm of the robot is moved to the lower side of the shoulder, that is, the shoulder part close to the bed. The second arm here is an arm different from the first arm. If the first arm is the left arm, the second arm is the right arm, and if the first arm is the right arm, the second arm is the left arm.
[0097] In step 1023, the upper hip of the target object is used as the force point of the first arm of the robot, and the lower shoulder of the target object is used as the force point of the second arm of the robot. The first arm and the second arm exert force on the target object to adjust the target object from lying on its side on the first target object to sitting up on the first target object.
[0098] In some embodiments, the force exerted on the target object by the first arm and the second arm in step 1023 can be achieved by the following technical solution: a force parallel to the plane of the target object's legs and perpendicular to the target object's legs is applied to the upper hip of the target object by the first arm; a force parallel to the plane of the target object's body and perpendicular to the target object's upper limb is applied to the lower side of the target object's shoulder by the second arm.
[0099] As an example, see FIG. 6A to FIG. 6B The core action is as follows: the robot holds the elderly's upper hip with its left hand and the lower shoulder with its right hand, and uses both arms and waist to change the elderly from lying to sitting up. Before completing the action, pay attention to ensure the stability of the elderly to avoid tipping over. During the posture adjustment process, the robot will put the elderly's legs under the bed to keep the elderly's legs stable.
[0100] As an example, a force is applied to the lower side of the shoulder of the target object through the second arm, which is parallel to the target object's body plane and perpendicular to the target object's upper arm. The force here is parallel to the target object's body plane and perpendicular to the target object's upper arm. The force here is used to help the elderly person stand up from a side-lying position to a sitting position. A force is applied to the upper hip of the target object through the first arm, which is parallel to the target object's leg plane and perpendicular to the target object's legs. The force here is parallel to the leg plane and perpendicular to the legs, so that the elderly person can be kept stable. Therefore, the force here actually plays a stabilizing role. The two forces here act simultaneously, so that the elderly person can be helped up and kept stable.
[0101] In step 103, the humanoid component of the robot autonomously and sequentially performs each action in a third action sequence on the target object supported by the first target object, so as to adjust the target object from sitting up on the first target object to sitting up on the second target object.
[0102] As an example, the third action sequence is used to assist an elderly person from a bed to a wheelchair. The robot supports the elderly person's armpits with both arms, lifts the elderly person up, turns on the spot, and places the elderly person on the wheelchair.
[0103] In some embodiments, the humanoid component of the robot autonomously and sequentially performs each action in the third action sequence on the target object supported by the first target object to adjust the target object from sitting up on the first target object to sitting up on a second first target object. Before the target object is not at the edge of the first target object, the following processing is performed: the body of the target object on either side is lifted by the humanoid component of the robot, and the body of the target object on either side is moved toward the edge of the first target object, and the target object is placed on the first target object; the body of the target object on the other side is lifted by the humanoid component of the robot, and the body of the target object on the other side is moved toward the edge of the first target object, and the target object is placed on the first target object.
[0104] As an example, here the fourth action sequence needs to be executed before the third action sequence. The fourth action sequence is used to assist the elderly to move closer to the bedside in a sitting state so as to transfer position: the robot supports the elderly's right hip with its left hand and the elderly's left armpit with its right hand, while exerting upward force to lift the elderly's left half of the body, move forward a short distance, and then put the elderly down. Then switch to the right side to perform a mirror action, and repeat it many times.
[0105] In some embodiments, the target object and the robot are facing each other; the above-mentioned lifting of either side of the target object's body by the humanoid part of the robot can be achieved by the following technical solution: the first arm of the robot is moved to under the buttocks on either side of the target object, wherein the first arm and either side are on the opposite side. Since the robot and the target object are in a face-to-face state, the left arm of the robot is moved to the right armpit of the elderly, or the right arm of the robot is moved to the left armpit of the elderly; the second arm of the robot is moved to the armpit on the other side of the target object; an upward force is applied to the target object by means of the robot's arms and waist to lift either side of the target object's body.
[0106] As an example, see Figure 8 , the robot holds the left side of the elderly under the buttocks with its left hand, and the left side of the elderly under the armpit with its right hand, and lifts the left side of the elderly under the body with the help of its arms and waist, and moves it in front of the elderly and behind the robot, and then puts it down. Then, the robot performs a mirror action, holding the right side of the elderly under the armpit with its left hand, and the left side of the elderly under the armpit with its right hand, and lifts the right side of the elderly under the body with the help of its arms and waist, and moves it in front of the elderly and behind the robot, and then puts it down. Repeat the above actions until the elderly sits on the edge of the bed for the next action.
[0107] In some embodiments, see Figure 3D In step 103, the humanoid component of the robot autonomously and sequentially performs each action in the third action sequence on the target object supported by the first target object, so as to adjust the target object from sitting up on the first target object to sitting up on the second target object, which can be achieved by Figure 3D Steps 1031 to 1033 are shown.
[0108] In step 1031, both arms of the robot move to the armpits of both sides of the target object to lift the target object and leave it from the first target object.
[0109] As an example, the action design needs to take labor saving into consideration. The robot should get as close to the elderly as possible to reduce the lever arm. On the premise of being able to reach the elderly, the robot should reduce the forward tilt of the waist as much as possible. The robot can use both hands to work together to reduce the force of a single hand, and the distance between the points of action of both hands should be as large as possible. Considering the human body structure, the robot's arms should reach as much as possible under the elderly's armpits, so that the elderly can get close to the robot's body and use the front part of the robot's upper arm to exert force, which has a smaller lever arm and a lower load on the robot.
[0110] In step 1032, the robot performs a turning action to place the target object directly above the second target object.
[0111] As an example, the robot only needs to lift the elderly slightly (the lifting distance is less than the first distance threshold, where the first distance threshold is the maximum distance obtained through experiments for the elderly to leave the support of the bed and retain the support of the elderly's legs facing the ground), and then turn to the wheelchair to obtain the support of the wheelchair. The whole action process is short and the load of the robot is low.
[0112] In step 1033, the robot places the target object on the second target object.
[0113] In some embodiments, before executing step 1031, the robot's arms move the second target object to the side of the target object and form a right angle with the target object; the robot stabilizes the second target object so that the second target object is in a stable state.
[0114] As an example, the third action sequence is used to assist the elderly to move from a bed to a wheelchair. The action design needs to take stability into consideration. The initial and final states of the elderly are both stable (sitting position). The stabilization process here is that the robot applies a small inward force to the elderly and a force to hold the robot tightly. The robot should be as close to the elderly as possible to resist the risk of tipping over. The action design needs to take into consideration spatial interference to avoid interference between the elderly's legs and the robot's legs. The robot's outer legs are wider, so the outer legs are in front. While moving forward as close to the elderly as possible, the elderly's legs are placed between the robot's legs. At this time, the elderly's body is basically within the robot's support area, and the risk of tipping over is also low.
[0115] In some embodiments, see Figure 3E , Figure 3E is a flowchart of the robot action processing method provided in the embodiment of the present application, which will be combined with Figure 3E Steps 201 to 202 are shown for illustration. Each of the actions involved in the embodiment of the present application corresponds to a posture change of the target object, and the posture change from the first posture to the second posture is obtained based on multiple posture changes of the action sequence.
[0116] In step 201, the robot moves to a range of motion of the target object, wherein the target object is supported by a target object, and the range of motion is a region in which the robot can perform motion on the target object.
[0117] In step 202, each action in the action sequence is autonomously and sequentially performed on the target object by the humanoid component of the robot, so as to adjust the target object from a first posture to a second posture on the target object.
[0118] The action sequence here can be a first action sequence, a second action sequence, a third action sequence and a fourth action sequence. When the action sequence is the first action sequence, the first posture is that the target object lies on its back on the first target object, and the second posture is that the target object lies on its side on the first target object; the second action sequence can be executed after executing the first action sequence. When the action sequence is the second action sequence, the first posture is that the target object lies on its side on the first target object, and the second posture is that the target object sits up on the first target object; the fourth action sequence can be executed after executing the first action sequence. When the action sequence is the fourth action sequence, the first posture is that the target object sits up on the first target object, and the second posture is that the target object sits up on the edge of the first target object; the third action sequence can be executed after executing the fourth action sequence. When the action sequence is the third action sequence, the first posture is that the target object sits up on the edge of the first target object, and the second posture is that the target object sits up on the second target object.
[0119] Through the humanoid part of the robot, each action in the action sequence is autonomously and sequentially performed on the target object supported by the target object, so as to adjust the target object on the target object from the first posture to the second posture; each action corresponds to a posture change of the target object, and the posture change from the first posture to the second posture is obtained based on multiple posture changes of the action sequence. Through the present application, the posture of the target object can be changed sequentially through the action sequence under the premise of having autonomy, so as to finally complete the adjustment of the target object from the first posture to the second posture. Since the final posture adjustment is achieved based on multiple actions, the convenience and safety of the posture adjustment process can be improved.
[0120] The following is an explanation of an exemplary application of the embodiments of the present application in a practical application scenario.
[0121] When the robot observes a disabled elderly person, the robot collects status data of the disabled elderly person and sends the status data to the server 200. The server 200 recognizes the intention of the disabled elderly person, thereby sensing that the disabled elderly person has the need to transfer from the bed to the wheelchair. The server 200 sends the action execution instructions of the first action sequence, the second action sequence and the third action sequence to the robot, so that the robot autonomously performs each action in the first action sequence on the disabled elderly person supported by the bed in sequence, so as to adjust the disabled elderly person from lying on his back in the bed to lying on his side in the bed; the robot autonomously performs each action in the second action sequence on the disabled elderly person supported by the bed in sequence, so as to adjust the disabled elderly person from lying on his side in the bed to sitting up in the bed; the robot autonomously performs each action in the third action sequence on the disabled elderly person supported by the bed in sequence, so as to adjust the disabled elderly person from sitting up in the bed to sitting up in the wheelchair.
[0122] Human habitation robots are used to assist the elderly in disabled states to transfer from bed to wheelchair in elderly care scenarios. The main action implementation steps include: assisting the elderly from supine to side-lying, from side-lying to sitting up, getting closer to the bedside when sitting up, and from bed to wheelchair. The main action sequence is formulated according to safety, mainly considering three principles: avoiding spatial interference, maintaining stability, and saving effort (minimizing the load borne by the robot, reducing energy consumption, and ensuring safety). According to the principles of stability and effort saving, a large task is completed through a series of simple action sequences, in which each action only slightly changes the posture of the elderly, so as to make full use of the support of the bed, the ground, the wheelchair, etc. Before and after each action, the elderly are in a stable state without external assistance.
[0123] The embodiments of the present application are mainly applicable to the following two categories of elderly people: 1. Elderly people who are slightly weak overall and who only need one caregiver to assist them in completing position transfer, such as elderly people who can sit stably but cannot transfer position independently; 2. Elderly people who are slightly weak on one side of the body and need slight assistance.
[0124] For the above-mentioned applicable elderly people, it is only necessary to provide assistance when transferring positions, and there is no need to bear the entire weight of the elderly. Part of the weight of the elderly is supported by themselves, the ground, the bed, etc., and the load requirements for the robot are relatively low. The usual service robot can meet the needs. In addition, for the same reasons as above, when providing assistance, a series of action sequences are required, in which each action only slightly changes the state of the elderly, so as to make full use of the support of the environment. And in the intervals between actions, the elderly can remain stable, and the robot does not need to provide support all the time. On the contrary, if the goal is achieved by changing the state of the elderly at one time, it is difficult to rely on the environment, and the robot must bear most of the weight of the elderly. General service robots do not have such a high load capacity, and it is not conducive to safety and energy saving.
[0125] Before the main steps are implemented, necessary preparations need to be made, including cleaning the environment, preparing wheelchairs, and properly placing the elderly's limbs before assisting them to transfer positions to ensure safety during the transfer. Disabled elderly people have relatively weak limbs, and changing their postures through their limbs cannot fully control their postures, increasing the risk of sprains. Therefore, the trunk needs to be used to change the elderly's postures.
[0126] The first action sequence is introduced below, which is used to assist the elderly from lying on their back to lying on their side. The elderly are initially lying flat on their back. First, the elderly's legs are straightened to bend their knees upward, and the elderly's arms are placed in front of their chest to avoid being pressed down later. Then, the robot holds the elderly's hips with its left hand and shoulders with its right hand, and the robot exerts force upward and backward to change the elderly from lying to lying on their side.
[0127] The second action sequence is introduced below, which is used to assist the elderly person to sit up from lying on their side. The elderly person's legs are put down on the side of the bed. The robot supports the elderly person's upper hip with its left hand and the lower shoulder with its right hand. The left hand exerts force to the left and downward, and the right hand exerts force to the left and upward, to change the elderly person from lying on his side to sitting up.
[0128] The third action sequence is introduced below, which is used to assist the elderly person to move from a bed to a wheelchair. The robot supports the elderly person's armpits with both arms, lifts the elderly person up, turns on the spot, and places the elderly person on the wheelchair.
[0129] The fourth action sequence is introduced below, which is used to assist the elderly to move closer to the bedside while sitting up, so as to transfer positions: the robot supports the elderly’s right hip with its left hand and the elderly’s left armpit with its right hand, while exerting force upward to lift the elderly’s left half of the body, moving it a short distance forward, and then putting the elderly down. Then the robot switches to the right side to perform a mirror action, and repeats this process multiple times.
[0130] The above action sequence relies on the robot to complete, requiring the robot to have flexible arms (6 degrees of freedom and above), palms, waist, and lower limbs that can ensure stable support and in-situ turning. Robots with these can all be applied to the action processing method provided in the embodiment of the present application. The action processing method provided in the embodiment of the present application mainly focuses on the basic action design under the principle of safety. In the specific robot implementation process, it is necessary to cooperate with the robot's compliant control, the elderly's intention recognition and a complete exception handling safety strategy to further ensure safety.
[0131] The embodiment of the present application adopts a humanoid robot, including a waist, a mechanical arm, a palm, etc., which can realize humanoid movements. General robot equipment can be applied to the motion processing method provided in the embodiment of the present application without special design. In addition to assisting the elderly to transfer positions, the robot can also be used for other service functions, such as delivering items, pushing wheelchairs, assisting walking and going up and down stairs, preparing meals, opening doors, etc. The robot can autonomously complete the task of assisting the elderly to transfer positions without manual intervention or operation.
[0132] The following is a detailed introduction to the design principles of the first action sequence, which is used to assist the elderly from lying on their back to lying on their side. The action design needs to take into account stability. The initial state of the elderly (lying on their back) is stable, and the final state (lying on their side) must also remain stable. The elderly's legs need to be bent, otherwise they will be unstable after lying on their side. Therefore, when the elderly are in the supine state at the beginning, the legs of the elderly are first assisted to bend. To adjust the elderly from lying on their back to lying on their side, the robot needs to apply upward and backward forces to the elderly, and the robot needs to bend forward to operate. In order to maintain stability, the robot is required to be able to resist the risk of tipping forward, so the chassis of the robot is extended as far as possible to extend under the bed, as close to the bed as possible, and can be supported against the edge of the bed to prevent tipping when necessary. In the later stage of the action, when approaching the side, both hands should cooperate to provide reverse force to maintain the stability of the elderly (relatively providing a smaller downward and forward force for the robot), and then let go after the elderly are stable. The action design needs to take into account the need for labor saving. The robot should get as close to the elderly as possible to reduce the force arm. On the premise of being able to reach the elderly, the waist should be tilted forward as little as possible, and the action should be completed by exerting force with the waist. The robot's two hands can cooperate to exert force to reduce the force of a single hand. The distance between the action points of both hands should be as large as possible. Considering the human body structure, it is more appropriate to exert force on the shoulders and hips. The action design also needs to take into account spatial interference to avoid pressing the hands of the elderly when they switch from supine to side-lying. At the beginning (supine state), help the elderly to put their hands on their chests. The robot's front legs extend under the bed to increase the support surface and increase stability. Both hospital beds and nursing beds have lower space.
[0133] The initial state of the first action sequence is that the elderly person is lying on his back on the bed. The robot enters the room and prepares for the following actions: The robot cleans the work space and avoids debris on the bed, on the side of the bed, and between the bed and the wheelchair; see Figure 5A , the robot moves to the bedside, touches the bed to stabilize the robot body and prevent it from leaning forward; puts the elderly's arms on the chest to avoid pressing them, and changes the elderly's legs from straight to bent. FIG. 5B to FIG. 5C The robot leans forward, raises its arms, holds the elderly's hips with its left hand, and holds the elderly's shoulders with its right hand. It uses both arms and waist to change the elderly from a lying position to a side-lying position. Before completing the action, the robot will ensure the stability of the elderly to prevent them from falling. FIG. 5A to FIG. 5C What is shown is just a schematic diagram of the action. In the actual implementation, fine-tuning is required according to the specific shapes of the robot arm and palm.
[0134] The following is a detailed introduction to the design principles of the second action sequence, which is used to assist the elderly from lying on their side to sitting up. The action design needs to take into account stability. The initial state of the elderly (lying on their side) is stable, and the final state (sitting position) is also stable. To adjust the elderly from lying on their side to sitting up, the robot needs to apply an upward and left force, and the robot needs to bend forward (the inclination of the bend is less than the inclination of the bend in the first action sequence). In order to maintain stability, the robot needs to be able to resist the risk of tipping forward and to the right. At the same time, considering that the elderly have an overall leftward offset, the robot faces the elderly to the left in advance, and the chassis is extended as far as possible under the bed, as close to the bed as possible, and the right leg can resist the edge of the bed to avoid tipping forward and to the right. Similarly, in the later stage of the action, both hands should cooperate to provide reverse force to maintain the stability of the elderly (left hand provides right, right hand provides left), and let go after the elderly are stable. The action design needs to consider labor saving. The robot should get as close to the elderly as possible to reduce the force arm. On the premise of being able to reach the elderly, the forward tilt of the waist should be reduced as much as possible. The robot's two hands can cooperate to exert force to reduce the force of a single hand. The distance between the action points of both hands should be as large as possible. Considering the human body structure, it is more appropriate to exert force on the lower shoulder (right hand) and upper hip (left hand). The right hand provides upward and left force, and the left hand provides downward and left force. The action design needs to consider spatial interference to avoid interference between the elderly's legs and the bed when they sit up. Before starting, move the elderly's legs from the bed to outside the edge of the bed and put them down. The robot's front legs extend under the bed to increase the support surface and stability. Both hospital beds and nursing beds have lower space. The robot's standing position needs to be as far to the left as possible but cannot interfere with the elderly's legs in space.
[0135] The initial state of the second action sequence is after the robot completes the first action sequence. The old man is lying on his side in bed, and the robot is beside the bed. FIG. 6A to FIG. 6B The preparatory action is as follows: the robot puts the elderly's legs under the bed. The core action is as follows: the robot holds the elderly's upper hip with its left hand and the lower shoulder with its right hand. Both arms and waist work together to change the elderly from a side-lying position to a sitting position. Before completing the action, pay attention to ensure the stability of the elderly to avoid tipping over.
[0136] The fourth action sequence is described in detail below, which is used to assist the elderly to sit closer to the bedside, in preparation for the next step of transferring the elderly to a wheelchair. Action design needs to consider stability. The elderly’s initial and final states (sitting position) are stable. The robot mainly needs to exert an upward force. To maintain stability, the robot is required to resist the risk of tipping forward. The robot should be as close to the elderly as possible. Action design needs to consider effort saving. The robot should be as close to the elderly as possible to reduce the lever arm. On the premise of being able to reach the elderly, the forward tilt of the waist should be reduced as much as possible. The collaborative force of the robot’s hands can reduce the force of a single hand. The distance between the points of action of both hands should be as large as possible. It only needs to lift half of the elderly’s body and then move a very small distance to the bedside. Therefore, considering the human body structure, force is applied to the armpit and buttocks on the same side, and the robot applies force upward and backward (relative to the robot itself). Action design needs to consider spatial interference to avoid interference between the elderly’s legs and the robot’s legs. See. Figure 4 The robot's outer legs are wider (the distance between the two legs included in the outer legs is greater than the distance between the two legs included in the inner legs). Therefore, the outer legs are in front, moving forward as close to the elderly as possible, while the elderly's legs are in the middle of the robot's legs. At this time, the elderly's body is basically in the robot's support area, and the risk of overturning is also low.
[0137] The initial state of the fourth action sequence is the sitting posture of the old man after the second action sequence is completed, see Figure 8 , the robot holds the left side of the elderly under the buttocks with its left hand, and the left side of the elderly under the armpit with its right hand, and lifts the left side of the elderly under the body with the help of its arms and waist, and moves it in front of the elderly and behind the robot, and then puts it down. Then, the robot performs a mirror action, holding the right side of the elderly under the armpit with its left hand, and the left side of the elderly under the armpit with its right hand, and lifts the right side of the elderly under the body with the help of its arms and waist, and moves it in front of the elderly and behind the robot, and then puts it down. Repeat the above actions until the elderly sits on the edge of the bed for the next action.
[0138] The third action sequence is introduced in detail below. It is used to assist the elderly to move from the bed to the wheelchair. The action design needs to take into account stability. The initial and final states of the elderly are stable (sitting position). The robot mainly needs to apply an upward force, but in order to keep the elderly stable, it also needs to apply a smaller inward force and a force to hold the robot tightly. The robot should be as close to the elderly as possible to resist the risk of tipping forward. The action design needs to take into account effort saving. The robot should be as close to the elderly as possible to reduce the lever arm. On the premise of being able to reach the elderly, the waist should be tilted forward as little as possible. The robot's two-handed collaborative force can reduce the force of a single hand, and the distance between the two hands' points of action should be as large as possible. Considering the human body structure, the robot's arms extend as much as possible to the elderly's armpits, so that the elderly are close to the robot's body, and the robot uses the front of the robot's upper arm to exert force. The force arm is small and the load on the robot is low. In addition, the elderly only need to be slightly lifted up, leaving the support of the bed (retaining the support of the elderly's legs facing the ground), and then turn to the wheelchair to obtain the support of the wheelchair. The whole action process is short and the load on the robot is low. The action design needs to take into account spatial interference to avoid interference between the elderly's legs and the robot's legs. The robot's outer legs are wider, so the outer legs are in front. While moving forward as close to the elderly as possible, the elderly's legs are placed between the robot's legs. At this time, the elderly's body is basically in the robot's support area, and the risk of overturning is also low.
[0139] See also Fig. 7A , the initial state of the third action sequence is that after the second action sequence or the third action sequence is completed, the elderly sit up on the edge of the bed, and the preparation action is as follows: move the wheelchair to the bedside, at a 90-degree angle to the bed, lock the brake, and raise the armrest; see FIG. 7B to FIG. 7C The core action of the third action sequence is as follows: the robot supports the elderly under the armpits on both sides with its arms, lifts the elderly up, and lifts the elderly off the edge of the bed, but the elderly's legs still touch the ground. At this time, the elderly is not completely lifted up. The robot only bears about 70% of the elderly's weight. The robot turns on the spot, moves the elderly above the wheelchair, puts the elderly down, and makes the elderly sit on the wheelchair. Before completing the action, pay attention to ensure the stability of the elderly to avoid tipping over.
[0140] Finally, the elderly is assisted to move closer to the backrest of the wheelchair. The corresponding action sequence is similar to the fourth action sequence, so it will not be repeated here.
[0141] The motion processing method provided in the embodiment of the present application uses a robot to complete a solution for assisting disabled elderly people to transfer positions (from bed to chair). Compared with special beds, wheelchairs, special equipment, etc., the embodiment of the present application is more humane and can provide emotional care. The embodiment of the present application is universal and applicable to other similar robots. The robot may provide other elderly care and home services in addition to assisting transfer. The motion processing method provided in the embodiment of the present application is autonomous and does not require manual operation, which can solve the pain points in elderly care services.
[0142] It is understandable that in the embodiments of the present application, related data such as user information is involved. When the embodiments of the present application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of relevant data need to comply with relevant laws, regulations and standards of relevant countries and regions.
[0143] The following is a description of an exemplary structure of the robot action processing device 255 provided in the embodiment of the present application implemented as a software module. In some embodiments, Figure 2 As shown, the software modules in the action processing device 255 of the robot stored in the memory 250 may include: a first action module, used to autonomously and sequentially perform each action in a first action sequence on a target object supported by a first target object through the humanoid component of the robot, so as to adjust the target object from lying on its back on the first target object to lying on its side on the first target object; a second action module, used to autonomously and sequentially perform each action in a second action sequence on a target object supported by the first target object through the humanoid component of the robot, so as to adjust the target object from lying on its side on the first target object to sitting up on the first target object; a third action module, used to autonomously and sequentially perform each action in a third action sequence on a target object supported by the first target object through the humanoid component of the robot, so as to adjust the target object from sitting up on the first target object to sitting up on the second target object; wherein each of the actions corresponds to a posture change of the target object, and each adjustment of the target object is obtained based on multiple posture changes of the corresponding action sequence.
[0144] In some embodiments, the first action module is also used for: the waist of the robot is tilted in the direction corresponding to the target object so that the target object is within the action range of the robot; the first arm of the robot moves to the hips of the target object, and the second arm of the robot moves upward to the shoulder of the target object; using the hips of the target object as the force point of the first arm of the robot, and the shoulder of the target object as the force point of the second arm of the robot, the target object is exerted with the first arm and the second arm to adjust the target object from lying on its back on the first target object to lying on its side on the first target object.
[0145] In some embodiments, the first action module is further used to: apply a force away from the robot to the target object through the first arm and the second arm to adjust the target object from lying on its back to lying on its side with its back facing the robot; or apply a force toward the robot to the target object through the first arm and the second arm to adjust the target object from lying on its back to lying on its side facing the robot.
[0146] In some embodiments, the first action module is further used to: tilt the waist of the robot toward the direction corresponding to the target object so that before the target object is within the robot's range of action, the robot removes obstacles in the area where the target object is located; straighten the robot's front legs under the first target object to form a support structure; place the arms of the target object on the chest of the target object; adjust the legs of the target object from a straight state to a bent state; wherein the bent state, the support structure and the placement of the arms are used to keep the target object stable during the process of adjusting from lying on its back on the first target object to lying on its side on the first target object.
[0147] In some embodiments, the second action module is also used for: moving the first arm of the robot to the upper hip of the target object; moving the second arm of the robot to the lower side of the shoulder of the target object; using the upper hip of the target object as the force point of the first arm of the robot, and using the lower side of the shoulder of the target object as the force point of the second arm of the robot, and exerting force on the target object through the first arm and the second arm to adjust the target object from lying on its side on the first target object to sitting up on the first target object.
[0148] In some embodiments, the second action module is further used to: apply a force parallel to the plane of the target object's legs and perpendicular to the target object's legs to the upper hip of the target object through the first arm; and apply a force parallel to the plane of the target object's body and perpendicular to the target object's upper limbs to the lower side of the target object's shoulder through the second arm.
[0149] In some embodiments, the third action module is also used to: autonomously and sequentially perform each action in the third action sequence on the target object supported by the first target object through the humanoid component of the robot, so as to adjust the target object from sitting up on the first target object to sitting up on the second first target object, and before the target object is not at the edge of the first target object, perform the following processing: lift the body of the target object on either side through the humanoid component of the robot, and move the body of the target object on either side toward the edge of the first target object, and place the target object on the first target object; lift the body of the target object on the other side through the humanoid component of the robot, and move the body of the target object on the other side toward the edge of the first target object, and place the target object on the first target object.
[0150] In some embodiments, the third action module is also used for: moving the first arm of the robot to under the buttocks on either side of the target object, wherein the first arm and either side are on the opposite side; moving the second arm of the robot to the armpit on the other side of the target object; and applying an upward force to the target object through both arms of the robot to lift the body on either side of the target object.
[0151] In some embodiments, the third action module is also used for: the robot's arms move to the armpits on both sides of the target object respectively to lift the target object and leave it from the first target object; the robot performs a turning action to make the target object directly above the second target object; the robot places the target object on the second target object.
[0152] In some embodiments, the third action module is also used for: the robot's arms move the second target object to the side of the target object and form a right angle with the target object; the robot stabilizes the second target object so that the second target object is in a stable state.
[0153] In some embodiments, a robot motion processing device includes: a moving module, used to move the robot to the motion range of the target object, wherein the target object is supported by the target object, and the motion range is the area range where the robot can perform actions on the target object; a fourth action module, used to autonomously and sequentially perform each action in an action sequence on the target object supported by the target object through the humanoid component of the robot, so as to adjust the target object on the target object from a first posture to a second posture; wherein each of the actions corresponds to a posture change of the target object, and the posture change from the first posture to the second posture is obtained based on multiple posture changes of the action sequence.
[0154] An embodiment of the present application provides a robot, comprising: a humanoid component and a controller; the controller is used to control the humanoid component to execute the robot action processing method described above in the embodiment of the present application.
[0155] An embodiment of the present application provides an electronic device for controlling a robot, characterized in that a memory is used to store computer-executable instructions; and a processor is used to control the robot to execute the robot action processing method described above in the embodiment of the present application when executing the computer-executable instructions stored in the memory.
[0156] The embodiment of the present application provides a computer program product, which includes computer executable instructions, which are stored in a computer-readable storage medium. The processor of the electronic device that controls the robot reads the computer executable instructions from the computer-readable storage medium, and the processor executes the computer executable instructions, so that the electronic device that controls the robot executes the robot action processing method described in the embodiment of the present application.
[0157] The present application embodiment provides a computer-readable storage medium storing computer-executable instructions, wherein the computer-executable instructions are stored. When the computer-executable instructions are executed by a processor, the processor will cause the processor to execute the robot action processing method provided by the present application embodiment, for example, FIG. 3A to FIG. 3E The robot's action processing method is shown.
[0158] In some embodiments, the computer-readable storage medium may be a memory such as FRAM, ROM, PROM, EP ROM, EEPROM, flash memory, magnetic surface storage, optical disk, or CD-ROM; or it may be various devices including one or any combination of the above memories.
[0159] In some embodiments, computer executable instructions may be in the form of a program, software, software module, script or code, written in any form of programming language (including compiled or interpreted languages, or declarative or procedural languages), and may be deployed in any form, including as a stand-alone program or as a module, component, subroutine or other unit suitable for use in a computing environment.
[0160] As an example, computer-executable instructions may, but need not, correspond to a file in a file system, may be stored as part of a file storing other programs or data, such as in one or more scripts in a HyperText Markup Language (HTML) document, in a single file dedicated to the program in question, or in multiple coordinated files (e.g., files storing one or more modules, subroutines, or code portions).
[0161] As an example, computer executable instructions may be deployed to be executed on one electronic device for controlling a robot, or on multiple electronic devices for controlling a robot located at one location, or on multiple electronic devices for controlling a robot distributed at multiple locations and interconnected by a communication network.
[0162] In summary, through the humanoid component of the robot, each action in the action sequence is autonomously and sequentially performed on the target object supported by the target object, so as to adjust the target object on the target object from the first posture to the second posture; each action corresponds to a posture change of the target object, and the posture change from the first posture to the second posture is obtained based on multiple posture changes of the action sequence. Through the present application, the posture of the target object can be changed sequentially through the action sequence under the premise of having autonomy, so as to finally complete the adjustment of the target object from the first posture to the second posture. Since the final posture adjustment is achieved based on multiple actions, the convenience and safety of the posture adjustment process can be improved.
[0163] The above is only an embodiment of the present application and is not intended to limit the protection scope of the present application. Any modifications, equivalent substitutions and improvements made within the spirit and scope of the present application are included in the protection scope of the present application.
Claims
1. A robot motion processing method, characterized in that: The method comprises: By means of the humanoid component of the robot, each action in a first action sequence is autonomously performed in sequence on a target object supported by a first target object, so as to adjust the target object from lying supinely on the first target object to lying sideways on the first target object; By means of the humanoid component of the robot, each action in a second action sequence is autonomously performed in sequence on the target object supported by the first target object, so as to adjust the target object from lying sideways on the first target object to sitting up on the first target object; By means of the humanoid component of the robot, each action in a third action sequence is autonomously and sequentially performed on the target object supported by the first target object, so as to adjust the target object from sitting up on the first target object to sitting up on the second target object; The second target object is an object different from the first target object, each of the actions corresponds to a posture change of the target object, and each adjustment of the target object is obtained based on multiple posture changes of the corresponding action sequence.
2. The method according to claim 1, characterized in that The method of autonomously and sequentially performing each action in a first action sequence on a target object supported by a first target object by means of the humanoid component of the robot, so as to adjust the target object from lying supinely on the first target object to lying sideways on the first target object, comprises: The waist of the robot is tilted toward the direction corresponding to the target object so that the target object is within the action range of the robot; The first arm of the robot moves to the hip of the target object, and the second arm of the robot moves upward to the shoulder of the target object; The buttocks of the target object are used as the force point of the first arm of the robot, and the shoulder of the target object is used as the force point of the second arm of the robot. The first arm and the second arm are used to exert force on the target object to adjust the target object from lying on its back on the first target object to lying on its side on the first target object.
3. The method according to claim 2, characterized in that The step of applying force to the target object by using the first arm and the second arm to adjust the target object from lying supinely on the first target object to lying sideways on the first target object includes: Applying a force to the target object away from the robot by the first arm and the second arm to adjust the target object from lying on its back to lying on its side with its back facing the robot; or A force acting on the target object toward the robot is applied by the first arm and the second arm to adjust the target object from lying on its back to lying on its side facing the robot.
4. The method according to claim 2, characterized in that: Before the waist of the robot is tilted toward the direction corresponding to the target object so that the target object is within the action range of the robot, the method further includes: The robot removes obstacles in the area where the target object is located; The front legs of the robot are extended below the first target object to form a support structure; The robot places both arms of the target object on the chest of the target object; The robot adjusts the legs of the target object from a straight state to a bent state; The bent state, the support structure, and the placement of the two arms are used to keep the target object stable during the process of adjusting from lying supinely on the first target object to lying sideways on the first target object.
5. The method according to claim 1, characterized in that The method of autonomously and sequentially performing each action in a second action sequence on a target object supported by the first target object by the humanoid component of the robot, so as to adjust the target object from lying sideways on the first target object to sitting up on the first target object, comprises: The first arm of the robot moves to the upper hip of the target object; The second arm of the robot moves to the underside of the shoulder of the target object; The upper hip of the target object is used as the force point of the first arm of the robot, and the lower side of the shoulder of the target object is used as the force point of the second arm of the robot. The first arm and the second arm exert force on the target object to adjust the target object from lying on its side on the first target object to sitting up on the first target object.
6. The method according to claim 5, characterized in that The applying force to the target object by using the first arm and the second arm includes: Applying a force parallel to the plane of the legs of the target object and perpendicular to the legs of the target object to the upper hip of the target object through the first arm; A force parallel to the target object's body plane and perpendicular to the target object's upper arm is applied to the lower side of the target object's shoulder through the second arm.
7. The method according to claim 1, characterized in that The method further comprises: autonomously and sequentially performing each action in a third action sequence on the target object supported by the first target object by the humanoid component of the robot, so as to adjust the target object from sitting up on the first target object to sitting up on a second first target object; When the target object is not at the edge of the first target object, the following processing is performed: Lifting the body of the target object on either side by using the humanoid component of the robot, and moving the body of the target object on either side toward the edge of the first target object, so as to place the target object on the first target object; The body on the other side of the target object is lifted by the humanoid component of the robot, and the body on the other side of the target object is moved toward the edge of the first target object, so that the target object is placed on the first target object.
8. The method according to claim 7, characterized in that The target object and the robot are facing each other; and the humanoid component of the robot is used to lift the body of the target object on either side, including: The first arm of the robot moves to under the buttocks of either side of the target object, wherein the first arm and the either side are on the opposite side; The second arm of the robot moves to the armpit on the other side of the target object; An upward force is applied to the target object by the double arms of the robot to lift the body on either side of the target object.
9. The method according to claim 1, characterized in that: The method of autonomously and sequentially performing each action in a third action sequence on the target object supported by the first target object by the humanoid component of the robot, so as to adjust the target object from sitting up on the first target object to sitting up on the second target object, comprises: The two arms of the robot move to the armpits of both sides of the target object respectively to lift the target object and leave the first target object; The robot performs a turning action so that the target object is directly above the second target object; The robot places the target object at the second target object.
10. The method according to claim 9, characterized in that The method further comprises: The double arms of the robot move the second target object to the side of the target object and form a right angle with the target object; The robot performs stabilization processing on the second target object so that the second target object is in a stable state.
11. A robot motion processing method, characterized in that: The method comprises: The robot moves to the action range of the target object, wherein the target object is supported by a target object, and the action range is the area in which the robot can perform actions on the target object; autonomously and sequentially performing each action in the action sequence on the target object through the humanoid component of the robot to adjust the target object from a first posture to a second posture on the target object; Each of the actions corresponds to a posture change of the target object, and the posture change from the first posture to the second posture is obtained based on multiple posture changes of the action sequence.
12. A robot motion processing device, characterized in that: The device comprises: A moving module, used for moving the robot to within the action range of the target object, wherein the target object is supported by a target object, and the action range is an area range in which the robot can perform actions on the target object; a fourth action module, configured to autonomously and sequentially perform each action in the action sequence on the target object supported by the target object through the humanoid component of the robot, so as to adjust the target object on the target object from the first posture to the second posture; Each of the actions corresponds to a posture change of the target object, and the posture change from the first posture to the second posture is obtained based on multiple posture changes of the action sequence.
13. A robot motion processing device, characterized in that: The device comprises: a first action module, configured to autonomously and sequentially perform each action in a first action sequence on a target object supported by a first target object through a humanoid component of the robot, so as to adjust the target object from lying supinely on the first target object to lying sideways on the first target object; a second action module, configured to autonomously and sequentially perform each action in a second action sequence on a target object supported by the first target object through the humanoid component of the robot, so as to adjust the target object from lying sideways on the first target object to sitting up on the first target object; a third action module, configured to autonomously and sequentially perform each action in a third action sequence on a target object supported by the first target object through the humanoid component of the robot, so as to adjust the target object from sitting up on the first target object to sitting up on the second target object; The second target object is an object different from the first target object, each of the actions corresponds to a posture change of the target object, and each adjustment of the target object is obtained based on multiple posture changes of the corresponding action sequence.
14. A robot, characterized in that: The robot comprises: a humanoid component and a controller; A controller is used to control the humanoid component to execute the robot action processing method according to any one of claims 1 to 10 or claim 11.
15. An electronic device for controlling a robot, characterized in that: The electronic device comprises: A memory for storing computer executable instructions; A processor is used to control the robot to implement the robot action processing method according to any one of claims 1 to 10 or claim 11 when executing the computer executable instructions stored in the memory.
16. A computer-readable storage medium storing computer-executable instructions, characterized in that: When the computer executable instructions are executed by a processor, the action processing method of the robot according to any one of claims 1 to 10 or claim 11 is implemented.
17. A computer program product comprising computer executable instructions, characterized in that: When the computer executable instructions are executed by a processor, the action processing method of the robot according to any one of claims 1 to 10 or claim 11 is implemented.
Citation Information
Patent Citations
Patient repositioning system
CN104582662A
Nursing robot
CN109397245A
Robot for moving patient
CN110394816A
Transfer nursing device
CN114795750A
Method of and apparatus for assisting persons from a lying position to a sitting position and a sitting position to a lying position
US10226393B1
