Guide dog robot for the visually impaired and method for controlling thereof

The guide dog robot system with a harness, spring damper, and IMUs provides stable control and intuitive interaction, addressing the instability and discomfort issues in existing robots, ensuring safe navigation for visually impaired users.

KR103044753B1Active Publication Date: 2026-11-10ELECTRONICS & TELECOMM RES INST
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
KR1020240042618
Authority / Receiving Office
KR · KR
Patent Type
Patents
Current Assignee / Owner
Filing Date
2024-03-28
Publication Date
2026-11-10
Estimated Expiration
2044-03-28

AI Technical Summary

Technical Problem

Existing guide dog robots face issues with unstable control due to reduced mechanical component lifespan and lack of precision in harnesses, leading to discomfort and difficulty in intuitive interaction with visually impaired users.

Method used

A guide dog robot system incorporating a harness portion, spring damper portion, and main body portion with IMUs to measure position and velocity, allowing for stable control and intuitive interaction through a spring damper mechanism that transmits external forces smoothly.

Benefits of technology

Enables stable and intuitive interaction between the visually impaired user and the guide dog robot, reducing wrist burden and ensuring safe navigation by minimizing instability during walking.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure R1020240042618_ABST
    Figure R1020240042618_ABST
Patent Text Reader

Abstract

A guide dog robot for the visually impaired is provided. The guide dog robot comprises a harness portion held by the visually impaired person, a spring damper portion connected to the harness portion and moving in a predetermined axial direction in response to an external force acting between the visually impaired person and the guide dog robot, and a main body portion mounted on the upper surface of the spring damper portion and performing movement according to the visually impaired person's movement intention and the guide dog robot's movement motion, wherein the harness portion, the spring damper portion, and the main body portion each include an IMU, and the IMU measures the position and velocity at the respective mounted position.
Need to check novelty before this filing date? Find Prior Art

Description

Technology Field

[0001] The present invention relates to a guide dog robot for the visually impaired and a method for controlling the same. Background Technology

[0002] Guide dogs play an essential role as assistants for the visually impaired. However, the reality is that there are many difficulties in the training and adoption processes of guide dogs.

[0003] Under these circumstances, research on guide dog robots is becoming active due to recent advancements in quadruped robot technology. Such guide dog robots must be able to maintain stable control through a harness, understand the user's intentions, and guide safely.

[0004] However, guide dog robots currently under development or research suffer from issues such as reduced lifespan of mechanical components due to the lack of precision and robustness in their harnesses; therefore, there is a need to research and develop guide dog robot technology incorporating new harness technology for the visually impaired. Prior art literature

[0005] Published Patent Application No. 10-2020-0081172 (July 7, 2020) The problem to be solved

[0006] The problem that the present invention aims to solve is to provide a guide dog robot for the visually impaired and a control method thereof, which can secure stable control against external forces while simultaneously providing intuitive interaction with the guide dog robot to the visually impaired person, for a guide dog robot capable of safely guiding the visually impaired person.

[0007] However, the problems that the present invention aims to solve are not limited to those described above, and other problems may exist. means of solving the problem

[0008] A guide dog robot for the visually impaired according to the first aspect of the present invention for solving the above-mentioned problem comprises a harness portion held by the visually impaired person, a spring damper portion connected to the harness portion and moving in a predetermined axial direction in response to an external force acting between the visually impaired person and the guide dog robot, and a main body portion mounted on the upper surface of the spring damper portion and performing movement according to the visually impaired person's movement intention and the guide dog robot's movement motion. At this time, the harness portion, the spring damper portion, and the main body portion each include an IMU, and the IMU measures the position and velocity at the respective mounted positions.

[0009] In addition, a control method for a guide dog robot for a visually impaired person according to a second aspect of the present invention comprises: a step of moving a spring damper part connected to a harness part held by a visually impaired person in a predetermined axial direction in response to an external force acting between the visually impaired person and the guide dog robot; a step of sensing the position and velocity at the mounted position in an IMU each included in the harness part, the spring damper part, and the main body part on which the spring damper part is mounted on the upper surface; and a step of performing movement in the main body part according to the moving intention of the visually impaired person and the moving motion of the guide dog robot based on the sensed position and velocity.

[0010] In addition, a guide dog robot for a visually impaired person according to the third aspect of the present invention includes a communication module that receives sensing data from an IMU, each comprising a harness part held by a visually impaired person, a spring damper part connected to the harness part, and a main body part on which the spring damper part is installed on the upper surface; a memory in which a program for performing movement of the guide dog robot based on the sensing data is stored; and a processor that, by executing the program stored in the memory, acquires a position and velocity at a mounted position based on the sensing data from the IMUs as the spring damper part moves in a predetermined axial direction in response to an external force acting between the visually impaired person and the guide dog robot, and controls movement according to the movement intention of the visually impaired person and the movement motion of the guide dog robot based on the position and velocity.

[0011] A computer program according to another aspect of the present invention for solving the above-described problem implements a guide dog robot for the visually impaired and a method for controlling the same, and is stored in a computer-readable recording medium.

[0012] Other specific details of the present invention are included in the detailed description and drawings. Effects of the invention

[0013] According to one embodiment of the present invention described above, the interaction between a guide dog robot and a visually impaired person can be optimized to avoid T-walking obstacles and enable safe movement.

[0014] One embodiment of the present invention enables a guide dog robot to intuitively understand the movement intentions of a visually impaired person through physical interaction via a harness and position and velocity measurement via an IMU, thereby allowing the guide dog robot to quickly understand the commands of the visually impaired person and guide the walking path along a planned path.

[0015] In addition, by stably transmitting external forces through the harness, the burden on the wrists and arms of the visually impaired can be reduced, allowing them to operate the guide dog robot more comfortably and focus on navigation.

[0016] In addition, stable control can be enabled by transmitting stable interaction forces to the guide dog robot through a harness and spring dampers. This minimizes instability that may occur during walking and ensures the safety of visually impaired people.

[0017] The effects of the present invention are not limited to those mentioned above, and other unmentioned effects will be clearly understood by a person skilled in the art from the description below. Brief explanation of the drawing

[0018] FIG. 1 is a block diagram of a guide dog robot for the visually impaired according to one embodiment of the present invention. FIG. 2 is a diagram illustrating the positional relationship of each component of a guide dog robot for the visually impaired according to one embodiment of the present invention. FIGS. 3a and FIGS. 3b are drawings illustrating an example of a spring damper part in an embodiment of the present invention. FIG. 4 is a diagram illustrating a mass-spring-damper model in one embodiment of the present invention. FIG. 5 is a diagram illustrating a method for collecting a dataset for a harness part and a spring damper part in one embodiment of the present invention. FIG. 6 is a drawing showing the configuration of the main body part according to one embodiment of the present invention. FIG. 7 is a flowchart of a control method for a guide dog robot for the visually impaired according to an embodiment of the present invention. Specific details for implementing the invention

[0019] The advantages and features of the present invention and the methods for achieving them will become clear by referring to the embodiments described below in detail together with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below but may be implemented in various different forms. These embodiments are provided merely to ensure that the disclosure of the present invention is complete and to fully inform those skilled in the art of the scope of the present invention, and the present invention is defined only by the scope of the claims.

[0020] The terms used in this specification are for describing embodiments and are not intended to limit the invention. In this specification, the singular form includes the plural form unless specifically stated otherwise in the text. The terms "comprises" and / or "comprising" used in this specification do not exclude the presence or addition of one or more other components in addition to the components mentioned. Throughout the specification, the same reference numerals refer to the same components, and "and / or" includes each of the mentioned components and all combinations of one or more. Although terms such as "first," "second," etc., are used to describe various components, these components are not limited by these terms. These terms are used merely to distinguish one component from another. Therefore, the first component mentioned below may be the second component within the technical scope of the invention.

[0021] Unless otherwise defined, all terms used herein (including technical and scientific terms) may be used in a meaning commonly understood by those skilled in the art to which the present invention pertains. Furthermore, terms defined in commonly used dictionaries are not to be interpreted ideally or excessively unless explicitly and specifically defined otherwise.

[0022] In the following, the background of the invention will be explained to assist those skilled in the art in understanding.

[0023] With the recent advancement of guide dog robot technology, active research is being conducted on guidance systems utilizing quadruped robots to replace or complement guide dogs. These systems assist in safe and efficient movement through intuitive and stable interaction with the visually impaired, and the harness plays an important role.

[0024] Guide dog robots must maintain stable control with the user through a harness and adjust their direction and speed of movement by understanding the user's intentions. For example, it is essential to quickly identify the user's movement intentions to maintain a constant distance between the user and the guide dog robot and to change their mutual formation.

[0025] Meanwhile, in the case of conventional guide dog robots, if they recognize the user's intention by receiving left and right commands via buttons, the robot is only capable of vertical or directional changes at a certain angle; and since it is impossible to provide visual feedback to the visually impaired, there is no way to verify how far the guide dog robot has changed its movement.

[0026] In addition, with existing harness structures, if a sturdy harness used by actual guide dogs is directly connected to the robot, there is a concern that the control of the guide dog robot may become unstable because the visually impaired person may directly apply sudden external force to the guide dog robot. Furthermore, changes in the movement of the guide dog robot are directly transmitted to the visually impaired person's wrist, which may cause discomfort to the visually impaired person.

[0027] When a harness is loosely connected to a visually impaired person via a leash-like strap or pole, the lack of a direct, strong response means the visually impaired person must delicately perceive the guide dog robot's movements through the wire or pole. This requires a high level of concentration from the visually impaired person and can hinder orientation. Furthermore, it becomes difficult for the visually impaired person to perceive the robot's motion of avoiding obstacles ahead, which may result in a disruption of the mobility capabilities the robot is supposed to provide. Additionally, since the visually impaired person cannot physically give control commands for omnidirectional movement to the guide dog robot, non-intuitive control methods are utilized, requiring additional interaction media such as buttons.

[0028] Finally, a harness configured using a motor mechanism equipped with an encoder can quickly grasp the motion of the guide dog robot and the intentions of the visually impaired person and smoothly convey them through a haptic device capable of 6-axis control, but this may lead to high power consumption and place an excessive load on the guide dog robot. In addition, there is a problem that the lifespan of the motor and mechanism may be shortened due to continuous external forces, requiring continuous maintenance.

[0029] To resolve these problems, a guide dog robot for the visually impaired and a control method thereof according to one embodiment of the present invention additionally install a spring damper portion between the main body portion and the harness portion of the guide dog robot, thereby enabling the external force corresponding to the visually impaired person's movement intention and the guide dog robot's movement motion to be transmitted smoothly and immediately to the guide dog robot. In addition, the force transmitted to the visually impaired person due to the sudden motion of the guide dog robot can be applied smoothly and immediately.

[0030] In addition, one embodiment of the present invention installs an IMU in each of the harness part, the spring damper part, and the main body part and measures the relative change between them, thereby enabling the visual impaired person and the guide dog robot to immediately recognize relative motion changes caused by the external force applied by the visual impaired person and the external force applied by the guide dog robot, and to maintain stable movement by transmitting smooth and immediate force to each other.

[0031] Hereinafter, a guide dog robot for the visually impaired (100, hereinafter also referred to as a guide dog robot) according to one embodiment of the present invention will be described with reference to FIGS. 1 to 6.

[0032] FIG. 1 is a block diagram of a guide dog robot (100) for the visually impaired according to one embodiment of the present invention. FIG. 2 is a diagram for explaining the positional relationship of each component of a guide dog robot (100) for the visually impaired according to one embodiment of the present invention.

[0033] A guide dog robot (100) according to one embodiment of the present invention includes a harness part (110), a spring damper part (120), and a main body part (130).

[0034] The harness portion (110) is an area that is grasped by a visually impaired person, and the harness portion (110) includes a 6-axis IMU (hereinafter referred to as the first IMU, 111). The harness portion (110) can measure the position and speed in the area grasped by the user.

[0035] The spring damper part (120) is connected to the harness part (110). At this time, the harness part (110) can be configured to allow free movement to a certain degree through the spring damper and a ring or a hinge structure that can rotate in the forward and backward directions.

[0036] The spring damper part (120) having such a structure moves in a predetermined axial direction in response to an external force acting between the visually impaired person and the guide dog robot (100). FIGS. 3a and 3b are drawings illustrating an example of a spring damper part (120-1, 120-2) in an embodiment of the present invention.

[0037] In one embodiment, the spring damper section (120) may be composed of a 6-axis spring damper that performs the function of a spring damper in the linear direction of the x-axis, y-axis, and z-axis and in the rotational direction. For example, one embodiment of the present invention may be designed to utilize a vibration isolator form as a 6-axis spring damper. This structure may be implemented using a vibration isolator made of an elastic material such as rubber.

[0038] At this time, the spring damper part (120) must be designed to accommodate the relative available displacement between the visually impaired person and the guide dog robot (100). That is, when movement occurs between the guide dog robot (100) and the visually impaired person, the spring damper part (120) must be configured to provide appropriate elasticity to maintain an appropriate distance and to absorb shocks within a certain range.

[0039] Additionally, the spring damper unit (120) is fixedly mounted on the upper surface of the main body (130), and a 6-axis IMU (hereinafter referred to as the second IMU, 121) is installed on the upper surface of the spring damper unit (120). Accordingly, the spring damper unit (120) can measure the position and velocity on the upper surface of the spring damper unit (120).

[0040] The main body (130) has a spring damper (120) mounted on its upper surface to perform movement according to the movement intention of a visually impaired person and the movement motion of the guide dog robot (100). A 6-axis IMU (hereinafter referred to as the third IMU, 131) is installed on the upper back plate of the main body (130). Accordingly, the main body (130) can measure the position and speed of the guide dog robot (100) on the upper surface of the main body (130). Meanwhile, the main body (130) may include detailed configurations for controlling the movement of the guide dog robot (100) by collecting sensing data from each IMU (111, 121, 131) as described below.

[0041] In one embodiment, the main body (130) can obtain the direction and position of a visually impaired person's wrist from the back of the guide dog robot (100) through the relative position between the first and third IMUs (111, 131) calculated based on the respective position and velocity measured by the first IMU (111) and the third IMU (131). That is, the main body (130) can calculate the relative distance and relative direction between the two IMUs (111, 131) based on the position data and velocity data of the first and third IMUs (111, 131) measured in real time. And based on the relative distance and direction, the direction and position of the visually impaired person's wrist from the guide dog robot (100) can be obtained.

[0042] However, the 6-axis spring damper unit (120) for reducing the burden on the wrist of the visually impaired person and dampening external forces acting directly on the robot is mounted between the main body unit (130) and the harness unit (110), so the force acting between the guide dog robot (100) and the visually impaired person cannot be directly calculated through relative positions.

[0043] Accordingly, in one embodiment of the present invention, the relative force resulting from the movement intention of a visually impaired person or the movement motion of a guide dog robot (100), expressed as an interaction force, can be modeled using a mass-spring-damper model so as to be expressed as a relationship for displacement, velocity, and acceleration with respect to 6 axes.

[0044] FIG. 4 is a diagram illustrating a mass-spring-damper model in one embodiment of the present invention.

[0045] Specifically, the first mass-spring-damper model is set for each axis between the harness part (110) and the spring damper part (120) and calculates the first interaction force between the harness part (110) and the spring damper part (120).

[0046] Additionally, the second mass-spring-damper model is set for each axis between the spring damper part (120) and the main body part (130) and calculates the second interaction force between the spring damper part (120) and the main body part (130).

[0047] In this case, the mass-spring-damper model can be formulated as shown in Equation 1 below. In Equation 1 represents mass, and represents the spring coefficient, and represents the damper coefficient.

[0048] [Equation 1]

[0049]

[0050] In one embodiment, the main body (130) can set a second mass-spring-damper model for each of the six axes (linear directions of the x, y, and z axes and rotational directions of the x, y, and z axes) between the spring damper part (120) and the main body (130).

[0051] Additionally, the main body (130) is capable of free movement for six axes between the harness part (110) and the spring damper part (120), so if there is an axis where spring damper action does not occur in the spring damper part (120), a first mass-spring-damper model can be set for the remaining axes excluding that axis.

[0052] In particular, the main body (130) can be configured to include a first mass-spring-damper model such that the spring damper action in the spring damper part (120), which acts when the harness part (110) is twisted in a specific direction, occurs.

[0053] Since the relative position, velocity, and acceleration for each axis of the harness part (110) and the spring damper part (120), and the spring damper part (120) and the main body part (130) can be obtained through relative measurements between the first to third IMUs (111, 121, 131), in order to complete the setting of the first and second mass-spring-damper models, the coefficients for the first and second mass-spring-damper models must be calculated. Once the calculation of these coefficients is completed, the first and second interaction forces for each axis can be calculated through the first and second mass-spring-damper models.

[0054] Meanwhile, the first and second interaction forces regarding the relative position, velocity, and acceleration between the harness part (110)-spring damper part (120) and the spring damper part (120)-body part (130) can be modeled as first and second mass-spring-damper models with different coefficients for each axis. However, the same coefficient may be used for axes having the same spring-damper properties. For example, in the case of the spring damper shown in FIGS. 3a and 3b, the linear direction and rotational direction with respect to the x-axis and y-axis of the spring damper part (120)-body part (130) have the same coefficient.

[0055] FIG. 5 is a diagram illustrating a method for collecting a dataset for a harness part (110) and a spring damper part (120) in one embodiment of the present invention.

[0056] To calculate the coefficients of the first and second mass-spring damper models for each axis, additional IMUs (201, 202) in addition to the first and second IMUs (111, 121) can be installed on a fixed rigid body for the harness part (110) and the spring damper part (120), respectively, as shown in FIG. 5. At this time, the harness part (110) and the spring damper part (120) are mounted in the same manner as they are mounted on the actual guide dog robot (100). Next, a data set regarding relative position, velocity, acceleration, and force is collected using a force or torque sensor (200) at another point of the spring damper part (120) to be measured.

[0057] mass-spring-damper model for each axis Coefficients can be obtained through machine learning techniques. That is, the collected dataset of relative position, velocity, acceleration, and force can be approximated to the measurements of the dataset through regression analysis using machine learning techniques.

[0058] At this time, regression analysis can be performed using a Single Layer Perceptron (SLP) model, and the SLP model can perform regression analysis for each axis through the collected dataset by creating a neural network structure in which each coefficient is a weight of one node.

[0059] In one embodiment, the main body (130) can calculate the total interaction force for performing movement according to the movement intention of a visually impaired person and the movement motion of a guide dog robot (100) through the vector sum of the first interaction force and the second interaction force based on the point of application of the force set when collecting the dataset for setting the first and second mass-spring-damper models.

[0060] That is, after calculating the first interaction force calculated by the first mass-spring-damper model between the main body (130), the harness (110), and the spring damper (120), and the second interaction force calculated by the second mass-spring-damper model between the spring damper (120) and the main body (130), the point of application of each interaction force can be set to the point where the force and torque sensor (200) is installed when collecting the data set, thereby fusing the first and second interaction forces. The first and second interaction forces are converted into a total interaction force that acts directly on the guide dog robot (100) and the visually impaired person through fusion using vector sum for all axes as in Equation 2.

[0061] [Equation 2]

[0062]

[0063] In this way, through the spring damper part (120) additionally provided in one embodiment of the present invention, a visually impaired person can safely and smoothly perceive changes in the relative position and direction of the guide dog robot (100) with the total interaction force. In addition, the visually impaired person's intention to move can be stably transmitted to the guide dog robot (100), and accordingly, the guide dog robot (100) can perceive the visually impaired person's relative position, speed, and acceleration, calculate the force to be applied, and utilize this as a measurement value for stable feedback control.

[0064] Meanwhile, in one embodiment of the present invention, the main body (130) converts the calculated total interaction force into a center of gravity external force based on the center of gravity of the guide dog robot (100), and can compensate for the control input for each joint of the guide dog robot (100) based on the center of gravity external force.

[0065] That is, the four-legged walking robot, which is a guide dog robot (100), needs to incorporate interaction forces into the four-legged walking control system to prevent deviation from the path, unstable walking, or overturning caused by external forces acting on the visually impaired person.

[0066] To this end, one embodiment of the present invention is the total interaction force External force on the center of gravity of a quadruped robot for impedance control By converting and utilizing it to compensate for control inputs for each joint through a quadruped walking robot system, stable control is made possible without deviating from the existing movement path even when external forces are applied by a visually impaired person.

[0067] In this embodiment of the present invention, when a visually impaired person is in charge of orientation (finding a way, navigation) and a guide dog robot (100) is in charge of mobility (obstacle avoidance, path-following movement), the visually impaired person must be able to issue a direction change command to the guide dog robot (100). To achieve this, the spring damper part (120) and the harness part (110) can be utilized simultaneously to minimize the external force acting on the guide dog robot (100). By doing so, the guide dog robot (100) can be stably controlled and can follow and move in the direction intended by the visually impaired person.

[0068] Furthermore, in one embodiment of the present invention, curvature information of the road being moved may be further reflected when calculating at least one of the first and second interaction forces. For example, if map information is provided in advance, when it is determined that the current location is a curved road, curvature information for the current curved road can be calculated based on the map information. The calculated curvature information can then be reflected in the interaction force.

[0069] In contrast, if there is no map information in advance, the amount of change in interaction force when moving on a curved road can be calculated to determine whether it is a curved road. And if it is determined that it is a curved road, the curvature information of the curved road is calculated and reflected in the interaction force, thereby allowing the movement motion of the guide dog robot (100) to be controlled more accurately.

[0070] Meanwhile, it goes without saying that additional sensing information, such as a camera and lidar equipped in the guide dog robot (100), can be used to estimate curvature information.

[0071] In addition, one embodiment of the present invention measures and stores the distance between a guide dog robot (100) and a visually impaired person, and measures the relative position that allows for the most stable guidance based on the measured distance and provides it to the visually impaired person in the form of a notification. That is, notifications are provided when the distance becomes closer than or equal to a preset first threshold and when the distance becomes farther than or equal to a second threshold, thereby enabling the visually impaired person to maintain a distance from the guide dog robot (100) between the first and second thresholds.

[0072] In addition, one embodiment of the present invention may form a first bounding box for the guide dog robot (100) and a second bounding box for the visually impaired person based on position information measured by the first to third IMUs (111, 121, 131), and the guide dog robot (100) may guide the visually impaired person by considering each bounding box area. Basically, when the guide dog robot (100) generates a path plan for guidance or performs obstacle avoidance, it generates a path centered on the guide dog robot (100) to provide guidance. In this case, if the visually impaired person is positioned diagonally or otherwise rather than in a straight line with the guide dog robot (100), there is a risk of colliding with other obstacles. To resolve this problem, one embodiment of the present invention may generate a first and second bounding box, respectively, and generate a path that encompasses the first and second bounding boxes. For example, a path can be generated based on the centers of the first and second bounding boxes, and if located diagonally, the areas of the first and second bounding boxes perpendicular to the overlapping current road can be reconstructed, and a path can be generated based on the center of the entire reconstructed bounding box.

[0073] FIG. 6 is a diagram showing the configuration of a main body part (130) according to one embodiment of the present invention.

[0074] A main body (130) according to one embodiment of the present invention may be composed of a computing device (200). The computing device (200) may include at least one of a processor (210) communicating via a bus (220), a memory (230), a user interface input device (240, or input unit), a user interface output device (250), and a storage device (260). The computing device (200) may also include a network interface (270, or communication module) electrically connected to a network, such as a wireless network. The network interface (270) may transmit or receive data with other network entities via the network.

[0075] The processor (210) can be implemented in various types such as an Application Processor (AP), a Central Processing Unit (CPU), a Graphic Processing Unit (GPU), etc., and may be any semiconductor device that executes instructions stored in memory (230) or a storage device (260). The processor (2310) may be configured to implement the functions and methods described in FIGS. 1 to 5 and FIG. 7 described later.

[0076] The memory (230) and storage device (260) may include various forms of volatile or non-volatile storage media. For example, the memory may include ROM (read-only memory) (231) and RAM (random access memory) (232). In one embodiment of the present invention, the memory (230) may be located inside or outside the processor (210), and the memory (230) may be connected to the processor (210) through various known means.

[0077] FIG. 7 is a flowchart of a control method for a guide dog robot (100) for the visually impaired according to one embodiment of the present invention.

[0078] First, a spring damper part (120) connected to a harness part (110) held by a visually impaired person moves in a predetermined axial direction in response to an external force acting between the visually impaired person and the guide dog robot (100) (S110).

[0079] Next, the position and speed at the mounted position are sensed in the IMUs respectively included in the main body (130) in which the harness part (110), spring damper part (120), and spring damper part (120) are mounted on the upper surface (S120).

[0080] Next, in the main body (130), movement is performed according to the movement intention of the visually impaired person and the movement motion of the guide dog robot (100) based on the sensed position and speed (S130).

[0081] Meanwhile, in the above description, steps S110 to S130 may be further divided into additional steps or combined into fewer steps according to an embodiment of the present invention. Also, some steps may be omitted as necessary, and the order between steps may be changed. Furthermore, even if other omitted details are included, the details described in FIGS. 1 to 6 and the details described in FIG. 7 may be mutually applicable.

[0082] The guide dog robot (100) for the visually impaired and the control method according to one embodiment of the present invention described above may be implemented as a program (or application) and stored on a medium to be executed in combination with a computer, which is hardware.

[0083] The aforementioned program may include code encoded in computer languages ​​such as C, C++, JAVA, Ruby, and machine language, which can be read by the computer's processor (CPU) through the computer's device interface, in order for the computer to read the program and execute the methods implemented in the program. Such code may include functional code related to functions that define the necessary functions for executing the methods, and may include control code related to execution procedures necessary for the computer's processor to execute the functions according to a predetermined procedure. Additionally, such code may further include memory reference code regarding where (address) additional information or media necessary for the computer's processor to execute the functions should be referenced in the computer's internal or external memory. In addition, if the processor of the computer needs to communicate with any other computer or server located remotely in order to execute the above functions, the code may further include communication-related code regarding how to communicate with any other computer or server located remotely using the communication module of the computer, and what information or media to transmit or receive during communication.

[0084] The above-mentioned storage medium refers to a medium that stores data semi-permanently and is readable by a device, rather than a medium that stores data for a short period of time, such as a register, cache, or memory. Specifically, examples of the above-mentioned storage medium include, but are not limited to, ROM, RAM, CD-ROM, magnetic tape, floppy disk, and optical data storage device. That is, the above-mentioned program may be stored on various recording media on various servers that the computer can access, or on various recording media on the user's computer. Additionally, the above-mentioned medium may be distributed across networked computer systems, and computer-readable code may be stored in a distributed manner.

[0085] The foregoing description of the present invention is for illustrative purposes only, and those skilled in the art will understand that other specific forms can be easily modified without altering the technical spirit or essential features of the present invention. Therefore, the embodiments described above should be understood as illustrative in all respects and not restrictive. For example, each component described as a single unit may be implemented in a distributed manner, and components described as distributed may likewise be implemented in a combined form.

[0086] The scope of the present invention is defined by the claims set forth below rather than by the detailed description above, and all modifications or variations derived from the meaning and scope of the claims and equivalent concepts thereof should be interpreted as being included within the scope of the present invention. Explanation of the symbols

[0087] 100: Guide dog robot for the visually impaired 110: Harness section 120: Spring damper section 130: Main body

Claims

Claim 1 A guide dog robot for a visually impaired person comprises: a harness portion held by a visually impaired person; a spring damper portion connected to the harness portion and moving in a predetermined axial direction in response to an external force acting between the visually impaired person and the guide dog robot; and a main body portion mounted on an upper surface of the spring damper portion and performing movement according to the movement intention of the visually impaired person and the movement motion of the guide dog robot, wherein the harness portion, the spring damper portion, and the main body portion each include an IMU, and the IMU measures the position and velocity at the respective mounted position, and the main body portion obtains the wrist direction and position of the visually impaired person through the relative position between each IMU calculated based on the position and velocity measured by the IMU of the main body portion and the IMU of the harness portion. Claim 2 A guide dog robot for the visually impaired according to claim 1, wherein the spring damper part is a 6-axis spring damper that performs the function of a spring damper in the linear direction and rotational direction of the x-axis, y-axis, and z-axis. Claim 3 delete Claim 4 A guide dog robot for the visually impaired according to claim 1, wherein the main body calculates a first interaction force between the harness part and the spring damper part based on a first mass-spring-damper model set for each axis between the harness part and the spring damper part, and calculates a second interaction force between the spring damper part and the main body part based on a second mass-spring-damper model set for each axis between the spring damper part and the main body part. Claim 5 A guide dog robot for the visually impaired according to claim 4, wherein, in the case where there is an axis where spring damper action does not occur in the spring damper part, the main body part sets the first mass-spring-damper model for the remaining axes excluding the axis where spring damper action does not occur. Claim 6 A guide dog robot for the visually impaired according to claim 4, wherein the main body part sets the first mass-spring-damper model such that a spring damper action occurs in the spring damper part acting when the harness part is twisted in a specific direction. Claim 7 A guide dog robot for the visually impaired, wherein, in paragraph 4, the main body calculates the total interaction force for performing movement according to the movement intention of the visually impaired person and the movement motion of the guide dog robot through the vector sum of the first interaction force and the second interaction force based on the point of application of the force set when collecting the dataset for setting the first and second mass-spring-damper models. Claim 8 A guide dog robot for the visually impaired according to claim 7, wherein the main body converts the total interaction force calculated above into a center of gravity external force based on the center of gravity of the guide dog robot, and compensates for control inputs for each joint of the guide dog robot based on the center of gravity external force. Claim 9 A control method for a guide dog robot for a visually impaired person, comprising: a step in which a spring damper part connected to a harness part held by a visually impaired person moves in a predetermined axial direction in response to an external force acting between the visually impaired person and the guide dog robot; a step of sensing the position and velocity at a mounted position in an IMU each included in the harness part, the spring damper part, and the main body part on which the spring damper part is mounted on an upper surface; and a step in which, in the main body part, movement is performed according to the movement intention of the visually impaired person and the movement motion of the guide dog robot based on the sensed position and velocity. Claim 10 In claim 9, the step of performing movement according to the movement intention of the visually impaired person and the movement motion of the guide dog robot based on the sensed position and velocity comprises the step of obtaining the wrist direction and position of the visually impaired person through the relative position between each IMU calculated based on the position and velocity measured by the IMU of the main body and the IMU of the harness part. Claim 11 In claim 9, the step of performing movement according to the movement intention of the visually impaired person and the movement motion of the guide dog robot based on the sensed position and velocity comprises: a step of calculating an interaction force between the harness part and the spring damper part based on a first mass-spring-damper model set for each axis between the harness part and the spring damper part; and a step of calculating an interaction force between the spring damper part and the main body part based on a second mass-spring-damper model set for each axis between the spring damper part and the main body part. Claim 12 A control method for a guide dog robot for a visually impaired person, wherein, in claim 11, the step of performing movement according to the movement intention of the visually impaired person and the movement motion of the guide dog robot based on the sensed position and velocity includes the step of setting the first mass-spring-damper model for the remaining axes excluding the axis where the spring damper action does not occur, if there is an axis where the spring damper action does not occur in the spring damper part. Claim 13 A control method for a guide dog robot for a visually impaired person, wherein the step of performing movement according to the movement intention of the visually impaired person and the movement motion of the guide dog robot based on the sensed position and speed includes the step of setting the first mass-spring-damper model such that the spring damper action in the spring damper part, which acts when the harness part is twisted in a specific direction, occurs. Claim 14 In claim 11, the step of performing movement according to the movement intention of the visually impaired person and the movement motion of the guide dog robot based on the sensed position and velocity comprises: a step of calculating a vector sum of a first interaction force calculated by the first mass-spring-damper model and a second interaction force calculated by the second mass-spring-damper model based on the point of application of the force set when collecting the dataset for setting the first and second mass-spring damper models; and a step of calculating a total interaction force to perform movement according to the movement intention of the visually impaired person and the movement motion of the guide dog robot based on the calculated vector sum. Claim 15 In claim 14, the step of performing movement according to the movement intention of the visually impaired person and the movement motion of the guide dog robot based on the sensed position and velocity further comprises: a step of converting the total interaction force calculated above into a center of gravity external force based on the center of gravity of the guide dog robot; and a step of compensating for control inputs for each joint of the guide dog robot based on the center of gravity external force. Claim 16 A guide dog robot for a visually impaired person, comprising: a communication module receiving sensing data from an IMU each included in a harness part held by a visually impaired person, a spring damper part connected to the harness part, and a main body part having the spring damper part installed on its upper surface; a memory storing a program for performing movement of the guide dog robot based on the sensing data; and a processor that, by executing the program stored in the memory, acquires a position and velocity at a mounted position based on the sensing data from the IMUs as the spring damper part moves in a predetermined axial direction in response to an external force acting between the visually impaired person and the guide dog robot, and controls movement according to the movement intention of the visually impaired person and the movement motion of the guide dog robot based on the position and velocity.

Citation Information

Patent Citations

  • Seeing-eye dog type robot

    JP2006345960A

  • The Blind Guided Robot with Step Climbing Function

    KR1020050067526A

  • Visually Impaired Guidance Robot

    JP2580978Y2

  • Walkers for blind person

    KR1020220083878A