Method and apparatus for estimating location of subject to be tracked

The method and device for robots use map and signal information to generate and update location candidates, ensuring accurate tracking and identification of care recipients within defined spaces, addressing the challenge of dynamic environments and enhancing care service delivery.

WO2024232491A1PCT designated stage expired Publication Date: 2024-11-14ROBOCARE CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/KR2023/018412
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-08
Filing Date
2023-11-16
Publication Date
2024-11-14

AI Technical Summary

Technical Problem

Current methods for robots providing care services struggle to accurately identify and locate service recipients within a defined space, especially in dynamic environments, due to limitations in recognizing activity spaces and tracking targets using map information and signal strength indicators.

Method used

A method and device that generate location candidates for a tracking target based on map information, measure signal strength indices at multiple points, update these candidates based on position and signal changes, and specify the target's location using a combination of image and signal information, ensuring accurate identification and tracking.

Benefits of technology

This approach enables robots to accurately and reliably identify and track care recipients, enhancing the provision of personalized care services by securely specifying their location on map information, even in complex situations, thereby improving service delivery.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure KR2023018412_14112024_PF_FP_ABST
    Figure KR2023018412_14112024_PF_FP_ABST
Patent Text Reader

Abstract

A method for estimating the location of a subject to be tracked to whom a care service is to be provided by a robot, according to an embodiment of the present invention, comprises the steps of: generating, on the basis of map information about an area where the care service is provided, a group of location candidates for the subject being tracked; while moving through a plurality of points on the map information, measuring a signal strength indicator of a device worn or carried by the subject being tracked; updating the group of location candidates on the basis of changes in location between the plurality of points and changes in the signal strength indicator; and specifying, on the basis of the updated group of location candidates, a location of the subject being tracked on the map information.
Need to check novelty before this filing date? Find Prior Art

Description

Method and device for estimating the location of a tracking target

[0001] The present invention relates to a method and device for estimating the location of a tracking target for providing care services based on map information, image information, device signals, etc.

[0002] With technological advancements in various fields such as sensors and artificial intelligence, labor shortages, and an aging society, robotics technology is gaining attention for its ability to move within defined spaces, perform repetitive tasks, provide services tailored to various situations, and provide customized care services for the elderly and others.

[0003] For example, in the case of a robot providing care services to the elderly, it can move within the living space of the care recipient and provide comprehensive functions such as providing various contents including various life notifications, medication reminders, cognitive training, and monitoring and reporting of abnormal activities and emergency situations.

[0004] For robots that provide interpersonal services, including these care services, a basic technology is required that can recognize and move within the activity space, quickly and accurately identify the service recipient within that space, and determine their location.

[0005] [Prior Art Document] (Patent Document 1) KR 10-2397078 B1 (May 9, 2022)

[0006] The present invention provides a method and device for identifying a tracking target for providing care services within a space based on map information and image information for an area providing care services and estimating the location of the tracking target by specifying the location of the tracking target on the map information.

[0007] The present invention provides a method and device for estimating the location of a tracking target, which can specify the location of the tracking target on map information based on map information and a signal strength indicator from a device worn or carried by the tracking target.

[0008] However, the technical tasks that this embodiment seeks to accomplish are not limited to the technical tasks described above, and other technical tasks may exist.

[0009] As a means for achieving the above-described technical task, a method for estimating a location of a tracking target for providing care service by a robot according to an embodiment of the present invention includes the steps of: generating a group of location candidates for the tracking target based on map information for an area for providing the care service; measuring a signal strength indicator of a device worn or carried by the tracking target at a plurality of points on the map information; updating the group of location candidates based on a change in location between the plurality of points and a change in the signal strength indicator; and specifying a location of the tracking target on the map information based on the updated group of location candidates.

[0010] A device for estimating a location of a tracking target for providing a care service according to another embodiment of the present invention includes: a location candidate group generation unit for generating a location candidate group of the tracking target based on map information for an area for providing the care service; a signal strength index measurement unit for measuring a signal strength index of a device worn or carried by the tracking target at a plurality of points on the map information; a location candidate group update unit for updating the location candidate group based on a change in location between the plurality of points and a change in the signal strength index; and a location specification unit for specifying a location of the measurement target on the map information based on the updated location candidate group.

[0011] The above-described problem-solving methods are merely exemplary and should not be construed as limiting the present invention. In addition to the exemplary embodiments described above, additional embodiments may exist, as described in the drawings and detailed description of the invention.

[0012] According to any one of the aforementioned problem-solving methods of the present invention, the robot identifies a tracking target for providing care services within the space based on map information and image information regarding the area where the care service is provided, and by specifying its location on the map information, the location of the tracking target can be accurately estimated. In particular, by identifying the tracking target by synthesizing facial information, body information, and clothing information, the reliability of identification and location estimation can be ensured in various situations.

[0013] In addition, the location of the tracking target can be accurately estimated by specifying the location of the tracking target within the space on the map information based on map information about the area where the robot provides care services and the signal strength indicator from the device worn or carried by the tracking target.

[0014] Figure 1 is a configuration diagram of a care service provision system according to one embodiment of the present invention.

[0015] FIG. 2 is a flowchart of a method for estimating the position of a tracking target according to one embodiment of the present invention.

[0016] FIG. 3 is a drawing specifically illustrating a step of identifying a tracking target in one embodiment of the present invention.

[0017] FIG. 4 is a drawing exemplarily showing a process of estimating the location of a tracking target by a robot in a space where an elderly person, who is a tracking target, resides according to one embodiment of the present invention.

[0018] FIG. 5 is a configuration diagram of a device for estimating the position of a tracking target according to one embodiment of the present invention.

[0019] Figure 6 is a flowchart of a method for estimating the position of a tracking target according to another embodiment of the present invention.

[0020] FIG. 7 is a diagram exemplarily showing a process of updating a group of candidate locations of a tracking target by measuring a signal strength index by a robot in a space where an elderly person, who is a tracking target, resides according to another embodiment of the present invention.

[0021] Figure 8 is a configuration diagram of a device for estimating the position of a tracking target according to another embodiment of the present invention.

[0022] Below, with reference to the attached drawings, embodiments of the present invention are described in detail so that those skilled in the art can easily implement them. However, the present invention may be implemented in various different forms and is not limited to the embodiments described herein. In the drawings, irrelevant parts have been omitted for clarity of description, and similar reference numerals have been used throughout the specification to indicate similar elements.

[0023] Throughout the specification, when a part is said to be "connected" to another part, this includes not only cases where it is "directly connected," but also cases where there are other components intervening or where it is "electrically connected" with other elements intervening. Furthermore, when a part is said to "include" a component, this should be understood to mean that, unless specifically stated to the contrary, it may include other components rather than excluding them, and does not preclude the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0024] Throughout this specification, when it is said that an element is "on" another element, this includes not only cases where the element is in contact with the other element, but also cases where another element exists between the two elements.

[0025] In this specification, the term "unit" includes a unit realized by hardware, a unit realized by software, and a unit realized using both. Furthermore, a single unit may be realized using two or more pieces of hardware, and two or more units may be realized by a single piece of hardware.

[0026] Some of the operations or functions described herein as being performed by a terminal or device may instead be performed by a server connected to the terminal or device. Similarly, some of the operations or functions described as being performed by a server may also be performed by a terminal or device connected to the server.

[0027] Hereinafter, embodiments of the present invention will be described in detail with reference to the attached drawings.

[0028] The method for estimating the location of a tracking target according to the present invention can be implemented by a robot that provides a service while moving in an indoor space or the like, or a server or terminal connected to the robot, and a linkage thereof. The tracking target may be an elderly person or a disabled person who receives care services while active or residing in an indoor space or the like, but is not necessarily limited thereto.

[0029] In addition, in the present invention, the care service may include providing various contents including various life notifications, medication reminders, and cognitive training to the care recipient who is the target of tracking, and services such as monitoring and reporting of abnormal activities and emergency situations.

[0030] Figure 1 is a configuration diagram of a care service provision system according to one embodiment of the present invention.

[0031] Referring to FIG. 1, the care service provision system (1) may include a robot (100).

[0032] As illustrated in FIG. 1, the robot (100) and the server (200) can be connected to a network simultaneously or at time intervals. In addition, the network refers to a connection structure that enables information exchange between each node, such as terminals and servers, and includes a local area network (LAN), a wide area network (WAN), the Internet (WWW), wired and wireless data communication networks, telephone networks, wired and wireless television communication networks, etc. Examples of wireless data communication networks include, but are not limited to, 3G, 4G, 5G, 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), WIMAX (World Interoperability for Microwave Access), Wi-Fi, Bluetooth communication, infrared communication, ultrasonic communication, visible light communication (VLC), LiFi, etc.

[0033] The robot (100) may be exemplified as a robot that operates based on a built-in power source or an external power source and communicates or interacts with a user (10). More specifically, the robot (100) may include a body part (110), a moving part (120), and may further include additional components necessary for driving other robots.

[0034] The body (110) is a central configuration in which major components of the robot (100), such as a CPU (not shown), a battery (not shown), a communication unit (117), etc., are mounted internally or other components are connected externally, and may further include a collection unit (111) for capturing a user or sensing the user's voice or ambient sound to generate related information, a display unit (115) for outputting images or text, and a speaker unit (not shown) for outputting voice.

[0035] The collection unit (111) can capture images of the user (10) or the environment around the user through a visual sensor such as a camera. Here, the components included in the visual sensor may include, for example, photographing devices such as a camera that generates photographing information of general RGB pixels, an infrared camera for capturing an object in a dark environment, and a depth camera that can generate depth information regarding the distance to the subject.

[0036] In addition, the collection unit (111) can receive sounds from the user (10) or the environment around the user through a sound sensor such as a microphone. Here, since the user's voice or ambient sounds are important information that are treated as user input in interactions with the user, it is preferable that the microphone be placed in a location where there are no elements that interfere with receiving the user's voice or ambient sounds. For example, if the microphone is placed immediately behind the hole of the speaker unit formed on the front of the body unit (110), the user's voice or ambient sounds can be directly received.

[0037] Meanwhile, the microphone may be formed as an integral part of the speaker unit, rather than as an independent component positioned separately from the speaker unit, as described below. In this case, consideration of the microphone placement location described above will not be necessary, and the space utilization within the body unit (110) will also be improved.

[0038] In addition, the collection unit (111) can receive device information generated from another smart device through a communication unit to be described later, and a detailed description thereof will be described later.

[0039] In addition, the collection unit (111) may include one or more sensors for sensing at least one of information within the robot (100) (particularly, the operating status of the care service providing device), information on the surrounding environment surrounding the care service providing device, location information, and user information.

[0040] For example, the collection unit (111) may be equipped with a proximity sensor, a laser scanner (lidar sensor), an RGBD sensor, a geomagnetic sensor, an ultrasonic sensor, an inertial sensor, a UWB sensor, etc. in addition to the above-mentioned sensors.

[0041] The display unit (115) is a type of liquid crystal display device, and can output one or more of text, images, and videos of predetermined information. Here, the predetermined information can include status information of the robot (100), such as communication status strength information, remaining battery level information, and wireless Internet ON / OFF information. The display unit (115) can display media content that the robot (100) displays in response to situational information, which will be described later, and can also display information that converts voice output by the robot (100) through the speaker unit into text, which will be described later. For example, if the robot (100) sets a wake-up alarm while providing an appropriate service to the user through situational awareness, the text corresponding to this can be output on the display unit (115) as "Wake up at 7:00 AM."

[0042] The text output on the display unit (115) may be one of the previously described pieces of information repeatedly output, or multiple pieces of information may be output alternately, or specific information may be set as default and output. For example, status information of the robot (100), such as communication status strength information, remaining battery level information, and wireless Internet ON / OFF information, may be set as default and continuously output as small text at the top or bottom of the display unit (115), and other information may be output alternately.

[0043] Meanwhile, it is said that the display unit (115) can output one or more of images and videos. In this case, it is preferable to implement the display unit (115) as a liquid crystal display device with a high resolution and a large size, rather than a case where only text is output, in order to improve visibility. The display unit (115) of FIG. 1 should be viewed as an example.

[0044] The speaker unit can output various sounds, including voice. Here, voice corresponds to auditory information output by the robot (100) for interaction with the user, and the type of voice can be set in various ways through a media-specific application installed on the user's terminal (not shown) or through direct control of the robot (100).

[0045] For example, you can select the type of voice to be output through the speaker section from among various voices, such as male voice, female voice, adult voice, and child voice, and you can even select the type of language, such as Korean, English, Japanese, and French.

[0046] Meanwhile, although the speaker unit outputs sound, it does not perform the role of a typical speaker, such as general sound output, and this can also be performed in the same manner. For example, if a user wants to listen to music through the robot (100), the music can be output through the speaker unit, and if a video is output through the display unit (115), a sound synchronized with the video can be output through the speaker unit.

[0047] The moving unit (120) can move the robot (100). More specifically, the moving unit (120) provides a means for the body (110) of the robot to move within a specific space in relation to driving according to a movement command from a control device. More specifically, the moving unit includes a motor and a plurality of wheels, which, when combined, can perform the functions of driving, changing direction, and rotating the robot (100).

[0048] The functions performed by the above-described body part (110) and moving part (120) are performed by control signals output from a control part (not shown) within the body part, but for convenience of explanation, the explanation will continue below as being performed by the robot (100).

[0049] Figure 2 is a flowchart illustrating a method for estimating the location of a tracking target according to one embodiment of the present invention. Figure 3 is a diagram specifically illustrating the steps for identifying a tracking target according to one embodiment of the present invention. Additionally, Figure 4 is a diagram exemplifying a process for tracking the location of a tracking target using a robot in a space where an elderly person, the tracking target, resides, according to one embodiment of the present invention.

[0050] Referring to FIG. 2, a method for estimating the location of a tracking target according to the present embodiment includes a step of generating map information (S110), a step of identifying a tracking target (S120), and a step of specifying the location of the tracking target on the map information (S150). In addition, the method of the present embodiment may further include a step of tracking a change in the location of the tracking target (S130), a step of specifying a single location of the tracking target (S140), and a step of generating or updating location pattern information (S160).

[0051] In the step (S110) of generating map information, map information for the area providing care services can be generated. Specifically, the map information can be generated based on information input by various sensors, such as a depth camera or lidar mounted on a robot. Alternatively, the map information for this embodiment can also be generated by receiving map data from an external device.

[0052] The step of identifying the tracking target (S120) is to accurately detect the identity of the tracking target, and according to the present embodiment, facial information, body information, and clothing information are generated from the input image information, and the tracking target is identified based on at least one of these pieces of information.

[0053] Here, the image information may be a video captured by a camera, and the camera may be mounted on the aforementioned robot.

[0054] When movement is detected in the video captured by the robot's camera, for example, when the tracking target comes out of the room in FIG. 4 and exists or starts moving in the same space as the robot (the living room in FIG. 4), a step (S120) for identifying the tracking target may be initiated.

[0055] Hereinafter, with reference to FIG. 3, a step (S120) for identifying a tracking target based on facial information, body information, and clothing information, respectively, will be described in detail. Here, as illustrated in FIG. 4, facial information, body information, and clothing information may be information about at least a portion of the tracking target.

[0056] First, as a step of identifying a tracking target based on face information, the step of identifying the tracking target (S120) may include a step of extracting a bounding box (S121) and a step of identifying the face of the tracking target (S122).

[0057] In the step of extracting a bounding box (S121), a bounding box for a human face can be extracted from image information input by a face detection model. The face detection model can be a detection model based on a convolutional neural network (CNN), and for example, object detection algorithms such as RCNN, Fast RCNN, YOLO, Single Shot Detector (SSD), Retina-Net, and Pyramid Net can be utilized.

[0058] In the step (S122) of identifying the face of the tracking target, feature points may be extracted from the image of the bounding box extracted by the identity recognition model and stored in a database, and the face of the tracking target may be identified by comparing the feature points extracted from the image of the bounding box with the feature points already stored in the database. A model based on a convolutional neural network may be applied as the identity recognition model, and for example, algorithms such as VGG-Face, FaceNet, OpenFace, DeepFace, and ArcFace may be utilized.

[0059] Next, as a step of identifying a tracking target based on body information, the step of identifying a tracking target (S120) may include a step of extracting skeletal information (S123) and a step of identifying the body of the tracking target (S124).

[0060] In the step of extracting skeletal information (S123), skeletal information including the position of joints can be extracted from image information by a skeletal information extraction (Pose Estimation) model.

[0061] In the step of identifying the body of the tracking target (S124), at least one of the height, bone length, and body proportion of the tracking target can be calculated based on the skeletal information and stored in a database, and the body of the tracking target can be identified by comparing the calculated value with a value already stored in the database.

[0062] In the step of identifying a tracking target based on body information, a feature detection model based on a convolutional neural network can be applied as a skeletal information extraction model. For example, algorithms such as MoveNet, PoseNet, OpenPose, MediaPipe, AlphaPose, Nuitrack, and Kinecct SDK can be utilized. Skeletal information and the values ​​calculated based on it do not change in a short period of time, so they can be effectively utilized for identifying a tracking target.

[0063] Furthermore, as a step of identifying a tracking target based on clothing information, the step of identifying a tracking target (S120) may include a step of extracting a clothing image (S125) and a step of identifying the clothing of the tracking target (S126).

[0064] Specifically, in the step of extracting a clothing image (S125), the clothing image can be extracted from the input image information. In the step of identifying the clothing to be tracked (S126), feature points are extracted from the clothing image, stored in a database, and compared, thereby identifying the clothing to be tracked. At this time, the clothing type can be classified into upper and lower garments using models such as machine learning, deep neural networks, and convolutional neural networks, and the feature points of the corresponding clothing can be extracted.

[0065] Meanwhile, as shown in FIG. 3, according to the present embodiment, the step (S120) of identifying the tracking target may further include a step (S127) of identifying the tracking target by matching or synthesizing facial information, body information, and clothing information with each other.

[0066] Specifically, at least two of the identified facial information, body information, and clothing information can be matched and stored in a database. Subsequently, if at least one of the newly generated and identified facial information, body information, or clothing information is available, the tracking target can be identified by comparing it with the information stored in the database. Therefore, even if one type of information is missing, the reliability of identifying the tracking target can be ensured.

[0067] Additionally, the tracking target can be identified by sequentially identifying the facial information, body information, and clothing information according to their mutual priorities, or by synthesizing, for example, adding, the tracking target based on their respective weights.

[0068] Meanwhile, in the method for estimating the location of a tracking target according to the present embodiment, the step (S130) of tracking a change in the location of the tracking target may be a step of detecting and tracking the movement of the identified tracking target in an area where care services are provided. Specifically, as in the previous embodiment, for the identified tracking target, video or image information is input for a certain period of time by a camera of a robot, etc., and the change in the location of the tracking target over time is tracked from the input image information, thereby tracking the direction or state of movement. As illustrated in Fig. 4, when the tracking target moves to a different space, the change in location can be tracked by image information input by a camera, etc.

[0069] On the other hand, the step (S140) of identifying a single location of the tracking target may be performed when the location of the tracking target is estimated to be multiple. In the aforementioned process of identifying the tracking target or tracking changes in the location of the tracking target, the tracking target may be calculated to exist in multiple locations.

[0070] In such cases, in this embodiment, a tracking target can be identified based on additionally input voice information. Voice information can be collected from a microphone mounted on a mobile robot, as described above, and the location of the tracking target can be selected and identified by selecting the location where voice information is collected and confirmed among multiple locations. As in the embodiment of Fig. 4, voice information can be obtained by inducing the tracking target to speak, such as by asking a question.

[0071] Alternatively, a tracking target can be identified by additionally inputting search image information. The search image information may be of the same type as the image information input to identify the tracking target, but may also be a different type of image acquired from another camera, etc. The robot can move to multiple locations where the tracking target is presumed to be located and directly capture search image information of those locations. This allows the tracking target location to be selected and identified by identifying the location where the tracking target is identified.

[0072] The audio information or search image information may be obtained from multiple locations within the space, and as described above, may be information obtained while the robot moves in the area where it provides care services.

[0073] As described above, when a tracking target is identified, or when a tracking target is identified and its location is specified as one, the location of the tracking target can be specified on the map information (S150). Specifically, the location of the tracking target on the map information can be specified based on information regarding the location and direction in which image information is input on the map information, and further based on changes in the location of the tracked identified target. Here, the direction in which the image information is input can refer to the direction of the robot's camera when the image information is input.

[0074] Meanwhile, according to this embodiment, information regarding the specific and accumulated location of a tracking target can be generated and updated as location pattern information (S160). Specifically, the location pattern information may record the frequency of the location of a tracking target specified on map information, the frequency of the location based on time zone, etc. Furthermore, records regarding the time and location of the robot's function operation, such as when the tracking target calls or operates the robot, can be utilized.

[0075] This updated location pattern information can be utilized in the step (S120) of identifying the tracking target. For example, if the tracking target's facial information, etc., is not accurately recognized, the tracking target can be identified as a likely person based on the location pattern information.

[0076] According to one embodiment of the present invention, by comprehensively utilizing facial, body, and clothing information among image information, tracking target recognition can be performed accurately. Furthermore, the location of the tracking target identified on the generated map information can be tracked and specified using various types of information, ensuring accuracy and establishing a foundation for providing advanced services targeting people.

[0077] Figure 5 is a schematic diagram of a device for estimating the location of a tracking target according to one embodiment of the present invention. The device for estimating the location of a tracking target according to this embodiment may be a robot or a component of a robot that provides services while moving in an indoor space or the like, or a component implemented in a server or terminal connected to a robot, or a system combining these.

[0078] Referring to FIG. 5, a device (100) for estimating a location of a tracking target for providing a care service according to the present embodiment may include a map information generation unit (110) for generating map information for an area for providing a care service, a tracking target identification unit (120) for generating face information, body information, and clothing information from input image information and identifying a tracking target based on at least one of the face information, body information, and clothing information, and a location specification unit (130) for specifying a location of a tracking target on the map information based on a location and direction in which image information is input on the map information. In addition, the device (100) may further include a location pattern information generation unit (140) for generating or updating location pattern information that accumulates information on the location of a tracking target specified on the map information.

[0079] In addition, the steps for estimating the position of the tracking target described through FIGS. 2 and 3 may be components of a device (100) for estimating the position of the tracking target according to one embodiment of the present invention, individually or in combination.

[0080] Next, Fig. 6 is a flowchart illustrating a method for estimating the location of a tracking target according to another embodiment of the present invention. Fig. 7 is a diagram exemplarily illustrating a process of updating a group of location candidates for a tracking target by measuring signal strength indicators by a robot in a space where an elderly person, the tracking target, resides, according to another embodiment of the present invention.

[0081] Hereinafter, a method for estimating the location of a tracking target according to another embodiment of the present invention will be described with reference to FIGS. 6 and 6. Another embodiment of the present invention is configured to estimate the location of a tracking target based on a signal and its intensity received from a device, such as various wearable devices, carried or worn by a tracking target, such as an elderly person.

[0082] Referring to FIG. 6, a method for estimating the location of a tracking target according to the present embodiment includes a step of generating a candidate location group of the tracking target (S210), a step of measuring a signal strength indicator of a device (S220), a step of updating the candidate location group of the tracking target (S230), and a step of specifying the location of the tracking target on map information (S250). In addition, a step of confirming the location of the tracking target with respect to the updated candidate location group (S240) and a step of generating or updating location pattern information (S260) may be further included.

[0083] In this embodiment, map information can be generated based on the robot's depth camera or lidar as in the previous embodiment, or by receiving map data from an external device, etc.

[0084] In the step (S210) of generating a group of location candidates for the tracking target, the group of location candidates may be generated based on map information. As shown in the example of Fig. 7, the group of location candidates may include at least one location candidate with a high probability of the tracking target existing on the map information.

[0085] In the step of measuring the signal strength indicator of the device (S220), the signal strength indicator (RSSI, Receiver Signal Strength Indicator) of the device worn or carried by the tracking target can be measured while moving through multiple points on the map information. Specifically, the signal strength indicator can be measured for multiple points on the path along which the robot moves so that the distance changes for at least one of the location candidates. The signal strength indicator can be measured multiple times on the path along which the robot moves in the area where the robot provides care services or on the map information generated based thereon.

[0086] In the step of updating the location candidate group of the tracking target (S230), the location candidate group can be updated based on the change in location between multiple points and the change in the measured signal strength index.

[0087] For example, when there is a change in the measurement position along the movement path of the robot as shown in (a) of Fig. 7, if the signal strength index changes to increase, candidate 3, which is a position where the signal strength index should decrease, can be excluded from the group of position candidates. Next, if it is detected that the signal strength index changes to increase along the movement path of the robot as shown in (b) of Fig. 7, candidate 1, which is a position where the signal strength index should decrease, can be excluded from the group of position candidates. The judgment to predict an increase or decrease in the signal strength index for each position candidate may be based on the candidate group positions on the map information and the signal strength index measurement positions.

[0088] That is, the step (S230) of updating the candidate locations of the tracking target can be performed by comparing the direction of the movement path on the map information with the increase or decrease in the measured signal strength index, thereby excluding unlikely candidate locations from the candidate locations.

[0089] In the step (S250) of specifying the location of the tracking target on the map information, the location of the tracking target on the map information can be specified based on the updated location candidate group. Based on the specified location of the tracking target, care services, etc. can be provided to the tracking target by the mobile robot exemplified in this embodiment.

[0090] Meanwhile, in at least one of the steps of generating a group of location candidates for the tracking target (S210) and updating the group of location candidates for the tracking target (S230), the group of location candidates may be generated or updated further based on at least one of the input voice information and image information. The voice information or image information may be collected by a microphone or camera mounted on the robot described in this embodiment.

[0091] Furthermore, in at least one of the step of generating a location candidate group of the tracking target (S210) and the step of updating the location candidate group of the tracking target (S230), the location candidate group may be generated or updated further based on additional detection information received from a sensor whose location is specified on the map information or an additional device that the tracking target is further carrying or wearing.

[0092] Specifically, if the tracking target is carrying or wearing additional devices, including a mobile phone or other IoT devices, the accuracy of location identification can be improved by receiving additional sensing information from the devices and updating the location candidate list based on this.

[0093] In addition, additional detection information received from sensors whose locations are specified on the map information, such as access detection sensors installed at specific locations within a space, can also be used to create or update a group of location candidates.

[0094] On the other hand, in the step (S240) of confirming the location of the tracking target with respect to the updated location candidate group, additionally input voice information and image information may be utilized. That is, if there are multiple location candidates in the updated location candidate group, the location of the tracking target may be confirmed again based on at least one of the voice information, image information, and signal strength indicators detected by the robot when it approached the location candidate.

[0095] In another embodiment of the present invention, location pattern information can be generated or updated, similar to one embodiment of the present invention. In the step of generating or updating location pattern information (S260), information regarding the location of the tracking target identified on the map information can be accumulated to generate and update the location pattern information. Furthermore, records regarding the time and location of the robot's function operation, such as when the tracking target calls or operates the robot, can be utilized.

[0096] Information generated or updated in this way can be used as basic information in at least one of the steps of generating a group of location candidates for the tracking target (S210) and the step of updating the group of location candidates for the tracking target (S230).

[0097] According to another embodiment of the present invention, by utilizing map information and signal strength indicators from devices such as wearable devices, tracking targets can be accurately identified. Furthermore, the location of the tracking target identified on the generated map information can be tracked and specified using additional information, ensuring accuracy. This provides a foundation for providing advanced care services for people.

[0098] Figure 8 is a schematic diagram of a device for estimating the location of a tracking target according to another embodiment of the present invention. The device for estimating the location of a tracking target according to this embodiment may be a robot or a component of a robot that provides services while moving in an indoor space or the like, or a component implemented in a server or terminal connected to a robot, or a system combining these.

[0099] Referring to FIG. 8, a device (200) for estimating a location of a tracking target to provide a care service according to the present embodiment may include a location candidate group generation unit (210) for generating a location candidate group of a tracking target on map information for an area providing a care service, a signal strength index measurement unit (220) for measuring a signal strength index of a device worn or carried by the tracking target at a plurality of points on the map information, a location candidate group update unit (230) for updating a location candidate group of the tracking target based on a change in location and a change in the signal strength index between the plurality of points, and a location specification unit (240) for specifying a location of the measurement target on the map information based on the updated location candidate group.

[0100] In addition, the steps for tracking the position of the tracking target described through FIGS. 6 to 6 may be functions performed by the device (200) for tracking the position of the tracking target according to another embodiment of the present invention, individually or in combination.

[0101] Furthermore, in the above description, the steps of the method for estimating the location of a tracking target according to one or more embodiments of the present invention may be further divided into additional steps or combined into fewer steps, depending on the implementation of the present invention. Furthermore, some steps may be omitted as needed, or the order of the steps may be reversed.

[0102] The foregoing description of the present invention is for illustrative purposes only, and those skilled in the art will readily appreciate that the present invention can be readily modified into other specific forms without altering the technical spirit or essential characteristics of the present invention. Therefore, the embodiments described above should be understood as illustrative in all respects and not restrictive. For example, each component described as a single entity may be implemented in a distributed manner, and similarly, components described as distributed may be implemented in a combined manner.

[0103] The scope of the present invention is indicated by the claims described below rather than the detailed description above, and all changes or modifications derived from the meaning and scope of the claims and their equivalent concepts should be interpreted as being included in the scope of the present invention.

Claims

1. A method for estimating the location of a tracking target to provide care services by a robot, A step of generating a group of candidate locations of the tracking target based on map information for an area providing the above care service; A step of measuring the signal strength indicator of a device worn or carried by the tracking target while moving through multiple points on the map information; A step of updating the position candidate group based on the change in position between the plurality of points and the change in the signal strength indicator; and A step of specifying the location of the tracking target on the map information based on the updated location candidate group, A method for estimating the location of a tracking target.

2. In paragraph 1, A method for estimating the location of a tracking target, wherein the step of measuring the signal strength indicator is performed at multiple points on a path along which the distance changes for at least one of the location candidates.

3. In paragraph 1, A method for estimating the location of a tracking target, wherein at least one of the steps of generating the location candidate group and the step of updating the location candidate group is performed based on at least one of input voice information and image information.

4. In paragraph 1, A method for estimating the location of a tracking target, wherein the step of generating the location candidate group or the step of updating the location candidate group is performed further based on additional sensing information input from a sensor whose location is specified on the map information or from an additional device further carried or worn by the tracking target.

5. In paragraph 1, For the updated location candidate group, further comprising a step of confirming the location of the tracking target based on at least one of the input voice information, image information, and the signal strength indicator. A method for estimating the location of a tracking target.

6. In paragraph 1, Further comprising a step of accumulating information on the location of the tracking target specified on the above map information to generate or update location pattern information, At least one of the step of generating the location candidate group and the step of updating the location candidate group is performed further based on the location pattern information. A method for estimating the location of a tracking target.

7. In a device for estimating the location of a tracking target to provide care services, A location candidate generation unit that generates a location candidate group of the tracking target based on map information for an area providing the above care service; A signal strength indicator measuring unit that measures the signal strength indicator of a device worn or carried by the tracking target at multiple points on the above map information; A location candidate update unit that updates the location candidate group based on the change in position between the plurality of points and the change in the signal strength indicator; and A location-specification unit that specifies the location of the measurement target on the map information based on the updated location candidate group, A device that estimates the location of a tracking target.

Citation Information

Patent Citations

  • Robot and its controlling method

    JP2005305631A

  • Target object detection apparatus and robot provided with the same

    JP2006192563A

  • Image information masking method of monitoring system based on face recognition and body information

    KR101215948B1

  • Door Lock Device And Vehicle Loading Box Boor Including Thereof

    KR1020230124361A

  • Merchandise sales system based on merchandise code link, and method thereof

    KR102134103B1