Method for providing care service on basis of smart map and care robot for performing same

Abstract

A method by which a care robot provides a care service on the basis of a smart map, according to one embodiment of the present invention, comprises the steps of: collecting image information obtained by driving in a service space in which the care service is provided; generating object information including an object location and an object type regarding an object present in the service space on the basis of the image information; generating a plurality of living areas in the service space on the basis of the object information and generating a smart map including the living areas and the object information; and generating a movement path of the care robot to perform the care service on the basis of the smart map.

Description

Method for providing care services based on smart maps and care robots performing the same

[0001] The present invention relates to a method for providing care services based on a smart map generated from image information about a service space and a care robot performing the same.

[0002] With technological advancements in artificial intelligence, labor shortages, and an aging society, robotics is gaining attention for its ability to move within defined spaces, perform repetitive tasks, provide services tailored to various situations, and provide customized care services for the elderly and others.

[0003] For example, in the case of a robot providing care services to the elderly, it can move within the activity space where the care recipient lives, providing various contents including various life notifications, medication reminders, cognitive training, monitoring and reporting of abnormal activities and emergency situations, and exercise assistance, etc., and providing comprehensive functions to the care recipient.

[0004] As the foundational technology required for providing care services via these care robots, smart maps are attracting attention. These maps can not only capture general map data regarding the shape and size of a space, but also recognize and reflect the current status and characteristics of various objects within that space. Thus, smart maps, which generate and update information on various objects within a living space, offer diverse potential applications.

[0005] One object of the present invention is to provide a method for generating information about objects existing in a space from image information generated by driving of a care robot, and generating a movement path of the care robot based on a smart map generated based on the information about the objects.

[0006] However, the technical tasks that this embodiment seeks to accomplish are not limited to the technical tasks described above, and other technical tasks may exist.

[0007] As a means for achieving the above-described technical task, a method for providing a care service based on a smart map by a care robot according to an embodiment of the present invention includes the steps of: collecting image information acquired by driving in a service space providing the care service; generating object information including an object location and an object type regarding an object existing in the service space based on the image information; generating a plurality of living areas in the service space based on the object information, and generating a smart map including the living areas and the object information; and generating a movement path of the care robot for performing the care service based on the smart map.

[0008] A care robot according to one embodiment of the present invention provides a care service based on a smart map, and includes: a moving unit configured to move in a service space providing the care service; a collecting unit configured to collect image information acquired by moving in the service space; an object information generating unit configured to generate object information including an object location and an object type regarding an object existing in the service space based on the image information; a smart map generating unit configured to generate a plurality of living areas in the service space based on the object information and generate a smart map including the living areas and the object information; and a moving path generating unit configured to generate a moving path of the care robot for performing the care service based on the smart map.

[0009] The above-described problem-solving methods are merely exemplary and should not be construed as limiting the present invention. In addition to the exemplary embodiments described above, additional embodiments may exist, as described in the drawings and detailed description of the invention.

[0010] According to any one of the problem solving means of the present invention described above, a smart map including object information generated based on image information obtained by a care robot driving through a service space and a living area generated based on the object information can be generated, and a movement path for the care robot to provide care service can be calculated based on the smart map.

[0011] The care robot's movement path may include avoiding objects that are dangerous to the user or the care robot, focusing on objects requiring security, locations where objects can be observed well and periods of observation, and may reflect the user's expected activities.

[0012] FIG. 1 is a drawing for explaining a care robot system according to one embodiment of the present invention.

[0013] FIG. 2 is a drawing showing an example of a care robot providing a care service according to one embodiment of the present invention.

[0014] FIG. 3 is a flowchart of a method for providing care services based on a smart map according to one embodiment of the present invention.

[0015] FIG. 4 is a drawing showing an example of a smart map generated according to one embodiment of the present invention.

[0016] Figure 5 is a flowchart for performing a reinforced observation step according to one embodiment of the present invention.

[0017] Figure 6 is a flowchart of steps for generating and utilizing pattern information according to one embodiment of the present invention.

[0018] Figure 7 is a schematic diagram for explaining the configuration of a care robot according to one embodiment of the present invention.

[0019] Below, with reference to the attached drawings, embodiments of the present invention are described in detail so that those skilled in the art can easily implement them. However, the present invention may be implemented in various different forms and is not limited to the embodiments described herein. In the drawings, irrelevant parts have been omitted for clarity of description, and similar reference numerals have been used throughout the specification to indicate similar elements.

[0020] Throughout the specification, when a part is said to be "connected" to another part, this includes not only cases where it is "directly connected," but also cases where there are other components intervening or where it is "electrically connected" with other elements intervening. Furthermore, when a part is said to "include" a component, this should be understood to mean that, unless specifically stated to the contrary, it may include other components rather than excluding them, and does not preclude the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0021] Throughout this specification, when we say that a component is "on" another component, this includes not only cases where the component is in contact with the other component, but also cases where another component exists between the two components.

[0022] In this specification, the term "unit" includes a unit realized by hardware, a unit realized by software, and a unit realized using both. Furthermore, a single unit may be realized using two or more pieces of hardware, and two or more units may be realized by a single piece of hardware.

[0023] Some of the operations or functions described herein as being performed by a terminal or device may instead be performed by a server connected to the terminal or device. Similarly, some of the operations or functions described as being performed by a server may also be performed by a terminal or device connected to the server.

[0024] Hereinafter, embodiments of the present invention will be described in detail with reference to the attached drawings.

[0025] The method for providing care services based on a smart map according to the present invention can be implemented by a care robot that provides care services while moving in an indoor space or the like, or a server or terminal connected to the care robot, and a linkage thereof. The user may be an elderly person or a disabled person who receives care services living or residing in a service space including an indoor space, but is not necessarily limited thereto.

[0026] In addition, in the present invention, the care service may include providing various contents including various life notifications, medication reminders, and cognitive training to the care recipient who is the target of tracking, monitoring and reporting abnormal activities and emergency situations, exercise assistance, and detecting and notifying of risk factors in the living space.

[0027] FIG. 1 is a diagram illustrating a care robot system according to one embodiment of the present invention. FIG. 2 is a diagram illustrating an example of a care system according to one embodiment of the present invention providing care services.

[0028] Referring to FIG. 1, the care robot system may include a care robot (100), a network (300), and a server (400).

[0029] The care robot (100) of the care robot system of FIG. 1 is connected to the server (400) via a network (300). For example, as illustrated in FIG. 1, the care robot (100) may be connected to the network (300) simultaneously or at time intervals. The network (300) refers to a connection structure that enables information exchange between each node, such as terminals and servers, and includes a local area network (LAN), a wide area network (WAN), the Internet (WWW), a wired / wireless data communication network, a telephone network, a wired / wireless television communication network, etc. Examples of wireless data communication networks include, but are not limited to, 3G, 4G, 5G, 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), WIMAX (World Interoperability for Microwave Access), Wi-Fi, Bluetooth, infrared, ultrasonic, visible light communication (VLC), and LiFi.

[0030] The care robot (100) is a robot that includes its own means of transportation, and may include a camera for photographing users and service spaces, a microphone for receiving sound input from users, a display for displaying information to users, a speaker for outputting sound to users, etc. In addition to the camera and microphone mentioned above, the care robot (100) may include sensors for detecting ambient temperature, humidity, illuminance, pressure, etc. The care robot (100) includes an integrated control unit for controlling the above mentioned devices, and the integrated control unit may mean a device having a computational processing capability by having a memory and a processor.

[0031] Memory is a device that stores information and may include various types of memory, such as high-speed random access memory, magnetic disk storage devices, flash memory devices, and non-volatile memory such as other non-volatile solid-state memory devices. In the care robot (100) described below, memory may be described in the form of a database.

[0032] The server (400) may include a memory in which a plurality of modules are stored, a processor connected to the memory and responsive to the plurality of modules, and processing service information provided to the care robot (100) or action information controlling the service information, a communication means, and a UI (user interface) display means.

[0033] Referring further to FIG. 2, the care robot (100) may be exemplified as a robot that operates based on a built-in power source or an external power source and communicates or interacts with a user (200). More specifically, the robot (100) may include a body part (110), a moving part (120), and may further include additional components necessary for driving other robots.

[0034] The body part (110) is a central configuration in which major components of the care robot (100), such as a CPU (not shown), a battery (not shown), a communication part (117), etc., are mounted inside or other components are connected to the outside, and may further include a collection part (111) for capturing a user or sensing the user's voice or ambient sound to generate related information, a display part (115) for outputting images or text, and a speaker part for outputting voice.

[0035] The collection unit (111) can capture images of the user (200) or the environment around the user through a visual sensor such as a camera. Here, the components included in the visual sensor may include, for example, photographing devices such as a camera that generates photographing information of general RGB pixels, an infrared camera for capturing an object in a dark environment, and a depth camera that can generate depth information regarding the distance to the subject.

[0036] In addition, the collection unit (111) can receive sounds from the user (200) or the environment around the user through a sound sensor such as a microphone. Here, since the user's voice or ambient sounds are important information that are treated as user input in interactions with the user, it is preferable that the microphone be placed in a location where there are no elements that interfere with receiving the user's voice or ambient sounds. For example, if the microphone is placed immediately behind the hole of the speaker unit formed on the front of the body unit (110), the user's voice or ambient sounds can be directly received.

[0037] Meanwhile, the microphone may be formed as an integral part of the speaker unit, rather than as an independent component positioned separately from the speaker unit, as described below. In this case, consideration of the microphone placement location described above will not be necessary, and the space utilization within the body unit (110) will also be improved.

[0038] In addition, the collection unit (111) may receive device information generated from another smart device through the communication unit. The collection unit (111) may include one or more sensors for sensing at least one of information within the care robot (100) (particularly, the operating status of the care service providing device), information about the surrounding environment surrounding the care robot, location information, and user information.

[0039] For example, the collection unit (111) may be equipped with a proximity sensor, a laser scanner (lidar sensor), an RGBD sensor, a geomagnetic sensor, an ultrasonic sensor, an inertial sensor, a UWB sensor, etc. in addition to the above-mentioned sensors.

[0040] The display unit (115) is a type of liquid crystal display device, and can output one or more of text, images, and videos of predetermined information. Here, the predetermined information can include status information of the care robot (100), such as communication status strength information, remaining battery level information, and wireless Internet ON / OFF information. The display unit (115) can display media content that the care robot (100) displays in response to situational information, and can also display information that converts voice output by the care robot (100) through the speaker into text. For example, if the care robot (100) sets a wake-up alarm while providing appropriate service to the user through situational awareness, the text corresponding to this can be output on the display unit (115) as "Wake up at 7:00 AM."

[0041] The text output on the display unit (115) may be one of the previously described pieces of information repeatedly output, or multiple pieces of information may be output alternately, or specific information may be set as default and output. For example, status information of the care robot (100), such as communication status strength information, remaining battery level information, and wireless Internet ON / OFF information, may be set as small text at the top or bottom of the display unit (115) by default and continuously output, and other information may be output alternately.

[0042] Meanwhile, it is said that the display unit (115) can output one or more of images and videos. In this case, it is desirable to implement the display unit (115) as a liquid crystal display device with a high resolution and a large size, rather than a case where only text is output, in order to improve visibility. The display unit (115) of FIG. 2 should be viewed as an example.

[0043] The speaker unit can output various sounds, including voice. Here, voice corresponds to auditory information output by the care robot (100) for interaction with the user, and the type of voice can be set in various ways through a media-only application installed on the user's terminal (not shown) or direct control of the care robot (100).

[0044] For example, you can select the type of voice to be output through the speaker section from among various voices, such as male voice, female voice, adult voice, and child voice, and you can even select the type of language, such as Korean, English, Japanese, and French.

[0045] Meanwhile, although the speaker unit outputs sound, it does not perform the role of a typical speaker, such as general sound output, and this can also be performed in the same manner. For example, if a user wants to listen to music through the care robot (100), the music can be output through the speaker unit, and if a video is output through the display unit (115), sound synchronized with the video can be output through the speaker unit.

[0046] The moving unit (120) can move the care robot (100). More specifically, the moving unit (120) provides a means for the robot's body (110) to move within a specific space in relation to driving according to a movement command from a control device. More specifically, the moving unit includes a motor and a plurality of wheels, which, when combined, can perform the functions of driving, changing direction, and rotating the care robot (100).

[0047] The functions performed by the above-described body part (110) and moving part (120) are performed by control signals output from a control part (not shown) within the body part, but for convenience of explanation, the explanation will continue below as being performed by the care robot (100).

[0048] Meanwhile, the care robot (100) can generate facial information, body information, and / or clothing information from the acquired image information to accurately detect the user's identity, and identify the user based on at least one of these pieces of information.

[0049] To achieve this, image information is analyzed using artificial intelligence algorithms, including machine learning, deep neural networks, and convolutional neural networks, to identify the presence of a user and infer their specific identity. For example, bounding boxes can be extracted and facial recognition models can be used to generate facial information, while skeletal extraction models can be used to generate body information.

[0050] Additionally, to generate clothing information, clothing images classified by clothing type can be extracted from image information using a model based on at least one of machine learning, a deep neural network, and a convolutional neural network. Feature points of the clothing can then be extracted from the clothing images as clothing information. Furthermore, facial information, body information, and clothing information can be combined based on their respective weights to identify the tracking target.

[0051] FIG. 3 is a flowchart illustrating a method for providing care services based on a smart map according to one embodiment of the present invention. FIG. 4 is a diagram illustrating an example of a smart map generated according to one embodiment of the present invention.

[0052] Referring to FIG. 3, a method for providing care services based on a smart map according to the present embodiment includes a step of collecting image information (S310), a step of generating object information (S320), a step of generating a smart map (S330), and a step of generating a movement path of a care robot (S340).

[0053] In the image information collection step (S310), the image information is acquired as the care robot moves through the service space. The care robot may move along a preset path or movement algorithm using a moving unit, and the image information may be acquired by the collecting unit. As previously described, the collecting unit may include a lidar and a camera, and may acquire image information in three-dimensional space.

[0054] In the step of generating object information (S320), object information including the object location and object type of an object existing within the service space can be generated based on image information. The object location may be, for example, coordinates that specify the location of the object within the service space.

[0055] Object types are analyzed based on image data and can identify the types of furniture or home appliances present in the service space, as well as various other items used by users in their daily lives. To identify object types, image data can be transmitted to a server, and artificial intelligence algorithms, including machine learning, deep neural networks, and convolutional neural networks, used in image analysis, can be utilized.

[0056] In this embodiment, object information may further include mobility information. The mobility information may be generated based on image information and the object type identified from the image information. The mobility information may be information that classifies objects as either mobile or fixed, depending on their movability. Fixed objects may be walls or pillars forming a service space, or objects installed to be fixed to walls, pillars, floors, or ceilings. Furthermore, mobile objects may include objects whose positions can be moved by the user, such as chairs or movable home appliances.

[0057] Meanwhile, object information may further include object size. Object size may be information regarding the size or volume of the object within the service space. Object size may, for example, be the length in each direction in three-dimensional space, the volume occupied in three-dimensional space, or may be inferred from image information. In this case, image information may include a point cloud of the object acquired by a three-dimensional camera while the care robot moves around the specified object. To efficiently generate object information, object size information may only be generated for the previously described moving objects.

[0058] In the step (S330) of generating a smart map, multiple living areas are generated based on object information, and a smart map including the object information and living areas is generated. The smart map may include a two-dimensional or three-dimensional map of a service space providing care services, and may be generated based on image information acquired from a collection unit. However, the smart map may also be generated based on data received from an external device or server, such as a floor plan of the service space. The generated smart map may be included in a database stored in a care robot or a server connected to the care robot.

[0059] In this embodiment, multiple living areas correspond to information that classifies service spaces. Each living area may be named, for example, bedroom, kitchen, living room, etc. Living areas can be created based on object information. Specifically, the types of objects can be identified from image information, and the attributes of spaces separated by pillars or walls can be specified. Object information, including the object location relative to a door recognized from image information, can be utilized as a criterion for distinguishing living areas.

[0060] Using an AI model, attributes can be inferred from the types of objects present in a given space (e.g., space type based on purpose, such as bedroom, kitchen, living room, etc.). In addition to processing image information into an image model, a language model can be used to derive attributes of a living space from the types of objects.

[0061] A smart map may include three-dimensional spatial information about the service space itself, as well as object information and living areas. That is, a smart map generated according to this embodiment may include the shape and size of the service space, as well as a list and location of the user's objects within the service space. It may also include the spatial divisions and names (purposes) of each living area within the service space.

[0062] Referring to FIG. 4, a smart map generated according to the present embodiment may include a living area such as a bedroom with multiple beds (bed1 to bed7) and a bathroom (toilet1 and toilet2). In addition, object information such as furniture and home appliances may be included. A bed, a sofa (couch1, couch2), an oven (oven1), a microwave oven (microwave1), etc. may be included as moving objects in the object information, and a sink (sink1, sink2), etc. may be included as fixed objects in the object information.

[0063] Meanwhile, the method according to the present embodiment may further include a step of updating the smart map to detect changes in object information. Changes in object information can be detected by comparing the object information used to generate the smart map with image information updated after the smart map was generated.

[0064] The step of updating the smart map may include collecting updated image information. Here, the updated image information may be acquired while the care robot navigates the service space to provide care services based on a previously generated smart map. In particular, the updated image information need not cover the entire service space, but may cover a portion of the service space or a portion of the living area.

[0065] Additionally, the step of updating the smart map may further include a step of removing an object from the service space based on the object size if at least a part of the object included in the object information is not identified in the updated image information.

[0066] Furthermore, the step of updating the smart map may further include a step of checking fluidity information to determine whether the identified object is a fluid object, if at least a part of the object is identified at a location other than the object location included in the object information from the updated image information.

[0067] In addition, if the identified object is a fluid object, the method may further include a step of updating the object location in the service space based on the object size, and if the identified object is not a fluid object, a step of generating new object information. In other words, new object information may be generated and the object information may be updated.

[0068] The above steps enable the smart map to be quickly updated even when the care robot does not travel through the entire service area. By utilizing object information stored in the database, simply updating the image data for either the location where an object is missing or where an object appears can update the object information for the remaining locations. Therefore, while the care robot is providing care services to users, information about locations where the care robot is not present can also be quickly updated.

[0069] In the step (S340) of generating a movement path of the care robot of the present embodiment, a movement path of the care robot for performing a care service is generated based on a smart map. That is, a movement path that approaches a user to whom the care service is to be provided or an object related to the care service can be generated. Here, the movement path may include not only a path to a single destination, but also the time to move to the destination, multiple stopovers, the time to move to and stay at multiple stopovers, multiple destinations and movement times, movement priorities, etc.

[0070] Specifically, based on the generated or updated smart map, a movement path can be generated to avoid objects that may obstruct the movement of the care robot or cause a dangerous situation such as a collision.

[0071] Additionally, based on a smart map containing object information, a route can be generated that reflects the task priorities for providing care services. For example, if a pet is recognized at a location where a specific task is to be performed, a route can be generated to facilitate the next or safer task.

[0072] By utilizing the movement path according to the smart map of this embodiment, the care robot can utilize the actual space usage and information on objects currently existing in the space rather than a fixed path in space, thereby enabling the provision of accurate and flexible care services.

[0073] Meanwhile, the object information generated in this embodiment may further include collection position information regarding the shooting position and shooting direction of the object being photographed. In this regard, the care robot according to this embodiment may be configured to control the shooting direction of the collection unit to be rotated vertically (tilted), the shooting direction of the collection unit to be rotated horizontally (panned), or the shooting height of the collection unit to be raised or lowered.

[0074] The collection location information may specify a location where the care robot can effectively identify the object to be photographed or observed. For example, if the object type is a bed, the collection location information may be designated as in front of the bed, i.e., a location and direction that can easily determine whether the user is sleeping. Additionally, if the object type is a gas range, the collection location information may include a location and direction that overlooks the burner (top surface) of the gas range, which can be added to the object information for the gas range.

[0075] Additionally, the collected location information may include information about the shooting location and shooting direction in a living space. For example, in a living room, the location and direction from which the user can clearly see the sofa, which is frequently used by users, may be stored in the collected location information.

[0076] Furthermore, the collected location information may be adjusted if the user is determined to be close to the object being photographed or is using the object being photographed. For example, if the user is recognized as sitting at a table eating, the care robot's location and direction for photographing the table may be set at a height and angle that allows it to look down on the table while avoiding the user. This allows the care robot to collect image information about the food or menu being consumed.

[0077] In addition, as an example, when driving to a location where object information such as a chair or robot vacuum cleaner has been confirmed on a smart map, the collected location information of the chair or robot vacuum cleaner may be set in a direction facing the ground, so that the care robot can be controlled to take pictures of the ground direction when moving near the object.

[0078] That is, by including the collected location information in the object information, the accuracy of observing the object can be improved, and as the accuracy increases, there is an advantage in that the care services that the care robot can provide become more diverse.

[0079] Meanwhile, FIG. 5 is a flowchart for performing a reinforced observation step according to one embodiment of the present invention.

[0080] Referring to Figure 5, first, in the step of generating object information described above, risk information and crime prevention information can be further generated (S510).

[0081] That is, the object information in this embodiment may further include risk information. Risk information may be generated based on the degree to which an object may cause a safety accident within the service space. Risk information can be inferred from the object type. For example, if the object type is inferred to be a heat-producing object, such as a gas range, oven, microwave, or hair dryer, the risk information value may be high. Furthermore, objects with a risk of breaking, such as ceramics, flower pots, glass, and mirrors, may have high risk information values.

[0082] Additionally, object information may further include security information. Security information may include information on objects that allow access between the interior and exterior of the service space, and / or objects requiring attention to theft. Objects that allow access may include front doors, windows, etc., while objects requiring attention to theft may be expensive or valuable items identified through video footage, or objects designated by the user to be captured in advance by the care robot.

[0083] The movement path generated according to this embodiment may be further based on risk information and / or security information (S520). The movement path may include at least one of the observation target, observation location, observation cycle, and observation priority for which image information is collected by the care robot.

[0084] For example, a movement path reflecting risk information may reflect the observation location, observation cycle, and observation priority of a care robot capable of observing objects with risk information values ​​exceeding a preset level, such as a gas range. Furthermore, a movement path reflecting crime prevention information may target objects included in the crime prevention information, and reflect the location, cycle, and observation priority of the objects to be observed.

[0085] The care robot, moving along the generated path, can analyze changes in the appearance of the observed object based on image information collected at each observation location during each observation period (S530). This enhanced observation step allows for analysis of changes in object information at a higher resolution than when creating or updating a smart map.

[0086] Furthermore, if the care robot is configured to collect sound information via a microphone or other means that may be included in the collection unit, the sound information can be further analyzed. The sound information can be used to detect the occurrence of a predefined type of risk event using an artificial intelligence algorithm.

[0087] The occurrence of a risk event may include, for example, the detection of a sound volume exceeding a preset level, the sound of an object of the type included in the object information breaking, or the identification of a user's loud voice. In the method according to the present embodiment, if the occurrence of such a risk event is detected, the care robot may move to the observation location of the relevant object or to a location where the user is expected to be present, and collect image information.

[0088] The smart map generated and updated according to this embodiment can include a risk distribution within a living area (or service space) based on object information containing risk information. For example, a living area containing objects with a risk of heat generation or breakage may be assigned a relatively high risk level. Furthermore, locations where objects with potential fire, electrical, or fall risks are identified may be assigned a high risk level.

[0089] Through risk information, crime prevention information, and risk distribution, users can be informed of various potential risks within their living areas and respond quickly to emergencies. In particular, care services can be provided to help ensure the safety of the elderly and others.

[0090] Figure 6 is a flowchart of steps for generating and utilizing pattern information according to one embodiment of the present invention.

[0091] Referring to FIG. 6, the method for providing care services based on a smart map according to the present embodiment may further include a step (S610) of generating pattern information. The pattern information is generated based on the update history of the smart map over a preset period, and may be generated by accumulating changes in the location of an object over time.

[0092] In addition, the method for providing care services based on a smart map according to the present embodiment may further include a step (S620) of generating event information for predicting the activity of a user living within a service space at an expected time and location based on pattern information.

[0093] Next, the method for providing care services based on a smart map according to the present embodiment may further include a step (S630) of moving the care robot to an expected location at an expected time based on event information to determine whether there is user activity that matches actual event information. If it is determined that there is user activity that matches actual event information, the care robot may provide care services related to the user activity. Furthermore, if it is determined that there is no user activity that matches actual event information, the pattern information and / or event information may be modified.

[0094] For example, if a user exercises in the living room on a specific day or at a specific time, exercise equipment that was previously located in the corner of the living room may be located in the center of the living room at that time. In the step of generating pattern information (S610), a pattern of changes in the position of an object according to the time of the exercise equipment can be generated as pattern information.

[0095] In the step of generating event information (S620), event information indicating that there is a high probability that an event called “user exercise” will occur at “3 PM” (expected time) in the “living room” (expected location) can be generated based on pattern information about exercise equipment.

[0096] Based on event information, in step S630 of determining whether the user is active, the care robot may move to the living room and collect video or audio information. If the user is determined to be exercising, i.e., if there is activity matching the event information, the care robot may play music, display content related to exercise, or provide guidance to promote safe exercise based on object information, risk information, and risk distribution around the living room. Conversely, if the user is not detected to be exercising, the care robot may update or modify pattern information and / or event information to improve the accuracy of the care service.

[0097] In this way, the smart map according to this embodiment can reflect the user's daily patterns, enabling more personalized, predictive care services. When user activity is detected, prompt, customized services can be provided. When user activity is inactive, pattern information can be updated and event information can be modified.

[0098] Additionally, the method for providing care services based on a smart map according to the present embodiment may further include a step of generating preference information. The preference information may relate to the preferences of a user living within the service space based on object information including object types.

[0099] A user's preferences may include information about their occupation, hobbies, or leisure activities. For example, if the generated object information includes multiple flower pots, it could be inferred that the user enjoys gardening, or if the generated object information includes multiple pieces of exercise equipment, it could be inferred that the user enjoys exercising. By generating preference information, personalized content or product information can be provided to the user.

[0100] Figure 7 is a schematic diagram for explaining the configuration of a care robot according to one embodiment of the present invention.

[0101] Referring to FIG. 7, a care robot providing care services based on a smart map according to one embodiment of the present invention includes a moving unit (710), a collecting unit (720), an object information generating unit (730), a smart map generating unit (740), and a moving path generating unit (750).

[0102] In addition, the care robot according to the present embodiment may further include an output unit (760), and although not specifically illustrated in FIG. 7, may further include an integrated control unit, a database, a communication unit, etc.

[0103] As described in detail above, the moving unit (710) is configured to drive in a service space, and the collecting unit (720) is configured to collect image information obtained by driving in the service space.

[0104] As shown in Fig. 7, the collection unit (720) may include a shooting unit (721) including a camera, etc. as described above, and a shooting control unit (722) that controls the shooting unit (721). The shooting control unit (722) may control the shooting unit (721) to tilt, pan, and elevate. In addition, the output unit (760) may include a display unit (761) and a speaker unit (762). The display unit (761) may transmit visual information to a user, etc., and the speaker unit (762) may transmit auditory information to a user, etc.

[0105] The object information generation unit (730) of the care robot according to this embodiment generates object information including object location, object type, and fluidity information existing within the service space.

[0106] The smart map generation unit (740) of the present embodiment generates multiple living areas within a service space based on object information and generates a smart map including the living areas and object information. Furthermore, the smart map generation unit (750) of the present embodiment can update the smart map by detecting changes in object information by comparing the generated object information with newly acquired updated image information.

[0107] The movement path generation unit (750) generates a movement path of a care robot for performing care services based on a smart map. The movement path may specify the work schedule of the care robot performing the care service, including space and time / priority.

[0108] As described above, the steps of the method for providing care services based on a smart map according to one embodiment of the present invention may be further divided into additional steps or combined into fewer steps, depending on the implementation of the present invention. Furthermore, some steps may be omitted as needed, or the order of steps may be reversed.

[0109] The foregoing description of the present invention is for illustrative purposes only, and those skilled in the art will readily appreciate that the present invention can be readily modified into other specific forms without altering the technical spirit or essential characteristics of the present invention. Therefore, the embodiments described above should be understood as illustrative in all respects and not restrictive. For example, each component described as a single entity may be implemented in a distributed manner, and similarly, components described as distributed may be implemented in a combined manner.

[0110] The scope of the present invention is indicated by the claims described below rather than the detailed description above, and all changes or modifications derived from the meaning and scope of the claims and their equivalent concepts should be interpreted as being included in the scope of the present invention.

[0111] According to the present invention, care services such as provision of various contents including various life notifications, medication reminders, cognitive training, monitoring and reporting of abnormal activities and emergency situations, exercise assistance, detection and notification of risk factors in living spaces, etc. can be provided to the care recipient based on a smart map generated for the care recipient's indoor space.

Claims

1. In a method for a care robot to provide care services based on a smart map, A step of collecting image information obtained by driving through a service space providing the above care service; A step of generating object information including object location and object type regarding an object existing in the service space based on the image information; A step of creating a plurality of living areas within the service space based on the object information, and creating a smart map including the living areas and the object information; and A method for providing care services based on a smart map, comprising a step of generating a movement path of the care robot for performing the care services based on the smart map.

2. In paragraph 1, A method for providing care services based on a smart map, wherein the object information further includes collected location information regarding the shooting location and shooting direction of the object or living space being photographed.

3. In paragraph 2, A method for providing a care service based on a smart map, wherein the above-mentioned collected location information is such that the shooting location and shooting direction are readjusted when a condition is satisfied that a user living within the service space is close to the object being shot or is using the object being shot.

4. In paragraph 1, The above object information further includes risk information generated based on the degree to which it may become a cause of a safety accident within the service space. A method for providing care services based on a smart map, wherein the above movement path is generated based on the risk information and includes at least one of an observation target, an observation location, an observation cycle, and an observation priority for collecting image information by the care robot.

5. In paragraph 1, The above object information further includes security information including objects that enable entry and exit between the inside and outside of the service space or objects that require attention to theft. A method for providing care services based on a smart map, wherein the above movement path is generated based on the crime prevention information and includes at least one of an observation target, an observation location, an observation cycle, and an observation priority for which image information is to be collected by the care robot.

6. In paragraph 4 or paragraph 5, A method for providing care services based on a smart map, further comprising an enhanced observation step of analyzing changes in the appearance of the observation subject based on image information collected at the observation location for each observation period.

7. In paragraph 4 or paragraph 5, A method for providing care services based on a smart map, wherein when the occurrence of a predetermined type of risk event is detected from collected sound information, the method moves to the observation location and collects image information.

8. In paragraph 1, The above object information further includes risk information generated based on the degree to which it may become a cause of a safety accident within the service space, and security information including objects that enable entry and exit between the inside and outside of the service space or objects that require caution against theft. A method for providing a care service based on a smart map, wherein the smart map further includes a risk distribution for the service space generated based on the risk information and the crime prevention information.

9. In paragraph 1, A method for providing care services based on a smart map, further comprising a step of moving to a position where the object location and the surrounding area of ​​the object location can be photographed, and checking whether a user living in the service space performs an activity related to the type of object at the object location.

10. In paragraph 1, A step of comparing the object information with the image information updated as the care robot moves along the movement path, thereby generating pattern information that accumulates changes in the object location over time; and A method for providing care services based on a smart map, further comprising a step of generating event information predicting the activity of a user living within the service space at an expected time and location based on the above pattern information.

11. In paragraph 10, A method for providing care services based on a smart map, further comprising the step of moving to the expected location at the expected time based on the event information and checking whether there is any activity of the user that matches the actual event information.

12. In paragraph 11, A method for providing a care service based on a smart map, wherein if it is determined that there is activity of a user that matches the above event information, a care service related to the activity of the user is provided, and if it is determined that there is no activity of the user that matches the above event information, at least one of the pattern information and the event information is modified.

13. In paragraph 1, A method for providing a care service based on a smart map, wherein the object information further includes object size regarding the size or volume that the object occupies in the service space, and fluidity information classifying the object as a fluid object or a fixed object depending on whether the object can move.

14. In paragraph 1, A step of generating taste information about the taste of a user living in the service space based on the object information; and A method for providing care services based on a smart map, further comprising the step of generating recommended product or service information based on the above preference information and guiding the user to the recommended product or service information.

15. In a care robot that provides care services based on a smart map, A mobile unit configured to drive through a service space providing the above care service; A collection unit that collects image information obtained by driving through the above service space; An object information generation unit that generates object information including object location and object type regarding an object existing in the service space based on the image information; A smart map generation unit that generates a plurality of living areas within the service space based on the object information and generates a smart map including the living areas and the object information; and A care robot that provides care services based on a smart map, comprising a movement path generation unit that generates a movement path of the care robot for performing the care services based on the smart map.

Images