Living support system, living support method, and living support program

Abstract

To predict what a user tries to put around.SOLUTION: A life support system includes: an acceptance unit for accepting user situation specifying information that specifies a situation of a user; a processing unit for grasping what the user has requested based on the user situation specifying information accepted by the acceptance unit; and a providing unit for providing the user with what is grasped by the processing unit. The processing unit has performed machine learning about a relation between the user situation specifying information and what is requested by the user, and grasps what the user requests relative to the user situation specifying information accepted by the acceptance unit using results of the machine learning.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present invention relates to a life support system, a life support method, and a life support program.

Background Art

[0002] Currently, the use of mobile devices such as mobile robots in homes, offices, etc. is increasing. For example, in homes, the spread of robot vacuum cleaners is progressing due to the increase in dual-income households and elderly households. In addition, the mobile device moves within a building and acquires the articles stored in the storage location. Regarding the storage location, a technique for increasing the living space by reducing the storage locations of articles in a house is known (see, for example, Patent Document 1). This technique includes a plurality of lockers installed in a predetermined area, a locker management center that manages the usage status of the plurality of lockers by a user, a warehouse that stores the articles stored in any of the plurality of lockers for a predetermined period based on the user's request, and a delivery center that delivers the articles stored based on the user's request to the warehouse and manages the delivery of the articles taken out from the warehouse to a location designated by the user.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the above-described technique, the articles are taken out from the warehouse based on the user's request and delivered to the location designated by the user. However, it is impossible to predict what the user will place around him / herself.

[0005] The present invention has been made in view of the above-described problems, and an object thereof is to provide a life support system, a life support method, and a life support program capable of predicting what a user intends to place around himself / herself.

Means for Solving the Problems

[0006] (1) To solve the above problems, an embodiment of the present invention includes a reception unit that receives user situation specifying information for specifying a user's situation, a processing unit that grasps what the user is requesting based on the user situation specifying information received by the reception unit, and a provision unit that provides what the processing unit has grasped to the user. The processing unit has learned the relationship between the user situation specifying information and what the user is requesting, and uses the result of the machine learning to grasp what the user is requesting for the user situation specifying information received by the reception unit. It is a life support system.

[0007] According to the life support system according to this embodiment, the life support system receives user situation specifying information for specifying a user's situation. The user situation specifying information includes image information, temperature information, humidity information, illuminance information, body temperature information, pulse wave information, and the like. The life support system has learned the relationship between the user situation specifying information and what the user is requesting. The life support system uses the result of the machine learning (learning model) to grasp what the user is requesting based on the received user situation specifying information. The life support system provides what it has grasped to the user. In this way, the life support system creates a learning model by machine learning the relationship between the user situation specifying information and what the user is requesting. Since the life support system can use the created learning model to grasp what the user is requesting based on the user situation specifying information, it can predict what the user intends to place around himself / herself.

[0008] (2) In one embodiment of the present invention, in the above-described life support system, the processing unit may update the relationship between the user situation specifying information and what the user requests based on the result of the providing unit providing what the processing unit has grasped to the user.

[0009] By configuring in this way, the processing unit obtains the result of the providing unit providing what the processing unit has grasped to the user. Since the processing unit can update the relationship between the user situation specifying information and what the user requests based on the result of the providing unit providing what the processing unit has grasped to the user, the accuracy of what the user requests that can be grasped based on the user situation specifying information can be improved compared to the case where it is not updated.

[0010] (3) In one embodiment of the present invention, in the above-described life support system, it may further include a determination unit that determines the storage location of the thing grasped by the processing unit, a moving unit, and an instruction unit that instructs the moving unit to move the life support system to the storage location of the thing determined by the determination unit.

[0011] By configuring in this way, the life support system further includes a determination unit that determines the storage location of the thing grasped by the processing unit, a moving unit, and an instruction unit. Therefore, the life support system can move to the determined storage location.

[0012] (4) In one embodiment of the present invention, in the above-described life support system, the storage location may be an outdoor storage space.

[0013] By configuring in this way, since the life support system can obtain things from the outdoor space which is the storage location, the storage locations of articles in the house can be reduced. Therefore, the living space can be increased.

[0014] (5) In one embodiment of the present invention, in the above-described life support system, it may further include a charging unit that charges for what is acquired from the storage location or what is provided by the providing unit. By configuring in this way, since it is possible to charge for what is acquired from the storage location or what is provided, the life support system can be provided by selling things.

[0015] (6) In one embodiment of the present invention, in the above-described life support system, the charging unit charges based on the result of the providing unit providing what is acquired from the storage location to the user or the result of the providing unit providing what it possesses to the user. By configuring in this way, the life support system can charge based on the result of providing what is acquired from the storage location to the user or the result of providing what it possesses to the user. For this reason, if, as a result of providing what is acquired from the storage location to the user or providing what it possesses to the user, the user does not need the thing, no charge is imposed. Therefore, compared with the case where a charge is imposed when acquired from the storage location or when providing what it possesses to the user, it is possible to prevent charging for unnecessary things.

[0016] (7) In one embodiment of the present invention, in the above-described life support system, it may further include an ordering unit that orders the thing when the determination unit determines that the thing is not in the storage location. By configuring in this way, the life support system can order the thing when the determination unit determines that the thing is not in the storage location. For this reason, the thing can be acquired without the user ordering it.

[0017] (8) In one embodiment of the present invention, in the above-described life support system, the providing unit may store the thing in the storage location determined by the determination unit. By configuring it in this way, the life support system can store the item in the storage location determined by the determination unit. Therefore, the user can store the item without storing it in the storage location.

[0018] (9) One embodiment of the present invention is a life support method executed by a computer, comprising the steps of receiving user situation specific information for specifying a user's situation, grasping what the user requests based on the user situation specific information obtained in the receiving step, and providing what is grasped in the grasping step to the user. In the grasping step, the result of machine learning of the relationship between the user situation specific information and what the user requests is used to grasp what the user requests for the user situation specific information received in the receiving step. According to the life support method according to one embodiment of the present invention, it is substantially the same invention except that the category is different from that of the life support system, and has the same operations and effects.

[0019] (10) One embodiment of the present invention is a life support program for causing a computer to execute the steps of receiving user situation specific information for specifying a user's situation, grasping what the user requests based on the user situation specific information received in the receiving step, and providing what is grasped in the grasping step to the user. In the grasping step, the result of machine learning of the relationship between the user situation specific information and what the user requests is used to cause the computer to grasp what the user requests for the user situation specific information received in the receiving step. According to the life support program according to an embodiment of the present invention, the life support program causes a computer to create a learning model by machine learning the relationship between user situation identification information and what the user requests. The life support program uses the learning model created by the computer to predict what the user will place around them based on the user situation identification information in order to grasp what the user requests.

Effect of the Invention

[0020] According to the present invention, the life support system creates a learning model by machine learning the relationship between user situation identification information and what the user requests, and uses the created learning model to grasp what the user requests based on the user situation identification information, so that it is possible to predict what the user will place around them.

Brief Description of the Drawings

[0021]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Mode for Carrying Out the Invention

[0022] Next, the life support system, life support method, and life support program of the present embodiment will be described with reference to the drawings. The embodiments described below are merely examples, and the embodiments to which the present invention is applied are not limited to the following embodiments. In all the drawings for explaining the embodiments, those having the same function are denoted by the same reference numerals, and repeated explanations are omitted. In addition, “based on XX” as used in the present application means “based on at least XX”, and includes cases where it is based on another element in addition to XX. Also, “based on XX” is not limited to the case where XX is directly used, and includes cases where it is based on something obtained by performing operations or processing on XX. “XX” is an arbitrary element (for example, arbitrary information).

[0023] (Embodiment) (Life Support System) FIG. 1 is a diagram showing a configuration example of a life support system according to an embodiment of the present invention. In FIG. 1, the life support system 1 includes a life support device 100. In FIG. 1, in addition to the life support device 100, users U1, ···, Un (n is an integer greater than 0) who receive life support by the life support device 100 are shown. Among users U1 to Un, any user is described as user U. The life support device 100 performs the following processing for each of users U1 to Un. The life support device 100 receives information for specifying the situation of user U (hereinafter referred to as “user situation specifying information”). The user situation specifying information includes time information, image information, temperature information, humidity information, illuminance information, body temperature information, pulse wave information, odor information, and the like.

[0024] Based on the received user situation identification information, the life support device 100 grasps what the user U requests. The life support device 100 has learned the relationship between the user situation identification information and what the user U requests, and stores the result of this machine learning (learning model). The life support device 100 uses the learning model to input the received user situation identification information into the learning model, and obtains information that identifies what the user U requests output by the learning model. The life support device 100 grasps what the user U requests based on the obtained information that identifies what the user U requests. Here, "thing" includes abstract things and objects. An object refers to a tangible thing other than a person having a personality that is the subject matter of a right. The life support device 100 provides what it has grasped to the user U. Hereinafter, the life support device 100 included in the life support system 1 will be described.

[0025] FIG. 2 is a diagram showing details of the life support device included in the life support system according to the present embodiment. (Life support device 100) The life support device 100 is a robot and is realized by including devices such as a personal computer, a server, a smartphone, a tablet computer, or an industrial computer. The life support device 100 includes, for example, a sensor unit 102, an imaging unit 104, a reception unit 106, a processing unit 108, a provision unit 112, and a storage unit 150. It may be realized by one or a plurality of devices having at least a part of the sensor unit 102, the imaging unit 104, the reception unit 106, the processing unit 108, the provision unit 112, and the storage unit 150. At least a part of the sensor unit 102, the imaging unit 104, the reception unit 106, the processing unit 108, the provision unit 112, and the storage unit 150 may be realized as a part of another device. The sensor unit 102 includes a temperature sensor, a humidity sensor, an illuminance sensor, a body temperature sensor, a pulse wave sensor, an odor sensor, a voice sensor, a position sensor, etc. The sensor unit 102 outputs the result (temperature information) measured by the temperature sensor to the reception unit 106. The sensor unit 102 outputs the result (humidity information) measured by the humidity sensor to the reception unit 106. The sensor unit 102 outputs the result (illuminance information) measured by the illuminance sensor to the reception unit 106. The sensor unit 102 outputs the result (body temperature information) measured by the body temperature sensor to the reception unit 106. The sensor unit 102 outputs the result (pulse wave information) measured by the pulse wave sensor to the reception unit 106. The sensor unit 102 outputs the result (odor information) measured by the odor sensor to the reception unit 106. The sensor unit 102 outputs the result (voice information) measured by the voice sensor to the reception unit 106. The sensor unit 102 outputs the result (position information) measured by the position sensor to the reception unit 106.

[0026] The imaging unit 104 acquires one or more pieces of image information by imaging the periphery of the life support device 100. The imaging unit 104 outputs the acquired one or more pieces of image information to the reception unit 106. The reception unit 106 acquires at least one of the temperature information, humidity information, illuminance information, body temperature information, pulse wave information, odor information, voice information, and position information output by the sensor unit 102. The reception unit 106 acquires one or more pieces of image information output by the imaging unit 104. The reception unit 106 receives user situation specific information such as at least one of the acquired temperature information, humidity information, illuminance information, body temperature information, pulse wave information, odor information, voice information, and position information, and one or more pieces of image information.

[0027] The processing unit 108 includes a learning model 110. The learning model 110 is a learned model obtained by learning the relationship between the user situation specific information and what the user U requests based on the user situation specific information and what the user U requests by machine learning or deep learning. For example, during the learning stage, when user U performs an action using a certain item, information associating information identifying user U, time information, information identifying the item, information identifying the action, information identifying the location, and user situation identification information is obtained, for example, by a home gateway. Here, the information for identifying the item includes the name of the item and the category of the item. The processing unit 108 obtains the information acquired by the home gateway and creates a learning model 110 by performing machine learning or deep learning on the acquired information. For example, the processing unit 108 may perform learning using teacher data that sets the user situation identification information and the information for identifying the action of user U corresponding to this user situation identification information as one set. The processing unit 108 obtains user situation identification information such as at least one of time information, temperature information received by the reception unit 106, humidity information, illuminance information, body temperature information, pulse wave information, odor information, voice information, and position information, and one or more pieces of image information. The processing unit 108 inputs the acquired user situation identification information into the learning model 110.

[0028] The learning model 110 calculates what user U is requesting based on the input information and outputs the calculated result (what user U is requesting). Such a trained model can be constructed, for example, using CNN (Convolution Neural Network), RNN (Recurrent Neural Network), LSTM (Long Short-Term Memory), etc. The processing unit 108 obtains information identifying what user U is requesting, which is output by the learning model 110. Specifically, when it is identified by the user situation identification information that the father is sitting in front of the TV, the learning model 110 outputs information identifying alcohol as what the user (father) is requesting. Also, when it is determined by the user situation identification information that it is a work - from - home scheduled day, the learning model 110 outputs information identifying that it is necessary to prepare work supplies (PC, printer, stationery, power supply) around the desk as requested by user U. Also, when it is determined by the user situation identification information that it is a holiday, the learning model 110 outputs information identifying that it is necessary to prepare hobby supplies as requested by user U and replenish the inventory of consumables (copy paper, printer ink, stationery). Also, when it is determined by the user situation identification information that it is a break time, the learning model 110 outputs information identifying that it is necessary to prepare coffee and snacks as requested by user U.

[0029] The providing unit 112 is configured to include, for example, a single - arm robot, and acquires information identifying what user U requests, which is obtained by the processing unit 108. Based on the information identifying what user U requests that is acquired, the providing unit 112 provides what user U requests to user U. Specifically, when the providing unit 112 acquires information identifying alcohol as what user U requests, it provides alcohol to user U. Also, when the providing unit 112 acquires information identifying that it is necessary to prepare work supplies (PC, printer, stationery, power supply) around the desk as requested by user U, it prepares work supplies around the desk. Also, when the providing unit 112 acquires information identifying that it is necessary to prepare hobby supplies and replenish the inventory of consumables (copy paper, printer ink, stationery) as requested by user U, it prepares hobby supplies and replenishes the inventory of consumables. Also, when the providing unit 112 acquires information identifying that it is necessary to prepare coffee and snacks as requested by user U, it prepares coffee and snacks for user U.

[0030] The storage unit 150 is implemented by a HDD (Hard Disk Drive), a flash memory, a RAM (Random Access Memory), a ROM (Read Only Memory), or the like. The reception unit 106, the processing unit 108, and the provision unit 112 are realized, for example, by a hardware processor such as a CPU (Central Processing Unit) executing a computer program (software) stored in the storage unit 150. Further, some or all of these functional units may be realized by hardware (including a circuit unit; circuitry) such as an LSI (Large Scale Integration), an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or a GPU (Graphics Processing Unit), or may be realized by cooperation between software and hardware. The computer program may be stored in advance in a storage device such as a HDD (Hard Disk Drive) or a flash memory, or may be stored in a removable storage medium such as a DVD or a CD-ROM, and may be installed by mounting the storage medium on a drive device.

[0031] (Operation of the Life Support System 1) The operation of the life support system 1 will be described. FIG. 3 is a flowchart showing an example of the operation of the life support system according to the present embodiment. Here, as an example, the case where a learning model is created and stored in the life support device 100 will be described. (Step S1-1) In the life support device 100, the sensor unit 102 outputs at least one of temperature information, humidity information, illuminance information, body temperature information, pulse wave information, odor information, voice information, and position information to the reception unit 106. The imaging unit 104 acquires one or more pieces of image information by imaging the periphery of the life support device 100, and outputs the acquired one or more pieces of image information to the reception unit 106. (Step S2-1) In the life support device 100, the reception unit 106 receives at least one of temperature information, humidity information, illuminance information, body temperature information, pulse wave information, odor information, voice information, and position information output by the sensor unit 102, and one or more pieces of image information output by the imaging unit 104, etc., as user situation identification information.

[0032] (Step S3-1) In the life support device 100, the processing unit 108 acquires the user situation identification information received by the reception unit 106. The processing unit 108 inputs the acquired user situation identification information into the learning model 110. The learning model 110 calculates what the user U requests based on the input user situation identification information, and outputs the calculated result (what the user U requests). The processing unit 108 acquires information for identifying what the user U requests output by the learning model 110. (Step S4-1) In the life support device 100, the providing unit 112 acquires information for identifying what the user U requests acquired by the processing unit 108. The providing unit 112 provides what the user U requests to the user U based on the acquired information for identifying what the user U requests.

[0033] In the above-described embodiment, the case where the sensor unit 102 includes a temperature sensor, a humidity sensor, an illuminance sensor, a body temperature sensor, a pulse wave sensor, an odor sensor, a voice sensor, etc. has been described, but it is not limited to this example. For example, the sensor unit 102 may include at least one of a temperature sensor, a humidity sensor, an illuminance sensor, a body temperature sensor, a pulse wave sensor, an odor sensor, and a voice sensor. In the above-described embodiment, when the providing unit 112 provides the user U with what the user U has requested, the sensor unit 102 may acquire at least one of temperature information, humidity information, illuminance information, body temperature information, pulse wave information, odor information, voice information, and position information, and output at least one of the acquired temperature information, humidity information, illuminance information, body temperature information, pulse wave information, odor information, voice information, and position information to the receiving unit 106. The receiving unit 106 acquires at least one of the temperature information, humidity information, illuminance information, body temperature information, pulse wave information, odor information, voice information, and position information output by the sensor unit 102.

[0034] The processing unit 108 acquires information for specifying what has been provided from the providing unit 112 to the user U. The processing unit 108 acquires at least one of the temperature information, humidity information, illuminance information, body temperature information, pulse wave information, odor information, voice information, and position information acquired by the receiving unit 106. The processing unit 108 determines whether what has been provided to the user U is what the user U has requested based on at least one of the acquired temperature information, humidity information, illuminance information, body temperature information, pulse wave information, odor information, voice information, and position information, thereby obtaining the result of providing what the user U has requested to the user U. The processing unit 108 may update the relationship between the user situation specifying information and what the user requests in the learning model 110 based on the user situation specifying information, the information for specifying what the user U has requested, and the result of providing something to the user U. For example, when the result of providing something to the user U is positive (when what has been provided to the user U is what the user U has requested), the processing unit 108 uses teacher data that sets the user situation specifying information and the information for specifying what the user requests corresponding to this user situation specifying information as one set for learning.

[0035] According to the life support system 1 according to this embodiment, the life support device 100 includes a reception unit 106 that receives user situation identification information for identifying the situation of the user U, a processing unit 108 that grasps what the user U is requesting based on the user situation identification information received by the reception unit 106, and a provision unit 112 that provides what the processing unit 108 has grasped to the user U. The processing unit 108 has learned the relationship between the user situation identification information and what the user U is requesting, and uses the result of this machine learning to grasp what the user U is requesting for the user situation identification information received by the reception unit 106. By configuring it in this way, the life support system 1 can create the learning model 110 by machine learning the relationship between the user situation identification information and what the user U is requesting. Therefore, the life support system 1 can use the created learning model 110 to grasp what the user U is requesting based on the user situation identification information, and thus can predict what the user U will place around him / herself.

[0036] Also, in the life support system 1, the processing unit 108 may update the relationship between the user situation identification information and what the user U is requesting based on the result of the provision unit 112 providing what the processing unit 108 has grasped to the user U. By configuring it in this way, the processing unit 108 obtains the result of the provision unit 112 providing what the processing unit 108 has grasped to the user U. The processing unit 108 can update the relationship between the user situation identification information and what the user U is requesting based on the result of the processing unit 108 providing what the processing unit 108 has grasped to the user U. Therefore, compared with the case where it is not updated, the accuracy of what the user U is requesting that can be grasped based on the user situation identification information can be improved.

[0037] (Modification Example 1 of the Embodiment) The configuration example of the life support system 1a according to Modification Example 1 of the embodiment can apply FIG. 1. However, it is different from the life support system 1 according to the embodiment in that it includes the life support device 100a instead of the life support system 1. The living support device 100a determines the storage location of the items requested by the user U. When the item requested by the user U is to store an item in the storage location, the living support device 100a acquires the item to be stored and moves it to the determined storage location. The living support device 100a stores the acquired item in the storage location. When the item requested by the user U is to acquire an item, the living support device 100a moves to the determined storage location. The living support device 100a acquires the item from the storage location. The living support device 100a moves to the location where the user U is and provides the acquired item to the user.

[0038] An example of the storage location will be described. The case where an example of the storage location is provided in a detached house will be described. An example of the storage location is a pantry system. The pantry system is a pantry provided in the house and a pantry system equipped with a control unit. The pantry includes a first storage box and a control unit. The first storage box may be provided inside the pantry or the pantry itself. Also, the first storage box is provided with a first door. The first door is a door that connects the inside of the first storage box and the outside of the house. Also, the first door is provided with a first electronic lock that locks or unlocks the first door. The control unit is provided in at least one of the inside and outside of the pantry. Also, the control unit causes the first electronic lock to lock or unlock the first door based on the received operation. Thereby, the pantry system can suppress the intrusion of people from outside the house into the house through the first storage box regarding the use of home delivery items of foods and daily necessities that frequently occur daily, while improving the convenience of the residents of the house. Hereinafter, such a pantry system, pantry, and house in which the pantry is provided will be described in detail, but instead of the pantry, it may be provided as a shoe cabinet.

[0039] <Configuration of Pantry System> FIG. 4 is a diagram showing an example of the configuration of the pantry system. The pantry system 10 is an example of the aforementioned pantry system. The pantry system 10 includes a pantry P, a control device (not shown), an information processing device 12, and a mobile terminal 13. The pantry system 10 is a system that improves the convenience for people using the pantry P. For example, the pantry system 10 can reduce the labor of the person storing or storing items in the pantry P. Also, for example, the pantry system 10 can reduce the labor of the person taking out the items stored or stored in the pantry P. Also, for example, the pantry system 10 can place an order for the items to be supplied to the pantry P with the merchant according to the storage status or storage status of the items in the pantry P without receiving an operation by the person using the pantry. In addition, the pantry system 10 is a system that improves the safety of the house in which the pantry P is installed. For example, the pantry system 10 can suppress intrusion from outside the house into the house through the pantry P. Hereinafter, as an example, the case where the pantry system 10 is applied to the house H shown in FIG. 4 will be described. That is, in the pantry system 10 in this example, the pantry P is provided in the house H. Here, the house H where a certain resident lives means the inside of the locking area of the resident within the building where the resident lives. The locking area of the resident is an area within the building that can be locked by the resident to prohibit entry by people other than the resident. The number of rooms included in the locking area of the resident may be one or two or more. For example, when the building is a detached house, the house H includes the house. However, in this case, the house H does not include the area associated with the house. More specifically, in this case, the house H does not include, for example, the garden associated with the house, the area between the fence associated with the house and the house, etc. Also, for example, when the building is a certain condominium, the house H includes the dwelling unit where the resident lives in the condominium. However, in this case, the house H does not include the area outside the dwelling unit among the areas of the condominium. More specifically, in this case, the house H does not include, for example, the other dwelling units in the condominium, the shared parts such as the entrance in the condominium, etc. Note that when the resident lives in a building provided with a vestibule, the house H may be configured to include the inside of the vestibule or may not include the inside of the vestibule.

[0040] In the example shown in FIG. 4, the house H is a detached house. An outer wall is provided on the outer peripheral portion of the house H. Also, as shown in FIG. 4, the first floor portion of the house H has a substantially rectangular shape in plan view. A plurality of rooms are provided in the first floor portion of the house H. More specifically, in the first floor portion of the house H, the inside of the house H is partitioned into a plurality of rooms by a plurality of walls. At least a part of the walls located between adjacent rooms among the plurality of rooms is provided with an opening or a door for the resident to move between the rooms. Hereinafter, for convenience of explanation, a person living in the house H will be simply referred to as an occupant. Also, hereinafter, for convenience of explanation, the area inside the house H (that is, the area surrounded by the outer wall of the house H) will be referred to as inside the house H. Further, hereinafter, for convenience of explanation, the area outside the house H will be referred to as outside the house H. Note that the pantry system 10 may be configured to be applied to a building other than a house, such as a commercial building or a factory, instead of the house H. As shown in FIG. 4, the plurality of rooms provided in the first floor portion of the house H include, together with the aforementioned pantry P, an entrance, a kitchen, a dining room, a living room, a washroom, a bathroom, a toilet, etc. That is, the pantry P is one of the rooms provided in the first floor portion of the house H. Note that the pantry P may be one of the rooms provided in the second floor or higher portion of the house H. Hereinafter, the pantry system 10 will be described by taking the first floor portion of the house H where the pantry P is provided as an example. For this reason, hereinafter, for convenience of explanation, the first floor portion of the house H will be simply referred to as the house H. Here, the three-dimensional coordinate system HC shown in FIG. 4 is a coordinate system indicating the directions related to the house H. The positive direction of the Z axis in the three-dimensional coordinate system HC indicates the direction from the floor surface of the house H toward the ceiling surface of the house H among the directions orthogonal to the floor surface of the house H. Also, the positive direction of the Y axis in the three-dimensional coordinate system HC indicates the direction from inside the house H toward outside the house H among the directions orthogonal to the entrance wall. The entrance wall is the outer wall of the house H in which the entrance door G is provided. The entrance door G is the door of the entrance of the house H. Further, the positive direction of the X axis in the three-dimensional coordinate system HC indicates the direction from the right side of the entrance door G to the left side of the entrance door G when viewing the entrance wall from outside the house H among the directions orthogonal to each of the Y axis and the Z axis. Pantry P is an example of the aforementioned pantry. Pantry P is a room among the rooms provided in house H for storing items desired by the occupants. Such items include, for example, food and drinks, daily necessities, cooking utensils, tableware, etc. Also, pantry P is a room for storing and keeping the home deliveries delivered by the delivery person. Below, as an example, the case where the home delivery is food and drinks will be described. Note that the home delivery may be other items that can be stored and kept in pantry P, such as daily necessities, cooking utensils, tableware, sundries, clothing, etc., instead of food and drinks.

[0041] Also, pantry P is provided in house H so as to be adjacent to the room desired by the occupants among the rooms provided in house H. Also, pantry P is provided in house H so as to be adjacent to the outer wall desired by the occupants among the outer walls that house H has. The desired room includes at least one of kitchen, dining, and living. This includes rooms that coexist in one, such as living-dining (LD), living-dining-kitchen (LDK), and dining-kitchen (DK). That is, living and dining each include living-dining. Also, each of living, dining, and kitchen includes living-dining-kitchen. Also, each of kitchen and dining includes dining-kitchen. In the example shown in FIG. 4, the desired room includes kitchen KC. That is, in this example, pantry P is adjacent to kitchen KC. Note that the desired room may include other rooms desired by the occupants in view of convenience among a part or all of the kitchen, dining, and living, instead of a part or all of them, among the plurality of rooms provided in house H. Also, in the example shown in FIG. 4, the desired outer wall is the outer wall on the positive X-axis side in the three-dimensional coordinate system HC among the outer walls that house H has. In addition, the pantry P includes a first storage box B1. The first storage box B1 is provided inside the pantry P. The first storage box B1 is a box for storing and keeping the delivered parcels by the delivery person inside the pantry P. The first storage box B1 is provided inside the pantry P so as to be adjacent to the outer wall of the house H to which the pantry P is adjacent. The first storage box B1 is, for example, a rectangular parallelepiped box. Note that the shape of the first storage box B1 may be other shapes instead of the rectangular parallelepiped shape. Also, the first storage box B1 may be a walk-in type box. In other words, the volume of the first storage box B1 may be a volume equal to or larger than the volume that a person can enter. When the first storage box B1 is a walk-in type box, in the pantry system 10, a person who takes in and out the parcels (for example, a resident, a delivery person who delivers the parcels, etc.) can easily take in and out the parcels stored in the first storage box B1. That is, the pantry system 10 can improve the convenience for the person who takes in and out the parcels. Note that the first storage box B1 may not be a walk-in type box. That is, the volume of the first storage box B1 may be a volume that a person cannot enter. In addition, the first storage box B1 includes a first door D1 and a second door D2. The first door D1 is an example of the aforementioned first door. The first door D1 is a door that connects the inside of the first storage box B1 and the outside of the house H. For example, an opening that leads from the outside of the house H to the inside of the first storage box B1 is formed in the portion of the outer wall of the house H adjacent to the first storage box B1. And the first door D1 is provided on the side surface so as to close the opening. In the pantry P, the side surface of the first storage box B1 may be configured to be formed by this portion. In this case, the opening that leads from the outside of the house H to the inside of the first storage box B1 is formed on the side surface.

[0042] When the first door D1 is opened, the inside of the first storage box B1 is connected to the outside of the house H. On the other hand, when the first door D1 is closed, the inside of the first storage box B1 is disconnected from the outside of the house H. Thus, for example, a delivery person delivering a package to the house H can store the package inside the first storage box B1 by opening the first door D1 from outside the house H. Also, the first door D1 is provided with a first electronic lock K1. The first electronic lock K1 is an example of the aforementioned first electronic lock. The first electronic lock K1 is provided on the first door D1. The first electronic lock K1 is controlled by a control device to lock or unlock the first door D1. The second door D2 is an example of the aforementioned second door. The second door D2 is a door that connects the inside of the first storage box B1 and a desired room within the house H. For example, an opening that leads from the desired room to the inside of the first storage box B1 is formed in the surface of the first storage box B1 that is adjacent to the desired room. And the second door D2 is provided on that surface so as to close the opening. In the example shown in FIG. 4, that surface is the side surface on the negative Y-axis side in the three-dimensional coordinate system HC among the side surfaces of the first storage box B1. When the second door D2 is opened, the inside of the first storage box B1 is connected to the desired room. On the other hand, when the second door D2 is closed, the inside of the first storage box B1 is disconnected from the desired room. Thus, for example, a resident can, by opening the second door D2 from within the house H, take out the package stored inside the first storage box B1 at the most suitable time for use, without being bothered by the movement of the package and without going outside the house H. As a result, the pantry system 10 can improve the convenience of the resident. Also, the second door D2 is provided with a second electronic lock K2. The second electronic lock K2 is an example of the aforementioned second electronic lock. The second electronic lock K2 is provided on the second door D2. The second electronic lock K2 is controlled by a control device to lock or unlock the second door D2.

[0043] With such a first storage box B1, the pantry P can store and preserve the home deliveries delivered by the delivery person. And the resident can take out the home deliveries stored and preserved in this way from the first storage box B1 in the house H at the most suitable time for use without being bothered by the movement of the home deliveries. Here, inside the first storage box B1, a member on which home deliveries such as a shelf board can be placed may or may not be provided. Also, the area may or may not be divided into a plurality of areas by a plate or the like. Further, the area inside the first storage box B1 may be configured to be provided with one or more boxes smaller in size than the first storage box B1, or may be configured not to be provided with any such box. Hereinafter, as an example, the case where the area inside the first storage box B1 is not divided into a plurality of areas will be described. The whole of the first storage box B1 may be one refrigerator, one freezer, one warm storage room, etc.

[0044] The control device controls the whole pantry P. The control device is an information processing device provided with a processor such as a CPU (Central Processing Unit) not shown in the figure. Also, the control device includes a storage unit not shown in FIG. 4 and a communication unit not shown in FIG. 4. The processor included in the control device executes various programs stored in the storage unit. The storage unit includes, for example, HDD (Hard Disk Drive), SSD (Solid State Drive), EEPROM (Electrically Erasable Programmable Read-Only Memory), ROM (Read-Only Memory), RAM (Random Access Memory), etc. Note that the storage unit may be an external storage device connected to the control device by a digital input / output port such as USB instead of being built into the control device. The storage unit stores various information, various images, various programs, etc. processed by the control device. The communication unit is configured to include, for example, digital input / output ports such as USB, Ethernet (registered trademark) ports, and the like.

[0045] Note that the processor included in the control device may be another processor such as an FPGA (Field Programmable Gate Array) instead of a CPU. The control device causes the first electronic lock K1 to lock or unlock the first door D1 in response to an operation received from the resident via the information processing device 12. Further, the control device receives the operation from the resident via the information processing device 12 by wireless or wired communication. For example, the control device receives the operation from the resident via the information processing device 12 by wireless or wired communication.

[0046] In addition, when the control device causes the first electronic lock K1 to unlock the first door D1, the control device causes the second electronic lock K2 to lock the second door D2. Thereby, the control device can suppress intrusion from outside the house H into the house H through the first storage box B1. For example, as shown in FIG. 4, when the pantry P is adjacent to the kitchen KC and the second door D2 is open, if a delivery person comes and tries to unlock the first door D1, the first door D1 cannot be unlocked. This is for ensuring the safety of the resident. Note that the pantry P may be configured to be provided with a display unit that displays information indicating that the second door D2 is open to the delivery person in such a case, or may be configured to notify the information to a mobile terminal held by the delivery person.

[0047] In addition, when the control device receives an authentication key pre-issued from the control device or the information processing device to the mobile terminal from the mobile terminal 13, the control device performs authentication using the received authentication key. When the control device succeeds in the authentication, the control device causes the first electronic lock K1 to unlock the first door D1. That is, the mobile terminal 13 can unlock the first door D1 by the authentication. Thereby, the control device can suppress the first door D1 from being opened by an unintended person.

[0048] In addition, the control device places an order for the delivery of the package desired by the resident in accordance with the operation received from the resident via the information processing device 12. At this time, the control device 11 may be configured to place the order with the vendor that sells the package, with the management company that manages the house H, or with another vendor.

[0049] Here, in the example shown in FIG. 4, the control device is built into the pantry P. In other words, in this example, the pantry P includes the control device 11. That is, in this example, the pantry system 10 includes the pantry P equipped with the control device, the information processing device 12, and the mobile terminal 13. Note that the control device may be configured to be installed outside the pantry P instead of being built into the pantry P. The outside of the pantry P may be the outside of the pantry P within the house H or outside the house H. In such a case, the control device is communicably connected to each of the pantry P, the information processing device 12, and the mobile terminal 13 by wire or wirelessly. Also, for example, in such a case, the control device 11 may be configured to be connected to each of the pantry P, the information processing device 12, and the mobile terminal 13 via a communication network such as the Internet. Further, the functions of the control device 11 may be configured to be divided and provided in both the inside and the outside of the pantry P.

[0050] As described above, the information processing device 12 is an information processing device owned by the resident. The information processing device 12 is, for example, a notebook PC (Personal Computer), a desktop PC, a tablet PC, a multifunctional mobile phone terminal (smartphone), a mobile phone terminal, a PDA (Personal Digital Assistant), etc., but is not limited thereto. In the example shown in FIG. 4, the information processing device 12 is a notebook PC. For example, a dedicated application program PM for performing processing related to the pantry P is installed in the information processing apparatus 12. In this case, the resident can operate the control apparatus 11 via an operation screen among various screens displayed on the display of the information processing apparatus 12 when the application program PM is executed. Here, the operation screen is a screen for receiving operations for causing the control apparatus 11 to perform various processes. For example, the resident can cause the control apparatus 11 to display the first captured image on the display of the information processing apparatus 12 via the operation screen. Also, for example, the resident can cause the control apparatus 11 to place an order for the delivery of a package desired by the resident via the operation screen. The portable terminal 13 is, for example, a handheld computer of a delivery person who delivers a package. Note that the portable terminal 13 may be a tablet PC, a multifunctional mobile phone terminal, a mobile phone terminal, a PDA, or the like of the delivery person instead of the handheld computer. The portable terminal 13 receives an authentication key pre-issued by the control apparatus 11 or the information processing apparatus 12. The portable terminal 13 outputs the received authentication key to the control apparatus 11 by some method. Thereby, the delivery person can cause the control apparatus 11 to unlock the first door D1. As a result, the delivery person can open the first door D1 and store the package in the first storage box B1. Note that the method will be described later. In addition, when the pantry P is adjacent to the kitchen (kitchen KC in FIG. 4) as in the example shown in FIG. 4, foodstuffs and daily necessities delivered can be used directly in the kitchen immediately without being moved to a location near or inside the kitchen in advance from the storage box (the first storage box B1 or the second storage box B2) provided in the pantry P. When there are foodstuffs and daily necessities delivered daily, the convenience for the user can be particularly enhanced by the pantry P. Also, when the pantry P is adjacent to the kitchen (kitchen KC in FIG. 4) as in the example shown in FIG. 4, the distance for moving from the storage box to the refrigerator installed in the kitchen is short. For this reason, the pantry P can save the labor of carrying frozen and refrigerated foodstuffs and the like delivered to the pantry P. Even if the food delivered to the storage box is stored without being transferred to the refrigerator and used as a substitute for the secondary refrigerator until the food is used, since the kitchen and the pantry P are adjacent, the user can immediately take out the food from the pantry P when they want to use the food. Such an effect can also be obtained by the pantry P even when the pantry P is adjacent to the dining room, living room, etc.

[0051] Hereinafter, the life support device 100a included in the life support system 1a will be described. FIG. 5 is a diagram showing details of a life support device included in a life support system according to Modification 1 of the embodiment. (Life support device 100a) The life support device 100a is a robot and is realized by including devices such as a personal computer, a server, a smartphone, a tablet computer, or an industrial computer. The life support device 100a includes, for example, a sensor unit 102, an imaging unit 104, a reception unit 106, a processing unit 108, a provision unit 112a, a determination unit 114a, an instruction unit 115a, a movement unit 116a, and a storage unit 150a. It may be realized by one or a plurality of devices having at least a part of the sensor unit 102, the imaging unit 104, the reception unit 106, the processing unit 108, the provision unit 112a, the determination unit 114a, the instruction unit 115a, the movement unit 116a, and the storage unit 150a. At least a part of the sensor unit 102, the imaging unit 104, the reception unit 106, the processing unit 108, the provision unit 112a, the determination unit 114a, the instruction unit 115a, the movement unit 116a, and the storage unit 150a may be realized as a part of other devices.

[0052] The provision unit 112a is configured to include, for example, a single-arm robot, and acquires information for specifying what the user U requests, which is acquired by the processing unit 108. The provision unit 112a provides what the user U requests to the user U based on the information for specifying what the user U requests, which is acquired. The storage unit 150a stores storage information and stored item information. The storage information associates information identifying one or more storage locations included in the house 10 with the position of each of the one or more storage locations. The stored item information associates information identifying one or more storage locations included in the storage information with information identifying the items stored in each of the one or more storage locations. The moving unit 116a is configured to include, for example, a moving body, and is controlled by the instruction unit 115a to move the life support device 100a to an arbitrary position. The determination unit 114a acquires information for identifying what the user U requests, which is acquired by the processing unit 108. The determination unit 114a determines whether what the user U requests is to store something or to acquire something.

[0053] When what the user U requests is to store something, the determination unit 114a identifies the storage location for storing the item based on the storage information and the stored item information stored in the storage unit 150a, and determines the position of the identified storage location. The providing unit 112a acquires information for identifying what the user U requests, which is acquired by the processing unit 108. The providing unit 112a acquires the item to be stored. The instruction unit 115a acquires information for identifying the position of the storage location determined by the determination unit 114a. Based on the information for identifying the position of the acquired storage location, the instruction unit 115a instructs the moving unit 116a to move the life support device 100a to the storage location determined by the determination unit 114a, thereby moving it to the position of the storage location. The providing unit 112a stores what the user U requests in the storage location. After the providing unit 112a stores what the user U requests, the instruction unit 115a instructs the moving unit 116a to move the life support device 100a back to its original position (location), thereby moving it back to the original position. Specifically, when necessary clothes and room furnishings (curtains, rugs) are delivered, and it is specified that what the user U requests, after use, is to be stored in external storage, the determination unit 114a identifies the storage location for storing the item based on the storage information and the stored item information stored in the storage unit 150a, and determines the position of the identified storage location. The provision unit 112a acquires information identifying what the user U requests, which is acquired by the processing unit 108. The provision unit 112a acquires the item to be stored (clothes and room furnishings). The instruction unit 115a acquires information identifying the position of the storage location determined by the determination unit 114a. The instruction unit 115a instructs the moving unit 116a to move the life support device 100a to the storage location determined by the determination unit 114a based on the information identifying the position of the acquired storage location, thereby moving it to the position of the storage location. The provision unit 112a stores what the user U requests at the storage location. Next, a case will be described where it is specified that what the user U requests, after use, is to be taken to a flea market. When clothes and room furnishings are to be taken to a flea market after use, the provision unit 112a acquires, as information identifying what the user U requests, information specifying to prepare to take it to the flea market from the processing unit 108. The provision unit 112a acquires the item to be stored (clothes and room furnishings) based on the information specifying to prepare to take it to the flea market. The provision unit 112a and the instruction unit 115a execute the process of taking the acquired item (clothes and room furnishings) to the flea market. Also, the food ingredients are automatically delivered to the storage location according to the dinner recipe. The processing unit 108 acquires information specifying that it is to be stored in the kitchen. The determination unit 114a specifies the storage location for storing the item itself based on the storage information and the stored item information stored in the storage unit 150a, and determines the position of the specified storage location. The providing unit 112a acquires the information specifying that it is to be stored in the kitchen, which the processing unit 108 has acquired. The providing unit 112a acquires the item (food ingredient) to be stored. The instruction unit 115a acquires the information specifying the position of the storage location determined by the determination unit 114a. Based on the information specifying the position of the acquired storage location, the instruction unit 115a controls the moving unit 116a to move it to the position of the storage location. The providing unit 112a stores in the storage location what the user U has requested.

[0054] When the determination unit 114a acquires what the user U has requested, it specifies the storage location where the item itself is stored based on the storage information and the stored item information stored in the storage unit 150a, and determines the position of the specified storage location. The providing unit 112a acquires the information specifying what the user U has requested, which the processing unit 108 has acquired. The instruction unit 115a acquires the information specifying the position of the storage location determined by the determination unit 114a. Based on the information specifying the position of the acquired storage location, the instruction unit 115a instructs the moving unit 116a to move the life support device 100a to the storage location of the item determined by the determination unit 114a, thereby moving it to the position of the storage location. The providing unit 112a acquires what the user U has requested that is stored in the storage location. After the providing unit 112a has acquired what the user U has requested, the instruction unit 115a instructs the moving unit 116a to move the life support device 100a back to its original position, thereby moving it back to its original position. After the providing unit 112a has moved the moving unit 116a back to its original position, it provides what the user U has requested to the user U. Specifically, when it is identified that the resident is sitting in front of the TV and what the user U requests is a specific beverage, the determination unit 114a identifies the storage location (e.g., the kitchen) where that item (the specific beverage) is stored based on the storage information and the stored item information stored in the storage unit 150a, and determines the position of the identified storage location. The provision unit 112a acquires information identifying what the user U requests, which is acquired by the processing unit 108. The instruction unit 115a acquires information identifying the position of the storage location (e.g., the kitchen) determined by the determination unit 114a. Based on the information identifying the position of the acquired storage location, the instruction unit 115a instructs the moving unit 116a to move the life support device 100a to the storage location determined by the determination unit 114a, thereby moving it to the position of the storage location. The provision unit 112a acquires what the user U requests that is stored in the storage location. After the provision unit 112a acquires what the user U requests, the instruction unit 115a instructs the moving unit 116a to move the life support device 100a back to its original position, thereby moving it back to the original position. After the instruction unit 115a instructs the moving unit 116a to move back to the original position, the provision unit 112a provides what the user U requests to the user U. The provision unit 112a and the determination unit 114a are realized, for example, by a hardware processor such as a CPU executing a computer program (software) stored in the storage unit 150a. Also, some or all of these functional units may be realized by hardware (including a circuit unit; circuitry) such as an LSI, an ASIC, an FPGA, or a GPU, or may be realized by the cooperation of software and hardware. The computer program may be stored in advance in a storage device such as an HDD or a flash memory, or may be stored in a removable storage medium such as a DVD or a CD-ROM, and may be installed by mounting the storage medium on a drive device.

[0055] (Operation of the life support system 1a) The operation of the life support system 1a will be described. FIG. 6 is a flowchart showing an example of the operation of the life support system according to Modification 1 of the embodiment. Steps S1-2 to S3-2 can apply Steps S1-1 to S3-1 described with reference to FIG. 3, and thus the description here is omitted. (Step S4-2) In the life support device 100a, the determination unit 114a acquires information for specifying what the user U requested, which was acquired by the processing unit 108. The determination unit 114a determines whether what the user U requested is to store something. (Step S5-2) In the life support device 100a, when the determination unit 114a determines that what the user U requested is to store something, based on the storage information and the stored item information stored in the storage unit 150a, the determination unit 114a specifies the storage location for storing that thing and determines the position of the specified storage location. (Step S6-2) In the life support device 100a, the providing unit 112a acquires information for specifying what the user U requested, which was acquired by the processing unit 108, and the instructing unit 115a acquires information for specifying the position of the determined storage location. The providing unit 112a acquires the thing to be stored. (Step S7-2) In the life support device 100a, based on the information for specifying the position of the acquired storage location, the instructing unit 115a instructs the moving unit 116a to move the life support device 100a to the storage location of the thing determined by the determination unit 114a, thereby moving it to the position of the storage location.

[0056] (Step S8-2) In the life support device 100a, the providing unit 112a stores what the user U requested in the storage location. (Step S9-2) In the life support device 100a, after the providing unit 112a stores what the user U requested, the instructing unit 115a instructs the moving unit 116a to move the life support device 100a back to its original position, thereby moving it back to the original position. (Step S10-2) In the life support device 100a, when what the user U requests is to obtain something, the determination unit 114a specifies the storage location where that thing is stored based on the storage information and the stored item information stored in the storage unit 150a, and determines the position of the specified storage location. (Step S11-2) In the life support device 100a, the providing unit 112a obtains the information specifying what the user U requests, which the processing unit 108 has obtained, and the instructing unit 115a obtains the information specifying the position of the storage location determined by the determination unit 114a. Based on the information specifying the obtained position of the storage location, the instructing unit 115a instructs the moving unit 116a to move the life support device 100a to the storage location of the thing determined by the determination unit 114a, thereby moving it to the position of the storage location.

[0057] (Step S12-2) In the life support device 100a, the providing unit 112a obtains what the user U requests, which is stored in the storage location. (Step S13-2) In the life support device 100a, after the providing unit 112a has obtained what the user U requests, the instructing unit 115a instructs the moving unit 116a to move the life support device 100a back to its original position, thereby moving it back to its original position. (Step S14-2) In the life support device 100a, after the instructing unit 115a has caused the moving unit 116a to move back to the original position, the providing unit 112a provides what the user U requests to the user U.

[0058] In Modification 1 of the above-described embodiment, the case where the storage location is provided inside the house 10 has been described, but it is not limited to this example. For example, the storage location may be provided outside the house 10, or may be an outdoor storage space (including part of the storage service provided by a merchant). According to the life support system 1a according to Modification Example 1 of the embodiment, the life support device 100a includes, in the life support device 100, a determination unit 114a that determines the storage location of the items grasped by the processing unit 108, a moving unit 116a, and an instruction unit 115a that instructs the moving unit 116a to move the life support device 100a to the determined storage location of the items. By configuring in this way, the life support system 1a can further include a determination unit 114a that determines the storage location of the items grasped by the processing unit 108, a moving unit 116a, and an instruction unit 115a that instructs the moving unit 116a to move the life support device 100a to the determined storage location of the items. Therefore, the life support system 1a can move to the determined storage location.

[0059] Also, in the life support system 1a, the storage location is an outdoor storage space. By configuring in this way, since the life support device 100a can acquire items from the outdoor storage location, the storage location of items in the house can be reduced. Therefore, the living space can be increased. Also, in the life support system 1a, the providing unit 112a stores the items in the storage location determined by the determination unit 114a. By configuring in this way, the life support system can store items in the storage location determined by the determination unit. Therefore, the user can store the items without storing them in the storage location.

[0060] (Modification Example 2 of the Embodiment) The configuration example of the life support system 1b according to Modification Example 2 of the embodiment can apply FIG. 1. However, it is different from the life support system 1 according to the embodiment in that it includes a life support device 100b instead of the life support system 1. The life support device 100b determines the storage location of the items requested by the user U. When the items requested by the user U are to store the items in the storage location, the life support device 100b acquires the items and moves to the determined storage location. The life support device 100b stores the acquired items in the storage location. When the item that user U requests is to obtain an item, the life support device 100b moves to the determined storage location. The life support device 100b obtains the item from the storage location. The life support device 100b moves to the location where user U is and provides the obtained item to the user. When the life support device 100b provides the item that user U requests to user U, it acquires at least one of temperature information, humidity information, illuminance information, body temperature information, pulse wave information, odor information, voice information, and position information, and based on at least one of the acquired temperature information, humidity information, illuminance information, body temperature information, pulse wave information, odor information, voice information, and position information, determines whether the item provided to user U is the item that user U requested, thereby obtaining the result of providing the item that user U requested to user U.

[0061] When the result of providing an item to user U is affirmative (when the item provided to user U is the item that user U requested), the life support device 100b performs a charging process based on the price of the item, and when the result of providing an item to user U is negative (when the item provided to user U is not the item that user U requested), it does not perform a charging process based on the price of the item. When the result of providing an item to user U is negative, the life support device 100b moves to the storage location. After moving to the storage location, the life support device 100b returns the item to the storage location. An example of the storage location has been described in Modification Example 1 of the embodiment, so the description here is omitted. Hereinafter, the life support device 100b included in the life support system 1b will be described.

[0062] FIG. 7 is a diagram showing details of a life support device included in a life support system according to Modification Example 2 of the embodiment. (Life support device 100b) The life support device 100b is a robot and is realized by including devices such as a personal computer, a server, a smartphone, a tablet computer, or an industrial computer. The life support device 100b includes, for example, a sensor unit 102, an imaging unit 104, a reception unit 106, a processing unit 108, a provision unit 112b, a determination unit 114b, an instruction unit 115b, a movement unit 116b, a charging unit 118b, and a storage unit 150b. It may be realized by one or a plurality of devices having at least a part of the sensor unit 102, the imaging unit 104, the reception unit 106, the processing unit 108, the provision unit 112b, the determination unit 114b, the instruction unit 115b, the movement unit 116b, the charging unit 118b, and the storage unit 150b. At least a part of the sensor unit 102, the imaging unit 104, the reception unit 106, the processing unit 108, the provision unit 112b, the determination unit 114b, the instruction unit 115b, the movement unit 116b, the charging unit 118b, and the storage unit 150b may be realized as a part of another device.

[0063] The provision unit 112b is configured to include, for example, a single-arm robot, and acquires information for specifying what the user U requested, which was acquired by the processing unit 108. The provision unit 112b provides what the user U requested to the user U based on the acquired information for specifying what the user U requested. The storage unit 150b stores storage information and stored item information. The movement unit 116b is configured to include, for example, a moving body, is controlled by the instruction unit 115b, and moves the life support device 100b to an arbitrary position.

[0064] The determination unit 114b acquires information for specifying what the user U requested, which was acquired by the processing unit 108. The determination unit 114b determines whether what the user U requested is to store something or to acquire something. When the determination unit 114b determines that what the user U requests is to store something, it identifies the storage location for storing that thing based on the storage information and the stored item information stored in the storage unit 150b, and determines the position of the identified storage location. The providing unit 112b acquires the information for identifying what the user U requests that the processing unit 108 has acquired. The providing unit 112b acquires the thing to be stored. The instructing unit 115b acquires the information for identifying the position of the storage location determined by the determination unit 114b. Based on the information for identifying the position of the acquired storage location, the instructing unit 115b instructs the moving unit 116b to move the life support device 100b to the storage location of the thing determined by the determination unit 114b, thereby moving it to the position of the storage location. The providing unit 112b stores what the user U requests in the storage location. After the providing unit 112b stores what the user U requests, the instructing unit 115b instructs the moving unit 116b to move the life support device 100b back to its original position, thereby moving it back to its original position.

[0065] When the determination unit 114b determines that what the user U requests is to obtain something, it identifies the storage location where that thing is stored based on the storage information and the stored item information stored in the storage unit 150b, and determines the position of the identified storage location. The providing unit 112b acquires the information for identifying what the user U requests that the processing unit 108 has acquired. The instructing unit 115b acquires the information for identifying the position of the storage location determined by the determination unit 114b. Based on the information for identifying the position of the acquired storage location, the instructing unit 115b instructs the moving unit 116b to move the life support device 100b to the storage location of the thing determined by the determination unit 114b, thereby moving it to the position of the storage location. The providing unit 112b obtains what the user U requests that is stored in the storage location. After the providing unit 112b obtains what the user U requests, the instructing unit 115b instructs the moving unit 116b to move the life support device 100b back to its original position, thereby moving it back to its original position. After the instructing unit 115b moves it back to its original position, the providing unit 112b provides what the user U requests to the user U.

[0066] When the providing unit 112b provides the user U with what the user U has requested, the sensor unit 102 acquires at least one of temperature information, humidity information, illuminance information, body temperature information, pulse wave information, odor information, voice information, and position information, and outputs at least one of the acquired temperature information, humidity information, illuminance information, body temperature information, pulse wave information, odor information, voice information, and position information to the receiving unit 106. The receiving unit 106 acquires at least one of the temperature information, humidity information, illuminance information, body temperature information, pulse wave information, odor information, voice information, and position information output by the sensor unit 102. The processing unit 108 acquires information for identifying what has been provided from the providing unit 112b to the user U. The processing unit 108 acquires at least one of the temperature information, humidity information, illuminance information, body temperature information, pulse wave information, odor information, voice information, and position information acquired by the receiving unit 106. The processing unit 108 determines whether what has been provided to the user U is what the user U has requested based on at least one of the acquired temperature information, humidity information, illuminance information, body temperature information, pulse wave information, odor information, voice information, and position information, thereby obtaining the result of providing something to the user U. When the result of providing something to the user U is positive, the charging unit 118b performs a charging process based on the price of the item, and when the result of providing something to the user U is negative, the charging unit 118b does not perform a charging process based on the price of the item. When the result of providing something to the user U is negative, the providing unit 112b causes the moving unit 116b to move to the storage location. After causing the moving unit 116b to move to the storage location, the providing unit 112b returns the item to the storage location. The providing unit 112b, the determination unit 114b, and the charging unit 118b are realized, for example, by a hardware processor such as a CPU executing a computer program (software) stored in the storage unit 150b. Further, some or all of these functional units may be realized by hardware (including a circuit unit; circuitry) such as an LSI, an ASIC, an FPGA, or a GPU, or may be realized by cooperation between software and hardware. The computer program may be stored in advance in a storage device such as an HDD or a flash memory, or may be stored in a removable storage medium such as a DVD or a CD-ROM, and may be installed by mounting the storage medium on a drive device.

[0067] (Operation of the life support system 1b) The operation of the life support system 1b will be described. FIG. 8 is a flowchart showing an example of the operation of the life support system according to Modification 2 of the embodiment. Steps S1-3 to S8-3 can apply steps S1-2 to S3-2 and S10-2 to S14-2 described with reference to FIG. 6, and thus the description here is omitted. (Step S9-3) In the life support device 100b, when the providing unit 112b provides the user U with what the user U has requested, the sensor unit 102 acquires at least one of temperature information, humidity information, illuminance information, body temperature information, pulse wave information, odor information, voice information, and position information, and outputs at least one of the acquired temperature information, humidity information, illuminance information, body temperature information, pulse wave information, odor information, voice information, and position information to the reception unit 106. The reception unit 106 acquires at least one of the temperature information, humidity information, illuminance information, body temperature information, pulse wave information, odor information, voice information, and position information output by the sensor unit 102. The processing unit 108 acquires information for specifying what has been provided from the providing unit 112b to the user U. The processing unit 108 acquires at least one of the temperature information, humidity information, illuminance information, body temperature information, pulse wave information, odor information, voice information, and position information acquired by the reception unit 106. The processing unit 108 obtains the result of providing something to the user U by determining whether what has been provided to the user U is what the user U has requested based on at least one of the acquired temperature information, humidity information, illuminance information, body temperature information, pulse wave information, odor information, voice information, and position information. (Step S10-3) In the life support device 100b, when the result of providing something to the user U is positive, the charging unit 118b performs a charging process based on the price of the item. (Step S11-3) In the life support device 100b, when the result of providing something to the user U is negative, the instruction unit 115b instructs the moving unit 116b to move the life support device 100b to the storage location determined by the determination unit 114b, thereby moving it to the storage location. After the moving unit 116b has moved to the storage location, the providing unit 112b returns the item to the storage location.

[0068] In Modification Example 2 of the above-described embodiment, the life support device 100b was described as performing a charging process based on the price of an item even when the result of providing the item to the user U was positive. However, the present invention is not limited to this example. For example, the charging unit 118b may perform a charging process on the item at the time of acquiring the item from the storage location, or may perform a charging process on the item at the time of providing the item held by the user U to the user U.

[0069] According to the life support system 1b according to Modification Example 2 of the embodiment, the life support device 100b further includes a charging unit 118b that charges for an item acquired from a storage location or an item provided by the providing unit 112b in the life support device 100a. By configuring in this way, since it is possible to charge for an item acquired from a storage location or an item provided by the providing unit 112b, the life support system 1b can be provided by selling items.

[0070] In the life support device 100b, the charging unit 118b charges based on the result of the providing unit 112b providing an item acquired from a storage location to the user U or the result of the providing unit 112b providing an item held by the providing unit 112b to the user. By configuring in this way, the life support system 1b can charge based on the result of providing an item acquired from a storage location to the user U or the result of the providing unit 112b providing an item held by the providing unit 112b to the user. For this reason, if the user U does not need the item as a result of providing an item acquired from a storage location to the user U or the result of the providing unit 112b providing an item held by the providing unit 112b to the user, the user U will not be charged. Therefore, compared with the case where the user is charged when the item is acquired from the storage location, it is possible to prevent the user from being charged for an unnecessary item.

[0071] (Modification Example 3 of the Embodiment) The configuration example of the life support system 1c according to Modification Example 3 of the embodiment can apply FIG. 1. However, it is different from the life support system 1 according to the embodiment in that the life support device 100c is provided instead of the life support system 1. The life support device 100c determines whether the user U is requesting something. If the life support device 100c determines that the user U is not requesting anything, it places an order for it. When the life support device 100c determines that the user U is requesting something, it determines the storage location of that thing. If what the user U is requesting is to store the thing in the storage location, the life support device 100c acquires the thing and moves it to the determined storage location. The life support device 100c stores the acquired thing in the storage location. If what the user U is requesting is to acquire the thing, the life support device 100c moves to the determined storage location. The life support device 100c acquires the thing from the storage location. The life support device 100c moves to the location where the user U is and provides the acquired thing to the user. Since an example of the storage location was described in Modification 1 of the embodiment, the description here is omitted. Hereinafter, the life support device 100b included in the life support system 1b will be described.

[0072] FIG. 9 is a diagram showing details of a life support device included in a life support system according to Modification 3 of the embodiment. (Life support device 100c) The life support device 100c is a robot and is realized by including devices such as a personal computer, a server, a smartphone, a tablet computer, or an industrial computer. The life support device 100c includes, for example, a sensor unit 102, an imaging unit 104, a reception unit 106, a processing unit 108, a provision unit 112c, a determination unit 114c, an instruction unit 115c, a movement unit 116c, an ordering unit 120c, and a storage unit 150c. It may be realized by one or a plurality of devices having at least a part of the sensor unit 102, the imaging unit 104, the reception unit 106, the processing unit 108, the provision unit 112c, the determination unit 114c, the instruction unit 115c, the movement unit 116c, the ordering unit 120c, and the storage unit 150c. At least a part of the sensor unit 102, the imaging unit 104, the reception unit 106, the processing unit 108, the provision unit 112c, the determination unit 114c, the instruction unit 115c, the movement unit 116c, the ordering unit 120c, and the storage unit 150c may be realized as a part of another device. The provision unit 112c is configured to include, for example, a single-arm robot, and acquires information for specifying what the user U requested that the processing unit 108 acquired. The provision unit 112c provides what the user U requested to the user U based on the acquired information for specifying what the user U requested. The storage unit 150c stores storage information and stored item information. The movement unit 116c is configured to include, for example, a moving body, is controlled by the provision unit 112c, and moves the life support device 100c to an arbitrary position.

[0073] The determination unit 114c acquires information for specifying what the user U requested that the processing unit 108 acquired. The determination unit 114c determines whether what the user U requested is to store something or to acquire something. When the determination unit 114c determines that what the user U requests is to store something, it identifies the storage location for storing that thing based on the storage information and the stored item information stored in the storage unit 150c, and determines the position of the identified storage location. The providing unit 112c acquires the information for identifying what the user U requests, which is acquired by the processing unit 108. The providing unit 112c acquires the thing to be stored. The instructing unit 115c acquires the information for identifying the position of the storage location determined by the determination unit 114c. Based on the acquired information for identifying the position of the storage location, the instructing unit 115c instructs the moving unit 116c to move the life support device 100c to the storage location determined by the determination unit 114c, thereby moving it to the position of the storage location. The providing unit 112c stores what the user U requests at the storage location. After the providing unit 112c stores what the user U requests, the instructing unit 115c instructs the moving unit 116c to move the life support device 100c back to its original position, thereby moving it back to the original position.

[0074] When the determination unit 114c determines that what the user U requests is to obtain something, it determines whether that thing exists. When the ordering unit 120c determines, based on the determination by the determination unit 114c, that that thing does not exist, it orders that thing. For example, the ordering unit 120c performs an ordering process via a home gateway (not shown). When the determination unit 114c determines that that thing exists, it identifies the storage location where that thing is stored based on the storage information and the stored item information stored in the storage unit 150c, and determines the position of the identified storage location. The providing unit 112c acquires information for specifying what the user U has requested, which has been acquired by the processing unit 108. The instructing unit 115c acquires information for specifying the position of the storage location determined by the determining unit 114c. Based on the acquired information for specifying the position of the storage location, the instructing unit 115c instructs the moving unit 116c to move the life support device 100c to the storage location determined by the determining unit 114c, thereby moving it to the position of the storage location. The providing unit 112c acquires what the user U has requested, which is stored in the storage location. After the providing unit 112c has acquired what the user U has requested, the instructing unit 115c instructs the moving unit 116c to move the life support device 100c back to its original position, thereby moving it back to the original position. After the instructing unit 115c has instructed the moving unit 116c to move back to the original position, the providing unit 112c provides what the user U has requested to the user U. The providing unit 112c, the determining unit 114c, and the ordering unit 120c are realized, for example, by a hardware processor such as a CPU executing a computer program (software) stored in the storage unit 150c. Also, some or all of these functional units may be realized by hardware (including circuitry such as LSI, ASIC, FPGA, GPU), or may be realized by the cooperation of software and hardware. The computer program may be stored in advance in a storage device such as an HDD or a flash memory, or may be stored in a removable storage medium such as a DVD or a CD-ROM, and may be installed by mounting the storage medium on a drive device.

[0075] (Operation of the life support system 1c) The operation of the life support system 1c will be described. FIG. 10 is a flowchart showing an example of the operation of the life support system according to Modification 3 of the embodiment. Steps S1-4 to S3-4 can apply steps S1-1 to S1-3 described with reference to FIG. 3, so the description here is omitted. (Step S4-4) In the life support device 100c, when the determination unit 114c determines that what the user U requests is to obtain something, it determines whether that thing exists. Steps S5-4 to S9-4 can apply steps S10-2 to S14-2 described with reference to FIG. 6, so the description here is omitted. (Step S10-4) In the life support device 100c, when the ordering unit 120c is determined by the determination unit 114c that the thing does not exist, it orders that thing.

[0076] According to the life support system 1c according to Modification Example 3 of the embodiment, the life support device 100c further includes an ordering unit 120c that orders something when the determination unit 114c determines that there is no thing in the storage location in the life support device 100. By configuring in this way, the life support system 1c can order the thing when the determination unit 114c determines that there is no thing in the storage location. Therefore, the user U can obtain the thing without ordering it.

[0077] As described above, the embodiments and their modification examples have been described. These embodiments and their modification examples are presented as examples and are not intended to limit the scope of the invention. These embodiments and their modification examples can be implemented in various other forms, and various omissions, replacements, changes, and combinations can be made without departing from the gist of the invention. These embodiments and their modification examples are included in the scope and gist of the invention and at the same time are included in the invention described in the claims and its equivalent scope. For example, an embodiment, Modification Example 1 of the embodiment, Modification Example 2 of the embodiment, and Modification Example 3 of the embodiment may be combined.

[0078] Note that, as described above, the life support device 100c is realized including a computer, as is the case with the life support device 100. In this case, a program for realizing the functions of each functional block is recorded on a computer-readable recording medium. The program recorded on this recording medium may be read into a computer system and realized by the CPU executing it. The "computer system" as used herein shall include hardware such as an OS (Operating System) and peripheral devices. Also, the "computer-readable recording medium" refers to portable media such as flexible disks, magneto-optical disks, ROMs, CD-ROMs, etc. Further, the "computer-readable recording medium" includes storage devices such as hard disks built into the computer system.

[0079] Furthermore, the "computer-readable recording medium" may include those that dynamically hold a program for a short period of time. Those that dynamically hold a program for a short period of time are, for example, communication lines in the case of transmitting a program via a network such as the Internet or a communication line such as a telephone line. Also, the "computer-readable recording medium" may include those that hold a program for a certain period of time, such as volatile memory inside a computer system that serves as a server or a client. Also, the above program may be for realizing a part of the functions described above. Further, the above program may be one that can be realized in combination with a program already recorded in the computer system for the functions described above. Also, the above program may be realized using a programmable logic device. The programmable logic device is, for example, an FPGA (Field Programmable Gate Array).

[0080] Incidentally, the living support devices 100 to 100c described above each have a computer inside. And the processes of each of the living support devices 100 to 100c described above are stored in a computer-readable recording medium in the form of a program, and the above processes are performed by the computer reading and executing this program. Here, the computer-readable recording medium refers to a magnetic disk, a magneto-optical disk, a CD-ROM, a DVD-ROM, a semiconductor memory, etc. Also, this computer program may be distributed to a computer via a communication line, and the computer that has received this distribution may execute the program. Also, the above program may be for realizing a part of the functions described above. Furthermore, it may be a so-called differential file (differential program) that can realize the functions described above in combination with a program already recorded in a computer system.

Explanation of Signs

[0081] 1, 1a, 1b, 1c Living support system 10 House 2 Entrance 3 Entrance hall 4 Living space (first living space) 5 Entrance space 6 Locking and unlocking system 21 Entrance door 22 Entrance door lock 31 Frame 41 Wall 42 Interior door (first interior door) 43 Interior door lock (first interior door lock) 51 Entrance storage (storage cabinet) 52 Door 53 Storage cabinet lock 54 Camera 61 Control unit 62 Operation unit 100, 100a, 100b, 100c Living support device 102 Sensor unit 104 Imaging unit 106 Reception unit 108 Processing unit 110 Learning model 112, 112a, 112b, 112c Provision unit 150, 150a, 150b, 150c Memory unit 114a, 114b, 114c Judgment unit 115a, 115b, 115c Instruction unit 116a, 116b, 116c Movement unit 118b Billing unit 120c Ordering unit

Claims

1. A receiving unit that receives user situation identification information for identifying the situation of a user; A processing unit that determines what the user is requesting based on the user situation identification information received by the receiving unit; A determination unit that determines the storage location of the item grasped by the processing unit; A moving unit; An instruction unit that instructs the moving unit to move to the storage location of the item determined by the determination unit; A providing unit that provides the item grasped by the processing unit to the user and comprising: The processing unit has learned the relationship between the user situation identification information and what the user is requesting through machine learning, and uses the result of the machine learning to determine what the user is requesting for the user situation identification information received by the receiving unit. A life support system.

2. The processing unit updates the relationship between the user situation identification information and what the user is requesting based on the result of the providing unit providing the item grasped by the processing unit to the user. The life support system according to claim 1.

3. The storage location is an outdoor storage space. The life support system according to claim 2.

4. A charging unit that charges for the item obtained from the storage location or the item provided by the providing unit The life support system according to any one of claims 1 to 3, further comprising:

5. The charging unit charges based on the result of the providing unit providing the item obtained from the storage location to the user or the result of the providing unit providing the item it possesses to the user. The life support system according to claim 4.

6. An ordering unit that orders the item when the determination unit determines that the item is not in the storage location The life support system according to any one of claims 1 to 5, further comprising:

7. The providing unit stores the item in the storage location determined by the determination unit. The life support system according to any one of claims 1 to 6.

8. A life support method executed by a computer, comprising: A step of receiving user situation identification information for identifying the situation of a user; A step of determining what the user is requesting based on the user situation identification information received in the receiving step; A step of providing the item grasped in the grasping step to the user A step of determining the storage location of the grasped item; A step of instructing a moving unit to move to the determined storage location of the item; It has, In the grasping step, using the result of machine learning the relationship between the user situation specific information and what the user requests, for the user situation specific information received in the receiving step, grasp what the user requests. A life support method.

9. On a computer, A step of receiving user situation specific information for specifying the situation of a user; A step of grasping what the user requests based on the user situation specific information received in the receiving step; A step of providing what is grasped in the grasping step to the user A step of determining the storage location of the grasped item; A step of instructing a moving unit to move to the determined storage location of the item; Execute, In the grasping step, using the result of machine learning the relationship between the user situation specific information and what the user requests, cause the user to grasp what the user requests for the user situation specific information obtained in the receiving step. A life support program.

Images