Living environment providing system, living environment providing method, and non-volatile storage medium
The living environment providing system addresses suboptimal environmental control by using machine learning to create a personalized and adaptive living environment based on user and building data, enhancing control accuracy and satisfaction.
Patent Information
- Application Number
- JP2023545704
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2021-09-03
- Filing Date
- 2022-09-02
- Publication Date
- 2026-01-27
- Estimated Expiration
- 2042-09-02
AI Technical Summary
Existing environmental control systems fail to consider building performance, equipment performance, room environment, or location characteristics, leading to suboptimal environmental control when building changes occur.
A living environment providing system that uses user identification and building status information to create a learning model through machine learning, identifying environments that suit user preferences and controlling environmental settings based on this model, including controlling window coverings and acquiring situation-specific information to enhance environmental control.
The system effectively creates a personalized and adaptive living environment by learning user preferences and building conditions, improving environmental control accuracy and user satisfaction.
Smart Images

Figure 0007807457000001 
Figure 0007807457000002 
Figure 0007807457000003
Abstract
Description
[Technical Field]
[0001] The present invention provides residence Environmental provision system, residence The present invention relates to an environment providing method and a nonvolatile storage medium. This application claims priority based on Japanese Patent Application No. 2021-144218, filed on September 3, 2021, the contents of which are incorporated herein by reference. [Background technology]
[0002] There is known a technology that can automatically measure environmental parameters and select an environmental control device appropriate for the measured environmental parameters (see, for example, Patent Document 1). This technology includes a plurality of environmental control devices, a measurement unit that measures two or more environmental parameters of temperature, humidity, and air quality, a threshold table that is set for each environmental parameter and that stores a first optimum range having at least an upper limit value, a priority table that stores priorities among the plurality of environmental parameters, a device selection table that is set for each environmental parameter and that stores the relationship between the environmental control device, the implementation effectiveness of each environmental control device, and the control method for the environmental control device, and a device control unit that references the threshold table, the priority table, and the device selection table to select one of the plurality of environmental control devices. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2014-240733 Summary of the Invention [Problem to be solved by the invention]
[0004] The aforementioned technology does not take into account the building performance, equipment performance, room environment, or location characteristics. As a result, when the building is changed, it is not possible to apply thresholds and priority information, and it is not possible to maintain an optimal environment.
[0005] The present invention has been made in consideration of the above-mentioned problems, and aims to provide a living environment providing system, a living environment providing method, and a living environment providing program that can create a living environment that suits the user's preferences. [Means for solving the problem]
[0006] (1) In order to solve the above problem, one embodiment of the present invention is to provide user identification information that identifies a user. user situation identification information that identifies the user's situation; A receiving unit that receives building status specifying information that specifies the status of a building, and a living environment that matches the preferences of the user based on the user specifying information and the building status specifying information received by the receiving unit. and grasping the request object that the user is requesting based on the user situation specifying information received by the receiving unit. a processing unit; and a control unit that controls the living environment of the building based on the living environment that matches the preferences of the user that are grasped by the processing unit. a determination unit that determines a storage location of the requested object recognized by the processing unit; a movement unit; an instruction unit that instructs the movement unit to move the system to the storage location determined by the determination unit; and a provision unit that provides the requested object recognized by the processing unit to the user. the processing unit learns, for each and each combination of a plurality of pieces of user specifying information, a relationship between one or more pieces of building condition specifying information and a living environment that suits the preferences of a user or a plurality of users corresponding to each of the one or more pieces of building condition specifying information, based on machine learning; and using a result of the machine learning, grasps a living environment that suits the preferences of the user or a plurality of users, based on the user specifying information or a combination of the user specifying information and the building condition specifying information received by the receiving unit. death , a relationship between the user situation specifying information and the request target is learned based on machine learning, and the request target is identified for the user situation specifying information received by the receiving unit using a result of the machine learning; It is a living environment provision system.
[0007] According to the living environment providing system of this embodiment, the living environment providing system receives user identification information that identifies a user and building status identification information that identifies the status of a building. For each and each combination of multiple user identification information, the living environment providing system learns, through machine learning, the relationship between one or more pieces of building status identification information and a living environment that suits the preferences of a user or multiple users corresponding to each of the one or more pieces of building status identification information. The living environment providing system uses the results of machine learning (learning model) to identify a living environment that suits the preferences of a user or multiple users based on the received user identification information or combination of multiple user identification information and the building status identification information. The living environment providing system controls the living environment of the building based on the identified living environment that suits the preferences of the user or multiple users. In this way, the living environment providing system creates a learning model by learning, based on machine learning, the relationship between one or more building status specifying information and a living environment that suits the preferences of a user or multiple users corresponding to each of the one or more building status specifying information, for each and each combination of multiple user specifying information.The living environment providing system can use the created learning model to grasp a living environment that suits the preferences of a user or multiple users based on the user specifying information or a combination of multiple user specifying information and the building status specifying information, and therefore can control the living environment of a building based on a living environment that suits the preferences of the user or multiple users. Furthermore, with this configuration, the living environment providing system creates a learning model by learning the relationship between the user situation specifying information and what the user wants based on machine learning. The living environment providing system can use the created learning model to understand what the user wants based on the user situation specifying information, and therefore predict what the user will want to keep around them. Furthermore, with this configuration, the living environment providing system further includes a determination unit that determines the storage location of the requested item identified by the processing unit, a movement unit, and an instruction unit that instructs the movement unit to move the living environment providing system to the storage location determined by the determination unit. Thus, the living environment providing system can move to the determined storage location.
[0008] (2) One embodiment of the present invention is the above-mentioned residence In the environment providing system, the control unit or multiple such users The above is to your liking residence Controls the opening and closing of window coverings based on the environment. By configuring it in this way, residence The environment provision system uses the created learning model to identify the user and building Based on situation-specific information and or multiple usersIt suited my tastes residence By understanding the environment, users or multiple users It suited my tastes residence The opening and closing of the window coverings can be controlled based on the environment. (3) One embodiment of the present invention is the above-mentioned residence In the environment providing system, building The situation-specific information is the first building The situation-specific information is the first building Second, different from situation-specific information building The control unit further includes an acquisition unit that acquires situation specifying information, and the control unit building Situation specifying information and the user recognized by the processing unit or multiple such users The above is to your liking residence Based on the environment and residence The environment may also be controlled.
[0009] By configuring it in this way, residence The environment provision system is the first building Second, different from situation-specific information building The control unit can acquire the second situation specifying information. building Further based on situation-specific information, building of residence The second one is because you can control the environment. building Based on situation-specific information building of residence Compared to not controlling the environment, building of residence environment, users or multiple users It suited my tastes residence It can be controlled by the environment.
[0010] (4) One embodiment of the present invention is the above-mentioned residence In the environment providing system, the processing unit building of residence Based on the results of the controlled environment, building Context-specific information and the user or multiple such users It suited my tastes residence The relationship with the environment may be updated.
[0011] By configuring in this way, the processing unit can transmit the user information that the processing unit has grasped to the user. or multiple users It suited my tastes residence Based on the environment, building of residence The processing unit acquires the result of controlling the environment. building of residence Based on the results of controlled environments, building Context-Specific Information and Users or multiple users It suited my tastes residence The relationship with the environment can be updated, so user-identifying information and building Users can be identified based on situation-specific information or multiple users It suited my tastes residence It can improve the accuracy of the environment.
[0014] ( 5 ) One embodiment of the present invention is that in the above-mentioned living environment providing system, the processing unit may update the relationship between the user situation identification information and the request target based on the result of the providing unit providing the user with what the processing unit has grasped. With this configuration, the processing unit acquires the result of the providing unit providing the user with what the processing unit has grasped. The processing unit can update the relationship between the user situation specifying information and what the user is requesting based on the result of the processing unit providing the user with what the processing unit has grasped, thereby improving the accuracy of what the user is requesting based on the user situation specifying information compared to when the information is not updated.
[0016] ( 6 In one embodiment of the present invention, in the living environment providing system described above, the storage location may be an outdoor storage space. By configuring it in this way, the living environment providing system can retrieve items from outdoor spaces that serve as storage locations, making it possible to create an ideal living environment and have necessary items delivered to one's fingertips, even in cases where multiple residences are used for multi-location living.
[0017] ( 7 ) One embodiment of the present invention is a living environment providing system as described above, further comprising a charging unit that charges for the requested object obtained from the storage location or the requested object provided by the providing unit, and the charging unit may charge based on the result of the providing unit providing the requested object obtained from the storage location to the user, or the result of the providing unit providing the requested object held by the providing unit to the user.
[0018] By configuring in this way, it is possible to charge for the requested object obtained from the storage location or the requested object provided, residence The environment providing system can provide requested objects by selling them. Also, since it is possible to charge a user based on the result of providing the user with a requested object acquired from a storage location or a requested object in one's possession, if the user does not need the requested object after being provided with the requested object acquired from a storage location or a requested object in one's possession, no charge will be made. This prevents the user from being charged for unnecessary requested objects compared to when a request object is acquired from a storage location or when a requested object in one's possession is provided to the user.
[0019] ( 8 ) One embodiment of the present invention may be such that, in the above-mentioned living environment providing system, the system further includes an ordering unit that orders the requested item when the determination unit determines that the requested item is not present in the storage location. By configuring the living environment providing system in this way, if the determination unit determines that the requested item is not available in the storage location, the living environment providing system can order the requested item, allowing the user to obtain the requested item without having to place an order.
[0020] ( 9 In one embodiment of the present invention, in the living environment providing system described above, the providing unit may store the requested object in the storage location determined by the determining unit. With this configuration, the living environment providing system can store the requested object in the storage location determined by the determination unit, allowing the user to store the requested object without storing it in a storage location.
[0022] ( 10 In one embodiment of the present invention, in the above-described living environment providing system, the building status specifying information includes at least one of building information and room information. By configuring in this manner, the living environment providing system can grasp the living environment that suits the preferences of the user or multiple users based on at least one of the building information and the room information, and can control the living environment of the building based on the living environment that suits the preferences of the user or multiple users. ( 11 In one embodiment of the present invention, in the above-described living environment providing system, the room information includes a building number, a room number, a room name, an area, and a volume. By configuring in this manner, the living environment providing system can grasp the living environment that suits the preferences of the user or multiple users based on room information including the building number, room number, room name, area, and volume, and can therefore control the living environment of the building based on the living environment that suits the preferences of the user or multiple users. ( 12 ) In one embodiment of the present invention, in the living environment providing system described above, the room names include at least one of pantry, entrance, kitchen, dining room, living room, washroom, bathroom, and toilet. By configuring in this manner, the living environment providing system can grasp the living environment that suits the preferences of a user or multiple users based on room information that includes at least one of the following room names: pantry, entrance, kitchen, dining room, living room, washroom, bathroom, and toilet, and can therefore control the living environment of the building based on the living environment that suits the preferences of the user or multiple users. ( 13 In one embodiment of the present invention, in the above-described living environment providing system, the room information includes information indicating the purpose of the room or information indicating the location of the room. By configuring in this manner, the living environment providing system can grasp the living environment that suits the preferences of a user or multiple users based on room information including information indicating the purpose of the room or information indicating the location of the room, and can therefore control the living environment of the building based on the living environment that suits the preferences of the user or multiple users.
[0023] ( 14 ) One embodiment of the present invention is that in the above-mentioned living environment providing system, the second building status identification information includes at least one of information identifying the performance of the building, information identifying the performance of the equipment provided in the building, information identifying the environment of the rooms provided in the building, and information identifying the location of the building. By configuring the living environment providing system in this manner, the control unit can control the living environment of the building based on at least one of the information specifying the performance of the building, the information specifying the performance of the equipment provided in the building, the information specifying the environment of the rooms provided in the building, and the information specifying the location of the building.Therefore, compared to a case where the living environment of the building is not controlled based on at least one of the information specifying the performance of the building, the information specifying the performance of the equipment provided in the building, the information specifying the environment of the rooms provided in the building, and the information specifying the location of the building, the living environment of the building can be controlled to be a living environment that suits the preferences of the user or multiple users.
[0026] ( 15 ) One embodiment of the present invention is that in the above-mentioned environment providing system, the building is a first building, and the control unit controls the living environment of a second building different from the first building based on the living environment that suits the user's preferences as understood by the processing unit. By configuring the living environment providing system in this manner, the control unit can control the living environment of the second building based on the living environment of the first building that suits the preferences of the user or multiple users that the processing unit has grasped, so that the living environment that suits the preferences of the user or multiple users can be carried to a second building that is different from the first building.
[0027] ( 16) One embodiment of the present invention is It is equipped with a living environment provision system A computer-implemented method for providing a living environment, comprising: user identification information for identifying a user; user situation identification information that identifies the user's situation; Receiving building status specification information that specifies the status of a building, and grasping a living environment that matches the preferences of the user based on the user specification information and the building status specification information received through the reception. and determining a request target that the user is requesting based on the user situation specifying information received by the receiving. and controlling the living environment of the building based on the living environment that matches the preferences of the user ascertained through the ascertainment. determining a storage location of the requested object identified by the identification; moving the requested object by a moving unit; instructing the moving unit to move the living environment providing system to the storage location identified by the identification; and providing the requested object identified by the identification to the user. and in the grasping, for each and each combination of a plurality of pieces of user identifying information, using a result of learning based on machine learning a relationship between one or more pieces of building status identifying information and a living environment that suits the preferences of a user or a plurality of users corresponding to each of the one or more pieces of building status identifying information, and grasping a living environment that suits the preferences of the user or a plurality of users based on the user identifying information or a combination of the plurality of pieces of user identifying information received by the receiving, and the building status identifying information. death , The relationship between the user situation specifying information and the request target is learned based on machine learning, and the result of the machine learning is used to grasp the request target for the user situation specifying information received by the receiving. This is a method for providing a living environment. The method for providing a living environment according to one embodiment of the present invention is essentially the same invention as the living environment providing system, except that it is in a different category, and provides similar actions and effects.
[0028] ( 17 ) One embodiment of the present invention is It is equipped with a living environment provision system The computer stores user-specific information that identifies the user and user situation identification information that identifies the user's situation; Receiving building identification information, which is information that identifies the status of a building, and grasping a living environment that matches the preferences of the user based on the user identification information received through the reception. and determining a request target that the user is requesting based on the user situation specifying information received by the receiving. and controlling the living environment of the building based on the living environment that matches the preferences of the user ascertained through the ascertainment. determining a storage location of the requested object identified by the identification; moving the requested object by a moving unit; instructing the moving unit to move the living environment providing system to the storage location identified by the identification; and providing the requested object identified by the identification to the user.a non-volatile storage medium having recorded thereon a program for executing the above-mentioned program, wherein the ascertaining includes using a result of learning based on machine learning a relationship between one or more pieces of building status specifying information and a living environment that suits the preferences of a user or a plurality of users corresponding to each of one or more pieces of building status specifying information for each of a plurality of pieces of user specifying information and each combination thereof, and ascertaining a living environment that suits the preferences of the user or a plurality of users for the user specifying information or a combination of a plurality of pieces of user specifying information received by the receiving, and the building status specifying information; a relationship between the user situation specifying information and the request target is learned based on machine learning, and the result of the machine learning is used to identify the request target for the user situation specifying information received by the receiving process; It is a non-volatile storage medium. According to a program recorded on a nonvolatile storage medium according to an embodiment of the present invention, the program: It is equipped with a living environment provision system The program causes a computer to create a learning model by learning, based on machine learning, the relationship between one or more pieces of building status specifying information and a living environment that matches the preferences of a user or multiple users corresponding to each of the one or more pieces of building status specifying information, for each of the multiple pieces of user specifying information and each combination of the multiple pieces of user specifying information. It is equipped with a living environment provision system The computer uses the created learning model to grasp a living environment that suits the preferences of a user or a plurality of users based on user-specific information or a combination of user-specific information and building status-specific information, so that the living environment of the building can be controlled based on the living environment that suits the preferences of the user or a plurality of users. Furthermore, with this configuration, the program causes the computer provided in the living environment providing system to create a learning model by learning the relationship between the user situation specifying information and what the user wants based on machine learning. Using the created learning model, the program can understand what the user wants based on the user situation specifying information, and therefore predict what the user will want to keep around them. Furthermore, with this configuration, the program causes the computer included in the living environment providing system to determine the storage location of the identified requested object, move the object using the moving unit, and instruct the moving unit to move the living environment providing system to the determined storage location of the requested object. Thus, the program can move the living environment providing system to the determined storage location. [Effects of the Invention]
[0029] According to the present invention, the environment providing system creates a learning model by learning, based on machine learning, the relationship between one or more spatial situation specifying information and an environment that suits the preferences of the user corresponding to each of one or more pieces of user specifying information, for each or each combination of one or more pieces of user specifying information, and by using the created learning model, it is possible to grasp an environment that suits the preferences of the user based on the user specifying information and the spatial situation specifying information, and therefore it is possible to control the spatial environment based on the grasped environment that suits the preferences of the user. [Brief explanation of the drawings]
[0030] [Figure 1] 1 is a diagram illustrating an example of the configuration of a living environment providing system according to an embodiment of the present invention. [Figure 2] 2 is a diagram showing details of a living environment providing device included in the living environment providing system according to the present embodiment. FIG. [Figure 3A] FIG. 10 is a diagram illustrating an example of building status identification information. [Figure 3B] FIG. 10 is a diagram illustrating an example of room information. [Figure 3C] FIG. 10 is a diagram showing an example of an indoor environment measurement value report. [Figure 4] 4 is a flowchart showing an example of the operation of the living environment providing system according to the present embodiment. [Figure 5] FIG. 10 is a diagram showing an example of an indoor environment comfort zone. [Figure 6] FIG. 10 is a diagram showing details of a living environment providing device included in a living environment providing system according to a first modified example of the embodiment. [Figure 7] 10 is a flowchart showing an example of the operation of the living environment providing system according to the first modified example of the embodiment. [Figure 8] FIG. 10 is a diagram showing details of a living environment providing device included in a living environment providing system according to a second modified example of the embodiment. [Figure 9] 10 is a flowchart showing an example of the operation of the living environment providing system according to the second modification of the embodiment. [Figure 10] FIG. 1 is a diagram illustrating an example of the configuration of a pantry system. [Figure 11]FIG. 10 is a diagram showing details of a living environment providing device included in a living environment providing system according to a third modified example of the embodiment. [Figure 12] 11 is a flowchart showing an example of the operation of the living environment providing system according to the third modification of the embodiment. [Figure 13] FIG. 10 is a diagram showing details of a living environment providing device included in a living environment providing system according to a fourth modified example of the embodiment. [Figure 14] 10 is a flowchart showing an example of the operation of the living environment providing system according to the fourth modification of the embodiment. [Figure 15] FIG. 10 is a diagram showing details of a living environment providing device included in a living environment providing system according to a fifth modified example of the embodiment. [Figure 16] 13 is a flowchart showing an example of the operation of the living environment providing system according to the fifth modified example of the embodiment. [Figure 17] FIG. 13 is a diagram illustrating a configuration example of a vehicle interior environment providing system according to a sixth modified example of the embodiment. [Figure 18] FIG. 13 is a diagram showing details of a vehicle interior environment providing device included in a vehicle interior environment providing system according to a sixth modified example of the embodiment. [Figure 19A] FIG. 10 is a diagram illustrating an example of vehicle status identification information. [Figure 19B] FIG. 10 is a diagram showing an example of seat information. [Figure 19C] FIG. 10 is a diagram illustrating an example of facility information. [Figure 20] 13 is a flowchart showing an example of the operation of the vehicle interior environment providing system according to the fifth modified example of the embodiment. DETAILED DESCRIPTION OF THE INVENTION
[0031] Next, a living environment providing system, a living environment providing method, and a living environment providing program according to the present embodiment will be described with reference to the drawings. The embodiment described below is merely an example, and the embodiments to which the present invention is applied are not limited to the following embodiments. In all the drawings for explaining the embodiments, the same reference numerals are used for components having the same functions, and repeated explanations will be omitted. Furthermore, in this application, "based on XX" means "based on at least XX," and includes cases where it is based on other elements in addition to XX. Furthermore, "based on XX" is not limited to cases where XX is used directly, but also includes cases where it is based on XX that has been calculated or processed. "XX" is any element (for example, any information).
[0032] (Embodiment) In this embodiment, a space is a space large enough to accommodate a user. In this embodiment, a building such as a house and a vehicle are examples of a space. Note that a space does not need to be sealed as long as the environment of the space can be controlled. (living environment provision system) FIG. 1 is a diagram showing an example of the configuration of a living environment providing system according to an embodiment of the present invention. In FIG. 1, the living environment providing system 1 includes a living environment providing device 100. In addition to the living environment providing device 100, FIG. 1 also shows users U1, . . . , and user Un (n is an integer greater than 0) who receive a living environment provided by the living environment providing device 100, and terminal devices 200-1, . . . , and terminal device 200-n used by each of users U1, . . . , and user Un. Any user from user U1 to user Un will be referred to as user U. Any terminal device from terminal device 200-1 to terminal device 200-n will be referred to as terminal device 200. An example of the living environment providing device 100 is installed in a building such as a house H. The living environment providing device 100 performs the following processing for each of users U1 to Un. The living environment providing device 100 accepts information that identifies user U (hereinafter referred to as "user identifying information") and information that identifies the building's status (hereinafter referred to as "building status identifying information"). Examples of user identifying information include various types of personal information, such as a personal ID, a user name, and personal attributes. Personal attributes include gender, age, family relationship, annual income, career history, and hometown. Examples of building status identifying information include building information, room information, etc.
[0033] The living environment providing device 100 ascertains a living environment that suits the preferences of the user U based on the received user identification information and building condition identification information. For each or each combination of one or more pieces of user identification information, the living environment providing device 100 performs machine learning to determine the relationship between one or more pieces of building condition identification information and information that identifies a living environment that suits the preferences of the user U corresponding to each of the one or more pieces of building condition identification information, and stores the results of the machine learning (learning model). Note that learning based on machine learning is referred to as machine learning.
[0034] The living environment providing device 100 uses a learning model to input the received user identification information and building status identification information into the learning model, and acquires information that identifies a living environment that suits the preferences of the user U, output by the learning model. The living environment providing device 100 identifies a living environment that suits the preferences of the user U based on the acquired information that identifies a living environment that suits the preferences of the user U. The living environment providing device 100 controls the living environment of the building based on the identified living environment that suits the preferences of the user U. An example of a building is a building where the user U is staying. The living environment providing device 100 included in the living environment providing system 1 will be described below.
[0035] FIG. 2 is a diagram showing details of a living environment providing device included in the living environment providing system according to this embodiment. (living environment providing device 100) The living environment providing device 100 is realized by including devices such as a personal computer, a server, a smartphone, a tablet computer, a robot, or an industrial computer. The living environment providing device 100 is installed in a home, in the cloud, or both. The living environment providing device 100 includes, for example, a communication unit 101, a sensor unit 102, an imaging unit 104, a reception unit 106, a processing unit 108, a control unit 111, and a storage unit 150. The living environment providing device 100 may be realized by one or more devices having at least a portion of the communication unit 101, the sensor unit 102, the imaging unit 104, the reception unit 106, the processing unit 108, the control unit 111, and the storage unit 150. At least a portion of the communication unit 101, the sensor unit 102, the imaging unit 104, the reception unit 106, the processing unit 108, the control unit 111, and the storage unit 150 may be realized as part of another device.
[0036] The communication unit 101 is realized by a communication module. The communication unit 101 communicates with an external communication device via a network NW. The communication unit 101 may communicate using a wireless communication method such as wireless LAN, Bluetooth (registered trademark), or LTE (registered trademark). The communication unit 101 may also communicate using a communication method such as wired LAN. The communication unit 101 receives a living environment request transmitted by the terminal device 200.
[0037] The sensor unit 102 includes a temperature sensor, a humidity sensor, an illuminance sensor, a solar radiation sensor, a wind speed sensor, a CO2 sensor, a power sensor, an audio sensor, a position sensor, and the like. The sensor unit 102 outputs the temperature measurement result (temperature information) obtained by the temperature sensor to the receiving unit 106. The sensor unit 102 outputs the humidity measurement result (humidity information) obtained by the humidity sensor to the receiving unit 106. The sensor unit 102 outputs the illuminance measurement result (illuminance information) obtained by the illuminance sensor to the receiving unit 106. The sensor unit 102 outputs the solar radiation acquisition amount measurement result (solar radiation acquisition amount information) obtained by the solar radiation sensor to the receiving unit 106. The sensor unit 102 outputs the wind speed measurement result (wind speed information) obtained by the wind speed sensor to the receiving unit 106. The sensor unit 102 outputs the CO2 concentration measurement result (CO2 concentration information) obtained by the CO2 sensor to the receiving unit 106. The sensor unit 102 outputs the result (power amount information) of the power sensor measuring power (for example, AC power) to the reception unit 106. The sensor unit 102 outputs the result (audio information) of the audio sensor measuring audio to the reception unit 106. The sensor unit 102 outputs the result (position information) of the position sensor measuring position to the reception unit 106.
[0038] The imaging unit 104 acquires one or more pieces of image information by capturing an image of the surroundings of the living environment providing apparatus 100. The imaging unit 104 outputs the acquired one or more pieces of image information to the receiving unit .
[0039] The reception unit 106 acquires the living environment request output by the communication unit 101. The reception unit 106 accepts user identification information included in the acquired living environment request. The reception unit 106 acquires at least one of audio information and location information output by the sensor unit 102. The reception unit 106 acquires one or more pieces of image information output by the imaging unit 104. The reception unit 106 accepts building situation identification information such as the acquired audio information, at least one of location information, and one or more pieces of image information.
[0040] The processing unit 108 includes a learning model 110. The learning model 110 is a trained model that has been trained by machine learning or deep learning to determine the relationship between a combination of user identifying information and each of one or more pieces of building identifying information and information specifying a living environment that suits the preferences of user U corresponding to the combination of user identifying information and each of one or more pieces of building identifying information, for each or each combination of one or more pieces of user identifying information, based on one or more pieces of building identifying information and information specifying a living environment that user U has determined to be preferable and corresponding to each of the one or more pieces of building identifying information.
[0041] Examples of the building situation specifying information include building information, room information, and the like, and are stored in the storage unit 150. FIG. 3A is a diagram illustrating an example of building status identification information. The building information includes a building number, a location, a region classification, a building coverage ratio, a site area, a building area, a second-floor area, and the number of floors. The building number is building identification information; an example of a building number is "NL0001a." The location is the location of the building corresponding to the building number; an example of a location is "Yokohama City." The location is indicated by an address or one or both of longitude and latitude. The region classification is information indicating the location classification of the building; an example of a region classification is "IV." The building coverage ratio is the ratio of the building area to the site area; an example of a building coverage ratio is "58%." The site area is the area of the land on which the building is built; an example of a site area is "145 m^2." The building area is the area of the building; an example of a building area is "84 m^2." The second-floor area is the area of the second floor of the building; an example of a second-floor area is "25 m^2." The floor number is the number of floors in a building, and an example of a floor number is "2".
[0042] FIG. 3B is a diagram showing an example of room information. The room information includes a building number, a room number, a room name, an area, and a volume. The room number is identification information of a room in the building corresponding to the building number, and an example of the room number is "01." The room name is information indicating the name of the room corresponding to the room number, and an example of the room name is "living room." The area is the area of the room, and an example of the room area is "30 m^2." The volume is the volume of the room, and an example of the volume is "81 m^3." The room information may also include information indicating the purpose of the room or the location of the room. Information indicating the purpose of the room is indicated by, for example, "living room," "workroom," or "children's room." Information indicating the location of the room is indicated by, for example, the floor number, such as "1st floor" or "2nd floor," and the direction, such as "east side," "west side," "south side," or "north side."
[0043] For example, in the learning stage, when a user U changes the indoor environment settings in a room, information that associates information that identifies the user U (user identification information), building situation identification information such as building information and room information, and information that identifies a living environment that suits the user U's preferences, such as indoor environment measurement values, is obtained, for example, by a home gateway.
[0044] FIG. 3C is a diagram showing an example of an indoor environment measurement value report. The indoor environment measurement values include a measurement point number, room temperature, humidity, illuminance, solar radiation gain, wind speed, CO2 concentration, and AC power consumption. The measurement point number is information identifying the measurement point, and an example of the measurement point number is the date and time of measurement, "2020 / 2 / 10 9:30." The room temperature is information identifying the temperature of the room corresponding to the measurement point number, and an example of the room temperature is "20.3°C." The room temperature is information identifying the humidity of the room corresponding to the measurement point number, and an example of the humidity is "40%." The illuminance is information identifying the illuminance of the room corresponding to the measurement point number, and an example of the illuminance is "200 lx." The solar radiation gain is information identifying the solar radiation gain of the room corresponding to the measurement point number, and an example of the solar radiation gain is "100 W / m^2." The wind speed is information specifying the wind speed in the room corresponding to the measurement point No., and an example of the wind speed is "1 m / s." The CO2 concentration is information specifying the CO2 concentration in the room corresponding to the measurement point No., and an example of the CO2 concentration is "500 ppm." The AC power amount is information specifying the AC power amount in the room corresponding to the measurement point No., and an example of the AC power amount is "500 Wh." Returning to Figure 2, we will continue the explanation.
[0045] The processing unit 108 acquires the information acquired by the home gateway and stores the acquired information in the storage unit 150. The processing unit 108 creates a learning model 110 by performing machine learning or deep learning on the acquired information. For example, the processing unit 108 may perform learning using training data in which building situation identification information and indoor environment measurement values are one set for each piece of user identification information.
[0046] The processing unit 108 acquires the user identification information accepted by the receiving unit 106. The processing unit 108 acquires the building identification information accepted by the receiving unit 106. The processing unit 108 acquires the date and time information at which the user identification information was acquired. The processing unit 108 acquires building information and room information based on at least one of audio information and location information, and one or more pieces of image information included in the acquired building identification information. For example, the processing unit 108 acquires building information and room information from at least one of audio information and location information, and an image created by image processing one or more pieces of image information. The processing unit 108 inputs the building situation identification information including the acquired building information and room information, the acquired user identification information, and the date and time information into the learning model 110.
[0047] The learning model 110 calculates a living environment that matches the preferences of the user U based on the input information, and outputs the calculation result (information specifying a living environment that matches the preferences of the user U). Such a trained model can be constructed using, for example, a convolution neural network (CNN), a recurrent neural network (RNN), or a long short-term memory (LSTM). The processing unit 108 acquires the information specifying a living environment that matches the preferences of the user U output by the learning model 110.
[0048] The control unit 111 acquires information identifying a living environment that matches the preferences of the user U acquired by the processing unit 108. The control unit 111 controls the living environment of the building where the user is staying based on the acquired information identifying a living environment that matches the preferences of the user U. An example of a living environment that matches the preferences of the user U may be an environment that is realized by adjusting at least one of the room temperature, humidity, illuminance, solar radiation, wind speed, CO2 concentration, and power consumption included in the indoor environment measurement values. Furthermore, an example of a living environment that matches the preferences of the user U may be an environment that is realized by items around the user U, such as food, beverages, daily necessities, books, home appliances, and clothing.
[0049] Specifically, the control unit 111 adjusts the temperature, humidity, wind speed, and CO2 concentration by controlling the air conditioning and ventilation equipment based on information specifying the living environment that suits the user U's preferences. The control unit 111 adjusts the temperature and illuminance of the space by controlling the brightness of the lights and the opening and closing of window coverings based on information specifying the living environment that suits the user U's preferences. The control unit 111 adjusts the amount of solar radiation obtained by controlling the opening and closing of windows based on information specifying the living environment that suits the user U's preferences. The control unit 111 adjusts the amount of solar radiation obtained by controlling the opening and closing of window coverings based on information specifying the living environment that suits the user U's preferences. The window coverings include blinds, curtains, etc. The blinds may be external blinds attached to the outside of the window or internal blinds attached to the inside of the window.
[0050] The storage unit 150 is realized by a hard disk drive (HDD), a flash memory, a random access memory (RAM), a read only memory (ROM), etc. The storage unit 150 stores building information, room information, etc.
[0051] The reception unit 106, the processing unit 108, and the control unit 111 are realized by, for example, a hardware processor such as a CPU (Central Processing Unit) executing a computer program (software) stored in the storage unit 150.
[0052] Furthermore, some or all of these functional units may be realized by hardware (including circuitry) such as an LSI (Large Scale Integration), an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or a GPU (Graphics Processing Unit), or may be realized by a combination of software and hardware. The computer program may be stored in advance in a storage device such as an HDD (Hard Disk Drive) or flash memory, or may be stored in a removable storage medium such as a DVD or CD-ROM and installed by inserting the storage medium into a drive device.
[0053] (Operation of living environment providing system 1) The operation of the living environment providing system 1 will be described. 4 is a flowchart showing an example of the operation of the living environment providing system according to this embodiment. Here, as an example, a case will be described in which a learning model is created and stored in the living environment providing device 100.
[0054] (Step S1-1) In the living environment providing device 100, the communication unit 101 receives the living environment request transmitted by the terminal device 200 of the user U.
[0055] (Step S2-1) In the living environment providing device 100, the receiving unit 106 acquires the user identification information included in the living environment request received by the communication unit 101. The receiving unit 106 accepts the acquired user identification information.
[0056] (Step S3-1) In the living environment providing device 100, the receiving unit 106 acquires at least one of the audio information and the location information output by the sensor unit 102. The receiving unit 106 acquires one or more pieces of image information output by the imaging unit 104. The receiving unit 106 accepts building situation specifying information such as the acquired audio information, at least one of the location information, and one or more pieces of image information.
[0057] (Step S4-1) In the living environment providing device 100, the processing unit 108 acquires the user identification information accepted by the receiving unit 106. The processing unit 108 acquires the building identification information accepted by the receiving unit 106. The processing unit 108 acquires the date and time information at which the user identification information was acquired. The processing unit 108 acquires building information and room information based on at least one of audio information and location information, and one or more pieces of image information, included in the acquired building identification information. The processing unit 108 inputs the acquired user identification information, the date and time information, and building situation identification information including the acquired building information and room information to the learning model 110. The learning model 110 calculates a living environment that suits the preferences of the user U based on the input user identification information, the date and time information, and the building situation identification information, and outputs the calculation result (information that identifies a living environment that suits the preferences of the user U). The processing unit 108 acquires the information that identifies a living environment that suits the preferences of the user U, output by the learning model 110.
[0058] (Step S5-1) In the living environment providing device 100, the control unit 111 acquires information that specifies a living environment that matches the preferences of the user U, which information has been acquired by the processing unit 108. The control unit 111 controls the living environment of the building where the user is staying, based on the acquired information that specifies a living environment that matches the preferences of the user U.
[0059] In the above-described embodiment, the living environment providing apparatus 100 receives a living environment request transmitted by the terminal device 200 and acquires the user identification information included in the received living environment request, but this is not a limitation. For example, the user U may input the user identification information into the living environment providing apparatus 100, so that the living environment providing apparatus 100 acquires the user identification information.
[0060] In the above-described embodiment, the sensor unit 102 includes a temperature sensor, a humidity sensor, an illuminance sensor, a solar radiation sensor, a wind speed sensor, a CO2 sensor, a power sensor, an audio sensor, etc. However, the sensor unit 102 is not limited to this example. For example, the sensor unit 102 may include at least one of a temperature sensor, a humidity sensor, an illuminance sensor, a solar radiation sensor, a wind speed sensor, a CO2 sensor, a power sensor, and an audio sensor.
[0061] In the above-described embodiment, when the control unit 111 controls the living environment of the building where the user U is staying based on information that identifies a living environment that suits the preferences of the user U, the sensor unit 102 may acquire at least one of temperature information, humidity information, illuminance information, solar radiation information, wind speed information, CO2 information, power information, audio information, and location information, and output the acquired at least one of the temperature information, humidity information, illuminance information, solar radiation information, wind speed information, CO2 information, power information, audio information, and location information to the reception unit 106. The reception unit 106 acquires at least one of the temperature information, humidity information, illuminance information, solar radiation information, wind speed information, CO2 information, power information, audio information, and location information output by the sensor unit 102.
[0062] The processing unit 108 acquires information specifying the result of controlling the living environment when the living environment of the building where the user U is staying is controlled based on the information specifying the living environment that matches the preferences of the user U from the control unit 111. The processing unit 108 acquires at least one of the temperature information, humidity information, illuminance information, solar radiation information, wind speed information, CO2 information, power information, audio information, and location information acquired by the reception unit 106. The processing unit 108 acquires the information specifying the result of controlling the living environment by determining whether the result of controlling the living environment of the building where the user U is staying is a living environment that matches the preferences of the user U based on at least one of the acquired temperature information, humidity information, illuminance information, solar radiation information, wind speed information, CO2 information, power information, audio information, and location information. For example, the processing unit 108 determines whether the living environment matches the preferences of the user U based on the voice uttered by the user.
[0063] The processing unit 108 may cause the learning model 110 to update the relationship between the building situation specifying information and the information specifying the living environment that matches the preferences of the user U, for the user specifying information, based on the user specifying information, the building situation specifying information, the information specifying the living environment that matches the preferences of the user U, and the information specifying the result of controlling the living environment. For example, if the result of controlling the living environment is positive (if the result of controlling the living environment is a living environment that matches the preferences of the user U), the processing unit 108 causes the learning model 110 to learn the user specifying information using training data that is a set of the building situation specifying information and the information specifying the living environment that matches the preferences of the user U that corresponds to the building situation specifying information.
[0064] In the above-described embodiment, when the control unit 111 controls the living environment of a building where the user U is staying based on information that identifies a living environment that suits the preferences of the user U, the living environment of the building may be controlled based on an indoor environment comfort range. An example of the indoor environment comfort range is set in advance and stored in the storage unit 150, for example.
[0065] FIG. 5 is a diagram showing an example of an indoor environment comfort range. The indoor environment comfort range includes the date and time, room name, room temperature (upper / lower limits), humidity (upper / lower limits), illuminance (upper / lower limits), solar radiation gain (upper / lower limits), wind speed (upper / lower limits), and CO2 concentration (upper limit). An example of the date and time is "2 / 10 9:00," an example of the room name is "living room," an example of the room temperature (upper / lower limits) is "22°C / 15°C," an example of the humidity (upper / lower limits) is "80°C / 40°C," an example of the illuminance (upper / lower limits) is "** / 200 lx," an example of the solar radiation gain (upper / lower limits) is "** / 120 W / m^2," an example of the wind speed (upper / lower limits) is "00 / 00 m / s," and an example of the CO2 concentration (upper limit) is "700 ppm." This configuration allows for more flexible control of the living environment.
[0066] Note that the indoor environment comfort zone as shown in Fig. 5 may be created for each combination of one or more individuals who were present in the same room by identifying one or more individuals. Based on the indoor environment comfort zone created for each combination of one or more users, different comfortable living environments can be realized for each of the following cases: when only user A is present in a room in a building, when user A and user B are present together, and when only user B is present, thereby enabling flexible control of the living environment. When one or more users who were in the same room are identified and an indoor environment comfort zone is created for each combination of one or more users, the control unit 111 identifies the combination of users who were in the same room during the measurement period. For example, the control unit 111 acquires user identification information from the terminal devices used by each of the one or more users during the measurement period, and identifies the combination of users who were in the same room during that period.
[0067] According to the living environment providing system 1 of this embodiment, the living environment providing device 100 includes a reception unit 106 that receives user identification information that identifies a user U and building condition identification information that identifies a building condition, a processing unit 108 that determines a living environment that suits the preferences of the user U based on the user condition identification information and the building condition identification information received by the reception unit 106, and a control unit 111 that controls the living environment of the building based on the living environment that suits the user's preferences determined by the processing unit 108. The processing unit 108 performs machine learning to determine, for each or each combination of one or more pieces of user identification information, the relationship between one or more pieces of building condition identification information and the living environment that suits the preferences of the user corresponding to each of the one or more pieces of building condition identification information, and determines an environment that suits the preferences of the user U based on the user identification information and building condition identification information received by the reception unit 106 using the results of the machine learning.
[0068] By configuring in this manner, the living environment providing system 1 can create the learning model 110 by machine learning the relationship between one or more pieces of building status specifying information and a living environment that suits the preferences of the user corresponding to each of the one or more pieces of building status specifying information, for each or each combination of one or more pieces of user specifying information. Therefore, the living environment providing system 1 can use the created learning model 110 to grasp a living environment that suits the preferences of the user U based on the user specifying information and the building status specifying information, and can control the living environment of the building based on the living environment that suits the preferences of the user U.
[0069] Furthermore, in the living environment providing system 1, the processing unit 108 may update the relationship between the building status specifying information and the living environment that matches the user's preferences, based on the result of controlling the living environment of the building.
[0070] With this configuration, the processing unit 108 acquires the result of the control unit 111 controlling the living environment of the building based on the living environment that matches the user's preferences that the processing unit 108 has grasped for the user U. The processing unit 108 can update the relationship between the building status specification information and the living environment that matches the user's preferences based on the result of the control unit 111 controlling the living environment of the building, and therefore can improve the accuracy of the living environment that matches the user's preferences that can be grasped based on the user specification information and the building status specification information compared to when no update is performed.
[0071] In addition, in the living environment providing system 1, the space is a building, the spatial situation specifying information is information that specifies the situation of the building, and the environment is a living environment. By configuring in this way, when the space is a building, the environment providing system can grasp the environment that suits the user's preferences, and can control the building environment based on the environment that suits the user's preferences.
[0072] (Modification 1 of the embodiment) 1 can be applied to a configuration example of a living environment providing system 1a according to a first modification of the embodiment. However, it differs from the living environment providing system 1 according to the embodiment in that a living environment providing device 100a is provided instead of the living environment providing device 100. The living environment providing device 100a acquires information specifying the performance of the building, information specifying the performance of the facilities provided in the building, information specifying the environment of the rooms provided in the building, and information specifying the location of the building. The living environment providing device 100a controls the living environment of the building where the user U is staying, based on the acquired information specifying the performance of the building, information specifying the performance of the facilities provided in the building, information specifying the environment of the rooms provided in the building, information specifying the location of the building, and the understood living environment that matches the preferences of the user U.
[0073] The building situation specifying information is an example of first spatial situation specifying information. The information specifying the performance of the building, the information specifying the performance of the facilities provided in the building, the information specifying the environment of the rooms provided in the building, and the information specifying the location of the building are each an example of second spatial situation specifying information different from the first spatial situation specifying information.
[0074] The living environment providing device 100a included in the living environment providing system 1a will be described below. FIG. 6 is a diagram showing details of a living environment providing device included in a living environment providing system according to the first modification of the embodiment. (living environment providing device 100a) The living environment providing device 100a is a robot and is realized by including devices such as a personal computer, a server, a smartphone, a tablet computer, or an industrial computer. The living environment providing device 100a is installed in a home, in the cloud, or both. The living environment providing device 100a includes, for example, a communication unit 101, a sensor unit 102, an imaging unit 104, a reception unit 106, an acquisition unit 107a, a processing unit 108, a providing unit 112a, and a storage unit 150a. The living environment providing device 100a may be realized by one or more devices having at least some of the communication unit 101, the sensor unit 102, the imaging unit 104, the reception unit 106, the acquisition unit 107a, the processing unit 108, the providing unit 112a, and the storage unit 150a. At least some of the communication unit 101, sensor unit 102, imaging unit 104, reception unit 106, acquisition unit 107a, processing unit 108, provision unit 112a, and memory unit 150a may be realized as part of another device.
[0075] The storage unit 150a is realized by a hard disk drive (HDD), flash memory, RAM, ROM, etc. The storage unit 150a stores building information, room information, and equipment information. The building information includes the aforementioned building number, location, zoning, building coverage ratio, site area, building area, second-floor area, and number of floors, as well as information identifying the building's location, such as the zoning, and information identifying the building's performance, such as the envelope average heat transfer coefficient (Ua value), heat loss coefficient Q value, and gap equivalent area C value. The zoning indicates the zoning of the building's location. An example of a zoning is "Type 1 Low-Rise Residence." The Ua value is the average value of the heat escaping from the interior of the building through the floor, exterior walls, roof (ceiling), openings, etc. to the exterior, calculated by averaging the amount of heat throughout the entire envelope. An example of a Ua value is "0.34." The room information includes the aforementioned building number, room number, room name, area, and volume, as well as information identifying the environment of the rooms in the building, such as window positions and window areas. The window position is information specifying the position of the window in the room, and an example of the window position is "S (south)." The window area is the area of the window, and an example of the window area is "6.48 m^2."
[0076] The equipment information includes a building number, a room number, an equipment number, an equipment name, a product number, efficiency 1, and efficiency 2. The equipment number is identification information of the equipment owned by the room corresponding to the room number, and an example of an equipment number is "0003". The equipment name is information indicating the name of the equipment corresponding to the equipment number, and an example of an equipment name is "air conditioner". The product number is a number assigned to the equipment corresponding to the equipment number, and an example of a product number is "NKL-03". Efficiency 1 is information indicating the efficiency (maximum efficiency) of the equipment corresponding to the equipment number, and an example of efficiency 1 is "600%". Efficiency 2 is information indicating the efficiency (normal efficiency) of the equipment corresponding to the equipment number, and an example of efficiency 2 is "580%".
[0077] The acquisition unit 107a acquires information that identifies the location of the building and information that identifies the performance of the building from the building information stored in the memory unit 150a based on building identification information such as the building number included in the building status identification information received by the reception unit 106, acquires information that identifies the environment of the rooms provided in the building from the room information, and acquires equipment information.
[0078] The rooms in the building do not have to be sealed by walls or windows, and may include a veranda, a balcony, a rooftop, or an entrance hall.
[0079] The control unit 111a acquires information that specifies a living environment that matches the preferences of the user U, which is acquired by the processing unit 108. The control unit 111a acquires information that specifies the location of the building, information that specifies the performance of the building, information that specifies the environment of the rooms provided in the building, and facility information, which are acquired by the acquisition unit 107a. The control unit 111a controls the living environment of the building in which the user is staying, based on the acquired information that specifies a living environment that matches the preferences of the user U, information that specifies the location of the building, information that specifies the performance of the building, information that specifies the environment of the rooms provided in the building, and facility information.
[0080] The control unit 111a controls the facilities included in the facility information based on information specifying a living environment that matches the preferences of the user U, information specifying the location of the building, information specifying the performance of the building, information specifying the environment of the rooms provided in the building, and the facility information. Specifically, the control unit 111a adjusts the temperature and illuminance by controlling air conditioning based on the information specifying a living environment that matches the preferences of the user U, information specifying the location of the building, information specifying the performance of the building, information specifying the environment of the rooms provided in the building, and the facility information. The control unit 111a adjusts the temperature and illuminance by controlling the brightness of the lighting based on the information specifying a living environment that matches the preferences of the user U, information specifying the location of the building, information specifying the performance of the building, information specifying the environment of the rooms provided in the building, and the facility information. The control unit 111a adjusts the amount of solar radiation obtained by controlling the opening and closing of windows based on the information specifying a living environment that matches the preferences of the user U, information specifying the location of the building, information specifying the performance of the building, information specifying the environment of the rooms provided in the building, and the facility information. The control unit 111a adjusts the amount of solar radiation obtained by controlling the opening and closing of the blinds based on information that identifies a living environment that suits the preferences of the user U, information that identifies the location of the building, information that identifies the performance of the building, information that identifies the environment of the rooms in the building, and equipment information.
[0081] The acquisition unit 107a and the control unit 111a are realized, for example, by a hardware processor such as a CPU executing a computer program (software) stored in the storage unit 150a. Furthermore, some or all of these functional units may be realized by hardware (including circuitry) such as an LSI, ASIC, FPGA, or GPU, or may be realized by a combination of software and hardware. The computer program may be stored in advance in a storage device such as a HDD or flash memory, or may be stored in a removable storage medium such as a DVD or CD-ROM and installed by inserting the storage medium into a drive.
[0082] (Operation of living environment providing system 1a) The operation of the living environment providing system 1a will be described. FIG. 7 is a flowchart showing an example of the operation of the living environment providing system according to the first modification of the embodiment. Steps S1-2 to S4-2 can be performed using steps S1-1 to S4-1 described with reference to FIG. 4, and therefore a description thereof will be omitted here.
[0083] (Step S5-2) In the living environment providing device 100a, the acquisition unit 107a acquires information that identifies the location of the building and information that identifies the performance of the building from the building information stored in the memory unit 150a based on building identification information such as the building number included in the building status identification information received by the reception unit 106, acquires information that identifies the environment of the rooms provided in the building from the room information, and acquires equipment information.
[0084] (Step S6-2) In the living environment providing device 100a, the control unit 111a acquires information that specifies a living environment that matches the preferences of the user U, which is acquired by the processing unit 108. The control unit 111a acquires information that specifies the location of the building, information that specifies the performance of the building, information that specifies the environment of the rooms provided in the building, and facility information, which are acquired by the acquisition unit 107a. The control unit 111a controls the living environment of the building in which the user is staying, based on the acquired information that specifies a living environment that matches the preferences of the user U, information that specifies the location of the building, information that specifies the performance of the building, information that specifies the environment of the rooms provided in the building, and facility information.
[0085] In the first modification of the embodiment described above, the control unit 111a of the living environment providing device 100a controls the living environment of the building where the user is staying based on the acquired information specifying the living environment that matches the preferences of the user U, the information specifying the location of the building, the information specifying the performance of the building, the information specifying the environment of the rooms in the building, and the facility information, but this is not the only example. For example, the control unit 111a may control the living environment of the building where the user is staying based on at least one of the acquired information specifying the location of the building, the information specifying the performance of the building, the information specifying the environment of the rooms in the building, and the facility information, and the information specifying the living environment that matches the preferences of the user U.
[0086] In the first variation of the above-described embodiment, the building identification information may include at least one of information identifying the location of the building, information identifying the performance of the building, information identifying the environment of the rooms in the building, and facility information. The learning model 110 may be a trained model that, for each or each combination of one or more pieces of user identification information, learns by machine learning or deep learning the relationship between the combination of the user identification information and each of the one or more pieces of building identification information and information identifying a living environment that corresponds to the combination of the user identification information and each of the one or more pieces of building identification information and that matches the preferences of the user U, based on one or more pieces of building identification information and information identifying a living environment that corresponds to the combination of the user identification information and each of the one or more pieces of building identification information and that matches the preferences of the user U. This configuration allows the processing unit 108 to acquire information identifying a living environment that matches the preferences of the user U, based on at least one of the information identifying the location of the building, information identifying the performance of the building, information identifying the environment of the rooms in the building, and facility information.
[0087] The first variation of the above-described embodiment may include a server that stores building information, room information, and facility information. In this case, the building information, room information, and facility information stored in the server may be information about a building other than the house H. For example, examples of the building information, room information, and facility information include information about a hotel or other accommodation facility, or a new home to which the user will move. The user U accesses the server by operating the terminal device 200 and acquires building information, room information, and facility information about the room in the hotel where the user U will be staying. The terminal device 200 creates a living environment request that includes the acquired information and user identification information. The terminal device 200 transmits the created living environment request to the living environment providing device 100a. The living environment providing device 100a receives the living environment request transmitted by the terminal device 200 and performs the above-described processing based on the information included in the living environment request. This configuration allows the living environment to be controlled to suit the user U's preferences in each room where the user U is staying.
[0088] That is, in the living environment providing device 100a, the control unit 111a may control the environment of a building other than the house H based on the living environment that matches the user's preferences ascertained by the processing unit 108. With this configuration, in the living environment providing system 1a according to the first modified embodiment, even if the user moves to a building other than the house H in which the user currently resides, the user can control the living environment of the other building. In other words, in the living environment providing system 1a, the user can carry a living environment that matches the user's preferences from a first building to a second building that is different from the first building. Note that the user includes, for example, the user and users who are family members of the user.
[0089] When carrying a living environment that suits the user's preferences, the user carries the living environment providing device 100a (i.e., the robot) to a second building at the destination. The user may also carry a home gateway provided in the first building together with the living environment providing device 100a to the second building at the destination. If the living environment providing device 100a is realized as a cloud server, the user can control the living environment of the second building by accessing the cloud server from a terminal device used by the user, without moving the living environment providing device 100a.
[0090] According to the living environment providing system 1a according to the first modified example of the embodiment, the living environment providing device 100a further includes an acquisition unit 107a that acquires at least one of information specifying the performance of the building, information specifying the performance of the equipment provided in the building, information specifying the environment of the rooms provided in the building, and information specifying the location of the building in the living environment providing device 100. The control unit 111a controls the living environment of the building in which the user is staying, based on at least one of the information specifying the performance of the building, information specifying the performance of the equipment provided in the building, information specifying the environment of the rooms provided in the building, and information specifying the location of the building acquired by the acquisition unit 107a.
[0091] With this configuration, living environment providing system 1a can acquire at least one of information specifying the performance of the building, information specifying the performance of the equipment provided in the building, information specifying the environment of the rooms provided in the building, and information specifying the location of the building. Control unit 111a can control the living environment of the building based on at least one of the acquired information specifying the performance of the building, information specifying the performance of the equipment provided in the building, information specifying the environment of the rooms provided in the building, and information specifying the location of the building. Therefore, the living environment of the building can be controlled to be a living environment that suits the user's preferences, compared to a case where the living environment of the building is not controlled based on at least one of the information specifying the performance of the building, information specifying the performance of the equipment provided in the building, information specifying the environment of the rooms provided in the building, and information specifying the location of the building.
[0092] According to an environment providing system according to a first modification of the embodiment (living environment providing system 1a in the first modification), the spatial situation specifying information (building situation specifying information in the first modification) is first spatial situation specifying information. Living environment providing device 100a further includes an acquisition unit 107a that acquires second spatial situation specifying information (at least one of information specifying the performance of the building, information specifying the performance of the equipment included in the building, information specifying the environment of the rooms included in the building, and information specifying the location of the building) different from the first spatial situation specifying information. Control unit 111a controls the spatial environment (living environment in the first modification) based on the second spatial situation specifying information acquired by acquisition unit 107a and the environment matching the user's preferences ascertained by processing unit 108.
[0093] With this configuration, the environment providing system can acquire second spatial situation specifying information different from the first spatial situation specifying information. The control unit 111a can control the spatial environment further based on the acquired second spatial situation specifying information, and therefore can control the spatial environment to an environment that suits the user's preferences, compared to when the spatial environment is not controlled based on the second spatial situation specifying information.
[0094] According to the environment providing system of the first variant embodiment (in the first variant, the living environment providing system 1a), the space is a building, and the second spatial situation identification information includes at least one of information identifying the performance of the building, information identifying the performance of the equipment provided in the building, information identifying the environment of the rooms provided in the building, and information identifying the location of the building.
[0095] By configuring the environment providing system in this manner, the control unit can control the living environment of the building based on at least one of the information specifying the performance of the building, the information specifying the performance of the equipment the building has, the information specifying the environment of the rooms the building has, and the information specifying the location of the building, so that the living environment of the building can be controlled to suit the user's preferences, compared to when the living environment of the building is not controlled based on at least one of the information specifying the performance of the building, the information specifying the performance of the equipment the building has, the information specifying the environment of the rooms the building has, and the information specifying the location of the building.
[0096] According to the environment providing system of the first variant of the embodiment (in the first variant, the living environment providing system 1a), the space (in the first variant, the house H) is a first space, and the control unit 111 controls the environment of a second space different from the first space based on an environment that matches the user's preferences as determined by the processing unit 108.
[0097] By configuring the environment providing system in this manner, the control unit can control the environment of the second space based on the environment of the first space that suits the user's preferences as determined by the processing unit, so that the environment that suits the user's preferences can be carried to the second space that is different from the first space. The second spatial situation specifying information may be spatial situation specifying information for a second space different from the first space. For example, the control unit 111a may control the environment of the second space (the second building as the destination) based on the second spatial situation specifying information for the second space (the second building as the destination) acquired by the acquisition unit 107a and an environment that matches the user's preferences and that is recognized by the processing unit 108 (an environment recognized based on the first spatial situation specifying information that is spatial situation specifying information for the first building).
[0098] (Modification 2 of the embodiment) 1 can be applied to a configuration example of a living environment providing system 1b according to a second modification of the embodiment. However, it differs from the living environment providing system 1 according to the embodiment in that a living environment providing device 100b is provided instead of the living environment providing device 100. The living environment providing device 100b performs the following processes in addition to the processes executed by the living environment providing device 100. The living environment providing device 100b accepts information that identifies the situation of the user U (hereinafter referred to as "user situation identification information"). The user situation identification information includes time information, image information, temperature information, humidity information, illuminance information, body temperature information, pulse wave information, odor information, information that identifies the user U, and the like. The information that identifies the user U includes gender, age, family relationship, annual income, career history, place of origin, and the like.
[0099] The living environment providing device 100b grasps what the user U is requesting (also referred to as "request target") based on the received user situation specifying information. The living environment providing device 100b performs machine learning to learn the relationship between the user situation specifying information and what the user U is requesting, and stores the results of the machine learning (learning model).
[0100] The living environment providing device 100b uses a learning model to input the received user situation identification information into the learning model and obtains information that identifies what the user U is requesting, which is output by the learning model. The living environment providing device 100b determines what the user U is requesting based on the obtained information that identifies what the user U is requesting. Here, "thing" includes abstract things and objects. A thing refers to a tangible object other than a person with personality that is the object of a right. The living environment providing device 100 provides the determined information to the user U. Below, the living environment providing device 100b included in the living environment providing system 1b will be described.
[0101] FIG. 8 is a diagram showing details of a living environment providing device included in a living environment providing system according to a second modification of the embodiment. (living environment providing device 100b) The living environment providing device 100b is a robot and is realized by including devices such as a personal computer, a server, a smartphone, a tablet computer, or an industrial computer. The living environment providing device 100b is installed in a home, in the cloud, or both. The living environment providing device 100b includes, for example, a communication unit 101, a sensor unit 102b, an imaging unit 104, a reception unit 106b, a processing unit 108b, a control unit 111, a providing unit 112b, and a storage unit 150b. The living environment providing device 100b may be realized by one or more devices having at least some of the communication unit 101, the sensor unit 102b, the imaging unit 104, the reception unit 106b, the processing unit 108b, the control unit 111, the providing unit 112b, and the storage unit 150b. At least some of the communication unit 101, sensor unit 102b, imaging unit 104, reception unit 106b, processing unit 108b, control unit 111, provision unit 112b, and memory unit 150b may be realized as part of another device.
[0102] The sensor unit 102b includes a temperature sensor, humidity sensor, illuminance sensor, solar radiation sensor, wind speed sensor, CO2 sensor, power sensor, audio sensor, and position sensor, as well as a body temperature sensor, pulse wave sensor, and odor sensor. The sensor unit 102b outputs the temperature measurement result (temperature information) obtained by the temperature sensor to the reception unit 106b. The sensor unit 102b outputs the humidity measurement result (humidity information) obtained by the humidity sensor to the reception unit 106b. The sensor unit 102b outputs the illuminance measurement result (illuminance information) obtained by the illuminance sensor to the reception unit 106b.
[0103] The sensor unit 102b outputs the result of measurement of the amount of solar radiation obtained by the solar radiation sensor (solar radiation obtained amount information) to the receiving unit 106b. The sensor unit 102b outputs the result of measurement of wind speed by the wind speed sensor (wind speed information) to the receiving unit 106b. The sensor unit 102b outputs the result of measurement of CO2 concentration by the CO2 sensor (CO2 concentration information) to the receiving unit 106b. The sensor unit 102b outputs the result of measurement of power (e.g., AC power) by the power sensor (power amount information) to the receiving unit 106b. The sensor unit 102b outputs the result of measurement of voice by the audio sensor (voice information) to the receiving unit 106b. The sensor unit 102b outputs the result of measurement of position by the position sensor (position information) to the receiving unit 106b. The sensor unit 102b outputs the result of measurement of temperature by the body temperature sensor (body temperature information) to the receiving unit 106b. Sensor unit 102b outputs the temperature measurement results (pulse wave information) from the pulse wave sensor to receiving unit 106b. Sensor unit 102b outputs the odor measurement results (odor information) from the odor sensor to receiving unit 106b.
[0104] The receiving unit 106b acquires at least one of the temperature information, humidity information, illuminance information, body temperature information, pulse wave information, odor information, voice information, location information, solar radiation acquisition information, wind speed information, CO2 concentration information, and power energy information output by the sensor unit 102b. The receiving unit 106b accepts at least one of the acquired temperature information, humidity information, illuminance information, body temperature information, pulse wave information, odor information, voice information, location information, solar radiation acquisition information, wind speed information, CO2 concentration information, and power energy information, as well as user situation identification information such as one or more pieces of image information.
[0105] Processing unit 108b can apply processing unit 108. However, the following processing is different. Processing unit 108b includes learning model 110b-1 and learning model 110b-2. Since learning model 110 can be applied to learning model 110b-1, a description thereof will be omitted here. Learning model 110b-2 is a trained model that has learned the relationship between user situation identification information and what user U is requesting by machine learning or deep learning based on the user situation identification information and what user U is requesting.
[0106] For example, in the learning stage, when user U uses a certain item to perform a certain action, information associating information identifying user U, time information, information identifying the item, information identifying the action, information identifying the location, and user situation identification information is acquired, for example, by a home gateway. Here, the information identifying the item includes the name and category of the item. Processing unit 108b acquires the information acquired by the home gateway and creates learning model 110b-2 by applying machine learning or deep learning to the acquired information. For example, processing unit 108b may perform learning using training data that includes a set of user situation identification information and information identifying the action of user U corresponding to the user situation identification information.
[0107] The processing unit 108b acquires user situation identification information such as time information, at least one of temperature information, humidity information, illuminance information, body temperature information, pulse wave information, odor information, audio information, and location information received by the receiving unit 106b, and one or more pieces of image information. The processing unit 108b inputs the acquired user situation identification information into the learning model 110b-2.
[0108] The learning model 110b-2 calculates what the user U is requesting based on the input information and outputs the calculation result (what the user U is requesting). Such a trained model can be constructed using, for example, CNN, RNN, LSTM, etc. The processing unit 108b acquires the information that identifies what the user U is requesting, output by the learning model 110b-2.
[0109] Specifically, when the user situation identification information identifies that the father has sat down in front of the television, the learning model 110b-2 outputs information identifying alcohol as what the user (father) is requesting. In addition, if the user situation identification information identifies that it is a planned day for working from home, the learning model 110b-2 outputs information identifying that user U has requested that work items (PC, printer, stationery, power supply) be prepared near the disk. In addition, when the user situation identification information identifies that it is a holiday, the learning model 110b-2 outputs information identifying that hobby items requested by user U should be prepared and that consumable items (copy paper, printer ink, stationery) should be replenished. Furthermore, when the user situation identification information identifies that it is break time, the learning model 110b-2 outputs information identifying that coffee and snacks are to be prepared as what the user U has requested.
[0110] The providing unit 112b is configured to include, for example, a single-arm robot, and acquires information acquired by the processing unit 108b that identifies what is requested by the user U. The providing unit 112b provides the user U with what the user U has requested based on the acquired information that identifies what the user U has requested.
[0111] Specifically, when the providing unit 112b acquires information that identifies alcohol as being requested by the user U, the providing unit 112b provides alcohol to the user U. In addition, when the providing unit 112b acquires information specifying that work items (PC, printer, stationery, power supply) should be prepared near the disk as requested by the user U, the providing unit 112b prepares the work items near the disk. In addition, when the provision unit 112b acquires information specifying that hobby supplies be prepared as requested by the user U and that consumables (copy paper, printer ink, stationery) be replenished, the provision unit 112b prepares the hobby supplies and replenishes the consumables. Furthermore, when the provision unit 112b acquires information specifying that coffee and a snack be prepared as requested by the user U, the provision unit 112b prepares coffee and a snack for the user U.
[0112] The storage unit 150b is realized by a HDD, a flash memory, a RAM, a ROM, or the like. The reception unit 106b, the processing unit 108b, and the providing unit 112b are realized, for example, by a hardware processor such as a CPU executing a computer program (software) stored in the storage unit 150. Furthermore, some or all of these functional units may be realized by hardware (including circuitry) such as an LSI, ASIC, FPGA, or GPU, or may be realized by a combination of software and hardware. The computer program may be stored in advance in a storage device such as a HDD or flash memory, or may be stored on a removable storage medium such as a DVD or CD-ROM and installed by inserting the storage medium into a drive device.
[0113] (Operation of living environment providing system 1b) The operation of the living environment providing system 1b will be described. 9 is a flowchart showing an example of the operation of the living environment providing system according to the second modification of the embodiment. The process of controlling the living environment can be applied to FIG. 4, and therefore the description thereof will be omitted. Here, as an example, a case will be described in which a learning model 110b-2 is created and stored in the living environment providing device 100b.
[0114] (Step S1-3) In the living environment providing device 100b, the sensor unit 102b outputs at least one of temperature information, humidity information, illuminance information, body temperature information, pulse wave information, odor information, audio information, and location information to the receiving unit 106b. The imaging unit 104 acquires one or more pieces of image information by capturing an image of the surroundings of the living environment providing device 100b, and outputs the acquired one or more pieces of image information to the receiving unit 106b.
[0115] (Step S2-3) In the living environment providing device 100b, the receiving unit 106b receives user situation identification information such as at least one of temperature information, humidity information, illuminance information, body temperature information, pulse wave information, odor information, audio information, and location information output by the sensor unit 102b, and one or more pieces of image information output by the imaging unit 104.
[0116] (Step S3-3) In the living environment providing device 100b, the processing unit 108b acquires the user situation identification information accepted by the accepting unit 106b. The processing unit 108b inputs the acquired user situation identification information to the learning model 110b-2. The learning model 110b-2 calculates what the user U is requesting based on the input user situation identification information and outputs the calculation result (what the user U is requesting). The processing unit 108b acquires the information that identifies what the user U is requesting, output by the learning model 110b-2.
[0117] (Step S4-3) In the living environment providing device 100b, the providing unit 112b acquires information that identifies what is requested by the user U, which is acquired by the processing unit 108b. The providing unit 112b provides the user U with what is requested by the user U, based on the acquired information that identifies what is requested by the user U.
[0118] In the above-described embodiment, the sensor unit 102b includes a temperature sensor, a humidity sensor, an illuminance sensor, a body temperature sensor, a pulse wave sensor, an odor sensor, an audio sensor, etc. However, the present invention is not limited to this example. For example, the sensor unit 102b may include at least one of a temperature sensor, a humidity sensor, an illuminance sensor, a body temperature sensor, a pulse wave sensor, an odor sensor, and an audio sensor.
[0119] In the above-described embodiment, when the providing unit 112b provides the user U with what the user U has requested, the sensor unit 102b may acquire at least one of temperature information, humidity information, illuminance information, body temperature information, pulse wave information, odor information, audio information, and location information, and output the acquired at least one of the temperature information, humidity information, illuminance information, body temperature information, pulse wave information, odor information, audio information, and location information to the receiving unit 106b. The receiving unit 106b acquires at least one of the temperature information, humidity information, illuminance information, body temperature information, pulse wave information, odor information, audio information, and location information output by the sensor unit 102b.
[0120] The processing unit 108b acquires information specifying what was provided to the user U from the providing unit 112b. The processing unit 108b acquires at least one of the temperature information, humidity information, illuminance information, body temperature information, pulse wave information, odor information, voice information, and location information acquired by the receiving unit 106b. The processing unit 108b acquires the result of providing the user U with what the user U requested by determining whether or not what was provided to the user U was what the user U requested based on at least one of the acquired temperature information, humidity information, illuminance information, body temperature information, pulse wave information, odor information, voice information, and location information. For example, the processing unit 108b determines whether or not the living environment matched the preferences of the user U based on the voice uttered by the user U.
[0121] The processing unit 108b may cause the learning model 110b-2 to update the relationship between the user situation specifying information and what the user is requesting, based on the user situation specifying information, information specifying what the user U is requesting, and the result of providing the thing to the user U. For example, if the result of providing the thing to the user U is positive (if what was provided to the user U was what the user U requested), the processing unit 108b causes learning using training data that is a set of the user situation specifying information and information specifying what the user is requesting that corresponds to the user situation specifying information.
[0122] According to the living environment providing system 1b according to the second modification of the embodiment, in the living environment providing device 100, the receiving unit 106b receives user situation specifying information that specifies the situation of the user U, and the processing unit 108b determines what the user U is requesting (the request target) based on the user situation specifying information received by the receiving unit 106b. The living environment providing system 1b further includes a providing unit 112b that provides the information determined by the processing unit 108b to the user U. The processing unit 108b performs machine learning on the relationship between the user situation specifying information and what the user U is requesting, and uses the results of the machine learning to determine what the user U is requesting from the user situation specifying information received by the receiving unit 106b.
[0123] By configuring in this manner, the living environment providing system 1b can create the learning model 110b-2 by machine learning the relationship between the user situation specifying information and what is required by the user U. Therefore, the living environment providing system 1b can use the created learning model 110b-2 to understand what the user U is requiring based on the user situation specifying information, and can therefore predict what the user U will try to keep around them.
[0124] In addition, in the living environment providing system 1b, the processing unit 108b may update the relationship between the user situation identification information and what the user U is requesting (the requested object) based on the result of the providing unit 112b providing the user U with what the processing unit 108b has grasped.
[0125] With this configuration, processing unit 108b acquires the result of providing unit 112b providing what processing unit 108b has grasped to user U. Processing unit 108b can update the relationship between the user situation specifying information and what user U is requesting, based on the result of processing unit 108b providing what processing unit 108b has grasped to user U, and therefore, the accuracy of what user U is requesting, which can be grasped based on the user situation specifying information, can be improved compared to when no update is performed.
[0126] (Modification 3 of the embodiment) 1 can be applied to a configuration example of a living environment providing system 1c according to a third modification of the embodiment. However, it differs from the living environment providing system 1 according to the embodiment in that a living environment providing device 100c is provided instead of the living environment providing device 100. In addition to the processing performed by the living environment providing device 100b, the living environment providing device 100c determines a storage location for the item requested by the user U. If the user U has requested that the item be stored in a storage location, the living environment providing device 100c acquires the item to be stored and moves it to the determined storage location. The living environment providing device 100c stores the acquired item in the storage location.
[0127] If the user U is requesting to acquire an item, the living environment providing device 100c moves to the determined storage location. The living environment providing device 100c acquires the item from the storage location. The living environment providing device 100c moves to the location where the user U is and provides the acquired item to the user.
[0128] An example of a storage location will be described. A case where the storage location is installed in a detached house will be described. One example of the storage location is a pantry system. The pantry system includes a pantry installed in a house and a control unit. The pantry includes a first storage box and a control unit. The first storage box may be installed in the pantry or may be the pantry itself. The first storage box also includes a first door. The first door connects the inside of the first storage box to the outside of the house. The first door also includes a first electronic lock that locks or unlocks the first door. The control unit is installed at least either inside or outside the pantry. The control unit also causes the first electronic lock to lock or unlock the first door based on the received operation. In this way, the pantry system can improve convenience for the residents of the house while preventing people from entering the house from outside via the first storage box, for example, when receiving home deliveries of food and daily necessities, which occur frequently on a daily basis. Such a pantry system, a pantry, and a home equipped with a pantry will be described in detail below, but a shoe closet may also be installed in place of the pantry.
[0129] <Pantry system configuration> 10 is a diagram showing an example of the configuration of a pantry system. The pantry system 10 is an example of the pantry system described above. The pantry system 10 includes a pantry P, a control device (not shown), an information processing device 12, and a mobile terminal 13.
[0130] The pantry system 10 is a system that improves the convenience of people who use the pantry P. For example, the pantry system 10 can reduce the effort required of people who store or keep items in the pantry P. Also, for example, the pantry system 10 can reduce the effort required of people who retrieve items stored or kept in the pantry P. Also, for example, the pantry system 10 can place an order for items to be supplied to the pantry P with a vendor in accordance with the storage or keeping status of items in the pantry P, without receiving operation from the person using the pantry. Also, the pantry system 10 is a system that improves the safety of a home in which the pantry P is installed. For example, the pantry system 10 can prevent intruders from outside the home from entering the home via the pantry P.
[0131] In the following, as an example, a case where the pantry system 10 is applied to a house H shown in Fig. 10 will be described. That is, in the pantry system 10 in this example, a pantry P is provided in the house H.
[0132] Here, a residence H in which a resident resides refers to the area within the resident's locked area within the building in which the resident resides. The resident's locked area is an area within the building that the resident can lock to prohibit entry to anyone other than the resident. The number of rooms included in the resident's locked area may be one or more. For example, if the building is a detached house, the residence includes the house itself. However, in this case, the residence does not include areas attached to the house. More specifically, in this case, the residence does not include, for example, a garden attached to the house, the area between the house and a fence attached to the house, etc. Furthermore, if the building is an apartment building, the residence includes the dwelling unit in the apartment where the resident resides. However, in this case, the residence does not include areas of the apartment building that are outside the dwelling unit. More specifically, in this case, the dwelling does not include, for example, any other dwelling unit in the condominium other than the dwelling unit in question, or common areas such as the entrance of the condominium. Note that if the resident lives in a building that has a vestibules, the dwelling may or may not include the vestibules inside.
[0133] In the example shown in FIG. 10, the house H is a detached house. Exterior walls are provided around the periphery of the house H. Furthermore, as shown in FIG. 10, the first floor of the house H has a substantially rectangular shape in plan view. The first floor of the house H has a plurality of rooms. More specifically, the first floor of the house H is divided into a plurality of rooms by a plurality of walls. At least some of the walls located between adjacent rooms among the plurality of rooms have openings or doors to allow residents to move between the rooms.
[0134] For ease of explanation, the person living in the house H will be referred to simply as a resident. Also, for ease of explanation, the area inside the house H (i.e., the area surrounded by the exterior walls of the house H) will be referred to as inside the house H. Also, for ease of explanation, the area outside the house H will be referred to as outside the house H. Note that the pantry system 10 may be configured to be applied to buildings other than houses, such as commercial buildings and factories, instead of houses such as the house H.
[0135] As shown in FIG. 10, the multiple rooms provided on the first floor of the house H include the aforementioned pantry P as well as an entrance hall, kitchen, dining room, living room, washroom, bathroom, toilet, etc. In other words, the pantry P is one of the rooms provided on the first floor of the house H. Note that the pantry P may also be one of the rooms provided on the second floor or higher of the house H. In the following, the pantry system 10 will be described using the first floor of the house H where the pantry P is provided as an example. For this reason, in the following, for convenience of explanation, the first floor of the house H will be simply referred to as the house H.
[0136] Here, the three-dimensional coordinate system HC shown in FIG. 10 is a coordinate system that indicates directions related to the house H. The positive direction of the Z axis in the three-dimensional coordinate system HC indicates, among directions perpendicular to the floor surface of the house H, the direction from the floor surface toward the ceiling surface of the house H. Furthermore, the positive direction of the Y axis in the three-dimensional coordinate system HC indicates, among directions perpendicular to the entrance wall, the direction from inside the house H toward outside the house H. The entrance wall is the exterior wall of the house H on which the entrance door G is provided. The entrance door G is the entrance door of the house H. Furthermore, the positive direction of the X axis in the three-dimensional coordinate system HC indicates, among directions perpendicular to the Y axis and the Z axis, the direction from the right side of the entrance door G toward the left side of the entrance door G when viewing the entrance wall from outside the house H.
[0137] Pantry P is an example of the pantry mentioned above. Pantry P is a room provided within residence H for storing items desired by the resident. Such items include, for example, food and drink, daily necessities, cooking utensils, tableware, etc. Pantry P is also a room for storing and storing parcels delivered by a delivery person. Below, as an example, a case where the parcels are food and drink will be described. Note that instead of food and drink, the parcels may be other items that can be stored and stored in pantry P, such as daily necessities, cooking utensils, tableware, miscellaneous goods, clothing, etc.
[0138] The pantry P is provided in the house H so as to be adjacent to a room desired by the resident among the rooms provided in the house H. The pantry P is provided in the house H so as to be adjacent to an exterior wall of the house H that the resident desires. The desired room includes at least one of the kitchen, dining room, and living room. This also includes rooms that coexist together, such as a living-dining room (LD), a living-dining-kitchen (LDK), and a dining-kitchen (DK). That is, each of the living room and dining room also includes a living-dining room. Also, each of the living room, dining room, and kitchen also includes a living-dining-kitchen. Also, each of the kitchen and dining room also includes a dining-kitchen. In the example shown in FIG. 10, the desired room includes the kitchen KC. That is, in this example, the pantry P is adjacent to the kitchen KC. Note that the desired room may include, instead of some or all of the kitchen, dining room, and living room, other rooms desired by the resident from among the multiple rooms provided in the house H in consideration of convenience. In the example shown in FIG. 10, the desired exterior wall is one of the exterior walls of the house H that is on the positive side of the X axis in the three-dimensional coordinate system HC.
[0139] The pantry P also includes a first storage box B1. The first storage box B1 is provided inside the pantry P. The first storage box B1 is a box inside the pantry P for storing and storing parcels delivered by the delivery person. The first storage box B1 is provided inside the pantry P so as to be adjacent to one of the exterior walls of the house H to which the pantry P is adjacent.
[0140] The first storage box B1 is, for example, a box having a rectangular parallelepiped shape. The shape of the first storage box B1 may be other shapes instead of a rectangular parallelepiped shape. The first storage box B1 may also be a walk-in type box. In other words, the volume of the first storage box B1 may be a volume that is larger than a person's capacity. If the first storage box B1 is a walk-in type box, the pantry system 10 allows a person who takes or puts home deliveries (e.g., a resident, a delivery person who delivers home deliveries, etc.) to easily take or put home deliveries stored in the first storage box B1. In other words, the pantry system 10 can improve the convenience of a person who takes or puts home deliveries. The first storage box B1 may not be a walk-in type box. In other words, the volume of the first storage box B1 may be a volume that is not large enough for a person to enter.
[0141] The first storage box B1 also includes a first door D1 and a second door D2. The first door D1 is an example of the aforementioned first door. The first door D1 is a door that connects the inside of the first storage box B1 to the outside of the house H. For example, an opening that connects from the outside of the house H to the inside of the first storage box B1 is formed in a portion of an exterior wall of the house H that is adjacent to the first storage box B1. The first door D1 is then provided on the side surface so as to close the opening. Note that in the pantry P, the side surface of the first storage box B1 may be configured to be formed by the portion. In this case, the opening that connects from the outside of the house H to the inside of the first storage box B1 is formed in the side surface.
[0142] When the first door D1 is opened, the inside of the first storage box B1 is connected to the outside of the house H. On the other hand, when the first door D1 is closed, the inside of the first storage box B1 is disconnected from the outside of the house H. This allows, for example, a delivery person delivering a parcel to the house H to open the first door D1 from outside the house H and store the parcel inside the first storage box B1.
[0143] The first door D1 is also equipped with a first electronic lock K1. The first electronic lock K1 is an example of the first electronic lock described above. The first electronic lock K1 is provided on the first door D1. The first electronic lock K1 is controlled by a control device to lock or unlock the first door D1.
[0144] The second door D2 is an example of the second door described above. The second door D2 is a door that connects the inside of the first storage box B1 to a desired room in the house H. For example, an opening that connects the desired room to the inside of the first storage box B1 is formed on one of the surfaces of the first storage box B1 that is adjacent to the desired room. The second door D2 is provided on that surface so as to close the opening. In the example shown in FIG. 10, the surface is one of the side surfaces of the first storage box B1 that is on the negative side of the Y axis in the three-dimensional coordinate system HC.
[0145] When the second door D2 is opened, the inside of the first storage box B1 is connected to the desired room. On the other hand, when the second door D2 is closed, the inside of the first storage box B1 is disconnected from the desired room. As a result, for example, by opening the second door D2 from inside the house H, a resident can retrieve a delivery item stored inside the first storage box B1 at the most convenient time for use without having to go outside the house H and without having to move the delivery item. As a result, the pantry system 10 can improve the convenience of the resident.
[0146] The second door D2 is also equipped with a second electronic lock K2. The second electronic lock K2 is an example of the second electronic lock described above. The second electronic lock K2 is provided on the second door D2. The second electronic lock K2 is controlled by a control device to lock the second door D2 or unlock the first door D1.
[0147] With this first storage box B1, the pantry P can store and keep items delivered by the delivery person. The resident can then take out the items stored and kept in this way from the first storage box B1 within the house H at the most convenient time for use, without having to worry about moving the items.
[0148] Here, the inside of the first storage box B1 may be provided with a member such as a shelf on which parcels can be placed, or such a member may not be provided. Also, the area may be divided into multiple areas by boards or the like, or may not be divided into multiple areas. Also, the area inside the first storage box B1 may be configured to have one or more boxes smaller than the first storage box B1, or may not have any such boxes. Below, as an example, a case will be described where the area inside the first storage box B1 is not divided into multiple areas. The entire first storage box B1 may be one refrigerator compartment, one freezer compartment, one warming compartment, etc.
[0149] The control device controls the entire pantry P. The control device is an information processing device equipped with a processor such as a CPU (Central Processing Unit) (not shown). The control device also includes a storage unit 11A (not shown in FIG. 10) and a communication unit 11B (not shown in FIG. 10). The processor included in the control device executes various programs stored in the storage unit 11A. The storage unit 11A includes, for example, a hard disk drive (HDD), a solid state drive (SSD), an electrically erasable programmable read-only memory (EEPROM), a read-only memory (ROM), a random access memory (RAM), etc. Note that instead of being built into the control device, the storage unit 11A may be an external storage device connected to the control device via a digital input / output port such as a USB. The storage unit 11A stores various types of information, images, programs, etc. to be processed by the control device. The communication unit 11B includes, for example, a digital input / output port such as a USB, an Ethernet (registered trademark) port, and the like. The processor included in the control device may be another processor such as an FPGA (Field Programmable Gate Array) instead of a CPU.
[0150] The control device causes the first electronic lock K1 to lock or unlock the first door D1 in response to an operation received from the resident via the information processing device 12. The control device also receives the operation from the resident via the information processing device 12 by wireless or wired communication. For example, the control device receives the operation from the resident via the information processing device 12 by wireless or wired communication.
[0151] Furthermore, when the control device causes the first electronic lock K1 to unlock the first door D1, it also causes the second electronic lock K2 to lock the second door D2. This allows the control device to prevent intruders from entering the house H from outside via the first storage box B1. For example, as shown in FIG. 10, if the pantry P is adjacent to the kitchen KC and the second door D2 is open, and a delivery person arrives and tries to unlock the first door D1, the first door D1 cannot be unlocked. This is to ensure the safety of the residents. Note that the pantry P may be configured to have a display unit that displays information to the delivery person that the second door D2 is open, or may be configured to notify the delivery person of this information on a mobile device carried by the delivery person.
[0152] Furthermore, when the control device receives from the mobile terminal 13 an authentication key that has been issued in advance to the mobile terminal 13 by the control device or the information processing device 12, the control device performs authentication using the received authentication key. If the authentication is successful, the control device causes the first electronic lock K1 to unlock the first door D1. That is, the mobile terminal 13 can unlock the first door D1 through the authentication. This allows the control device to prevent an unintended person from opening the first door D1.
[0153] Furthermore, the control device places an order for delivery of the parcel desired by the resident in response to an operation received from the resident via the information processing device 12. At this time, the control device may be configured to place the order with a vendor selling the parcel, with a management company that manages the house H, or with another vendor.
[0154] Here, in the example shown in FIG. 10 , the control device is built into the pantry P. In other words, in this example, the pantry P is equipped with the control device. That is, in this example, the pantry system 1 is equipped with the pantry P equipped with the control device, the information processing device 12, and the mobile terminal 13. Note that instead of being built into the pantry P, the control device may be installed outside the pantry P. The outside of the pantry P may be outside the pantry P within the house H, or may be outside the house H. In such a case, the control device is communicatively connected to each of the pantry P, the information processing device 12, and the mobile terminal 13 wirelessly or via a wired connection. Also, for example, in this case, the control device may be connected to each of the pantry P, the information processing device 12, and the mobile terminal 13 via a communication network such as the Internet. Furthermore, the functions of the control device may be provided separately both inside the pantry P and outside the pantry P.
[0155] As described above, the information processing device 12 is an information processing device owned by a resident. The information processing device 12 is, for example, a notebook PC (Personal Computer), a desktop PC, a tablet PC, a multi-function mobile phone terminal (smartphone), a mobile phone terminal, a PDA (Personal Digital Assistant), etc., but is not limited to these. In the example shown in Fig. 10, the information processing device 12 is a notebook PC.
[0156] For example, a dedicated application program PM for performing processing related to the pantry P is installed in the information processing device 12. In this case, the resident can operate the control device via an operation screen, one of various screens displayed on the display of the information processing device 12 by executing the application program PM. Here, the operation screen refers to a screen that accepts operations to cause the control device to perform various processes. For example, the resident can cause the control device to display a first captured image on the display of the information processing device 12 via the operation screen. Also, for example, the resident can cause the control device to place an order for delivery of a parcel desired by the resident via the operation screen.
[0157] The mobile terminal 13 is, for example, a handheld computer of the deliverer who delivers the parcel. Note that instead of a handheld computer, the mobile terminal 13 may be the deliverer's tablet PC, multi-function mobile phone terminal, mobile phone terminal, PDA, etc. The mobile terminal 13 accepts an authentication key issued in advance by the control device or information processing device 12. The mobile terminal 13 outputs the accepted authentication key to the control device by some method. This allows the deliverer to have the control device unlock the first door D1. As a result, the deliverer can open the first door D1 and store the parcel in the first storage box B1. Note that this method will be described later.
[0158] In addition, when the pantry P is adjacent to the kitchen (Kitchen KC in FIG. 10) as in the example shown in FIG. 10, delivered groceries and daily necessities can be used directly in the kitchen without having to be moved from the storage box (first storage box B1 or second storage box B2) provided in the pantry P to a location near or inside the kitchen in advance. The pantry P particularly enhances user convenience when groceries and daily necessities are delivered on a daily basis. Furthermore, when the pantry P is adjacent to the kitchen (Kitchen KC in FIG. 10) as in the example shown in FIG. 10, the distance traveled from the storage box to the refrigerator installed in the kitchen is short. Therefore, the pantry P can save the user the trouble of transporting frozen and refrigerated groceries and the like delivered to the pantry P.
[0159] Furthermore, even if the food delivered to the storage box is not moved to the refrigerator but is stored in place of a secondary refrigerator until it is used, the user can immediately take out the food from the pantry P when they want to use it, since the kitchen and pantry P are adjacent to each other. This effect can be obtained by the pantry P in the same way even if the pantry P is adjacent to the dining room, living room, etc.
[0160] The living environment providing device 100c included in the living environment providing system 1c will be described below. FIG. 11 is a diagram showing details of a living environment providing device included in a living environment providing system according to a third modification of the embodiment. (living environment providing device 100c) The living environment providing device 100c is a robot and is realized by including devices such as a personal computer, a server, a smartphone, a tablet computer, or an industrial computer. The living environment providing device 100c is installed in a home, in the cloud, or both. The living environment providing device 100c includes, for example, a communication unit 101, a sensor unit 102b, an imaging unit 104, a reception unit 106b, a processing unit 108b, a control unit 111, a providing unit 112c, a determination unit 114c, an instruction unit 115c, a movement unit 116c, and a storage unit 150c. The living environment providing device 100c may be realized by one or more devices having at least some of the communication unit 101, the sensor unit 102b, the imaging unit 104, the reception unit 106b, the processing unit 108b, the control unit 111, the providing unit 112c, the determination unit 114c, the instruction unit 115c, the movement unit 116c, and the storage unit 150c. At least some of the communication unit 101, sensor unit 102b, imaging unit 104, reception unit 106b, processing unit 108b, control unit 111, provision unit 112c, determination unit 114c, instruction unit 115c, movement unit 116c, and memory unit 150c may be realized as part of another device.
[0161] The providing unit 112c is configured to include, for example, a single-arm robot, and acquires information acquired by the processing unit 108b that identifies what is requested by the user U. The providing unit 112c provides the user U with what the user U has requested based on the acquired information that identifies what the user U has requested.
[0162] The storage unit 150c stores storage information and stored item information. The storage information associates information specifying one or more storage locations included in the house 10 with the location of each of the one or more storage locations. The stored item information associates information specifying one or more storage locations included in the storage information with information specifying items stored in each of the one or more storage locations.
[0163] The moving unit 116c includes, for example, a moving body, and is controlled by the instruction unit 115c to move the living environment providing apparatus 100c to an arbitrary position.
[0164] The determination unit 114c acquires information acquired by the processing unit 108b that identifies what is being requested by the user U. The determination unit 114c determines whether what the user U is requesting is to store an item or to acquire an item.
[0165] When what the user U is requesting is to store an item, the determination unit 114c identifies a storage location for storing the item based on the storage information and stored item information stored in the memory unit 150c, and determines the location of the identified storage location.
[0166] The providing unit 112c acquires information that specifies what the user U has requested, which is acquired by the processing unit 108b. The providing unit 112c acquires what to store.
[0167] The instruction unit 115c acquires information specifying the location of the storage location determined by the determination unit 114c. Based on the acquired information specifying the location of the storage location, the instruction unit 115c instructs the movement unit 116c to move the living environment providing device 100c to the storage location determined by the determination unit 114c, thereby moving the living environment providing device 100c to the location of the storage location. The provision unit 112c stores the item requested by the user U in the storage location. After the provision unit 112c stores the item requested by the user U, the instruction unit 115c instructs the movement unit 116c to move the living environment providing device 100c to its original location (place), thereby moving the living environment providing device 100c to its original location.
[0168] Specifically, when the necessary clothes and room furnishings (curtains, rugs) are delivered and it is determined that the items requested by the user U will be stored in an external storage area after use, the determination unit 114c determines a storage location for the items based on the storage information and storage item information stored in the memory unit 150c, and determines the location of the determined storage location. The provision unit 112c acquires information identifying the items requested by the user U acquired by the processing unit 108. The provision unit 112c acquires the items to be stored (clothes and room furnishings). The instruction unit 115c acquires information identifying the location of the storage location determined by the determination unit 114c. Based on the acquired information identifying the location of the storage location, the instruction unit 115c instructs the movement unit 116c to move the living environment providing device 100c to the storage location determined by the determination unit 114c, thereby moving the living environment providing device 100c to the location of the storage location. The provision unit 112c stores the items requested by the user U in the storage location.
[0169] Next, a case will be described in which it is specified that the items requested by the user U will be put up for sale at a flea market once they have finished using them. When clothing or room decorations are to be put up for sale at a flea market once they have finished using them, the providing unit 112c acquires information specifying the items requested by the user U. The providing unit 112a acquires items to be stored (clothing or room decorations) based on the information specifying that they will be prepared to be put up for sale at a flea market. The providing unit 112c and the instruction unit 115c execute a process to put up the acquired items (clothing or room decorations) at a flea market.
[0170] Furthermore, ingredients are automatically delivered to the storage location according to the dinner recipe. The processing unit 108 acquires information specifying that the item will be stored in the kitchen. The determination unit 114c specifies a storage location for the item based on the storage information and storage item information stored in the memory unit 150c, and determines the location of the specified storage location. The provision unit 112c acquires the information specifying that the item will be stored in the kitchen acquired by the processing unit 108. The provision unit 112c acquires the item (ingredients) to be stored. The instruction unit 115c acquires information specifying the location of the storage location determined by the determination unit 114c. The instruction unit 115c controls the movement unit 116c to move the item to the location of the storage location based on the acquired information specifying the location of the storage location. The provision unit 112c stores the item requested by the user U in the storage location.
[0171] When acquiring the item requested by the user U, the determination unit 114c identifies the storage location where the item is stored based on the storage information and stored item information stored in the memory unit 150c, and determines the location of the identified storage location. The provision unit 112c acquires information identifying the item requested by the user U acquired by the processing unit 108. The instruction unit 115c acquires information identifying the location of the storage location determined by the determination unit 114c. Based on the acquired information identifying the location of the storage location, the instruction unit 115c instructs the movement unit 116c to move the living environment providing device 100c to the storage location of the item determined by the determination unit 114c, thereby moving the living environment providing device 100c to the location of the storage location. The provision unit 112c acquires the item requested by the user U that is stored in the storage location. After the provision unit 112c acquires the item requested by the user U, the instruction unit 115c instructs the movement unit 116c to move the living environment providing device 100c to its original location, thereby moving the living environment providing device 100c to its original location. The providing unit 112c moves the moving unit 116c to the original position, and then provides the user U with what the user U has requested.
[0172] Specifically, when it is determined that the father has sat in front of the television and the item requested by the user U is alcohol, the determination unit 114c determines the storage location (e.g., the kitchen) where the item (alcohol) is stored based on the storage information and storage item information stored in the memory unit 150c, and determines the location of the determined storage location. The provision unit 112c acquires information identifying the item (alcohol) requested by the user U acquired by the processing unit 108. The instruction unit 115c acquires information identifying the location of the storage location (e.g., the kitchen) determined by the determination unit 114c. Based on the acquired information identifying the location of the storage location, the instruction unit 115c instructs the movement unit 116c to move the living environment providing device 100c to the storage location determined by the determination unit 114c, thereby moving the living environment providing device 100c to the location of the storage location. The provision unit 112c acquires the item requested by the user U that is stored in the storage location. After the providing unit 112c acquires what the user U has requested, the instruction unit 115c instructs the moving unit 116c to move the living environment providing device 100c to its original position. After the instruction unit 115c causes the moving unit 116c to move to its original position, the providing unit 112c provides the user U with what the user U has requested.
[0173] The providing unit 112c and the determining unit 114c are realized, for example, by a hardware processor such as a CPU executing a computer program (software) stored in the storage unit 150c. Furthermore, some or all of these functional units may be realized by hardware (including circuitry) such as an LSI, ASIC, FPGA, or GPU, or may be realized by a combination of software and hardware. The computer program may be stored in advance in a storage device such as a HDD or flash memory, or may be stored in a removable storage medium such as a DVD or CD-ROM and installed by inserting the storage medium into a drive.
[0174] (Operation of living environment providing system 1c) The operation of the living environment providing system 1c will be described. FIG. 12 is a flowchart showing an example of the operation of the living environment providing system according to the third modification of the embodiment. Steps S1-3 to S3-3 described with reference to FIG. 9 can be applied to steps S1-4 to S3-4, and therefore a description thereof will be omitted here.
[0175] (Step S4-4) In the living environment providing device 100c, the determination unit 114c acquires information acquired by the processing unit 108b that identifies what is requested by the user U. The determination unit 114c determines whether what is requested by the user U is to store something.
[0176] (Step S5-4) In the living environment providing device 100c, when the determination unit 114c determines that what the user U is requesting is to store an item, it identifies a storage location to store the item based on the storage information and stored item information stored in the memory unit 150c, and determines the location of the identified storage location.
[0177] (Step S6-4) In the living environment providing device 100c, the providing unit 112c acquires information identifying the item requested by the user U acquired by the processing unit 108b, and the instruction unit 115c acquires information identifying the location of the determined storage location. The providing unit 112c acquires the item to be stored.
[0178] (Step S7-4) In the living environment providing device 100c, the instruction unit 115c instructs the movement unit 116c to move the living environment providing device 100c to the storage location determined by the determination unit 114c, based on the acquired information specifying the location of the storage location, thereby moving the living environment providing device 100c to the location of the storage location.
[0179] (Step S8-4) In the living environment providing device 100c, the providing unit 112c stores the item requested by the user U in a storage location.
[0180] (Step S9-4) In the living environment providing device 100c, after the providing unit 112c stores the item requested by the user U, the instruction unit 115c instructs the moving unit 116c to move the living environment providing device 100c to its original position, thereby moving the living environment providing device 100c to its original position.
[0181] (Step S10-4) In the living environment providing device 100c, when the user U requests to acquire an item, the determination unit 114c identifies the storage location where the item is stored based on the storage information and stored item information stored in the memory unit 150c, and determines the location of the identified storage location.
[0182] (Step S11-4) In the living environment providing device 100c, the providing unit 112c acquires information identifying the item requested by the user U acquired by the processing unit 108b, and the instructing unit 115c acquires information identifying the location of the storage location determined by the determining unit 114c. Based on the acquired information identifying the location of the storage location, the instructing unit 115c instructs the moving unit 116c to move the living environment providing device 100c to the storage location of the item determined by the determining unit 114c, thereby moving the living environment providing device 100c to the location of the storage location.
[0183] (Step S12-4) In the living environment providing device 100c, the providing unit 112c acquires the item requested by the user U that is stored in the storage location.
[0184] (Step S13-4) In the living environment providing device 100c, after the providing unit 112c acquires what the user U has requested, the instruction unit 115c moves the living environment providing device 100c to its original position by instructing the moving unit 116c to move the living environment providing device 100c to its original position.
[0185] (Step S14-4) In the living environment providing device 100c, after the instruction unit 115c causes the movement unit 116c to move to the original position, the provision unit 112c provides the user U with what the user U has requested.
[0186] In the third modification of the embodiment described above, the storage location is provided inside the house 10, but this is not limiting. For example, the storage location may be provided outside the house 10, or may be an outdoor storage space.
[0187] According to the living environment providing system 1c relating to the third variant example of the embodiment, the living environment providing device 100c further includes a determination unit 114c that determines a storage location of the item identified by the processing unit 108b in the living environment providing device 100, a movement unit 116c, and an instruction unit 115c that instructs the movement unit 116c to move the living environment providing device 100c to the storage location of the item determined by the determination unit 114c.
[0188] With this configuration, living environment providing system 1c can further include determination unit 114c that determines a storage location for the item identified by processing unit 108b, movement unit 116c, and instruction unit 115c that instructs movement unit 116c to move living environment providing device 100c to the storage location for the item determined by determination unit 114c. Thus, living environment providing system 1c can move to the determined storage location.
[0189] In addition, in the living environment providing system 1c, the storage location is an outdoor storage space. With this configuration, the living environment providing device 100c can obtain items from the outdoor storage location, thereby reducing the storage location for items within the home. This allows for an increase in living space. Furthermore, in the living environment providing system 1c, the providing unit 112c stores the item in the storage location determined by the determining unit 114c. By configuring in this way, the living environment providing system 1c can store the item in the storage location determined by the determining unit 114c. Therefore, the user can store the item without storing it in a storage location.
[0190] (Fourth Modification of the Embodiment) 1 can be applied to a configuration example of a living environment providing system 1d according to a fourth modification of the embodiment. However, it differs from the living environment providing system 1 according to the embodiment in that a living environment providing device 100d is provided instead of the living environment providing device 100. The living environment providing device 100d performs the following processes in addition to the processes performed by the living environment providing device 100c. The living environment providing device 100d determines a storage location for the item requested by the user U. If the item requested by the user U is to be stored in a storage location, the living environment providing device 100d acquires the item and moves it to the determined storage location. The living environment providing device 100d stores the acquired item in the storage location.
[0191] If the user U is requesting to acquire an item, the living environment providing device 100d moves to the determined storage location. The living environment providing device 100d acquires the item from the storage location. The living environment providing device 100d moves to the location where the user U is and provides the acquired item to the user.
[0192] When the living environment providing device 100d provides the user U with something that the user U has requested, it acquires at least one of temperature information, humidity information, illuminance information, body temperature information, pulse wave information, odor information, audio information, and location information, and determines whether the thing provided to the user U was what the user U requested based on the acquired at least one of the temperature information, humidity information, illuminance information, body temperature information, pulse wave information, odor information, audio information, and location information, thereby acquiring the result of providing the thing that the user U requested to the user U.
[0193] If the result of providing an item to user U is positive (if the item provided to user U is what user U requested), living environment providing device 100d performs charging processing based on the price of the item, and if the result of providing an item to user U is negative (if the item provided to user U is not what user U requested), living environment providing device 100d does not perform charging processing based on the price of the item. If the result of providing an item to user U is negative, living environment providing device 100d moves the item to a storage location. After moving the item to the storage location, living environment providing device 100d returns the item to the storage location. An example of the storage location has been described in the third modified example of the embodiment, and therefore will not be described here. The living environment providing device 100d included in the living environment providing system 1d will be described below.
[0194] FIG. 13 is a diagram showing details of a living environment providing device included in a living environment providing system according to a fourth modification of the embodiment. (living environment providing device 100d) The living environment providing device 100d is a robot, and is realized by including devices such as a personal computer, a server, a smartphone, a tablet computer, an industrial computer, etc. The living environment providing device 100d includes, for example, a communication unit 101, a sensor unit 102b, an imaging unit 104, a reception unit 106b, a processing unit 108b, a control unit 111, a provision unit 112d, a determination unit 114d, an instruction unit 115d, a movement unit 116d, a billing unit 118d, and a storage unit 150d.
[0195] The providing unit 112d is configured to include, for example, a single-arm robot, and acquires information acquired by the processing unit 108b that identifies what is requested by the user U. The providing unit 112d provides the user U with what the user U has requested, based on the acquired information that identifies what the user U has requested. The storage unit 150d stores storage information and storage item information. The moving unit 116d includes, for example, a moving body, and is controlled by the instruction unit 115d to move the living environment providing apparatus 100d to an arbitrary position.
[0196] The determination unit 114d acquires information acquired by the processing unit 108b that identifies what is being requested by the user U. The determination unit 114d determines whether what the user U is requesting is to store an item or to acquire an item.
[0197] When the user U requests that an item be stored, the determination unit 114d identifies a storage location for storing the item based on the storage information and stored item information stored in the memory unit 150d, and determines the location of the identified storage location. The provision unit 112d acquires information identifying the item requested by the user U acquired by the processing unit 108b. The provision unit 112d acquires the item to be stored. The instruction unit 115d acquires information identifying the location of the storage location determined by the determination unit 114d. Based on the acquired information identifying the location of the storage location, the instruction unit 115d instructs the movement unit 116d to move the living environment providing device 100d to the storage location determined by the determination unit 114d, thereby moving the living environment providing device 100d to the location of the storage location. The provision unit 112d stores the item requested by the user U in the storage location. After the providing unit 112d stores the item requested by the user U, the instruction unit 115d instructs the moving unit 116d to move the living environment providing device 100d to its original position, thereby moving the living environment providing device 100d to its original position.
[0198] When the determination unit 114d determines that the user U is requesting an item, it identifies the storage location where the item is stored based on the storage information and stored item information stored in the memory unit 150d, and determines the location of the identified storage location. The provision unit 112d acquires information identifying the item requested by the user U acquired by the processing unit 108b. The instruction unit 115d acquires information identifying the location of the storage location determined by the determination unit 114d. Based on the acquired information identifying the location of the storage location, the instruction unit 115d instructs the movement unit 116d to move the living environment providing device 100d to the storage location of the item determined by the determination unit 114d, thereby moving the living environment providing device 100d to the location of the storage location. The provision unit 112d acquires the item requested by the user U that is stored in the storage location. After the provision unit 112d acquires the item requested by the user U, the instruction unit 115d instructs the movement unit 116d to move the living environment providing device 100d to its original location, thereby moving the living environment providing device 100d to its original location. The instruction unit 115d causes the movement unit 116d to move to the original position, and then the provision unit 112d provides the user U with what the user U has requested.
[0199] When the providing unit 112d provides the user U with what the user U requested, the sensor unit 102b acquires at least one of temperature information, humidity information, illuminance information, body temperature information, pulse wave information, odor information, audio information, and location information, and outputs the acquired at least one of the temperature information, humidity information, illuminance information, body temperature information, pulse wave information, odor information, audio information, and location information to the receiving unit 106b. The receiving unit 106b acquires at least one of the temperature information, humidity information, illuminance information, body temperature information, pulse wave information, odor information, audio information, and location information output by the sensor unit 102b. The processing unit 108b acquires information identifying what was provided to the user U from the providing unit 112d. The processing unit 108b acquires at least one of the temperature information, humidity information, illuminance information, body temperature information, pulse wave information, odor information, audio information, and location information acquired by the receiving unit 106b. The processing unit 108b obtains the result of providing something to the user U by determining whether or not the thing provided to the user U was what the user U requested, based on at least one of the acquired temperature information, humidity information, illuminance information, body temperature information, pulse wave information, odor information, voice information, and location information.
[0200] The charging unit 118d performs charging processing based on the price of the item when the result of providing the item to the user U is positive, and does not perform charging processing based on the price of the item when the result of providing the item to the user U is negative.
[0201] If the result of providing the item to the user U is negative, the providing unit 112d causes the moving unit 116d to move the item to a storage location. After causing the moving unit 116d to move the item to the storage location, the providing unit 112d returns the item to the storage location.
[0202] The providing unit 112d, the determining unit 114d, and the billing unit 118d are realized, for example, by a hardware processor such as a CPU executing a computer program (software) stored in the storage unit 150d. Furthermore, some or all of these functional units may be realized by hardware (including circuitry) such as an LSI, ASIC, FPGA, or GPU, or may be realized by a combination of software and hardware. The computer program may be stored in advance in a storage device such as a HDD or flash memory, or may be stored on a removable storage medium such as a DVD or CD-ROM and installed by inserting the storage medium into a drive.
[0203] (Operation of living environment providing system 1d) The operation of the living environment providing system 1d will be described. FIG. 14 is a flowchart showing an example of the operation of the living environment providing system according to the fourth modification of the embodiment. Steps S1-4 to S3-4 and S10-4 to S14-4 described with reference to FIG. 13 can be applied to steps S1-5 to S8-5, and therefore a description thereof will be omitted here.
[0204] (Step S9-5) In living environment providing device 100d, when providing unit 112d provides user U with what user U has requested, sensor unit 102b acquires at least one of temperature information, humidity information, illuminance information, body temperature information, pulse wave information, odor information, audio information, and location information, and outputs the acquired at least one of temperature information, humidity information, illuminance information, body temperature information, pulse wave information, odor information, audio information, and location information to receiving unit 106b. Receiving unit 106b acquires at least one of temperature information, humidity information, illuminance information, body temperature information, pulse wave information, odor information, audio information, and location information output by sensor unit 102b. Processing unit 108b acquires information identifying what was provided to user U from providing unit 112d. Processing unit 108b acquires at least one of temperature information, humidity information, illuminance information, body temperature information, pulse wave information, odor information, audio information, and location information acquired by receiving unit 106b. The processing unit 108b obtains the result of providing something to the user U by determining whether or not the thing provided to the user U was what the user U requested, based on at least one of the acquired temperature information, humidity information, illuminance information, body temperature information, pulse wave information, odor information, voice information, and location information.
[0205] (Step S10-5) In the living environment providing device 100d, the billing unit 118d performs billing processing based on the price of the item when the result of providing the item to the user U is positive.
[0206] (Step S11-5) In the living environment providing device 100d, when the result of providing the item to the user U is negative, the instruction unit 115d instructs the moving unit 116d to move the living environment providing device 100d to the storage location of the item determined by the determination unit 114d, thereby moving the item to the storage location. After the moving unit 116d moves the item to the storage location, the providing unit 112d returns the item to the storage location.
[0207] In the fourth modification of the embodiment described above, the living environment providing device 100d performs charging based on the price of the item when the result of providing the item to the user U is positive, but this is not limiting. For example, the charging unit 118d may perform charging for the item when it is acquired from the storage location, or may perform charging for the item when it is provided to the user U.
[0208] According to the living environment providing system 1d relating to the second variant example of the embodiment, the living environment providing device 100d further includes a charging unit 118d that charges for items acquired from the storage location or items provided by the providing unit 112d in the living environment providing device 100c, and the charging unit 118d charges based on the result of the providing unit 112d providing the user U with items acquired from the storage location or the result of the providing unit 112d providing the user with items it possesses.
[0209] With this configuration, it is possible to charge for items acquired from a storage location or items provided by the providing unit 112d, and the living environment providing system 1d can provide items by selling them. Furthermore, the living environment providing system 1d can charge based on the result of providing the user U with an item acquired from a storage location or the result of the providing unit 112d providing the user with an item it owns. Therefore, if the user U does not need the item as a result of providing the user U with an item acquired from a storage location or the providing unit 112d providing the user with an item it owns, no charge will be made. This makes it possible to prevent charging for items that are not needed, as compared to when the item is acquired from a storage location.
[0210] (Fifth Modification of the Embodiment) 1 can be applied to a configuration example of a living environment providing system 1e according to a fifth modification of the embodiment. However, it differs from the living environment providing system 1 according to the embodiment in that a living environment providing device 100e is provided instead of the living environment providing device 100. The living environment providing device 100e executes the following process in addition to the process executed by the living environment providing device 100c. The living environment providing device 100e determines whether or not there is something requested by the user U. If the living environment providing device 100e determines that the thing requested by the user U does not exist, it places an order for that thing.
[0211] When the living environment providing device 100e determines that the item requested by the user U exists, it determines a storage location for that item. When the user U has requested that the item be stored in a storage location, the living environment providing device 100e acquires the item and moves it to the determined storage location. The living environment providing device 100e stores the acquired item in the storage location.
[0212] If the user U is requesting to acquire an item, the living environment providing device 100e moves to the determined storage location. The living environment providing device 100e acquires the item from the storage location. The living environment providing device 100e moves to the location where the user U is and provides the acquired item to the user. An example of the storage location has been described in the third modified example of the embodiment, and therefore will not be described here. The living environment providing device 100e included in the living environment providing system 1e will be described below.
[0213] FIG. 15 is a diagram showing details of a living environment providing device included in a living environment providing system according to a fifth modification of the embodiment. (living environment providing device 100e) The living environment providing device 100e is a robot, and is realized by including devices such as a personal computer, a server, a smartphone, a tablet computer, an industrial computer, etc. The living environment providing device 100e includes, for example, a communication unit 101, a sensor unit 102b, an imaging unit 104, a reception unit 106b, a processing unit 108b, a control unit 111, a provision unit 112e, a determination unit 114e, an instruction unit 115e, a movement unit 116e, an order unit 120e, and a storage unit 150e.
[0214] The providing unit 112e is configured to include, for example, a single-arm robot, and acquires information acquired by the processing unit 108b that identifies what is requested by the user U. The providing unit 112e provides the user U with what is requested by the user U based on the acquired information that identifies what is requested by the user U. The storage unit 150e stores storage information and storage item information. The moving unit 116e includes, for example, a moving body, and is controlled by the providing unit 112e to move the living environment providing apparatus 100e to an arbitrary position.
[0215] The determination unit 114e acquires information acquired by the processing unit 108b that identifies what is being requested by the user U. The determination unit 114e determines whether what the user U is requesting is to store an item or to acquire an item.
[0216] When the user U is requesting to store an item, the determination unit 114e identifies a storage location to store the item based on the storage information and stored item information stored in the memory unit 150e, and determines the location of the identified storage location. The provision unit 112e acquires information identifying the item requested by the user U acquired by the processing unit 108b. The provision unit 112e acquires the item to be stored. The instruction unit 115e acquires information identifying the location of the storage location determined by the determination unit 114e. Based on the acquired information identifying the location of the storage location, the instruction unit 115e instructs the movement unit 116e to move the living environment providing device 100e to the storage location determined by the determination unit 114e, thereby moving the living environment providing device 100e to the location of the storage location. The provision unit 112e stores the item requested by the user U in the storage location. After the providing unit 112e stores the item requested by the user U, the instruction unit 115e instructs the moving unit 116e to move the living environment providing device 100e to its original position, thereby moving the living environment providing device 100e to its original position.
[0217] If the determining unit 114e determines that the user U is requesting to acquire an item, it determines whether or not the item is available. When the determining unit 114e determines that the item is not available, the ordering unit 120e places an order for the item. For example, the ordering unit 120e performs the ordering process via a home gateway (not shown). When the determination unit 114e determines that the item is present, it identifies the storage location where the item is stored based on the storage information and stored item information stored in the memory unit 150e, and determines the position of the identified storage location.
[0218] The providing unit 112e acquires information identifying the item requested by the user U, which is acquired by the processing unit 108b. The instruction unit 115e acquires information identifying the location of the storage location determined by the determination unit 114e. Based on the acquired information identifying the location of the storage location, the instruction unit 115e instructs the moving unit 116e to move the living environment providing device 100e to the storage location of the item determined by the determination unit 114e, thereby moving the living environment providing device 100e to the location of the storage location. The providing unit 112e acquires the item requested by the user U, which is stored in the storage location. After the providing unit 112e acquires the item requested by the user U, the instruction unit 115e instructs the moving unit 116e to move the living environment providing device 100e to its original location, thereby moving the living environment providing device 100e to its original location. After the instruction unit 115e causes the moving unit 116e to move the living environment providing device 100e to its original location, the providing unit 112e provides the item requested by the user U to the user U.
[0219] The providing unit 112e, the determining unit 114e, and the ordering unit 120e are realized, for example, by a hardware processor such as a CPU executing a computer program (software) stored in the storage unit 150e. Furthermore, some or all of these functional units may be realized by hardware (including circuitry) such as an LSI, ASIC, FPGA, or GPU, or may be realized by a combination of software and hardware. The computer program may be stored in advance in a storage device such as a HDD or flash memory, or may be stored on a removable storage medium such as a DVD or CD-ROM and installed by inserting the storage medium into a drive device.
[0220] (Operation of the living environment provision system 1e) The operation of the living environment providing system 1e will be described. FIG. 16 is a flowchart showing an example of the operation of the living environment providing system according to the fifth modification of the embodiment. Steps S1-4 to S3-4 described with reference to FIG. 13 can be applied to steps S1-6 to S3-6, and therefore a description thereof will be omitted here.
[0221] (Step S4-6) In the living environment providing device 100e, when the determining unit 114e determines that the user U is requesting to acquire an item, it determines whether or not the item is available. Steps S10-4 to S14-4 described with reference to FIG. 13 can be applied to steps S5-6 to S9-6, and therefore a description thereof will be omitted here.
[0222] (Step S10-6) In the living environment providing device 100e, when the determining unit 114e determines that the item does not exist, the ordering unit 120e orders the item.
[0223] According to the living environment providing system 1e relating to the fifth embodiment, the living environment providing device 100e further includes an ordering unit 120e that orders an item when the determination unit 114e in the living environment providing device 100 determines that there is no item in the storage location. With this configuration, the living environment providing system 1e can order the item when the determination unit 114e determines that the item is not in the storage location. Therefore, the user U can obtain the item without having to order it.
[0224] In the above-described first modification, it has been described that in the living environment providing system 1a according to the first modification, a living environment that suits the user's preferences can be carried from a first building to a second building different from the first building. In the living environment providing system 1 according to the embodiment and the living environment providing systems 1b, 1c, and 1d according to the second to fifth modifications, respectively, the control unit 111 provided in the living environment providing devices 100b, 100c, and 100d may control the living environment of the second building different from the first building based on the living environment that suits the user's preferences ascertained by the processing units 108 and 108b.
[0225] Furthermore, in the vehicle in-vehicle environment providing system 1f relating to variant example 6, the control unit 111f provided in the vehicle in-vehicle environment providing device 100f may control the vehicle in-vehicle environment of a second vehicle different from the first vehicle based on the vehicle in-vehicle environment that matches the user's preferences as determined by the processing unit 108f. That is, the control unit may control the environment of the second space, which is different from the first space, based on the environment that matches the user's preferences ascertained by the processing unit.
[0226] In the above-described Modification 2, a case has been described in which a requested object requested by a user is provided to the user. The environment providing device may provide the requested object requested by the user in a second space different from the first space.
[0227] In Modification 3, a case has been described in which an item is stored in a storage location in response to a user request, or a case in which a requested object is obtained from a storage location and provided to the user. The environment providing device may store an item in a storage location in response to a user request, or may obtain a requested object from a storage location and provide it to the user, in a second space different from the first space.
[0228] In Variation 4, a case has been described in which, if the result of providing a requested object to a user is positive, a charging process is performed based on the price of the requested object, and if the result is negative, the charging process is not performed. In a second space different from the first space, the environment providing device, if the result of providing a requested object to a user is positive, a charging process is performed based on the price of the requested object, and if the result is negative, the charging process does not have to be performed.
[0229] In the fifth modification, a case has been described in which a requested object is ordered when it is determined that the requested object is not within a space. In a second space different from the first space, the environment providing device may order the requested object when it is determined that the requested object is not within the second space.
[0230] The above describes various processes related to a requested object that are performed in a second space different from the first space. These various processes related to the requested object are suitable, for example, for a user who is staying at an accommodation facility on a travel or business trip, and who needs a requested object and does not have the requested object in stock at the accommodation facility, because the user can receive the requested object from the environment providing device. The second space may also be any of various stores or facilities with private rooms, as long as the environment can be controlled and user control is permitted. Examples of various stores include restaurants with private rooms. Examples of various facilities include entertainment facilities such as karaoke booths, or beauty salons.
[0231] (Modification 6 of the embodiment) The sixth modification of the embodiment will be described in detail below with reference to the drawings. In the above embodiment and Modifications 1 to 5 of the embodiment, an environment providing system in which an environment providing device is provided in a building such as a house and provides a living environment to a user is described. In Modification 6, an environment providing system in which an environment providing device is provided in a vehicle and provides an in-vehicle environment to a user is described. Therefore, Modification 6 differs from the above embodiment and Modifications 1 to 5 of the embodiment in that the space to be controlled for the environment is a vehicle and not a building. In Modification 6, as an example, a case will be described in which the control of the environment providing device is the same as the control of the living environment providing device 100a according to Modification 1, except that the space to be controlled for the environment is a vehicle and not a building.
[0232] FIG. 17 is a diagram showing an example of the configuration of a vehicle interior environment providing system 1f according to a sixth modified example of the embodiment. The vehicle interior environment providing system 1f is an example of an environment providing system. The vehicle interior environment providing system 1f includes a vehicle interior environment providing device 100f. As an example, the vehicle interior environment providing device 100f is provided at a predetermined position on the seat of the automobile V (such as the dashboard, windshield, or rearview mirror). A user U1f is an occupant (driver or passenger) of the automobile V. The terminal device 200f-1 is used by the user U1f. The user U1f is provided with an environment inside the vehicle (hereinafter referred to as "vehicle interior environment") by the vehicle interior environment providing device 100f. The interior of the vehicle refers to the space inside the automobile V, including the driver's seat, passenger seat, and the entire back seat.
[0233] In addition, in FIG. 17, users U2f, ..., and user Unf are shown along with user U1f. Also, in FIG. 17, terminal devices 200f-2, ..., and terminal device 200f-n used by users U2f, ..., and user Unf, respectively, are shown. Although users U2f, ..., and user Unf are not in automobile V in FIG. 17, if they were in automobile V, they would receive an in-vehicle environment from vehicle in-environment providing device 100f, just like user U1f. In the following description, any user from users U1f to user Unf will be referred to as user Uf. Any terminal device from terminal device 200f-1 to terminal device 200f-n will be referred to as terminal device 200f.
[0234] The vehicle interior environment providing device 100f is provided in a vehicle. An automobile V is an example of a vehicle. A vehicle is, for example, a vehicle used by a person. Examples of vehicles used by a person include automobiles and other vehicles, or ships such as yachts and cruisers. Note that the space inside the vehicle does not need to be sealed off from the space outside the vehicle as long as the environment (temperature, illuminance, etc.) of the space can be controlled. Examples of vehicles may include an open car or a vehicle with a roof over the passenger seats.
[0235] In addition, if the environment of at least the space used by an individual within the vehicle can be changed to suit the individual's preferences and the individual is permitted to change the environment to suit the individual's preferences, the vehicle may be public. The space used by an individual is, for example, a partitioned private room within the vehicle. The public vehicle is, for example, a bus, a train, a passenger ship, or a passenger airplane.
[0236] The vehicle interior environment providing device 100f receives user identification information and information that identifies the vehicle status (hereinafter referred to as "vehicle status identification information"). The vehicle status identification information includes, for example, vehicle information, seat information, etc. The vehicle interior environment providing device 100f determines a vehicle interior environment that matches the preferences of the user Uf based on the received user identification information and vehicle status identification information. The vehicle status identification information is an example of first spatial status identification information.
[0237] The vehicle in-vehicle environment providing device 100f also acquires information specifying the performance of facilities equipped in the vehicle and information specifying the environment of seats equipped in the vehicle. The vehicle in-vehicle environment providing device 100f controls the vehicle in-vehicle environment of the vehicle in which the user Uf is riding, based on the acquired information specifying the performance of facilities equipped in the vehicle, the information specifying the environment of seats equipped in the vehicle, and the grasped vehicle in-vehicle environment that matches the preferences of the user Uf. The information specifying the performance of the facilities provided on the vehicle and the information specifying the environment of the seats provided on the vehicle are each an example of second spatial situation specifying information that is different from the first spatial situation specifying information.
[0238] The vehicle in-vehicle environment providing device 100f included in the vehicle in-vehicle environment providing system 1f will be described below. Fig. 18 is a diagram showing details of the vehicle in-vehicle environment providing device 100f included in the vehicle in-vehicle environment providing system 1f according to a sixth modified example of the embodiment. (In-vehicle environment providing device 100f) The vehicle interior environment providing device 100f is realized by including a device such as a personal computer, a server, a smartphone, a tablet computer, a robot, or an industrial computer. The vehicle interior environment providing device 100f is installed in either or both of the vehicle and the cloud server. The vehicle interior environment providing device 100f may be a terminal device. The terminal device may be a smartphone, a tablet computer, or the like. The vehicle interior environment providing device 100f may be incorporated into a vehicle control device.
[0239] The vehicle interior environment providing device 100f includes, for example, a communication unit 101f, a sensor unit 102f, an imaging unit 104f, a reception unit 106f, an acquisition unit 107f, a processing unit 108f, and a storage unit 150f. The vehicle interior environment providing device 100f may be realized by one or more devices having at least some of the communication unit 101f, the sensor unit 102f, the imaging unit 104f, the reception unit 106f, the acquisition unit 107f, the processing unit 108f, and the storage unit 150f. At least some of the communication unit 101f, the sensor unit 102f, the imaging unit 104f, the reception unit 106f, the acquisition unit 107f, the processing unit 108f, and the storage unit 150f may be realized as part of another device. Other devices include, for example, devices installed in a vehicle such as various sensors, in-vehicle cameras, drive recorders, or HMI (Human Machine Interface), or devices not installed in a vehicle such as the cloud server mentioned above.
[0240] The communication unit 101f is realized by a communication module. The communication unit 101 communicates with an external communication device via a network. The communication unit 101f communicates with the terminal device 200f using short-range wireless communication such as Bluetooth (registered trademark). The communication unit 101f receives an in-vehicle environment request transmitted by the terminal device 200f. The communication unit 101f may communicate with the terminal device 200f by connecting the terminal device 200f to the communication unit 101f using a dedicated cable. Furthermore, the communication unit 101f may communicate with an external communication device using wireless communication such as a mobile communication network such as LTE (registered trademark) or an in-vehicle LAN (Local Area Network).
[0241] The sensor unit 102f has the same functions as the sensor unit 102, except that the object to be detected or measured is the environment inside the vehicle. The imaging unit 104f captures one or more pieces of image information by capturing an image of the periphery of the vehicle interior environment providing device 100f. The periphery of the vehicle interior environment providing device 100f is the periphery of a predetermined position of a seat on which the vehicle interior environment providing device 100f is provided.
[0242] The reception unit 106f acquires the vehicle interior environment request output by the communication unit 101f. The reception unit 106f accepts user identification information included in the acquired vehicle interior environment request. The reception unit 106f acquires at least one of audio information and location information output by the sensor unit 102f. The reception unit 106f acquires one or more pieces of image information output by the imaging unit 104f. The reception unit 106f accepts vehicle situation identification information such as the acquired audio information, at least one of location information, and one or more pieces of image information.
[0243] The processing unit 108f includes a learning model 110f. The learning model 110f is a trained model that has been trained by machine learning to determine the relationship between a combination of user-specific information and one or more vehicle-specific information, and information that identifies the vehicle environment that matches the preferences of the user Uf. Machine learning is, for example, deep learning.
[0244] Examples of vehicle status identification information include vehicle information and seat information, and are stored in the memory unit 150f. Vehicle information is information that identifies a vehicle. Vehicle information includes, for example, vehicle type, owner, and parking location information. Parking location information is information that indicates the location where a vehicle is stopped or parked, and is indicated by an address or one or both of longitude and latitude. Figure 19A is a diagram showing an example of vehicle status identification information. Vehicle information includes a vehicle number, a vehicle type, and a vehicle area. The vehicle number is vehicle identification information, and an example of a vehicle number is "AA3489c." The vehicle area is the area of the vehicle, and an example of a vehicle area is "14m^2."
[0245] FIG. 19B is a diagram showing an example of seat information. The seat information includes a vehicle number, a seat number, a seat name, an area, a volume, a window position, and a window area. The seat number is identification information of a seat in the vehicle corresponding to the vehicle number, and an example of a seat number is "01." The seat name is information indicating the name of the seat corresponding to the seat number, and an example of a seat name is "rear seat." The area is the area of the seat, and an example of an area is "5 m^2." The volume is the volume of the seat, and an example of a volume is "8 m^3." The window position is the position of a window provided in the seat, and an example of a window position is "RL." The window area is the area of a window provided in the seat, and an example of a window area is "0.6 m^2." The window position and window area are each examples of information specifying the environment of a seat provided in a vehicle.
[0246] Furthermore, the storage unit 150f stores facility information together with vehicle status identification information. FIG. 19C is a diagram illustrating an example of facility information. The facility information includes a vehicle number, a seat number, a facility number, a facility name, a product number, efficiency 1, and efficiency 2. The facility number is identification information of the facility owned by the seat corresponding to the seat number, and an example of the facility number is "0003." The facility name is information indicating the name of the facility, and an example of the facility name is "air conditioner." The product number is information indicating the product number of the facility, and an example of the product number is "PCM055." Efficiency 1 is information indicating the efficiency (maximum efficiency) of the facility corresponding to the facility number, and an example of efficiency 1 is "450%." Efficiency 2 is information indicating the efficiency (normal efficiency) of the facility corresponding to the facility number, and an example of efficiency 2 is "400%." Efficiency 1 and efficiency 2 are each an example of information specifying the performance of the facility.
[0247] The acquiring unit 107f acquires information that identifies the performance of the facilities equipped in the vehicle from the facility information stored in the storage unit 150f based on the vehicle identification information such as the vehicle number included in the vehicle status identification information received by the receiving unit 106f. Also, the acquiring unit 107f acquires information that identifies the environment of the seats equipped in the vehicle from the seat information stored in the storage unit 150f based on the vehicle identification information.
[0248] The control unit 111f acquires information specifying an in-vehicle environment that matches the preferences of the user Uf acquired by the processing unit 108f. The control unit 111f also acquires information specifying the performance of the facilities equipped in the vehicle and information specifying the environment of the seats equipped in the vehicle acquired by the acquisition unit 107f. The control unit 111f controls the in-vehicle environment of the vehicle in which the user Uf is riding, based on the acquired information specifying an in-vehicle environment that matches the preferences of the user Uf, the information specifying the performance of the facilities equipped in the vehicle, and the information specifying the environment of the seats equipped in the vehicle.
[0249] The control unit 111f controls the facilities included in the facility information based on information specifying the vehicle interior environment that matches the preferences of the user Uf, information specifying the performance of the facilities provided in the vehicle, and information specifying the environment of the seats provided in the vehicle. For example, the control unit 111f controls an air conditioner provided in the vehicle to adjust the room temperature of the seats in the vehicle. For example, the control unit 111f adjusts at least one of the temperature and humidity of the seats by controlling the opening and closing of windows provided in the seats. For example, the control unit 111f adjusts the amount of solar radiation obtained by controlling the opening and closing of blinds provided in windows provided in the seats.
[0250] (Operation of the vehicle environment provision system 1F) The operation of the vehicle interior environment providing system 1f will be described. Fig. 20 is a flowchart showing an example of the operation of the vehicle in-vehicle environment providing system 1f according to Modification 6. The operation of the vehicle in-vehicle environment providing system 1f shown in Fig. 20 is executed every time the vehicle in-vehicle environment providing device 100f receives a vehicle in-vehicle environment request.
[0251] (Step S1-7) In the vehicle interior environment providing device 100f, the communication unit 101f receives the vehicle interior environment request transmitted by the terminal device 200f of the user Uf.
[0252] (Step S2-7) In the vehicle interior environment providing device 100f, the receiving unit 106f acquires the user identification information included in the vehicle interior environment request received by the communication unit 101f. The receiving unit 106f accepts the acquired user identification information.
[0253] (Step S3-7) In the vehicle interior environment providing device 100f, the receiving unit 106f acquires at least one of audio information and location information output by the sensor unit 102f. The receiving unit 106f acquires one or more pieces of image information output by the imaging unit 104f. The receiving unit 106f accepts vehicle situation specifying information such as the acquired audio information, at least one of location information, and one or more pieces of image information.
[0254] (Step S4-7) In the vehicle interior environment providing device 100f, the processing unit 108f acquires the user identification information accepted by the receiving unit 106f. The processing unit 108f acquires the vehicle identification information accepted by the receiving unit 106f. The processing unit 108f acquires the date and time information at which the user identification information was acquired. The processing unit 108f acquires vehicle information and seat information based on at least one of audio information and location information, and one or more pieces of image information, included in the acquired vehicle identification information. The processing unit 108f inputs the acquired user identification information, date and time information, and vehicle situation identification information including the acquired vehicle information and seat information into the learning model 110f. When the user identification information, date and time information, and vehicle situation identification information are input, the learning model 110f outputs information identifying an interior vehicle environment that matches the preferences of the user Uf. The processing unit 108f acquires the information identifying an interior vehicle environment that matches the preferences of the user Uf, output by the learning model 110f.
[0255] (Step S5-7) In the vehicle in-vehicle environment providing device 100f, the acquiring unit 107f acquires information specifying the performance of the facilities equipped in the vehicle from the facility information stored in the memory unit 150f based on vehicle identification information such as the vehicle number included in the vehicle status identification information received by the receiving unit 106f. Also, the acquiring unit 107f acquires information specifying the environment of the seats equipped in the vehicle from the seat information stored in the memory unit 150f based on the vehicle identification information.
[0256] (Step S6-7) In the vehicle in-vehicle environment providing device 100f, the control unit 111f acquires information specifying an in-vehicle environment that matches the preferences of the user Uf, which is acquired by the processing unit 108f. The control unit 111f acquires information specifying the performance of the facilities equipped in the vehicle and information specifying the environment of the seats equipped in the vehicle, which are acquired by the acquisition unit 107f. The control unit 111f controls the in-vehicle environment of the vehicle in which the user Uf is riding, based on the acquired information specifying an in-vehicle environment that matches the preferences of the user Uf, the information specifying the performance of the facilities equipped in the vehicle, and the information specifying the environment of the seats equipped in the vehicle. This completes the operation of the vehicle interior environment providing system 1f.
[0257] In the sixth modification, an example has been described in which the control unit 111f uses both information specifying the performance of the facilities of the vehicle and information specifying the environment of the seats of the vehicle to control the in-vehicle environment, but this is not limiting. The control unit 111f may use at least one of information specifying the performance of the facilities of the vehicle and information specifying the environment of the seats of the vehicle to control the in-vehicle environment. In other words, the control unit 111f may control the in-vehicle environment of the vehicle in which the user Uf is riding, based on the acquired information specifying the in-vehicle environment that matches the preferences of the user Uf, and at least one of information specifying the performance of the facilities of the vehicle and information specifying the environment of the seats of the vehicle.
[0258] Furthermore, in Modification 6, as described above, the control of the vehicle in-vehicle environment providing device 100f is similar to the control of the living environment providing device 100a according to Modification 1, except that the space to be controlled for the environment is a vehicle and not a building. Note that the control of the vehicle in-vehicle environment providing device 100f may be similar to the control of the living environment providing device 100 according to the embodiment, except that the space to be controlled for the environment is a vehicle and not a building. In this case, the control unit 111f controls the in-vehicle environment of the vehicle in which the user Uf is riding, based on the acquired information specifying the in-vehicle environment that matches the preferences of the user Uf. In this case, the acquisition unit 107f may be omitted from the configuration of the vehicle in-vehicle environment providing device 100f.
[0259] In addition, in the sixth modification, an example has been described in which the information specifying the performance of the facilities provided in the vehicle and the information specifying the environment of the seats provided in the vehicle are each the second spatial situation specifying information, but this is not limiting. At least one of the information specifying the performance of the facilities provided in the vehicle and the information specifying the environment of the seats provided in the vehicle may be used as the first spatial situation specifying information.
[0260] According to the environment providing system according to the sixth modification of the embodiment (in-vehicle environment providing system 1f in the sixth modification), the space is a vehicle. By configuring in this manner, when the space is a vehicle, the environment providing system can grasp the environment that suits the user's preferences, and can control the environment inside the vehicle based on the environment that suits the user's preferences.
[0261] As described above, the environment providing system according to each embodiment (in this embodiment, the living environment providing system 1, 1a, 1b, 1c, 1d, 1e, or the vehicle environment providing system 1f) includes a reception unit 106, 106b, 106f, a processing unit 108, 108b, 108f, and a control unit 111, 111f, 111a. The receiving units 106, 106b, and 106f receive user identification information that identifies a user and space situation identification information (in each embodiment, building situation identification information or vehicle situation identification information) that identifies the situation of the space (in each embodiment, building or vehicle). The processing units 108, 108b, and 108f grasp an environment (a living environment or a vehicle environment in each embodiment) that matches the user's preferences based on the user specifying information and spatial situation specifying information received by the receiving units 106, 106b, and 106f. The control units 111, 111f, and 111a control the environment of the space based on the environment that matches the user's preferences ascertained by the processing units 108, 108b, and 108f. The processing units 108, 108b, 108f learn, based on machine learning, the relationship between one or more pieces of spatial situation specifying information and an environment that suits the preferences of the user corresponding to each of the one or more pieces of spatial situation specifying information, for each or each combination of one or more pieces of user specifying information, and use the results of the machine learning to determine an environment that suits the preferences of the user for the user specifying information and spatial situation specifying information received by the receiving unit.
[0262] By configuring in this manner, the environment providing system according to each embodiment (in the present embodiment, the living environment providing system 1, 1a, 1b, 1c, 1d, 1e, or the in-vehicle environment providing system 1f) can create the learning model 110 by machine learning the relationship between one or more pieces of spatial situation specifying information and an environment that suits the preferences of the user corresponding to each of the one or more pieces of spatial situation specifying information, for each or each combination of one or more pieces of user specifying information. Therefore, the environment providing system 1 can use the created learning model 110 to grasp an environment that suits the preferences of the user U based on the user specifying information and the spatial situation specifying information, and can control the spatial environment based on the environment that suits the preferences of the user U.
[0263] The above describes the embodiments and their modifications. However, these embodiments and their modifications are presented as examples and are not intended to limit the scope of the invention. These embodiments and their modifications can be implemented in various other forms, and various omissions, substitutions, modifications, and combinations can be made without departing from the spirit of the invention. These embodiments and their modifications are within the scope and spirit of the invention, as well as the scope of the invention and its equivalents as set forth in the claims. For example, the embodiment, the first modification of the embodiment, the second modification of the embodiment, the third modification of the embodiment, the fourth modification of the embodiment, and the fifth modification of the embodiment may be combined.
[0264] As mentioned above, the above-mentioned living environment providing devices 100 to 100e and the vehicle interior environment providing device 100f are realized by including a computer. In this case, a program for realizing the functions of each functional block is recorded on a computer-readable recording medium. The program recorded on this recording medium may be read into a computer system and executed by a CPU to realize the functions. The "computer system" here includes hardware such as an OS (Operating System) and peripheral devices. Furthermore, "computer-readable recording media" refers to portable media such as flexible disks, optical magnetic disks, ROMs, CD-ROMs, etc. "Computer-readable recording media" also includes storage devices such as hard disks built into computer systems.
[0265] Furthermore, the term "computer-readable recording medium" may include a medium that dynamically stores a program for a short period of time, such as a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line. Furthermore, the "computer-readable recording medium" may also include something that stores a program for a certain period of time, such as volatile memory within a computer system that is a server or client. The program may be for realizing part of the above-described functions, or may be capable of realizing the above-described functions in combination with a program already stored in the computer system. The program may be implemented using a programmable logic device, such as a field programmable gate array (FPGA).
[0266] The above-described living environment providing devices 100 to 100e and vehicle interior environment providing device 100f each have a built-in computer. The processes of the above-described living environment providing devices 100 to 100e and vehicle interior environment providing device 100f are stored in a computer-readable recording medium in the form of a program, and the above processes are performed by the computer reading and executing the program. Here, the computer-readable recording medium refers to a magnetic disk, a magneto-optical disk, a CD-ROM, a DVD-ROM, a semiconductor memory, etc. The computer program may also be distributed to a computer via a communication line, and the computer receiving the program may execute the program. The program may also be a program for implementing some of the functions described above, or may be a so-called differential file (differential program) that can implement the functions described above in combination with a program already stored in the computer system. [Explanation of symbols]
[0267] 1, 1a, 1b, 1c, 1d, 1e Living environment provision system 1F In-store environment provision system 10. Housing 2. Entrance 3 Entrance hall 4. Living space (first living space) 5. Entrance space 6 Locking and unlocking system 11 Common corridor (exterior) 21 Entrance door 22 Entrance door lock 31 stile 41 Wall 42 Interior door (first interior door) 43 Interior door lock (first interior door lock) 51 Entrance storage (storage room) 52 Door 53 Storage Lock 54 Camera 62 Operation section 100, 100a, 100b, 100c, 100d, 100e Living environment providing device 100f Vehicle environment providing device 101, 101f Communication Department 102, 102b, 102f sensor section 104, 104f imaging unit 106, 106b, 106f Reception 107a, 107f acquisition part 108, 108b, 108f processing section 110, 110b-1, 110b-2, 110f Learning Model 111, 111a, 111f control unit 112b, 112c, 112d, 112e supply department 115c, 115d, 115e Instruction section 150, 150a, 150b, 150c, 150d, 150e, 150f storage section 114c, 114d, 114e Judgment section 116c, 116d, 116e Moving part 118d Billing Department 120e Ordering Department Terminal devices 200-1 to 200-n
Claims
1. a receiving unit that receives user identification information that identifies a user, user situation identification information that identifies a situation of the user, and building situation identification information that is information that identifies a situation of a building; a processing unit that identifies a living environment that matches the user's preferences based on the user identification information and the building situation identification information received by the receiving unit, and identifies a requested object that the user is requesting based on the user situation identification information received by the receiving unit; a control unit that controls the living environment of the building based on the living environment that matches the user's preferences ascertained by the processing unit; a determination unit that determines a storage location of the requested object recognized by the processing unit; A moving part and an instruction unit that instructs the moving unit to move the system to the storage location determined by the determination unit; a providing unit that provides the requested object grasped by the processing unit to the user; Equipped with The processing unit For each of a plurality of pieces of user identifying information and each combination thereof, the relationship between one or more pieces of building status identifying information and a living environment that suits the preferences of a user or a plurality of users corresponding to each of the one or more pieces of building status identifying information is learned based on machine learning, and the results of the machine learning are used to grasp a living environment that suits the preferences of the user or a plurality of users based on the user identifying information or a combination of the plurality of pieces of user identifying information received by the receiving unit and the building status identifying information; a relationship between the user situation specifying information and the request target is learned based on machine learning, and the request target is identified for the user situation specifying information received by the receiving unit using a result of the machine learning; Living environment provision system.
2. The living environment providing system according to claim 1 , wherein the control unit controls opening and closing of the window covering device based on the living environment that matches the preference of the user or multiple users that is grasped by the processing unit.
3. The building status identification information is first building status identification information, an acquisition unit that acquires second building status specifying information different from the first building status specifying information; Furthermore, The living environment providing system of claim 1, wherein the control unit controls the living environment based on the second building condition specific information acquired by the acquisition unit and the living environment that suits the preferences of the user or multiple users as understood by the processing unit.
4. The living environment providing system of claim 1, wherein the processing unit updates the relationship between the building condition specification information and a living environment that matches the preferences of the user or multiple users based on the results of the control of the living environment of the building by the control unit.
5. The living environment providing system according to claim 1, wherein the processing unit updates the relationship between the user situation identification information and the request object based on the result of the providing unit providing the user with what the processing unit has grasped.
6. The living environment providing system according to claim 1 , wherein the storage location is an outdoor storage space.
7. a charging unit that charges for the requested object acquired from the storage location or the requested object provided by the providing unit; Furthermore, The living environment providing system of claim 6, wherein the charging unit charges based on the result of the providing unit providing the requested object obtained from the storage location to the user, or the result of the providing unit providing the requested object held by the providing unit to the user.
8. an ordering unit that orders the requested object when the determining unit determines that the requested object is not present in the storage location; The living environment providing system according to claim 1 , further comprising:
9. The living environment providing system according to claim 1 , wherein the providing unit stores the requested object in the storage location determined by the determining unit.
10. The living environment providing system according to claim 1 , wherein the building status specifying information includes at least one of building information and room information.
11. The living environment providing system according to claim 10, wherein the room information includes a building number, a room number, a room name, an area, and a volume.
12. The living environment providing system according to claim 11 , wherein the room names include at least one of a pantry, an entrance hall, a kitchen, a dining room, a living room, a washroom, a bathroom, and a toilet.
13. The living environment providing system according to claim 10 , wherein the room information includes information indicating a purpose of the room or information indicating a location of the room.
14. The living environment providing system of claim 3, wherein the second building status identification information includes at least one of information identifying the performance of the building, information identifying the performance of equipment equipped in the building, information identifying the environment of rooms equipped in the building, and information identifying the location of the building.
15. The building is a first building, The living environment providing system of claim 1, wherein the control unit controls the living environment of a second building different from the first building based on the living environment that matches the user's preferences as determined by the processing unit.
16. A living environment providing method executed by a computer provided in a living environment providing system, comprising: Receiving user identification information that identifies a user, user situation identification information that identifies a situation of the user, and building situation identification information that is information that identifies a situation of a building; Based on the user identification information and the building situation identification information received by the receiving, grasp a living environment that matches the user's preferences, and based on the user situation identification information received by the receiving, grasp a requested object that is requested by the user; Controlling the living environment of the building based on the living environment that matches the preferences of the user ascertained through the ascertainment; determining a storage location of the requested object identified by the identification; Moving the moving part; instructing the moving unit to move the living environment providing system to the storage location determined by the determination; providing the requested object identified by the identification to the user; and By understanding the above, using a result of learning, based on machine learning, a relationship between one or more pieces of building status specifying information and a living environment that suits the preferences of a user or a plurality of users corresponding to each of the one or more pieces of building status specifying information, for each of the plurality of pieces of user specifying information and each combination thereof, to grasp a living environment that suits the preferences of the user or a plurality of users based on the user specifying information or the combination of the plurality of pieces of user specifying information received by the receiving and the building status specifying information; The relationship between the user situation specifying information and the request target is learned based on machine learning, and the result of the machine learning is used to grasp the request target for the user situation specifying information received by the receiving. How to provide a living environment.
17. A computer provided in a living environment providing system, Receiving user identification information that identifies a user, user situation identification information that identifies a situation of the user, and building identification information that is information that identifies a situation of a building; Based on the user identification information received by the receiving, grasp a living environment that matches the user's preferences, and based on the user situation identification information received by the receiving, grasp a requested object that is requested by the user; Controlling the living environment of the building based on the living environment that matches the preferences of the user ascertained through the ascertainment; determining a storage location of the requested object identified by the identification; Moving the moving part; instructing the moving unit to move the living environment providing system to the storage location determined by the determination; providing the requested object identified by the identification to the user; A non-volatile storage medium that stores a program for executing the above. By understanding the above, using a result of learning based on machine learning about the relationship between one or more pieces of building status specifying information and a living environment that suits the preferences of a user or a plurality of users corresponding to each of the one or more pieces of building status specifying information, for each of the plurality of pieces of user specifying information and each combination of the plurality of pieces of building status specifying information, to grasp a living environment that suits the preferences of the user or a plurality of users for the user specifying information or the combination of the plurality of pieces of user specifying information received by the receiving and the building status specifying information; a relationship between the user situation specifying information and the request target is learned based on machine learning, and the result of the machine learning is used to identify the request target for the user situation specifying information received by the receiving process; Non-volatile storage media.
Citation Information
Patent Citations
Method for controlling artificial intelligence home environment system based on big data
CN108829074A
Residential environment navigation system
JP2006300428A
Vehicle allocation information provision system and vehicle allocation reservation server
JP2007207077A
Environment determination system, environment determination program and apparatus selection device
JP2014240733A
In-vehicle environment setting system, in-vehicle environment setting method and in-vehicle environment setting program
JP2019182096A