Indoor space providing system and method

Abstract

Recommend an indoor space that is appropriate for the user's mental and physical state. [Solution] The system includes an indoor space monitoring unit that monitors the state of the indoor space, an indoor space state analysis unit that analyzes the state of the indoor space and obtains indoor space state information as the analysis result, a user monitoring unit that monitors the mental / physical state of a user in the indoor space, a user state analysis unit that analyzes the user's mental / physical state and obtains user state information as the analysis result, and a recommended tag creation unit that creates recommended tags related to the indoor space that may influence the user's behavior based on the indoor space state information and the user state information.

Description

[Technical Field]

[0001] The present invention is suitable for application to an indoor space providing system and an indoor space providing method relating to a technology for providing a comfortable indoor space for a user. [Background technology]

[0002] A technique for recommending activities based on a user's mental health is disclosed in Patent Document 1. The technique disclosed in Patent Document 1 grasps the user's emotional state based on facial expressions acquired through facial expression recognition, and recommends activities to the user along with content in order to improve the user's emotional state. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] U.S. Patent Application Publication No. 2023 / 0317246 Summary of the Invention [Problem to be solved by the invention]

[0004] However, while the technology described in Patent Document 1 improves the user's emotional state by recommending activities along with content to the user, it is unable to recommend an indoor space that is suitable for the user's mental / physical state.

[0005] The present invention has been made in consideration of the above points, and aims to propose an indoor space providing system and an indoor space providing method that can recommend an indoor space suitable for the user's mental / physical state. [Means for solving the problem]

[0006] In order to solve such problems, the present invention comprises an indoor space monitoring unit that monitors the state of the indoor space, an indoor space state analysis unit that analyzes the state of the indoor space and obtains indoor space state information as the analysis result, a user monitoring unit that monitors the mental / physical state of a user in the indoor space, a user state analysis unit that analyzes the mental / physical state of the user and obtains user state information as the analysis result, and a recommended tag creation unit that creates recommended tags related to the indoor space that may influence the behavior of the user based on the indoor space state information and the user state information.

[0007] Furthermore, the present invention includes an indoor space monitoring step in which an indoor space monitoring unit monitors the state of the indoor space; an indoor space state analysis step in which an indoor space state analysis unit analyzes the state of the indoor space and obtains indoor space state information as an analysis result; a user monitoring step in which a user monitoring unit monitors the mental / physical state of a user in the indoor space; a user state analysis step in which a user state analysis unit analyzes the mental / physical state of the user and obtains user state information as an analysis result; and a recommended tag creation step in which a recommended tag creation unit creates recommended tags related to the indoor space that may influence the behavior of the user based on the indoor space state information and the user state information. [Effects of the Invention]

[0008] According to the present invention, it is possible to recommend an indoor space that is suitable for the mental / physical state of the user. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a system configuration diagram showing an example of the configuration of a smart building system as an example of an indoor space providing system according to a first embodiment. FIG. [Figure 2] 10 is a flowchart showing an example of the procedure of an indoor space providing process as an indoor space providing method in a smart building system. [Figure 3]FIG. 10 is a diagram illustrating an example of input and output on the user analysis side in a smart building system. [Figure 4] FIG. 10 is a diagram illustrating an example of input and output on the user analysis side in a smart building system. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings. (1) First embodiment FIG. 1 is a system configuration diagram showing an example of the configuration of a smart building system 1000 as an example of an indoor space providing system according to the first embodiment. The smart building system 1000 is a system installed in a so-called smart building. The smart building is, for example, highly systematized and has at least one office in which an indoor space is formed. In this embodiment, the smart building has, for example, multiple offices.

[0011] The smart building system 1000 has, as its functional configuration, for example, a review summary module 301, a spatial information summary module 111, a security camera 201, an image interpretation module 302, a dynamic database 102, an information collection robot 211, a language processing module 303, a body language interpretation module 304, and a user state information summary module 112.

[0012] The smart building system 1000 uses, as data, for example, a user review 221, an indoor space state description 222, and current indoor space state information 232. The user review 221 is a review written by a user regarding the indoor space of an office.

[0013] The user review 221 is input by a user using a user review input device (not shown). The indoor space state description 222 is a description of the state of the indoor space of the office. The current indoor space state information 232 is information about the indoor space of the office at the current time.

[0014] The smart building system 1000 includes an indoor space monitoring unit that monitors the status of each indoor space in each office, and is equipped with, for example, a user review input device, a security camera 201, and an information collection robot 211. Instead of the indoor space monitoring unit, for example, an indoor sensor (not shown) installed somewhere in the indoor space, or an automatic vacuum cleaner (not shown) that autonomously travels across the floor of the indoor space, detects dirt on the floor with a sensor, and automatically cleans the indoor space.

[0015] The user review input device is an input device for inputting user reviews. The security camera 201 is a camera for visually capturing images of people and conditions in the surrounding area, including the user.

[0016] The information gathering robot 211 has the function of collecting surrounding sounds and recognizing sounds from the collected sound data. Furthermore, the information gathering robot 211 is an interactive robot that uses artificial intelligence to interpret the content of the recognized sounds and output a response to the content of the sounds in the corridor.

[0017] The smart building system 1000 includes an indoor space state analysis unit on the spatial analysis side that analyzes the state of the indoor space and obtains indoor space state information as the analysis result. The indoor space state information includes an indoor space state description 222 and current indoor space state information 232. The indoor space state analysis unit includes a review summarization module 301 and an image interpretation module 302.

[0018] The review summarization module 301 summarizes a user review 221 about the indoor space of, for example, an office A among a plurality of offices, and acquires an indoor space state description 222 as indoor space state information. The user review 221 about the indoor space of the office A is a user review written by a user who used the office A and input using a user review input device.

[0019] The image interpretation module 302 obtains the current indoor space state information 232 as the indoor space state information relating to the indoor space monitored by the indoor space monitoring unit.

[0020] The smart building system 1000 includes a user state analysis unit on the user analysis side. The user state analysis unit analyzes the mental / physical state of the user and obtains user state information as the analysis result. The user state information includes user verbal state information 241 and user non-verbal state information 213. The user state analysis unit includes a language processing module 303 and a body language interpretation module 304.

[0021] The language processing module 303 performs language processing of the conversation uttered by the user, and creates user dictation state information 241, which is information about the state of the user according to the contents of the user's dictation.

[0022] The body language interpretation module 304 interprets the user's body language and creates user non-verbal state information 213, which is information about the user's state according to the user's non-verbal content. Here, body language refers to non-verbal content (referred to as "non-verbal") such as the user's gestures and behavior, which express the user's will, emotions, and mood that can be recognized from the user's body and behavior.

[0023] The above-mentioned user state analysis unit includes a user state information summarization module 112. The user state information summarization module 112 creates a user state description 103 relating to the user's mental / physical state based on the user's verbal state information 241 and the user's non-verbal state information 213.

[0024] The smart building system 1000 includes a recommendation module 101 as an example of a recommendation unit. The recommendation module 101 considers the description content of the user state description 103, and when a specific recommended tag created by the spatial information summarization module 111 as a recommended tag creation unit matches a previous recommended tag created in the past, the recommendation module 101 provides the specific recommended tag to the user. For example, the recommendation module 101 provides the user with the specific recommended tag attached to the recommendation result 400.

[0025] The language processing module 303 and the body language interpretation module 304, which are examples of a user state analysis unit, estimate the mental / physical state of the user based on the results of processing the content of the user's conversation as a result of monitoring by the user state monitoring unit using natural language processing. Note that the user state analysis unit may use artificial intelligence instead of natural language processing.

[0026] The configuration of the smart building system 1000 according to this embodiment has been described above. Next, a method for providing an indoor space in the smart building system 1000 will be described.

[0027] 2 is a flowchart showing an example of an outline of the procedure of an indoor space providing process as an indoor space providing method in the smart building system 1000. Note that the following steps S101 and S102 may be executed before or simultaneously with steps S103 and S104.

[0028] <Indoor space monitoring steps> First, in step S101, the user review input device, security camera 201, and information gathering robot 211, which are examples of an indoor space monitoring unit, monitor the state of the indoor space.

[0029] <Indoor space condition analysis step> In step S102, the review summary module 301 and the image interpretation module 302, which are examples of an indoor space state analysis unit, analyze the state of the indoor space and obtain the indoor space state description 222 and the current indoor space state information 232 as examples of indoor space state information as the analysis results.

[0030] In step S103, the security camera 201 and the information gathering robot 211, which are examples of a user monitoring unit, monitor the mental and physical state of the user in the indoor space by capturing, for example, conversations, gestures, facial expressions, and behavior, and then performing recognition processing to monitor the user's state.

[0031] In step S104, the language processing module 303 and the body language interpretation module 304, which are examples of a user state analysis unit, analyze the user's mental / physical state and obtain user verbal state information 241 and user non-verbal state information 213 as examples of user state information as the analysis results.

[0032] <Recommended tag creation steps> In step S105, the spatial information summary module 111, which is an example of a recommended tag creation unit, creates recommended tags for the indoor space that may influence the user's behavior based on the indoor space state description 222, which is an example of indoor space state information, the current indoor space state information 232, and the user spoken state information 241 and the user non-spoken state information 213, which are examples of user state information.

[0033] Here, we will explain the processing on the spatial analysis side of the smart building system 1000. On the spatial analysis side, first, a user inputs a user review 221, which is a description of, for example, the office A that the user used, into a user review input device. The review summarization module 301 summarizes the user review 221 and creates an indoor space state description 222.

[0034] Meanwhile, the security camera 201 captures images of the user, capturing images of the user's facial expressions and gestures. The image interpretation module 302 recognizes and interprets the images, and creates current indoor space state information 232 that indicates the state of the office at the time of capturing the image by the security camera 201.

[0035] The space information summarization module 111 creates a recommendation tag recommending the use of the office based on the indoor space state description 222 and the current indoor space state information 232 according to the state of the office, and stores the recommendation tag in the dynamic database 102 .

[0036] The recommended tags include descriptions that may have a mental / physical impact on the user and are tags related to the interior space of the office. For example, for Office A, recommended tags could be "#relaxing," "#good for healing spirit," or "#a nice rest place," which describe the comfort of Office A. These recommended tags are added to content that recommends the use of the office to the user. An example of such content could be a commercial promoting the use of the office on an internal social networking site of the company to which the user belongs or on an external social network.

[0037] 3 and 4 are diagrams showing examples of inputs and outputs on the user analysis side in the smart building system 1000. Fig. 3 shows an example of basic inputs and outputs, and Fig. 4 shows an example of extended inputs and outputs.

[0038] First, in an example of basic input and output shown in Fig. 3, a user U named "Michael" is photographed by a security camera 201. The security camera 201 photographs the user's body language (e.g., gestures). Note that the security camera 201 may photograph the user's facial expressions instead of the user's body language.

[0039] The body language interpretation module 304 interprets the body language detected by the photograph as, for example, "slow walking steps" or "depressed facial expression" and creates user non-verbal state information 213 relating to the user's mental / physical state.

[0040] On the other hand, the information collecting robot 211 speaks to the user and converses with the user. Examples of such conversations include the following:

[0041] Information Gathering Robot 211: "Hey Michael, how are you?" Michael: "I'm a little tired. I had a long day yesterday. Meetings, lots of reports, lots of things to do. I'm not sure how I'll feel today... I'm exhausted."

[0042] The information collecting robot 211 collects the conversation of the user "Michael" ("I'm a little tired. Yesterday was a long day. I have a lot to do, like meetings and writing lots of reports. I wonder how it will be today... I'm exhausted."). The information collecting robot 211 passes the conversation data, which is the result of speech recognition of the conversation, to the language processing module 303. The language processing module 303 generates user spoken state information 241 relating to the user's mental / physical state based on the conversation data.

[0043] The user state information summarizing module 112 analyzes the user's physical state as, for example, "fatigue" based on the user's verbal state information 241 and the user's non-verbal state information 213. On the other hand, the user state information summarizing module 112 analyzes the user's mental state as, for example, "low motivation" or "oppressed."

[0044] The user state information summary module 112 generates a user state description 103 that summarizes the user's mental / physical state from the analysis results. In this embodiment, the user state description 103 corresponds to the input of the recommendation module 101, and includes, for example, input contents such as "Michael is tired, has low motivation, and feels depressed," and "What kind of office can be provided based on his condition?"

[0045] The recommendation module 101 generates a recommendation result 400 such as "Office A: A nice view that can soothe anger and anxiety..., Office B:..." based on the user state description 103, which is the input content described above.

[0046] The recommendation module 101 generates the following recommendation result 400: Information Gathering Robot 211: "Well, things will calm down after January. By the way, I have a nice office available." Information Gathering Robot 211: "How about Office A, B, or C?"

[0047] Based on the content of these conversations, specific recommendation tags including descriptions that will make the user want to use one of the offices are attached to the recommendation result 400. Examples of specific recommendation tags include "#Offices A, B, C," "#Good for mental health care," and "#Offices good for changing your mood."

[0048] On the other hand, in the example of extended input / output shown in Fig. 4, a user U named "Michael" is photographed by a security camera 201. The security camera 201 photographs the user's body language (e.g., gestures). Note that the security camera 201 may photograph the user's facial expressions instead of the user's body language.

[0049] The body language interpretation module 304 interprets the body language detected by the photograph as, for example, "slow walking steps" or "depressed facial expression" and creates user non-verbal state information 213 relating to the user's mental / physical state.

[0050] On the other hand, the information collecting robot 211 speaks to the user and converses with the user. Examples of such conversations include the following:

[0051] Information Gathering Robot 211: "Hey Michael, how are you?" Michael: "I'm a little tired. I had a long day yesterday. Meetings, lots of reports, lots of things to do. I'm not sure how I'll feel today... I'm exhausted." Information Gathering Robot 211: "Well, why don't you go out and relax for a bit?"

[0052] The information collecting robot 211 collects the conversation of the user "Michael" ("I'm a little tired. Yesterday was a long day. I have a lot to do, like meetings and writing lots of reports. I wonder how it will be today... I'm exhausted."). The information collecting robot 211 passes the conversation data, which is the result of speech recognition of the conversation, to the language processing module 303. The language processing module 303 generates user spoken state information 241 relating to the user's mental / physical state based on the conversation data.

[0053] The user state information summarizing module 112 analyzes the user's physical state as, for example, "fatigue" based on the user's verbal state information 241 and the user's non-verbal state information 213. On the other hand, the user state information summarizing module 112 analyzes the user's mental state as, for example, "low motivation" or "oppressed."

[0054] The user state information summary module 112 generates a user state description 103 that summarizes the user's mental / physical state from the analysis results. In this embodiment, the user state description 103 corresponds to the input of the recommendation module 101, and includes, for example, input contents such as "Michael is tired, has low motivation, and feels depressed," and "What kind of office can be provided based on his condition?"

[0055] Based on the user state description 103, which is the input content described above, the recommendation module 101 analyzes that the user's mental / physical state is bad, for example, if the input content is "Warning: Michael is in a very bad state!", the recommendation module 101 determines that the user's mental / physical state is bad, and based on the analysis result, generates a recommendation result 400 with a specific recommendation tag added, which is a recommendation content that can resolve the bad state, for example, "Well, why don't you go outside and relax for a while?"

[0056] In the recommendation result 400, in addition to the above-mentioned description, specific recommended tags may include, for example, "#If you go out and relax, Office A will be clean and comfortable."

[0057] The smart building system 1000 according to this embodiment includes an input device (such as a security camera 201 or an information gathering robot 211) as an example of an indoor space monitoring unit that monitors the state of the indoor space, a review summarization module 301 and an image interpretation module 302 as examples of an indoor space state analysis unit that analyzes the state of the indoor space and acquires an indoor space state description 222 as an example of indoor space state information as an analysis result, and current indoor space state information 232, the security camera 201 and the information gathering robot 211 as examples of a user monitoring unit that monitors the mental / physical state of a user in the indoor space, and a user's mental state. / The system is equipped with a language processing module 303 and a body language interpretation module 304 as an example of a user state analysis unit that analyzes the physical state and obtains user spoken state information 241 and user non-spoken state information 213 as an example of user state information as the analysis results, and a spatial information summarization module 111 as an example of a recommended tag creation unit that creates specific recommended tags related to indoor spaces that may influence the user's behavior based on an indoor space state description 222 as an example of indoor space state information, current indoor space state information 232, and user spoken state information 241 and user non-spoken state information 213 as an example of user state information.

[0058] The indoor space providing method of the smart building system 1000 according to this embodiment includes an indoor space monitoring step in which an indoor space monitoring unit monitors the state of the indoor space; an indoor space state analysis step in which an indoor space state analysis unit analyzes the state of the indoor space and obtains indoor space state information as the analysis result; a user monitoring step in which a user monitoring unit monitors the mental / physical state of a user in the indoor space; a user state analysis step in which a user state analysis unit analyzes the mental / physical state of the user and obtains user state information as the analysis result; and a recommended tag creation step in which a recommended tag creation unit creates specific recommended tags related to the indoor space that may influence the user's behavior based on the indoor space state information and the user state information.

[0059] With this configuration, when a user comes across the specific recommended tag, the system can recommend an indoor space that is suitable for the user's mental / physical state, which can change the user's mood due to the mental / physical effects of the description of the specific recommended tag.

[0060] In this embodiment, the indoor space state analysis unit includes a review summarization module 301 that summarizes user reviews about indoor spaces, which are descriptions written by users, to acquire indoor space state descriptions as indoor space state information, an image interpretation module 302 that acquires current indoor space state information 232 as indoor space state information about the indoor space monitored by the indoor space monitoring unit, and a space information summarization module 111 that creates the above-mentioned specific recommended tags about the indoor space based on the indoor space state description 222 and the current indoor space state information 232. In this way, it is possible to recommend an indoor space suitable for the user's mental / physical state to a user who comes across the specific recommended tag created based on the indoor space state description 222 and the current indoor space state information 232.

[0061] In this embodiment, the user state analysis unit includes a language processing module 303 that performs language processing on the conversation uttered by the user to create user spoken state information 241, which is information on the user's state according to the content spoken by the user, and a body language interpretation module 304 that interprets the user's body language to create user non-spoken state information 213, which is information on the user's state according to the content non-spoken by the user. In this way, it is possible to recommend an indoor space suitable for the mental / physical state of a user who has come into contact with a specific recommended tag created based on the created user spoken state information 241 and the user non-spoken state information 213.

[0062] In this embodiment, the user state analysis unit includes a user state information summarization module 112 that creates a user state description 103 related to the user's mental / physical state based on the user's verbal state information 241 and the user's non-verbal state information 213, and the smart building system 1000 includes a recommendation module 101 that takes the user state description 103 into consideration and provides the user with a specific recommended tag when a specific recommended tag created by a spatial information summarization module 111 that is an example of a recommended tag creation unit matches a previous recommended tag created in the past. In this way, an indoor space suitable for the user's mental / physical state can be recommended to a user who has come across a more effective specific recommended tag.

[0063] In this embodiment, the language processing module 303 and the body language interpretation module 304, which are examples of a user state analysis unit, estimate the user's mental / physical state based on the results of processing the content of the user's conversation as a result of monitoring by the user state monitoring unit using natural language processing. Note that the user state analysis unit may use artificial intelligence instead of natural language processing. In this way, for a user who has come across a specific recommended tag that is more effective from the content of the user's conversation, it is possible to recommend an indoor space that is suitable for that user's mental / physical state.

[0064] The present invention is not limited to the above-described embodiments, and includes various modifications and equivalent configurations within the spirit and scope of the appended claims. For example, the above-described embodiments have been described in detail to clearly explain the present invention, and the present invention is not necessarily limited to those including all of the described configurations. Furthermore, the elements described in parallel in the present embodiment may be configured such that at least one of the elements is connected in series to the other elements. [Industrial Applicability]

[0065] The present invention can be applied to, for example, an indoor space providing system related to a technology for providing a comfortable indoor space for a user. [Explanation of symbols]

[0066] 101...Recommendation module, 102...Dynamic database, 111...Spatial information summarization module, 112...User state information summarization module, 301...Review summarization module, 302...Image interpretation module, 303...Language processing module, 304...Body language interpretation module, 1000...Smart building system

Claims

1. an indoor space monitoring unit that monitors the state of the indoor space; an indoor space state analysis unit that analyzes the state of the indoor space and acquires indoor space state information as an analysis result; a user monitoring unit that monitors the mental / physical state of a user in the indoor space; a user state analysis unit that analyzes the mental / physical state of the user and acquires user state information as an analysis result; a recommended tag creation unit that creates a specific recommended tag related to the indoor space that may affect the behavior of the user based on the indoor space state information and the user state information; An indoor space providing system comprising:

2. The indoor space state analysis unit a review summarization module that summarizes the reviews about the indoor space written by the user to obtain an indoor space state description as the indoor space state information; an image interpretation module that acquires current indoor space state information as the indoor space state information regarding the indoor space monitored by the indoor space monitoring unit; a spatial information summarization module that generates the specific recommended tag for the indoor space based on the indoor space state description and the current indoor space state information; The indoor space providing system according to claim 1, further comprising:

3. The user state analysis unit a language processing module that performs language processing of the conversation uttered by the user and creates user dictation state information that is information about the state of the user according to the content of the dictation by the user; a body language interpretation module that interprets the body language of the user and creates user non-verbal state information, which is information about the state of the user according to non-verbal content of the user; The indoor space providing system according to claim 1, further comprising:

4. The user state analysis unit a user state information summarizing module for creating a user state description relating to the mental / physical state of the user based on the user dictated state information and the user non-dictated state information; The indoor space providing system includes: a recommendation unit that considers the user state description and, if a specific recommended tag created by the recommended tag creation unit matches a previous recommended tag created in the past, provides the specific recommended tag to the user; 4. The indoor space providing system according to claim 3.

5. The user state analysis unit The content of the conversation of the user as a result of monitoring by the user state monitoring unit is processed using natural language processing, and the mental / physical state of the user is estimated based on the result. The indoor space providing system according to claim 1 .

6. an indoor space monitoring step in which an indoor space monitoring unit monitors a state of the indoor space; an indoor space state analysis step in which an indoor space state analysis unit analyzes the state of the indoor space and acquires indoor space state information as an analysis result; a user monitoring step in which a user monitoring unit monitors the mental / physical state of a user in the indoor space; a user state analysis step in which a user state analysis unit analyzes the mental / physical state of the user and acquires user state information as an analysis result; a recommended tag creation step in which a recommended tag creation unit creates recommended tags related to indoor spaces that may affect the behavior of the user based on the indoor space state information and the user state information; A method for providing an indoor space, comprising:

7. The indoor space state analysis step includes: a review summarization step in which a review summarization module summarizes the reviews written by the users and related to the indoor space to obtain an indoor space state description as the indoor space state information; an image interpretation step in which an image interpretation module acquires current indoor space state information as the indoor space state information regarding the indoor space monitored by the indoor space monitoring unit; a spatial information summarization step in which a spatial information summarization module generates the specific recommended tag for the indoor space based on the indoor space state description and the current indoor space state information; The method for providing an indoor space according to claim 6, further comprising:

8. The user state analysis step includes: a language processing step in which a language processing module performs language processing on the conversation uttered by the user to create user dictation state information, which is information about the state of the user according to the content of the dictation by the user; a body language interpretation step in which a body language interpretation module interprets the body language of the user and creates user non-verbal state information, which is information about the state of the user according to non-verbal content by the user; The method for providing an indoor space according to claim 6, further comprising:

9. The user state analysis step includes: the user state information summarizing module comprises a user state information summarizing step of creating a user state description relating to the mental / physical state of the user based on the user dictated state information and the user non-dictated state information; a recommendation unit that considers the user state description, and if the specific recommended tag created by the recommended tag creation unit matches a previous recommended tag created in the past, provides the specific recommended tag to the user. The method for providing an indoor space according to claim 8 .

10. In the user state analysis step, The user state analysis unit estimates the mental / physical state of the user based on a result of processing the content of the user's conversation as a result of monitoring by the user state monitoring unit using natural language processing. The method for providing an indoor space according to claim 6 .

Images