Intelligence provision methods
The method effectively utilizes sensor data to determine family time by detecting user behavior and sound volume, enabling tailored service provision through a first and second information processing device.
Patent Information
- Application Number
- JP2024117551
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2018-10-02
- Filing Date
- 2024-07-23
- Publication Date
- 2025-10-30
- Estimated Expiration
- 2039-10-02
AI Technical Summary
Conventional technologies lack effective methods to utilize sensor data for providing services, making it difficult to leverage the potential of collected sensor data effectively.
An information providing method using a first information processing device with sensors in different spaces of a house to detect user behavior and sound volume, generating information indicating family time when specific conditions are met, and outputting this information to a second information processing device for service provision.
Enables effective utilization of sensor data for providing services tailored to user situations, such as family time, by accurately determining social gatherings and generating appropriate service information.
Smart Images

Figure 0007762768000001 
Figure 0007762768000002 
Figure 0007762768000003
Abstract
Description
[Technical Field]
[0001] Regarding information provision methods. [Background technology]
[0002] In recent years, it has become possible to collect huge amounts of sensor data from sensors placed in various locations, and there is a demand for effective use of the collected sensor data. For example, by using sensor data from various sensors placed in indoor spaces such as homes, it becomes possible to provide services that are suited to the user's situation. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Application Publication No. 2018-32272 Summary of the Invention [Problem to be solved by the invention]
[0004] However, with conventional technologies, there is little information on how to use sensor data, making it difficult to effectively utilize sensor data for providing services.
[0005] The present disclosure provides an information providing method and the like that can effectively utilize sensor data for providing services. [Means for solving the problem]
[0006] An information providing method according to one aspect of the present disclosure is an information providing method using a first information processing device including a processor and a memory, wherein a first sensor is disposed in a first space of a house, and a second sensor is disposed in a second space of the house, and the processor acquires, by the first sensor, appliance operation status information associated with a predetermined behavior of a user in the first space, and, by the second sensor, acquires information on the volume of a sound in the second space, ( i) A threshold time or more has elapsed since the start time of the predetermined action of the user. In cases where (ii) when the volume of the sound in the second space is equal to or greater than the first threshold volume; for The first information indicating that it is family time at the house is generated, and the first information is output.
[0007] These comprehensive or specific aspects may be realized as a system, a device, an integrated circuit, a computer program, or a computer-readable recording medium such as a CD-ROM, or may be realized as any combination of a system, a method, an integrated circuit, a computer program, and a recording medium. [Effects of the Invention]
[0008] The information providing method according to one aspect of the present invention can effectively utilize sensor data for providing services. [Brief explanation of the drawings]
[0009] [Figure 1] FIG. 1 shows an overview of a service providing system according to the first embodiment. [Figure 2] FIG. 2 shows the configuration of the service providing system according to the first embodiment. [Figure 3] FIG. 3 shows functional configurations of the first information processing device and the second information processing device according to the first embodiment. [Figure 4] FIG. 4 is a sequence diagram of the service providing system according to the first embodiment. [Figure 5] FIG. 5 is a flowchart showing the processing of the first information processing device according to the first embodiment. [Figure 6] FIG. 6 is a flowchart showing an example of the determination process for the first condition according to the first embodiment. [Figure 7] FIG. 7 shows an example of sensing information related to the operation of the electronic device according to the first embodiment. [Figure 8] FIG. 8 shows an example of sensing information related to the opening of the refrigerator door in the first embodiment. [Figure 9] FIG. 9 shows an example of sensing information relating to the presence of a person according to the first embodiment. [Figure 10] FIG. 10 is a sequence diagram of the service providing system according to the first modification. [Figure 11] FIG. 11 is a sequence diagram of a service providing system according to the second modification. [Figure 12] FIG. 12 is a flowchart showing an example of a process for generating second information in the third modification. [Figure 13A] FIG. 13A shows an example of the relationship between services and the five senses in Modification 3. [Figure 13B] FIG. 13B shows an example of the relationship between devices and the five senses in Modification 3. [Figure 14] FIG. 14 is a flowchart showing an example of a process for generating second information in the fourth modification. [Figure 15] FIG. 15 shows an example of a service provision history in the fourth modification. [Figure 16A] FIG. 16A shows an example of service provision possibility information in the fourth modification. [Figure 16B] FIG. 16B shows an example of the simultaneous service provision prohibition information in the fourth modification. [Figure 16C] FIG. 16C shows an example of service change prohibition information in the fourth modification example. [Figure 17] FIG. 17 is a flowchart showing an example of output processing of the second information in the fifth modification. [Figure 18A] FIG. 18A shows an overview of the service providing system. [Figure 18B] FIG. 18B shows an example of a data center operating company. [Figure 18C] FIG. 18C shows an example of a data center operating company. [Figure 19] FIG. 19 shows service type 1 (own data center type). [Figure 20] Figure 20 shows service type 2 (IaaS usage type). [Figure 21]Figure 21 shows service type 3 (PaaS usage type). [Figure 22] FIG. 22 shows service type 4 (SaaS usage type). DETAILED DESCRIPTION OF THE INVENTION
[0010] Hereinafter, the embodiments will be specifically described with reference to the drawings.
[0011] The embodiments described below are all comprehensive or specific examples, and the numerical values, shapes, materials, components, the arrangement and connection of the components, steps, and the order of steps shown in the following embodiments are merely examples and are not intended to limit the scope of the claims.
[0012] In addition, the drawings are not necessarily strict illustrations, and the same reference numerals are used to designate substantially the same components in the drawings, and redundant explanations are omitted or simplified.
[0013] (Embodiment 1) [Overview of Service Provision System 10] First, an overview of the service providing system 10 will be described with reference to Fig. 1. Fig. 1 shows an overview of the service providing system 10 according to the first embodiment.
[0014] In the service providing system 10 according to the present embodiment, sensor data from a plurality of indoor spaces is collected in a cloud server. The indoor spaces include, for example, homes, office spaces, buildings, and spaces inside vehicles. The sensor data is data based on the user's usual behavior and / or unusual activities in the indoor spaces.
[0015] Each of the multiple service providers can obtain various information based on the sensor data collected by the cloud server via an application programming interface (API), which is an information processing function of the cloud server that can be called and used from a computer.
[0016] Each service provider provides a service to the user based on the information acquired via the API. The service may be an information provision service, an advertisement distribution service, an automatic control service for devices on a home network, or any combination thereof. Note that the service is not limited to these, and may be, for example, a product delivery service.
[0017] [Configuration of service provision system 10] Next, the configuration of the service providing system 10 will be described with reference to Fig. 2. Fig. 2 shows the configuration of the service providing system 10 according to the first embodiment. As shown in Fig. 2, the service providing system 10 according to the present embodiment includes a first information processing device 100, a second information processing device 200, a sensor group 300, and a device group 400.
[0018] The sensor group 300 is arranged in the space 20 and includes at least one sensor. The sensor group 300 is connected to a communication network such as the Internet via a gateway 500. Note that the gateway 500 is optional, and the sensor group 300 may be connected to the communication network without going through the gateway 500.
[0019] The sensor group 300 outputs a sensor value indicating operation information related to the user's operation or information related to the operation / management of the device group 400. For example, the sensor group 300 can output a sensor value indicating whether a lighting device is turned on or not, a sensor value indicating whether an audio device is outputting sound or not, a sensor value indicating whether a user is present in the space 20 or in a predetermined area within the space 20, or any combination thereof.
[0020] The sensor group 300 may include, for example, a motion sensor, an open / close sensor, a sound sensor, or any combination thereof. The sensors of the sensor group 300 may be, for example, an image sensor, an infrared sensor, an ultrasonic sensor, a visible light sensor, a vibration sensor, a touch sensor, a microphone, or any combination thereof. Such sensors may be installed on the walls, floors, or ceilings that form the space 20, or on electronic devices or furniture arranged in the space 20. The sensors may also be built into the devices of the device group 400, such as touch sensors built into the touch screen of a smartphone or the like. Note that the sensors are not limited to the above sensors.
[0021] The device group 400 is arranged in the space 20 and includes at least one electronic device. The device group 400 is connected to a communication network such as the Internet via a gateway 500. Note that the gateway 500 is optional, and the device group 400 may be connected to the communication network without going through the gateway 500.
[0022] The device group 400 may include, for example, a display panel, a lighting device, a sound device, a refrigerator, a vacuum cleaner, or any combination thereof. However, the devices in the device group 400 are not limited to these.
[0023] The first information processing device 100 is a device that is arranged outside the space 20 and has a processor and a memory, and corresponds to, for example, the cloud server in Fig. 1. Note that the first information processing device 100 may be an edge server arranged within the space 20.
[0024] A cloud server is a server provided via the Internet, and an edge server is a server provided via a network (such as a local area network (LAN)) in an area closer to the user than the Internet.
[0025] The second information processing device 200 is a device including a processor and a memory, and is, for example, a device of the service provider in Fig. 1. The second information processing device 200 provides a service to a user via a group of devices 400 in the space 20.
[0026] Here, the service providing system 10 shown in FIG. 2 is assumed to exist in each of a plurality of indoor spaces. Specifically, a first information processing device 100 exists in each of the plurality of indoor spaces, and a plurality of second information processing devices 200 are connected to each of the first information processing devices 100, thereby providing services to the indoor spaces. In this case, the aim is to provide a variety of information about the user or the space 20 from the plurality of first information processing devices 100 and the plurality of second information processing devices 200 independently, and to provide a variety of services using the plurality of second information processing devices 200. Meanwhile, new information exchange occurs between the plurality of first information processing devices 100 and the plurality of second information processing devices 200. In this embodiment, by defining this information exchange, a mechanism is provided that effectively utilizes sensor data and provides appropriate services.
[0027] [Functional configuration of the first information processing device 100] Next, the functional configuration of the first information processing device 100 will be described with reference to Fig. 3. Fig. 3 shows the functional configuration of the first information processing device 100 and the second information processing device 200 according to the first embodiment.
[0028] 3, the first information processing device 100 according to this embodiment includes a sensor data acquisition unit 101, a first memory 103, a determination unit 104, a second memory 105, a first information generation unit 106, a third memory 107, a second information generation unit 108, and an input / output unit 109. Each functional block of the first information processing device 100 will be described below.
[0029] The sensor data acquisition unit 101 acquires first sensor data including first sensor values from the sensor group 300. A part or all of the first sensor data is stored in the first memory 103. The first sensor data may include, for example, data indicating whether or not a person is present in a predetermined area in the space 20. Further, for example, the first sensor data may include data indicating the sound output status of an audio device. Further, the first sensor data may include data indicating the operation status of the device. Further, the first sensor data may include data indicating the opening / closing status of a refrigerator door.
[0030] The first memory 103 stores a part or all of the first sensor data acquired by the sensor data acquisition unit 101.
[0031] The determination unit 104 determines whether or not the first condition is satisfied. Details of the first condition will be described later.
[0032] The second memory 105 stores information for generating the first information. For example, the second memory 105 stores a correspondence table in which the contents of information to be generated correspond to a plurality of different conditions.
[0033] The first information generating unit 106 generates the first information when the first condition is satisfied. In this embodiment, the first information indicates that it is family time at home, but is not limited to this.
[0034] The third memory 107 stores information for generating the second information. That is, the third memory 107 stores information for identifying a user or a space 20 corresponding to the first information generated by the first information generating unit 106.
[0035] The second information generation unit 108 determines whether the first information is included in the first request content included in the information acquired from the second information processing device 200 via the input / output unit 109. If the first request content includes the first information, the second information generation unit 108 generates second information using the first information. The second information includes information for identifying the user or the space 20 (e.g., a user ID, an address, an IP address, device identification information, etc.). For example, the second information generation unit 108 generates the second information by reading, from the third memory 107, information for identifying the user or the space 20 corresponding to the first information generated by the first information generation unit 106. Here, the second information may be information necessary to provide a service to the user or the space 20. If the first request includes the content of the service to be provided, second information corresponding to the content of the service may be provided. For example, an example of the second information when a service is provided using a communication environment is an IP address. Alternatively, an example of the second information when a service for controlling a device is provided is device identification information. When a service for controlling a device is provided using a communication environment, an example of the second information may be a combination of an IP address and device identification information.
[0036] The input / output unit 109 acquires information describing the first request content (hereinafter referred to as first request information) from the second information processing device 200 connected to the first information processing device 100 via a network. Furthermore, the input / output unit 109 outputs the second information generated by the second information generation unit 108 to the second information processing device 200.
[0037] The above-described determination unit 104, first information generation unit 106, and second information generation unit 108 are realized by, for example, a processor and a memory. When instructions or a software program stored in the memory is executed, the processor functions as the determination unit 104, first information generation unit 106, and second information generation unit 108. Alternatively, the determination unit 104, first information generation unit 106, and second information generation unit 108 may be realized by dedicated electronic circuits.
[0038] The above-described first memory 103, second memory 105, and third memory 107 are realized by, for example, a semiconductor memory and / or a disk drive, etc. The input / output unit 109 is realized by, for example, a network interface controller (NIC), etc.
[0039] [Functional configuration of the second information processing device 200] Next, the functional configuration of the second information processing device 200 will be described with reference to FIG.
[0040] 3, the second information processing device 200 according to this embodiment includes a fourth memory 201, a request generation unit 202, an input / output unit 203, a fifth memory 204, a service generation unit 205, and an output unit 206. Each functional block of the second information processing device 200 will be described below.
[0041] The fourth memory 201 stores information for generating the first request information.
[0042] The request generator 202 generates first request information. Specifically, the request generator 202 references the information stored in the fourth memory 201 and generates the first request information in which the first request content is described.
[0043] The first request content indicates a requirement that a user or a space to which a predetermined service is provided must satisfy. In this embodiment, the first request content indicates, but is not limited to, a requirement that the user or space be a time for family time at home.
[0044] The input / output unit 203 outputs the first request information generated by the request generation unit 202 to the first information processing device 100. Furthermore, the input / output unit 203 acquires second information from the first information processing device 100.
[0045] The fifth memory 204 stores information for generating service information, for example, a correspondence table in which service contents are associated with a plurality of different request contents.
[0046] The service generation unit 205 generates first service information using the second information. The first service information is information for providing a service to users in the space 20 via the device group 400.
[0047] In this embodiment, the first service information may be, for example, information for notifying a family member living in another house that family members in the house are having a family time together. Also, for example, the first service information may be information for transmitting conversations and / or videos of the family members having a family time together in the house to a family member living in another house.
[0048] The service information can also be expressed as service content, which includes information about the service, such as music or advertising information, and information about device control for providing the service.
[0049] The output unit 206 refers to the second information and outputs the service information generated by the service generation unit 205 to the device group 400. Note that the second information processing device 200 may have a memory that records a correspondence between information corresponding to the second information and information necessary to provide the service, and may obtain the information necessary to provide the service by referring to the second information, and provide the service to the user or the space 20.
[0050] The request generator 202 and the service generator 205 are realized by, for example, a processor and a memory. When instructions or software programs stored in the memory are executed, the processor functions as the request generator 202 and the service generator 205. Alternatively, the request generator 202 and the service generator 205 may be realized by dedicated electronic circuits.
[0051] The fourth memory 201 and fifth memory 204 are realized by, for example, a semiconductor memory and / or a disk drive, etc. The input / output unit 203 and output unit 206 are realized by, for example, a network interface controller (NIC), etc.
[0052] [Interaction within service provision system 10] Next, interactions within the service providing system 10 will be described with reference to Fig. 4. Fig. 4 is a sequence diagram of the service providing system 10 according to the first embodiment.
[0053] As shown in FIG. 4, the first information processing device 100 acquires first sensor data including a first sensor value from the sensor group 300 (S101). The first information processing device 100 determines whether a first condition is satisfied based on the first sensor data (S102). In other words, the acquisition of the first sensor data can be expressed as trigger information for determining whether the first condition is satisfied. If the first condition is satisfied, the first information processing device 100 generates first information (S103). The first sensor data that served as trigger information for determining whether the first condition is satisfied is used to determine whether the first condition is satisfied. In other words, the first sensor data can be used not only as trigger information but also to determine whether the first condition is satisfied, which corresponds to a condition for providing a service. Furthermore, the first sensor data that previously served as trigger information for determining whether the first condition is satisfied may be used to determine whether the first condition is satisfied.
[0054] Here, when the first information processing device 100 acquires first request information from the second information processing device 200 (S111), the first information processing device 100 determines whether or not there is a user or space that satisfies the first request content (S112). Here, if it is determined that there is a user or space that satisfies the first request content, the first information processing device 100 generates second information (S113). Furthermore, the first information processing device 100 outputs the generated second information to the second information processing device 200 (S114).
[0055] The second information processing device 200 generates first service information based on the second information (S121). The first service information is information for providing a first service to users in the space 20 via the device group 400. Then, the second information processing device 200 outputs the first service information to the device group 400 (S122).
[0056] It should be noted that the sequence diagram shown in Fig. 4 is an example and is not limiting. For example, the order of the processes in Fig. 4 may be changed.
[0057] [Processing of the first information processing device 100] Here, details of the processing of the first information processing device 100 (that is, the information providing method) will be described with reference to Fig. 5. Fig. 5 is a flowchart showing the processing of the first information processing device 100 according to the first embodiment.
[0058] 5, the sensor data acquisition unit 101 acquires first sensor data including a first sensor value from the sensor group 300 arranged in the space 20 (S101). The determination unit 104 determines whether or not a first condition is satisfied based on the first sensor data (S102). Details of this determination process will be described later with reference to the drawings.
[0059] Here, if the first condition is satisfied (Yes in S102), the first information generation unit 106 generates the first information (S103). On the other hand, if the first condition is not satisfied (No in S102), the first information generation unit 106 skips the first information generation process, that is, the first information generation unit 106 does not generate the first information.
[0060] Thereafter, the input / output unit 109 acquires first request information in which the first request content is described from the second information processing device 200 (S111). The second information generation unit 108 determines whether or not there is a user or space that matches the first request content (S112). In other words, the second information generation unit 108 determines whether or not the first request content includes the content of the first information.
[0061] Here, if there is a user or space that matches the first request content (Yes in S112), the second information generation unit 108 generates second information using the generated first information (S113). Then, the input / output unit 203 outputs the generated second information to the second information processing device 200 (S114). On the other hand, if there is no user or space that matches the first request content (No in S112), the second information generation unit 108 skips the generation process and output process of the second information. In other words, the second information generation unit 108 does not generate or output the second information.
[0062] [Determination process for the first condition] In this embodiment, the first condition includes the following (I) and (ii): (I) A threshold time or more has elapsed since the user started cooking, and (ii) the volume of the sound in the dining space is equal to or greater than a threshold volume.
[0063] If the above (I) and (ii) are met, it is presumed that the residents are socializing in the home.
[0064] Here, details of the determination process for the first condition (S102 in FIG. 5) will be described with reference to Fig. 6. Fig. 6 is a flowchart showing an example of the determination process for the first condition in the first embodiment.
[0065] First, the determination unit 104 determines whether or not a threshold time or more has elapsed since the time when the user started cooking (S1021). That is, the determination unit 104 determines whether or not the above condition (I) is satisfied.
[0066] The threshold time is the time for determining that cooking has finished and eating has begun. The threshold time may be a time registered in advance by the user, or may be a time obtained by analyzing past cooking and meal times.
[0067] The time when the user starts cooking is detected by a first sensor placed in the kitchen space. The first sensor may be, for example, a human presence sensor that detects the presence of a person in the kitchen space, an image sensor that takes pictures of the kitchen space, a sensor that detects the operation of an electronic device placed in the kitchen space, an opening / closing sensor that detects the opening / closing of a refrigerator door placed in the kitchen space, or any combination thereof.
[0068] Fig. 7 shows an example of sensing information related to the operation of an electronic device in embodiment 1. In Fig. 7, the horizontal axis represents time, and the vertical axis represents days. Double-headed arrows represent times when the electronic device is operating. Conversely, periods without arrows represent times when the electronic device is not operating.
[0069] The electronic devices are included in the device group 400 and are arranged in the kitchen space. Examples of the electronic devices include lighting devices and cooking devices (for example, an induction heater, a gas stove, a microwave oven, a rice cooker, or a coffee maker).
[0070] For example, the start time of the operating hours (double arrow) is used as the cooking start time. Note that only the start time of the operating hours included in a predetermined time period (for example, 4:00 PM to 7:00 PM) may be used as the cooking start time.
[0071] Fig. 8 shows an example of sensing information related to the opening of the refrigerator door in Embodiment 1. Fig. 8 shows an example of the time when the refrigerator door is opened in a certain day (hereinafter referred to as the opening time).
[0072] The time when the refrigerator door is opened in Fig. 8 can be obtained by, for example, a door open / close sensor or an image sensor that takes an image of the refrigerator, etc. Such an opening time can be used as the time to start cooking.
[0073] FIG. 9 shows an example of sensing information related to the presence of a person in the first embodiment. In FIG. 9, the horizontal axis represents time, and the vertical axis represents days. The double-headed arrows represent the time during which a person was detected by the human presence sensor (hereinafter referred to as detection time). Conversely, periods without arrows represent the time during which a person was not detected by the human presence sensor. The human presence sensor is included in the sensor group 300 and is arranged in the kitchen space.
[0074] Using such a detection time, the time when cooking starts can be determined, similar to the operating time of the electronic device.
[0075] Now, returning to the explanation of the flowchart in Fig. 6, if the threshold time or more has passed since the user started cooking (Yes in S1021), the determination unit 104 determines whether the volume of the sound in the dining space is equal to or greater than the threshold volume (S1022). In other words, the determination unit 104 determines whether the above condition (ii) is satisfied.
[0076] Information about the volume of sound in the dining space is acquired by a second sensor disposed in the dining space. The second sensor may be, for example, a microphone. Information based on the information acquired by the second sensor is also referred to as sound information.
[0077] The volume of the sound in the dining space may be determined by acquiring output information from a device that outputs sound and subtracting the output information from the volume of the sound acquired by the second sensor, thereby making the sound information closer to the information of the sound spoken by the user.
[0078] The threshold volume is the volume of the voices used to determine whether the voices being uttered by people are getting louder due to social gatherings. The threshold volume may be a volume registered in advance by the user, or the volume of the voices detected during past social gatherings may be used.
[0079] If the volume of the sound in the dining space is equal to or greater than the threshold volume (Yes in S1022), the determination unit 104 determines that the first condition is met (S1026). On the other hand, if the threshold time has not elapsed since the user started cooking (No in S1021), or if the volume of the sound in the dining space is not equal to or greater than the threshold volume (No in S1022), the determination unit 104 determines that the first condition is not met (S1027).
[0080] Note that time-series information on the volume of the audio may be used as the information on the volume of the audio. A specific example of the time-series information on the volume of the audio is information on the volume of the audio for each time period in a predetermined period. For example, the audio of a family gathering is composed of a combination of conversation (first audio) having a volume equal to or greater than a first threshold volume and equal to or less than a second threshold volume, laughter (second audio) having a volume equal to or greater than the second threshold volume, and silence (third audio) having a volume equal to or less than the first threshold volume. If the proportions of the time corresponding to conversation, laughter, and silence correspond to a predetermined proportion, the determination unit 104 may determine that the first condition is satisfied (S1026). Examples of the predetermined proportions are 90% conversation, 1% laughter, and 9% silence. Alternatively, if the proportion of conversation falls within a predetermined range, the determination unit 104 may determine that the first condition is satisfied (S1026). An example of the predetermined range is 80% or more and 95% or less.
[0081] Furthermore, if the sound louder than the second threshold continues for a predetermined period of time or longer, the determination unit 104 may determine that a sound other than the user's laughter is being heard, and may determine that the first condition is not satisfied (S1027).
[0082] Note that the order of the steps in Fig. 6 is not limited to this. For example, step S1021 and step S1022 may be performed in reverse order, or may be performed simultaneously.
[0083] [Service Information] Based on the determination result of such a first condition, the first information is generated (S103), the first request is determined (S112), and the second information is generated (S113), as in embodiment 1. Then, based on the second information, the second information processing device 200 generates and outputs first service information for providing the first service to users in the space 20 via the device group 400 (S121, S122).
[0084] At this time, in this embodiment, the second information processing device 200 may output the user's past video information or image information to the display panel as the first service information. Furthermore, for example, if multiple first information processing devices 100 associated in advance satisfy the first condition, the second information processing device 200 may output, as the first service information, a control signal for controlling an electronic device so that the multiple first information processing devices 100 provide telephone services. The telephone services include voice-only telephone calls and video and voice telephone calls. Note that, prior to providing the telephone service, the second information processing device 200 may propose the telephone service to the multiple first information processing devices 100 via a display panel or an audio output device, and output the control signal only if the proposal is accepted.
[0085] [Effects, etc.] As described above, the information provision method of this embodiment is an information provision method using a first information processing device 100 equipped with a processor and a memory, in which a first sensor is placed in the kitchen space of a house and a second sensor is placed in the dining space of the house, and the processor detects the time when a user starts cooking in the kitchen space using the first sensor and acquires the volume of the voice in the dining space using the second sensor, and if (I) more than a threshold time has passed since the user started cooking and (ii) the volume of the voice in the dining space is more than a first threshold volume, generates first information indicating that it is time for family time in the house, and acquires information describing the first request content from a second information processing device 200 connected to the first information processing device 100 via a network, and if the first request content includes the content of the first information, can use the generated first information to output second information to the second information processing device 200, which includes information for identifying the user or the house.
[0086] According to this, the first sensor and the second sensor arranged in the kitchen space and the dining space, respectively, can be used to determine whether users are having a social gathering at home. Therefore, information for identifying a user or a home in such a situation can be output to a service provider, etc. As a result, the service provider, etc. can provide a service suited to the user or home situation. In other words, effective use of sensor data for service provision is realized.
[0087] For example, the sound in the dining space may include information on the volume of the sound over time over a predetermined period of time.
[0088] This makes it possible to more accurately determine whether users are having a social gathering at home based on time-series information on the volume of the voice.
[0089] For example, the information on the volume of the audio over time may be a combination of a first audio having a volume equal to or greater than a first threshold volume and equal to or less than a second threshold volume, a second audio having a volume greater than the second threshold volume, and a third audio having a volume less than the first threshold volume, and in (ii), the processor may generate first information indicating that it is family time at home if the proportion of time during the specified period that is the first audio is within a specified range.
[0090] According to this, by using appropriate first and second threshold magnitudes, it is possible to acquire, as the first sound, a sound corresponding to a conversation during a family gathering. By using the ratio of the length of time during which such a first sound is acquired in (ii) of the first condition, it is possible to more accurately determine whether users are having a family gathering at home.
[0091] For example, the information on the volume of the audio over time may be a combination of a first audio having a volume equal to or greater than a first threshold volume and equal to or less than a second threshold volume, a second audio having a volume greater than the second threshold volume, and a third audio having a volume less than the first threshold volume, and the processor may generate first information indicating that it is family time at home if, in (ii), the percentage of time that the audio is the first audio in the specified period, the percentage of time that the audio is the second audio in the specified period, and the percentage of time that the audio is the first audio in the specified period are all specified percentages.
[0092] According to this, by using appropriate first and second threshold magnitudes, sounds corresponding to conversation, laughter, and silence during a family gathering can be acquired as the first sound, the second sound, and the third sound, respectively. By using the ratio of the length of time during which each of the first sound, the second sound, and the third sound is acquired in (ii) of the first condition, it is possible to more accurately determine the situation in which users are having a family gathering at home.
[0093] (Variation 1) Next, a first modification of the first embodiment will be described. This modification is different from the first embodiment in that the service is provided via the first information processing device 100. This modification will be described with reference to the drawings, focusing on the differences from the first embodiment.
[0094] The configuration of the service providing system 10 according to this modification is the same as that of the first embodiment, and therefore illustrations and explanations thereof will be omitted.
[0095] [Interaction within service provision system 10] FIG. 10 is a sequence diagram of the service providing system 10 according to the first modification. As shown in FIG. 10, the second information processing device 200 according to this modification generates first service information (S121), and then outputs the first service information to the first information processing device 100 (S122A). The first information processing device 100 transfers the first service information acquired from the first information processing device 100 to the device group 400 (S122B). The first information processing device 100 may transmit record information on the provision of the first service information to the second information processing device 200. Examples of the record information include the number of times the first service information has been provided and attribute information related to the user or the space 20. The attribute information is information that does not allow the user or the space 20 to be identified. Examples of the attribute information include geographical information and demographic information of the user. The record information may be limited to information that the user has been previously permitted to transmit.
[0096] [Effects, etc.] As described above, according to the service providing system 10 of this modification, the second information processing device 200 does not need to communicate directly with the device group 400 arranged in the space 20, and therefore it is possible to restrict disclosure of information related to the space 20 to the second information processing device 200. Therefore, it is possible to protect the privacy of users in the space 20.
[0097] (Variation 2) Next, a second modification of the first embodiment will be described. This modification is different from the first embodiment in that the transmission of the first request information from the second information processing device 200 to the first information processing device 100 is performed before, rather than after, the generation of the first information (S103). This modification will be described with reference to the drawings, focusing on the differences from the first embodiment.
[0098] The configuration of the service providing system 10 according to this modification is the same as that of the first embodiment, and therefore illustrations and explanations thereof will be omitted.
[0099] [Interaction within service provision system 10] Fig. 11 is a sequence diagram of the service providing system 10 according to Modification 2. As shown in Fig. 11, the first information processing device 100 according to this modification acquires first request information (S111) before acquiring first sensor data (S101).
[0100] Note that the first request information may be acquired (S111) before the determination of the first request (S112) and is not limited to being acquired before the first sensor data (S101). Furthermore, since the first request is transmitted in advance, the second information processing device 200 may desire to acquire information regarding the timing at which it is determined that the first condition is satisfied (S102). If the determination of the first condition (S102) is performed each time first sensor data is continuously received in chronological order, it is possible to acquire information regarding the timing at which the situation changes so that the first condition is satisfied by acquiring information about first center data that does not satisfy the first condition immediately before the first center data that satisfies the first condition is received. For example, the second information may include information about the first center data that does not satisfy the first condition immediately before the first condition is satisfied. Furthermore, the first information processing device 100 may propose to the second information processing device 200 a change to the first condition based on the results of analyzing statistical information about the information about the first center data that does not satisfy the first condition immediately before the first condition is satisfied.
[0101] [Effects, etc.] As described above, according to the service providing system 10 of this modified example, the second information can be output regardless of the timing of obtaining the first request information, thereby realizing more timely provision of the second information.
[0102] (Variation 3) Next, a third modification of the first embodiment will be described. This modification is different from the first embodiment in that the second information includes operation information of equipment related to the service in addition to information for identifying the user or space. This modification will be described with reference to the drawings, focusing on the differences from the first embodiment.
[0103] The configuration of the service providing system 10 according to this modification is the same as that of the first embodiment, and therefore illustrations and explanations thereof will be omitted. Furthermore, the interactions within the service providing systems 10 and 10A and the processing of the first information processing device 100 are also the same as those in Figs. 6 to 9, and therefore illustrations and explanations thereof will be simplified or omitted.
[0104] [Generation process of second information] The second information generation process (S113 in FIG. 5) in this modified example will be described in detail with reference to FIG. 12. FIG. 12 is a flowchart showing an example of the second information generation process (S113) in modified example 3. Note that in this modified example, the first request information includes information for identifying a service provided by the second information processing device 200.
[0105] The first information processing device 100 selects a device related to the service identified by the first request information from the device group 400 arranged in the space 20 where the first information was generated (S1131). For example, the first information processing device 100 selects a device from the device group 400 based on the effect of the service on the user's five senses (sight, hearing, smell, touch, and taste) and the effect of the device on the user's five senses.
[0106] Fig. 13A shows an example of relationship information between a service and the five senses. Fig. 13B shows an example of relationship information between a device and the five senses. In Fig. 13A and Fig. 13B, a check mark indicates that an effect is exerted, and a dash mark indicates that an effect is not exerted.
[0107] 13A, it can be seen that, for example, Service 1 affects the senses of sight and hearing, but does not affect the senses of smell and touch (back, waist, and eyes). Also, with reference to FIG. 13B, it can be seen that, for example, television affects the senses of sight and hearing, but does not affect the senses of smell and touch (back, waist, and eyes).
[0108] Here, for example, when service 1 is identified by the first request information, the first information processing device 100 selects, from the multiple devices shown in FIG. 13B, a television and speakers related to the visual or auditory sense that service 1 affects in FIG. 13A.
[0109] Next, the first information processing device 100 acquires operation information of the selected device (S1132). The operation information is information indicating the operation status of the device, for example, information indicating whether the device is operating. The operation information may be acquired directly from the device or via a sensor, for example.
[0110] Then, the first information processing apparatus 100 generates second information including the operation information (S1133).
[0111] [Effects, etc.] As described above, according to this modification, the second information can include operation information of the devices. Therefore, the second information processing device 200 can, for example, refer to the operation information of the devices and start up devices that are not in operation to provide services, thereby avoiding conflicts between services among devices that are in operation. Furthermore, for example, when there are many devices in an operating state, the second information processing device 200 can skip providing a service, thereby avoiding confusion for the user caused by multiple devices.
[0112] In this modification, the second information includes the operation information of the selected device, but is not limited to this. For example, the second information may include the operation information of all devices. Furthermore, the operation information may be output separately from the second information.
[0113] The second information may include only the operation information of the devices that have been permitted to be provided to the user in advance. Furthermore, if there is a device that has been denied provision to the user, the second information may include information indicating that the device has been denied provision to the user. For example, when providing a service using a device that has been denied provision to the user, the second information processing device 200 may inquire of the user as to whether the service can be provided.
[0114] The second information may include audio information used to determine the first condition, instead of the device operation information. The second information may also include audio information in addition to the device operation information. Examples of audio information included in the second information include time-series changes in the volume of the audio in the second information, or information on the ratio of talking, laughter, and silence in the audio. The audio information may also include the number of users conversing. For example, the number of users may be acquired from the audio information using a known analysis method, or the number of users may be acquired based on information from the sensor group 300. The second information processing device 200 can pre-set the situation of the space 20 corresponding to the audio information and provide services by referring to the audio-based information. For example, the second information processing device 200 provides services depending on whether the users are having a relaxed, friendly conversation or a lively, friendly conversation. When users are having a relaxed, friendly conversation, the ratio of silence is high or laughter is low. When users are having a lively, friendly conversation, the ratio of laughter is high. For example, when the voice information shows a similar tendency, by providing telephone services from a plurality of first information processing devices 100, it becomes possible to provide a service that takes into account the situation of each space 20 due to telephone conversations.
[0115] Furthermore, when permission to propose a telephone service has been obtained between multiple first information processing devices 100 that are not previously associated, if the audio information shows a similar tendency even when the multiple first information processing devices 100 are not previously associated, the second information processing device 200 may provide the telephone service. In this case, the information provided to the other party when the telephone service is provided between multiple first information processing devices 100 that are previously associated may be reduced compared to the information provided to the other party when the telephone service is provided between multiple first information processing devices 100 that are not previously associated. For example, a voice telephone service may be provided. Or, even in the case of a telephone service that includes video, the information on the video of the space 20 may be reduced. For example, to reduce the information on the video, the area in which the video is displayed may be reduced, or background information other than people may be removed.
[0116] (Variation 4) Next, a fourth modification of the first embodiment will be described. This modification is mainly different from the first embodiment in that the second information includes suitability information indicating suitability for providing the service in addition to information for identifying the user or space. This modification will be described with reference to the drawings, focusing on the differences from the first embodiment.
[0117] The configuration of the service providing system 10 according to this modification is the same as that of the first embodiment, and therefore illustrations and explanations thereof will be omitted. Furthermore, the interactions within the service providing systems 10 and 10A and the processing of the first information processing device 100 are also the same as those in Figs. 6 to 9, and therefore illustrations and explanations thereof will be simplified or omitted.
[0118] [Generation process of second information] Details of the second information generation process (S113 in FIG. 5) in this modified example will be described with reference to FIG. 14. FIG. 14 is a flowchart showing an example of the second information generation process (S113) in modified example 4. Note that in this modified example, the first request information includes information for identifying a service provided by the second information processing device 200.
[0119] The first information processing device 100 acquires a service provision history for the space 20 or the user (S1134). The service provision history is information that associates a service that has been provided to the space 20 or the user in the past with the date and time when the service was provided.
[0120] FIG. 15 shows an example of a service provision history in Modification Example 4. In FIG. 15, the horizontal axis represents time, and the vertical axis represents days. The double-headed arrows represent the time when a service was provided or will be provided to the space 20 or the user. For example, service 1 was provided twice between 18:00 and 24:00 on June 2, 2018. Note that the service provision history may include multiple different services provided by multiple different second information processing devices 200 (i.e., multiple different service providers).
[0121] Next, the first information processing device 100 evaluates the suitability of providing the service specified in the first request information to the space 20 or the user based on the acquired service provision history (S1135). Specifically, the first information processing device 100 evaluates the suitability of providing the service specified in the first request information based on, for example, the number of times the service has been provided within a predetermined period. Furthermore, for example, the first information processing device 100 may evaluate the suitability of providing the service specified in the first request information based on other services currently being provided.
[0122] A specific example of such an evaluation of suitability for providing a service will be described with reference to Figures 16A to 16C. Figure 16A shows an example of service provision possibility information in Modification Example 4. The service provision possibility information may be stored in advance in third memory 107, for example, or may be acquired from an external server (not shown).
[0123] The service availability information indicates the number of times each service can be provided per day and the circumstances under which it cannot be provided. For example, in Figure 16A, it is shown that services 1 and 3 can each be provided an unlimited number of times per day, while service 2 can only be provided once per day.
[0124] In the service provision history of Figure 15, Service 1 and Service 2 have already been provided today (June 7, 2018). Therefore, if the service provision possibility information of Figure 16A is referred to, the suitability of providing Services 1 and 3 will be evaluated as high, and the suitability of providing Service 2 will be evaluated as low.
[0125] FIG. 16A also shows that services 1 and 2 cannot be provided in user situations A and B, respectively. User situations A and B can be, for example, situations in which the user's actions are slower than usual. In this case, by prohibiting the provision of less urgent services (for example, playing music or displaying fortune-telling information), it is possible to provide services suited to the user's situation. User situations A and B can also be, for example, situations in which users are having a family time at home.
[0126] 16B shows an example of simultaneous service provision prohibition information in Modification 4. The simultaneous service provision prohibition information may be stored in advance in, for example, third memory 107, or may be acquired from an external server (not shown).
[0127] The service simultaneous provision prohibition information indicates the combination of services that are prohibited / allowed to be provided simultaneously. A check mark indicates prohibition, and a dash mark indicates permission.
[0128] In FIG. 16B, for example, service 1 indicates that simultaneous provision with each of services 2 and 3 is permitted. That is, service 1 can be provided together with each of services 2 and 3. Also, for example, service 2 indicates that simultaneous provision with service 3 is prohibited. That is, service 2 cannot be provided together with service 3.
[0129] 16C shows an example of service change prohibition information in Modification 4. The service change prohibition information may be stored in advance in, for example, third memory 107, or may be acquired from an external server (not shown).
[0130] The service change prohibition information indicates which services are prohibited or permitted to be provided in place of the currently provided service. A check mark indicates that the service in the left column cannot be changed to the service in the row above, and a dash indicates that the service in the left column can be changed to the service in the row above.
[0131] 16C, for example, when service 1 is currently being provided, a change from service 1 to service 2 is prohibited. On the other hand, when service 2 is currently being provided, a change from service 2 to service 1 is permitted. Also, when service 2 is currently being provided, a change from service 2 to service 3 is prohibited.
[0132] In the service provision history of Fig. 15, service 2 is being provided at the current time. Therefore, if the simultaneous service provision prohibition information of Fig. 16B and the service change prohibition information of Fig. 16C are referenced, the suitability of providing service 1 will be evaluated as high, and the suitability of providing service 3 will be evaluated as low.
[0133] The result of such an evaluation is expressed in two or more levels. For example, two levels, "suitable" and "unsuitable," can be used as the evaluation result. Also, for example, a score from 0 to 10 or 0 to 100 can be used as the evaluation result.
[0134] Finally, the first information processing apparatus 100 generates second information including aptitude evaluation information indicating the evaluation result (S1136).
[0135] [Effects, etc.] As described above, according to this modification, the second information can include suitability evaluation information. Therefore, the second information processing device 200 can skip providing a service when the suitability evaluation is low, for example, and can prevent the service from being provided at an inappropriate time. As a result, the service providing system 10, 10A can, for example, reduce excessive service provision and prevent interference between services.
[0136] In this modification, the second information includes the suitability evaluation information, but is not limited to this. For example, information on the service provision history may be included in addition to or instead of the suitability evaluation information. Furthermore, the service suitability information may be output separately from the second information.
[0137] (Variation 5) Next, a fifth variation of the first embodiment will be described. This variation is different from the first embodiment in that, when first requests having the same request content have been received in advance from a plurality of second information processing devices 200 (see the second variation), the second information is output to a second information processing device 200 selected based on priority. This variation will be described with reference to the drawings, focusing on the differences from the first embodiment.
[0138] The configuration of the service providing system 10 according to this modification is the same as that of the first embodiment, and therefore illustrations and explanations thereof will be omitted. Furthermore, the interactions within the service providing systems 10 and 10A and the processing of the first information processing device 100 are also the same as those in Figs. 6 to 9, and therefore illustrations and explanations thereof will be simplified or omitted.
[0139] [Output process of second information] The output process of the second information in this modification (S114 in FIG. 5) will be described in detail with reference to Fig. 17. Fig. 17 is a flowchart showing an example of the output process of the second information (S114) in the fifth modification.
[0140] The first information processing device 100 sets priorities for the plurality of second information processing devices 200 (S1141). That is, the first information processing device 100 sets priorities for the plurality of second information processing devices 200 corresponding to the plurality of first requests having the same request content. For example, the priority may be included in the first request information, in which case the priority is set according to the priority included in the first request information. Furthermore, the priority may be set according to the situation of the space 20 or the user obtained from the sensor group 300 and the device group 400. Furthermore, the priority of the plurality of second information processing devices 200 may be set based on the bid price of the service provider in response to the bid for providing the second information.
[0141] Next, the first information processing device 100 selects one or more second information processing devices 200 based on the set priority (S1142). For example, the first information processing device 100 selects the second information processing device 200 with the highest priority from among the second information processing devices 200 corresponding to the first requests having the same request content. Note that the number of selected second information processing devices 200 is not limited to one.
[0142] Then, the first information processing device 100 outputs the second information to the selected second information processing device 200 (S1143). Thereafter, the first information processing device 100 determines whether or not the service has been provided by the selected second information processing device 200 within a predetermined time (S1144). In other words, it is determined whether or not the second information processing device 200 has provided the service within a predetermined time from the output of the second information. The predetermined time may be a time determined empirically or experimentally, and may be, for example, a time common to multiple services. Alternatively, the predetermined time may be different for each of the multiple services.
[0143] If the service has been provided within the predetermined time (Yes in S1144), the process ends. On the other hand, if the service has not been provided within the predetermined time (No in S1144), the process proceeds to step S1141. At this time, in step S1141, the priorities of the multiple second information processing devices 200 are updated, and the priorities of the second information processing devices 200 that did not provide the service are lowered. The first information processing device 100 selects one or more second information processing devices 200 based on the updated priorities (S1142). Here, the first information processing device 100 may be configured to provide the service to the user or the space 20 only if the priority is set to the highest. For example, if second information has been transmitted to both the second information processing device 200 whose priority was set to the highest before the update and the second information processing device 200 whose priority was set to the highest after the update, if an attempt is made to provide the service from the second information processing device 200 whose priority was set to the highest before the update after the predetermined time, there is a possibility that the services will overlap. Therefore, only the second information processing device 200 whose priority was set to the highest may be configured to be able to use the second information. For example, the second information can be realized by providing an encryption key corresponding to the second information processing device 200 that is set to the highest priority and that can be used only when the service is being executed and that is encrypted and changed with each update.
[0144] [Effects, etc.] As described above, according to this modification, the first information processing device 100 can select the second information processing device 200 based on the priority. Therefore, the service providing system 10, 10A can select the second information processing device 200 that is suitable for providing the service from among the second information processing devices 200 corresponding to the first requests having the same request content.
[0145] (Other variations) In the first embodiment, information on the operation of electronic devices related to cooking is used, but this is not limiting. For example, information on the operation of electronic devices in the bathroom may be used.
[0146] Other examples of the first condition include the following (iii) and (iv): (iii) A threshold time or more has elapsed since the user started bathing, and (iv) the volume of the sound in the living room or bedroom is equal to or greater than a threshold volume.
[0147] The time when the bathing begins is acquired by a sensor group 300 arranged in the bathroom or the changing room.
[0148] That is, the first condition only needs to satisfy the operating status of the device associated with the predetermined user behavior and the volume of the sound in the predetermined space being equal to or greater than a threshold volume.
[0149] (Service type) Next, the types of services provided by the service providing system according to the first embodiment will be described.
[0150] [Overview of services provided] FIG. 18A shows an overview of the service providing system.
[0151] The group 1000 may be, for example, a company, an organization, a home, or the like, and may be of any size. The group 1000 includes a device A, a device B, and a home gateway 1020, which are included in a plurality of devices 1010. For example, the plurality of devices 1010 are devices included in the device group 400 in the first embodiment. The home gateway 1020 is the gateway 500 in the first embodiment. The plurality of devices 1010 include devices that can connect to the Internet (e.g., a smartphone, a PC, a TV, etc.) and devices that cannot connect to the Internet by themselves (e.g., a light, a washing machine, etc.). Even if a device cannot connect to the Internet by itself, it may be possible for the device to connect to the Internet via the home gateway 1020. The group 1000 also includes a user 990A who uses a plurality of devices 1010.
[0152] The data center operating company 1100 has a cloud server 1110. The cloud server 1110 is a virtualized server that cooperates with various devices via the Internet. For example, the cloud server 1110 is the first information processing device 100 in the first embodiment. The cloud server 1110 mainly manages huge amounts of data (big data) that are difficult to handle with ordinary database management tools, etc. The data center operating company 1100 manages data, manages the cloud server 1110, and operates the data center that performs these tasks. The services provided by the data center operating company 1100 will be described in detail later. Here, the data center operating company 1100 is not limited to a company that only manages data and operates the cloud server 1110. For example, if a device manufacturer that develops and manufactures one of the multiple devices 1010 also manages data and manages the cloud server 1110, the device manufacturer corresponds to the data center operating company 1100 (FIG. 18B). Furthermore, the data center operating company 1100 is not limited to one company. For example, if a device manufacturer and another management company jointly or jointly manage data and operate the cloud server 1110, either one or both of them will be considered to be the data center operating company 1100 (FIG. 18C).
[0153] The service provider 1200 owns a server 1210. The server 1210 here includes, for example, a memory in a personal PC, regardless of its size. There is also a case where the service provider does not own the server 1210. For example, the server 1210 is the second information processing device 200 in the first embodiment.
[0154] Note that the home gateway 1020 is not essential for the above services. For example, if the cloud server 1110 manages all data, the home gateway 1020 is not required. Also, there may be cases where no device is incapable of connecting to the Internet by itself, such as when all devices in a home are connected to the Internet.
[0155] Next, the flow of information in the above service will be explained.
[0156] First, device A or device B of group 1000 transmits information obtained by each device to cloud server 1110 of data center operating company 1100. Cloud server 1110 collects information about device A or device B ((a) of FIG. 18A). The collected information is information indicating, for example, the operating status, operating date and time, operating mode, location, etc., of multiple devices 1010. Examples of the collected information include television viewing history, recorder recording reservation information, washing machine operating date and time and amount of laundry, refrigerator opening and closing date and time and number of openings and closings, and amount of food in the refrigerator. However, this information is not limited to these, and refers to all information that can be obtained from any device. The information may be provided directly from multiple devices 1010 to cloud server 1110 via the Internet. Alternatively, information may be collected from multiple devices 1010 in home gateway 1020 and then provided from home gateway 1020 to cloud server 1110.
[0157] Next, the cloud server 1110 of the data center operating company 1100 provides the accumulated information to the service provider 1200 in a fixed unit. Here, the fixed unit may be a unit that allows the data center operating company to organize the accumulated information and provide it to the service provider 1200, or may be a unit requested by the service provider 1200. Although the fixed unit is described, it does not have to be a fixed unit, and the amount of information provided may change depending on the situation. The information is stored in a server 1210 owned by the service provider 1200 as needed ((b) of FIG. 18A). Then, the service provider 1200 organizes the information into information suitable for the service to be provided to the user and provides it to the user. The user to whom the information is provided may be a user 990A who uses multiple devices 1010 or an external user 990B. The service may be provided to the user directly from the service provider ((e) and (f) of FIG. 18A). Furthermore, the method of providing the service to the user may be, for example, to provide the service to the user via the cloud server 1110 of the data center operating company 1100 again ((c) and (d) in FIG. 18A). Furthermore, the cloud server 1110 of the data center operating company 1100 may organize the information into information suitable for the service to be provided to the user and provide it to the service provider 1200.
[0158] Note that user 990A and user 990B may be different or the same person.
[0159] The technology described in the above aspects can be realized in the following types of cloud services, for example: However, the types in which the technology described in the above aspects can be realized are not limited to these.
[0160] [Service type 1: In-house data center type] FIG. 19 shows service type 1 (own data center type). In this type, a service provider 1200 acquires information from a group 1000 and provides services to users. In this type, the service provider 1200 has the functions of a data center operating company. In other words, the service provider owns a cloud server 1110 that manages big data. Therefore, there is no data center operating company.
[0161] In this type, a service provider 1200 operates and manages a data center 903 (cloud server 1110). The service provider 1200 also manages an OS 902 and an application 901. The service provider 1200 provides a service 904 using the OS 902 and application 901 managed by the service provider 1200.
[0162] [Service type 2: IaaS usage type] Figure 20 shows service type 2 (IaaS usage type). Here, IaaS stands for Infrastructure as a Service, and is a cloud service delivery model in which the infrastructure for building and running computer systems is provided as a service via the Internet.
[0163] In this type, a data center operating company 1100 operates and manages a data center 903 (cloud server 1110). In addition, a service provider 1200 manages an OS 902 and an application 901. The service provider 1200 provides a service 904 using the OS 902 and the application 901 managed by the service provider 1200.
[0164] [Service type 3: PaaS usage type] Figure 21 shows service type 3 (PaaS usage type). PaaS stands for Platform as a Service, a cloud service model that provides a platform, the foundation for building and running software, as a service via the Internet.
[0165] In this type, a data center operating company 1100 manages an OS 902 and operates and manages a data center 903 (cloud server 1110). In addition, a service provider 1200 manages an application 901. The service provider 1200 provides a service 904 using the OS 902 managed by the data center operating company and the application 901 managed by the service provider 1200.
[0166] [Service type 4: SaaS usage] Figure 22 shows service type 4 (SaaS usage type). Here, SaaS stands for Software as a Service. This is a cloud service provision model that allows companies and individuals (users) that do not own data centers (cloud servers) to use applications provided by platform providers that own data centers (cloud servers) via a network such as the Internet.
[0167] In this type, a data center operating company 1100 manages an application 901, an OS 902, and operates and manages a data center 903 (cloud server 1110). In addition, a service provider 1200 provides a service 904 using the OS 902 and application 901 managed by the data center operating company 1100.
[0168] In any of the above types, it is assumed that the service provider 1200 provides the service. For example, the service provider or the data center operating company may develop the OS, application, big data database, etc. by itself, or may outsource it to a third party.
[0169] (Other embodiments) While the service providing system according to one or more aspects of the present disclosure has been described above based on the embodiments, the present disclosure is not limited to these embodiments. As long as they do not deviate from the spirit of the present disclosure, various modifications conceivable by those skilled in the art to the present embodiments and configurations constructed by combining components of different embodiments may also be included within the scope of one or more aspects of the present disclosure.
[0170] For example, in the first embodiment, the first information processing device 100 that processes sensor data and the second information processing device 200 that generates service information are separate devices, but the first information processing device 100 and the second information processing device 200 may be realized as a single information processing device. In this case, interaction between the first information processing device 100 and the second information processing device 200 is unnecessary, so that when the first condition is satisfied, the processing from the generation of the first information to the output of the second information may be skipped. [Industrial Applicability]
[0171] The present disclosure can be used as an information processing device that provides information for providing a service to a user. [Explanation of symbols]
[0172] 10 Service provision system 20 space 100 First information processing device 101 Sensor data acquisition unit 103 First Memory 104 Judgment section 105 Second Memory 106 1st information generation section 107 Third Memory 108 Second information generation section 109, 203 Input / output section 200 Second information processing device 201 4th Memory 202 Request generator 204 5th Memory 205 Service Generation Unit 206 Output section 300 sensors 400 equipment groups 500 Gateway
Claims
1. An information providing method using a first information processing device including a processor and a memory, A first sensor is disposed in a first space of the home; a second sensor is disposed in a second space of the house; The processor: acquiring, by the first sensor, device operation status information associated with a predetermined behavior of the user in the first space; acquiring information about the volume of sound in the second space by the second sensor; (i) if a threshold time or more has elapsed since the start time of the predetermined behavior of the user, and (ii) if the volume of the sound in the second space is equal to or greater than a first threshold volume, generate first information indicating that it is family time in the house; outputting the first information; Information provision method.
2. The information on the volume of the sound in the second space includes time-series information on the volume of the sound in a predetermined period of time. The information providing method according to claim 1 .
3. the time-series information on the loudness of the audio is a combination of a first audio having a loudness equal to or greater than the first threshold loudness and equal to or less than a second threshold loudness, a second audio having a loudness greater than the second threshold loudness, and a third audio having a loudness less than the first threshold loudness, In (ii), when a ratio of the time during which the first sound is heard in the predetermined period is within a predetermined range, the processor generates first information indicating that the time is family time at the home. The information providing method according to claim 2.
4. the time-series information on the loudness of the audio is a combination of a first audio having a loudness equal to or greater than the first threshold loudness and equal to or less than a second threshold loudness, a second audio having a loudness greater than the second threshold loudness, and a third audio having a loudness less than the first threshold loudness, In (ii), when the proportion of time during which the first voice is heard in the predetermined period, the proportion of time during which the second voice is heard in the predetermined period, and the proportion of time during which the third voice is heard in the predetermined period are all predetermined proportions, the processor generates first information indicating that the time is family time at the home. The information providing method according to claim 2.
5. acquiring information describing the first request content from a second information processing device connected to the first information processing device via a network; When the first request content includes the content of the first information, outputting, to the second information processing device, second information including information for identifying the user or the house, using the generated first information. The information providing method according to claim 1 .
6. A plurality of electronic devices are arranged in the house, the second information includes operation statuses of the plurality of electronic devices to be used when the second information processing device provides a service to the first information processing device; The information providing method according to claim 5.
7. the second information includes information based on a voice in the second space to be used by the second information processing device when providing a service to the first information processing device; The information providing method according to claim 5.
Citation Information
Patent Citations
Illumination device
JP1993217677A
Voice processor, moving picture processor, voice and moving picture processor, and recording medium with voice and moving picture processing program recorded
JP2002006874A
Communication support system
JP2010204965A
Viewing terminal device, viewing statistics apparatus, viewing statistics processing system, and viewing statistics processing method
JP2011139441A
Device and method for estimating group behavior within household
JP2014115865A