Information providing method

The method uses sensors in a kitchen and dining space to generate information about gathering times, addressing the challenge of utilizing sensor data for service provision by enabling accurate determination of user situations for tailored services.

JP7703086B2Active Publication Date: 2025-07-04PANASONIC INTELLECTUAL PROPERTY CORP OF AMERICA
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2024117550
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2018-10-02
Filing Date
2024-07-23
Publication Date
2025-07-04
Estimated Expiration
2039-10-02

AI Technical Summary

Technical Problem

Existing technologies lack effective methods to utilize sensor data for service provision, making it difficult to provide tailored services based on user situations.

Method used

An information providing method using a first sensor in a kitchen space and a second sensor in a dining space to detect cooking initiation and sound levels, generating information indicating a gathering time when specific conditions are met, and outputting data to a second information processing device for service provision.

Benefits of technology

Enables effective utilization of sensor data for service provision by accurately determining user situations, allowing providers to offer suitable services.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007703086000001
    Figure 0007703086000001
  • Figure 0007703086000002
    Figure 0007703086000002
  • Figure 0007703086000003
    Figure 0007703086000003
Patent Text Reader

Abstract

To provide an information providing method capable of making effective use of sensor data for providing services.SOLUTION: The information providing method includes the steps of: detecting time when a user starts cooking in a given space with a first sensor; acquiring a piece of information of sound volume in the given space with a second sensor; (i) when a threshold time or more has elapsed since the user started cooking, and (ii) when the sound volume in the given space is greater than a first threshold value, generating a piece of first information indicating that it is time for family time at home (S103); and outputting the first information.SELECTED DRAWING: Figure 4
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] It relates to an information providing method.

Background Art

[0002] In recent years, it has become possible to collect a huge amount of sensor data from sensors arranged in various places, and effective utilization of the collected sensor data has been demanded. For example, by using sensor data from various sensors arranged in an indoor space such as a house, it becomes possible to provide a service suitable for the user's situation.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the prior art, there is little information on how to use sensor data, and it is difficult to effectively utilize sensor data for service provision.

[0005] The present disclosure provides an information providing method and the like capable of effectively utilizing sensor data for service provision.

Means for Solving the Problems

[0006] An information providing method according to an aspect of the present disclosure is an information providing method using a first information processing apparatus including a processor and a memory, wherein a first sensor is disposed in a predetermined space of a house, and a second sensor is disposed in the predetermined space of the house, and the processor detects, by the first sensor, a time when a user starts cooking in the predetermined space, and acquires, by the second sensor, information on the loudness of sound in the predetermined space, and generates first information indicating that it is the gathering time of the house when (i) a threshold time or more has elapsed since the time when the user starts cooking, and (ii) the loudness of sound in the predetermined space is equal to or greater than a first threshold loudness, and outputs the first information.

[0007] Note that these general or specific aspects may be implemented by a system, an apparatus, an integrated circuit, a computer program, or a recording medium such as a computer-readable CD-ROM, or may be implemented by any combination of a system, a method, an integrated circuit, a computer program, and a recording medium.

Effects of the Invention

[0008] An information providing method according to an aspect of the present invention can effectively utilize sensor data for service provision.

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13A

Figure 13B

Figure 14

Figure 15

Figure 16A

Figure 16B

Figure 16C

Figure 17

Figure 18A

Figure 18B

Figure 18C

Figure 19

Figure 20

Figure 21

Figure 22

Embodiments for Carrying Out the Invention

[0010] Hereinafter, the embodiments will be specifically described with reference to the drawings.

[0011] Note that all of the embodiments described below show comprehensive or specific examples. The numerical values, shapes, materials, components, arrangement positions and connection forms of the components, steps, order of steps, etc. shown in the following embodiments are merely examples and are not intended to limit the scope of the claims.

[0012] Also, each figure is not necessarily drawn precisely. In each figure, substantially the same configurations are denoted by the same reference numerals, and duplicate descriptions are omitted or simplified.

[0013] (Embodiment 1) [Overall Image of Service Provision System 10] First, the overall image of service provision system 10 will be described with reference to FIG. 1. FIG. 1 shows the overall image of service provision system 10 according to Embodiment 1.

[0014] In the service providing system 10 according to this embodiment, sensor data in a plurality of indoor spaces is collected by a cloud server. The indoor spaces are, for example, spaces in houses, office spaces, buildings, and vehicles. The sensor data is data based on the daily and / or unusual activities of users in the indoor spaces.

[0015] Each of a plurality of service providers can obtain various types of information based on the sensor data collected by the cloud server via an application programming interface (API). The API is an information processing function of the cloud server that can be called and used from a computer.

[0016] Each service provider provides a service to the user based on the information obtained via the API. Examples of the service include an information providing service, an advertisement distribution service, an automatic control service for devices on a home network, or any combination thereof. Note that the service is not limited thereto, and may be, for example, a delivery service for goods.

[0017] [Configuration of Service Providing System 10] Next, the configuration of the service providing system 10 will be described with reference to FIG. 2. FIG. 2 shows the configuration of the service providing system 10 according to Embodiment 1. As shown in FIG. 2, the service providing system 10 according to this embodiment includes a first information processing device 100, a second information processing device 200, a sensor group 300, and a device group 400.

[0018] The sensor group 300 is arranged in the space 20 and includes at least one sensor. The sensor group 300 is connected to a communication network such as the Internet via a gateway 500. Note that the gateway 500 is optional, and the sensor group 300 may be connected to the communication network without passing through the gateway 500.

[0019] The sensor group 300 outputs sensor values indicating operation information regarding the user's actions or information regarding the operation / control of the device group 400. For example, the sensor group 300 can output a sensor value indicating whether a lighting device is on, a sensor value indicating whether an audio device is outputting sound, a sensor value indicating whether a user exists within the space 20 or within a predetermined area within the space 20, or any combination thereof.

[0020] The sensor group 300 can include, for example, a motion sensor, an open / close sensor, a sound sensor, or any combination thereof. The sensors of such a sensor group 300 can be realized, for example, by an image sensor, an infrared sensor, an ultrasonic sensor, a visible light sensor, a vibration sensor, a touch sensor, a microphone, or any combination thereof. Such sensors can be installed on the walls, floor, or ceiling forming the space 20, or on electronic devices or furniture arranged within the space 20. Further, the sensors may be built into the devices of the device group 400, for example, a touch sensor built into a touch screen of a smartphone or the like. Note that the sensors are not limited to the above sensors.

[0021] The device group 400 is arranged within the space 20 and includes at least one electronic device. The device group 400 is connected to a communication network such as the Internet via the gateway 500. Note that the gateway 500 is optional, and the device group 400 may be connected to the communication network without passing through the gateway 500.

[0022] The device group 400 can include, for example, a display panel, a lighting device, an audio device, a refrigerator, a vacuum cleaner, or any combination thereof. Note that the devices of the device group 400 are not limited to these.

[0023] The first information processing device 100 is a device including a processor and a memory, which is arranged outside the space 20 and corresponds to, for example, the cloud server shown in FIG. 1. Note that the first information processing device 100 may be an edge server arranged within the space 20.

[0024] Note that a cloud server means a server provided via the Internet. An edge server means a server provided via a network in an area closer to the user than the Internet (for example, a local area network (LAN)).

[0025] The second information processing device 200 is a device including a processor and a memory, which is, for example, the device of the service provider shown in FIG. 1. The second information processing device 200 provides services to the user via the device group 400 within the space 20.

[0026] Here, the service providing system 10 shown in FIG. 2 assumes an example existing for each of a plurality of indoor spaces. Specifically, the first information processing device 100 exists for each of the plurality of indoor spaces, and a plurality of second information processing devices 200 are connected to each first information processing device 100, so that services are provided in the indoor space. At this time, by the plurality of first information processing devices 100 and the plurality of second information processing devices 200 existing independently, various information of the user or the space 20 can be provided from the plurality of first information processing devices 100, and various services can be provided using the plurality of second information processing devices 200. On the other hand, new information exchange occurs between the plurality of first information processing devices 100 and the plurality of second information processing devices 200. In the present embodiment, by defining this information exchange, a mechanism is provided for effectively utilizing sensor data and providing appropriate services.

[0027] [Functional Configuration of the First Information Processing Device 100] Next, the functional configuration of the first information processing device 100 will be described with reference to FIG. 3. FIG. 3 shows the functional configurations of the first information processing device 100 and the second information processing device 200 according to the first embodiment.

[0028] As shown in FIG. 3, the first information processing apparatus 100 according to the present embodiment includes a sensor data acquisition unit 101, a first memory 103, a determination unit 104, a second memory 105, a first information generation unit 106, a third memory 107, a second information generation unit 108, and an input / output unit 109. Each functional block of the first information processing apparatus 100 will be described below.

[0029] The sensor data acquisition unit 101 acquires first sensor data including a first sensor value from the sensor group 300. Part or all of the first sensor data is stored in the first memory 103. The first sensor data may include, for example, data indicating whether there is a person in a predetermined area within the space 20. Also, for example, the first sensor data may include data indicating the sound output status of an audio device. Further, the first sensor data may include data indicating the operation status of a device. Also, the first sensor data may include data indicating the open / closed status of the door of a refrigerator.

[0030] The first memory 103 stores part or all of the first sensor data acquired by the sensor data acquisition unit 101.

[0031] The determination unit 104 determines whether the first condition is satisfied. Details of the first condition will be described later.

[0032] The second memory 105 stores information for generating the first information. For example, the second memory 105 stores a correspondence table in which the contents of information generated for a plurality of different conditions are associated.

[0033] The first information generation unit 106 generates the first information when the first condition is satisfied. In the present embodiment, the first information indicates the gathering time of the house, but is not limited thereto.

[0034] The third memory 107 stores information for generating second information. That is, the third memory 107 stores information for identifying the user or space 20 corresponding to the first information generated by the first information generation unit 106.

[0035] The second information generation unit 108 determines whether the content of the first information is included in the first request content included in the information acquired from the second information processing device 200 via the input / output unit 109. Here, when the content of the first information is included in the first request content, the second information generation unit 108 generates second information using the first information. The second information includes information for identifying the user or space 20 (for example, user ID, address, IP address, device identification information, etc.). For example, the second information generation unit 108 reads out from the third memory 107 the information for identifying the user or space 20 corresponding to the first information generated by the first information generation unit 106 to generate the second information. Here, the second information may be information necessary for providing a service to the user or space 20. When the content of the service to be provided in the first request is included, the second information corresponding to the content of the service may be provided. For example, an example of the second information when providing a service using a communication environment is an IP address. Or, an example of the second information when providing a service for controlling a device is the device identification information. An example of the second information when providing a service for controlling a device using a communication environment may be a combination of an IP address and the device identification information.

[0036] The input / output unit 109 acquires information (hereinafter referred to as first request information) in which the first request content is described from the second information processing device 200 connected to the first information processing device 100 via a network. Further, the input / output unit 109 outputs the second information generated by the second information generation unit 108 to the second information processing device 200.

[0037] Note that the determination unit 104, the first information generation unit 106, and the second information generation unit 108 described above are realized by, for example, a processor and a memory. When an instruction or software program stored in the memory is executed, the processor functions as the determination unit 104, the first information generation unit 106, and the second information generation unit 108. Further, the determination unit 104, the first information generation unit 106, and the second information generation unit 108 may be realized by a dedicated electronic circuit.

[0038] Also, the first memory 103, the second memory 105, and the third memory 107 described above are realized by, for example, a semiconductor memory and / or a disk drive, etc. The input / output unit 109 is realized by, for example, a network interface controller (NIC), etc.

[0039] [Functional Configuration of Second Information Processing Apparatus 200] Next, the functional configuration of the second information processing apparatus 200 will be described with reference to FIG. 3.

[0040] As shown in FIG. 3, the second information processing apparatus 200 according to the present embodiment includes a fourth memory 201, a request generation unit 202, an input / output unit 203, a fifth memory 204, a service generation unit 205, and an output unit 206. Each functional block of the second information processing apparatus 200 will be described below.

[0041] The fourth memory 201 stores information for generating first request information.

[0042] The request generation unit 202 generates first request information. Specifically, the request generation unit 202 refers to the information stored in the fourth memory 201 and generates first request information in which the first request content is described.

[0043] The first request content indicates requirements that a user or space for which a predetermined service is provided should satisfy. In the present embodiment, the first request content indicates that the requirement is the gathering time of a house, but it is not limited to this.

[0044] The input / output unit 203 outputs the first request information generated by the request generation unit 202 to the first information processing apparatus 100. Further, the input / output unit 203 acquires second information from the first information processing apparatus 100.

[0045] The fifth memory 204 stores information for generating service information. For example, the fifth memory 204 stores a correspondence table in which service contents are associated with a plurality of different request contents.

[0046] The service generation unit 205 generates first service information using the second information. The first service information is information for providing a service to a user in the space 20 via the device group 400.

[0047] In the present embodiment, the first service information may be, for example, information for notifying a member of a family living in another house that the members of the family in the house are having a party. Also, for example, the first service information may be information for transmitting conversations and / or videos of the family having a party in the house to a member of the family living in another house.

[0048] Note that the service information can also be expressed as service content. The service content includes information on services such as music or advertisement information, and information on device control for providing the service.

[0049] The output unit 206 refers to the second information and outputs the service information generated by the service generation unit 205 to the device group 400. Note that the second information processing apparatus 200 may have a memory that records the relationship in which information corresponding to the second information and information necessary for providing the service are associated, and acquires the information necessary for providing the service by referring to the second information, and provides the service to the user or the space 20.

[0050] Note that the above-described request generation unit 202 and service generation unit 205 are realized by, for example, a processor and a memory. When instructions or software programs stored in the memory are executed, the processor functions as the request generation unit 202 and the service generation unit 205. Also, the request generation unit 202 and the service generation unit 205 may be realized by dedicated electronic circuits.

[0051] Also, the above-described fourth memory 201 and fifth memory 204 are realized by, for example, a semiconductor memory and / or a disk drive, etc. The input / output unit 203 and the output unit 206 are realized by, for example, a network interface controller (NIC), etc.

[0052] [Interaction within Service Provision System 10] Next, the interaction within the service provision system 10 will be described with reference to FIG. 4. FIG. 4 is a sequence diagram of the service provision system 10 according to Embodiment 1.

[0053] As shown in FIG. 4, the first information processing device 100 acquires first sensor data including a first sensor value from the sensor group 300 (S101). The first information processing device 100 determines whether the first condition is satisfied based on the first sensor data (S102). In other words, the acquisition of the first sensor data can also be expressed as information for triggering the determination of the first condition. If the first condition is satisfied, the first information processing device 100 generates first information (S103). For the determination of the first condition, the first sensor data that has become the information for triggering the determination of the first condition is used. That is, in addition to being used as the triggering information, the first sensor data can also be used for the determination of the first condition corresponding to the conditions for service provision. Also, for the determination of the first condition, the first sensor data that has become the information for triggering the determination of the first condition in the past may be used.

[0054] Here, if the first information processing apparatus 100 acquires first request information from the second information processing apparatus 200 (S111), the first information processing apparatus 100 determines whether there is a user or space that satisfies the first request content (S112). Here, if it is determined that there is a user or space that satisfies the first request content, the first information processing apparatus 100 generates second information (S113). Further, the first information processing apparatus 100 outputs the generated second information to the second information processing apparatus 200 (S114).

[0055] The second information processing apparatus 200 generates first service information based on the second information (S121). The first service information is information for providing a first service to a user in the space 20 via the device group 400. Then, the second information processing apparatus 200 outputs the first service information to the device group 400 (S122).

[0056] Note that the sequence diagram shown in FIG. 4 is an example and is not limited thereto. For example, in FIG. 4, the order of processing may be changed.

[0057] [Processing of the First Information Processing Apparatus 100] Here, the details of the processing of the first information processing apparatus 100 (that is, the information providing method) will be described with reference to FIG. 5. FIG. 5 is a flowchart showing the processing of the first information processing apparatus 100 according to the first embodiment.

[0058] As shown in FIG. 5, the sensor data acquisition unit 101 acquires first sensor data including a first sensor value from the sensor group 300 arranged in the space 20 (S101). The determination unit 104 determines whether the first condition is satisfied based on the first sensor data (S102). The details of this determination process will be described later with reference to the drawings.

[0059] Here, when the first condition is satisfied (Yes in S102), the first information generation unit 106 generates first information (S103). On the other hand, when the first condition is not satisfied (No in S102), the first information generation unit 106 skips the generation process of the first information, that is, the first information generation unit 106 does not generate the first information.

[0060] After that, the input / output unit 109 acquires first request information describing the first request content from the second information processing apparatus 200 (S111). The second information generation unit 108 determines whether there is a user or space that matches the first request content (S112). That is, the second information generation unit 108 determines whether the first request content includes the content of the first information.

[0061] Here, when there is a user or space that matches the first request content (Yes in S112), the second information generation unit 108 generates second information using the generated first information (S113). Then, the input / output unit 203 outputs the generated second information to the second information processing apparatus 200 (S114). On the other hand, when there is no user or space that matches the first request content (No in S112), the second information generation unit 108 skips the generation process and output process of the second information. That is, the second information generation unit 108 does not generate and output the second information.

[0062] [Determination Process of First Condition] In the present embodiment, the first condition includes the following (I) and (ii). (I) A threshold time or more has elapsed since the start time of the user's cooking. (ii) The loudness of the voice in the dining space is equal to or greater than the threshold loudness.

[0063] If the above (I) and (ii) are satisfied, it is presumed that the residents in the house are in a convivial situation.

[0064] Here, the details of such determination processing of the first condition (S102 in FIG. 5) will be described with reference to FIG. 6. FIG. 6 is a flowchart showing an example of the determination processing of the first condition in Embodiment 1.

[0065] First, the determination unit 104 determines whether a threshold time or more has elapsed since the start time of the user's cooking (S1021). That is, the determination unit 104 determines whether the above (I) is satisfied.

[0066] The threshold time is the time for determining that cooking has ended and a meal has started. As the threshold time, a time registered in advance by the user may be used, or a time obtained by analyzing past cooking and meal times may be used.

[0067] The time when the user starts cooking is detected by a first sensor arranged in the kitchen space. As the first sensor, for example, a human presence sensor that detects the presence of a person in the kitchen space, an image sensor that captures images inside the kitchen space, a sensor that detects the operation of an electronic device arranged in the kitchen space, an opening / closing sensor that detects the opening and closing of the door of a refrigerator arranged in the kitchen space, or any combination thereof can be used.

[0068] FIG. 7 shows an example of sensing information regarding the operation of an electronic device in Embodiment 1. In FIG. 7, the horizontal axis represents time, and the vertical axis represents days. The double arrows represent the time when the electronic device is operating. Conversely, the period without arrows represents the time when the electronic device is not operating.

[0069] The electronic device is included in the device group 400 and is arranged in the kitchen space. Examples of the electronic device include lighting devices or cooking devices (such as IH heaters, gas stoves, microwave ovens, rice cookers, or coffee makers, etc.).

[0070] For example, the start time of the operation time (double arrows) is used as the cooking start time. Note that only the start time of the operation time included in a predetermined time zone (such as 16:00 to 19:00, etc.) may be used as the cooking start time.

[0071] FIG. 8 shows an example of sensing information regarding the opening of the refrigerator door in Embodiment 1. FIG. 8 shows an example of the time when the refrigerator door was opened (hereinafter referred to as the opening time) on a certain day.

[0072] The opening time of the refrigerator door in FIG. 8 can be obtained by, for example, an opening / closing sensor of the door or an image sensor that captures an image of the refrigerator. Such an opening time can be used as the start time of cooking.

[0073] FIG. 9 shows an example of sensing information regarding the presence of a person in Embodiment 1. In FIG. 9, the horizontal axis represents time, and the vertical axis represents days. The double arrows represent the time during which a person was detected by the presence sensor (hereinafter referred to as the detection time). Conversely, the period without an arrow represents the time during which a person was not detected by the presence sensor. The presence sensor is included in the sensor group 300 and is arranged in the kitchen space.

[0074] Using such detection time, the start time of cooking can be obtained in the same manner as the operating time of the electronic device.

[0075] Here, returning to the description of the flowchart in FIG. 6, when the threshold time or more has elapsed since the start time of cooking by the user (Yes in S1021), the determination unit 104 determines whether the loudness of the voice in the dining space is equal to or greater than the threshold loudness (S1022). That is, the determination unit 104 determines whether the above (ii) is satisfied.

[0076] The information on the loudness of the voice in the dining space is acquired by a second sensor arranged in the dining space. As the second sensor, for example, a microphone can be used. The information based on the information acquired by the second sensor is also referred to as voice information.

[0077] As the loudness of the voice in the dining space, the loudness obtained by acquiring the output information of the device that outputs the voice and subtracting the output information from the information on the loudness of the voice acquired by the second sensor may be used. Thereby, the voice information can be made closer to the information on the voice uttered by the user.

[0078] The threshold magnitude is the magnitude of the sound for determining that the voices emitted by people are getting louder due to the commotion. As the threshold magnitude, the magnitude pre-registered by the user may be used, or the magnitude of the sound detected during past commotions may be used.

[0079] When the magnitude of the sound in the dining space is equal to or greater than the threshold magnitude (Yes in S1022), the determination unit 104 determines that the first condition is satisfied (S1026). On the other hand, when the time elapsed from the start time of the user's cooking is less than the threshold time (No in S1021), or when the magnitude of the sound in the dining space is less than the threshold magnitude (No in S1022), the determination unit 104 determines that the first condition is not satisfied (S1027).

[0080] Note that, as information on the magnitude of the sound, time-series information on the magnitude of the sound may be used. A specific example of the time-series information on the magnitude of the sound is information on the magnitude of the sound for each time within a predetermined period. For example, the sound of the commotion is composed of a combination of conversations (first sound) having a magnitude equal to or greater than the first threshold magnitude and less than or equal to the second threshold magnitude, laughter (second sound) having a magnitude greater than the second threshold magnitude, and silence (third sound) having a magnitude less than the first threshold magnitude. When the ratio of the time corresponding to the conversation, laughter, and silence corresponds to a predetermined ratio, the determination unit 104 may determine that the first condition is satisfied (S1026). An example of the predetermined ratio is that the conversation is 90%, the laughter is 1%, and the silence is 9%. Also, when the ratio of the conversation is included in a predetermined range, the determination unit 104 may determine that the first condition is satisfied (S1026). An example of the predetermined range is 80% or more and 95% or less.

[0081] Also, when a sound greater than the second threshold continues for a predetermined period or more, the determination unit 104 may determine that a sound other than the user's laughter is sounding and determine that the first condition is not satisfied (S1027).

[0082] Note that the order of the plurality of steps in FIG. 6 is not limited to this. For example, step S1021 and step S1022 may be performed in reverse order or simultaneously.

[0083] [Service information] Based on the determination result of such a first condition, similar to Embodiment 1, generation of first information (S103), determination of a first request (S112), generation of second information (S113), etc. are performed. Then, the second information processing apparatus 200 generates and outputs first service information for providing a first service to a user in the space 20 via the device group 400 based on the second information (S121, S122).

[0084] At this time, in the present embodiment, the second information processing apparatus 200 may output the user's past video information or image information as the first service information to the display panel. Also, for example, when a plurality of first information processing apparatuses 100 associated in advance satisfy the first condition, the second information processing apparatus 200 may output, as the first service information, a control signal for controlling the electronic devices so that the plurality of first information processing apparatuses 100 provide a telephone service. The telephone service includes a voice-only telephone, a video and voice telephone. Note that, before the telephone service, the second information processing apparatus 200 may propose the telephone service to the plurality of first information processing apparatuses 100 via a display panel or a voice output device, etc., and output a control signal only when the proposal is accepted.

[0085] [Effects, etc.] As described above, the information providing method according to the present embodiment is an information providing method using a first information processing apparatus 100 including a processor and a memory. A first sensor is disposed in the kitchen space of a house, and a second sensor is disposed in the dining space of the house. The processor detects the time when cooking by a user starts in the kitchen space by the first sensor, and acquires the volume of sound in the dining space by the second sensor. When (i) a threshold time or more has elapsed since the time when the user starts cooking, and (ii) the volume of sound in the dining space is equal to or greater than a first threshold volume, the processor generates first information indicating that it is the gathering time of the house, acquires information in which a first request content is described from a second information processing apparatus 200 connected to the first information processing apparatus 100 via a network, and when the content of the first information is included in the first request content, the processor can output second information including information for specifying the user or the house to the second information processing apparatus 200 using the generated first information.

[0086] According to this, it is possible to determine the situation in which the user is gathering in the house by using the first sensor and the second sensor respectively disposed in the kitchen space and the dining space. Therefore, it is possible to output information for specifying the user or the house in such a situation to a service provider or the like. As a result, the service provider or the like can provide a service suitable for the situation of the user or the house. That is, effective utilization of sensor data for service provision is realized.

[0087] Also, for example, the sound in the dining space may include information on the volume of time-series sound in a predetermined period.

[0088] According to this, based on the information on the volume of time-series sound, it is possible to more accurately determine the situation in which the user is gathering in the house.

[0089] For example, the information on the magnitude of time-series audio is a combination of a first audio having a magnitude equal to or greater than a first threshold magnitude and equal to or less than a second threshold magnitude, a second audio having a magnitude greater than the second threshold, and a third audio having a magnitude less than the first threshold magnitude. In (ii), when the ratio of the time of the first audio in a predetermined period is within a predetermined range, the processor may generate first information indicating that it is a gathering time in the house.

[0090] According to this, by using appropriate first and second threshold magnitudes, it is possible to obtain, as the first audio, the audio corresponding to conversations during gatherings. By using the ratio of the length of time during which such first audio is obtained in (ii) of the first condition, it is possible to more accurately determine the situation where the user is in a gathering in the house.

[0091] For example, the information on the magnitude of time-series audio is a combination of a first audio having a magnitude equal to or greater than a first threshold magnitude and equal to or less than a second threshold magnitude, a second audio having a magnitude greater than the second threshold, and a third audio having a magnitude less than the first threshold magnitude. In (ii), when the ratio of the time of the first audio, the ratio of the time of the second audio, and the ratio of the time of the first audio in a predetermined period are at predetermined ratios, the processor may generate first information indicating that it is a gathering time in the house.

[0092] According to this, by using appropriate first and second threshold magnitudes, it is possible to obtain, as the first, second, and third audios, the audio corresponding to conversations, laughter, and silence during gatherings, respectively. By using the ratio of the length of time during which each of such first, second, and third audios is obtained in (ii) of the first condition, it is possible to more accurately determine the situation where the user is in a gathering in the house.

[0093] (Modification Example 1) Next, a modification example 1 of the above-described Embodiment 1 will be described. The main difference from Embodiment 1 is that a service is provided via the first information processing apparatus 100. This modification example will be described with reference to the drawings centering on the differences from Embodiment 1.

[0094] Note that since the configuration of the service providing system 10 according to this modification example is the same as that of Embodiment 1, illustration and description thereof are omitted.

[0095] [Interaction within Service Providing System 10] FIG. 10 is a sequence diagram of the service providing system 10 according to Modification Example 1. As shown in FIG. 10, the second information processing apparatus 200 according to this modification example outputs the first service information to the first information processing apparatus 100 after generating the first service information (S121). The first information processing apparatus 100 transfers the first service information acquired from the first information processing apparatus 100 to the device group 400 (S122B). Note that the first information processing apparatus 100 may transmit performance information on the provision of the first service information to the second information processing apparatus 200. An example of the performance information is the number of times the first service information is provided, and attribute information regarding the user or the space 20. The attribute information is information that cannot identify the user or the space 20. An example of the attribute information is geographical information of the user and demographic information. Note that the performance information may be limited to information for which the user has given prior permission for transmission.

[0096] [Effects, etc.] As described above, according to the service providing system 10 according to this modification example, the second information processing apparatus 200 does not need to directly communicate with the device group 400 arranged in the space 20, so disclosure of information regarding the space 20 to the second information processing apparatus 200 can be restricted. Therefore, privacy protection of the user in the space 20 can be achieved.

[0097] (Modification Example 2) Next, a modification example 2 of the above-described Embodiment 1 will be described. The main difference between this modification example and the above-described Embodiment 1 is that the transmission of the first request information from the second information processing apparatus 200 to the first information processing apparatus 100 is performed before, rather than after, the generation of the first information (S103). This modification example will be described with reference to the drawings, centering on the differences from the above-described Embodiment 1.

[0098] Note that since the configuration of the service providing system 10 according to this modification example is the same as that of the above-described Embodiment 1, illustration and description thereof are omitted.

[0099] [Interaction within Service Providing System 10] FIG. 11 is a sequence diagram of the service providing system 10 according to Modification Example 2. As shown in FIG. 11, the first information processing apparatus 100 according to this modification example acquires first request information (S111) before acquiring first sensor data (S101).

[0100] Note that the acquisition of the first request information (S111) only needs to be before the determination of the first request (S112), and is not limited to being before the acquisition of the first sensor data (S101). Also, since the first request has been transmitted in advance, the second information processing apparatus 200 may have a desire to acquire information about at what timing it is determined that the first condition is satisfied (S102). When the determination of the first condition (S102) is executed every time the first sensor data is continuously received in time series, information about the timing at which the situation changes so that the first condition is satisfied can be acquired by acquiring information about the first sensor data that does not satisfy the first condition at the timing immediately before the first sensor data that satisfies the first condition is received. For example, the second information may include information about the first sensor data that is immediately before satisfying the first condition and does not satisfy the first condition. Further, the first information processing apparatus 100 may propose a change to the first condition to the second information processing apparatus 200 according to the result of analyzing the statistical information of the information about the first sensor data that is immediately before satisfying the first condition and does not satisfy the first condition.

[0101] [Effects, etc.] As described above, according to the service providing system 10 according to this modification example, the second information can be output regardless of the timing of acquiring the first request information, and it is possible to realize the provision of more timely second information.

[0102] (Modification Example 3) Next, a third modification example of the first embodiment will be described. The main difference between this modification example and the first embodiment is that the second information includes operation information of devices related to the service in addition to information for identifying the user or the space. This modification example will be described mainly with reference to the drawings, focusing on the differences from the first embodiment.

[0103] Note that since the configuration of the service providing system 10 according to this modification example is the same as that of the first embodiment, illustration and description thereof are omitted. Also, the interactions within the service providing systems 10 and 10A and the processing of the first information processing apparatus 100 are the same as those in FIGS. 6 to 9, so illustration and description are simplified or omitted.

[0104] [Generation Process of Second Information] Details of the generation process of the second information (S113 in FIG. 5) in this modification example will be described with reference to FIG. 12. FIG. 12 is a flowchart showing an example of the generation process (S113) of the second information in the third modification example. Note that in this modification example, the first request information includes information for identifying the service provided by the second information processing apparatus 200.

[0105] The first information processing apparatus 100 selects a device related to the service specified by the first request information from among the device group 400 arranged in the space 20 where the first information is generated (S1131). For example, the first information processing apparatus 100 selects a device from the device group 400 based on the influence of the service on the user's five senses (vision, hearing, smell, touch, taste) and the influence of the device on the user's five senses.

[0106] FIG. 13A shows an example of relationship information between a service and the five senses. FIG. 13B shows an example of relationship information between a device and the five senses. In FIGS. 13A and 13B, a check mark indicates having an impact, and a dash mark indicates having no impact.

[0107] Referring to FIG. 13A, for example, it can be seen that Service 1 affects vision and hearing and does not affect smell and touch (back, waist, and eyes). Also, referring to FIG. 13B, for example, it can be seen that a TV affects vision and hearing and does not affect smell and touch (back, waist, and eyes).

[0108] Here, for example, when Service 1 is specified by the first request information, the first information processing device 100 selects a TV and a speaker related to vision or hearing that Service 1 affects in FIG. 13A from among the plurality of devices shown in FIG. 13B.

[0109] Next, the first information processing device 100 acquires operation information of the selected device (S1132). The operation information is information indicating the operation status of the device, for example, information indicating whether the device is operating or not. The operation information may be acquired directly from the device or via a sensor, for example.

[0110] Then, the first information processing device 100 generates second information including the operation information (S1133).

[0111] [Effects, etc.] As described above, according to this modification example, the second information can include the operation information of the device. Therefore, the second information processing device 200 can, for example, refer to the operation information of the device, start a non-operating device to provide a service, and avoid service competition in an operating device. Also, when there are many operating devices, for example, the second information processing device 200 can avoid confusing the user's senses by skipping service provision.

[0112] Note that, in this modified example, the operation information of the selected device was included in the second information, but it is not limited to this. For example, the operation information of all devices may be included in the second information. Also, the operation information may be output separately from the second information.

[0113] Also, the second information may include only the operation information of the devices for which the user has been pre - permitted to provide. Also, when there are devices for which the user has refused to provide, the second information may include information indicating that they are the devices for which the user has refused to provide. For example, when the second information processing device 200 provides a service using a device for which the user has refused to provide, it may inquire of the user whether the service can be provided.

[0114] Also, instead of the operation information of the devices, the second information may include voice information used for determining the first condition. Also, in addition to the operation information of the devices, the second information may include voice information. Examples of the voice information included in the second information are the time - series change in the loudness of the voice of the second information, or information on the ratio of conversation, laughter, and silence in the voice. Also, the number of users having a conversation may be included as voice information. For example, the number of users may be obtained from the voice information using a known analysis method, or the number of users may be obtained based on the information from the sensor group 300. The second information processing device 200 can set in advance the situation of the space 20 corresponding to the voice information, and provide a service by referring to the information based on the voice. For example, the second information processing device 200 provides a service according to whether the user is in a calm gathering or a lively gathering. When the user is in a calm gathering, the ratio of silence is high or the ratio of laughter is low. Also, when the user is in a lively gathering, the ratio of laughter is high. For example, when the voice information shows a similar tendency, by providing the telephone service of a plurality of first information processing devices 100, a service considering the situation of each space 20 due to the conversation on the telephone becomes possible.

[0115] Also, when permission for proposing a telephone service is obtained among a plurality of first information processors 100 that are not associated in advance, even if the plurality of first information processors 100 are not associated in advance, when the voice information shows a similar tendency, the second information processor 200 may provide a telephone service. At this time, when a telephone service is provided among a plurality of first information processors 100 that are associated in advance, the information provided to the other party may be made less than the information provided to the other party when a telephone service is provided among a plurality of first information processors 100 that are not associated in advance. For example, a voice-based telephone service is provided. Or, even in the case of a telephone service including video, the video information in space 20 may be reduced. For example, in order to reduce the video information, the range where the video is displayed may be reduced, or background information other than people may be deleted.

[0116] (Modification Example 4) Next, Modification Example 4 of the above-described Embodiment 1 will be described. In this modification example, the main difference from Embodiment 1 above is that, in addition to the information for specifying the user or the space, the second information includes fitness information indicating the fitness of service provision. This modification example will be described mainly with reference to the drawings, centering on the points different from Embodiment 1 above.

[0117] Note that since the configuration of the service provision system 10 according to this modification example is the same as that of Embodiment 1 above, illustration and description thereof are omitted. Also, the interactions within the service provision systems 10 and 10A and the processing of the first information processor 100 are the same as those in FIGS. 6 to 9, so illustration and description are simplified or omitted.

[0118] [Generation Process of Second Information] Details of the generation process of the second information (S113 in FIG. 5) in this modification example will be described with reference to FIG. 14. FIG. 14 is a flowchart showing an example of the generation process (S113) of the second information in Modification Example 4. Note that in this modification example, it is assumed that the first request information includes information for specifying the service provided by the second information processor 200.

[0119] The first information processing apparatus 100 acquires the provision history of the service for the space 20 or the user (S1134). The service provision history is information in which the services provided to the space 20 or the user in the past and the date and time when the services were provided are associated with each other.

[0120] FIG. 15 shows an example of the service provision history in Modification 4. In FIG. 15, the horizontal axis represents time and the vertical axis represents days. The double arrows represent the time when the service is provided or will be provided to the space 20 or the user. For example, Service 1 was provided twice between 18:00 and 24:00 on June 2, 2018. Note that the service provision history may include a plurality of different services provided by a plurality of different second information processing apparatuses 200 (that is, a plurality of different service providers).

[0121] Subsequently, the first information processing apparatus 100 evaluates the appropriateness of providing the service specified by the first request information for the space 20 or the user based on the acquired service provision history (S1135). Specifically, the first information processing apparatus 100 evaluates the appropriateness of providing the service specified by the first request information based on, for example, the number of times the service has been provided within a predetermined period. Also, for example, the first information processing apparatus 100 may evaluate the appropriateness of providing the service specified by the first request information based on other services currently being provided.

[0122] A specific example of such an evaluation of the appropriateness of service provision will be described with reference to FIGS. 16A to 16C. FIG. 16A shows an example of service provision possibility information in Modification 4. The service provision possibility information may be stored in advance in, for example, the third memory 107, or may be acquired from an external server (not shown).

[0123] The service provision possibility information indicates the number of times the service can be provided per day and the situations where the service cannot be provided for each service. In FIG. 16A, for example, it is shown that for each of Service 1 and Service 3, there is no limit on the number of times the service can be provided per day, and Service 2 can be provided only once per day.

[0124] In the service provision history of FIG. 15, Service 1 and Service 2 have already been provided today (June 7, 2018). Therefore, if the service availability information in FIG. 16A is referred to, the suitability of providing Service 1 and Service 3 is highly evaluated, and the suitability of providing Service 2 is lowly evaluated.

[0125] Also, in FIG. 16A, it is shown that Service 1 and Service 2 cannot provide services in user situations A and B, respectively. As user situations A and B, for example, situations where the user's actions are slower than usual can be used. In this case, by prohibiting the provision of services with low urgency (such as music playback or fortune-telling information presentation), it is possible to realize the provision of services suitable for the user's situation. Also, as user situations A and B, for example, a situation where the user is relaxing at home may be used.

[0126] FIG. 16B shows an example of service simultaneous provision prohibition information in Modification 4. The service simultaneous provision prohibition information may be stored in advance in the third memory 107, for example, or may be acquired from an external server (not shown).

[0127] The service simultaneous provision prohibition information indicates combinations of services for which simultaneous provision is prohibited / permitted. The check mark represents prohibition, and the dash mark represents permission.

[0128] In FIG. 16B, for example, it is shown that Service 1 is permitted to be provided simultaneously with each of Service 2 and Service 3. That is, it is shown that Service 1 can be provided together with each of Service 2 and Service 3. Also, for example, it is shown that Service 2 is prohibited from being provided simultaneously with Service 3. That is, it is shown that Service 2 cannot be provided together with Service 3.

[0129] FIG. 16C shows an example of service change prohibition information in Modification 4. The service change prohibition information may be stored in advance in the third memory 107, for example, or may be acquired from an external server (not shown).

[0130] The service change prohibition information indicates the services that are prohibited / allowed to be newly provided in place of the provided services. The check mark represents the prohibition of changing from the service described in the left column to the service described in the upper row, and the dash mark represents the permission of changing from the service described in the left column to the service described in the upper row.

[0131] In FIG. 16C, for example, when service 1 is currently provided, the change from service 1 to service 2 is prohibited. On the other hand, when service 2 is currently provided, the change from service 2 to service 1 is permitted. Also, when service 2 is currently provided, the change from service 2 to service 3 is prohibited.

[0132] In the service provision history of FIG. 15, service 2 is being provided at the current time. Therefore, referring to the service co - provision prohibition information in FIG. 16B and the service change prohibition information in FIG. 16C, the suitability of providing service 1 is highly evaluated, and the suitability of providing service 3 is poorly evaluated.

[0133] The results of such evaluation are represented at two or more levels. For example, as evaluation results, two levels of "suitable" and "not suitable" can be used. Also for example, as evaluation results, scores from 0 to 10 or from 0 to 100 can be used.

[0134] Finally, the first information processing apparatus 100 generates second information including suitability evaluation information indicating the evaluation result (S1136).

[0135] [Effects, etc.] As described above, according to this modification example, the second information can include appropriate evaluation information. Therefore, the second information processing apparatus 200 can skip service provision, for example, when the appropriate evaluation is low, and can suppress the service from being provided at inappropriate timing. As a result, the service provision systems 10 and 10A can, for example, reduce excessive service provision or suppress interference between services.

[0136] Note that in this modification example, although the appropriate evaluation information is included in the second information, it is not limited to this. For example, in addition to or instead of the appropriate evaluation information, information on the service provision history may be included. Also, the service suitability information may be output separately from the second information.

[0137] (Modification Example 5) Next, Modification Example 5 of the above-described Embodiment 1 will be described. In this modification example, when a first request having the same request content is received in advance from a plurality of second information processing apparatuses 200 (see the above Modification Example 2), the main difference from Embodiment 1 above is that the second information is output to the second information processing apparatus 200 selected based on the priority. This modification example will be described centering on the differences from Embodiment 1 above with reference to the drawings.

[0138] Note that the configuration of the service provision system 10 according to this modification example is the same as that of Embodiment 1 above, and thus the illustration and description thereof are omitted. Also, the interaction within the service provision systems 10 and 10A and the processing of the first information processing apparatus 100 are the same as those in FIGS. 6 to 9, and thus the illustration and description are simplified or omitted.

[0139] [Output Processing of Second Information] Details of the output processing of the second information (S114 in FIG. 5) in this modification example will be described with reference to FIG. 17. FIG. 17 is a flowchart showing an example of the output processing (S114) of the second information in Modification Example 5.

[0140] The first information processing apparatus 100 sets priorities for a plurality of second information processing apparatuses 200 (S1141). That is, the first information processing apparatus 100 sets priorities for a plurality of second information processing apparatuses 200 corresponding to a plurality of first requests having the same request content. For example, the first request information may include a priority, and in this case, the priority is set according to the priority included in the first request information. Also, the priority may be set according to the situation of the space 20 or the user obtained from the sensor group 300 and the device group 400. Further, the priorities of the plurality of second information processing apparatuses 200 may be set based on the bid price of the service provider for the bid of the second information provision.

[0141] Subsequently, the first information processing apparatus 100 selects one or more second information processing apparatuses 200 based on the set priorities (S1142). For example, the first information processing apparatus 100 selects the second information processing apparatus 200 having the highest priority from among the plurality of second information processing apparatuses 200 corresponding to a plurality of first requests having the same request content. Note that the number of the selected second information processing apparatuses 200 is not limited to one.

[0142] Then, the first information processing apparatus 100 outputs second information to the selected second information processing apparatus 200 (S1143). After that, the first information processing apparatus 100 determines whether or not a service has been provided by the selected second information processing apparatus 200 within a predetermined time (S1144). That is, it is determined whether or not the second information processing apparatus 200 has provided a service within a predetermined time after the second information is output. As the predetermined time, a time determined in advance empirically or experimentally can be used. For example, a common time can be used for a plurality of services. Also, as the predetermined time, individual times may be used for a plurality of services.

[0143] If the service is provided within the specified time (Yes in S1144), the process ends. On the other hand, if the service is not provided within the specified time (No in S1144), the process proceeds to step S1141. At this time, in step S1141, the priorities of the plurality of second information processing devices 200 are updated, and the priority of the second information processing device 200 that did not provide the service is lowered. The first information processing device 100 selects one or more second information processing devices 200 based on the updated priorities (S1142). Here, only when the priority is set to the highest level, it may be possible to provide the service to the user or space 20. For example, if the second information has been transmitted to each of the second information processing devices 200 whose priority was set to the highest level before the update and the second information processing device 200 whose priority was set to the highest level after the update, and if an attempt is made to provide the service from the second information processing device 200 whose priority was set to the highest level before the update after a predetermined time, there may be a possibility of service duplication. Therefore, only the second information processing device 200 whose priority is set to the highest level may be set to be able to use the second information. For example, the second information can be used only during service execution and is encrypted and changed every time it is updated, and can be realized by providing the encryption key corresponding to the second information processing device 200 whose priority is set to the highest level.

[0144] [Effects, etc.] As described above, according to this modification example, the first information processing device 100 can select the second information processing device 200 based on the priority. Therefore, the service providing systems 10 and 10A can select the second information processing device 200 suitable for providing the service from among the plurality of second information processing devices 200 corresponding to the plurality of first requests having the same request content.

[0145] (Other modification examples) In the above-described Embodiment 1, the information on the operation of the electronic devices related to cooking was used, but it is not limited to this. For example, the information on the operation of the electronic devices in the bathroom may be used.

[0146] Other examples of the first condition include the following (iii) and (iv). (iii) A threshold time or more has elapsed since the start time of the user's bath. (iv) The loudness of the voice in the living space or the bedroom space is equal to or greater than the threshold loudness.

[0147] The start time of the bath is acquired by the sensor group 300 disposed in the bathroom or the dressing room.

[0148] That is, the first condition only needs to satisfy that the operating status of the device associated with the predetermined action of the user and the loudness of the voice in the predetermined space are equal to or greater than the threshold loudness.

[0149] (Service type) Next, the service type of the service providing system according to the first embodiment will be described.

[0150] [Overall image of the service to be provided] FIG. 18A shows an overall image of the service providing system.

[0151] The group 1000 is, for example, a company, an organization, a family, etc., regardless of its scale. In the group 1000, there are device A, device B, and home gateway 1020 included in the plurality of devices 1010. For example, the plurality of devices 1010 are the devices included in the device group 400 in the first embodiment. Further, the home gateway 1020 is the gateway 500 in the first embodiment. Among the plurality of devices 1010, there are devices connectable to the Internet (for example, smartphones, PCs, TVs, etc.), and there are also devices that are not connectable to the Internet by themselves (for example, lighting, washing machines, etc.). Even a device that is not connectable to the Internet by itself may be a device that can be connected to the Internet via the home gateway 1020. Also, in the group 1000, there is a user 990A who uses the plurality of devices 1010.

[0152] Data center operating company 1100 has a cloud server 1110. The cloud server 1110 is a virtualized server that communicates with various devices via the Internet. For example, the cloud server 1110 is the first information processing device 100 in the above-described Embodiment 1. The cloud server 1110 mainly manages huge data (big data) and the like that are difficult to handle with ordinary database management tools and the like. The data center operating company 1100 performs data management, management of the cloud server 1110, operation of the data center that performs these, and the like. Details of the services provided by the data center operating company 1100 will be described later. Here, the data center operating company 1100 is not limited to a company that only performs data management and operation of the cloud server 1110. For example, when a device manufacturer that develops and manufactures one of a plurality of devices 1010 also performs data management and management of the cloud server 1110, the device manufacturer corresponds to the data center operating company 1100 (FIG. 18B). Further, the data center operating company 1100 is not limited to one company. For example, when a device manufacturer and another management company jointly or share the operation of data management and the cloud server 1110, both or either one of them shall be deemed to correspond to the data center operating company 1100 (FIG. 18C).

[0153] Service provider 1200 owns a server 1210. The server 1210 mentioned here includes, for example, the memory in a personal computer regardless of its scale. Also, there may be a case where the service provider does not own the server 1210. For example, the server 1210 is the second information processing device 200 in the above-described Embodiment 1.

[0154] Note that the home gateway 1020 is not essential in the above service. For example, when the cloud server 1110 performs all data management, the home gateway 1020 becomes unnecessary. Also, there may be a case where there are no devices that cannot be connected to the Internet by themselves, such as when all devices in the home are connected to the Internet.

[0155] Next, the information flow in the above service will be described.

[0156] First, the device A or device B of the group 1000 transmits the information obtained by each device to the cloud server 1110 of the data center operation company 1100. The cloud server 1110 aggregates the information of the device A or device B ((a) in FIG. 18A). The information aggregated here is information indicating, for example, the operation status, operation date and time, operation mode, position, etc. of a plurality of devices 1010. For example, it is the viewing history of a TV, the recording reservation information of a recorder, the operation date and time of a washing machine and the amount of laundry, the opening and closing date and time and the number of opening and closing times of a refrigerator, the amount of food in the refrigerator, etc., but it is not limited to these and refers to all information that can be obtained from any device. The information may be provided directly from a plurality of devices 1010 themselves to the cloud server 1110 via the Internet. Also, the information may be aggregated from a plurality of devices 1010 to the home gateway 1020 once and then provided from the home gateway 1020 to the cloud server 1110.

[0157] Next, the cloud server 1110 of the data center operation company 1100 provides the integrated information to the service provider 1200 in a certain unit. Here, the certain unit may be a unit that the data center operation company can organize the integrated information and provide it to the service provider 1200, or a unit requested by the service provider 1200. Although it is described as a certain unit, it does not have to be fixed, and the amount of information provided may change according to the situation. The information is stored in the server 1210 held by the service provider 1200 as needed ((b) in FIG. 18A). Then, the service provider 1200 organizes the information into information suitable for the service provided to the user and provides it to the user. The user to whom the service is provided may be the user 990A who uses a plurality of devices 1010, or the external user 990B. The method of providing the service to the user may be directly provided from the service provider to the user, for example ((e), (f) in FIG. 18A). Also, the method of providing the service to the user may be provided to the user via the cloud server 1110 of the data center operation company 1100 again, for example ((c), (d) in FIG. 18A). Further, the cloud server 1110 of the data center operation company 1100 may organize the information into information suitable for the service provided to the user and provide it to the service provider 1200.

[0158] Note that the user 990A and the user 990B may be different or the same.

[0159] The technology described in the above aspect can be realized, for example, in the following types of cloud services. However, the types in which the technology described in the above aspect is realized are not limited to this.

[0160] [Service type 1: In-house data center type] Figure 19 shows service type 1 (in-house data center type). This type is where service provider 1200 obtains information from group 1000 and provides services to users. In this type, service provider 1200 has the function of a data center operating company. That is, the service provider owns a cloud server 1110 for managing big data. Therefore, there is no data center operating company.

[0161] In this type, service provider 1200 operates and manages data center 903 (cloud server 1110). Also, service provider 1200 manages OS 902 and application 901. Service provider 1200 provides service 904 using OS 902 and application 901 managed by service provider 1200.

[0162] [Service Type 2: IaaS Usage Type] Figure 20 shows service type 2 (IaaS usage type). Here, IaaS is short for Infrastructure as a Service, which is a cloud service provision model that provides the very foundation for building and operating a computer system as a service via the Internet.

[0163] In this type, data center operating company 1100 operates and manages data center 903 (cloud server 1110). Also, service provider 1200 manages OS 902 and application 901. Service provider 1200 provides service 904 using OS 902 and application 901 managed by service provider 1200.

[0164] [Service Type 3: PaaS Usage Type] Figure 21 shows service type 3 (PaaS usage type). Here, PaaS is an abbreviation for Platform as a Service, which is a cloud service provision model that provides, as an Internet-based service, a platform that serves as the foundation for building and operating software.

[0165] In this type, the data center operating company 1100 manages the OS 902 and operates and manages the data center 903 (cloud server 1110). Also, the service provider 1200 manages the application 901. The service provider 1200 provides the service 904 using the OS 902 managed by the data center operating company and the application 901 managed by the service provider 1200.

[0166] [Service Type 4: SaaS Usage Type] Figure 22 shows service type 4 (SaaS usage type). Here, SaaS is an abbreviation for Software as a Service. For example, it is a cloud service provision model that enables a company or individual (user) who does not own a data center (cloud server) to use, via a network such as the Internet, an application provided by a platform provider that owns a data center (cloud server).

[0167] In this type, the data center operating company 1100 manages the application 901, manages the OS 902, and operates and manages the data center 903 (cloud server 1110). Also, the service provider 1200 provides the service 904 using the OS 902 and the application 901 managed by the data center operating company 1100.

[0168] In any of the above types, it is assumed that the service provider 1200 performs the service provision act. Also, for example, the service provider or the data center operating company may develop on its own an OS, an application, or a database of big data, etc., or may outsource it to a third party.

[0169] (Other embodiments) As described above, the service providing system according to one or more aspects of the present disclosure has been described based on the embodiments. However, the present disclosure is not limited to these embodiments. Without departing from the spirit of the present disclosure, various modifications conceived by those skilled in the art to these embodiments, or forms constructed by combining components in different embodiments, may also be included within the scope of one or more aspects of the present disclosure.

[0170] For example, in the above-described Embodiment 1, the first information processing apparatus 100 that processes sensor data and the second information processing apparatus 200 that generates service information are separate apparatuses. However, the first information processing apparatus 100 and the second information processing apparatus 200 may be realized by one information processing apparatus. In this case, since the interaction between the first information processing apparatus 100 and the second information processing apparatus 200 becomes unnecessary, when the first condition is satisfied, the processing from the generation of the first information to the output of the second information may be skipped.

Industrial applicability

[0171] The present disclosure can be used as an information processing apparatus that provides information for providing services to users.

Explanation of reference numerals

[0172] 10 Service providing system 20 Space 100 First information processing apparatus 101 Sensor data acquisition unit 103 First memory 104 Determination unit 105 Second memory 106 First information generation unit 107 Third memory 108 Second information generation unit 109, 203 Input / output unit 200 Second information processing apparatus 201 Fourth memory 202 Request generation unit 204 Fifth Memory 205 Service Generation Unit 206 Output Unit 300 Sensor Group 400 Device Group 500 Gateway

Claims

1. An information providing method using a first information processing apparatus including a processor and a memory, wherein a first sensor is disposed within a predetermined space of a house, a second sensor is disposed within the predetermined space of the house, the processor detects, by the first sensor, a time when a user starts cooking in the predetermined space, acquires, by the second sensor, information on the loudness of sound in the predetermined space, generates first information indicating that it is a gathering time of the house when (i) a threshold time or more has elapsed since the time when the user starts cooking and (ii) the loudness of sound in the predetermined space is equal to or greater than a first threshold loudness, and outputs the first information, the information providing method.

2. The information on the loudness of sound in the predetermined space includes information on the loudness of time-series sound in a predetermined period, The information providing method according to claim 1.

3. The information on the loudness of the time-series sound is a combination of a first sound having a loudness equal to or greater than the first threshold loudness and equal to or less than a second threshold loudness, a second sound having a loudness greater than the second threshold loudness, and a third sound having a loudness less than the first threshold loudness, In the (ii), the processor generates first information indicating that it is a gathering time of the house when a ratio of a time of the first sound in the predetermined period is within a predetermined range, The information providing method according to claim 2.

4. The information on the loudness of the time-series sound is a combination of a first sound having a loudness equal to or greater than the first threshold loudness and equal to or less than a second threshold loudness, a second sound having a loudness greater than the second threshold loudness, and a third sound having a loudness less than the first threshold loudness, In the (ii), the processor generates first information indicating that it is a gathering time of the house when ratios of a time of the first sound, a time of the second sound, and a time of the third sound in the predetermined period are at predetermined ratios, The information providing method according to claim 2.

5. acquires information in which a first request content is described from a second information processing apparatus connected to the first information processing apparatus via a network, When the content of the first information is included in the content of the first claim, the second information processing device outputs second information including information for identifying the user or the house using the generated first information. The information providing method according to claim 1.

6. A plurality of electronic devices are arranged in the house. The second information includes the operating status of the plurality of electronic devices for use by the second information processing device when providing a service to the first information processing device. The information providing method according to claim 5.

7. The second information includes information based on sound in the predetermined space for use by the second information processing device when providing a service to the first information processing device. The information providing method according to claim 5.

Citation Information

Patent Citations

  • System and method for providing contents and computer program for the same

    JP2002366166A

  • Determination device, determination method, and determination program

    JP2018032272A

  • Activity capability monitoring

    US20180254096A1

  • Information processing device and information processing method

    WO2018100829A1