Reporting system, reporting method, control device, and program

Abstract

A reporting system (1) comprises: an acquisition unit that acquires audio content to be reported and a sensing result obtained by a sensor (24) that senses a space in which reporting devices are installed; a determination unit that uses the sensing result to determine whether or not the space accommodates a first user in a state of being able to hear reporting of the audio content by reporting devices (10, 20); and a control unit that performs first control for controlling reporting of the audio content by the reporting devices according to whether or not the space accommodates the first user. In the first control, if it is determined that the space accommodates the first user, the control unit causes the reporting devices to report the audio content, or if it is determined that the space does not accommodate the first user, the control unit does not cause the reporting devices to report the audio content.

Description

Notification system, notification method, control device, and program

[0001] The present disclosure relates to a notification system, a notification method, a control device, and a program.

[0002] Patent Document 1 discloses an electronic device that outputs voice guidance tailored to the preferences of the user.

[0003] JP 2011-43894 A

[0004] The present disclosure provides a notification system and the like that can effectively notify users of audio content.

[0005] A notification system according to one aspect of the present disclosure comprises an acquisition unit that acquires audio content to be notified and sensing results obtained by a sensor that senses a space in which a notification device is located, and a control unit that performs first control to control notification of the audio content by the notification device based on the sensing results, depending on whether a first user who is able to hear the notification of the audio content by the notification device is present in the space, and in the first control, the control unit causes the notification device to notify the audio content if the first user is present in the space, and does not cause the notification device to notify the audio content if the first user is not present in the space.

[0006] In addition, a notification method according to one aspect of the present disclosure acquires audio content to be notified and sensing results obtained by a sensor that senses a space in which a notification device is placed, and determines whether to notify the audio content based on the sensing results, depending on whether a first user who is able to hear the notification of the audio content by the notification device is present in the space, and notifies the audio content based on the result of the determination, and in the determination, decides to notify the audio content if the first user is present in the space, and decides not to notify the audio content if the first user is not present in the space.

[0007] In addition, a control device according to one aspect of the present disclosure is a control device that is communicatively connected to a notification device, and includes: an acquisition unit that acquires audio content to be notified and sensing results obtained by a sensor that senses the space in which the notification device is located; and a control unit that performs first control that controls notification of the audio content by the notification device based on the sensing results, depending on whether a first user who is able to hear the notification of the audio content by the notification device is present in the space; and in the first control, the control unit causes the notification device to notify the audio content if the first user is present in the space, and does not cause the notification device to notify the audio content if the first user is not present in the space.

[0008] These general or specific aspects may be realized by a device, an integrated circuit, a computer program, or a non-transitory recording medium such as a computer-readable CD-ROM, or may be realized by any combination of a device, a method, a system, an integrated circuit, a computer program, and a non-transitory recording medium.

[0009] The notification system and the like in the present disclosure can effectively notify users of audio content.

[0010] Fig. 1 is a diagram for explaining an overview of a notification system according to an embodiment. Fig. 2 is a diagram showing an example of the configuration of a notification system according to an embodiment. Fig. 3 is a sequence diagram showing an example of operation in the notification system. Fig. 4 is a flowchart showing an example of notification control in a server.

[0011] (Findings forming the basis of the present disclosure) In the prior art, in an electronic device that outputs voice guidance when a display screen is displayed on a display means, a voice output control method controls the timing of the voice output depending on the number of times the display screen is displayed and whether or not a user operates the device. In this way, the electronic device (notification device) notifies the user by outputting (uttering) voice guidance. However, it is difficult for the user to recognize the voice notification when there is a loud noise or other sound occurring in the user's environment or when the voice is uttered while the user is performing other tasks such as viewing content.

[0012] After extensive research, the inventors have discovered a notification system that can effectively notify a user by speech at a timing that allows the user to easily recognize the speech notification.

[0013] A notification system according to a first aspect of the present disclosure comprises an acquisition unit that acquires audio content to be notified and sensing results obtained by a sensor that senses a space in which a notification device is located, and a control unit that performs first control to control notification of the audio content by the notification device based on the sensing results, depending on whether a first user who is able to hear the notification of the audio content by the notification device is present in the space, and in the first control, the control unit causes the notification device to notify the audio content if the first user is present in the space, and does not cause the notification device to notify the audio content if the first user is not present in the space.

[0014] According to this, when a first user who is able to hear the notification of the audio content is in the space where the notification device is located, the audio content is notified to the first user, making it easier for the first user to recognize the notification of the audio content. On the other hand, when a first user who is able to hear the notification of the audio content is not in the space where the notification device is located, the audio content is not notified to the first user, making it possible to suppress notification of the audio content in situations where it is difficult to recognize the notification, thereby reducing power consumption.

[0015] A notification system according to a second aspect of the present disclosure is the notification system according to the first aspect, wherein the sensor is a microphone that detects sound generated in the space, and the control unit determines that the first user is present when it determines, based on an audio signal generated by the microphone, that the sound pressure of the sound generated in the space is below a predetermined threshold, and determines that the first user is not present when it determines, based on the audio signal, that the sound pressure of the sound generated in the space is greater than the predetermined threshold.

[0016] According to this, when the sound pressure of the sound generated in the space where the notification device is placed is equal to or lower than a predetermined threshold, the audio content is notified, making it easier for the first user to recognize the notification of the audio content. Therefore, the audio content can be effectively notified to the user. On the other hand, when the sound pressure of the sound generated in the space where the notification device is placed is higher than the predetermined threshold, the audio content is not notified, making it possible to suppress notification of the audio content in situations where it is difficult to recognize, and reducing power consumption.

[0017] A notification system according to a third aspect of the present disclosure is the notification system according to the first aspect, wherein the sensor is a camera that photographs the space or a human presence sensor whose detection range is the space, and the control unit determines that the first user is present in the space if it determines that a person is present in the space based on one or more images photographed by the camera or the detection results of the human presence sensor, and determines that the first user is not present in the space if it determines that a person is not present in the space based on the one or more images or the detection results.

[0018] According to this, when the first user is present in the space, the audio content is notified, making it easier for the first user to recognize the notification of the audio content. Therefore, the audio content can be effectively notified to the user. On the other hand, when the first user is not present in the space, the audio content is not notified, making it possible to suppress notification of the audio content in situations where it is difficult for the first user to recognize it, and reducing power consumption.

[0019] A notification system according to a fourth aspect of the present disclosure is the notification system according to the first aspect, wherein the sensor includes at least one of a microphone that detects sounds generated in the space and a camera that photographs the space, and the control unit determines that the first user is in the space when it determines that a person in the space is performing a predetermined behavior based on an audio signal generated by the microphone and at least one of one or more images photographed by the camera, and determines that the first user is in the space when it determines that a person in the space is not performing the predetermined behavior based on the audio signal and at least one of the one or more images.

[0020] According to this, if a person in the space where the notification device is placed is not performing a predetermined action, the audio content is notified, making it easier for the first user to recognize the notification of the audio content. Therefore, the audio content can be effectively notified to the user. On the other hand, if a person in the space where the notification device is placed is performing a predetermined action, the audio content is not notified, making it possible to suppress notification of the audio content in situations where it is difficult to recognize, and reducing power consumption.

[0021] A notification system according to a fifth aspect of the present disclosure is a notification system according to any one of the first to fourth aspects, wherein the acquisition unit acquires a plurality of audio contents at different timings, and the control unit determines, for each of the plurality of timings, whether the first user is present in the space based on sensing results by the sensor at that timing, and if the control unit determines that the first user is not present in the space based on the sensing results at the first timing when the first audio content was acquired, and then determines that the first user is present in the space, the control unit notifies the notification device of the first audio content that was not notified at the timing when it was determined that the first user was not present in the space.

[0022] Therefore, if the first audio content cannot be notified, the first audio content is notified once a situation arises in which the audio content can be notified, thereby preventing the first audio content from being recognized by the user.

[0023] A notification system according to a sixth aspect of the present disclosure is a notification system according to any one of the first to fifth aspects, wherein the acquisition unit further acquires importance information regarding the importance of the audio content, and the control unit performs a second control to notify the notification device of the audio content if the importance is a first rank, and performs the first control if the importance is a second rank lower than the first rank.

[0024] Therefore, audio content with high importance can be notified to the user immediately.

[0025] A notification method according to a seventh aspect of the present disclosure acquires audio content to be notified and sensing results obtained by a sensor that senses a space in which a notification device is located, and determines whether to notify the audio content based on the sensing results, depending on whether a first user who is able to hear the notification of the audio content by the notification device is present in the space, and notifies the audio content based on the result of the determination, and in the determination, decides to notify the audio content if the first user is present in the space, and decides not to notify the audio content if the first user is not present in the space.

[0026] According to this, when a first user who is able to hear the notification of the audio content is in the space where the notification device is located, the audio content is notified to the first user, making it easier for the first user to recognize the notification of the audio content. On the other hand, when a first user who is able to hear the notification of the audio content is not in the space where the notification device is located, the audio content is not notified to the first user, making it possible to suppress notification of the audio content in situations where it is difficult to recognize the notification, thereby reducing power consumption.

[0027] A control device according to an eighth aspect of the present disclosure is a control device communicatively connected to a notification device, and comprises: an acquisition unit that acquires audio content to be notified and sensing results obtained by a sensor that senses the space in which the notification device is located; and a control unit that performs first control to control notification of the audio content by the notification device based on the sensing results, depending on whether a first user who is able to hear the notification of the audio content by the notification device is present in the space; and in the first control, the control unit causes the notification device to notify the audio content if the first user is present in the space, and does not cause the notification device to notify the audio content if the first user is not present in the space.

[0028] According to this, when a first user who is able to hear the notification of the audio content is in the space where the notification device is located, the audio content is notified to the first user, making it easier for the first user to recognize the notification of the audio content. On the other hand, when a first user who is able to hear the notification of the audio content is not in the space where the notification device is located, the audio content is not notified to the first user, making it possible to suppress notification of the audio content in situations where it is difficult to recognize the notification, thereby reducing power consumption.

[0029] A program according to a ninth aspect of the present disclosure is a program for causing a computer to execute the notification method according to the seventh aspect.

[0030] These general or specific aspects may be realized by a device, an integrated circuit, a computer program, or a non-transitory recording medium such as a computer-readable CD-ROM, or may be realized by any combination of a device, a method, a system, an integrated circuit, a computer program, and a non-transitory recording medium.

[0031] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. However, more detailed explanation than necessary may be omitted. For example, detailed explanation of well-known matters or redundant explanation of substantially the same configuration may be omitted. This is to avoid unnecessary redundancy in the following explanation and to facilitate understanding by those skilled in the art.

[0032] The inventors have provided the accompanying drawings and the following description to enable those skilled in the art to fully understand the present disclosure, and do not intend for them to limit the subject matter described in the claims.

[0033] (Embodiment) [1. Configuration] FIG. 1 is a diagram for explaining an overview of a notification system according to an embodiment.

[0034] 1 shows notification devices 10 and 20, a server 30, a network 60, and a router 61. Of these components, for example, notification system 1 includes notification devices 10 and 20 and server 30. Notification devices 10 and 20 and server 30 are communicatively connected to each other via network 60. Router 61 is a device that mediates communication between notification devices 10 and 20 and network 60.

[0035] The notification system 1 is a system in which a server 30 transmits a notification instruction to the notification devices 10, 20, and the notification devices 10, 20 output audio based on the received notification instruction, thereby notifying the user of predetermined notification content. The server 30 transmits the notification instruction to the notification devices 10, 20, for example, by push. The notification instruction includes audio indicating the notification content (i.e., audio content) and at least one of a character string and an image indicating the notification content (i.e., display content). Note that the notification instruction may include audio content but may not necessarily include display content.

[0036] Alternatively, the notification device 10, 20 may store multiple notification contents in advance, and the notification instruction may instruct the notification device 10, 20 to play audio indicated by one of the multiple notification contents stored in the notification device 10, 20. In other words, the notification instruction may include information specifying which of the multiple notification contents is to be played. In this case, the notification content may include audio content and display content, or may include audio content but not display content.

[0037] FIG. 2 is a diagram illustrating an example of a configuration of a notification system according to an embodiment.

[0038] The notification system 1 includes notification devices 10, 20 and a server 30. The router 61 is not shown in FIG. 2 . The notification devices 10, 20 are, for example, devices owned by the same user. For example, the server 30 stores the device information of the notification devices 10, 20 in association with the user identifier of the same user. The notification devices 10, 20 are located in the same space. For example, the notification devices 10, 20 are located in a specific space and can notify users in the specific space of audio content. In other words, by notifying users of audio content, the notification devices 10, 20 can make the users in the specific space aware of the audio content.

[0039] The notification device 10 includes a communication unit 11, a control unit 12, and a first notification unit 13. The notification device 10 is, for example, a device capable of outputting audio and video. The notification device 10 is, for example, a TV. The notification device 10 may include a speaker for outputting audio and a display for outputting video. Note that the notification device 10 may be any home appliance as long as it includes a speaker and a display.

[0040] Furthermore, the notification device 10 does not need to have a speaker or a display, but may be any device that can output an audio signal to a speaker and a video signal to a display. For example, the notification device 10 may be a recorder, a set-top box, or the like.

[0041] The communication unit 11 receives a notification instruction from the server 30 via the network 60. The communication unit 11 is realized, for example, by a communication IF (Interface). The communication unit 11 may be realized by a wired communication interface or a wireless communication interface. The communication unit 11 does not have to be connected to the network 60 via the router 61, and may be connected to the network 60 via a communication line such as a mobile phone communication network.

[0042] When a notification instruction is received by the communication unit 11, the control unit 12 causes the first notification unit 13 to notify the content based on the notification instruction. If the notification instruction includes audio content, the control unit 12 causes the first notification unit 13 to notify the audio content by audio. If the notification instruction includes audio content and display content, the control unit 12 causes the first notification unit 13 to notify the audio content by audio and to notify the display content by display.

[0043] When the notification instruction includes an instruction to play a jingle sound, the control unit 12 may cause the first notification unit 13 to output a jingle sound. When the notification instruction includes an instruction to play audio content and a jingle sound, the control unit 12 may cause the first notification unit 13 to output a jingle sound and then notify the audio content by voice. The control unit 12 is realized by a control circuit such as a processor.

[0044] The first notification unit 13 performs notification based on control by the control unit 12. The first notification unit 13 has an audio output unit 13a and a video output unit 13b. When the control unit 12 notifies the user of audio content, the audio output unit 13a plays the audio content and outputs audio or an audio signal indicated by the audio content. The audio output unit 13a may be realized by a speaker, or may be realized by an audio signal processing circuit and an output terminal that output an audio signal to the speaker. When the control unit 12 notifies the user of display content, the video output unit 13b plays the display content and outputs a display or a display signal indicated by the display content. The video output unit 13b may be realized by a display, or may be realized by a video signal processing circuit and an output terminal that output a display signal to the display.

[0045] The notification device 20 includes a communication unit 21, a control unit 22, a second notification unit 23, and a sensor 24. The notification device 20 is, for example, an example of a device capable of outputting audio. The notification device 20 may also be capable of outputting video. The notification device 20 is, for example, a lighting device equipped with a speaker and a microphone. Note that the notification device 20 may be any device equipped with a speaker and a microphone, and may be a VPA (Virtual Private Assistant) terminal such as a smart speaker, an autonomous vacuum cleaner, a refrigerator, a washing machine, an air conditioner, or the like.

[0046] The communication unit 21 receives a notification instruction from the server 30 via the network 60. The communication unit 21 is realized, for example, by a communication IF (Interface). The communication unit 21 may be realized by a wired communication interface or a wireless communication interface. The communication unit 21 does not have to be connected to the network 60 via the router 61, and may be connected to the network 60 via a communication line such as a mobile phone communication network.

[0047] When the communication unit 21 receives a notification instruction, the control unit 22 causes the second notification unit 23 to notify the content based on the notification instruction. If the notification instruction includes audio content, the control unit 22 causes the second notification unit 23 to notify the audio content by audio. If the notification instruction includes audio content and display content, the control unit 22 causes the second notification unit 23 to notify the audio content by audio. In this case, the second notification unit 23 cannot present the display content, so the control unit 22 does not cause the second notification unit 23 to notify the display content.

[0048] When the notification instruction includes an instruction to play a jingle sound, the control unit 22 may cause the second notification unit 23 to output a jingle sound. When the notification instruction includes an instruction to play audio content and a jingle sound, the control unit 22 may cause the second notification unit 23 to output a jingle sound and then notify the audio content by voice. The control unit 22 is realized by a control circuit such as a processor.

[0049] The second notification unit 23 performs notification based on the control of the control unit 22. The second notification unit 23 has an audio output unit 23a. When the control unit 22 notifies the user of audio content, the audio output unit 23a plays the audio content and outputs the audio or audio signal indicated by the audio content. The audio output unit 23a may be realized by a speaker, or may be realized by an audio signal processing circuit and an output terminal that output an audio signal to the speaker.

[0050] The sensor 24 senses the predetermined space in which the notification device 20 is placed. The sensor 24 is, for example, a microphone that detects sound generated in the predetermined space. The sensing results sensed by the sensor 24 are transmitted by the communication unit 21 to the server 30 via the network 60. The sensing results include the time of sensing. The sensor 24 periodically and repeatedly performs sensing. Multiple sensing results obtained by repeated sensing are periodically transmitted to the server 30. If the sensor 24 is a microphone, the sensing results include an audio signal generated by the microphone.

[0051] The server 30 includes a communication unit 31, a storage unit 32, and a control unit 33. The server 30 is an example of a control device.

[0052] The communication unit 31 exchanges information with the notification devices 10 and 20 via the network 60. Specifically, the communication unit 31 transmits notification instructions to the notification devices 10 and 20. The communication unit 31 also receives sensing results from the notification device 20. The communication unit 31 may be realized, for example, by a wired communication interface or a wireless communication interface.

[0053] The storage unit 32 stores information indicating the destinations of the notification devices 10, 20 as destinations of notification instructions. When a notification instruction includes notification content composed of audio data, the storage unit 32 may store multiple notification instructions. The storage unit 32 stores device information for each of the notification devices 10, 20 in association with a user identifier of the same user. The storage unit 32 may store device information for one or more notification devices owned by each of multiple users. The device information may include information indicating the destinations of the notification devices 10, 20. The storage unit 32 may store a notification history for the notification devices 10, 20. The storage unit 32 may also store sensing results received from the notification device 20.

[0054] When a predetermined condition in the server 30 is satisfied, the control unit 33 controls the communication unit 31 to send a predetermined notification instruction to the notification device 10, 20. Satisfying the predetermined condition in the server 30 may mean, for example, when a predetermined time arrives, when predetermined information is received, or when a predetermined action is performed a predetermined number of times. In other words, when one of a plurality of conditions in the server 30 is satisfied, the control unit 33 controls the communication unit 31 to send a single notification instruction linked to that one condition to the notification device 10, 20.

[0055] For example, each of the multiple conditions is associated with a multiple amount of content. When one of the multiple conditions is satisfied, the control unit 33 selects the content associated with that condition as content to be notified. Then, the control unit 33 acquires the selected content to be notified and the sensing results of the notification device 20. The control unit 33 acquires the content to be notified from the storage unit 32. The control unit 33 may acquire the sensing results from the storage unit 32, or may acquire the sensing results via the communication unit 31 by requesting the notification device 20.

[0056] Here, the acquired sensing results include, for example, sensing results detected at a timing corresponding to the time when a predetermined condition corresponding to the content to be notified is satisfied. The corresponding timing may be the same time as the time when the predetermined condition is satisfied, or may be a timing included in a time period shifted by a certain time (for example, 5 minutes before or after) from the time when the predetermined condition is satisfied. The content to be notified includes at least audio content out of audio content and display content. The control unit 33 may also acquire importance information regarding the importance of the content from the storage unit 32.

[0057] A plurality of contents associated with a plurality of conditions are stored in the storage unit 32. Each of the plurality of contents may be stored in association with importance information relating to the importance of the corresponding content. The importance information is information indicating the importance. The importance may be classified into three ranks, for example, a first rank (high importance), a second rank (medium importance), and a third rank (low importance), in descending order of importance.

[0058] The importance information may be information used to identify the importance. The importance information may be information indicating a content category. In this case, importance may be associated with each content category, and category information indicating the category associated with the importance may be stored in the storage unit 32. Each of multiple pieces of content may be linked to a category so that the content can be classified by category. This allows the control unit 33 to identify the importance of the content according to the content category.

[0059] Alternatively, the importance information may be information indicating a category of conditions corresponding to the content. In this case, multiple conditions associated with multiple pieces of content may be linked to categories. In this way, when one condition is satisfied, the control unit 33 can identify the content associated with that one condition and determine the importance associated with the category associated with that one condition as the importance of the identified content.

[0060] The multiple conditions may each be conditions based on personal information such as user information indicating user attributes and preference information indicating user preferences. User attributes are demographic information, such as the user's age, gender, residential area, annual income, marital status, whether with children, occupational classification, place of employment, and educational background. User preference information is information indicating the user's areas of preference. For example, a user's preferences may include games, game consoles, game strategies, baseball, American football, skiing, cameras, audio equipment, recorders, LCD TVs, high-definition TVs, videos, SNS (Social Networking Service), music, coffee, cooking recipes, automobiles, automobile exteriors, travel, travel bags, route maps, child-rearing, interior decoration, and gardens.

[0061] For example, if the category of the content for which the conditions are satisfied matches or is similar to the user's attribute or preference information, a high importance level may be set as the importance level of the content for which the conditions are satisfied. Conversely, if the category of the content for which the conditions are satisfied does not match or is not similar to the user's attribute or preference information, a low importance level may be set as the importance level of the content for which the conditions are satisfied. Furthermore, the higher the similarity obtained by comparing the category of the content for which the conditions are satisfied with the user's attribute or preference information, the higher the importance level may be set as the importance level of the content for which the conditions are satisfied.

[0062] Each of the multiple conditions may be set so that the importance of content associated with the corresponding condition varies depending on the time period of the day. For example, if a certain condition is met in the morning, the importance of content associated with that condition may be ranked first, and if the condition is met in the afternoon, the importance of content associated with that condition may be ranked second.

[0063] As described above, the control unit 33 identifies the importance level based on the acquired importance level information.

[0064] Based on the sensing result, the control unit 33 determines whether a first user who is able to hear the notification of audio content by the notification devices 10 and 20 is present in the specified space where the notification devices 10 and 20 are located.

[0065] Specifically, the control unit 33 may determine whether the sound pressure of the sound generated in the predetermined space is equal to or less than a predetermined threshold based on the audio signal generated by the microphone. If the control unit 33 determines that the sound pressure of the sound generated in the predetermined space is equal to or less than the predetermined threshold, the control unit 33 may determine that the first user is present in the predetermined space, and if the control unit 33 determines that the sound pressure of the sound generated in the predetermined space is greater than the predetermined threshold, the control unit 33 may determine that the first user is not present in the predetermined space. In this way, the control unit 33 may recognize that the sound pressure of the sound generated in the predetermined space is equal to or less than the predetermined threshold as a case in which the first user is present in the predetermined space and can hear the notification of audio content from the notification device 10, 20.

[0066] Then, the control unit 33 performs first control to control notification of audio content by the notification devices 10, 20 according to the determination result. When the control unit 33 determines in the first control that the first user is in a predetermined space, the control unit 33 causes the notification devices 10, 20 to notify the audio content. That is, the control unit 33 transmits an instruction to notify the audio content to the notification devices 10, 20 via the communication unit 31. Note that the control unit 33 does not need to cause both notification devices 10, 20 to notify the audio content, and may cause one of the notification devices 10, 20 to notify the audio content. That is, the control unit 33 may transmit an instruction to notify the audio content to one of the notification devices 10, 20 via the communication unit 31.

[0067] On the other hand, when the control unit 33 determines in the first control that the first user is not in the predetermined space, the control unit 33 does not cause the notification device 10, 20 to notify the audio content. In this case, the control unit 33 may cause the notification device 10 to notify a sound other than audio. The control unit 33 may, for example, cause the notification device 10 to notify a jingle sound. In this case, the control unit 33 may also cause the notification device 10 to notify, for example, display content included in the content to be notified. In this case, the control unit 33 may also cause the notification device 20 to notify the audio content included in the content to be notified.

[0068] Furthermore, the control unit 33 notifies the notification device 10, 20 of the first content corresponding to the first condition at a first timing when a first condition among the multiple conditions is satisfied, and notifies the notification device 10, 20 of the second content corresponding to the first condition at a second timing when a second condition is satisfied. Therefore, if the first timing and the second timing are different, the control unit 33 acquires multiple audio contents at different timings. In this case, the control unit 33 determines, for each of the multiple timings, based on the sensing result of the sensor 24 at that timing, whether the first user is in a predetermined space and able to hear the notification of the audio content by the notification device 10, 20. Then, if the control unit 33 determines that the first user is not in the predetermined space based on the sensing result at the first timing when the first content is acquired, and then determines that the first user is in the predetermined space, the control unit 33 may cause the notification device 10, 20 to notify the first content that was not notified at the timing when it was determined that the first user was not in the predetermined space. In other words, when a first content that was not notified because the first user was not in a specified space occurs, the control unit 33 may cause the notification device 10, 20 to notify the first content when it detects that the first user has transitioned to a state where they are in the specified space.

[0069] Furthermore, the control unit 33 may control the notification of the audio content in the notification devices 10 and 20 according to the identified importance. When the importance of the content to be notified is a first rank, the control unit 33 may perform a second control to cause the notification devices 10 and 20 to notify the audio content included in the content to be notified, and when the importance is a rank lower than the first rank (second rank or third rank), the control unit 33 may perform a first control.

[0070] [2. Operation] Next, the operation of the notification system 1 will be described.

[0071] FIG. 3 is a sequence diagram showing an example of the operation of the notification system.

[0072] First, the server 30 performs notification control (S1). Details of the notification control will be described later.

[0073] Based on the notification control, the server 30 transmits a notification instruction to the notification device 10 (S2), and transmits a notification instruction to the notification device 20 (S3).

[0074] The notification device 10 issues a notification based on the notification instruction received from the server 30 (S4).

[0075] Similarly, the notification device 20 issues a notification based on the notification instruction received from the server 30 (S5).

[0076] The notification instruction sent from the server 30 in step S2 may be the same as or different from the notification instruction sent from the server 30 in step S3.

[0077] FIG. 4 is a flowchart showing an example of notification control in the server.

[0078] The server 30 determines whether a specific user satisfies a predetermined condition (S11).

[0079] If the server 30 determines that the predetermined condition is met (Yes in S11), it executes step S12, and if it determines that the predetermined condition is not met (No in S11), it returns to step S11.

[0080] In step S12, the server 30 selects content that satisfies a predetermined condition (S12).

[0081] Next, the server 30 determines the importance of the selected content based on the selected content (S13).

[0082] Next, the server 30 determines whether the importance is rank 1, rank 2, or rank 3 (S14).

[0083] If the importance level is rank 1 ("rank 1" in S14), the server 30 executes step S15, and if the importance level is rank 2 or rank 3 ("rank 2, 3" in S15), the server 30 executes step S16.

[0084] In step S15, the server 30 instructs the notification devices 10 and 20 to make a notification by voice (S15). Specifically, the server 30 transmits a notification instruction including an instruction to play a jingle sound, and audio content and display content to the notification device 10. Furthermore, the server 30 transmits a notification instruction including an instruction to play a jingle sound and audio content to the notification device 20.

[0085] In step S16, the server 30 determines whether or not the first user is in a predetermined space and is in a state where he or she can hear the notification of the audio content from the notification devices 10 and 20 (S16).

[0086] If the first user is in the predetermined space (Yes in S16), the server 30 executes step S17, and if the first user is not in the predetermined space (No in S16), the server 30 executes step S18.

[0087] In step S17, the server 30 instructs the notification devices 10 and 20 to make a voice notification (S17). Specifically, the server 30 transmits a notification instruction including an instruction to play a jingle sound, and audio content and display content to the notification device 10. Furthermore, the server 30 transmits a notification instruction including an instruction to play a jingle sound and audio content to the notification device 20.

[0088] In step S18, the server 30 does not instruct the notification devices 10, 20 to make a notification by voice (S18). Note that in step S18, the server 30 may instruct the notification device 10 to make a notification to present display content. In step S18, the server 30 may also send a notification instruction including an instruction to play a jingle sound to the notification devices 10, 20.

[0089] In this way, the server 30 determines whether to notify the first user of the audio content based on the sensing result, depending on whether the first user is in a predetermined space and is able to hear the notification of the audio content from the notification devices 10 and 20. Then, the server 30 notifies the first user of the audio content based on the result of the determination.

[0090] [3. Effects, etc.] The notification system 1 according to the present embodiment includes an acquisition unit (control unit 33) and a control unit 33. The acquisition unit acquires audio content to be notified and sensing results obtained by a sensor 24 that senses the space in which the notification device is located. The control unit 33 performs first control to control notification of the audio content by the notification device 10, 20 based on the sensing results of the sensor 24, depending on whether a first user who is able to hear the notification of the audio content by the notification device 10, 20 is present in the specified space. In the first control, the control unit 33 causes the notification device 10, 20 to notify the audio content if the first user is present in the specified space, and does not cause the notification device 10, 20 to notify the audio content if the first user is not present in the specified space.

[0091] According to this, when a first user who can hear the notification of the audio content is in a predetermined space, the audio content is notified, making it easier for the first user to recognize the notification of the audio content. Therefore, it is easier for the first user to recognize the notification of the audio content. On the other hand, when a first user who can hear the notification of the audio content is not in the predetermined space, the audio content is not notified, making it possible to suppress notification of the audio content in situations where it is difficult to recognize, and reducing power consumption.

[0092] Furthermore, in the notification system 1 according to the present embodiment, the sensor 24 is a microphone that detects sound generated in a predetermined space. The control unit 33 determines that the first user is present when it determines, based on the audio signal generated by the microphone, that the sound pressure of the sound generated in the space is equal to or lower than a predetermined threshold. The control unit 33 determines that the first user is not present when it determines, based on the audio signal, that the sound pressure of the sound generated in the predetermined space is greater than the predetermined threshold.

[0093] According to this, when the sound pressure of the sound generated in the specified space where the notification device 10, 20 is placed is equal to or lower than a specified threshold (i.e., when there is no sound in the specified space that is loud enough to interfere with the audio notification), the audio content is notified, making it easier for the first user to recognize the notification of the audio content. Therefore, the audio content can be effectively notified to the user. On the other hand, when the sound pressure of the sound generated in the space where the notification device 10, 20 is placed is greater than the specified threshold (i.e., when there is a sound in the specified space that is loud enough to interfere with the audio notification), the audio content is not notified. Therefore, notification of the audio content in situations where it is difficult to recognize the content can be suppressed, and power consumption can be reduced.

[0094] Furthermore, in the notification system 1 according to the present embodiment, the acquisition unit (control unit 33) acquires a plurality of audio contents at a plurality of different timings. For each of the timings, the control unit 33 determines whether the first user is present in a predetermined space based on the sensing result by the sensor 24 at that timing. If the control unit 33 determines that the first user is not present in the predetermined space based on the sensing result at the first timing at which the first audio content was acquired, and then determines that the first user is present in the predetermined space, the control unit 33 causes the notification device 10, 20 to notify the first audio content that was not notified at the timing at which it was determined that the first user was not present in the predetermined space.

[0095] Therefore, if the first audio content cannot be notified, the first audio content is notified once a situation arises in which the audio content can be notified, thereby preventing the first audio content from being recognized by the user.

[0096] Furthermore, in the notification system 1 according to the present embodiment, the acquisition unit (control unit 33) further acquires importance information regarding the importance of the audio content. When the importance is a first rank, the control unit 33 performs a second control to cause the notification devices 10 and 20 to notify the audio content. When the importance is a second rank lower than the first rank, the control unit 33 performs a first control.

[0097] Therefore, audio content with high importance can be notified to the user immediately.

[0098] [4. Modifications] (1) In the notification system 1 according to the above embodiment, a microphone is used as the sensor 24, but the sensor 24 is not limited to this and may be a camera, a motion sensor, or the like.

[0099] If the sensor 24 is a camera, the camera is provided in the notification device 20 to capture images of the predetermined space. The control unit 33 determines whether a person is present in the predetermined space based on one or more images captured by the camera. For example, the control unit 33 may determine whether a person is present in the predetermined space by performing image recognition processing on one or more images. The one or more images may include multiple still images captured at multiple different times, or multiple frames included in a moving image. If the sensor 24 is a human presence sensor, the human presence sensor is provided in the notification device 20 to have a detection range that covers the predetermined space. The control unit 33 determines whether a person is present in the predetermined space based on the detection result of the human presence sensor. In this way, if the control unit 33 determines that a person is present in the predetermined space, it may determine that a first user who is able to hear the notification of audio content by the notification device 10, 20 is present in the predetermined space. If the control unit 33 determines that a person is not present in the predetermined space, it may determine that the first user is not present in the predetermined space.

[0100] According to this, when the first user is in a predetermined space, the audio content is notified, making it easier for the first user to recognize the notification of the audio content. Therefore, the audio content can be effectively notified to the user. On the other hand, when the first user is not in the predetermined space, the audio content is not notified, making it possible to suppress notification of the audio content in situations where it is difficult to recognize, and reducing power consumption.

[0101] (2) In the notification system 1 according to the modification (1), the control unit 33 determines whether the first user is in a predetermined space based on one or more images captured by a camera or the detection result of a motion sensor, depending on whether a person is present in the predetermined space. However, this is not limited to this. The control unit 33 may determine whether a person in the predetermined space is performing a predetermined action based on at least one of an audio signal generated by a microphone and one or more images captured by a camera, and determine whether the first user is in a state in which they can hear the notification of audio content from the notification device 10, 20 based on the determination result. For example, the control unit 33 may determine whether a person in the predetermined space is performing a predetermined action by performing a voice recognition process on the audio signal, or may determine whether a person in the predetermined space is performing a predetermined action by performing an image recognition process on one or more images, or may determine whether a person in the predetermined space is performing a predetermined action by performing both the voice recognition process and the image recognition process.

[0102] The control unit 33 determines that the first user is present in the predetermined space when it determines, based on at least one of the audio signal and one or more images, that a person in the predetermined space is performing a predetermined behavior. The control unit 33 determines that the first user is not present in the predetermined space when it determines, based on at least one of the audio signal and one or more images, that a person in the predetermined space is not performing a predetermined behavior. The predetermined behavior may be, for example, behavior other than watching video content on the notification device 10 or behavior other than watching video content or audio content on another device. The predetermined behavior may be watching a predetermined video content among video content or a predetermined audio content among audio content. The predetermined video content or the predetermined audio content may be, for example, video content or audio content of a commercial. Furthermore, the predetermined video content or the predetermined audio content may be, for example, video content or audio content of a genre different from the genre that is of interest to the user in the predetermined space. In this case, the person in the predetermined space may be identified based on a user ID associated with a mobile device, such as a smartphone, connected to the router 61. The predetermined action may be a conversation between multiple people, or a call using a telephone or an information terminal.

[0103] According to this, when a person in a specified space is not performing a specified action, the audio content is notified, making it easier for the first user to recognize the notification of the audio content. Therefore, the audio content can be effectively notified to the user. On the other hand, when a person in a specified space is performing a specified action, the audio content is not notified, making it possible to suppress notification of the audio content in situations where it is difficult to recognize, and reducing power consumption.

[0104] (3) In the above embodiment and its variations, the sensor 24 is provided in the notification device 20, but this is not limiting and the sensor 24 may be provided in a device separate from the notification device 20. When the sensor 24 is provided in a separate device, the separate device can communicate with the server 30 and can transmit the sensing results of the sensor 24 via the network 60.

[0105] (4) In the notification system 1 according to the above embodiment, the control unit 33 selects one piece of content to be notified from among a plurality of pieces of content. However, this is not limited to this. When one of a plurality of conditions is satisfied, the content to be notified may be generated based on a rule that is pre-linked to that one condition.

[0106] (5) In the notification system 1 according to the above embodiment, the notification device 10 plays audio content if the notification instruction includes audio content, and plays display content if the notification instruction includes display content. However, this is not limited to this. For example, the notification instruction may always include audio content and display content, and may further include information indicating whether to notify the audio content and information indicating whether to notify the display content. In this way, the notification device 10 may switch between notifying the audio content and the display content included in the notification instruction based on the information indicating whether to notify the audio content and the information indicating whether to notify the display content.

[0107] [5. Other] In the above embodiments, each component may be configured with dedicated hardware, or may be realized by executing a software program appropriate for that component. Each component may be realized by a program execution unit such as a CPU or processor reading and executing a software program recorded on a recording medium such as a hard disk or semiconductor memory. Here, the software that realizes the system, information terminal, server, camera device, etc. of the above embodiments is a program that causes a computer to execute each step included in the flowcharts shown in the figures.

[0108] The following cases are also included in this disclosure:

[0109] (1) Specifically, each of the above devices is a computer system consisting of a microprocessor, ROM, RAM, hard disk unit, display unit, keyboard, mouse, etc. A computer program is stored in the RAM or hard disk unit. Each device achieves its function when the microprocessor operates in accordance with the computer program. Here, a computer program is composed of a combination of multiple instruction codes that indicate commands to a computer to achieve a specified function.

[0110] (2) Some or all of the components constituting each of the above devices may be configured as a single system LSI (Large Scale Integration). A system LSI is an ultra-multifunctional LSI manufactured by integrating multiple components on a single chip, and specifically, is a computer system configured to include a microprocessor, ROM, RAM, etc. A computer program is stored in the RAM. The system LSI achieves its functions by the microprocessor operating in accordance with the computer program.

[0111] (3) Some or all of the components constituting each of the above devices may be configured as an IC card or a standalone module that can be attached to each device. The IC card or module may be a computer system configured with a microprocessor, ROM, RAM, etc. The IC card or module may include the above-mentioned ultra-multifunctional LSI. The IC card or module achieves its functions when the microprocessor operates in accordance with a computer program. The IC card or module may be tamper-resistant.

[0112] (4) The present disclosure may be embodied as the above-described methods, a computer program for implementing these methods on a computer, or a digital signal comprising the computer program.

[0113] The present disclosure may also be a computer program or a digital signal recorded on a computer-readable recording medium, such as a flexible disk, a hard disk, a CD-ROM, an MO, a DVD, a DVD-ROM, a DVD-RAM, a BD (Blu-ray (registered trademark) Disc), a semiconductor memory, etc. Alternatively, the present disclosure may be a digital signal recorded on such a recording medium.

[0114] Furthermore, the present disclosure may involve transmitting the computer program or the digital signal via a telecommunications line, a wireless or wired communication line, a network such as the Internet, data broadcasting, or the like.

[0115] The present disclosure may also be a computer system including a microprocessor and a memory, the memory storing the computer program, and the microprocessor operating in accordance with the computer program.

[0116] The program or the digital signal may also be implemented by another independent computer system by recording it on the recording medium and transferring it, or by transferring it via the network or the like.

[0117] (5) The above-described embodiments and modifications may be combined with each other.

[0118] The present disclosure is useful as a notification system that can effectively notify users of audio content.

[0119] REFERENCE SIGNS LIST 1 Notification system 10, 20 Notification device 11, 21, 31 Communication unit 12, 22, 33 Control unit 13 First notification unit 13a, 23a Audio output unit 13b Video output unit 23 Second notification unit 24 Sensor 32 Storage unit 60 Network 61 Router

Claims

1. A notification system comprising: an acquisition unit that acquires audio content to be notified and sensing results obtained by a sensor that senses a space in which a notification device is placed; and a control unit that performs first control to control notification of the audio content by the notification device based on the sensing results and depending on whether a first user who is in a state where he or she can hear the notification of the audio content by the notification device is present in the space, wherein the control unit, in the first control, causes the notification device to notify of the audio content if the first user is present in the space, and does not cause the notification device to notify of the audio content if the first user is not present in the space.

2. The notification system of claim 1, wherein the sensor is a microphone that detects sound generated in the space, and the control unit determines that the first user is present when it determines, based on the audio signal generated by the microphone, that the sound pressure of the sound generated in the space is equal to or lower than a predetermined threshold, and determines that the first user is not present when it determines, based on the audio signal, that the sound pressure of the sound generated in the space is greater than the predetermined threshold.

3. The notification system of claim 1, wherein the sensor is a camera that photographs the space or a human presence sensor whose detection range is the space, and the control unit determines that the first user is in the space when it determines that a person is in the space based on one or more images photographed by the camera or the detection result of the human presence sensor, and determines that the first user is not in the space when it determines that a person is not in the space based on the one or more images or the detection result.

4. The notification system of claim 1, wherein the sensor includes at least one of a microphone that detects sounds generated in the space and a camera that photographs the space, and the control unit determines that the first user is in the space when it determines that a person in the space is performing a predetermined behavior based on an audio signal generated by the microphone and at least one of one or more images photographed by the camera, and determines that the first user is in the space when it determines that a person in the space is not performing the predetermined behavior based on the audio signal and at least one of the one or more images.

5. The notification system described in any one of claims 1 to 4, wherein the acquisition unit acquires multiple audio contents at multiple different timings, and the control unit determines whether or not the first user is present in the space for each of the multiple timings based on a sensing result by the sensor at that timing, and when it is determined that the first user is present in the space after determining that the first user is not present in the space based on the sensing result at the first timing when the first audio content was acquired, causes the notification device to notify the first audio content that was not notified at the timing when it was determined that the first user was not present in the space.

6. A notification system as described in any one of claims 1 to 4, wherein the acquisition unit further acquires importance information regarding the importance of the audio content, and the control unit performs a second control to cause the notification device to notify the audio content when the importance is a first rank, and performs the first control when the importance is a second rank lower than the first rank.

7. A notification method comprising: acquiring audio content to be notified and sensing results obtained by a sensor that senses a space in which a notification device is placed; determining whether to notify the audio content based on the sensing results, depending on whether a first user who is able to hear the notification of the audio content by the notification device is present in the space; notifying the audio content based on the result of the determination; and, in the determination, deciding to notify the audio content if the first user is present in the space, and deciding not to notify the audio content if the first user is not present in the space.

8. A control device communicatively connected to a notification device, comprising: an acquisition unit that acquires audio content to be notified and sensing results obtained by a sensor that senses the space in which the notification device is placed; and a control unit that performs first control to control notification of the audio content in the notification device based on the sensing results and depending on whether a first user who is in a state where he or she can hear the notification of the audio content by the notification device is present in the space, wherein the control unit, in the first control, causes the notification device to notify of the audio content if the first user is present in the space, and does not cause the notification device to notify of the audio content if the first user is not present in the space.

9. A program for causing a computer to execute the notification method according to claim 7.

Images