Notification system, notification method, control device, and program

Abstract

A notification system (1) is provided with: an acquisition unit that acquires a sensing result obtained by a sensor (24) that senses a space in which a notification device is disposed, and a voice content to be notified; a determination unit that determines, on the basis of the sensing result, whether or not the first user is in the space in a state in which it is possible to hear the notification of the audio content by the notification device (10, 20); and a control unit that performs a first control for controlling the notification of the voice content in the notification device in accordance with whether or not the first user is in the space, the control unit causing the notification device to notify the voice content when it is determined that the first user is in the space, and causing the notification device to notify the voice content when it is determined that the first user is not in the space, the control unit causing the notification device to notify the voice content when it is determined that the first user is not in the space. The notification device is not caused to notify the sound content.

Description

Technical Field

[0001] The present disclosure relates to a notification system, a notification method, a control device, and a program. Background Art

[0002] A patent document 1 discloses an electronic device that outputs a voice guidance that matches the user's preference.

[0003] Prior Art Documents

[0004] Patent Documents

[0005] Patent Document 1: Japanese Patent Application Laid-Open No. 2011-43894 Summary of the Invention

[0006] Problems to be Solved by the Invention

[0007] The present disclosure provides a notification system or the like that can effectively notify a user of voice content.

[0008] Means for Solving the Problems

[0009] A notification system according to one aspect of the present disclosure includes: an acquisition unit that acquires a sensing result and voice content of a predetermined notification, the sensing result being a sensing result obtained by a sensor that senses a space in which a notification device is disposed; and a control unit that, based on the sensing result, performs first control for controlling notification of the voice content in the notification device according to whether a first user is in the space, the first user being a user who is in a state where he / she can hear the notification of the voice content by the notification device, and in the first control, when the first user is in the space, the control unit causes the notification device to notify the voice content, and when the first user is not in the space, the control unit does not cause the notification device to notify the voice content.

[0010] Moreover, in a notification method according to one aspect of the present disclosure, a sensing result and voice content of a predetermined notification are acquired, the sensing result being a sensing result obtained by a sensor that senses a space in which a notification device is disposed, and based on the sensing result, it is determined whether to notify the voice content according to whether a first user is in the space, the first user being a user who is in a state where he / she can hear the notification of the voice content by the notification device, and based on the determination result, the voice content is notified. In the determination, when the first user is in the space, it is determined to notify the voice content, and when the first user is not in the space, it is determined not to notify the voice content.

[0011] Moreover, a control device according to one aspect of the present disclosure is a control device connected to a notification device so as to be able to communicate, and the control device includes: an acquisition unit that acquires a sensing result and voice content of a predetermined notification, the sensing result being a sensing result obtained by a sensor that senses a space in which the notification device is arranged; and a control unit that, based on the sensing result, performs first control for controlling notification of the voice content in the notification device according to whether a first user is in the space, the first user being a user in a state where the user can hear the notification of the voice content by the notification device, and in the first control, the control unit causes the notification device to notify the voice content when the first user is in the space, and does not cause the notification device to notify the voice content when the first user is not in the space.

[0012] In addition, these general or specific aspects can be implemented by a device, an integrated circuit, a computer program, or a non-transitory recording medium such as a computer-readable CD-ROM, or can be implemented by any combination of a device, a method, a system, an integrated circuit, a computer program, and a non-transitory recording medium.

[0013] Advantageous Effects of the Invention

[0014] The notification system and the like in the present disclosure can effectively notify a user of voice content. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 is a diagram for explaining an outline of a notification system according to an embodiment.

[0016] Figure 2 shows an example of a configuration of a notification system according to an embodiment.

[0017] Figure 3 is a sequence diagram showing an example of operations in a notification system.

[0018] Figure 4 is a flowchart showing an example of notification control in a server. DETAILED DESCRIPTION OF THE INVENTION

[0019] (Forming the basis of the present disclosure)

[0020] In the prior art, an electronic device (notification device) notifies a user by outputting (speaking) a voice guidance as in the following voice output control method. This voice output control method is a method of controlling the timing of voice output in an electronic device that outputs a voice guidance when a display screen is displayed on a display device, according to the number of times the display screen is displayed and the presence or absence of user operations. However, when there is a loud noise or other sound in the environment where the user is located, or when the user is performing other tasks such as watching or listening to content and speaking, it is difficult for the user to recognize the notification by speaking.

[0021] After careful research, the inventor of the present invention found a notification system that can effectively notify the user of the voice notification at a timing when the user can easily recognize the voice notification.

[0022] The notification system according to the first aspect of the present disclosure includes: an acquisition unit that acquires a sensing result and voice content of a predetermined notification, where the sensing result is a sensing result obtained by a sensor that senses the space in which the notification device is disposed; and a control unit that, based on the sensing result, performs first control to control the notification of the voice content in the notification device according to whether a first user is in the space. The first user refers to a user who is in a state where they can hear the notification of the voice content by the notification device. In the first control, when the first user is in the space, the control unit causes the notification device to notify the voice content, and when the first user is not in the space, the control unit does not cause the notification device to notify the voice content.

[0023] By the above method, when the first user who is in a state where they can hear the notification of the voice content is in the space where the notification device is disposed, since the voice content is notified, the first user can easily recognize the notification of the voice content. Accordingly, the first user can easily recognize the notification of the voice content. On the other hand, when the first user who is in a state where they can hear the notification of the voice content is not in the space where the notification device is disposed, since the voice content is not notified, it is possible to suppress the notification of the voice content in a situation where it is difficult to recognize, and further reduce power consumption.

[0024] The notification system according to the second aspect of the present disclosure is a notification system based on the first aspect. The sensor is a microphone that detects the sound generated in the space. When the control unit determines, based on the sound signal generated by the microphone, that the sound pressure of the sound generated in the space is below a specified threshold, it determines that the first user is in the space. When the control unit determines, based on the sound signal, that the sound pressure of the sound generated in the space is greater than the specified threshold, it determines that the first user is not in the space.

[0025] In the above-described manner, when the sound pressure of the sound generated in the space where the notification device is disposed is below the specified threshold, due to the notification sound content, the first user can easily recognize the notification of the sound content. Accordingly, the sound content can be effectively notified to the user. On the other hand, when the sound pressure of the sound generated in the space where the notification device is disposed is greater than the specified threshold, since the sound content is not notified, it is possible to suppress the notification of the sound content in a situation where it is difficult to recognize, and thus the power consumption can be reduced.

[0026] The notification system according to the third aspect of the present disclosure is a notification system premised on the first aspect, the sensor is a camera that photographs the space or a human body sensor having the space as a detection range, and the control unit determines that the first user is in the space when it is determined that a person is in the space based on one or more images photographed by the camera or the detection result of the human body sensor, and determines that the first user is not in the space when it is determined that a person is not in the space based on the one or more images or the detection result.

[0027] In the above-described manner, when the first user is in the space, due to the notification sound content, the first user can easily recognize the notification of the sound content. Accordingly, the sound content can be effectively notified to the user. On the other hand, when the first user is not in the space, since the sound content is not notified, it is possible to suppress the notification of the sound content in a situation where it is difficult to recognize, and thus the power consumption can be reduced.

[0028] The notification system according to the fourth aspect of the present disclosure is a notification system premised on the first aspect, the sensor includes at least one of a microphone that detects a sound generated in the space and a camera that photographs the space, and the control unit determines that the first user is in the space when it is determined that a person in the space has performed a specified action based on at least one of one or more images photographed by the camera and a sound signal generated by the microphone, and determines that the first user is in the space when it is determined that a person in the space has not performed the specified action based on at least one of the one or more images and the sound signal.

[0029] In the above-described manner, when a person in the space equipped with the notification device does not perform a prescribed action, due to the notification sound content, the first user can easily recognize the notification of the sound content. Accordingly, the sound content can be effectively notified to the user. On the other hand, when a person in the space equipped with the notification device performs a prescribed action, since the sound content is not notified, it is possible to suppress the notification of the sound content in a situation where it is difficult to recognize, and furthermore, power consumption can be reduced.

[0030] The notification system according to the fifth aspect of the present disclosure is a notification system premised on any one of the first to fourth aspects. The acquisition unit acquires a plurality of sound contents at different timings, and the control unit determines, for each of the plurality of timings, whether the first user is in the space based on the sensing result sensed by the sensor at that timing. After determining that the first user is not in the space based on the sensing result at the first timing when the first sound content is acquired, when it is determined that the first user is in the space, the notification device is caused to notify the first sound content that was not notified at the timing when it was determined that the first user was not in the space.

[0031] Thus, in a case where the first sound content could not be notified, since the first sound content is notified after the situation where the sound content can be notified is reached, it is possible to suppress the first sound content from not being recognized by the user.

[0032] The notification system according to the sixth aspect of the present disclosure is a notification system premised on any one of the first to fifth aspects. The acquisition unit further acquires importance information related to the importance level of the sound content, and the control unit performs second control to cause the notification device to notify the sound content when the importance level is the first level, and performs the first control when the importance level is a second level lower than the first level.

[0033] Thus, it is possible to immediately notify the user of the sound content with a high level of importance.

[0034] In the notification method according to the seventh aspect of the present disclosure, a sensing result and a sound content to be pre-notified are acquired. The sensing result is a sensing result obtained by a sensor that senses the space equipped with the notification device. Based on the sensing result, it is determined whether to notify the sound content according to whether the first user is in the space. The first user refers to a user in a state where the user can hear the notification of the sound content by the notification device. Based on the determined result, the sound content is notified. In the determination, when the first user is in the space, it is determined to notify the sound content, and when the first user is not in the space, it is determined not to notify the sound content.

[0035] In the above-described manner, when the first user who is in a state of being able to hear the notification of the voice content is in the space where the notification device is configured, due to the notification of the voice content, the first user can easily recognize the notification of the voice content. Accordingly, the first user can easily recognize the notification of the voice content. On the other hand, when the first user who is in a state of being able to hear the notification of the voice content is not in the space where the notification device is configured, since the voice content is not notified, it is possible to suppress the notification of the voice content in a state where it is difficult to recognize, and furthermore, power consumption can be reduced.

[0036] The control device according to the eighth aspect of the present disclosure is a control device connected to a notification device so as to be able to communicate, and the control device includes: an acquisition unit that acquires a sensing result and voice content of a predetermined notification, the sensing result being a sensing result obtained by a sensor that senses the space where the notification device is configured; and a control unit that, based on the sensing result, performs first control for controlling the notification of the voice content in the notification device according to whether the first user is in the space, the first user being a user who is in a state of being able to hear the notification of the voice content by the notification device, and in the first control, the control unit causes the notification device to notify the voice content when the first user is in the space, and does not cause the notification device to notify the voice content when the first user is not in the space.

[0037] In the above-described manner, when the first user who is in a state of being able to hear the notification of the voice content is in the space where the notification device is configured, due to the notification of the voice content, the first user can easily recognize the notification of the voice content. Accordingly, the first user can easily recognize the notification of the voice content. On the other hand, when the first user who is in a state of being able to hear the notification of the voice content is not in the space where the notification device is configured, since the voice content is not notified, it is possible to suppress the notification of the voice content in a state where it is difficult to recognize, and furthermore, power consumption can be reduced.

[0038] The program according to the ninth aspect of the present disclosure is a program for causing a computer to execute the notification method according to the seventh aspect.

[0039] In addition, these general or specific aspects can be implemented by a device, an integrated circuit, a computer program, or a non-transitory recording medium such as a computer-readable CD-ROM, or can be implemented by any combination of a device, a method, a system, an integrated circuit, a computer program, and a non-transitory recording medium.

[0040] Hereinafter, embodiments will be described in detail with appropriate reference to the accompanying drawings. However, there may be cases where unnecessary details are omitted. For example, details of well-known matters or repeated descriptions of substantially the same configurations are omitted. This is to avoid making the following description overly lengthy and to facilitate understanding by those skilled in the art.

[0041] In addition, the accompanying drawings and the following description are provided by the inventors of the present invention to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the content described in the scope of the technical solution.

[0042] (Embodiment)

[0043] [1. Configuration]

[0044] Figure 1 It is a diagram for explaining the outline of the notification system according to the embodiment.

[0045] Specifically, Figure 1 shows a notification device 10 and 20, a server 30, a network 60, and a router 61. The notification system 1 includes, for example, the notification devices 10 and 20 and the server 30 among these components. The notification devices 10 and 20 and the server 30 are connected via the network 60 so as to be able to communicate with each other. The router 61 is a device that mediates the connection of the notification devices 10 and 20 to the network 60 in a communicable manner.

[0046] The notification system 1 is a system that sends a notification instruction from the server 30 to the notification devices 10 and 20, and the notification devices 10 and 20 output a sound based on the received notification instruction to notify a user of a specified notification content. The server 30 sends the notification instruction to the notification devices 10 and 20 by, for example, a push notification. The notification instruction may also include at least one of a sound showing the notification content (i.e., sound content), a string showing the notification content, and an image (i.e., display content). Alternatively, the notification instruction may include the sound content and not include the display content.

[0047] In addition, the notification devices 10 and 20 pre-store a plurality of notification contents, and the notification instruction may also be an instruction to cause the notification devices 10 and 20 to reproduce the sound shown in one of the plurality of notification contents stored in the notification devices 10 and 20. That is, the notification instruction may also include information specifying the notification content to be reproduced among the plurality of notification contents. The notification content in this case may include both the sound content and the display content, or may include the sound content but not the display content.

[0048] Figure 2 Shows an example of the configuration of the notification system according to the embodiment.

[0049] The notification system 1 includes notification devices 10 and 20, and a server 30. In Figure 2 the illustration of the router 61 is omitted. The notification devices 10 and 20 are, for example, devices owned by the same user. For example, the server 30 associates and stores the device information of each of the notification devices 10 and 20 with the user identifier of the same user. The notification devices 10 and 20 are arranged in the same space. For example, the notification devices 10 and 20 are arranged in a specified space and can notify the user in the specified space of the voice content. In other words, by notifying the voice content, the notification devices 10 and 20 can enable the user in the specified space to recognize the voice content.

[0050] The notification device 10 includes a communication unit 11, a control unit 12, and a first notification unit 13. The notification device 10 is, for example, a device capable of outputting sound and video. The notification device 10 is, for example, a TV. The notification device 10 may also include a speaker for outputting sound and a display for outputting video. In addition, as long as the notification device 10 includes a speaker and a display, it can be any household appliance.

[0051] Moreover, the notification device 10 may not include a speaker and a display, as long as it is a device capable of outputting a sound signal to a speaker or a video signal to a display. For example, the notification device 10 may also be a recorder, a set-top box, etc.

[0052] The communication unit 11 receives a notification instruction from the server 30 via the network 60. The communication unit 11 is implemented by, for example, a communication IF (Interface). The communication unit 11 can be implemented either by a wired communication interface or by a wireless communication interface. The communication unit 11 can be connected to the network 60 either via the router 61 or via a communication line such as a mobile phone communication network.

[0053] When the communication unit 11 receives a notification instruction, the control unit 12 causes the first notification unit 13 to notify the content based on the notification instruction. When the notification instruction includes voice content, the control unit 12 causes the first notification unit 13 to notify the voice content by voice. When the notification instruction includes voice content and display content, the control unit 12 causes the first notification unit 13 to notify the voice content by voice and the display content by display.

[0054] Alternatively, when the notification instruction includes a reproduction instruction of a ringtone, the control unit 12 causes the first notification unit 13 to output the ringtone. And when the notification instruction includes voice content and a reproduction instruction of a ringtone, after causing the first notification unit 13 to output the ringtone, the control unit 12 notifies the voice content by voice. The control unit 12 is implemented by a control circuit such as a processor.

[0055] The first notification unit 13 makes a notification based on the control performed by the control unit 12. The first notification unit 13 includes a sound output unit 13a and a video output unit 13b. When the sound output unit 13a performs the notification of the sound content under the control of the control unit 12, it reproduces the sound content and outputs the sound or sound signal indicated by the sound content. The sound output unit 13a can be implemented by a speaker, or by a sound signal processing circuit and an output terminal that output a sound signal to the speaker. When the control unit 12 performs the notification of the display content, the video output unit 13b reproduces the display content and outputs the display or display signal indicated by the display content. The video output unit 13b can be implemented by a display, or by an output video signal processing circuit and an output terminal that output a display signal to the display.

[0056] The notification device 20 includes a communication unit 21, a control unit 22, a second notification unit 23, and a sensor 24. The notification device 20 is, for example, an example of a device capable of outputting sound. The notification device 20 can also be a device capable of outputting video. The notification device 20 is, for example, a lighting device equipped with a speaker and a microphone. In addition, as long as the notification device 20 is a device equipped with a speaker and a microphone, it can be a VPA (Virtual Private Assistant) terminal such as a smart speaker, an autonomous vacuum cleaner, a refrigerator, a washing machine, an air conditioner, or the like.

[0057] The communication unit 21 receives a notification instruction from the server 30 via the network 60. The communication unit 21 is implemented by a communication IF (Interface), for example. The communication unit 21 can be implemented by a wired communication interface or a wireless communication interface. The communication unit 21 can be connected to the network 60 via a router 61, or can be connected to the network 60 via a communication line such as a mobile phone communication network.

[0058] When the communication unit 21 receives a notification instruction, the control unit 22 causes the second notification unit 23 to notify the content based on the notification instruction. When the notification instruction includes a sound content, the control unit 12 causes the second notification unit 23 to notify the sound content by sound. When the notification instruction includes a sound content and a display content, the control unit 12 causes the second notification unit 23 to notify the sound content by sound. In this case, since the second notification unit 23 cannot present the display content, the control unit 22 does not cause the second notification unit 23 to notify the display content.

[0059] Alternatively, when the control unit 22 includes an instruction to reproduce a ringtone in the notification instruction, the second notification unit 23 outputs the ringtone. Also, when the notification instruction includes an instruction to reproduce a sound content and a ringtone, after causing the second notification unit 23 to output the ringtone, the control unit 22 notifies the sound content by sound. The control unit 22 is implemented by a control circuit such as a processor.

[0060] The second notification unit 23 makes a notification based on the control by the control unit 22. The second notification unit 23 includes a sound output unit 23a. When the notification of the sound content is executed by the control of the control unit 22, the sound output unit 23a reproduces the sound content and outputs the sound or sound signal indicated by the sound content. The sound output unit 23a may be implemented by a speaker, or may be implemented by a sound signal processing circuit that outputs a sound signal to the speaker and an output terminal.

[0061] The sensor 24 senses a specified space in which the notification device 20 is disposed. The sensor 24 is, for example, a microphone that detects a sound generated in the specified space. The sensing result sensed by the sensor 24 is transmitted to the server 30 by the communication unit 21 via the network 60. The sensing result includes the sensing time. The sensor 24 repeatedly performs sensing at regular intervals. A plurality of sensing results obtained by repeated sensing are periodically transmitted to the server 30. When the sensor 24 is a microphone, the sensing result includes a sound signal generated by the microphone.

[0062] The server 30 includes a communication unit 31, a storage unit 32, and a control unit 33. The server 30 is an example of a control device.

[0063] The communication unit 31 transmits and receives information to and from the notification devices 10 and 20 via the network 60. Specifically, the communication unit 31 sends a notification instruction to the notification devices 10 and 20. Also, the communication unit 31 receives the sensing result from the notification device 20. The communication unit 31 may be implemented, for example, by a wired communication interface or a wireless communication interface.

[0064] As a transmission destination of the notification instruction, the storage unit 32 stores information indicating the addresses of the notification devices 10 and 20. When the notification instruction includes notification content composed of sound data, the storage unit 32 may also store a plurality of notification instructions. The storage unit 32 associates the device information of each of the notification devices 10 and 20 with a user identifier of the same user and stores them. The storage unit 32 may also store the device information of one or more notification devices owned by each of a plurality of users. The device information may also include information indicating the addresses of the notification devices 10 and 20. The storage unit 32 may also store a notification history of notifications made to the notification devices 10 and 20. Further, the storage unit 32 may store the sensing results received from the notification device 20.

[0065] When a predetermined condition in the server 30 is satisfied, the control unit 33 controls the communication unit 31 to send a predetermined notification instruction to the notification devices 10 and 20. The satisfaction of the predetermined condition in the server 30 means that, for example, it may be a predetermined time, or a predetermined information is received, or a predetermined operation is performed a predetermined number of times. In other words, when one of the multiple conditions in the server 30 is satisfied, the control unit 33 controls the communication unit 31 to send one notification instruction associated with this condition to the notification devices 10 and 20.

[0066] For example, the multiple conditions are respectively associated with multiple contents. When one of the multiple conditions is satisfied, the control unit 33 selects the content associated with the condition as the content of the predetermined notification. Then, the control unit 33 obtains the content of the selected predetermined notification and the sensing result of the notification device 20. The control unit 33 obtains the content of the predetermined notification from the storage unit 32. The control unit 33 may obtain the sensing result from the storage unit 32 or may obtain it by requesting the notification device 20 via the communication unit 31.

[0067] Here, the obtained sensing result includes, for example, the sensing result detected at a timing corresponding to the time when the predetermined condition corresponding to the content of the predetermined notification is satisfied. The corresponding timing may be the same time as the time when the predetermined condition is satisfied, or may be a time period including a time deviated from that time by a certain time (for example, 5 minutes before and after). The content of the predetermined notification includes at least the sound content among the sound content and the display content. Further, the control unit 33 may obtain importance information related to the importance of the content from the storage unit 32.

[0068] Multiple conditions are associated with multiple pieces of content, which are stored in the storage unit 32. Each of the multiple pieces of content can also be associated with importance information related to the importance level of the corresponding content and stored. The importance information is information indicating the importance level. The importance level is classified, for example, into three levels: the first level (high importance), the second level (medium importance), and the third level (low importance) in the order of decreasing importance.

[0069] In addition, the importance information can also be information used to determine the importance level. The importance information can also be information indicating the category of the content. In this case, the categories of the content are associated with the importance level, and the category information indicating the categories associated with the importance level can also be stored in the storage unit 32. The multiple pieces of content are associated with the categories respectively so that classification can be performed within the categories. Accordingly, the control unit 33 can determine the importance level of the content according to the category of the content.

[0070] Alternatively, the importance information can also be information indicating the category of the condition corresponding to the content. In this case, the multiple conditions associated with the multiple pieces of content can also be associated with the category. Accordingly, when one condition is satisfied, the control unit 33 can determine the content associated with this condition and can determine the importance level corresponding to the category associated with this condition as the importance level of the determined content.

[0071] Each of the multiple conditions can also be a condition based on personal information such as user information indicating the attributes of the user or preference information indicating the preferences of the user. The attributes of the user are demographic data information, such as the user's age group, gender, residential area, annual income, married / unmarried, having children / not having children, occupation classification, workplace, educational background, etc. The preference information of the user is information indicating the fields of the user's interests and hobbies. For example, a user's preferences are games, game consoles, game strategy methods, baseball, American football, skiing, cameras, audio equipment, recorders, LCD TVs, high-definition TVs, videos, SNS (Social Networking Service), music, coffee, recipes, cars, car exteriors, travel, travel bags, road maps, raising children, interior decoration, gardens, etc.

[0072] For example, when the category of the content for which the condition is satisfied matches or is similar to the user's attributes or preference information, the importance level of the content for which the condition is satisfied can also be set to a high importance level. Conversely, when the category of the content for which the condition is satisfied does not match or is not similar to the user's attributes or preference information, the importance level of the content for which the condition is satisfied can also be set to a low importance level. Also, it can be that, as the importance level of the content for which the condition is satisfied, it is set in such a way that the higher the similarity obtained by comparing the category of the content for which the condition is satisfied with the user's attributes or preference information, the higher the importance level.

[0073] Each of the multiple conditions can also be set to be different for each time period of the day according to the importance level of the content associated with the corresponding condition. For example, it can also be that when a certain condition is satisfied in the morning time period, the importance level of the content associated with that condition is the first level, and when that condition is satisfied in the noon time period, the importance level of the content associated with that condition is the second level.

[0074] As described above, the control unit 33 determines the importance level based on the obtained importance level information.

[0075] The control unit 33 determines, based on the sensing result, whether the first user is in the specified space where the notification devices 10 and 20 are arranged, and the first user refers to a user who is in a state where they can hear the notification of the voice content by the notification devices 10 and 20.

[0076] Specifically, the control unit 33 can also determine whether the sound pressure of the sound generated in the specified space is below a specified threshold value based on the sound signal generated by the microphone. The control unit 33 can also, when it determines that the sound pressure of the sound generated in the specified space is below the specified threshold value, determine that the first user is in the specified space, and when it determines that the sound pressure of the sound generated in the specified space is greater than the specified threshold value, determine that the first user is not in the specified space. In this way, the control unit 33 can also identify the situation where the sound pressure of the sound generated in the specified space is below the specified threshold value as the situation where the first user who is in a state where they can hear the notification of the voice content by the notification devices 10 and 20 is in the specified space.

[0077] Then, based on the judgment result, the control unit 33 performs a first control to control the notification of the voice content in the notification devices 10 and 20. In the first control, when the control unit 33 determines that the first user is in the specified space, it causes the notification devices 10 and 20 to notify the voice content. That is, the control unit 33 sends a notification instruction for the voice content to the notification devices 10 and 20 via the communication unit 31. Alternatively, the control unit 33 may cause only one of the notification devices 10 and 20 to notify the voice content instead of causing both of the notification devices 10 and 20 to notify the voice content. That is, the control unit 33 may also send a notification instruction for the voice content to only one of the notification devices 10 and 20 via the communication unit 31.

[0078] On the other hand, in the first control, when the control unit 33 determines that the first user is not in the specified space, it does not cause the notification devices 10 and 20 to notify the voice content. In this case, the control unit 33 may also cause the notification device 10 to notify a sound other than the voice. For example, the control unit 33 may cause the notification device 10 to notify a ringtone. Also, in this case, for example, the control unit 33 may cause the notification device 10 to notify the display content included in the content of the scheduled notification. Also, in this case, the control unit 33 may cause the notification device 20 to notify the voice content included in the content of the scheduled notification.

[0079] Moreover, the control unit 33 performs the notification of the first content corresponding to the first condition at the first timing when the first condition among the multiple conditions is satisfied, and performs the notification of the second content corresponding to the second condition at the second timing when the second condition is satisfied. Thus, if the first timing and the second timing are different, the control unit 33 obtains multiple voice contents at different multiple timings. In this case, for each of the multiple timings, the control unit 33 determines whether the first user who is in a state where the voice content notified by the notification devices 10 and 20 can be heard is in the specified space based on the sensing result sensed by the sensor 24 at that timing. Then, after determining that the first user is not in the specified space based on the sensing result at the first timing when the first content is obtained, the control unit 33 may determine that the first user is in the specified space and cause the notification devices 10 and 20 to notify the first content that was not notified at the timing when it was determined that the first user was not in the specified space. That is, when the first content that was not notified because the first user was not in the specified space occurs, the control unit 33 may cause the notification devices 10 and 20 to notify the first content when it detects that the state has changed to the state where the first user is in the specified space.

[0080] Alternatively, the control unit 33 may control the notification of the sound content in the notification devices 10 and 20 according to the determined importance level. When the importance level of the content of the predetermined notification is the first level, the control unit 33 performs the second control to cause the notification devices 10 and 20 to notify the sound content included in the content of the predetermined notification. When the importance level is a level lower than the first level (the second level or the third level), the first control is performed.

[0081] [2. Operation]

[0082] Next, the operation in the notification system 1 will be described.

[0083] Figure 3 It is a sequence diagram showing an example of the operation in the notification system.

[0084] First, the server 30 performs notification control (S1). Details of the notification control will be described later.

[0085] Based on the notification control, the server 30 sends a notification instruction to the notification device 10 (S2) and sends a notification instruction to the notification device 20 (S3).

[0086] The notification device 10 performs notification based on the notification instruction received from the server 30 (S4).

[0087] Similarly, the notification device 20 performs notification based on the notification instruction received from the server 30 (S5).

[0088] The notification instruction sent from the server 30 in step S2 may be the same as or different from the notification instruction sent from the server 30 in step S3.

[0089] Figure 4 It is a flowchart showing an example of the notification control in the server.

[0090] The server 30 determines whether a specified condition is satisfied for a specific user (S11).

[0091] If the server 30 determines that the specified condition is satisfied (Yes in S11), it executes step S12. If it determines that the specified condition is not satisfied (No in S11), it returns to step S11.

[0092] In step S12, the server 30 selects the content that satisfies the specified condition (S12).

[0093] Then, the server 30 determines the importance level of the selected content based on the selected content (S13).

[0094] Next, the server 30 determines whether the importance level is level 1, level 2, or level 3 (S14).

[0095] If the importance level is level 1 ( "level 1" in S14), the server 30 executes step S15. If the importance level is level 2 or level 3 ( "level 2, 3" in S15), the server 30 executes step S16.

[0096] In step S15, the server 30 instructs the notification devices 10 and 20 to give a notification by sound (S15). Specifically, the server 30 sends an instruction for reproducing a ringtone, as well as an instruction for notifying the sound content and the display content, to the notification device 10. Further, the server 30 sends an instruction for reproducing a ringtone and an instruction for notifying the sound content to the notification device 20.

[0097] In step S16, the server 30 determines whether the first user who is in a state where they can hear the notification of the sound content by the notification devices 10 and 20 is in a specified space (S16).

[0098] If the first user is in the specified space ( "yes" in S16), the server 30 executes step S17. If the first user is not in the specified space ( "no" in S16), the server 30 executes step S18.

[0099] In step S17, the server 30 instructs the notification devices 10 and 20 to give a notification by sound (S17). Specifically, the server 30 sends an instruction for reproducing a ringtone, as well as an instruction for notifying the sound content and the display content, to the notification device 10. Further, the server 30 sends an instruction for reproducing a ringtone and an instruction for notifying the sound content to the notification device 20.

[0100] In step S18, the server 30 does not instruct the notification devices 10 and 20 to give a notification by sound (S18). Alternatively, in step S18, the server 30 may instruct the notification device 10 to notify the display content. Further alternatively, in step S18, the server 30 may send an instruction for reproducing a ringtone to the notification devices 10 and 20.

[0101] In this way, based on the sensing result, the server 30 decides whether to notify the sound content according to whether the first user who is in a state where they can hear the notification of the sound content by the notification devices 10 and 20 is in a specified space. Then, the server 30 notifies the sound content based on the determined result.

[0102] [3. Effects, etc.]

[0103] The notification system 1 according to this embodiment includes an acquisition unit (control unit 33) and a control unit 33. The acquisition unit acquires the sensing result and the voice content of a predetermined notification, and the sensing result is obtained by the sensor 24 that senses the space where the notification device is arranged. The control unit 33 performs a first control for controlling the notification of the voice content in the notification devices 10 and 20 based on the sensing result of the sensor 24 according to whether the first user is in a predetermined space. The first user refers to a user who is in a state where he can hear the notification of the voice content by the notification devices 10 and 20. In the first control, the control unit 33 causes the notification devices 10 and 20 to notify the voice content when the first user is in the predetermined space, and does not cause the notification devices 10 and 20 to notify the voice content when the first user is not in the predetermined space.

[0104] In the above manner, when the first user who is in a state where he can hear the notification of the voice content is in the predetermined space, since the voice content is notified, the first user can easily recognize the notification of the voice content. Accordingly, the first user can easily recognize the notification of the voice content. On the other hand, when the first user who is in a state where he can hear the notification of the voice content is not in the predetermined space, since the voice content is not notified, the notification of the voice content in a situation where it is difficult to recognize can be suppressed, and thus the power consumption can be reduced.

[0105] Moreover, in the notification system 1 according to this embodiment, the sensor 24 is a microphone that detects the sound generated in the predetermined space. When the control unit 33 determines based on the sound signal generated by the microphone that the sound pressure of the sound generated in the space is below a predetermined threshold, it determines that the first user is in the predetermined space. When the control unit 33 determines based on this sound signal that the sound pressure of the sound generated in the predetermined space is greater than the predetermined threshold, it determines that the first user is not in the predetermined space.

[0106] In the above manner, when the sound pressure of the sound generated in the predetermined space where the notification devices 10 and 20 are arranged is below the predetermined threshold (i.e., when no sound that is so loud as to interfere with the voice notification is generated in the predetermined space), since the voice content is notified, the first user can easily recognize the notification of the voice content. Accordingly, the voice content can be effectively notified to the user. On the other hand, when the sound pressure of the sound generated in the space where the notification devices 10 and 20 are arranged is greater than the predetermined threshold (i.e., when a sound that is so loud as to interfere with the voice notification is generated in the predetermined space), since the voice content is not notified, the notification of the voice content in a situation where it is difficult to recognize can be suppressed, and thus the power consumption can be reduced.

[0107] Further, in the notification system 1 according to the present embodiment, the acquisition unit (control unit 33) acquires a plurality of voice contents at different timings. For each of the plurality of timings, the control unit 33 determines whether the first user is in a specified space based on the sensing result sensed by the sensor 24 at that timing. After determining that the first user is not in the specified space based on the sensing result at the first timing when the first voice content is acquired, when it is determined that the first user is in the specified space, the notification devices 10 and 20 are caused to notify the first voice content that was not notified at the timing when it was determined that the first user was not in the specified space.

[0108] Accordingly, in the case where the first voice content could not be notified, since the first voice content is notified after the state where the voice content can be notified is reached, it is possible to suppress the first voice content from not being recognized by the user.

[0109] Further, in the notification system 1 according to the present embodiment, the acquisition unit (control unit 33) further acquires importance information related to the importance level of the voice content. When the importance level is the first level, the control unit 33 performs second control to cause the notification devices 10 and 20 to notify the voice content. When the importance level is the second level lower than the first level, the control unit 33 performs first control.

[0110] Accordingly, it is possible to immediately notify the user of the voice content with a high importance level.

[0111] [4. Modification Example]

[0112] (1) In the notification system 1 according to the above embodiment, as the sensor 24, a microphone is exemplified, but it is not limited thereto, and it may be a camera, a human body sensor, or the like.

[0113] In the case where the sensor 24 is a camera, the camera is provided in the notification device 20 so as to photograph a prescribed space. The control unit 33 determines whether a person is in the prescribed space based on one or more images captured by the camera. For example, it may be that the control unit 33 determines whether a person is in the prescribed space by performing image recognition processing on one or more images. In addition, the one or more images may include a plurality of still images captured at a plurality of different timings, or may include a plurality of frames included in a moving image. And, in the case where the sensor 24 is a human body sensor, the human body sensor is provided in the notification device 20 so as to use the prescribed space as a detection range. The control unit 33 determines whether a person is in the prescribed space based on the detection result of the human body sensor. In this way, the control unit 33 may also determine that the first user in a state where the first user can hear the notification of the voice content by the notification devices 10 and 20 is in the prescribed space when it is determined that a person is in the prescribed space, and determine that the first user is not in the prescribed space when it is determined that a person is not in the prescribed space.

[0114] In the above manner, when the first user is in the prescribed space, due to the notification of the voice content, the first user can easily recognize the notification of the voice content. Accordingly, the voice content can be effectively notified to the user. On the other hand, when the first user is not in the prescribed space, since the voice content is not notified, it is possible to suppress the notification of the voice content in a situation where it is difficult to recognize, and further reduce the power consumption.

[0115] (2) In the notification system 1 according to the modification (1), although the control unit 33 determines whether the first user is in the prescribed space according to whether a person is in the prescribed space based on one or more images captured by the camera or the detection result of the human body sensor, it is not limited thereto. The control unit 33 may also determine whether a person in the prescribed space has performed a prescribed action based on at least one of the voice signal generated by the microphone and one or more images captured by the camera, and determine whether the first user in a state where the first user can hear the notification of the voice content by the notification devices 10 and 20 is in the prescribed space based on the determination result. For example, it may be that the control unit 33 determines whether a person in the prescribed space has performed a prescribed action by performing voice recognition processing on the voice signal, determines whether a person in the prescribed space has performed a prescribed action by performing image recognition processing on one or more images, or may determine whether a person in the prescribed space has performed a prescribed action by performing both the above voice recognition processing and image recognition processing.

[0116] When the control unit 33 determines, based on at least one of one or more images and sound signals, that a person in a prescribed space has performed a prescribed action, it determines that the first user is in the prescribed space. When the control unit 33 determines, based on at least one of one or more images and sound signals, that a person in the prescribed space has not performed the prescribed action, it determines that the first user is not in the prescribed space. The prescribed action may be, for example, an action other than viewing and listening to video content through the notification device 10, or an action of viewing and listening to video content or sound content other than through other devices. The prescribed action may also be an action of viewing and listening to prescribed video content or prescribed sound content in the video content. The prescribed video content or prescribed sound content is, for example, the video content or sound content of an advertisement. Also, the prescribed video content or prescribed sound content may be, for example, video content or sound content having a style different from the style that the user in the prescribed space is interested in. In this case, a person in the prescribed space can also be identified based on a user ID associated with a portable terminal such as a smartphone connected to the router 61. Also, the prescribed action may be a conversation carried out by multiple people, or a call using a telephone or information terminal.

[0117] In the above manner, when a person in the prescribed space has not performed the prescribed action, due to the notification sound content, the first user can be easily made to recognize the notification of the sound content. Accordingly, the sound content can be effectively notified to the user. On the other hand, when a person in the prescribed space has performed the prescribed action, since the sound content is not notified, it is possible to suppress the notification of the sound content in a situation where it is difficult to recognize, and furthermore, power consumption can be reduced.

[0118] (3) In the above-described embodiment and its modified example, although the sensor 24 is provided in the notification device 20, it is not limited thereto, and it may be provided in another device different from the notification device 20. When another device is provided with the sensor 24, the other device can communicate with the server 30 and can transmit the sensing result of the sensor 24 via the network 60.

[0119] (4) In the notification system 1 according to the above-described embodiment, although the control unit 33 selects one content to be notified from among multiple contents, it is not limited thereto, and when one of multiple conditions is satisfied, the content of the predetermined notification may be generated based on a rule previously associated with the condition.

[0120] (5) In the notification system 1 according to the above-described embodiment, although the notification device 10 reproduces the sound content if the notification instruction includes the sound content, and reproduces the display content if the notification instruction includes the display content, it is not limited thereto. For example, it may be that the notification instruction always includes the sound content and the display content, and further includes information indicating whether to notify the sound content and information indicating whether to notify the display content. In this way, the notification device 10 can also perform switching between notifying and not notifying the sound content included in the notification instruction and the display content included in the notification instruction based on the information indicating whether to notify the sound content and the information indicating whether to notify the display content.

[0121] [5. Other]

[0122] In addition, in the above-described embodiment, each component may be constituted by dedicated hardware or may be implemented by executing a software program suitable for each component. Each component may also be implemented by a program execution unit such as a CPU or a processor reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory. Here, the software for implementing the system, information terminal, server, imaging device, etc. of the above-described embodiment is a program that causes a computer to execute each step included in the illustrated flowchart.

[0123] In addition, the following cases are also included in the present disclosure.

[0124] (1) Specifically, each of the above-described devices is a computer system constituted by a microprocessor, ROM, RAM, a hard disk unit, a display unit, a keyboard, a mouse, etc. A computer program is stored in the RAM or the hard disk unit. By the microprocessor operating in accordance with the computer program, each device realizes its respective function. Here, the computer program is composed of a combination of a plurality of command codes that issue instructions to the computer in order to realize a prescribed function.

[0125] (2) Part or all of the components constituting each of the above-described devices may be constituted by one system LSI (Large Scale Integration). A system LSI is a super multi-functional LSI in which a plurality of components are integrally manufactured on one chip, and specifically is a computer system including a microprocessor, ROM, RAM, etc. A computer program is stored in the RAM. The microprocessor operates in accordance with the computer program, whereby the system LSI realizes its function.

[0126] (3) Part or all of the constituent elements of each of the above-described devices may be constituted by an IC card or a single module that can be attached to and detached from each device. The IC card or the module is a computer system constituted by a microprocessor, ROM, RAM, etc. The IC card or the module may include the above-described super multifunctional LSI. The microprocessor operates according to a computer program, whereby the IC card or the module realizes its respective functions. The IC card or the module may also have tamper resistance.

[0127] (4) The present disclosure may also be the method shown above. And it may be a computer program for implementing these methods by a computer, and may also be a digital signal constituted by the computer program.

[0128] Furthermore, the present disclosure may also be a computer-readable recording medium recording the computer program or the digital signal, and the recording medium is, for example, a floppy disk, a hard disk, a CD-ROM, an MO, a DVD, a DVD-ROM, a DVD-RAM, a BD (Blu-ray (registered trademark) Disc), a semiconductor memory, etc. And it may also be the digital signal recorded on these recording media.

[0129] Furthermore, the present disclosure may transmit and convey the computer program or the digital signal via an electronic communication line, a wireless or wired communication line, a network represented by the Internet, data broadcasting, etc.

[0130] Furthermore, the present disclosure may be a computer system including a microprocessor and a memory, and the above-described computer program is stored in the memory, and the microprocessor operates according to the computer program.

[0131] And it may be transmitted by recording the program or the digital signal on the recording medium, or by transmitting the program or the digital signal via the network, etc., whereby it can be executed by an independent other computer system.

[0132] (5) The above-described embodiments and the above-described modification examples may be combined respectively.

[0133] Industrial Applicability

[0134] The present disclosure is useful as a notification system or the like that can effectively notify a user of voice content.

[0135] Symbol Description

[0136] 1 Notification System

[0137] 10, 20 Notification Device

[0138] 11, 21, 31 Communication Unit

[0139] 12, 22, 33 Control Unit

[0140] 13 First Notification Unit

[0141] 13a, 23a Sound Output Unit

[0142] 13b Image Output Unit

[0143] 23 Second Notification Unit

[0144] 24 Sensor

[0145] 32 Storage Unit

[0146] 60 Network

[0147] 61 Router

Claims

1. A notification system, The notification system includes: An acquisition unit that acquires a sensing result and voice content of a predetermined notification, where the sensing result is obtained by a sensor that senses a space in which a notification device is disposed; and A control unit that, based on the sensing result, performs first control to control the notification of the voice content in the notification device according to whether a first user is in the space, where the first user refers to a user who is in a state where they can hear the notification of the voice content by the notification device. The control unit, in the first control, When the first user is in the space, causes the notification device to notify the voice content. When the first user is not in the space, does not cause the notification device to notify the voice content.

2. The notification system according to claim 1, The sensor is a microphone that detects sound generated in the space. The control unit, If it is determined, based on a sound signal generated by the microphone, that the sound pressure of the sound generated in the space is below a specified threshold, then it is determined that the first user is in the space. If it is determined, based on the sound signal, that the sound pressure of the sound generated in the space is greater than the specified threshold, then it is determined that the first user is not in the space.

3. The notification system according to claim 1, The sensor is a camera that photographs the space or a human body sensor that has the space as a detection range. The control unit, If it is determined, based on one or more images photographed by the camera or the detection result of the human body sensor, that a person is in the space, then it is determined that the first user is in the space. If it is determined, based on the one or more images or the detection result, that a person is not in the space, then it is determined that the first user is not in the space.

4. The notification system according to claim 1, The sensor includes at least one of a microphone that detects sound generated in the space and a camera that photographs the space. The control unit, If it is determined, based on at least one of one or more images photographed by the camera and a sound signal generated by the microphone, that a person in the space has performed a specified action, then it is determined that the first user is in the space. If it is determined, based on at least one of the one or more images and the sound signal, that a person in the space has not performed the specified action, then it is determined that the first user is in the space.

5. The notification system according to any one of claims 1 to 4, The acquisition unit acquires a plurality of voice contents at different timings. The control unit, For each of the plurality of timings, based on the sensing result sensed by the sensor at that timing, determines whether the first user is in the space. After determining that the first user is not in the space based on the sensing result at the first timing when the first sound content is obtained, when it is determined that the first user is in the space, the notification device is caused to notify the first sound content that was not notified at the timing when it was determined that the first user was not in the space.

6. The notification system according to any one of claims 1 to 4, The obtaining unit further obtains importance information related to the importance level of the sound content, The control unit, In the case where the importance level is the first level, performs a second control to cause the notification device to notify the sound content, In the case where the importance level is a second level lower than the first level, performs the first control.

7. A notification method, in which A sensing result and a sound content to be notified are obtained, the sensing result being a sensing result obtained by a sensor that senses a space in which a notification device is arranged; Based on the sensing result, it is determined whether to notify the sound content according to whether a first user is in the space, the first user being a user in a state where they can hear the notification of the sound content by the notification device; Based on the result of the determination, the sound content is notified, In the determination, When the first user is in the space, it is determined to notify the sound content, When the first user is not in the space, it is determined not to notify the sound content.

8. A control device that is connected to a notification device so as to be able to communicate, The control device includes: An obtaining unit that obtains a sensing result and a sound content to be notified, the sensing result being a sensing result obtained by a sensor that senses a space in which a notification device is arranged; and A control unit that, based on the sensing result, performs a first control to control the notification of the sound content in the notification device according to whether a first user is in the space, the first user being a user in a state where they can hear the notification of the sound content by the notification device, The control unit, in the first control, When the first user is in the space, causes the notification device to notify the sound content, When the first user is not in the space, does not cause the notification device to notify the sound content.

9. A program for causing a computer to execute the notification method according to claim 7.

Images