Notification system, notification apparatus, notification method, and program

WO2025046819A1PCT designated stage expired Publication Date: 2025-03-06PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
PCT/JP2023/031613
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-08-30
Publication Date
2025-03-06

Smart Images

  • Figure JP2023031613_06032025_PF_FP_ABST
    Figure JP2023031613_06032025_PF_FP_ABST
Patent Text Reader

Abstract

This notification system (100) comprises an acquisition unit (11) and a processing unit (12). The acquisition unit (11) acquires sound information indicating a specific sound including at least one among a beep sound and an action sound emitted by an apparatus (3). The processing unit (12) specifies, on the basis of the sound information acquired by the acquisition unit (11), the content of an event generated with the apparatus (3) corresponding to the specific sound, and causes a notification apparatus (2) to output notification information indicating the specified content of the event.
Need to check novelty before this filing date? Find Prior Art

Description

Notification system, notification device, notification method, and program

[0001] The present disclosure relates to a notification system or the like that, when an event occurs in a device, causes a notification device to output notification information indicating the content of the event.

[0002] For example, Patent Document 1 discloses a technique for causing a home appliance having a voice input / output function to speak by instructing the content and timing of speech to the home appliance.

[0003] Japanese Patent Application Laid-Open No. 2017-151718

[0004] The present disclosure provides a notification system and the like that makes it easier for a user to notice that an event has occurred on a device.

[0005] A notification system according to one aspect of the present disclosure includes an acquisition unit and a processing unit. The acquisition unit acquires sound information indicating a specific sound, including at least one of a beep and an operation sound, emitted by a device. The processing unit identifies an event that occurred in the device corresponding to the specific sound based on the sound information acquired by the acquisition unit, and causes the notification device to output notification information indicating the identified event.

[0006] A notification device according to an aspect of the present disclosure includes an instruction acquisition unit and an output unit, wherein the instruction acquisition unit acquires an instruction to output the notification information from the notification system, and the output unit outputs the notification information when the instruction acquisition unit acquires the instruction.

[0007] In a notification method according to one aspect of the present disclosure, sound information indicating a specific sound, including at least one of a beep and an operation sound, is acquired, and based on the acquired sound information, content of an event that occurred in the device corresponding to the specific sound is identified, and notification information indicating the content of the identified event is output from the notification device.

[0008] A program according to one aspect of the present disclosure causes one or more processors to execute the notification method.

[0009] The notification system and the like according to the present disclosure has the advantage that it makes it easier for a user to notice that an event has occurred on a device.

[0010] FIG. 1 is a block diagram showing an overall configuration including a notification system according to an embodiment. FIG. 2 is a diagram showing an example of registration processing. FIG. 3 is a diagram showing another example of registration processing. FIG. 4 is a flowchart showing an example of operation of a notification system according to an embodiment. FIG. 5 is an explanatory diagram of issues with a notification system of a comparative example. FIG. 6 is an explanatory diagram of advantages of a notification system according to an embodiment. FIG. 7 is a block diagram showing an overall configuration including a notification system according to a modified example of an embodiment. FIG. 8 is a block diagram showing an overall configuration including a notification system according to another modified example of an embodiment.

[0011] (Findings that Form the Basis of the Present Disclosure) First, the inventor's point of view will be explained below.

[0012] As disclosed in Patent Literature 1, there is a conventional technology for causing a home appliance (notification device) equipped with a voice input / output function to speak by instructing the content and timing of the speech (notification) to the home appliance. This technology is used to notify a user who is not near a home appliance, for example, a washing machine, of the content of an event that has occurred by causing the notification device equipped with a voice input / output function to speak the content of the event. The event may include, for example, the occurrence of an error in the home appliance or the completion of an operation that the home appliance was executing.

[0013] The above technology can be used when a home appliance has a function to communicate with a notification device directly or indirectly via a server or the like, and also has a function to transmit information indicating that an event has occurred, but cannot be used for home appliances that do not have these functions.

[0014] For example, the above technology cannot be used for home appliances that only emit a beep when an operation is completed or when some error occurs, but do not have the function of transmitting information indicating the completion of the operation. Therefore, when an event occurs on such a home appliance, unless the user is in a location where he or she can hear the beep, the user will not notice the occurrence of the event and will be unable to respond to the event. Furthermore, even if the user is in a location where he or she can hear the beep, the user will not be able to understand what event has occurred just by hearing the beep, and will be unable to respond to the event.

[0015] In view of the above, the inventors have come up with the present disclosure.

[0016] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. However, more detailed explanation than necessary may be omitted. For example, detailed explanation of well-known matters or redundant explanation of substantially the same configuration may be omitted. This is to avoid unnecessary redundancy in the following explanation and to facilitate understanding by those skilled in the art.

[0017] The inventors have provided the accompanying drawings and the following description to enable those skilled in the art to fully understand the present disclosure, and do not intend for them to limit the subject matter described in the claims.

[0018] (Embodiment) [1-1. Overall Configuration] First, an overall configuration including a notification system 100 according to an embodiment will be described with reference to Fig. 1. Fig. 1 is a block diagram showing an overall configuration including a notification system 100 according to an embodiment. In the embodiment, the notification system 100 is a system that, when an event occurs in a device 3 such as a home appliance, causes a notification device 2 to output notification information indicating the content of the event via a sound collection device 4 located around the device 3.

[0019] The notification device 2 is a device capable of notifying a user U1 (see FIG. 2, etc., described later) of the content of an event that has occurred on the device 3. In the embodiment, the notification device 2 notifies the user U1 by, for example, outputting audio from a speaker. Note that the notification device 2 may notify the user U1 by, for example, displaying text or an image on a built-in display, or by both audio output and display.

[0020] The notification device 2 is, for example, a device installed in the facility where user U1 resides, and is a device having the above-mentioned audio output function or display function. In the embodiment, the notification device 2 is a home appliance. Specifically, the notification device 2 may include, for example, a smart speaker, a television receiver, a lighting fixture, a pet camera, an intercom master unit, an intercom slave unit, an air conditioner, or a robot vacuum cleaner. Note that the notification device 2 may also be a portable information device owned by user U1, such as a portable television receiver, a smartphone, a tablet terminal, or a laptop personal computer.

[0021] The notification device 2 includes an instruction acquisition unit 21 and an output unit 22. In the embodiment, the notification device 2 includes a processor and a memory, and the notification device 2 realizes each of its components by causing the processor to execute a computer program stored in the memory.

[0022] The instruction acquisition unit 21 acquires an instruction to output notification information from the notification system 100. In the embodiment, the instruction acquisition unit 21 acquires the instruction included in the instruction signal by receiving the instruction signal transmitted from the notification system 100 via a network such as the Internet (hereinafter simply referred to as the "network").

[0023] The output unit 22 outputs notification information when the instruction acquisition unit 21 acquires an instruction. For example, if the notification device 2 has an audio output function, the output unit 22 accesses a sound source URL (Uniform Resource Locator) included in the instruction, downloads an audio message, and plays the audio message to output the notification information. The output unit 22 may play the audio message included in the instruction. Furthermore, if various audio messages are pre-stored in the memory of the notification device 2, the output unit 22 may read and play the corresponding audio message from the memory in accordance with the instruction. Furthermore, if the notification device 2 has an automatic audio generation function, the output unit 22 may generate and play the corresponding audio message in accordance with the instruction.

[0024] Furthermore, for example, if the notification device 2 has a display function, the output unit 22 outputs the notification information by displaying the character string or image, etc. included in the instruction on the display. Note that if various character strings or images, etc. are stored in advance in the memory of the notification device 2, the output unit 22 may read the corresponding character string or image, etc. from the memory in accordance with the instruction and display it on the display. Also, if the notification device 2 has a function to automatically generate character strings or images, etc., the output unit 22 may generate the corresponding character string or image, etc. in accordance with the instruction and display it on the display.

[0025] The device 3 is a device that emits specific sounds including at least one of a beep sound and an operation sound. The beep sound is a sound that is emitted when the device 3 completes an operation, for example, to notify those around that the operation has been completed. The beep sound is also a sound that is emitted when an error occurs in the device 3, for example, to notify those around that the error has occurred. Unlike the beep sound, the operation sound is a sound that is emitted from the device 3 due to vibrations or the like of the device 3 when the device 3 is performing an operation.

[0026] In the embodiment, the device 3 is a home appliance. Specifically, the device 3 is, for example, an air conditioner, a washing machine, a robot vacuum cleaner, a refrigerator, a rice cooker, or a microwave oven. Events that occur in the device 3 may include, for example, the start or end of operation of the device 3, the occurrence of an error in the device 3, or maintenance of the device 3.

[0027] The sound collection device 4 is a device equipped with a microphone 41. The sound collection device 4 collects the specific sound emitted by the device 3 using the microphone 41. The sound collection device 4 also has a function of transmitting a signal including data of the collected specific sound to a server 1 (described later) by communicating with the server 1 via a network. In the embodiment, the sound collection device 4 is a home appliance. Specifically, the sound collection device 4 is, for example, an air conditioner, a washing machine, a robot vacuum cleaner, a refrigerator, a rice cooker, or a microwave oven. Note that the sound collection device 4 may also be a portable information device carried by the user U1, such as a portable television receiver, a smartphone, a tablet terminal, or a laptop personal computer.

[0028] [1-2. Notification System] Next, details of the notification system 100 will be described. As shown in Fig. 1 , the notification system 100 includes an acquisition unit 11, a processing unit 12, and a storage unit 13. Note that, although the notification system 100 includes the storage unit 13 in the embodiment, the storage unit 13 does not have to be a component of the notification system 100.

[0029] In the embodiment, the notification system 100 is realized by a server 1. The server 1 has a processor and a memory, and the processor executes a computer program stored in the memory to realize each component of the notification system 100. In the embodiment, the memory is a storage unit 13.

[0030] The notification system 100 is configured to be able to communicate with the notification device 2 and the sound collection device 4 via a network. In the example shown in Fig. 1, there is one each of the notification device 2, device 3, and sound collection device 4, but there may be multiple of each.

[0031] The acquisition unit 11 acquires sound information indicating specific sounds including at least one of beep sounds and operation sounds emitted by the device 3. In the embodiment, the acquisition unit 11 acquires the sound information by receiving a signal including data of the specific sound picked up by the sound collection device 4, which is transmitted from the sound collection device 4 via a network. That is, in the embodiment, the specific sound is picked up by the sound collection device 4 located around the device 3. Then, the acquisition unit 11 acquires the sound information by communicating with the sound collection device 4.

[0032] Here, the sound collection device 4 transmits the signal to the notification system 100 when it collects the specific sound emitted by the device 3, that is, when an event occurs in the device 3. Therefore, the acquisition unit 11 acquires the sound information approximately when an event occurs in the device 3. Note that the timing at which the acquisition unit 11 acquires the sound information may be later than when the event occurs in the device 3.

[0033] The processing unit 12 identifies the content of the event that occurred in the device 3 corresponding to the specific sound based on the sound information acquired by the acquisition unit 11, and causes notification information indicating the content of the identified event to be output from the notification device 2. In the embodiment, the processing unit 12 identifies the content of the event that corresponds to the specific sound by referring to the correspondence information stored in the storage unit 13.

[0034] The correspondence information is information that indicates the correspondence between the specific sound and the content of the event. Specifically, the correspondence information is information that indicates the correspondence between the characteristics of the specific sound and the message that indicates the content of the event. Here, the characteristics of the specific sound may include, for example, the frequency of the specific sound, the sound quality of the specific sound (such as the signal-to-noise ratio), the interval between the specific sound, or the number of times the specific sound occurs.

[0035] For example, the correspondence information may include information linking the characteristics of a beep emitted by a rice cooker, which is device 3, when the rice cooking operation is completed with a message such as "The rice is cooked in the rice cooker" indicating that the rice cooking operation is completed. Furthermore, for example, the correspondence information may include information linking the characteristics of a beep emitted by a refrigerator, which is device 3, when a certain period of time has passed with the door open with a message such as "The refrigerator door is open" indicating a refrigerator door error. Furthermore, for example, the correspondence information may include information linking the characteristics of an operating sound emitted by a washing machine, which is device 3, while it is operating with some kind of abnormality occurring with a message such as "An error has occurred in the washing machine" indicating that the washing machine is abnormal.

[0036] In the embodiment, the processing unit 12 extracts characteristics of the specific sound by analyzing the sound information acquired by the acquisition unit 11 using an appropriate analysis algorithm. Then, the processing unit 12 identifies the content of an event linked to the extracted characteristics of the specific sound by referring to the correspondence information. For example, assume that the sound information acquired by the acquisition unit 11 includes data capturing a beep sound emitted when a rice cooker completes cooking rice. In this case, the processing unit 12 analyzes the sound information to extract the characteristics of the beep sound. Then, the processing unit 12 identifies a message, such as "The rice is cooked in the rice cooker," linked to the characteristics of the beep sound by referring to the correspondence information.

[0037] In the embodiment, the processing unit 12 causes the notification device 2 to output notification information by transmitting an instruction signal to the notification device 2 via the network. In the embodiment, the processing unit 12 includes a sound source URL in the instruction signal and transmits it to the notification device 2. The sound source URL is a URL that can be accessed to download a voice message. In other words, in the embodiment, outputting an instruction to the notification device 2 corresponds to transmitting the sound source URL.

[0038] Specifically, the processing unit 12 causes a voice synthesis system (not shown) to generate a voice message indicating the content of the identified event, and stores the generated voice message and a sound source URL linked to the voice message in a notification database (not shown). The voice synthesis system acquires a character string indicating the notification content and parameters for the sound source to be used from the notification system 100 via a network, and generates the voice message by synthesizing a voice using the acquired character string and parameters. The notification database is a storage device that stores various voice messages transmitted from the notification system 100 via the network, linked to the sound source URL. The notification database is realized, for example, by a semiconductor memory, but is not particularly limited and any known electronic information storage means can be used.

[0039] The processing unit 12 then transmits the sound source URL to the notification device 2 via the network, thereby outputting an instruction to the notification device 2 to output the voice message. Furthermore, if an existing voice message exists in the notification database, the processing unit 12 reads out the sound source URL corresponding to the voice message from the notification database without causing the voice synthesis system to generate the voice message, and transmits the read sound source URL to the notification device 2.

[0040] The processing unit 12 may include, for example, a voice message in the instruction signal and transmit it to the notification device 2. Furthermore, if, for example, various voice messages are stored in advance in the memory of the notification device 2, or if the notification device 2 has a function for automatically generating voice messages, the processing unit 12 may include, in the instruction signal and transmit it to the notification device 2, a command specifying the voice message to be played by the notification device 2.

[0041] The storage unit 13 is a storage device that stores information (such as computer programs) necessary for the processor of the notification system 100 to perform various controls. The storage unit 13 is realized, for example, by a semiconductor memory, but is not particularly limited and any known electronic information storage means can be used. The storage unit 13 stores, for example, the above-mentioned correspondence information. The storage unit 13 also stores, for example, instruction data included in an instruction signal transmitted to the notification device 2.

[0042] [1-3. Registration Process] The above-described correspondence information is stored in advance in the storage unit 13, for example, before the notification system 100 is used. Here, the correspondence information may be stored in the storage unit 13, for example, by the user U1 executing a registration process using the information terminal 5. The information terminal 5 is a portable information device carried by the user U1, such as a smartphone, a tablet terminal, or a laptop-type personal computer, and has a microphone.

[0043] In this case, the user U1 may execute the registration process for all specific sounds emitted by the one or more devices 3 that the user U1 uses, or may execute the registration process only for specific sounds that are not included in the correspondence information pre-stored in the storage unit 13. The user U1 may also execute the registration process when he or she wants to change the message that is linked to the characteristics of a specific sound in the correspondence information.

[0044] The registration process will be described below with reference to FIG. 2 . FIG. 2 illustrates an example of the registration process. First, user U1 operates the information terminal 5 to launch an application for executing the registration process. Next, user U1 moves near the device 3 that emits the specific sound to be registered and has the microphone of the information terminal 5 pick up the specific sound emitted by the device 3. Then, user U1 operates the information terminal 5 to input the details of the event to be linked to the picked-up specific sound. Then, user U1 operates the information terminal 5 to transmit a signal including data on the picked-up specific sound and data indicating the details of the input event from the information terminal 5 to the server 1 (notification system 100). Upon receiving the signal, the processing unit 12 of the notification system 100 associates the data on the specific sound included in the signal with the data indicating the details of the event and stores the associated data in the storage unit 13.

[0045] 2, user U1 has the information terminal 5 pick up the beep sound emitted when the rice cooker, which is the device 3, completes the cooking operation as a specific sound. Then, user U1 inputs the content of the event corresponding to the beep sound as "rice cooking completed" into the information terminal 5. As a result, information linking the beep sound with "rice cooking completed" is stored in the storage unit 13 as corresponding information.

[0046] In the example shown in Fig. 2, user U1 voluntarily performs the registration process, but the registration process is not limited to this. Other registration processes will be described below with reference to Fig. 3. Fig. 3 is a diagram showing another example of the registration process. The registration process shown in Fig. 3 is performed, for example, when the specific sound emitted by device 3 is a new specific sound that is not included in the correspondence information. Furthermore, in the example shown in Fig. 3, the notification system 100 performs the registration process via a notification device 2 that has a microphone. It should be noted that the notification system 100 may also perform the registration process via a sound collection device 4 instead of the notification device 2.

[0047] First, when notification device 2 located near device 3 picks up a specific sound emitted by device 3 with a microphone, it transmits a signal including data on the picked-up specific sound (i.e., sound information) to server 1 (notification system 100) via the network. Upon receiving the signal, processing unit 12 of notification system 100 refers to the correspondence information stored in memory unit 13 to determine whether the specific sound indicated by the sound information is included in the correspondence information.

[0048] Then, when the processing unit 12 determines that the specific sound is not included in the correspondence information, that is, that the specific sound is a new specific sound, the processing unit 12 causes the notification device 2 to output prompt information that prompts the user U1 to register the details of the event that corresponds to the specific sound. For example, the processing unit 12 causes the notification device 2 to output the prompt information by transmitting a prompt instruction signal to the notification device 2 via the network.

[0049] Here, the processing unit 12 includes the sound source URL in a prompt instruction signal and transmits it to the notification device 2. For example, the processing unit 12 causes the voice synthesis system to generate a voice message that prompts the user U1 to register the details of the event corresponding to the specific sound, and stores the generated voice message and the sound source URL linked to the voice message in the notification database. Then, the processing unit 12 transmits the prompt instruction signal including the sound source URL to the notification device 2 via the network, thereby outputting an instruction to the notification device 2 to output the voice message.

[0050] When the notification device 2 receives the prompt instruction signal, it accesses the sound source URL included in the prompt instruction signal, downloads the voice message, and plays the voice message to output the prompt information. If the user U1 listens to the prompt information (here, the voice message) output by the notification device 2 and determines that the specific sound should be registered, the user U1 executes a registration process similar to the example shown in FIG. 2.

[0051] In the example shown in Fig. 3, the notification system 100 determines that the beep sound emitted when the rice cooker, which is the device 3, completes the rice cooking operation is a new specific sound. The notification system 100 then causes the notification device 2 to output a voice message as prompting information saying, "Is this the rice cooker beep sound? Would you like to register it?" User U1 listens to the voice message, determines that the rice cooker beep sound should be registered, and executes a registration process similar to the example shown in Fig. 2. As a result, information linking the beep sound with "rice cooking completed" is stored as corresponding information in the storage unit 13.

[0052] [2. Operation] The operation (i.e., notification method) of notification system 100 according to the embodiment will be described below with reference to Fig. 4. Fig. 4 is a flowchart showing an example of the operation of notification system 100 according to the embodiment.

[0053] When the device 3 emits a specific sound, the sound collection device 4 collects the specific sound using the microphone 41 and transmits a signal including data of the collected specific sound to the server 1 (notification system 100) via the network. As a result, the acquisition unit 11 acquires sound information via the network (S1).

[0054] Next, the processing unit 12 identifies the content of the event that occurred in the device 3 corresponding to the specific sound based on the sound information acquired by the acquisition unit 11 (S2). Here, the processing unit 12 identifies the content of the event that corresponds to the specific sound by referring to the correspondence information stored in the storage unit 13. Then, the processing unit 12 transmits an instruction signal including an instruction to the notification device 2 via the network, that is, outputs the instruction (S3). Upon receiving the instruction signal, the notification device 2 outputs notification information in accordance with the instruction included in the instruction signal.

[0055] [3. Advantages, etc.] The advantages of the notification system 100 (notification method) according to the embodiment will be described below. Fig. 5 is an explanatory diagram of a problem with a notification system of a comparative example. In Fig. 5, the solid lines between the device 3 and the sound collection device 4 and the user U1 and the notification device 2 indicate that the locations of the device 3 and the sound collection device 4 are different from the locations of the user U1 and the notification device 2. The solid lines are also the same in Fig. 6, which will be described later.

[0056] The notification system of the comparative example is a system in which, when device 3 has the function of communicating with notification device 2 directly or indirectly via a server or the like and also has the function of transmitting information indicating that an event has occurred, notification information indicating an event that has occurred in device 3 is output to notification device 2. On the other hand, when device 3 does not have the above function, the notification system of the comparative example cannot cause notification device 2 to output notification information even if an event has occurred in device 3.

[0057] For example, as shown in Figure 5, suppose that the rice cooker, which is device 3, does not have the above function. In this case, even if the rice cooker, which is device 3, emits a beep when it completes cooking rice, the beep does not trigger the output of notification information from notification device 2. Therefore, unless user U1 is in a location where he or she can hear the beep, he or she will not be able to notice that an event has occurred on device 3 and will be unable to respond to the event. Furthermore, even if user U1 is in a location where he or she can hear the beep, user U1 will not be able to understand what event has occurred on device 3 just by hearing the beep, and will still be unable to respond to the event.

[0058] In contrast, in the notification system 100 (notification method) according to the embodiment, when the device 3 emits a specific sound, the content of the event that occurred in the device 3 corresponding to the specific sound is identified, and notification information indicating the content of the identified event is output from the notification device 2. Therefore, in the notification system 100 (notification method) according to the embodiment, the content of the event that corresponds to the specific sound emitted by the device 3 is output from the notification device 2, which has the advantage that the user U1 can easily notice that an event has occurred in the device 3.

[0059] FIG. 6 is an explanatory diagram of advantages of the notification system 100 (notification method) according to the embodiment. As shown in FIG. 6, in the notification system 100 (notification method) according to the embodiment, when the rice cooker (device 3) emits a beep when it completes cooking rice, the beep triggers the output of notification information from the notification device 2. Therefore, even if the user U1 is not in a location where he or she can hear the beep, he or she can notice that an event has occurred in the rice cooker (device 3) that the rice cooking operation has been completed, and can respond to the event. Furthermore, even if the user U1 cannot understand what event has occurred in the device 3 just by hearing the beep, he or she can notice that an event has occurred in the rice cooker (device 3) that the rice cooking operation has been completed, and can respond to the event.

[0060] (Modifications) As described above, the embodiments have been described as examples of the technology disclosed in this application. However, the technology in this disclosure is not limited to these, and can be applied to embodiments in which modifications, substitutions, additions, omissions, etc. are made as appropriate. Furthermore, it is also possible to combine the components described in the above embodiments to create new embodiments.

[0061] Therefore, modifications of the embodiment will be exemplified below.

[0062] In the above embodiment, the specific sound may include a human voice or an animal cry. For example, if the specific sound is a baby's crying, the processing unit 12 of the notification system 100 causes the notification device 2 to output notification information indicating the content of the event, that the baby is crying. Specifically, the processing unit 12 causes the notification device 2 to output a voice message, such as "The baby is crying." This makes it easier for the user U1 to notice that a baby is crying, for example, at a distance from the user U1.

[0063] Furthermore, for example, if the sound of a pet barking is a specific sound, the processing unit 12 of the notification system 100 causes the notification device 2 to output notification information indicating the content of the event, that is, that the pet is barking. Specifically, the processing unit 12 causes the notification device 2 to output a voice message, such as "Your pet is barking." This makes it easier for the user U1 to notice that, for example, the pet is barking at a location far away from the user U1.

[0064] Furthermore, for example, if the voice of a child calling his mother is a specific sound, the processing unit 12 of the notification system 100 causes the notification device 2 to output notification information indicating the content of the event, that is, the child calling his mother. Specifically, the processing unit 12 causes the notification device 2 to output a voice message such as "XX-chan is calling his mother." This makes it easier for the user U1 to notice that, for example, a child is calling his mother at a location far away from him.

[0065] In the above-described embodiment, the notification system 100 may be realized by a device other than the server 1. An example in which the notification system is realized by a device other than the server 1 will be described below with reference to FIG. 7. FIG. 7 is a block diagram showing an overall configuration including a notification system 100A according to a modified embodiment. The notification system 100A shown in FIG. 7 is configured with a sound collection device 4. The sound collection device 4 includes a microphone 41, an acquisition unit 11, a processing unit 12, and a storage unit 13. The sound collection device 4 is also configured to be able to communicate with the notification device 2 via, for example, a LAN (Local Area Network). In this way, the notification system 100A shown in FIG. 7 is realized by the sound collection device 4, which is a device other than the server 1.

[0066] Furthermore, for example, in the above embodiment, notification system 100 is realized as a single device, but it may also be realized by multiple devices. When notification system 100 is realized by multiple devices, the components of notification system 100 may be distributed in any manner among the multiple devices. For example, some of the components of notification system 100 in the above embodiment may be provided in the facility where user U1 resides. In other words, the present disclosure may be realized by cloud computing or edge computing.

[0067] An example of a notification system realized by multiple devices will be described below with reference to FIG. 8 . FIG. 8 is a block diagram showing an overall configuration including a notification system 100B according to another variation of the embodiment. The notification system 100B shown in FIG. 8 is composed of a sound collection device 4 and a server 1. The sound collection device 4 includes a microphone 41, an acquisition unit 11, a specific processing unit 12A, and a storage unit 13. The server 1 includes an output processing unit 12B. The specific processing unit 12A has some of the functions of the processing unit 12 and executes processing to identify the content of an event that occurred in the device 3 corresponding to the specific sound based on sound information acquired by the acquisition unit 11. The output processing unit 12B has some of the functions of the processing unit 12 and executes processing to output notification information indicating the content of the identified event from the notification device 2. As such, in the notification system 100B shown in FIG. 8 , the processing executed by the notification system 100 is distributed between the sound collection device 4 and the server 1.

[0068] Furthermore, for example, in the above-described embodiment, all or some of the components of notification system 100 of the present disclosure may be configured with dedicated hardware, or may be realized by executing a software program suitable for each component. Each component may be realized by a program execution unit such as a CPU (Central Processing Unit) or a processor reading and executing a software program recorded on a recording medium such as an HDD (Hard Disk Drive) or semiconductor memory.

[0069] Furthermore, the components of the notification system 100 of the present disclosure may be configured as one or more electronic circuits. Each of the one or more electronic circuits may be a general-purpose circuit or a dedicated circuit.

[0070] The one or more electronic circuits may include, for example, a semiconductor device, an integrated circuit (IC), or a large-scale integration (LSI). The IC or LSI may be integrated on a single chip or on multiple chips. Although the IC or LSI is referred to here as an IC or LSI, the name may vary depending on the degree of integration, and may be called a system LSI, a very large-scale integration (VLSI), or an ultra-large-scale integration (ULSI). A field programmable gate array (FPGA), which is programmed after the LSI is manufactured, can also be used for the same purpose.

[0071] Furthermore, the general or specific aspects of the present disclosure may be realized as a system, device, method, integrated circuit, or computer program. Alternatively, the present disclosure may be realized as a computer-readable non-transitory recording medium, such as an optical disc, HDD, or semiconductor memory, on which the computer program is stored. For example, the present disclosure may be realized as a program for causing a computer to execute the notification method of the above-described embodiment. Furthermore, the program may be recorded on a computer-readable non-transitory recording medium, such as a CD-ROM, or may be distributed via a communication channel, such as the Internet.

[0072] As described above, the embodiments have been described as examples of the technology in the present disclosure, and for that purpose, the accompanying drawings and detailed description have been provided.

[0073] Therefore, the components shown in the accompanying drawings and detailed description may include not only essential components for solving the problem, but also components that are not essential for solving the problem in order to illustrate the above technology. Therefore, the fact that these non-essential components are shown in the accompanying drawings or detailed description should not be interpreted as immediately indicating that these non-essential components are essential.

[0074] Furthermore, since the above-described embodiments are intended to illustrate the technology of the present disclosure, various modifications, substitutions, additions, omissions, etc. may be made within the scope of the claims or their equivalents.

[0075] (Summary) As described above, the notification systems 100, 100A, 100B according to the first aspect include the acquisition unit 11 and the processing unit 12. The acquisition unit 11 acquires sound information indicating a specific sound including at least one of a beep sound and an operation sound emitted by the device 3. The processing unit 12 identifies the content of an event that occurred in the device 3 corresponding to the specific sound based on the sound information acquired by the acquisition unit 11, and causes the notification device 2 to output notification information indicating the content of the identified event.

[0076] This has the advantage that the content of the event corresponding to the specific sound emitted by the device 3 is output from the notification device 2, making it easier for the user U1 to notice that an event has occurred in the device 3.

[0077] In the notification systems 100, 100A, and 100B according to the second aspect, in the first aspect, correspondence information indicating the correspondence between the specific sound and the content of the event is stored in the storage unit 13. The processing unit 12 refers to the correspondence information stored in the storage unit 13 to identify the content of the event corresponding to the specific sound.

[0078] This has the advantage that the content of the event that has occurred in the device 3 can be more easily notified to the user U1 with high accuracy, since the content of the event can be more easily identified by referring to the correspondence information.

[0079] In addition, in the notification systems 100, 100A, and 100B relating to the third aspect, in the second aspect, if the specific sound indicated by the sound information is not included in the corresponding information, the processing unit 12 outputs prompting information from the notification device 2 to prompt the user U1 to register the content of the event corresponding to the specific sound.

[0080] This has the advantage that it is expected that user U1 who receives the prompt information will register a new specific sound in the corresponding information, and therefore it is expected that notification device 2 will be able to notify user U1 of new specific sounds as well.

[0081] In addition, in the notification systems 100, 100A, 100B according to the fourth aspect, in any one of the first to third aspects, the specific sound includes a human voice or an animal cry.

[0082] This has the advantage that the content of the event corresponding to a human voice or an animal cry is output from the notification device 2, making it easier for user U1 to notice that an event related to a human or animal has occurred.

[0083] In addition, in the notification system 100 according to the fifth aspect, in any one of the first to fourth aspects, the specific sound is picked up by a sound collection device 4 located around the device 3. The acquisition unit 11 acquires sound information by communicating with the sound collection device 4.

[0084] This has the advantage that the notification device 2 can notify the user U1 of specific sounds emitted by a device 3 located far from the notification device 2, making it easier for the user U1 to notice events occurring in the device 3 located far away.

[0085] Furthermore, the notification device 2 according to the sixth aspect includes an instruction acquisition unit 21 and an output unit 22. The instruction acquisition unit 21 acquires an instruction to output notification information from the notification system 100 according to any one of the first to fifth aspects. The output unit 22 outputs the notification information when the instruction acquisition unit 21 acquires the instruction.

[0086] This has the advantage that the content of the event corresponding to the specific sound emitted by the device 3 is output from the notification device 2, making it easier for the user U1 to notice that an event has occurred in the device 3.

[0087] In addition, in a notification method according to a seventh aspect, sound information indicating a specific sound including at least one of a beep sound and an operation sound emitted by the device 3 is acquired (S1), and the content of an event that occurred in the device 3 and corresponds to the specific sound is identified based on the acquired sound information (S2), and notification information indicating the content of the identified event is output from the notification device 2 (S3).

[0088] This has the advantage that the content of the event corresponding to the specific sound emitted by the device 3 is output from the notification device 2, making it easier for the user U1 to notice that an event has occurred in the device 3.

[0089] A program according to an eighth aspect causes one or more processors to execute the notification method according to the seventh aspect.

[0090] This has the advantage that the content of the event corresponding to the specific sound emitted by the device 3 is output from the notification device 2, making it easier for the user U1 to notice that an event has occurred in the device 3.

[0091] The present disclosure is applicable to a system that notifies a user of the content of an event that has occurred in a device.

[0092] REFERENCE SIGNS LIST 1 Server 11 Acquisition unit 12 Processing unit 12A Specific processing unit 12B Output processing unit 13 Storage unit 2 Notification device 21 Instruction acquisition unit 22 Output unit 3 Device 4 Sound collection device 41 Microphone 5 Information terminal 100, 100A, 100B Notification system U1 User

Claims

1. A notification system comprising: an acquisition unit that acquires sound information indicating a specific sound, including at least one of a beep sound and an operation sound emitted by a device; and a processing unit that identifies the content of an event that has occurred in the device corresponding to the specific sound based on the sound information acquired by the acquisition unit, and outputs notification information indicating the identified content of the event from a notification device.

2. The notification system of claim 1, wherein correspondence information indicating the correspondence between the specific sound and the content of the event is stored in a memory unit, and the processing unit identifies the content of the event corresponding to the specific sound by referring to the correspondence information stored in the memory unit.

3. The notification system of claim 2, wherein the processing unit, when the specific sound indicated by the sound information is not included in the correspondence information, outputs from the notification device prompting information prompting the user to register the contents of the event corresponding to the specific sound.

4. The notification system according to any one of claims 1 to 3, wherein the specific sound includes a human voice or an animal cry.

5. The notification system according to any one of claims 1 to 3, wherein the specific sound is picked up by a sound-collecting device located around the device, and the acquisition unit acquires the sound information by communicating with the sound-collecting device.

6. A notification device comprising: an instruction acquisition unit that acquires an instruction to output the notification information from the notification system according to any one of claims 1 to 3; and an output unit that outputs the notification information when the instruction acquisition unit acquires the instruction.

7. A notification method comprising: acquiring sound information indicating a specific sound, including at least one of a beep sound and an operation sound emitted by a device; identifying an event that occurred in the device corresponding to the specific sound based on the acquired sound information; and outputting notification information indicating the identified event from a notification device.

8. A program causing one or more processors to execute the notification method according to claim 7.

Citation Information

Patent Citations

  • Consumer electronics administrative system, consumer electronics, remote-control device, and robot

    JP2016076799A

  • Robot cleaner and method for controlling a robot cleaner

    US20150052703A1

  • Information processing device, information processing method, and information processing program

    WO2020195821A1