Information processing apparatus, information processing method, and information processing system

Abstract

To provide an information processing device, an information processing method, and an information processing system capable of causing a self-propelled device to execute a more appropriate operation.SOLUTION: The information processing apparatus includes a noise detection unit configured to detect noise in a vicinity of an output apparatus capable of outputting audio content, a listening situation determination unit configured to determine whether a user is listening to the audio content output from the output apparatus, and an information setting unit configured to set information regarding driving of a self-propelled apparatus in accordance with a magnitude of the noise detected by the noise detection unit when the listening situation determination unit determines that the user is listening to the audio content.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present disclosure relates to an information processing device, an information processing method, and an information processing system. [Background technology]

[0002] Conventionally, systems that create a cleaning plan for a room using a self-propelled vacuum cleaner based on the state of the room have been known. For example, Patent Document 1 discloses a self-propelled cleaning system that recognizes the state of the room based on sensor information acquired by sensors installed in the room, creates a cleaning plan for the room based on the state of the room and the position of the self-propelled vacuum cleaner, and controls the operation of the self-propelled vacuum cleaner based on the cleaning plan. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-21903 Summary of the Invention [Problem to be solved by the invention]

[0004] In the self-propelled cleaning system of Patent Document 1, the operation of the self-propelled vacuum cleaner can be controlled according to a cleaning plan created based on the state of the room. However, the operation of the self-propelled vacuum cleaner desired by the user is not necessarily determined by the state of the room. For example, the user may want the self-propelled vacuum cleaner to perform different operations depending on the user's state.

[0005] The present disclosure has been made in view of the above-mentioned problems, and an object of the present disclosure is to provide an information processing device, an information processing method, and an information processing system that are capable of causing a self-propelled device to perform more appropriate operations. [Means for solving the problem]

[0006] An information processing device according to one embodiment of the present disclosure includes a noise detection unit that detects noise in the vicinity of an output device capable of outputting audio content, a listening status determination unit that determines whether a user is listening to the audio content output from the output device, and an information setting unit that, when the listening status determination unit determines that the user is listening to the audio content, sets information regarding the operation of a self-propelled device according to the magnitude of the noise detected by the noise detection unit.

[0007] An information processing method according to one embodiment of the present disclosure is an information processing method executed by an information processing device, which detects noise in the vicinity of an output device capable of outputting audio content, determines whether a user is listening to the audio content output from the output device, and, if the listening status determination unit determines that the user is listening to the audio content, sets information regarding the operation of a self-propelled device according to the level of the noise detected by the noise detection unit.

[0008] An information processing system according to one embodiment of the present disclosure includes an information processing device and a self-propelled device, wherein the information processing device detects noise in the vicinity of an output device capable of outputting audio content, determines whether a user is listening to the audio content output from the output device, and when the listening status determination unit determines that the user is listening to the audio content, sets information regarding the operation of the self-propelled device according to the level of the noise detected by the noise detection unit, and the self-propelled device moves based on the information regarding the operation. [Effects of the Invention]

[0009] According to the present disclosure, it is possible to provide an information processing device, an information processing method, and an information processing system that are capable of causing a self-propelled device to perform more appropriate operations. [Brief explanation of the drawings]

[0010] [Figure 1]1 is a functional block diagram illustrating a schematic configuration of an information processing system according to an embodiment. [Figure 2] 10 is a flowchart showing an example of a prohibited area setting process executed in the first embodiment. [Figure 3] FIG. 10 is a schematic diagram showing an example of an initial prohibited area. [Figure 4] FIG. 10 is a schematic diagram showing an example of an expanded prohibited area. [Figure 5] FIG. 10 is a schematic diagram showing an example of a prohibited area after reduction. [Figure 6] 10 is a flowchart showing an example of a prohibited area setting process executed in the second embodiment. [Figure 7] FIG. 10 is a schematic diagram showing the relationship between volume and threshold value. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, several embodiments of the present disclosure will be described with reference to the drawings. In the drawings, identical or equivalent components are denoted by the same reference numerals, and redundant descriptions of identical or equivalent components will be omitted as appropriate.

[0012] [Overall configuration] Fig. 1 is a schematic diagram showing an example of an information processing system 1 according to an embodiment. As shown in Fig. 1, the information processing system 1 includes an information processing device 10 and a self-propelled device 30. The information processing device 10 and the self-propelled device 30 are connected to each other so that they can communicate information with each other using any communication method. The information processing device 10 and the self-propelled device 30 may be connected via a network such as the Internet, for example, or may be connected using another communication method such as Bluetooth (registered trademark) or a wireless local area network (LAN).

[0013] The information processing device 10 sets a prohibited area where the self-propelled device 30 is prohibited from traveling. The information processing device 10 can be realized by any device that is capable of setting a prohibited area. For example, the information processing device 10 can be realized by a computer, a server device, a mobile terminal such as a smartphone or a tablet terminal, or other electronic device. In the present embodiment, the information processing device 10 will be described below as being configured by an output device that can output audio content.

[0014] The output device may be any device capable of outputting at least audio content. For example, the output device may be configured as an audio device equipped with a speaker. The output device may also be capable of outputting video content. In this case, the output device may be configured as a television receiver, for example. However, examples of the output device are not limited to those described here, and may be any device capable of outputting at least audio content. In this embodiment, the following description will be given assuming that the output device is configured as a television receiver (hereinafter also referred to as a "television").

[0015] The self-propelled device 30 is a device that can travel autonomously based on a signal from an internal control mechanism or an external device. The self-propelled device 30 can be configured, for example, as a self-propelled robot vacuum cleaner that cleans while traveling autonomously, a food delivery robot that delivers food, or a care device that assists in nursing care. The self-propelled device 30 travels within a predetermined range, such as a room in a home or a specific facility such as a hospital or nursing home. However, examples of the self-propelled device 30 are not limited to those described herein, and can be any device that can travel autonomously. In this embodiment, the self-propelled device 30 will be described below as being configured as a self-propelled robot vacuum cleaner.

[0016] In this embodiment, the information processing device 10 determines a travel area for the self-propelled device 30, and the self-propelled device 30 travels in the travel area determined by the information processing device 10. For example, the information processing device 10 determines the travel area by excluding prohibited areas from the area in which the self-propelled device 30 is to travel. The area in which the self-propelled device 30 travels is, for example, an area designated by a user. If the self-propelled device is a self-propelled robot vacuum cleaner, the area in which the self-propelled device 30 travels is a designated area or room to be cleaned. In this specification, the area in which the self-propelled device 30 is to travel is also referred to as a "target area." The self-propelled device 30 travels so as not to enter the prohibited areas set by the information processing device 10. Note that the information processing device 10 may further determine a travel route for the self-propelled device 30.

[0017] As shown in FIG. 2, the information processing device 10 includes, as functional units, a control unit 11, a memory unit 12, a communication unit 13, a display unit 14, an audio output unit 15, an input unit 16, a noise detection unit 17, a hearing condition determination unit 18, an information setting unit 19, an audio input unit 20, and an imaging unit 21.

[0018] The control unit 11 controls and manages the entire information processing device 10, including each functional unit of the information processing device 10. The control unit 11 performs various controls, for example, by running a control program stored in the storage unit 12. For example, the control unit 11 can be configured by a control device such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit).

[0019] The storage unit 12 is a storage medium capable of storing programs and data. The storage unit 12 can be configured, for example, with a semiconductor memory or a magnetic memory. Specifically, the storage unit 12 can be configured, for example, with an EEPROM (Electrically Erasable Programmable Read-Only Memory). The storage unit 12 may store, for example, a program for operating the control unit 11.

[0020] The communication unit 13 executes information communication with an external device. In this embodiment, the communication unit 13 executes information communication with the self-propelled device 30. The communication unit 13 executes information communication, for example, wirelessly. The communication unit 13 transmits and receives various information through information communication. The communication unit 13 also receives signals transmitted from a remote controller (hereinafter also referred to as a "remote control") for remotely operating the information processing device 10.

[0021] The display unit 14 is a device that displays images or videos. The display unit 14 is configured with a well-known display such as a liquid crystal display (LCD), an organic electro-luminescence display (ELD), or an inorganic electro-luminescence display (IELD). The display unit 14 displays various information under the control of the control unit 11. For example, the display unit 14 can output video content.

[0022] The audio output unit 15 is a device that outputs audio. The audio output unit 15 is configured with one or more speakers that output audio. The audio output unit 15 outputs audio under the control of the control unit 11. For example, the audio output unit 15 outputs audio content.

[0023] The input unit 16 is a mechanism capable of receiving operation input from a user to the information processing device 10. The input unit 16 is configured by, for example, a group of operation buttons provided on the main body of the information processing device 10, a keyboard, etc. Furthermore, if the display unit 14 is provided with a touch sensor, the touch sensor provided on the display unit 14 may function as the input unit 16.

[0024] The noise detection unit 17, the hearing condition determination unit 18, and the information setting unit 19 may each be configured by hardware such as a different processor, or may function as a functional unit of the control unit 11.

[0025] The noise detection unit 17 detects noise in the vicinity of an output device capable of outputting audio content. In this embodiment, since the information processing device 10 is configured by an output device, the noise detection unit 17 detects noise in the vicinity of the information processing device 10. Specifically, the noise detection unit 17 acquires an audio signal of audio acquired by the audio input unit 20. Note that, in this specification, noise may include any sound that may interfere with the user's ability to hear the target sound, regardless of the loudness of the sound. Therefore, in this specification, quiet noise may also be included in the term noise.

[0026] Here, the audio input unit 20 is a device capable of acquiring ambient audio, and specifically, for example, a microphone. In the example shown in FIG. 1, the audio input unit 20 is included in the information processing device 10. Therefore, in the example shown in FIG. 1, the audio input unit 20 is configured, for example, by a microphone built into the information processing device 10. However, the audio input unit 20 does not necessarily have to be included in the information processing device 10. The audio input unit 20 may be an external microphone connected to the information processing device 10. It is sufficient that the audio input unit 20 is configured to be able to acquire ambient audio around the information processing device 10.

[0027] The noise detection unit 17 detects noise in the vicinity of the information processing device 10, for example, by extracting components corresponding to noise from an audio signal acquired from the audio input unit 20. For example, the noise detection unit 17 can extract components corresponding to noise by excluding components corresponding to audio content output from the audio output unit 15 of the information processing device 10 from the audio signal. Note that the vicinity of the information processing device 10 refers to a predetermined range around the information processing device 10, for example, a range in which audio can be acquired by the audio input unit 20. Therefore, it is preferable to arrange the audio input unit 20 in a position closer to the information processing device 10.

[0028] The listening condition determination unit 18 determines whether or not the user is listening to audio content output from the output device. In this embodiment, since the output device is configured as a television, the listening condition determination unit 18 determines whether or not the user is watching content (audio content and video content) output from the television. Specifically, the listening condition determination unit 18 acquires a video signal of a video captured by the imaging unit 21.

[0029] Here, the imaging unit 21 is a device capable of capturing video, specifically, for example, a camera. In the example shown in FIG. 1, the imaging unit 21 is included in the information processing device 10. Therefore, in the example shown in FIG. 1, the imaging unit 21 is configured by, for example, a camera built into the information processing device 10. However, the imaging unit 21 does not necessarily have to be included in the information processing device 10. The imaging unit 21 may be an external camera connected to the information processing device 10. The imaging unit 21 is disposed in a position where it can capture an image of, for example, a user watching television. As an example, the imaging unit 21 is disposed in a position where it can capture an image of the front side of the television. When a user is watching television in front of the television, the image captured by the imaging unit 21 includes the user watching television. However, the placement of the imaging unit 21 is not limited to this, and for example, the imaging unit 21 may be disposed so as to capture an image of a part or the entire room in which the output device is disposed.

[0030] The listening situation determination unit 18 determines whether the user is watching television, for example, based on a video signal acquired from the imaging unit 21. For example, the listening situation determination unit 18 analyzes the video represented by the video signal and determines whether the user's line of sight detected by the imaging unit 21 is directed toward the display unit 14. The listening situation determination unit 18 can determine whether the user's line of sight is directed toward the television's display unit 14 using known technology. If the user's line of sight is directed toward the television's display unit 14, the listening situation determination unit 18 determines that the user is watching television, i.e., that the user is listening to audio content output from the output device. On the other hand, if the user's line of sight is not directed toward the television's display unit 14, the listening situation determination unit 18 determines that the user is not watching television, i.e., that the user is not listening to audio content output from the output device.

[0031] The method by which the listening situation determination unit 18 determines whether or not the user is listening to audio content is not limited to the above example, and other methods may be used. For example, the listening situation determination unit 18 may determine whether or not the user is listening to audio content based on whether or not the user is in front of the television, whether or not the audio content is being output from an output device, etc.

[0032] The information setting unit 19 sets information related to the driving of the self-propelled device 30. In this embodiment, the information setting unit 19 sets, as information related to driving, a prohibited area where the self-propelled device 30 is prohibited from driving. That is, in this embodiment, the information setting unit 19 sets a prohibited area where the self-propelled device 30 is prohibited from driving. For example, when the hearing condition determination unit 18 determines that the user is listening to audio content, the information setting unit 19 can set the prohibited area according to the level of noise detected by the noise detection unit 17. Details of how the information setting unit 19 sets the prohibited area will be described later. Note that, when the hearing condition determination unit 18 determines that the user is not listening to audio content, the information setting unit 19 does not need to set the prohibited area. Alternatively, when the hearing condition determination unit 18 determines that the user is not listening to audio content and a prohibited area has been set, the information setting unit 19 may cancel the set prohibited area. In this case, the prohibited area is removed from the target area, and the entire target area becomes the driving area.

[0033] The information setting unit 19 may acquire information about the target area when setting the prohibited area. The information about the target area is, for example, map information about the target area (e.g., a room to be cleaned) to be cleaned by the self-propelled robot vacuum cleaner constituting the self-propelled device 30. The map information is, for example, created in advance by a known method and stored in the memory unit 12 of the information processing device 10, the memory unit 32 of the self-propelled device 30, or a memory unit of another device.

[0034] As shown in FIG. 2, the self-propelled device 30 includes, as functional units, a control unit 31, a storage unit 32, a communication unit 33, and a driven unit .

[0035] The control unit 31 controls and manages the entire self-propelled device 30, including each functional unit of the self-propelled device 30. The control unit 31 performs various controls, for example, by running a control program stored in the storage unit 32. For example, the control unit 31 can be configured with a control device such as a CPU or an MPU.

[0036] The storage unit 32 is a storage medium capable of storing programs and data. The storage unit 32 can be configured, for example, with a semiconductor memory or a magnetic memory. Specifically, the storage unit 32 can be configured, for example, with an EEPROM. The storage unit 32 may store, for example, a program for operating the control unit 31. The storage unit 32 may also store, for example, the map information described above.

[0037] The communication unit 33 executes information communication with an external device. In this embodiment, the communication unit 33 executes information communication with the information processing device 10. The communication unit 33 executes information communication, for example, wirelessly. The communication unit 33 transmits and receives various information through information communication.

[0038] The driven unit 34 is a mechanism for executing the functions of the self-propelled device 30. For example, the driven unit 34 includes a motor that drives wheels for travel. If the self-propelled device 30 is a self-propelled robot vacuum cleaner, the driven unit 34 includes a mechanism for cleaning. The driven unit 34 may have a known configuration and operates based on the control of the control unit 31.

[0039] Hereinafter, several embodiments of setting the prohibited area by the information processing device 10 will be described.

[0040] [First embodiment] Fig. 2 is a flowchart showing an example of a prohibited area setting process executed in the first embodiment. The flow in Fig. 2 is executed by the information processing device 10, for example, when the self-propelled device 30 starts operating. As a specific example, the flow in Fig. 2 is executed when, for example, a user performs an operation input to start cleaning by the self-propelled robot vacuum cleaner, and the self-propelled robot vacuum cleaner starts cleaning. For example, when the self-propelled device 30 starts operating, the information processing device 10 can recognize that the self-propelled device 30 has started operating by receiving a signal from the self-propelled device 30 indicating that the self-propelled device 30 has started operating.

[0041] The information processing device 10 first determines whether or not the user is listening to audio content (step S11). For example, the listening status determination unit 18 determines whether or not the user is listening to audio content using the above-described method based on the video signal acquired from the imaging unit 21.

[0042] If the listening situation determination unit 18 determines that the user is not listening to the audio content (No in step S11), the information setting unit 19 cancels the set prohibited area if one has been set (step S20). Then, this flow ends. When the flow ends, the information processing device 10 transmits the processing result of the flow to the self-propelled device 30 via the communication unit. In this example, the information processing device 10 transmits information indicating that the prohibited area has been canceled to the self-propelled device 30. In this case, the self-propelled device 30 travels throughout the entire target area based on the information received from the information processing device 10. Alternatively, the information processing device 10 may determine a travel route for the self-propelled device 30 based on the processing result of the flow. In this case, the information processing device 10 transmits information of the determined travel route to the self-propelled device 30, and the self-propelled device 30 travels according to the received travel route information.

[0043] On the other hand, if the listening situation determination unit 18 determines that the user is listening to audio content (Yes in step S11), the information setting unit 19 acquires map information related to the target area (step S12). If the map information is stored in the storage unit 12, the information setting unit 19 acquires the map information by reading out the map information stored in the storage unit 12. If the map information is stored in an external device, the information setting unit 19 can acquire the map information by transmitting a signal requesting the map information to the external device and receiving the map information transmitted in response to the signal via the communication unit 13.

[0044] Next, the information setting unit 19 initializes the prohibited area (step S13). For example, information on an initial prohibited area related to the target region is stored in advance in the storage unit 12 or in a storage unit of an external device. The information setting unit 19 can acquire the information on the initial prohibited area by reading the information on the initial prohibited area from the storage unit 12, or by the information processing device 10 receiving the information on the initial prohibited area from an external device. The information setting unit 19 initializes the prohibited area by setting the acquired initial prohibited area as the prohibited area.

[0045] The initial prohibited area is set, for example, when the map is created by the information processing device 10, the self-propelled device 30, or another device. When the initial prohibited area is set by the information processing device 10, the self-propelled device 30, or another device, the initial prohibited area is set using a predetermined algorithm. Alternatively, the initial prohibited area may be set based on, for example, a user's specification.

[0046] Fig. 3 is a schematic diagram showing an example of an initial prohibited area. Fig. 3 is a plan view showing a part of a target area. In the target area, for example, an information processing device 10 constituted by a television and a sofa 40 exist. The sofa 40 is placed on the front side (lower side in Fig. 3) of the television constituting the information processing device 10. In the example of Fig. 3, the initial prohibited area A0 is set as an area on the front side of the television, with a predetermined range surrounding the sofa 40.

[0047] After initializing the prohibited area in step S13, the information setting unit 19 transmits information about the initialized prohibited area to the self-propelled device 30. The self-propelled device 30 travels in the target area excluding the initialized prohibited area. Steps S14 to S19 are executed while the self-propelled device 30 is traveling in the target area excluding the prohibited area.

[0048] Next, the information setting unit 19 executes a loop process for setting the prohibited area. Specifically, the information setting unit 19 executes a loop process for setting the prohibited area from step S14 to step S18.

[0049] The information setting unit 19 acquires information about the noise volume from the noise detection unit 17 (step S14). Specifically, the noise detection unit 17 detects noise using the method described above based on the audio signal acquired from the audio input unit 20. The information setting unit 19 acquires information about the noise detected by the noise detection unit 17. The information setting unit 19 can acquire the noise volume by determining the noise volume based on the acquired noise information. Alternatively, the noise detection unit 17 may determine the volume of the detected noise and provide information about the determined noise volume to the information setting unit 19.

[0050] Here, the sound acquired by the sound input unit 20 includes the traveling sound of the self-propelled device 30 traveling in the target area and the cleaning sound of the self-propelled robot vacuum cleaner that constitutes the self-propelled device 30. Therefore, the loudness of the noise acquired in step S14 reflects the loudness of the noise caused by the sound generated by the self-propelled device 30.

[0051] The information setting unit 19 determines whether the noise level acquired in step S14 is within a predetermined range (step S15). The predetermined range is defined as the range between a first threshold value T1 and a second threshold value T2 that is smaller than the first threshold value T1. In other words, the predetermined range is defined as a range that is larger than the second threshold value T2 and smaller than the first threshold value T1.

[0052] The first threshold T1 and the second threshold T2 may be determined as appropriate. For example, the first threshold T1 and the second threshold T2 are determined by the information processing device 10 or an external device. The first threshold T1 and the second threshold T2 may be determined based on the position and / or size of the initial prohibited area. The first threshold T1 is set, for example, as a threshold for determining whether the prohibited area should be expanded. The second threshold T2 is set, for example, as a threshold for determining whether the prohibited area can be reduced.

[0053] If the information setting unit 19 determines that the noise volume acquired in step S14 is not within the predetermined range (No in step S15), the information setting unit 19 proceeds to step S16. For example, if the noise volume is equal to or greater than the first threshold T1 or equal to or less than the second threshold, the information setting unit 19 determines that the noise volume is not within the predetermined range.

[0054] If the information setting unit 19 determines that the noise volume is not within the predetermined range (No in step S15), it then determines whether the noise volume is equal to or greater than the first threshold value T1 (step S16). Note that if the noise volume is not equal to or greater than the first threshold value T1, this means that the noise volume is equal to or less than the second threshold value T2, since the No in step S15 has determined that the noise volume is not within the range greater than the second threshold value T2 and less than the first threshold value T1.

[0055] If the information setting unit 19 determines that the noise level is equal to or greater than the first threshold T1 (Yes in step S16), it expands the prohibited area (step S17). For example, assume that the prohibited area is set as an initial prohibited area A0. In this state, if the information setting unit 19 determines that the noise level is equal to or greater than the first threshold T1, it expands the prohibited area from the initial prohibited area A0 to an expanded prohibited area A1, as shown in FIG. 4, for example. The expansion width may be predetermined. Alternatively, the expansion width may be determined based on, for example, the difference between the noise level acquired in step S14 and the first threshold T1. In other words, the expansion width may be set to be larger as the difference between the noise level acquired in step S14 and the first threshold T1 increases.

[0056] If the information setting unit 19 determines that the noise level is not equal to or greater than the first threshold T1 (No in step S16), it narrows the prohibited area (step S18). As described above, if the noise level is not equal to or greater than the first threshold T1, the noise level is equal to or less than the second threshold T2. In this case, the information setting unit 19 narrows the prohibited area. For example, assume that the prohibited area is set as an initial prohibited area A0. In this state, if the information setting unit 19 determines that the noise level is not equal to or greater than the first threshold T1 (i.e., equal to or less than the second threshold T2), it narrows the prohibited area from the initial prohibited area A0 to a reduced prohibited area A2, as shown in FIG. 5, for example. The reduction amount may be predetermined. Alternatively, the reduction amount may be determined based on, for example, the difference between the noise level acquired in step S14 and the second threshold T2. In other words, the reduction amount may be set to be larger as the difference between the noise level acquired in step S14 and the second threshold T2 increases.

[0057] When the information setting unit 19 changes (expands or reduces) the prohibited area in step S17 or step S18, it transmits information about the changed prohibited area to the self-propelled device 30. The self-propelled device 30 travels in the target area excluding the changed prohibited area. After that, the process is executed in a state in which the self-propelled device 30 travels in the target area excluding the prohibited area. In other words, if the prohibited area is expanded in step S17, the area in which the self-propelled device 30 travels becomes narrower, and if the prohibited area is reduced in step S18, the area in which the self-propelled device 30 travels becomes wider.

[0058] Then, the information setting unit 19 proceeds to step S14. In this case, the sound generated from the self-propelled device 30 traveling in an area excluding the changed prohibited area is acquired by the sound input unit 20 as noise.

[0059] When the prohibited area is expanded in step S17, the area in which the self-propelled device 30 travels becomes narrower. As a result, the self-propelled device 30 travels farther from the television, as shown in Fig. 4. Therefore, the noise of the self-propelled device 30 acquired by the audio input unit 20 becomes smaller.

[0060] On the other hand, if the prohibited area is reduced in step S18, the area in which the self-propelled device 30 travels becomes wider. As a result, the self-propelled device 30 travels closer to the television, as shown in Fig. 5. Therefore, the noise of the self-propelled device 30 acquired by the audio input unit 20 becomes louder.

[0061] Therefore, after the prohibited area is changed in step S17 or step S18, the noise level acquired in step S14 falls within the predetermined range, or at least approaches the predetermined range. Therefore, by performing the loop process from step S14 to step S18, or by repeating this loop process, the noise level acquired in step S14 will fall within the predetermined range.

[0062] In step S15, if the information setting unit 19 determines that the noise level acquired in step S14 is within a predetermined range (Yes in step S15), it sets a prohibited area as a result of the loop processing. Specifically, the information setting unit 19 sets the prohibited area when it is determined that the noise level is within the predetermined range as the prohibited area as a result of the loop processing.

[0063] When the information setting unit 19 determines the prohibited area in step S19, it transmits information about the determined prohibited area to the self-propelled device 30. The self-propelled device 30 performs operation by traveling through the target area excluding the determined prohibited area. For example, the self-propelled device 30 cleans while traveling through the area excluding the determined prohibited area.

[0064] In this way, when the user is listening to audio content, the information setting unit 19 sets the prohibited area according to the volume of the noise. For example, when the noise is equal to or greater than the first threshold T1, the prohibited area is expanded. When the noise is equal to or greater than the first threshold T1, the noise is loud and it may be difficult for the user to listen to the audio content. Therefore, the information processing device 10 can make it easier for the user to listen to the audio content by expanding the prohibited area and narrowing the area in which the self-propelled device 30 can travel. In other words, the user can listen to the audio content even while the self-propelled device 30 is traveling.

[0065] On the other hand, when the noise is equal to or less than the second threshold T2, the noise is low, so the user can listen to the audio content even if the noise becomes louder. Furthermore, by reducing the prohibited area, the self-propelled device 30 can more easily achieve the purpose of its operation (cleaning in this embodiment). Therefore, by reducing the prohibited area and widening the area in which the self-propelled device 30 can travel, the information processing device 10 can expand the travel area of ​​the self-propelled device 30 while ensuring ease of listening to the audio content for the user, thereby making it easier to achieve the purpose. In this way, the information processing device 10 can cause the self-propelled device 30 to perform a more appropriate operation depending on the situation.

[0066] [Second embodiment] 6 is a flowchart showing an example of a prohibition area setting process executed in the second embodiment. In the second embodiment, the information setting unit 19 determines at least one of the first threshold value T1 and the second threshold value T2. That is, in the second embodiment, at least one of the first threshold value T1 and the second threshold value T2 is variable. The setting process executed in the second embodiment will be described while omitting explanations of the same points as in the first embodiment as appropriate. Note that in this embodiment, the information setting unit 19 will be described as determining both the first threshold value T1 and the second threshold value T2.

[0067] Similar to the first embodiment, the information processing apparatus 10 executes steps S11 to S13. Then, the information setting unit 19 executes a loop process for setting a prohibited area. In the second embodiment, the information setting unit 19 executes a loop process for setting a prohibited area in steps S21 and S14 to S18.

[0068] In the loop process of the second embodiment, the information setting unit 19 determines a first threshold value T1 and a second threshold value T2 (step S21). Specifically, the information setting unit 19 determines the first threshold value T1 and the second threshold value T2 based on volume information regarding the volume of the audio content output from the output device.

[0069] The volume information is information regarding the volume set for the output device, and for example, is information obtained by quantifying the volume that the user has the output device output. The user can set (adjust) the volume, for example, by operating a remote control or by operating operation buttons or the like that constitute the input unit 16. The control unit 11 controls the volume output from the audio output unit 15 based on the user's operation input. The information setting unit 19 acquires the volume information regarding the volume set in this way, and determines the first threshold value T1 and the second threshold value T2 based on the volume information.

[0070] For example, when the volume of the audio content is large, the information setting unit 19 sets the first threshold value T1 and the second threshold value T2 higher than when the volume of the audio content is small. Conversely, when the volume of the audio content is small, the information setting unit 19 sets the first threshold value T1 and the second threshold value T2 lower than when the volume of the audio content is large.

[0071] FIG. 7 is a schematic diagram showing the relationship between the volume and the threshold values determined by the information setting unit 19 in the second embodiment. In FIG. 7, volume V1, volume V2, and volume V3 are shown. Volume V1 is smaller than volume V2, and volume V2 is smaller than volume V3. That is, V1 < V2 < V3. In FIG. 7, the horizontal axis represents the magnitude of the noise.

[0072] As shown in, for example, FIG. 7, when the volume set for the output device is V1, the information setting unit 19 determines the level N11 of the noise magnitude as the first threshold value T1; when the volume set for the output device is V2, the information setting unit 19 determines the level N12 of the noise magnitude as the first threshold value T1; and when the volume set for the output device is V3, the information setting unit 19 determines the level N13 of the noise magnitude as the first threshold value T1. Here, N11 < N12 < N13. In this way, when the volume of the audio content is large, the information setting unit 19 can determine the first threshold value T1 to be higher than when the volume of the audio content is small.

[0073] Similarly, as shown in, for example, FIG. 7, when the volume set for the output device is V1, the information setting unit 19 determines the level N21 of the noise magnitude as the second threshold value T2; when the volume set for the output device is V2, the information setting unit 19 determines the level N22 of the noise magnitude as the second threshold value T2; and when the volume set for the output device is V3, the information setting unit 19 determines the level N23 of the noise magnitude as the second threshold value T2. Here, N21 < N22 < N23. In this way, when the volume of the audio content is large, the information setting unit 19 can determine the second threshold value T2 to be higher than when the volume of the audio content is small.

[0074] The relationship between the volume and the threshold values as shown in FIG. 7 may be stored in the storage unit 12 in a form such as a table, for example, or may be calculated by the information setting unit 19 using a mathematical formula or the like stored in the storage unit 12. Note that the information setting unit 19 does not necessarily determine the first threshold value T1 and the second threshold value T2 by the method described here, and may determine them by other methods. Also, the information setting unit 19 may determine only one of the first threshold value T1 and the second threshold value T2. In this case, the other of the first threshold value T1 and the second threshold value T2 may be, for example, a constant value (fixed value).

[0075] 6 again, the information setting unit 19 acquires noise loudness information from the noise detection unit 17 (step S14). Then, the information setting unit 19 determines whether the noise loudness acquired in step S14 is within a predetermined range (step S15). In the second embodiment, the predetermined range used as the determination criterion in step S15 is determined by the first threshold value T1 and the second threshold value T2 determined in step S21. That is, the predetermined range used as the determination criterion in step S15 is determined as a range greater than the second threshold value T2 and less than the first threshold value T1.

[0076] The processes from step S15 to step S18 are the same as those in the first embodiment, and therefore detailed description thereof will be omitted here. If the prohibited area is changed in step S17 or step S18, the information setting unit 19 proceeds to step S21. That is, the information setting unit 19 determines the first threshold T1 and the second threshold T2 again. This is because the volume set for the output device may have been changed while the processes from step S14 to step S18 are being executed. Note that if the prohibited area is changed in step S17 or step S18, the information setting unit 19 may proceed to step S14. In this case, the values ​​initially determined in step S21 are used as the first threshold T1 and the second threshold T2.

[0077] Thus, in the second embodiment, for the same reasons as in the first embodiment, the information processing device 10 can cause the self-propelled device 30 to perform a more appropriate operation depending on the situation. In the second embodiment, the first threshold T1 and the second threshold T2 are further determined based on the volume of the audio content, and therefore the prohibited area is set taking into account the volume of the audio output from the output device. This allows the information processing device 10 to set the prohibited area more appropriately depending on the situation, and as a result, it is possible to cause the self-propelled device 30 to perform a more appropriate operation.

[0078] [Other examples of operation] In the above embodiment, the information processing device 10 has been described as being configured as an output device capable of outputting audio content. However, the information processing device 10 does not necessarily have to be configured as an output device. For example, the information processing device 10 may be configured as a separate device that is different from the output device capable of outputting audio content. In other words, the information processing device 10 and the output device may be separate, separate devices.

[0079] In the above embodiment, when the self-propelled device 30 starts operating, the information processing device 10 or the self-propelled device 30 may determine a travel route for the self-propelled device 30 in the target area. In other words, when the self-propelled device 30 starts operating, the route for the self-propelled device 30 to travel in the target area may be determined. The control unit 11 of the information processing device 10 may notify the user of route information regarding the travel route for the self-propelled device 30. In other words, the information processing device 10 may notify the user in advance of the route for the self-propelled device 30 before the self-propelled device 30 starts traveling. The information processing device 10 can notify the user by, for example, displaying the route on the display unit 14 or outputting the route as audio from the audio output unit 15. This allows the user to know the travel route for the self-propelled device 30 in advance.

[0080] In this case, the information processing device 10 may accept a change of the driving route from the user. The user can, for example, perform a predetermined operational input to change the driving route. The user can perform the predetermined operational input to change the driving route, for example, by operating a remote control or an operation button or the like that constitutes the input unit 16. When changing the driving route, for example, candidate driving routes that can be changed are presented to the user, and the user can select from the candidates or freely create a new driving route. The control unit 11 of the information processing device 10 changes the driving route of the self-propelled device 30 based on the predetermined operational input by the user. When the driving route is changed, the self-propelled device 30 drives according to the changed driving route.

[0081] In the above embodiment, the information processing device 10 may not set a prohibited area if a predetermined condition is satisfied. The predetermined condition may be, for example, an appropriate condition that is expected to prevent a user from listening to audio content. For example, the information setting unit 19 of the information processing device 10 may not set a prohibited area if audio content from the output device is output from an external speaker that the user can wear. Examples of external speakers that the user can wear include earphones, headphones, and neck speakers. The information setting unit 19 of the information processing device 10 may determine, for example, whether the output device is communicatively connected to such an external speaker. If the output device is communicatively connected to the external speaker, the information setting unit 19 determines that the audio content from the output device is output from the external speaker that the user can wear. In this case, the information setting unit 19 does not set a prohibited area. This is because, if the user is listening to audio content using the external speaker that the user can wear, it is expected that the user can listen to the audio content through the external speaker even when the self-propelled device 30 is operating.

[0082] If no prohibited areas are set, the self-propelled device 30 can travel throughout the entire target area. Therefore, for example, if the self-propelled device 30 is a self-propelled robotic vacuum cleaner, the self-propelled robotic vacuum cleaner can be made to clean the entire target area without setting any prohibited areas.

[0083] In the above embodiment, the information setting unit 19 may notify the user when the self-propelled device 30 has not traveled through at least a portion of an area set as a prohibited area for a predetermined period of time or more. For example, even if the self-propelled device 30 is operated as a self-propelled robot vacuum cleaner to clean a room, if a specific area continues to be set as a prohibited area every time the self-propelled robot vacuum cleaner cleans, the specific area will not be cleaned by the self-propelled robot vacuum cleaner. Therefore, when a certain area is set as a prohibited area and the self-propelled device 30 has not traveled through the certain area for a predetermined period of time or more, the information setting unit 19 notifies the user of this. The information setting unit 19 can notify the user by, for example, displaying a message on the display unit 14 or outputting a sound from the audio output unit 15. The predetermined period of time can be determined appropriately depending on the function of the self-propelled device 30, etc. The notification allows the user to know that the self-propelled device 30 has not traveled through the certain area for a predetermined period of time or more.

[0084] When the user recognizes a notification indicating that the self-propelled device 30 has not traveled through a certain area for a predetermined period of time or more, the user can cause the self-propelled device 30 to travel through that area. For example, the user can cause the self-propelled device 30 to travel through that area by operating a remote control or an operation button or the like that constitutes the input unit 16. At this time, if the user is listening to audio content, the self-propelled device 30 traveling through that area may make it difficult for the user to listen to the audio content. Therefore, when causing the self-propelled device 30 to travel through that area, the information processing device 10 may temporarily stop outputting the audio content until the self-propelled device 30 has finished traveling through that area. For example, if the user is watching a television program that includes video content, the information processing device 10 may stop outputting the television program and record the television program. After the self-propelled device 30 has finished traveling through that area, the information processing device 10 may play back the recorded television program in a time-shifted manner. That is, the information processing device 10 may output the recorded television program after the self-propelled device 30 has finished traveling through that area. This allows the self-propelled device 30 to travel through the partial area, and after the travel ends, the output of the audio content can be resumed.

[0085] In the above embodiment, the information setting unit 19 may expand or reduce the area set as the prohibited area depending on the genre of the audio content being output from the output device. For example, the information setting unit 19 acquires information related to the genre of the audio content to be output. The genre of the content is, for example, assigned to each piece of content in advance. The storage unit 12 also stores information related to whether the area set as the prohibited area should be expanded or reduced for each genre, and, if expanded or reduced, the extent of the expansion or reduction. The information setting unit 19 refers to the information stored in the storage unit 12 and expands or reduces the area set as the prohibited area based on the information related to the genre of the audio content to be output.

[0086] An example will be described in which the content output from the output device is a television program including audio content and video content. For example, if the genre is a movie or drama, the information setting unit 19 expands the area set as the prohibited area. This is because, in the case of a movie or drama, it is considered that a user will often want to concentrate on the content while watching. On the other hand, if the genre is a variety show or news, for example, the information setting unit 19 reduces the area set as the prohibited area. This is because, in the case of a variety show or news, it is considered that a user will be able to understand the content even if there is some noise. Note that reducing the area set as the prohibited area may include canceling the prohibited area.

[0087] In the above embodiment, the information setting unit 19 may expand or reduce the area set as the prohibited area depending on the output setting of the content. For example, in content including video content, when subtitle display is set to on, the information setting unit 19 reduces the area set as the prohibited area. This is because when subtitle display is on, even if the user cannot hear part of the audio due to noise, the subtitles allow the user to understand.

[0088] In the above embodiment, the information setting unit 19 may expand or reduce the area set as the prohibited area depending on the brightness of the room where the user is listening to the audio content. In this case, the information processing device 10 acquires information about the brightness of the room by, for example, acquiring illuminance information from an illuminance sensor that detects the brightness of the room, acquiring on / off information about lighting devices installed in the room, or estimating the brightness of the room based on the brightness of an image of the room captured by a camera. The information setting unit 19 expands or reduces the area set as the prohibited area based on the acquired information about the brightness of the room. For example, the information setting unit 19 expands the area set as the prohibited area when the room is dark. Examples of when the room is dark include when the illuminance in the room is lower than a predetermined illuminance or when the lighting device is off. When the room is dark, the user may be concentrating on watching content such as a movie. Therefore, in this case, expanding the prohibited area can make it less likely to interfere with the user's viewing of the content. Note that the example described here is merely an example, and the information setting unit 19 may expand or reduce the area set as the prohibited area as appropriate depending on the brightness of the room where the user is listening to the audio content.

[0089] In the above embodiment, the information setting unit 19 was described as setting a prohibited area where the self-propelled device 30 is prohibited from traveling as information related to driving. However, the information related to driving set by the information setting unit is not limited to a prohibited area. For example, the information setting unit 19 can set the self-propelled device 30 not to travel if the magnitude of noise detected by the noise detection unit 17 is greater than a predetermined threshold before the self-propelled device 30 travels. Alternatively, the information setting unit 19 may be set to stop the self-propelled device 30 from traveling or to move the self-propelled device 30 away from the information processing device 10 if the magnitude of noise detected by the noise detection unit 17 becomes greater than a predetermined threshold while the self-propelled device 30 is traveling.

[0090] Furthermore, if the noise level at the start of the self-propelled device 30 is already greater than the predetermined threshold, i.e., if the noise level detected by the noise detection unit 17 at the start of the self-propelled device 30 is greater than the predetermined threshold, the information setting unit 19 can be set to cancel the start of the self-propelled device 30 and stop the self-propelled device 30. In other words, in this case, the information setting unit 19 does not operate the self-propelled device 30. Alternatively, if the noise level at the start of the self-propelled device 30 is already greater than the predetermined threshold, the information setting unit 19 may set a threshold that takes into account the noise level at the start of the self-propelled device 30. The information setting unit 19 can use the threshold set in this case to make the determinations in steps S15 and S16 described in the above embodiment.

[0091] Although the present disclosure has been described based on the drawings and embodiments, it should be noted that those skilled in the art can easily make various modifications and alterations based on the present disclosure. Therefore, it should be noted that these modifications and alterations are included in the scope of the present disclosure. For example, functions included in each functional unit or step can be rearranged so as not to be logically inconsistent, and multiple functional units or steps can be combined or divided into one. [Explanation of symbols]

[0092] 1. Information Processing Systems 10. Information processing equipment 11,31 Control unit 12,32 Storage part 13,33 Communications Department 14 Display section 15 Audio output section 16 Input section 17 Noise detection unit 18 Hearing condition determination unit 19 Information setting section 20 Audio input section 21 Imaging unit 30 Self-propelled equipment 34 Driven part 40 sofa

Claims

1. a noise detection unit that detects noise in the vicinity of an output device that can output audio content; a listening status determination unit that determines whether a user is listening to the audio content output from the output device; an information setting unit that sets information regarding driving of the self-propelled device in accordance with the magnitude of the noise detected by the noise detection unit when the listening condition determination unit determines that the user is listening to the audio content; and An information processing device comprising:

2. The information processing device according to claim 1 , wherein the information setting unit sets, as the information relating to driving, a prohibited area in which the self-propelled device is prohibited from traveling.

3. 3. The information processing device according to claim 2, wherein the information setting unit sets the prohibited area by widening the prohibited area when the loudness of the noise is equal to or greater than a first threshold, and by narrowing the prohibited area when the loudness of the noise is equal to or less than a second threshold that is smaller than the first threshold.

4. The information processing device according to claim 3 , wherein the information setting unit determines at least one of the first threshold value and the second threshold value based on volume information relating to a volume of the audio content output from the output device.

5. The information processing device according to claim 4 , wherein the information setting unit sets at least one of the first threshold value and the second threshold value higher when the volume of the audio content is high than when the volume of the audio content is low.

6. The information processing device according to claim 1 , further comprising a control unit that notifies the user of route information regarding a travel route of the self-propelled device.

7. The information processing device according to claim 6 , wherein the control unit changes the travel route of the self-propelled device based on a predetermined operation input by the user.

8. The information processing device according to claim 2 , wherein the information setting unit does not set the prohibited area when the audio content from the output device is output from an external speaker that can be worn by the user.

9. The information processing device according to claim 2 , wherein the information setting unit notifies the user when the self-propelled device has not traveled through at least a part of the area set as the prohibited area for a predetermined time or longer.

10. The information processing device according to claim 2 , wherein the information setting unit expands or reduces the area set as the prohibited area depending on the genre of the audio content being output from the output device.

11. The information processing device according to claim 2 , wherein the information setting unit expands or reduces the area set as the prohibited area depending on the brightness of a room in which the user is listening to the audio content.

12. The information processing device according to claim 1 , wherein the self-propelled device is a self-propelled robotic cleaner.

13. the output device further includes a display unit capable of outputting video content; the listening situation determination unit determines that the user is listening to the audio content output from the output device when the line of sight of the user detected by the imaging unit is directed toward the display unit. The information processing device according to claim 1 .

14. An information processing method executed by an information processing device, Detecting noise in the vicinity of an output device capable of outputting audio content; determining whether a user is listening to the audio content output from the output device; When the listening state determination unit determines that the user is listening to the audio content, information regarding the driving of the self-propelled device is set in accordance with the magnitude of the noise detected by the noise detection unit. Information processing methods.

15. An information processing device and a self-propelled device, The information processing device, Detecting noise in the vicinity of an output device capable of outputting audio content; determining whether a user is listening to the audio content output from the output device; When the listening state determination unit determines that the user is listening to the audio content, information regarding the driving of the self-propelled device is set in accordance with the magnitude of the noise detected by the noise detection unit; The self-propelled device travels based on the information regarding the drive. Information processing system.

Images