Information processing method, information processing system, information processing device, and program

Abstract

This information processing method is executed by a computer, the method including: issuing a sound; acquiring a reflected sound of the sound; determining whether or not a person detected with the reflected sound corresponds to a person who is not permitted to operate a predetermined apparatus; and controlling the predetermined apparatus in accordance with the determination.

Description

Information processing method, information processing system, information processing device, and program

[0001] The present disclosure relates to an information processing method, an information processing system, an information processing device, and a program.

[0002] Conventionally, devices that use ultrasonic waves to detect people have been known. Patent Document 1 discloses a device that detects people in a room by emitting ultrasonic signals and turns on the power of various devices in the room.

[0003] U.S. Pat. No. 1,079,5018

[0004] However, if the person detected by sound is a child, it may be better not to turn on the power to the devices in the room. Also, if a child performs some kind of operation input on a device, it may be inconvenient if the device is activated based on that operation input. Therefore, it is desirable to control specific devices depending on the type of person detected by sound.

[0005] The present disclosure provides an information processing method and the like that can control a predetermined device in response to a person detected by sound.

[0006] An information processing method according to one aspect of the present disclosure is an information processing method executed by a computer, which emits a sound, obtains a reflected sound of the sound, determines whether a person detected by the reflected sound is a person who is not authorized to operate a specified device, and controls the specified device in accordance with the determination.

[0007] An information processing system according to one aspect of the present disclosure includes a sound generating unit that emits sound, a sound receiving unit that acquires reflected sound of the sound, a judgment unit that determines whether a person detected by the reflected sound is a person who is not authorized to operate a specified device, and a control unit that controls the specified device in accordance with the judgment.

[0008] An information processing device according to one aspect of the present disclosure includes a judgment unit that judges whether a person detected by the reflected sound of an emitted sound is a person who is not authorized to operate a specified device, and a control unit that controls the specified device in accordance with the judgment.

[0009] A program according to one aspect of the present disclosure causes a computer to execute the above information processing method.

[0010] In addition, the general or specific aspects of the present disclosure may be realized as a system, a method, an integrated circuit, a computer program, or a computer-readable recording medium such as a CD-ROM, or may be realized as any combination of a system, a method, an integrated circuit, a computer program, and a recording medium.

[0011] According to the information processing method and the like of the present disclosure, it is possible to control a predetermined device in response to a person detected by sound.

[0012] FIG. 1 is a diagram illustrating an information processing system according to a first embodiment. FIG. 2 is a block diagram illustrating the functional configuration of the information processing system according to the first embodiment, and the detection device, information processing device, and the like included in the information processing system. FIG. 3 is a diagram illustrating device information and room information stored in a storage unit of the information processing device. FIG. 4 is a diagram illustrating a flow for determining whether a detected person is a child. FIG. 5 is a diagram illustrating an example of control content executed in response to a person detected by reflected sound. FIG. 6 is a flowchart illustrating an information processing method according to the first embodiment. FIG. 7 is a flowchart illustrating an information processing method according to a first modification of the first embodiment. FIG. 8 is a flowchart illustrating an information processing method according to a second modification of the first embodiment. FIG. 9 is a flowchart illustrating an information processing method according to a third modification of the first embodiment. FIG. 10 is a block diagram illustrating the functional configuration of an information processing system according to the second embodiment. FIG. 11 is a block diagram illustrating the functional configuration of an information processing system according to the third embodiment. FIG. 12 is a block diagram illustrating the functional configuration of an information processing system according to the fourth embodiment. FIG. 13 is a diagram illustrating device information, room information, and family composition information stored in a storage unit of the information processing device. FIG. 14 is a flowchart illustrating an information processing method according to the fourth embodiment.

[0013] Conventionally, there is known a technology that detects a person in a room by emitting an ultrasonic signal and turns on various devices in the room. However, if the person detected by the sound is a child, it may be better not to turn on the devices in the room.

[0014] Furthermore, if a small child inputs some kind of operation into a device, it may cause a problem if the device is activated based on that operation input. For example, if a small child inputs operation into an electrical device such as a heater or gas appliance placed in a room, the small child or the indoor environment may be put in a dangerous state. Therefore, it is desirable to detect a person in a room by sound, determine the type of person detected, and control the electrical devices in the room according to the detected person.

[0015] The information processing method and the like disclosed herein have the following configuration so that a predetermined device can be controlled in response to a person detected by sound.

[0016] The information processing method of Example 1 is an information processing method executed by a computer, which emits a sound, obtains the reflected sound of the sound, determines whether or not a person detected by the reflected sound is a person who is not authorized to operate a specified device, and controls the specified device in accordance with the determination.

[0017] This allows a predetermined device to be controlled depending on whether or not the person detected by the reflected sound corresponds to the unauthorized person. This allows a predetermined device to be controlled depending on the person detected by the sound.

[0018] The information processing method of Example 2 is the information processing method described in Example 1, and if the person detected by the reflected sound is a person who is not authorized to operate a specified device, the specified device may be controlled to restrict external operation of the specified device.

[0019] According to this, even if an operation input is made to a predetermined device by an unauthorized person, for example, the predetermined device can be prevented from performing an operation corresponding to the operation input.

[0020] The information processing method of Example 3 is the information processing method described in Example 1 or Example 2, and if the person detected by the reflected sound is a person who is authorized to operate a specified device, the specified device may be controlled without imposing any restrictions on external operation of the specified device.

[0021] This allows, for example, the authorized person to freely operate a predetermined device.

[0022] The information processing method of Example 4 is the information processing method according to any one of Examples 1 to 3, and the specified device may be an electrical device installed in a space where a person detected by the reflected sound is present.

[0023] This makes it possible to control electrical appliances installed in a space where a person is present, the person being detected by the reflected sound.

[0024] An information processing method of Example 5 is the information processing method according to any one of Examples 1 to 4, wherein the person detection may be performed based on an image indicating the direction of arrival of a reflected wave based on the reflected sound.

[0025] This makes it possible to accurately detect a person using reflected sound and control a specific device in response to the detected person.

[0026] The information processing method of Example 6 is the information processing method described in Example 5, in which the judgment is made based on a value obtained by correcting and normalizing the area of ​​the person's region or the aspect ratio of the person's region appearing in the image with respect to distance, and if the corrected and normalized value is equal to or less than a predetermined value, the person is judged to be a child, and if it is greater than the predetermined value, the person is judged to be an adult.

[0027] In this way, by making the above judgment based on the area of ​​the person's area appearing in the image or the aspect ratio of the person's area corrected and normalized by distance, for example, if the detected person is a child, even if the child makes an operation input to a specified device, the device will not perform the operation corresponding to that operation input.

[0028] An information processing method according to Example 7 is the information processing method according to any one of Examples 1 to 6, wherein the sound may be ultrasonic.

[0029] This makes it possible to accurately detect a person using ultrasound and control a specific device in response to the detected person.

[0030] The information processing method of Example 8 is the information processing method described in any of Examples 1 to 7, wherein, when multiple people are detected by the reflected sound and the multiple people include both people who are not authorized to operate the specified device and people who are authorized to operate the specified device, the positions of the unauthorized and authorized people are obtained based on the reflected sound, and the specified device is controlled according to a first distance, which is the distance between the unauthorized and authorized people.

[0031] This allows a predetermined device to be controlled in accordance with the first distance, which is the distance between the detected people.

[0032] The information processing method of Example 9 is the information processing method described in Example 8, and may include controlling the specified device so as to restrict external operation of the specified device when the first distance is equal to or greater than a first threshold, and controlling the specified device without imposing any restrictions on external operation of the specified device when the first distance is less than the first threshold.

[0033] This allows the predetermined device to be controlled depending on whether the first distance is equal to or greater than the first threshold value.

[0034] The information processing method of Example 10 is the information processing method described in any of Examples 1 to 9, and may acquire the position of the person based on the reflected sound, acquire position information of the specified device, and control the specified device according to a second distance, which is the distance between the person and the specified device.

[0035] This allows the predetermined device to be controlled according to the second distance, which is the distance between the detected person and the predetermined device.

[0036] An information processing method of Example 11 is the information processing method described in Example 10, wherein, when the second distance is less than a second threshold, the specified device is controlled to restrict external operation of the specified device, and when the second distance is equal to or greater than the second threshold, the specified device is controlled without imposing any restrictions on external operation of the specified device.

[0037] This allows the predetermined device to be controlled depending on whether the second distance is equal to or greater than the second threshold value.

[0038] The information processing method of Example 12 is the information processing method described in any of Examples 1 to 7, and may use information indicating that an external operation input has been made to the specified device as a trigger to obtain registration information indicating whether the specified device to which the operation input has been made is a device that has been pre-registered to restrict external operation, and may control the specified device to which the operation input has been made based on the registration information.

[0039] This makes it possible to control the predetermined device to which the operation input has been made, depending on whether the predetermined device to which the operation input has been made is a pre-registered device.

[0040] An information processing method of Example 13 is the information processing method described in Example 12, and in the case where the specified device to which the operation input is made is the pre-registered device and the person detected by the reflected sound is a person who is not authorized to operate the specified device, the specified device may be controlled so that the specified device is not activated by the operation input.

[0041] This allows a specific device to be controlled depending on whether the specific device to which the operation input is made is a pre-registered device or not, and depending on whether the person detected by the reflected sound corresponds to the unauthorized person described above or not.

[0042] The information processing system of Example 14 includes a sound generating unit that emits sound, a sound receiving unit that acquires the reflected sound of the sound, a judgment unit that determines whether the person detected by the reflected sound is a person who is not authorized to operate a specified device, and a control unit that controls the specified device in accordance with the judgment.

[0043] According to this information processing system, it is possible to control a predetermined device depending on whether or not the person detected by the reflected sound corresponds to the unauthorized person. This makes it possible to control a predetermined device depending on the person detected by the sound.

[0044] The information processing device of Example 15 includes a judgment unit that judges whether a person detected by the reflected sound of an emitted sound is a person who is not authorized to operate a specified device, and a control unit that controls the specified device in accordance with the judgment.

[0045] According to this information processing device, a predetermined device can be controlled depending on whether or not the person detected by the reflected sound corresponds to the unauthorized person. This makes it possible to control the predetermined device depending on the person detected by the sound.

[0046] The program of Example 16 is a program for causing a computer to execute the information processing method according to any one of Examples 1 to 13.

[0047] According to this program, it is possible to provide an information processing method that can control a predetermined device in response to a detected person.

[0048] Hereinafter, an information processing method, an information processing system, an information processing device, and the like according to an embodiment of the present disclosure will be specifically described with reference to the drawings.

[0049] Note that the embodiments described below each illustrate a specific example of the present disclosure. The numerical values, shapes, materials, components, component placement and connection configurations, steps, and step order shown in the following embodiments are merely examples and are not intended to limit the present disclosure. Furthermore, among the components in the following embodiments, components that are not described in the independent claims that represent the highest concept are described as optional components.

[0050] First Embodiment [Overall Configuration of Information Processing System] The overall configuration of an information processing system according to a first embodiment will be described with reference to FIGS. 1 and 2. FIG.

[0051] The information processing system according to the first embodiment is a system for controlling devices installed in a space used by people. The space referred to here is, for example, an indoor space of a facility such as a house or an apartment building. The space may also be an indoor space of a facility such as an art gallery, a museum, a department store, or an event venue.

[0052] Fig. 1 is a diagram showing an information processing system 1 according to embodiment 1. Fig. 2 is a block diagram showing the functional configuration of the information processing system 1 and a detection device 10, an information processing device 20, and the like provided in the information processing system 1. Note that Figs. 1 and 2 also show a plurality of devices 9 arranged in an indoor space S and an information terminal 8 carried by a user inside or outside the indoor space S.

[0053] As shown in FIGS. 1 and 2, the information processing system 1 includes a detection device 10 and an information processing device 20.

[0054] The detection device 10 is a device for detecting a person in an indoor space S. The detection device 10 is attached to, for example, a wall of the indoor space S. The detection device 10 is communicatively connected to an information processing device 20 via an information communication network, and transmits detection information obtained by the detection device 10 to the information processing device 20.

[0055] The information processing device 20 is a device that controls a predetermined device 9 in the indoor space S based on the detection information transmitted from the detection device 10. The information processing device 20 is installed outside the indoor space S, for example, in the building of a service management company that provides a device control service. The information processing device 20 is communicatively connected to the detection device 10, the plurality of devices 9, and the information terminal 8 via an information communication network.

[0056] The information terminal 8 is communicatively connected to the information processing device 20 via an information communication network. The information terminal 8 is a terminal device carried by a user who uses the indoor space S and the multiple devices 9, and is, for example, a smartphone or a tablet terminal. The information terminal 8 displays various information transmitted from the information processing device 20. The information terminal 8 also transmits information input to the information terminal 8 by the user to the information processing device 20.

[0057] The plurality of devices 9 are communicatively connected to the information processing device 20 via an information communication network. The plurality of devices 9 are arranged in the indoor space S. The plurality of devices 9 are, for example, heaters, gas appliances, and security devices. The plurality of devices 9 may also be cooking appliances, water heaters, irons, etc. Each of the plurality of devices 9 is capable of transmitting information relating to the device 9 to the information processing device 20. Furthermore, the plurality of devices 9 can be operated by a control command transmitted from the information processing device 20.

[0058] There may be times when only a child is present in the indoor space S, and it is necessary to prevent the child from being in danger near the device 9. Therefore, the information processing system 1 of this embodiment detects a person in the indoor space S using the detection device 10, and controls a predetermined device 9 according to the characteristics of the detected person. The configurations of the detection device 10 and the information processing device 20 will be described below.

[0059] [Configuration of the Detection Device] The detection device 10 shown in FIG. 2 includes a sound generating unit 11, a sound receiving unit 12, a control unit 15, and a communication unit 16.

[0060] The communication unit 16 is a communication module that is communicatively connected to the information processing device 20 via an information communication network. The communication unit 16 is connected to the information communication network wirelessly or by wire.

[0061] The sound generator 11 is an ultrasonic transmitter that emits a sound in the ultrasonic band, and outputs a chirp wave sound with a frequency of, for example, 20 kHz to 100 kHz based on a command from the controller 15. The signal waveform of the sound emitted from the sound generator 11 may be a burst wave.

[0062] The sound generator 11 is installed, for example, on a wall of the indoor space S, and emits ultrasonic waves throughout the entire indoor space S. Furthermore, the sound generator 11 constantly emits ultrasonic waves when the information processing system 1 is in a setting mode for detecting people. The sound emitted from the sound generator 11 is reflected by people in the indoor space S.

[0063] The sound receiving unit 12 is a receiver that collects sound reflected by a person. The sound receiving unit 12 is installed on a wall of the indoor space S, the same wall on which the sound generating unit 11 is installed. The sound receiving unit 12 is, for example, a microphone array configured with three or more MEMS (Micro Electro Mechanical Systems) microphones 12a. When the number of microphones 12a in the sound receiving unit 12 is three, each microphone 12a is arranged at each vertex of a triangle. To easily detect sound reflected in the vertical and horizontal directions in the indoor space S, four or more microphones 12a may be arranged vertically and another four or more microphones 12a may be arranged horizontally. The sound receiving unit 12 receives the reflected sound to generate a reflected wave signal and output the reflected wave signal to the control unit 15.

[0064] The control unit 15 is a processor that controls the sound generating unit 11, the sound receiving unit 12, and the communication unit 16. The control unit 15 outputs information about an outgoing signal for transmitting an outgoing sound and information about a reflected wave signal based on a reflected sound to the information processing device 20 via the communication unit 16.

[0065] The detection device 10 of this embodiment uses ultrasonic waves to sense and determine the location of a person, but cannot detect a person's face, as can a camera. This allows for sensing that takes privacy into consideration. Furthermore, the detection device 10 performs active sensing by using reflected sound based on the transmission of ultrasonic waves, so it can detect a person even when the person is not making any sound.

[0066] [Configuration of Information Processing Apparatus] The configuration of the information processing apparatus 20 will be described with reference to FIGS. 2 to 5. FIG.

[0067] The information processing device 20 shown in FIG. 2 includes a data processing unit 30, a display unit 70, a communication unit 80, and a storage unit 90.

[0068] The display unit 70 is a monitor that displays various information processed by the data processing unit 30. For example, the display unit 70 displays an image created by the detection unit 40 (described later), which is an image that takes privacy into consideration and does not allow the recognition of human faces or the like.

[0069] The communication unit 80 is a communication module, and is connected to the detection device 10, the plurality of devices 9, and the information terminal 8 via an information communication network. The communication unit 80 outputs detection information transmitted from the detection device 10 to the data processing unit 30, and transmits information generated by the data processing unit 30 to a predetermined device 9 and the information terminal 8. The communication unit 80 also outputs device information transmitted from the plurality of devices 9 and indoor information transmitted from the information terminal 8 to the data processing unit 30.

[0070] The storage unit 90 stores device information output from the plurality of devices 9 and room information output from the information terminal 8 .

[0071] FIG. 3 is a diagram showing the device information and room information stored in the storage unit 90 of the information processing device 20. As shown in FIG.

[0072] The device information stored in the storage unit 90 is, for example, the name of the device 9, identification information of the device 9 (such as an IP address), and a restriction command for restricting the operation of the device 9.

[0073] The restriction command is a command that prevents the device 9 from accepting external operation input. Not accepting external operation input means not accepting or ignoring input from operation switches and the like that are the user interface of the device 9. The restriction command may be a command that prevents the device 9 from being powered on. This restriction command is set, for example, for devices that could be dangerous if operated by children, such as heaters and gas appliances, and for devices that are undesirable for children to operate carelessly, such as security devices. This device information is stored in the memory of each device 9, and is transmitted from each device 9 to the information processing device 20 via the information communication network when each device 9 is registered as a user, and is then stored in the storage unit 90.

[0074] The indoor information stored in the storage unit 90 is, for example, information regarding the location of the device 9 in the indoor space S. The indoor information may include layout information of the indoor space S, such as a floor plan of the room. The indoor information is input by the user to the information terminal 8 in association with the device information, transmitted from the information terminal 8 to the information processing device 20 via the information communication network, and stored in the storage unit 90.

[0075] The storage unit 90 also stores a program for performing data processing in the data processing unit 30. The data processing unit 30 is configured by a computer having a processor and the like.

[0076] 2 includes a detection unit 40, a determination unit 50, and a control unit 60. The detection unit 40, the determination unit 50, and the control unit 60 are software functions that are realized, for example, by a processor executing a program recorded in a storage unit 90.

[0077] The detection unit 40 detects a person based on the detection information output from the detection device 10. The detection unit 40 generates an image showing the direction of arrival of the reflected wave by performing beamforming on the reflected wave signals obtained based on the multiple microphones 12a. Specifically, a two-dimensional image is created by calculating beamforming in which a specific delay amount is applied to each of the multiple microphones 12a and the signals are added together for the reflected wave signals obtained by the detection device 10 in any direction corresponding to position coordinates within the image. The horizontal axis of the created image corresponds to the horizontal coordinate of the indoor space S, and the vertical axis of the image corresponds to the vertical coordinate of the indoor space S. In the image, the intensity distribution of the reflected wave is represented by multiple colors or different shades of color.

[0078] The detection unit 40 acquires information about the position and size of a person in the indoor space S from the intensity distribution of the reflected waves that appear in the image. For example, the detection unit 40 detects a person by regarding an area in the image where the brightness value is equal to or greater than a predetermined value as an area where a person is present. In other words, the detection unit 40 detects the position and size of a person in the indoor space S based on a high-brightness image area where the brightness value of the image is equal to or greater than a predetermined value. The detection unit 40 outputs the obtained detection result to the determination unit 50.

[0079] The determination unit 50 determines whether the detected person corresponds to a person who is not authorized to operate the predetermined device 9 based on the detection result obtained by the detection unit 40. Here, whether the detected person corresponds to a person who is not authorized to operate the predetermined device 9 means whether the person is classified into a group that satisfies predetermined conditions. For example, if the detected person is a child, the determination unit 50 determines that the detected person corresponds to a person who is not authorized to operate the predetermined device 9. If the detected person is not a child, the determination unit 50 determines that the detected person corresponds to a person who is authorized to operate the predetermined device 9.

[0080] To make the above-mentioned determination, the determination unit 50 specifically identifies whether the detected person is a child or not based on the size of a high-brightness image area where the brightness value is equal to or greater than a predetermined value.

[0081] FIG. 4 is a diagram showing a flow for determining whether a detected person is a child or not.

[0082] First, the reflected waves to be analyzed are divided into fixed intervals based on the distance from the sensor (sound receiving unit 12) (step S110). Next, a reflected wave intensity distribution image is generated for each fixed interval (step S120). Next, high-brightness areas are extracted from the reflected wave intensity distribution image (step S130). These high-brightness areas correspond to human regions. Next, the size and aspect ratio of the high-brightness areas are calculated (step S140). Next, the size and aspect ratio of the high-brightness areas are corrected and normalized by the distance from the sensor (step S150). For example, the corrected and normalized value is calculated by normalizing the aspect ratio by the distance. Then, it is determined whether the calculated value is equal to or less than a predetermined value (step S160). If the calculated value is equal to or less than the predetermined value (Yes in S160), it is determined that the person is not authorized to operate the device 9 (step S170). That is, in this case, the detected person is determined to be a child. If the calculated value is not equal to or less than the predetermined value (No in S160), it is determined that the person is authorized to operate the device 9 (step S180). In other words, in this case, the detected person is determined to be an adult.

[0083] The determination unit 50 may derive a person's height from a high-brightness image region, and if the derived height is equal to or shorter than the average height of a person in the lower grades of elementary school (age 7), may identify the detected person as a child. In addition to deriving a person's height from a high-brightness image region, the determination unit 50 may also derive a person's head size, arm length, leg length, torso length, etc. from the high-brightness image region and identify whether the detected person is a child or not.

[0084] The result of the judgment made by the judgment unit 50, i.e., the judgment result indicating whether the detected person is a person who is not authorized to operate the specified device 9, is output to the control unit 60.

[0085] The control unit 60 controls a predetermined device 9 arranged in the indoor space S according to the determination result of the determination unit 50 .

[0086] FIG. 5 is a diagram showing an example of control content executed in response to a person detected by reflected sound.

[0087] The figure shows an example in which a person who is not permitted to operate a specific device 9 is a child, and an example in which a person who is permitted to operate a specific device 9 is an adult.

[0088] 5 , when the detected person is a person who is not authorized to operate the predetermined device 9, the control unit 60 controls the predetermined device 9 so as to restrict external operation of the predetermined device 9. Furthermore, when the detected person is a person who is authorized to operate the predetermined device 9, the control unit 60 controls the predetermined device 9 without imposing any restrictions on external operation of the predetermined device 9.

[0089] Note that restricting external operation of a specific device 9 means not accepting or ignoring any operation input made to the device 9 by an unauthorized person. For example, this means preventing the device 9 from turning on even if an input to turn on the power is made when the device 9 is off, or preventing the device 9 from performing an operation corresponding to an operation input made using an operation switch or the like of the device 9 when the device 9 is powered on.

[0090] As described above, the information processing device 20 of this embodiment includes a judgment unit 50 that judges whether or not a person detected by the reflected sound of the emitted sound is a person who is not authorized to operate a specified device 9, and a control unit 60 that controls the specified device 9 in accordance with the judgment.

[0091] According to this information processing device 20, it is possible to control a specific device 9 in response to a person detected by sound. Specifically, by determining whether or not the person detected by sound corresponds to a person who is not permitted to operate the specific device 9, it is possible to restrict the operation of the device 9 by people who should not be allowed to operate the device 9, such as children.

[0092] [Information Processing Method] The information processing method according to the first embodiment will be described with reference to FIG.

[0093] FIG. 6 is a flowchart showing an information processing method according to the first embodiment.

[0094] In this information processing method, first, the detection device 10 emits a sound toward the indoor space S (step S10). The detection device 10 also acquires a reflected sound reflected by a person by emitting an ultrasonic wave (step S20). The detection device 10 outputs the acquired detection information to the information processing device 20.

[0095] The information processing device 20 detects a person based on the detection information output from the detection device 10 (step S30). For example, the information processing device 20 creates an image showing the arrival direction of the reflected wave based on the reflected sound. Specifically, the information processing device 20 generates an image showing the arrival direction of the reflected wave by performing beamforming on the reflected wave signals obtained by the multiple microphones 12a. The information processing device 20 then acquires information about the position and size of the person in the indoor space S from the intensity distribution of the reflected wave that appears in the generated image.

[0096] Next, the information processing device 20 determines whether or not the person detected by the reflected sound is a person who is not permitted to operate the predetermined device 9 (step S40).

[0097] The information processing device 20 determines whether the detected person is a child or not based on the information about the person's size obtained in step S30. Note that determining whether the person is a child or not is substantially the same as determining whether the person is an adult or not. If the detected person is a child, the detected person corresponds to a person who is not authorized to operate the specified device 9. If the detected person is not a child, the detected person corresponds to a person who is authorized to operate the specified device 9.

[0098] The information processing device 20 controls the predetermined device 9 based on the determination made in step S40. The predetermined device 9 is an electrical device installed in the indoor space S where the person detected by the reflected sound is present. Information about the predetermined device 9 is stored in advance in the storage unit 90.

[0099] If the person detected by the reflected sound corresponds to the unauthorized person (Yes in S40), the information processing device 20 controls the predetermined device 9 so as to restrict external operation of the predetermined device 9 (step S50). On the other hand, if the person detected by the reflected sound corresponds to the authorized person (No in S40), the information processing device 20 controls the predetermined device 9 without imposing any restrictions on external operation of the predetermined device 9 (step S60).

[0100] In step S60, controlling the predetermined device 9 without imposing any operational restrictions includes not controlling the predetermined device 9 from the information processing device 20 but leaving the operation of the predetermined device 9 to the predetermined device 9 itself. In addition, controlling the predetermined device 9 without imposing any operational restrictions includes operating the predetermined device 9 based on an external operational input when the external operational input is made to the predetermined device 9.

[0101] According to this information processing method, it is possible to control a predetermined device 9 in response to a person detected by sound. Specifically, if the person detected by sound is a person who should not be allowed to operate the device 9, such as a child, it is possible to restrict the operation of the device 9.

[0102] [Modification 1] An information processing method according to Modification 1 of Embodiment 1 will be described with reference to Fig. 7. Modification 1 describes an example in which, when multiple people are detected by sound, a predetermined device 9 is controlled based on the distances between the multiple people.

[0103] FIG. 7 is a flowchart showing an information processing method according to the first modification of the first embodiment.

[0104] First, the detection device 10 emits a sound toward the indoor space S (step S10). The detection device 10 also acquires the reflected sound reflected by a person by emitting ultrasonic waves (step S20). The detection device 10 outputs the acquired detection information to the information processing device 20.

[0105] The information processing device 20 detects a person based on the detection information output from the detection device 10 (step S30). For example, the information processing device 20 creates an image showing the direction from which the reflected wave comes based on the reflected sound.

[0106] In this example, multiple people are present in the indoor space S, and therefore the information processing device 20 detects the multiple people. The information processing device 20 acquires information regarding the positions of the multiple people in the indoor space S and the sizes of each of the multiple people from the intensity distribution of the reflected waves in the image that indicates the direction from which the reflected waves arrive.

[0107] Next, the information processing device 20 determines whether or not all of the people detected by the reflected sounds are people who are not permitted to operate the predetermined device 9 (step S40A).

[0108] If all of the detected people correspond to the unauthorized persons (Yes in S40A), the information processing device 20 controls the predetermined device 9 so as to restrict external operation of the predetermined device 9 (step S50). Note that a case in which all of the detected people correspond to the unauthorized persons is, for example, a case in which all of the detected people are children.

[0109] If not all of the detected people fall under the unauthorized people category (No in S40A), the information processing device 20 makes the following determination.

[0110] In the next step, the information processing device 20 determines whether or not all of the detected people are people who are permitted to operate the predetermined device 9 (step S41).

[0111] If all of the detected people are authorized persons (Yes in S41), the information processing device 20 controls the predetermined device 9 without imposing any restrictions on external operation of the predetermined device 9 (step S60). Note that the case where all of the detected people are authorized persons means that all of the detected people are adults.

[0112] If not all of the detected people correspond to the above-mentioned authorized people (No in S41), the information processing device 20 makes the following determination. Note that if not all of the detected people correspond to the above-mentioned authorized people in step S41, this means that some of the detected people are not authorized and the remaining people are authorized, for example, if the detected people are children and adults.

[0113] In the next step, the information processing device 20 determines whether a first distance, which is the distance between a person who is not permitted to operate a specific device 9 and a person who is permitted to operate the device 9, is equal to or greater than a first threshold value (step S42). In other words, the information processing device 20 determines whether a child and an adult are far apart in the indoor space S. The first distance is calculated based on the image showing the direction of arrival of the reflected wave created in step S30. The first threshold value is a predetermined value, and is set to a distance within reach of an adult's hand (for example, 1 meter or less).

[0114] If the first distance, which is the distance between a person who is not permitted to operate the predetermined device 9 and a person who is permitted to operate the predetermined device 9, is equal to or greater than the first threshold value (Yes in S42), the information processing device 20 controls the predetermined device 9 so as to restrict external operation of the predetermined device 9 (step S50). In other words, if a child and an adult are too far apart in the indoor space S, the adult cannot stop the child's behavior, so external operation of the predetermined device 9 is restricted.

[0115] On the other hand, if the first distance, which is the distance between a person who is not permitted to operate the predetermined device 9 and a person who is permitted to operate the predetermined device 9, is less than the first threshold value (No in S42), the information processing device 20 controls the predetermined device 9 without imposing any restrictions on external operation of the predetermined device 9 (step S60). In other words, if a child and an adult are close to each other in the indoor space S, the adult can restrain the child's actions, so no restrictions are imposed on external operation of the predetermined device 9.

[0116] According to the information processing method of the first modification, it is possible to control a predetermined device 9 according to a first distance, which is the distance between the detected people. Specifically, if one of the people detected by sound is a person who should not be allowed to operate the device 9, such as a child, it is possible to restrict the operation of the device 9.

[0117] In the above example, steps S10 to S60 are executed once, but in reality, the above flow is executed repeatedly. Therefore, even if external operations on the specified device 9 are restricted, the operation restriction is lifted when the first distance becomes less than the first threshold, and even if external operations on the specified device 9 are not restricted, the operation restriction is lifted when the first distance becomes equal to or greater than the first threshold. Note that the operation restriction may be lifted after a predetermined time (e.g., 10 seconds) has elapsed since the first distance became less than the first threshold.

[0118] [Modification 2] An information processing method according to Modification 2 of Embodiment 1 will be described with reference to Fig. 8. In Modification 2, an example will be described in which a predetermined device 9 is controlled based on the distance between a person detected by sound and the predetermined device 9.

[0119] FIG. 8 is a flowchart showing an information processing method according to the second modification of the first embodiment.

[0120] First, the detection device 10 emits a sound toward the indoor space S (step S10). The detection device 10 also acquires the reflected sound reflected by a person by emitting ultrasonic waves (step S20). The detection device 10 outputs the acquired detection information to the information processing device 20.

[0121] The information processing device 20 detects a person based on the detection information output from the detection device 10 (step S30).

[0122] Next, the information processing device 20 determines whether or not the person detected by the reflected sound is a person who is not permitted to operate the predetermined device 9 (step S40).

[0123] If the detected person is a person who is authorized to operate the specified device 9 (No in S40), the information processing device 20 controls the specified device 9 without imposing any restrictions on external operation of the specified device 9 (step S60).

[0124] If the detected person is not authorized to operate the predetermined device 9 (Yes in S40), the information processing device 20 makes the following determination.

[0125] In the next determination, the information processing device 20 determines whether a second distance, which is the distance between the person who is not authorized to operate the predetermined device 9 and the predetermined device 9, is equal to or greater than a second threshold value (step S44). In other words, the information processing device 20 determines whether the distance between the child and the predetermined device 9 in the indoor space S is large. The second distance is calculated based on the image showing the direction of arrival of the reflected wave created in step S30 and information related to the placement position of the predetermined device 9 stored in the storage unit 90. The second threshold value is a predetermined value that is set to be equal to or greater than the height of the child (for example, 1 meter or more).

[0126] If the second distance, which is the distance between the person who is not permitted to operate the predetermined device 9 and the predetermined device 9, is less than the second threshold value (No in S44), the information processing device 20 controls the predetermined device 9 so as to restrict external operation of the predetermined device 9 (step S50). In other words, if the distance between the child and the predetermined device 9 in the indoor space S is too close, the child can easily touch the device 9, so external operation of the predetermined device 9 is restricted.

[0127] On the other hand, if the second distance, which is the distance between the person who is not permitted to operate the predetermined device 9 and the predetermined device 9, is equal to or greater than the second threshold value (Yes in S44), the information processing device 20 controls the predetermined device 9 without imposing any restrictions on external operation of the predetermined device 9 (step S60). In other words, if the distance between the child and the predetermined device 9 in the indoor space S is long, the child cannot easily touch the device 9, so no restrictions on external operation of the predetermined device 9 are imposed.

[0128] According to the information processing method of the second modification, it is possible to control the predetermined device 9 in accordance with the second distance between the detected person and the predetermined device 9. Specifically, if the detected person is a person who should not be allowed to operate the device 9, such as a child, it is possible to restrict the operation of the device 9 near the child.

[0129] In the above example, steps S10 to S60 are executed once, but in reality, the above flow is executed repeatedly. Therefore, even if external operations on the specified device 9 are restricted, the operation restriction is lifted when the second distance becomes equal to or greater than the second threshold. Even if external operations on the specified device 9 are not restricted, the operation restriction is lifted when the second distance becomes less than the second threshold. Note that the operation restriction may be lifted after a predetermined time (e.g., 10 seconds) has elapsed since the second distance became equal to or greater than the second threshold.

[0130] [Modification 3] An information processing method according to Modification 3 of Embodiment 1 will be described with reference to Fig. 9. Modification 3 describes an example in which an external operation input to the device 9 is used as a trigger to control the device 9 to which the operation input has been made.

[0131] FIG. 9 is a flowchart showing an information processing method according to the third modification of the first embodiment.

[0132] First, when the device 9 placed in the indoor space S receives some kind of operational input from a person in the indoor space S, the device 9 outputs information indicating that the operational input has been made from outside to the information processing device 20 via the information communication network. At this point, the detection function of the detection device 10 is not working, and trigger information indicating that the operational input has been made from outside is output from the device 9.

[0133] The information processing device 20 acquires trigger information indicating that an external operation input has been performed (step S5). For example, if the device 9 is a heater, the trigger information may be information for turning on the heater's power. For example, if the device 9 is a smartphone, the trigger information may be authentication information for charging via the smartphone.

[0134] When the information processing device 20 acquires the trigger information, it outputs a control signal to the detection device 10 to instruct the detection device 10 to detect the indoor space S (step S6).

[0135] Upon receiving the control signal, the detection device 10 emits a sound (step S10). The detection device 10 also acquires a sound reflected by the emitted ultrasonic wave (step S20). The detection device 10 may execute steps S10 and S20 by acquiring trigger information output from the device 9 via an information and communication network.

[0136] Next, the information processing device 20 detects a person based on the detection information output from the detection device 10 (step S30).

[0137] Next, the information processing device 20 determines whether or not the person detected by the reflected sound is a person who is not permitted to operate the predetermined device 9 (step S40).

[0138] If the detected person is a person who is authorized to operate the specified device 9 (No in S40), the information processing device 20 controls the specified device 9 without imposing any restrictions on external operation of the specified device 9 (step S60).

[0139] If the detected person corresponds to the unauthorized person (Yes in S40), the information processing device 20 makes the following determination.

[0140] In the next step, the information processing device 20 determines whether the device 9 to which the operation input was made is a device that has been pre-registered so that external operation is restricted (step S47). That is, the information processing device 20 determines whether the device 9 to which the operation input was made is a device that may be put into an undesirable state by the operation input. Note that registration information indicating whether the device is pre-registered so that external operation is restricted is stored in advance in the storage unit 90 by the information terminal 8.

[0141] If the operated device 9 is a device that has not been registered in advance, that is, if it is not stored in the memory unit 90 as registration information (No in S47), the information processing device 20 controls the specified device 9 without imposing any restrictions on external operation of the specified device 9 (step S60).

[0142] If the operated device 9 is a pre-registered device, that is, if it is stored in the storage unit 90 as registration information (Yes in S47), the information processing device 20 controls the predetermined device 9 to restrict external operations on the predetermined device 9 (step S50). For example, the information processing device 20 controls the predetermined device 9 so that the predetermined device 9 does not operate based on external operation input. In this case, the information processing device 20 may output information indicating that external operation input has been made to the predetermined device 9 but that the operation has been restricted to the information terminal 8 via the information communication network.

[0143] According to the information processing method of the third modification, it is possible to control a specific device 9 according to the relationship between the device 9 to which an operation input has been made and the detected person. Specifically, if the person detected by the sound is a person who should not be allowed to operate the device 9, such as a child, it is possible to restrict the operation of the device 9 to which an operation input has been made.

[0144] Second Embodiment An information processing system 1A according to a second embodiment will be described with reference to Fig. 10. In the second embodiment, an example in which a detection device 10A has the function of a detection unit 40 will be described.

[0145] 10 is a block diagram showing the functional configuration of an information processing system 1A according to Embodiment 2. Note that a plurality of devices 9 and an information terminal 8 are also shown in FIG.

[0146] As shown in FIG. 10, an information processing system 1A includes a detection device 10A and an information processing device 20A.

[0147] The detection device 10A is a device for detecting a person in an indoor space S. The detection device 10A is communicatively connected to an information processing device 20A via an information communication network, and transmits information obtained by the detection device 10A to the information processing device 20A.

[0148] The information processing device 20A is a device that controls predetermined devices 9 in the indoor space S based on information transmitted from the detection device 10A. The information processing device 20A is communicatively connected to the detection device 10A, the plurality of devices 9, and the information terminal 8 via an information communication network.

[0149] The information terminal 8 is communicatively connected to the information processing device 20A via an information communication network. Various information transmitted from the information processing device 20A is displayed on the information terminal 8. The information terminal 8 also transmits information input to the information terminal 8 to the information processing device 20A.

[0150] The plurality of devices 9 are communicatively connected to the information processing device 20A via an information communication network. Each of the plurality of devices 9 can transmit information relating to the device 9 to the information processing device 20A. The plurality of devices 9 can also be operated by a control command transmitted from the information processing device 20A.

[0151] 10 includes a sound generating unit 11, a sound receiving unit 12, a control unit 15, a communication unit 16, and a detection unit 40. The sound generating unit 11, the sound receiving unit 12, and the communication unit 16 are the same as those in the first embodiment.

[0152] The detection unit 40 detects a person based on the reflected wave signals output from the sound receiving unit 12. The detection unit 40 generates an image indicating the direction from which the reflected waves arrive by performing beamforming on the reflected wave signals obtained based on the multiple microphones 12a.

[0153] The detection unit 40 acquires information about the position and size of a person in the indoor space S from the intensity distribution of the reflected waves that appear in the image. For example, the detection unit 40 detects a person by regarding an area in the image where the brightness value is equal to or greater than a predetermined value as an area where a person is present. In other words, the detection unit 40 of the detection device 10A detects the position and size of a person in the indoor space S based on a high-brightness image area in the image where the brightness value is equal to or greater than a predetermined value. The detection unit 40 outputs the obtained detection result to the control unit 15.

[0154] The control unit 15 is a processor that controls the sound generation unit 11, the sound receiving unit 12, the communication unit 16, and the detection unit 40. The control unit 15 outputs information related to the detection result obtained by the detection unit 40 to the information processing device 20A via the communication unit 16.

[0155] 10 includes a data processing unit 30A, a display unit 70, a communication unit 80, and a storage unit 90. The display unit 70, the communication unit 80, and the storage unit 90 are the same as those in the first embodiment.

[0156] The data processing unit 30A includes a determination unit 50 and a control unit 60. The determination unit 50 and the control unit 60 are the same as those in the first embodiment.

[0157] Based on the information transmitted from the detection device 10A, the determination unit 50 determines whether the detected person is a person who is not authorized to operate the predetermined device 9. The control unit 60 controls the predetermined device 9 arranged in the indoor space S according to the determination result of the determination unit 50.

[0158] According to the information processing device 20A of the second embodiment, it is possible to control a predetermined device 9 in accordance with a detected person. Specifically, by determining whether or not a person detected by sound is permitted to operate the predetermined device 9, it is possible to restrict the operation of the device 9 by a person who should not be allowed to operate the device 9, such as a child.

[0159] Third Embodiment A description will be given of an information processing system 1B according to a third embodiment. In the third embodiment, an example will be described in which an information processing device 20B has the functions of the detection device 10 shown in the first embodiment.

[0160] 11 is a block diagram showing the functional configuration of an information processing system 1B according to Embodiment 3. Note that a plurality of devices 9 and an information terminal 8 are also shown in FIG.

[0161] As shown in FIG. 11, an information processing system 1B includes an information processing device 20B.

[0162] The information processing device 20B is provided on a wall of the indoor space S, for example.

[0163] The information processing device 20B includes a sound generating unit 11, a sound receiving unit 12, a communication unit 80, a data processing unit 30B, a memory unit 90, and a display unit 70. The information processing device 20B emits a sound using the sound generating unit 11 and acquires a reflected sound using the sound receiving unit 12.

[0164] The data processing unit 30B includes a detection unit 40, a determination unit 50, and a control unit 60. The detection unit 40 of the data processing unit 30B acquires the reflected wave signal output from the sound receiving unit 12, and performs the same data processing as in the first embodiment.

[0165] According to the information processing device 20B of the third embodiment, it is possible to control a predetermined device 9 in accordance with a detected person. Specifically, by determining whether or not a person detected by sound is permitted to operate the predetermined device 9, it is possible to restrict the operation of the device 9 by a person who should not be allowed to operate the device 9, such as a child.

[0166] (Fourth embodiment) An information processing system 1C according to a fourth embodiment will be described with reference to Fig. 12 and Fig. 13. In the fourth embodiment, an example will be described in which information related to family structure is used to determine whether a detected person is a person who is not authorized to operate a predetermined device.

[0167] Fig. 12 is a block diagram showing the functional configuration of an information processing system 1C according to embodiment 4. Fig. 12 also shows a plurality of devices 9 arranged in an indoor space S and an information terminal 8 carried by a user inside or outside the indoor space S.

[0168] 12, an information processing system 1C includes a detection device 10 and an information processing device 20C. The configurations of the detection device 10, the information terminal 8, and the plurality of devices 9 are the same as those in the first embodiment.

[0169] 12 includes a data processing unit 30C, a display unit 70, a communication unit 80, and a storage unit 90C. The configurations of the display unit 70 and the communication unit 80 are the same as those in the first embodiment.

[0170] The storage unit 90C stores device information output from the plurality of devices 9, and room information and family composition information output from the information terminal 8.

[0171] 13 is a diagram showing the device information, room information, and family structure information stored in the storage unit 90C of the information processing device 20C. The device information and room information are the same as those in the first embodiment.

[0172] The family composition information stored in the memory unit 90C is, for example, information about the family using the indoor space S. The family composition information includes information indicating whether the members of the family are adults or children, such as husband, wife, first child, second child, etc. The family composition information may also include information about the ages, heights, and weights of the members. This family composition information is input by the user to the information terminal 8 in association with the device information, transmitted from the information terminal 8 to the information processing device 20C via the information communication network, and stored in the memory unit 90C.

[0173] 12 includes a detection unit 40, a determination unit 50, and a control unit 60. The configurations of the detection unit 40 and the control unit 60 are the same as those in the first embodiment.

[0174] The determination unit 50 determines whether the detected person corresponds to a person who is not authorized to operate the predetermined device 9, based on the detection result obtained by the detection unit 40 and the family composition information. For example, if the detected person is a child, the determination unit 50 determines that the detected person corresponds to a person who is not authorized to operate the predetermined device 9. If the detected person is not a child, the determination unit 50 determines that the detected person corresponds to a person who is authorized to operate the predetermined device 9.

[0175] The judgment unit 50 may derive the person's height from the information obtained by the detection unit 40, and if the derived height of the person is below the average height of a child in the lower grades of elementary school (age 7) and if there is a member corresponding to this in the family composition information, the judgment unit 50 may identify the detected person as a child.

[0176] The result of the judgment made by the judgment unit 50, i.e., the judgment result indicating whether the detected person is a person who is not authorized to operate the specified device 9, is output to the control unit 60.

[0177] The control unit 60 controls a predetermined device 9 arranged in the indoor space S according to the determination result of the determination unit 50 .

[0178] As described above, the information processing device 20C of this embodiment includes a judgment unit 50 that judges whether a person detected by the reflected sound of the emitted sound is a person who is not authorized to operate a specified device 9, and a control unit 60 that controls the specified device 9 in accordance with the judgment.

[0179] According to this information processing device 20C, it is possible to control a specific device 9 in response to a person detected by sound. Specifically, by determining whether or not the person detected by sound corresponds to a person who is not permitted to operate the specific device 9, it is possible to restrict the operation of the device 9 by people who should not be allowed to operate the device 9, such as children.

[0180] An information processing method according to the fourth embodiment will be described with reference to FIG.

[0181] FIG. 14 is a flowchart showing an information processing method according to the fourth embodiment.

[0182] In this information processing method, first, the detection device 10 emits a sound toward the indoor space S (step S10). The detection device 10 also acquires a reflected sound reflected by a person by emitting an ultrasonic wave (step S20). The detection device 10 outputs the acquired detection information to the information processing device 20C.

[0183] The information processing device 20C detects a person based on the detection information output from the detection device 10 (step S30). For example, the information processing device 20C creates an image showing the arrival direction of the reflected wave based on the reflected sound. Specifically, the information processing device 20C generates an image showing the arrival direction of the reflected wave by performing beamforming on the reflected wave signals obtained by the multiple microphones 12a. The information processing device 20C then acquires information about the position and size of the person in the indoor space S from the intensity distribution of the reflected wave that appears in the generated image.

[0184] Next, the information processing device 20C acquires family structure information (step S35). The family structure information is stored in advance in the storage unit 90C, and the information processing device 20C acquires the family structure information from the storage unit 90C.

[0185] Next, the information processing device 20C determines whether or not the person detected by the reflected sound is a person who is not permitted to operate the predetermined device 9 (step S40).

[0186] The information processing device 20C determines whether the detected person is a child or not based on the information about the person's size obtained in step S30 and the family structure information obtained in step S35. Note that determining whether the person is a child or not is substantially the same as determining whether the person is an adult or not. If the detected person is a child, the detected person corresponds to a person who is not authorized to operate the specified device 9. If the detected person is not a child, the detected person corresponds to a person who is authorized to operate the specified device 9.

[0187] Based on the determination made in step S40, the information processing device 20C controls the predetermined device 9. The predetermined device 9 is an electrical device provided in the indoor space S where the person detected by the reflected sound is present. Information about the predetermined device 9 is pre-stored in the storage unit 90C.

[0188] If the person detected by the reflected sound corresponds to the unauthorized person (Yes in S40), the information processing device 20C controls the predetermined device 9 so as to restrict external operation of the predetermined device 9 (step S50). On the other hand, if the person detected by the reflected sound corresponds to the authorized person (No in S40), the information processing device 20C controls the predetermined device 9 without imposing any restrictions on external operation of the predetermined device 9 (step S60).

[0189] According to this information processing method, it is possible to control a predetermined device 9 in response to a person detected by sound. Specifically, if the person detected by sound is a person who should not be allowed to operate the device 9, such as a child, it is possible to restrict the operation of the device 9.

[0190] While the information processing method and the like according to the embodiments of the present disclosure have been described above, the present disclosure is not limited to the individual embodiments. As long as they do not deviate from the spirit of the present disclosure, various modifications conceivable by those skilled in the art to the present embodiments and modifications constructed by combining components of different embodiments may also be included within the scope of one or more aspects of the present disclosure.

[0191] For example, in the first embodiment, the detection unit 40 detects a person based on a two-dimensional image of a reflected wave, but the present invention is not limited to this. The detection unit 40 may obtain time difference data between a direct wave and a reflected wave to obtain information on not only the direction from which the reflected sound arrives but also the depth direction (a direction perpendicular to both the vertical and horizontal directions), and thereby detect a person.

[0192] For example, in the first embodiment, the detection unit 40 detects a person based on a two-dimensional still image, but this is not limiting. The detection unit 40 may detect a person based on a moving image obtained by connecting two-dimensional still images in a time series. Furthermore, the determination unit 50 may determine whether the detected person is a child based on the moving image.

[0193] For example, in embodiment 1, the detection unit 40 and the determination unit 50 of the information processing device 20 are separate components, but the functions of the detection unit 40 and the determination unit 50 may be realized by a single component.

[0194] For example, in the first embodiment, the sound generating unit 11 and the sound receiving unit 12 are separate components, but this is not limiting, and the sound generating unit 11 and the sound receiving unit 12 may be integrated into an ultrasonic sensor.

[0195] For example, in the first embodiment, the information processing device 20 is configured by hardware, but the present invention is not limited to this, and the functions of the information processing device may be realized by cloud computing.

[0196] In addition, in the first and second embodiments, each component may be realized by executing a software program suitable for that component. Each component may be realized by a program execution unit such as a CPU or processor reading and executing a software program recorded on a recording medium such as a hard disk or semiconductor memory.

[0197] Furthermore, each component may be realized by hardware. Each component may be a circuit (or integrated circuit). These circuits may form a single circuit as a whole, or each may be a separate circuit. Furthermore, each of these circuits may be a general-purpose circuit or a dedicated circuit.

[0198] Furthermore, the general or specific aspects of the present disclosure may be realized as a system, an apparatus, a method, an integrated circuit, a computer program, or a computer-readable recording medium such as a CD-ROM, or as any combination of a system, an apparatus, a method, an integrated circuit, a computer program, and a recording medium.

[0199] For example, the present disclosure may be realized as a data processing unit of the above-described embodiments, or as an information processing system of the above-described embodiments. Furthermore, the present disclosure may be realized as an information processing method executed by a computer such as the information processing system of the above-described embodiments. The present disclosure may be realized as a program for causing a computer to execute such an information processing method, or as a computer-readable non-transitory recording medium on which such a program is recorded.

[0200] The information processing method and the like disclosed herein can be widely used as a device control method for controlling devices installed in a facility.

[0201] REFERENCE SIGNS LIST 1, 1A, 1B, 1C Information processing system 8 Information terminal 9 Device 10, 10A Detection device 11 Sound generating unit 12 Sound receiving unit 12a Microphone 15 Control unit 16 Communication unit 20, 20A, 20B, 20C Information processing device 30, 30A, 30B, 30C Data processing unit 40 Detection unit 50 Determination unit 60 Control unit 70 Display unit 80 Communication unit 90, 90C Storage unit S Indoor space

Claims

1. An information processing method executed by a computer, comprising the steps of: transmitting a sound; acquiring a reflected sound of the sound; determining whether or not a person detected from the reflected sound is a person not authorized to operate a specified device; and controlling the specified device in accordance with the determination.

2. The information processing method of claim 1, further comprising the steps of: if the person detected by the reflected sound corresponds to a person not authorized to operate a specified device, controlling the specified device so as to restrict external operation of the specified device.

3. The information processing method of claim 1, further comprising the steps of: if the person detected by the reflected sound corresponds to a person authorized to operate a specified device, controlling the specified device without imposing any restrictions on external operation of the specified device.

4. The information processing method according to any one of claims 1 to 3, wherein the specified device is an electrical device installed in a space where a person detected by the reflected sound is present.

5. An information processing method according to any one of claims 1 to 3, wherein the detection of a person is performed based on an image indicating the direction of arrival of a reflected wave based on the reflected sound.

6. The information processing method of claim 5, wherein the judgment is made based on a value obtained by correcting and normalizing the area of ​​the area of ​​the person appearing in the image or the aspect ratio of the area of ​​the person, and if the corrected and normalized value is equal to or less than a predetermined value, the person is judged to be a person who is not authorized to operate a specified device, and if the corrected and normalized value is greater than the predetermined value, the person is judged to be a person who is authorized to operate a specified device.

7. The information processing method according to any one of claims 1 to 3, wherein the sound is ultrasonic.

8. The information processing method of claim 1, wherein, when a plurality of people are detected by the reflected sound and among the plurality of people there are both people who are unauthorized and people who are authorized to operate the specified device, the positions of the unauthorized and authorized people are obtained based on the reflected sound, and the specified device is controlled according to a first distance which is the distance between the unauthorized and authorized people.

9. The information processing method according to claim 8, further comprising: controlling the specified device so as to restrict external operation of the specified device when the first distance is equal to or greater than a first threshold; and controlling the specified device without imposing any restriction on external operation of the specified device when the first distance is less than a first threshold.

10. The information processing method of claim 1, further comprising: acquiring a position of the person based on the reflected sound; acquiring position information of the specified device; and controlling the specified device according to a second distance, which is a distance between the person and the specified device.

11. The information processing method of claim 10, further comprising: controlling the specified device so as to restrict external operation of the specified device when the second distance is less than a second threshold; and controlling the specified device without imposing any restriction on external operation of the specified device when the second distance is equal to or greater than a second threshold.

12. The information processing method according to claim 1, further comprising the steps of: using information indicating that an external operation input has been made to the specified device as a trigger; acquiring registration information indicating whether the specified device to which the operation input has been made is a device that has been pre-registered to restrict external operation; and controlling the specified device to which the operation input has been made based on the registration information.

13. An information processing method as described in claim 12, further comprising the step of controlling a specific device so that the specific device is not operated by an operational input when the specific device to which the operational input has been performed is a pre-registered device and the person detected by the reflected sound is a person who is not authorized to operate the specific device.

14. An information processing system comprising: a sound generating unit that emits sound; a sound receiving unit that acquires reflected sound of the sound; a judgment unit that determines whether a person detected from the reflected sound is a person who is not authorized to operate a specified device; and a control unit that controls the specified device in accordance with the judgment.

15. An information processing device comprising: a judgment unit that judges whether a person detected by a reflected sound of an emitted sound is a person who is not authorized to operate a specified device; and a control unit that controls the specified device in accordance with the judgment.

16. A program for causing the computer to execute the information processing method according to any one of claims 1 to 3 and 8 to 13.

Images