Information processing system, information processing method, and recording medium

Abstract

An information processing system (10) comprises an acquisition means (110) that acquires target biometric information, an identification means (120) that performs authentication processing using the biometric information to identify a target, and a control means (140) that performs control relating to equipment on the basis of history information in which the identified target and a history of using the equipment are stored in association with each other. With such an information processing system, it is possible to appropriately perform control relating to equipment according to the history of use of equipment by a target.

Description

Information processing system, information processing method, and recording medium

[0001] The present disclosure relates to the technical fields of an information processing system, an information processing method, and a recording medium.

[0002] Systems that control devices such as home appliances based on user information are known. For example, Patent Document 1 discloses a technology that automatically controls the power of a television or stereo by linking the user's face with the device. Patent Document 2 discloses a technology that provides services that take the user's preferences into consideration by storing the device operated by the user, the operation content, and the time of operation. Patent Document 3 discloses a technology that determines the user's entry and exit status in a building such as an apartment building and controls the front door lock, lighting fixtures, air conditioning equipment, etc.

[0003] JP-T-2004-536376A JP-A-2004-185612 JP-A-2009-288957

[0004] This disclosure aims to improve upon the techniques disclosed in the prior art documents.

[0005] One aspect of the information processing system disclosed herein comprises an acquisition means for acquiring biometric information of a target, an identification means for performing an authentication process using the biometric information and identifying the target, and a control means for executing control over the device based on history information stored in association with the identified target and the device's usage history.

[0006] One aspect of the information processing method disclosed herein involves using at least one computer to acquire biometric information of a target, perform authentication processing using the biometric information, identify the target, and execute control over the device based on stored history information that associates the identified target with the device's usage history.

[0007] One aspect of the recording medium of this disclosure is a recording medium having recorded thereon a computer program that causes at least one computer to execute an information processing method, which includes acquiring biometric information of a target, performing an authentication process using the biometric information, identifying the target, and associating the identified target with a usage history of the device and executing control related to the device based on stored history information.

[0008] 1 is a block diagram showing a hardware configuration of an information processing system according to a first embodiment. FIG. 2 is a block diagram showing a functional configuration of an information processing system according to the first embodiment. FIG. 3 is a flowchart showing a flow of a storage operation in the information processing system according to the first embodiment. FIG. 4 is a flowchart showing a flow of a control operation in the information processing system according to the first embodiment. FIG. 5 is a block diagram showing a functional configuration of an information processing system according to a second embodiment. FIG. 6 is a flowchart showing a flow of a control operation in the information processing system according to the second embodiment. FIG. 7 is a flowchart showing a flow of a control operation in the information processing system according to the third embodiment. FIG. 8 is a block diagram showing a functional configuration of an information processing system according to a fourth embodiment. FIG. 9 is a flowchart showing a flow of a control operation in the information processing system according to the fourth embodiment. FIG. 10 is a block diagram showing a functional configuration of an information processing system according to a fifth embodiment. FIG. 11 is a flowchart showing a flow of a control operation in the information processing system according to the fifth embodiment. FIG. 12 is a block diagram showing a functional configuration of an information processing system according to a sixth embodiment. FIG. 13 is a flowchart showing a flow of an image output operation in the information processing system according to the sixth embodiment. FIG. 14 is a block diagram showing a functional configuration of an information processing system according to a seventh embodiment. FIG. 15 is a flowchart showing a flow of a height information output operation in the information processing system according to the seventh embodiment. FIG. 16 is a plan view showing an example of displaying height information in the information processing system according to the seventh embodiment. FIG. 17 is a block diagram showing a functional configuration of an information processing system according to an eighth embodiment. FIG. 18 is a flowchart showing a flow of an entry permission operation in the information processing system according to the eighth embodiment.

[0009] Hereinafter, embodiments of an information processing system, an information processing method, and a recording medium will be described with reference to the drawings.

[0010] First Embodiment An information processing system according to a first embodiment will be described with reference to FIGS. 1 to 4. FIG.

[0011] (Hardware Configuration) First, the hardware configuration of the information processing system according to the first embodiment will be described with reference to Fig. 1. Fig. 1 is a block diagram showing the hardware configuration of the information processing system according to the first embodiment.

[0012] 1 , an information processing system 10 according to the first embodiment includes a processor 11, a RAM (Random Access Memory) 12, and a ROM (Read Only Memory) 13. The information processing system 10 may further include a storage device 14, an input device 15, an output device 16, and a camera 18. The processor 11, RAM 12, ROM 13, storage device 14, input device 15, output device 16, and camera 18 are connected via a data bus 17.

[0013] The processor 11 loads a computer program. For example, the processor 11 is configured to load a computer program stored in at least one of the RAM 12, the ROM 13, and the storage device 14. Alternatively, the processor 11 may load a computer program stored in a computer-readable storage medium using a storage medium reading device (not shown). The processor 11 may acquire (i.e., load) the computer program from a device (not shown) located outside the information processing system 10 via a network interface. The processor 11 controls the RAM 12, the storage device 14, the input device 15, and the output device 16 by executing the loaded computer program. In particular, in this embodiment, when the processor 11 executes the loaded computer program, a functional block that executes control of devices based on history information is realized within the processor 11. In other words, the processor 11 may function as a controller that executes each control in the information processing system 10.

[0014] The processor 11 may be configured as, for example, a central processing unit (CPU), a graphics processing unit (GPU), a field-programmable gate array (FPGA), a digital signal processor (DSP), an application-specific integrated circuit (ASIC), or a quantum processor. The processor 11 may be configured as one of these, or may be configured to use multiple processors in parallel.

[0015] The RAM 12 temporarily stores computer programs executed by the processor 11. The RAM 12 temporarily stores data that the processor 11 temporarily uses while it is executing the computer programs. The RAM 12 may be, for example, a dynamic random access memory (D-RAM) or a static random access memory (SRAM). Alternatively, other types of volatile memory may be used instead of the RAM 12.

[0016] The ROM 13 stores computer programs executed by the processor 11. The ROM 13 may also store fixed data. The ROM 13 may be, for example, a programmable read-only memory (PROM) or an erasable read-only memory (EPROM). Alternatively, other types of non-volatile memory may be used instead of the ROM 13.

[0017] The storage device 14 stores data that is to be saved long-term by the information processing system 10. The storage device 14 may operate as a temporary storage device for the processor 11. The storage device 14 may include, for example, at least one of a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and a disk array device.

[0018] The input device 15 is a device that receives input instructions from a user of the information processing system 10. The input device 15 may include, for example, at least one of a keyboard, a mouse, and a touch panel. The input device 15 may be configured as a mobile terminal such as a smartphone or a tablet. The input device 15 may also be, for example, a device that includes a microphone and is capable of voice input.

[0019] The output device 16 is a device that outputs information related to the information processing system 10 to the outside. For example, the output device 16 may be a display device (e.g., a display) that can display information related to the information processing system 10. The output device 16 may also be a speaker or the like that can output information related to the information processing system 10 as audio. The output device 16 may be configured as a mobile terminal such as a smartphone or a tablet. The output device 16 may also be a device that outputs information in a format other than an image. For example, the output device 16 may be a speaker that outputs information related to the information processing system 10 as audio.

[0020] The camera 18 captures images handled by the information processing system 10. The camera 18 captures, for example, images of a target. Note that the "target" here may include not only humans but also animals such as dogs and cats, robots, etc. A plurality of cameras 18 may be provided. In this case, the cameras 18 may be of different types. For example, the camera 18 may include a visible light camera that captures the face of the target and a near-infrared camera that captures the iris of the target.

[0021] 1 may be provided in an external device of the information processing system 10. For example, the information processing system 10 may be configured to include only the processor 11, RAM 12, and ROM 13 described above, and the other components (i.e., the storage device 14, the input device 15, the output device 16, and the camera 17) may be provided in an external device connected to the information processing system 10. Furthermore, some of the calculation functions of the information processing system 10 may be realized by an external device (e.g., an external server, a cloud, etc.).

[0022] (Functional Configuration) Next, the functional configuration of the information processing system 10 according to the first embodiment will be described with reference to Fig. 2. Fig. 2 is a block diagram showing the functional configuration of the information processing system according to the first embodiment.

[0023] 2, the information processing system 10 according to the first embodiment includes, as components for realizing its functions, a biometric information acquisition unit 110, a user identification unit 120, and a control unit 140. Each of the biometric information acquisition unit 110, the user identification unit 120, and the control unit 140 may be a processing block realized by, for example, the above-mentioned processor 11 (see FIG. 1).

[0024] The biometric information acquisition unit 110 is configured to be able to acquire biometric information of a target. The type of biometric information is not particularly limited as long as it can be used for authentication processing. For example, the biometric information acquisition unit 110 may use the camera 18 to acquire biometric information related to the target's face or iris. Alternatively, the biometric information acquisition unit 110 may use a scanner to acquire biometric information related to the target's fingerprint. Furthermore, the biometric information acquisition unit 110 may acquire multiple types of biometric information.

[0025] The user identification unit 120 is configured to be able to identify a target by performing authentication processing using the biometric information acquired by the biometric information acquisition unit 110. That is, the user identification unit 120 identifies which pre-registered user the target is through authentication processing. The user identification unit 120 identifies the user by comparing the biometric information acquired by the biometric information acquisition unit 110 with pre-stored biometric information of registered users. For example, the user identification unit 120 identifies the user by performing face authentication, iris authentication, fingerprint authentication, or multimodal authentication.

[0026] The control unit 140 is configured to be able to control devices based on the history information. The history information is information that associates the target identified by the user identification unit 120 with the target's device usage history. The history information may be, for example, information that associates a unique ID indicating the identified user with the device's operating time and various parameters (e.g., parameters indicating intensity, mode, etc.). The history information may also include usage history for multiple devices. For example, the history information may be information that associates user A with user A's usage history of devices B, C, and D. The history information may be information stored in a device external to the information processing system 10. In this case, the control unit 140 may be configured to communicate with the external device in which the history information is stored and appropriately read the history information. Alternatively, the history information may be stored in a storage device or the like included in the information processing system 10 (see the second embodiment described below).

[0027] The "device" according to this embodiment is a device used by the subject, and is typically a device installed in the subject's residence. For example, the device may be a television, refrigerator, air conditioner, vacuum cleaner, computer, audio player, beauty appliance, etc., in the subject's home. The device according to this embodiment may also include facilities used by the subject. For example, the device may be a bath, a swimming pool, a treadmill, etc. Note that the above-mentioned devices are merely examples, and the device according to this embodiment may include other devices and facilities.

[0028] For example, the control unit 140 may execute control to operate the device in the same manner as the usage history included in the history information. More specifically, the control unit 140 may execute control to operate the device at the same time as the past operating times. Furthermore, the control unit 140 may execute control to operate the device with the same parameters as in the past. Note that "device-related control" may be a control to directly control the operation of the device as described above, or a control to output information encouraging the subject to use the device. For example, the control unit 140 may execute control to display an image on a display in the subject's room encouraging the subject to use a swimming pool or a treadmill.

[0029] (Storage Operation) Next, the flow of the storage operation (i.e., the operation when storing history information) by the information processing system 10 according to the first embodiment will be described with reference to Fig. 3. Fig. 3 is a flowchart showing the flow of the storage operation in the information processing system according to the first embodiment.

[0030] 3, in the storage operation by the information processing system 10 according to the first embodiment, the biometric information acquisition unit 110 first acquires biometric information from a target (step S101). Then, the user identification unit 120 executes authentication processing using the biometric information acquired by the biometric information acquisition unit 110 (step S102).

[0031] Next, the user identification unit 120 identifies the user based on the result of the authentication process (step S103). Then, the information processing system 10 stores history information that associates the identified user with the device usage history (step S104). As already described, the history information may be stored by a device external to the information processing system. Alternatively, the history information may be stored by a storage device or the like included in the information processing system 10.

[0032] The above-described series of processes may be repeatedly executed, thereby accumulating more history information. That is, history information relating to more users and more devices may be accumulated.

[0033] (Control Operation) Next, the flow of control operation by the information processing system 10 according to the first embodiment (i.e., operation when the control unit 140 executes control related to the device) will be described with reference to Fig. 4. Fig. 4 is a flowchart showing the flow of control operation in the information processing system according to the first embodiment.

[0034] 4, in the control operation of the information processing system 10 according to the first embodiment, the biometric information acquisition unit 110 first acquires biometric information from a target (step S151). Then, the user identification unit 120 executes authentication processing using the biometric information acquired by the biometric information acquisition unit 110 (step S152).

[0035] Next, the user identification unit 120 identifies the user based on the result of the authentication process (step S153). Then, the control unit 140 reads history information corresponding to the identified user (step S154). The control unit 140 executes control related to the device based on the read history information (step S155).

[0036] If the history information includes usage histories for multiple devices, the control unit 140 may execute control corresponding to each of the multiple devices. That is, the control unit 140 may execute multiple types of control based on the history information.

[0037] (Technical Effects) Next, technical effects obtained by the information processing system 10 according to the first embodiment will be described.

[0038] As described with reference to FIGS. 1 to 4, in the information processing system 10 according to the first embodiment, a target is identified through authentication processing using biometric information, and control of the device is performed according to the usage history of the identified target's device. In this way, it is possible to appropriately control the device based on the target's past behavior. For example, the device that the target normally uses can be operated while taking into consideration the target's preferences. It is also possible to suggest devices that the target should use.

[0039] Second Embodiment An information processing system 10 according to a second embodiment will be described with reference to Figures 5 and 6. Note that the second embodiment differs from the first embodiment described above only in some configurations and operations, and other parts may be the same as the first embodiment. Therefore, the following will describe in detail the parts that differ from the first embodiment already described, and will omit explanations of other overlapping parts as appropriate.

[0040] (Functional Configuration) First, the functional configuration of the information processing system 10 according to the second embodiment will be described with reference to Fig. 5. Fig. 5 is a block diagram showing the functional configuration of the information processing system according to the second embodiment. Note that in Fig. 5, elements similar to those shown in Fig. 2 are denoted by the same reference numerals.

[0041] As shown in Fig. 5, the information processing system 10 according to the second embodiment is configured to include, as components for realizing its functions, a biometric information acquisition unit 110, a user identification unit 120, a history information storage unit 130, and a control unit 140. That is, the information processing system 10 according to the second embodiment further includes the history information storage unit 130 in addition to the configuration of the first embodiment (see Fig. 2). The history information storage unit 130 may be realized by, for example, the storage device 14 described above.

[0042] The history information storage unit 130 is configured to be able to store history information. That is, the history information storage unit 130 is configured to be able to store information that associates the target identified by the user identification unit 120 with the target's device usage history. The history information storage unit 130 may have a function to collect information related to the user's device usage history. For example, the history information storage unit 130 may collect information related to the usage history by communicating with each device.

[0043] The history information storage unit 130 is also configured to be able to store the absence time of the target. Note that the "absence time" here refers to the time when the target is not present at the location where the device is installed. The absence time may be the time from when the target leaves the location where the device is installed until when the target returns to the location where the device is installed. In this case, the information regarding the absence time may include information regarding the time when the target left the location where the device is installed and the time when the target returned.

[0044] Examples of the location where the device is installed include a room where the device is installed, a house where the device is installed, an apartment building where the device is installed, etc. For example, if the location where the device is installed is a room, the absence time may be the time from when the subject leaves the room to when they enter the room. In this case, the information regarding the absence time may include information regarding the subject's departure time and entry time. Furthermore, if the location where the device is installed is a house (home), the absence time may be the time from when the subject leaves the house to when they return home. In this case, the information regarding the absence time may include information regarding the subject's departure time and return time. Furthermore, if the location where the device is installed is an apartment building, the absence time may be the time from when the subject leaves the entrance of the apartment building (e.g., a shared entrance with an auto-lock) to when they return to the entrance. In this case, the information regarding the absence time may include information regarding the subject's departure time and entry time.

[0045] Information about the absence time of the subject may be estimated using an authentication process using biometric information. For example, the absence time may be estimated using the time when the subject is authenticated leaving the location where the device is installed and the time when the subject is authenticated entering the location where the device is installed.

[0046] (Control Operation) Next, the flow of control operation by the information processing system 10 according to the second embodiment will be described with reference to Fig. 6. Fig. 6 is a flowchart showing the flow of control operation in the information processing system according to the second embodiment. Note that in Fig. 6, the same processes as those shown in Fig. 2 are denoted by the same reference numerals.

[0047] 6 , in the control operation of the information processing system 10 according to the second embodiment, the biometric information acquisition unit 110 first acquires biometric information from a target (step S151). Then, the user identification unit 120 executes authentication processing using the biometric information acquired by the biometric information acquisition unit 110 (step S152).

[0048] Next, the user identification unit 120 identifies the user based on the result of the authentication process (step S153). In the second embodiment, the control unit 140 reads out history information and information related to the absence time corresponding to the identified user (step S201). That is, in the second embodiment, the control unit 140 reads out information related to the absence time in addition to the history information.

[0049] The control unit 140 executes control related to the appliances based on the history information read from the history information storage unit 130 and information related to the absence time (step S202). For example, the control unit 140 may control the appliances to operate according to the absence time of the target. For example, the control unit 140 may control the robot vacuum cleaner to operate when the target is absent. Alternatively, the control unit 140 may control the appliances not to operate when the target is absent. For example, the control unit 140 may control the lights and air conditioner not to operate when the target is absent.

[0050] (Technical Effects) Next, technical effects obtained by the information processing system 10 according to the second embodiment will be described.

[0051] 6, in the information processing system 10 according to the second embodiment, control of devices is executed based on the time period during which the target is absent. In this way, it becomes possible to execute, at more appropriate timing, control that is preferably executed when the target is absent or control that is preferably not executed when the target is absent.

[0052] In the following embodiments, a configuration will be described in which the information processing system 10 includes a history information storage unit 130, as in the second embodiment described above. However, in the following embodiments, the information processing system 10 does not necessarily have to include the history information storage unit 130, as in the first embodiment (see FIG. 2 ). In other words, the history information may be stored outside the information processing system 10.

[0053] Third Embodiment An information processing system 10 according to a third embodiment will be described with reference to Fig. 7. Note that the third embodiment differs from the first and second embodiments described above only in some of its operations, and other parts may be the same as the first and second embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0054] (Control Operation) First, the flow of control operation by the information processing system 10 according to the third embodiment will be described with reference to Fig. 7. Fig. 7 is a flowchart showing the flow of control operation in the information processing system according to the third embodiment.

[0055] 7 , in the control operation by the information processing system 10 according to the third embodiment, the biometric information acquisition unit 110 first acquires biometric information from a target at an entrance to a residence (step S301). The biometric information acquisition unit 110 may capture an image of the target using a camera installed at the entrance of an apartment building, for example, and acquire the biometric information from the image of the target.

[0056] Next, the user identification unit 120 executes authentication processing using the biometric information acquired by the biometric information acquisition unit 110 (step S302). The user identification unit 120 also identifies the user based on the result of the authentication processing (step S303).

[0057] Next, the control unit 140 reads history information corresponding to the identified user from the history information storage unit 130 (step S304).The control unit 140 then executes control of the devices in the target room based on the read history information (step S305).That is, in the third embodiment, control of the devices in the target room is started when the target is at the entrance of the residence.

[0058] For example, the control unit 140 executes control to start supplying hot water to the bathtub in the room of the user identified in the authentication process. By controlling in this way, hot water can be filled in the bathtub more quickly compared to when hot water supply is started after the target returns to the room. Furthermore, the control unit 140 executes control to start operation of the air conditioner in the room of the user identified in the authentication process. By controlling in this way, the room temperature can be adjusted to an appropriate state by the time the target returns to the room.

[0059] (Technical Effects) Next, technical effects obtained by the information processing system 10 according to the third embodiment will be described.

[0060] 7, in the information processing system 10 according to the third embodiment, control of devices in the target residence is initiated in response to the authentication result at the entrance to the residence. In this way, control is initiated when the target returns home, making it possible to more efficiently control the devices.

[0061] Fourth Embodiment An information processing system 10 according to a fourth embodiment will be described with reference to Figures 8 and 9. The fourth embodiment differs only in part of the configuration and operation from the first to third embodiments described above, and other parts may be the same as the first to third embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0062] (Functional Configuration) First, the functional configuration of the information processing system 10 according to the fourth embodiment will be described with reference to Fig. 8. Fig. 8 is a block diagram showing the functional configuration of the information processing system according to the fourth embodiment. Note that in Fig. 8, the same elements as those shown in Fig. 5 are denoted by the same reference numerals.

[0063] As shown in Fig. 8, the information processing system 10 according to the fourth embodiment is configured to include, as components for realizing its functions, a biometric information acquisition unit 110, a user identification unit 120, a history information storage unit 130, a control unit 140, and a skin condition estimation unit 150. That is, the information processing system 10 according to the fourth embodiment further includes a skin condition estimation unit 150 in addition to the configuration of the second embodiment (see Fig. 5). The skin condition estimation unit 150 may be a processing block realized by, for example, the above-mentioned processor 11 (see Fig. 1).

[0064] The skin condition estimation unit 150 is configured to be able to estimate the skin condition of a target based on the biometric information acquired by the biometric information acquisition unit 110. The biometric information used by the skin condition estimation unit 150 to estimate the skin condition and the biometric information used by the user identification unit 120 for authentication processing may be different biometric information. For example, the skin condition estimation unit 150 may estimate the skin condition from an image of the target's face, while the user identification unit 120 may perform authentication processing using an iris image of the target. As existing technologies can be appropriately adopted as the specific method for estimating the skin condition, a detailed description thereof will be omitted here.

[0065] (Control Operation) Next, the flow of control operation by the information processing system 10 according to the fourth embodiment will be described with reference to Fig. 9. Fig. 9 is a flowchart showing the flow of control operation in the information processing system according to the fourth embodiment. Note that in Fig. 9, the same processes as those shown in Fig. 2 are denoted by the same reference numerals.

[0066] 9 , in the control operation of the information processing system 10 according to the fourth embodiment, the biometric information acquisition unit 110 first acquires biometric information from a target (step S151). Then, the user identification unit 120 executes authentication processing using the biometric information acquired by the biometric information acquisition unit 110 (step S152).

[0067] Next, the user identification unit 120 identifies the user based on the result of the authentication process (step S153). Then, particularly in the fourth embodiment, the skin condition estimation unit 150 estimates the target's skin condition (step S401). Note that the process of estimating the skin condition may be executed before the authentication process. That is, the process of step S401 may be executed before the process of step S152 or S153.

[0068] Next, the control unit 140 reads history information corresponding to the identified user from the history information storage unit 130 (step S154). The control unit 140 executes control of the device based on the read history information and the estimated skin condition (step S402). The control unit 140 may change operating parameters of the device based on the target's skin condition. For example, the control unit 140 may change parameters of a facial massager or a shaver based on the target's skin condition.

[0069] (Technical Effects) Next, technical effects obtained by the information processing system 10 according to the fourth embodiment will be described.

[0070] 8 and 9, in the information processing system 10 according to the fourth embodiment, device control is performed taking into consideration the skin condition of the subject. In this way, control according to the skin condition of the subject can contribute to improving the skin quality of the subject.

[0071] Fifth Embodiment An information processing system 10 according to a fifth embodiment will be described with reference to Figures 10 and 11. The fifth embodiment differs only in part of the configuration and operation from the first to fourth embodiments described above, and other parts may be the same as the first to fourth embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0072] (Functional Configuration) First, the functional configuration of the information processing system 10 according to the fifth embodiment will be described with reference to Fig. 10. Fig. 10 is a block diagram showing the functional configuration of the information processing system according to the fifth embodiment. Note that in Fig. 10, elements similar to those shown in Fig. 5 are denoted by the same reference numerals.

[0073] 10 , the information processing system 10 according to the fifth embodiment is configured to include, as components for realizing its functions, a biometric information acquisition unit 110, a user identification unit 120, a history information storage unit 130, a control unit 140, and a body type estimation unit 160. That is, the information processing system 10 according to the fifth embodiment further includes a body type estimation unit 160 in addition to the configuration of the second embodiment (see FIG. 5 ). The body type estimation unit 160 may be a processing block realized by, for example, the above-described processor 11 (see FIG. 1 ).

[0074] The body type estimation unit 160 is configured to be able to estimate the body type of the subject based on the biometric information acquired by the biometric information acquisition unit 110. The biometric information used by the body type estimation unit 160 to estimate the body type and the biometric information used by the user identification unit 120 for authentication processing may be different biometric information. For example, the body type estimation unit 160 may estimate the skin condition from an image of the subject's whole body, while the user identification unit 120 may perform authentication processing using an image of the subject's face. As existing technologies can be appropriately adopted as a specific method for estimating the body type, detailed description thereof will be omitted here.

[0075] (Control Operation) Next, the flow of control operation by the information processing system 10 according to the fifth embodiment will be described with reference to Fig. 11. Fig. 11 is a flowchart showing the flow of control operation in the information processing system according to the fifth embodiment. Note that in Fig. 11, the same processes as those shown in Fig. 2 are denoted by the same reference numerals.

[0076] 11 , in the control operation of the information processing system 10 according to the fifth embodiment, the biometric information acquisition unit 110 first acquires biometric information from a target (step S151). Then, the user identification unit 120 executes authentication processing using the biometric information acquired by the biometric information acquisition unit 110 (step S152).

[0077] Next, the user identification unit 120 identifies the user based on the result of the authentication process (step S153). Then, particularly in the fifth embodiment, the body type estimation unit 160 estimates the body type of the target (step S501). The body type estimation process may be performed before the authentication process. That is, the process of step S501 may be performed before the process of step S152 or S153.

[0078] Next, the control unit 140 reads history information corresponding to the identified user from the history information storage unit 130 (step S154). The control unit 140 executes control related to the device based on the read history information and the estimated body type (step S402). The control unit 140 may change the operating parameters of the device based on the subject's body type. For example, if the subject's body type is slightly overweight, the control unit 140 may execute control to increase the bath temperature. Alternatively, the control unit 140 may provide device guidance based on the subject's body type. For example, if the subject's body type is slightly overweight, the control unit 140 may output information encouraging the subject to use a treadmill or a swimming pool. Alternatively, the control unit 140 may execute control to automatically order products based on the subject's body type. For example, if the subject's body type is slightly overweight, the control unit 140 may execute control to automatically purchase low-calorie foods.

[0079] (Technical Effects) Next, technical effects obtained by the information processing system 10 according to the fifth embodiment will be described.

[0080] 10 and 11 , in the information processing system 10 according to the fifth embodiment, control of the device is performed taking into consideration the body shape of the subject. In this way, it is possible to promote the health of the subject through control according to the body shape of the subject.

[0081] Sixth Embodiment An information processing system 10 according to a sixth embodiment will be described with reference to Figures 12 and 13. Note that the sixth embodiment differs only in part of the configuration and operation from the first to fifth embodiments described above, and other parts may be the same as the first to fifth embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0082] (Functional Configuration) First, the functional configuration of the information processing system 10 according to the sixth embodiment will be described with reference to Fig. 12. Fig. 12 is a block diagram showing the functional configuration of the information processing system according to the sixth embodiment. Note that in Fig. 12, the same elements as those shown in Fig. 5 are denoted by the same reference numerals.

[0083] As shown in FIG. 12 , the information processing system 10 according to the sixth embodiment includes, as components for realizing its functions, a biometric information acquisition unit 110, a user identification unit 120, a history information storage unit 130, a control unit 140, an image storage unit 170, an image selection unit 180, and an image output unit 190. That is, the information processing system 10 according to the sixth embodiment further includes the image storage unit 170, the image selection unit 180, and the image output unit 190 in addition to the configuration of the second embodiment (see FIG. 5 ). The image storage unit 170 may be realized by, for example, the storage device 14 (see FIG. 1 ). Each of the image selection unit 180 and the image output unit 190 may be a processing block realized by, for example, the processor 11 (see FIG. 1 ).

[0084] The image storage unit 170 is configured to be able to store images of targets. The images stored by the image storage unit 170 are images of targets photographed in order for the biometric information acquisition unit 110 to acquire biometric information. Therefore, the image storage unit 170 stores a new image each time biometric information is acquired by the biometric information acquisition unit 110. The image storage unit 170 may store images of multiple targets. When the user identification unit 120 identifies which user the target is, the image storage unit 170 may store images for each user.

[0085] The image selection unit 180 selects images that satisfy a predetermined quality standard from among the images stored in the image storage unit 170. The "predetermined quality standard" here refers to a standard for determining whether an image is suitable for image output. The image selection unit 180 may select, for example, an image whose quality score exceeds a predetermined value as an image that satisfies the predetermined quality standard. Alternatively, the image selection unit 180 may select, from among the stored images, an image with the best image quality as an image that satisfies the predetermined quality standard. The predetermined image selection unit 180 selects images for each predetermined storage period. The "predetermined storage period" is a period that is set in advance as a period for determining the timing of image selection. For example, if the predetermined storage period is set to one month, the image selection unit 180 selects images that satisfy the predetermined quality standard every month.

[0086] The image output unit 190 is configured to be able to output the image selected by the image selection unit 180. The image output unit 190 outputs the selected image to, for example, a display in a target room. When there are multiple selected images, the image output unit 190 may output them sequentially. For example, the displayed images may be changed at predetermined intervals, like a slide show.

[0087] (Image Output Operation) Next, an image output operation (i.e., an operation when the image output unit 190 outputs an image) by the information processing system 10 according to the sixth embodiment will be described with reference to Fig. 13. Fig. 13 is a flowchart showing the flow of the image output operation in the information processing system according to the sixth embodiment.

[0088] 13 , in the image output operation by the information processing system 10 according to the sixth embodiment, the image storage unit 170 first stores the target image (step S601). Then, the image selection unit 180 determines whether a predetermined storage period has elapsed since the start of image storage (step S602). If the predetermined storage period has not elapsed (step S602: NO), the image storage unit 170 continues to store the image.

[0089] On the other hand, if the predetermined storage period has elapsed (step S602: YES), the image selection unit 180 selects an image that satisfies a predetermined quality standard from the images stored in the image storage unit 170 (step S603).Then, the image output unit 190 outputs the image selected by the image selection unit 180 (step S604).

[0090] (Technical Effects) Next, technical effects obtained by the information processing system 10 according to the sixth embodiment will be described.

[0091] 12 and 13, in the information processing system 10 according to the sixth embodiment, images that satisfy a predetermined quality standard are selected for each predetermined accumulation period, and the selected images are output. In this way, it becomes possible to display and check high-quality images of captured objects in an album-like manner.

[0092] Seventh Embodiment An information processing system 10 according to a seventh embodiment will be described with reference to Figures 14 to 16. Note that the seventh embodiment differs only in part of the configuration and operation from the first to sixth embodiments described above, and other parts may be the same as the first to sixth embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0093] (Functional Configuration) First, the functional configuration of the information processing system 10 according to the seventh embodiment will be described with reference to Fig. 14. Fig. 14 is a block diagram showing the functional configuration of the information processing system according to the seventh embodiment. Note that in Fig. 14, the same elements as those shown in Fig. 5 are denoted by the same reference numerals.

[0094] As shown in FIG. 14 , the information processing system 10 according to the seventh embodiment includes, as components for realizing its functions, a biometric information acquisition unit 110, a user identification unit 120, a history information storage unit 130, a control unit 140, a height estimation unit 200, a height storage unit 210, and a height information output unit 220. That is, the information processing system 10 according to the seventh embodiment further includes, in addition to the configuration of the second embodiment (see FIG. 5 ), a height estimation unit 200, a height storage unit 210, and a height information output unit 220. Each of the height estimation unit 200 and the height information output unit 220 may be a processing block realized by, for example, the above-described processor 11 (see FIG. 1 ). The height storage unit 210 may be realized by, for example, the above-described storage device 14 (see FIG. 1 ).

[0095] The height estimation unit 200 is configured to be able to estimate the height of a target from an image of the target. More specifically, the height estimation unit 200 is configured to be able to estimate the height of a target from an image of the target captured by the biometric information acquisition unit 110 to acquire biometric information. The height estimation unit 200 may estimate the height of a target every time a new image of the target is captured. Alternatively, the height estimation unit 200 may estimate the height of a target at predetermined intervals (for example, approximately once a month). Note that, since existing technology can be appropriately adopted as a method for estimating the height from an image of a target, detailed description thereof will be omitted here.

[0096] The height storage unit 210 is configured to be able to store the height of the subject estimated by the height estimation unit 200 in association with the time of capturing the image used to estimate the height (in other words, the time when the height was measured). In this way, the height storage unit 210 stores the height of the subject in chronological order. The height storage unit 210 may be configured to store the height of each of a plurality of subjects.

[0097] The height information output unit 220 is configured to be able to calculate information indicating the degree of change in the subject's height from the information stored in the height storage unit 210. For example, the height information output unit 220 may calculate information indicating the extent to which the subject's height has grown over a period of time. The height information output unit 220 is also configured to be able to output information indicating the degree of change in the subject's height together with a facial image of the subject. The facial image of the subject may be an image in which the face portion has been cut out from the image used to estimate the height. Alternatively, the facial image of the subject may be an image captured separately from the image used to estimate the height.

[0098] (Height Information Output Operation) Next, a height information output operation by the information processing system 10 according to the seventh embodiment (i.e., an operation when height information is output by the height information output unit 220) will be described with reference to Fig. 15. Fig. 15 is a flowchart showing the flow of the height information output operation in the information processing system according to the seventh embodiment.

[0099] 15 , in the height information output operation by the information processing system 10 according to the seventh embodiment, the height estimation unit 200 first estimates the height of a subject from an image of the subject captured to acquire biometric information (step S701). Then, the height storage unit 210 stores the subject's height estimated by the height estimation unit 200 in association with the capture time of the image used to estimate the height (step S702).

[0100] Next, the height information output unit 220 calculates information indicating the degree of change in the target's height from the information stored in the height storage unit 210 (step S703), and outputs the information indicating the degree of change in the target's height together with the target's facial image (step S704).

[0101] Although the configuration described here is such that information about height is output each time the target height is estimated, the information about height may be output at a timing different from the timing at which the height is estimated. For example, the height information output unit 220 may output information about height every month. Alternatively, the height information output unit 220 may output information about height in response to a user operation.

[0102] (Display Example of Height Information) Next, a display example of height information in the height information output operation described above will be described with reference to Fig. 16. Fig. 16 is a plan view showing a display example of height information in the information processing system according to the seventh embodiment.

[0103] As shown in FIG. 16 , the height information output unit 220 outputs a facial image of a subject and information indicating the degree of change in the subject's height. The facial image of the subject may be displayed together with the subject's name and age. The information indicating the degree of change in height may be output together with the time of height measurement. In the example shown in the figure, it is displayed that the height estimated in April of 20XX was 125.4 cm and that the height estimated in December of 20XX was 128.6 cm. It also displays information indicating that the height grew 3.2 cm in 8 months.

[0104] The display mode described here is merely an example, and the height of the subject may be displayed in a different mode. For example, the degree of change in the height of each of a plurality of subjects may be displayed side by side on the screen for comparison.

[0105] (Technical Effects) Next, technical effects obtained by the information processing system 10 according to the seventh embodiment will be described.

[0106] 14 to 16, the information processing system 10 according to the seventh embodiment outputs information indicating the degree of change in the height of the target together with a facial image of the target. In this way, it is possible to easily check the change in the height of the target.

[0107] Eighth Embodiment An information processing system 10 according to an eighth embodiment will be described with reference to Figures 17 and 18. Note that the eighth embodiment differs only in part of the configuration and operation from the first to seventh embodiments described above, and other parts may be the same as the first to seventh embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0108] (Functional Configuration) First, the functional configuration of the information processing system 10 according to the eighth embodiment will be described with reference to Fig. 17. Fig. 17 is a block diagram showing the functional configuration of the information processing system according to the eighth embodiment. Note that in Fig. 17, the same elements as those shown in Fig. 5 are denoted by the same reference numerals.

[0109] As shown in FIG. 17 , the information processing system 10 according to the eighth embodiment includes, as components for realizing its functions, a biometric information acquisition unit 110, a user identification unit 120, a history information storage unit 130, a control unit 140, a first camera 310, a second camera 320, a number of people detection unit 330, a permission control unit 340, and a permission unit 350. That is, the information processing system 10 according to the seventh embodiment further includes, in addition to the configuration of the second embodiment (see FIG. 5 ), the first camera 310, the second camera 320, the number of people detection unit 330, the permission control unit 340, and the permission unit 350. Each of the first camera 310 and the second camera 320 may be, for example, a camera included in the camera 18 (see FIG. 1 ). Each of the number of people detection unit 330, the permission control unit 340, and the permission unit 350 may be, for example, a processing block realized by the processor 11 (see FIG. 1 ).

[0110] The first camera 310 is a camera installed to acquire biometric information. The first camera 310 may be configured, for example, as a visible light camera that captures facial images or a near-infrared camera that captures iris images. On the other hand, the second camera 320 is a camera installed to have a different shooting angle from the first camera 310. For example, the second camera 320 is a camera installed to have a wider angle of view than the first camera 310. The second camera 320 may be configured, for example, as a camera that can overlook the shooting location, like a surveillance camera.

[0111] Number of people detection unit 330 is configured to be able to detect the number of people who will perform the authentication process (in other words, the number of targets) from the image captured by second camera 320. Number of people detection unit 330 may, for example, detect objects from the image captured by second camera 320 and count the number of objects to detect the number of people.

[0112] The permission control unit 340 is configured to be able to determine whether or not the authentication process has been successful for the number of people detected by the number of people detection unit 330. For example, if the number of people detection unit 330 detects four targets, the permission control unit 340 determines whether or not the authentication process for all four targets has been successful. The permission control unit 340 is configured to be able to control the operation of the permission unit 350 depending on whether or not the authentication process for the number of people has been successful. The specific operation of the permission control unit 340 will be described in detail in the operation description below.

[0113] The permission unit 350 is configured to permit the target to enter a predetermined area if the authentication process is successful. Note that the "predetermined area" here refers to an area where only targets whose authentication process is successful are allowed to become close friends, such as an area reserved for residents in an apartment building. If the authentication process for the target is successful, the permission unit 350 executes control to open a door or gate to permit the target to enter. On the other hand, if the authentication process for the target fails, the permission unit 350 may execute control to close a door or gate to prohibit the target from entering.

[0114] (Entry permission operation) Next, an entry permission operation by the information processing system 10 according to the eighth embodiment (i.e., an operation by the permission unit 350 to permit entry of a target into a predetermined area) will be described with reference to Fig. 18. Fig. 18 is a flowchart showing the flow of the entry permission operation in the information processing system according to the eighth embodiment.

[0115] 18 , in the entry permission operation by the information processing system 10 according to the eighth embodiment, the number-of-persons detection unit 330 first detects the number of people who will undergo authentication processing from the image captured by the second camera 320 (step S801). Then, the user identification unit 120 executes target authentication processing based on the biometric information acquired by the biometric information acquisition unit 110 (step S802).

[0116] Next, the permission control unit 340 determines whether the authentication process for the number of people detected by the number-of-people detection unit 330 has been successful (step S803). If the authentication process for the number of people has not been successful (step S803: NO), the user identification unit 120 continues executing the authentication process so that the authentication process for the number of people will be successful. However, if the authentication process for the number of people is not successful even after continuing the authentication process, the permission control unit 340 may output an alert.

[0117] On the other hand, if the authentication process is successful for the number of people (step S803: YES), the permission control unit 340 controls the permission unit 350 to permit the targets whose authentication process was successful to enter the specified area (step S804).

[0118] (Technical Effects) Next, technical effects obtained by the information processing system 10 according to the eighth embodiment will be described.

[0119] 17 and 18 , in the information processing system 10 according to the eighth embodiment, the number of targets is detected, and no targets are permitted to enter the predetermined area until the authentication process for the detected number of targets is successful. This prevents targets whose authentication process has not been successful from blending in with the other targets whose authentication process has been successful and entering the predetermined area.

[0120] The scope of each embodiment also includes a processing method in which a program that operates the configuration of each embodiment to realize the functions of the above-described embodiments is recorded on a recording medium, the program recorded on the recording medium is read as code, and the program is executed on a computer. In other words, a computer-readable recording medium is also included in the scope of each embodiment. Furthermore, each embodiment includes not only a recording medium on which the above-described program is recorded, but also the program itself.

[0121] Examples of recording media that can be used include floppy disks, hard disks, optical disks, magneto-optical disks, CD-ROMs, magnetic tapes, non-volatile memory cards, and ROMs. Furthermore, the scope of each embodiment is not limited to programs that execute processes by themselves, but also includes programs that execute processes by operating on an OS in conjunction with other software or expansion board functions. Furthermore, the program itself may be stored on a server, and part or all of the program may be downloadable from the server to a user terminal. The program may be provided to the user in, for example, a SaaS (Software as a Service) format.

[0122] <Supplementary Notes> The above-described embodiment may be further described as in the following supplementary notes, but is not limited to the following.

[0123] (Supplementary Note 1) The information processing system described in Supplementary Note 1 is an information processing system that includes an acquisition means for acquiring biometric information of a target, an identification means for performing authentication processing using the biometric information and identifying the target, and a control means for executing control related to the device based on history information stored in association with the identified target and the usage history of the device.

[0124] (Appendix 2) The information processing system described in Appendix 2 is the information processing system described in Appendix 1, further comprising a storage means for storing the history information and the absence time of the target regarding the location where the device is used, and the control means controls the device based on the history information and the absence time.

[0125] (Appendix 3) The information processing system described in Appendix 3 is the information processing system described in Appendix 1 or 2, in which the identification means performs the authentication process at an entrance to a residence, and the control means starts control of the device when the target is identified in the authentication process at the entrance to the residence.

[0126] (Appendix 4) The information processing system described in Appendix 4 is the information processing system described in any one of Appendices 1 to 3, further comprising a skin condition estimation means for estimating a skin condition of the subject using the biometric information, and the control means controls the device based on the history information and the skin condition.

[0127] (Appendix 5) The information processing system described in Appendix 5 is the information processing system described in any one of Appendices 1 to 4, further comprising a body type estimation means for estimating a body type of the subject using the biometric information, and the control means controls the device based on the history information and the body type.

[0128] (Appendix 6) The information processing system described in Appendix 6 is the information processing system described in any one of Appendices 1 to 5, further comprising: an image storage means for storing images of the subject photographed to acquire the biometric information; a selection means for selecting, from the stored images, images that satisfy a predetermined quality standard for each predetermined storage period; and an image output means for outputting the selected images.

[0129] (Supplementary Note 7) The information processing system described in Supplementary Note 7 is the information processing system described in any one of Supplements 1 to 6, further comprising: height estimation means for estimating a height of the subject from an image of the subject taken to acquire the biometric information; height storage means for storing the estimated height in association with the time of taking the image from which the height was estimated; and height information output means for outputting information indicating a degree of change in the height of the subject calculated from the information stored in the height storage means, together with a facial image of the subject.

[0130] (Appendix 8) The information processing system described in Appendix 8 is the information processing system described in any one of Appendices 1 to 7, further comprising: a first camera installed to acquire the biometric information; a second camera having a different shooting angle from that of the first camera; a permission means for permitting the target to enter a specified area if the authentication process is successful; a number detection means for detecting the number of people performing the authentication process from an image taken by the second camera; and a permission control means for controlling the permission means to not permit all of the targets to enter the specified area until the authentication process is successful for the detected number of people.

[0131] (Appendix 9) The information processing method described in Appendix 9 is an information processing method that, by at least one computer, acquires biometric information of a target, performs authentication processing using the biometric information, identifies the target, and executes control of the device based on history information that is stored by associating the identified target with a usage history of the device.

[0132] (Appendix 10) The recording medium described in Appendix 10 is a recording medium having recorded thereon a computer program that causes at least one computer to execute an information processing method, which includes acquiring biometric information of a target, performing authentication processing using the biometric information, identifying the target, and executing control related to the device based on history information that is stored in association with the identified target and a usage history of the device.

[0133] (Appendix 11) The computer program described in Appendix 11 is a computer program that causes at least one computer to execute an information processing method, which acquires biometric information of a target, performs authentication processing using the biometric information, identifies the target, and executes control related to the device based on history information that is stored in association with the identified target and a usage history of the device.

[0134] This disclosure may be modified as appropriate within the scope that does not contradict the gist or idea of ​​the invention that can be read from the claims and the entire specification, and information processing systems, information processing methods, and recording media that involve such modifications are also included in the technical idea of ​​this disclosure.

[0135] REFERENCE SIGNS LIST 10 Information processing system 11 Processor 14 Storage device 110 Biometric information acquisition unit 120 User identification unit 130 History information storage unit 140 Control unit 150 Skin condition estimation unit 160 Body type estimation unit 170 Image accumulation unit 180 Image selection unit 190 Image output unit 200 Height estimation unit 210 Height storage unit 220 Height information output unit 310 First camera 320 Second camera 330 Number of people detection unit 340 Permission control unit 350 Permission unit

Claims

1. an acquisition means for acquiring biometric information of a target; an identification means for performing an authentication process using the biometric information and identifying the target; a control means for controlling the device based on history information stored in association with the identified target and a usage history of the device; An information processing system comprising:

2. The device further includes a storage means for storing the history information and the absence time of the subject at the location where the device is used, the control means controls the device based on the history information and the absence time. The information processing system according to claim 1 .

3. The identification means performs the authentication process at an entrance of the residence, the control means starts controlling the device when the target is identified in the authentication process at the entrance of the residence.

3. The information processing system according to claim 1 or 2.

4. The method further includes a skin condition estimation means for estimating a skin condition of the subject using the biological information, the control means controls the device based on the history information and the skin condition.

3. The information processing system according to claim 1 or 2.

5. further comprising a body type estimation means for estimating a body type of the subject using the biological information; the control means controls the device based on the history information and the body type.

3. The information processing system according to claim 1 or 2.

6. an image storage means for storing images of the subject taken to acquire the biometric information; a selection means for selecting, from the stored images, images that satisfy a predetermined quality standard for each predetermined storage period; an image output means for outputting the selected image; The information processing system according to claim 1 or 2, further comprising:

7. height estimation means for estimating a height of the subject from an image of the subject taken to acquire the biometric information; a height storage means for storing the estimated height and the time of capturing the image for which the height was estimated in association with each other; height information output means for outputting information indicating a degree of change in height of the subject calculated from the information stored in the height storage means, together with a face image of the subject; The information processing system according to claim 1 or 2, further comprising:

8. a first camera installed to acquire the biometric information; a second camera having a different shooting angle from the first camera; an authorization means for authorizing the target to enter a predetermined area if the authentication process is successful; a number-of-persons detecting means for detecting the number of people who will perform the authentication process from the image captured by the second camera; a permission control means for controlling the permission means so as not to permit any of the targets to enter the predetermined area until the authentication process for the number of detected people is successful; The information processing system according to claim 1 or 2, further comprising:

9. by at least one computer, Acquire the subject's biometric information, Performing authentication processing using the biometric information to identify the target; and executing control of the device based on history information stored by associating the identified target with a usage history of the device. Information processing methods.

10. At least one computer Acquire the subject's biometric information, Performing authentication processing using the biometric information to identify the target; and executing control of the device based on history information stored by associating the identified target with a usage history of the device. A computer program that executes an information processing method.