Information processing device, information processing method, and information processing program

Abstract

To provide an information processing device, an information processing method, and an information processing program that suitably guides a user in a direction of improving the user's authentication accuracy in the case that multiple pieces of authentication information can be registered as information for authenticating a user.SOLUTION: In an information processing system connecting a server and a robot via a communication line, a control unit of an information processing device comprises a first peripheral information acquisition section, a second peripheral information acquisition section, a registration control section, and a registration promotion section. The first peripheral information acquisition section acquires first peripheral information related to a peripheral environment of an information processing device. The second peripheral information acquisition section acquires second peripheral information related to the peripheral environment of an information processing device. The registration control section causes information based on the first peripheral information to be registered as first authentication information for authenticating a first user. In the case that authentication of the first user is successful based on the first peripheral information and the first authentication information, and that the information based on the second peripheral information is not registered as second authentication information for authenticating the first user, the registration control section prompts the first user to register the second authentication information.SELECTED DRAWING: Figure 5

Description

[Technical Field]

[0001] The present invention relates to an information processing device, an information processing method, and an information processing program. [Background technology]

[0002] Conventionally, users are authenticated by registering their passwords and biometric information in advance and determining whether the passwords and biometric information received from the users match the registered information. In addition, to ensure even higher security and authentication accuracy, one-time password authentication using disposable passwords and multi-factor authentication using multiple types of authentication are also used.

[0003] For example, Patent Document 1 discloses multi-factor authentication using two or more pieces of information, including biometric information, possession information, knowledge information, and other pieces of knowledge information. Patent Document 2 discloses multi-factor authentication using multiple pieces of biometric information, such as face and voice. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Publication No. 2017-111608 [Patent Document 2] Special Publication No. 2017-535986 Summary of the Invention [Problem to be solved by the invention]

[0005] However, in the technology in which multiple pieces of authentication information can be registered as information for authenticating a user, as in Patent Documents 1 and 2 above, there is a problem in that there is still room for improvement in terms of favorably guiding the user in a direction that improves the accuracy of user authentication.

[0006] The object of the present invention is to provide an information processing device, an information processing method, and an information processing program that can preferably guide a user in a direction that improves the accuracy of user authentication when multiple pieces of authentication information can be registered as information for authenticating the user. [Means for solving the problem]

[0007] The information processing device according to the present invention comprises: An information processing device including a first surrounding information acquisition unit, a second surrounding information acquisition unit, a registration control unit, and a registration promotion unit, the first surrounding information acquisition unit acquires first surrounding information relating to a surrounding environment of the information processing device; the second surrounding information acquisition unit acquires second surrounding information related to a surrounding environment of the information processing device; the registration control unit registers information based on first surrounding information about a first user acquired by the first surrounding information acquisition unit as first authentication information for authenticating the first user; When the first user is successfully authenticated based on the first surrounding information acquired by the first surrounding information acquisition unit and the first authentication information, if information based on the second surrounding information acquired by the second surrounding information acquisition unit about the first user is not registered as second authentication information for authenticating the first user, the registration promotion unit prompts the first user to register the second authentication information. [Effects of the Invention]

[0008] According to the present invention, in a case where a plurality of pieces of authentication information can be registered as information for authenticating a user, the user can be suitably guided in a direction that improves the accuracy of user authentication. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a diagram illustrating a configuration of an information processing system according to an embodiment of the present invention. [Figure 2] FIG. 2 is a block diagram showing the hardware configuration of a server according to the present embodiment. [Figure 3] FIG. 2 is a block diagram showing the hardware configuration of the communication robot according to the present embodiment. [Figure 4] FIG. 2 is a block diagram showing the hardware configuration of a user terminal according to the present embodiment. [Figure 5] FIG. 2 is a block diagram showing an example of the functional configuration of a communication robot according to the present embodiment. [Figure 6] 10 is an example of a registration prompt screen displayed on a display unit of a user terminal. [Figure 7] 10 is a flowchart showing an example of a registration control process performed by a communication robot. [Figure 8] 10 is a flowchart showing an example of a registration control process performed by a communication robot. [Figure 9] 10 is a flowchart showing an example of a registration promotion process performed by a communication robot. [Figure 10] 10 is a modified example of a registration prompting screen displayed on the display unit of a user terminal. [Figure 11] FIG. 10 is a block diagram showing a modified example of the functional configuration of the communication robot. DETAILED DESCRIPTION OF THE INVENTION

[0010] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention will be described with reference to the accompanying drawings, in which the same reference numerals denote the same or similar components.

[0011] (Configuration of Information Processing System 1) FIG. 1 shows the configuration of an information processing system 1 according to this embodiment. The information processing system 1 shown in FIG. 1 includes a server 10 (conversation server), a communication robot 20, and a user terminal 30. The server 10 and the communication robot 20 are communicatively connected to each other via a communication line 5 such as the Internet, an intranet, a wireless LAN, or mobile communication. The communication robot 20 and the user terminal 30 are communicatively connected to each other via short-range wireless communication such as Bluetooth (registered trademark). The communication robot 20 functions as the "information processing device" of the present invention.

[0012] In this embodiment, a user who uses the user terminal 30 is referred to as a user U. The number of user terminals 30 included in the information processing system 1 is not limited to one, and two or more user terminals 30 may be included.

[0013] The user terminal 30 is an information processing terminal such as a smartphone or tablet terminal. The user U can perform initial settings or change settings of the communication robot 20 using a dedicated application pre-installed on the user terminal 30. Note that the user terminal 30 may be any type of terminal, such as a mobile phone, personal computer (PC), laptop PC, personal digital assistant (PDA), or home game console.

[0014] The communication robot 20 is a home communication robot designed to communicate with a user U (human) through words, actions, etc., such as conversation. The communication robot 20 is particularly good at emotional, soothing communication, empathizing with the user U (speaker) and sharing in joy, tears, and anger. The appearance of the communication robot 20 is not particularly limited. The appearance of the communication robot 20 may be that of a stuffed animal or a mechanical robot.

[0015] The server 10 is a conversation server that understands the content of utterances made by the user U to the communication robot 20 and returns a response to the communication robot 20. Specifically, a conversation between the user U and the communication robot 20 is realized as follows. First, when the user U speaks to the communication robot 20, the communication robot 20 converts voice data corresponding to the user U's utterance into character string data using a voice recognition function. Next, the communication robot 20 transmits the converted character string data to the server 10. Next, the server 10 constructs a response to the character string data (the user U's utterance) as text data using a conversation generation AI (artificial intelligence) and returns the response to the communication robot 20. Finally, the communication robot 20 converts the text data returned from the server 10 into voice data using a voice synthesis function and responds to the user U. The server 10 may be configured as one or more information processing devices, or may be configured using a virtual server (such as a cloud server).

[0016] (Family Features) Next, we will explain the "family function" of the communication robot 20. The family function is a function that identifies (authenticates) a person and calls them by name based on the voice and face of the user U detected by a microphone or camera when the user U speaks to the communication robot 20 or when the communication robot 20 speaks to the user U. The family function can be used by simply registering the user U's voice, but by registering the face, the following effects can be achieved. Compared to using only the user U's voice, the accuracy of identifying a person can be improved. This is because the content of user U's voice detected by a microphone varies more than the content of user U's face detected by a camera, and moreover, the communication robot 20 does not grasp the user U's position and detect his / her voice, and user U does not speak to the communication robot 20 using set phrases. -Children, the elderly, and people with disabilities, who previously had difficulty registering by voice, can now register as well. - It will be possible to address the user by name when speaking from the communication robot 20, such as "Welcome back, ○○!"

[0017] In order for the communication robot 20 to perform the family functions, the voice of the user U is registered in the following manner. 1. The user U starts the dedicated application installed on the user terminal 30 and presses the "family registration button" displayed on the display screen. 2. The user U presses the "voice registration button" displayed on the display screen of the user terminal 30. This causes the mode of the communication robot 20 to transition from the normal mode to the voice registration mode. 3. The user U reads out the keyword sentence displayed on the display screen of the user terminal 30 or the keyword sentence read out by the communication robot 20 while being guided by voice. 4. The communication robot 20 uses a microphone to detect the voice of the user U when he / she reads out the keyword sentence, and acquires the voice data. If the user U reads out the keyword sentence incorrectly, steps 3 and 4 are repeated. 5. The communication robot 20 stores the acquired voice data in the storage unit and transitions from the voice registration mode to the normal mode, thereby completing the voice registration process for the user U.

[0018] In order for the communication robot 20 to perform the family function, the face of the user U is registered in the following manner. 1. The user U starts the dedicated application installed on the user terminal 30 and presses the "family registration button" displayed on the display screen. 2. The user U presses the "face registration button" displayed on the display screen of the user terminal 30. This causes the mode of the communication robot 20 to transition from the normal mode to the face registration mode. 3. The communication robot 20 uses a camera to detect the face of the user U and acquire image data. If the camera fails to detect the face of the user U, the communication robot 20 gives voice instructions to the user U to correct the direction of their face. 4. Based on the acquired image data, the communication robot 20 stores in the memory unit feature data indicating the features of the user U's facial features, such as the outline, eyes, nose, and mouth, and then transitions from the face registration mode to the normal mode. This completes the registration process for the user U's face.

[0019] (Server 10 hardware configuration) 2 is a block diagram showing the hardware configuration of the server 10 in this embodiment. As shown in FIG. 2, the server 10 includes a control unit 11, a storage unit 12, a communication unit 13, an operation input unit 14, and a monitor 15.

[0020] The control unit 11 is, for example, a CPU (Central Processing Unit), a microprocessor, a DSP (Digital Signal Processor), or the like, and controls the overall operation of the server 10.

[0021] A part of the storage unit 12 is configured with, for example, a RAM (Random Access Memory) or a DRAM (Dynamic Random Access Memory), and is used as a work area when the control unit 11 executes processes based on various programs.

[0022] Furthermore, a part of the storage unit 12 is, for example, a non-volatile memory such as a ROM (Read Only Memory) or an HDD (Hard Disk Drive), and stores various data and programs used in the processing of the control unit 11. The storage unit 12 can hold a database including one or more tables for recording various information, processing results, and the like.

[0023] The programs stored in the storage unit 12 include, for example, an OS (Operating System) for implementing the basic functions of the server 10, drivers for controlling various hardware, programs for implementing various functions, and the like.

[0024] The communication unit 13 is, for example, a network interface controller (NIC) and has a function of connecting to the communication line 5. Instead of or in addition to the NIC, the communication unit 13 may have a function of connecting to a wireless local area network (LAN), a function of connecting to a wireless wide area network (WAN), a function of enabling short-range wireless communication such as Bluetooth (registered trademark), infrared communication, etc. The server 10 is connected to the communication robot 20 etc. via the communication line 5 and can transmit and receive various data to and from the communication robot 20 etc.

[0025] The operation input unit 14 is composed of a keyboard, a mouse, etc., and accepts input of various operations by a user who uses the server 10. The monitor 15 is, for example, a liquid crystal display device, etc., and displays various images.

[0026] The control unit 11, storage unit 12, communication unit 13, operation input unit 14, and monitor 15 are electrically connected to one another via a system bus 16. Therefore, the control unit 11 can access the storage unit 12, display images on the monitor 15, grasp the operation status of the operation input unit 14 by the user, and access various communication networks and user terminals 30 via the communication unit 13.

[0027] (Hardware configuration of Communication Robot 20) 3 is a block diagram showing the hardware configuration of the communication robot 20 in this embodiment. As shown in Fig. 3, the communication robot 20 is configured with a control unit 21, a memory unit 22, a communication unit 23, a display unit 24, a speaker 25, a microphone 26, a camera 27, and an operation button 28.

[0028] The control unit 21 is, for example, a CPU (Central Processing Unit), a microprocessor, a DSP (Digital Signal Processor), or the like, and controls the overall operation of the user terminal 30.

[0029] A part of the storage unit 22 is configured with, for example, a RAM (Random Access Memory) or a DRAM (Dynamic Random Access Memory), and is used as a work area when the control unit 21 executes processes based on various programs.

[0030] Furthermore, a part of the storage unit 22 is, for example, a non-volatile memory such as a ROM (Read Only Memory) or an HDD (Hard Disk Drive), and stores various data and programs used in the processing of the control unit 21. The storage unit 22 can hold a database including one or more tables for recording various information, processing results, and the like.

[0031] The programs stored in the memory unit 22 include, for example, an OS (Operating System) for realizing the basic functions of the user terminal 30, drivers for controlling various hardware, programs for realizing various functions, etc., and include programs that function as the ``information processing program'' of the present invention.

[0032] The communication unit 23 is, for example, a network interface controller (NIC) and has a function of connecting to the communication line 5. In addition to the NIC, the communication unit 23 also has a function of connecting to a wireless local area network (LAN), a function of connecting to a wireless wide area network (WAN), and a function of enabling short-range wireless communication such as Bluetooth (registered trademark), infrared communication, etc. The communication robot 20 can be connected to the server 10 via the communication line 5 or to a user terminal 30, etc. via short-range wireless communication, and can transmit and receive various data to and from the server 10, the user terminal 30, etc.

[0033] The display unit 24 is a touch panel display or the like, and is capable of displaying images and the like and accepting operations by the user U.

[0034] The speaker 25 outputs various sounds under the control of the control unit 21. The microphone 26 inputs various sounds under the control of the control unit 21. The camera 27 captures an image of a subject under the control of the control unit 21.

[0035] The operation button 28 is provided, for example, on the side of the communication robot 20, and includes a power button for starting or stopping the communication robot 20, a button for adjusting the volume of the sound output from the speaker 25, etc.

[0036] The control unit 21, memory unit 22, communication unit 23, display unit 24, speaker 25, microphone 26, camera 27, and operation buttons 28 are electrically connected to one another via a system bus 29. Therefore, the control unit 21 can access the memory unit 22, display images on the display unit 24, grasp the operation state of the touch panel display (display unit 24) and operation buttons 28 by the user U, input sound to the microphone 26, output sound from the speaker 25, control the camera 27, and access various communication networks, the server 10, the user terminal 30, etc. via the communication unit 23.

[0037] (Hardware configuration of user terminal 30) 4 is a block diagram showing the hardware configuration of the user terminal 30 in this embodiment. As shown in FIG. 4, the user terminal 30 includes a control unit 31, a storage unit 32, a communication unit 33, a display unit 34, a speaker 35, a microphone 36, a camera 37, and an operation button 38.

[0038] The control unit 31 is, for example, a CPU (Central Processing Unit), a microprocessor, a DSP (Digital Signal Processor), or the like, and controls the overall operation of the user terminal 30.

[0039] A part of the storage unit 32 is configured, for example, with RAM (Random Access Memory) or DRAM (Dynamic Random Access Memory), and is used as a work area when the control unit 31 executes processes based on various programs.

[0040] Furthermore, a part of the storage unit 32 is, for example, a non-volatile memory such as a ROM (Read Only Memory) or an HDD (Hard Disk Drive), and stores various data and programs used in the processing of the control unit 31. The storage unit 32 can hold a database including one or more tables for recording various information, processing results, and the like.

[0041] The programs stored in the storage unit 32 include, for example, an OS (Operating System) for realizing the basic functions of the user terminal 30, drivers for controlling various hardware, programs for realizing various functions, and the like.

[0042] The communication unit 33 is, for example, a network interface controller (NIC), and has a function of connecting to the communication line 5. In addition to the NIC, the communication unit 33 also has a function of connecting to a wireless local area network (LAN), a function of connecting to a wireless wide area network (WAN), and a function of enabling short-range wireless communication such as Bluetooth (registered trademark), infrared communication, etc. The user terminal 30 is connected to the communication robot 20, etc. via short-range wireless communication, and can transmit and receive various data to and from the communication robot 20, etc.

[0043] The display unit 34 is a touch panel display or the like, and is capable of displaying images and the like and accepting operations by the user U.

[0044] The speaker 35 outputs various sounds under the control of the control unit 31. The microphone 36 inputs various sounds under the control of the control unit 31. The camera 37 captures an image of a subject under the control of the control unit 31.

[0045] The operation button 38 is provided on, for example, the side surface of the user terminal 30, and includes a power button for starting or stopping the user terminal 30, a button for adjusting the volume of the sound output from the speaker 35, etc.

[0046] The control unit 31, memory unit 32, communication unit 33, display unit 34, speaker 35, microphone 36, camera 37, and operation buttons 38 are electrically connected to one another via a system bus 39. Therefore, the control unit 31 can access the memory unit 32, display images on the display unit 34, grasp the operation status of the touch panel display (display unit 34) and operation buttons 38 by the user U, input sound to the microphone 36, output sound from the speaker 35, control the camera 37, and access various communication networks, the communication robot 20, etc. via the communication unit 33.

[0047] 5 is a block diagram showing an example of the functional configuration of the control unit 21 included in the communication robot 20 according to this embodiment. As shown in FIG. 5, the control unit 21 includes, as its functional configuration, a first surrounding information acquisition unit 21a, a second surrounding information acquisition unit 21b, a registration control unit 21c, a registration promotion unit 21d, an environment analysis unit 21e, and an authentication unit 21f. Note that the control unit 21 of the communication robot 20 generally has various functions in addition to those described above. However, here, only the functions characteristic of the "family function" of the communication robot 20 according to this embodiment will be described, and illustrations and descriptions of other known functions will be omitted.

[0048] The first ambient information acquisition unit 21a acquires ambient sounds as first ambient information relating to the ambient environment of the communication robot 20 via the microphone .

[0049] The second surrounding information acquisition unit 21b acquires a surrounding image via the camera 27 as second surrounding information relating to the surrounding environment of the communication robot 20.

[0050] The registration control unit 21c registers information based on the first ambient information acquired by the first ambient information acquisition unit 21a about the user U (corresponding to the "first user" of the present invention) in the storage unit 12 of the server 10 as first authentication information for authenticating the user U. In this embodiment, the information based on the first ambient information is characteristic information of the voice (voiceprint) of the user U identified from the voice (detected by the microphone 26) when the keyword sentence is read out after the user U presses the "family registration button" and the "voice registration button" when the "family function" of the communication robot 20 is executed.

[0051] The registration control unit 21c registers information based on the second surrounding information about the user U acquired by the second surrounding information acquisition unit 21b in the storage unit 12 of the server 10 as second authentication information for authenticating the user U. In this embodiment, the information based on the second surrounding information is characteristic information about the contours of the user U and facial features such as the eyes, nose, and mouth, which are identified from the face of the user U detected by the camera 27 after the user U presses the "family registration button" and the "face registration button" when the "family function" of the communication robot 20 is executed.

[0052] When authentication of user U is successful based on the first ambient information (ambient sound) and first authentication information acquired by the first ambient information acquisition unit 21a, if information based on the second ambient information about user U acquired by the second ambient information acquisition unit 21b (characteristic information about user U's facial features such as the user's outline, eyes, nose, and mouth) has not been registered as second authentication information for authenticating user U, the registration promotion unit 21d prompts user U to register the second authentication information.

[0053] Here, examples of the promotion mode by the registration promotion unit 21d include a mode in which the promotion information is audibly notified by playing an audio signal through the speaker 25 of the communication robot 20 or the speaker 35 of the user terminal 30, a mode in which the promotion information is visually notified by displaying an image on the display unit 24 of the communication robot 20 or the display unit 34 of the user terminal 30, a mode in which the promotion information is visually notified by generating light by controlling the color, lighting / flashing pattern, light intensity, etc. of the light in the communication robot 20 or the user terminal 30, a mode in which the promotion information is tactilely notified by generating vibrations using the vibration function of the communication robot 20 or the user terminal 30 by controlling the vibration pattern, intensity, etc., and a mode in which the notification information is olfactorily notified by firing air with a predetermined odor, such as an irritating odor, into the nasal cavity of the user U using a swiveling air cannon in the communication robot 20 or the user terminal 30. Note that audio signals include human voice messages, buzzers, chimes, alarms, etc. The images displayed on the display units 24 and 34 include at least one element such as a figure, computer graphics, a photograph, a letter, a number, and a symbol, and may also include a combination of two or more elements. Furthermore, the images may be either monochrome or color images, and may be either still images or moving images.

[0054] 6 is a diagram showing an example of a registration prompting screen displayed on the display unit 34 of the user terminal 30. As shown in FIG. 6, when authentication of user U is successful based on the first ambient information (ambient sound) and the first authentication information acquired by the first ambient information acquisition unit 21a, if second authentication information has not been registered for user U, the registration prompting unit 21d prompts user U to register the second authentication information by displaying a display message 40 (in the illustrated example, "Please register second authentication information") on the display unit 34 of the user terminal 30. This makes it possible to suitably guide user U in a direction that improves authentication accuracy for user U (toward registering both the first authentication information and the second authentication information) when multiple pieces of authentication information (first authentication information, second authentication information) can be registered as information for authenticating user U.

[0055] In addition, when the registration promotion unit 21d successfully authenticates user U based on the second ambient information (ambient image) and second authentication information acquired by the second ambient information acquisition unit 21b, if information based on the first ambient information acquired about user U by the first ambient information acquisition unit 21a (characteristic information of user U's voiceprint) has not been registered as first authentication information for authenticating user U, the registration promotion unit 21d may prompt user U to register the first authentication information.

[0056] When authentication of user U is successful based on the first ambient information and first authentication information acquired by the first ambient information acquisition unit 21a, if the ambient environment of the communication robot 20 based on the first or second ambient information acquired by the first or second ambient information acquisition unit 21a, 21b satisfies a predetermined condition, the registration promotion unit 21d does not urge the user U to register the second authentication information, but if the ambient environment of the communication robot 20 based on the first or second ambient information acquired by the first or second ambient information acquisition unit 21a, 21b does not satisfy the predetermined condition, the registration promotion unit 21d urges the user U to register the second authentication information.

[0057] Here, the predetermined conditions are conditions that are not suitable for registering the second authentication information, such as when multiple users are talking and there is a possibility that their conversations will be interrupted, when the ambient noise is loud and there are many people who are not involved in registering the authentication information, when the surroundings are dark, or when the communication robot 20 is located outdoors and there are many people who are not involved in registering the authentication information.

[0058] As described above, when the surrounding environment of the communication robot 20 is not suitable for registering the second authentication information, it is possible to prevent the user U from being prompted to register the second authentication information. Also, when the surrounding environment of the communication robot 20 is suitable for registering the second authentication information, it is possible to suitably prompt the user U to register the second authentication information. In particular, it is possible to suitably vary whether or not the user U is prompted to register the second authentication information depending on whether or not the surrounding environment of the communication robot 20 is outdoors.

[0059] Whether the communication robot 20 is located indoors or outdoors can be determined, for example, by performing image analysis processing on the surrounding image acquired by the second surrounding information acquisition unit 21b. If a room is recognized in the surrounding image acquired by the second surrounding information acquisition unit 21b, the communication robot 20 can be determined to be located outdoors. To recognize the room in the surrounding image, the communication robot 20 may store images of characteristic belongings (placed objects) in the user U's room, such as a television, air conditioner, and refrigerator, in the storage unit 22. The communication robot 20 may also determine whether it is located indoors or outdoors by acquiring location information from the user terminal 30 of the user U or its own GPS (Global Positioning System) or by acquiring connection (access) status to a wireless LAN.

[0060] When it is determined that there are multiple users around the communication robot 20 based on the first or second ambient information (ambient sound or ambient image) acquired by the first or second ambient information acquisition unit 21a, 21b (for example, the ambient sound includes the voices of multiple users, or the ambient image includes the faces of multiple users), the registration promotion unit 21d does not prompt the user U to register the second authentication information. Thereafter, after it is determined that there is only one user around the communication robot 20 and a predetermined time (several minutes) has elapsed, when it is determined that the user around the communication robot 20 is the user U based on the first or second ambient information acquired by the first or second ambient information acquisition unit 21a, 21b (that is, the user U is speaking or the user U is captured on camera 27), the registration promotion unit 21d prompts the user U to register the second authentication information. This makes it possible to suitably determine whether there are multiple users around the communication robot 20, depending on whether there are multiple users around the communication robot 20. In addition, the registration promotion unit 21d may prompt the user U to register the second authentication information only when, after it has been determined that the number of users present around the communication robot 20 is one and a predetermined time (several minutes) has elapsed, it is determined that the user U has spoken to the communication robot 20 based on the first or second surrounding information acquired by the first or second surrounding information acquisition unit 21a, 21b.

[0061] The registration promoting unit 21d determines whether or not to prompt the user U to register the second authentication information depending on the current time. For example, if the current time is during the daytime or when the user U is at work, the registration promoting unit 21d does not prompt the user U to register the second authentication information, but if the current time is during the evening (for example, when the user U is likely to have more free time, such as when he or she is watching television), the registration promoting unit 21d prompts the user U to register the second authentication information. This makes it possible to suitably determine whether or not to prompt the user U to register the second authentication information depending on the current time.

[0062] The registration promoting unit 21d prompts the user U to register the second authentication information when it is determined that the user U is present at a predetermined position relative to the communication robot 20 (for example, a position where the size of the user U's face in the peripheral image is appropriate and there is a high possibility that the user U's face can be successfully registered) based on the second peripheral information (peripheral image) about the user U acquired by the second peripheral information acquiring unit 21b. In other words, the registration promoting unit 21d prompts the user U to register the second authentication information when the user U is close to the communication robot 20, such as when the user U is talking to the communication robot 20, and there is no need for additional location guidance (a state where there is no need to take the time to register an image of the face). This makes it possible to suitably prompt the user U to register the second authentication information when the user U is located at a position suitable for registering the second authentication information.

[0063] When the second authentication information is registered in the storage unit 12 of the server 10 but the first authentication information is not registered in the storage unit 12 of the server 10, the registration promoting unit 21d prompts the user U to register the first authentication information (corresponding to the "second authentication information" of the present invention) if it is determined that the user U is within a predetermined distance (e.g., 1 to 2 m) from the communication robot 20 and the volume of the ambient sound of the communication robot 20 is equal to or lower than a predetermined volume based on the first and second ambient information (ambient sound, ambient image) acquired by the first and second ambient information acquiring units 21a and 21b. This makes it possible to suitably prompt the user U to register the second authentication information when the user U's location and the ambient sound of the communication robot 20 are in a situation suitable for registering the second authentication information.

[0064] The environment analysis unit 21e analyzes the surrounding environment (for example, brightness and surrounding sounds) of the communication robot 20 based on the first and second surrounding information acquired by the first and second surrounding information acquisition units 21a and 21b.

[0065] The authentication unit 21f authenticates the user U based on the first ambient information acquired by the first ambient information acquisition unit 21a and the first authentication information registered in the storage unit 12 of the server 10. For example, the authentication unit 21f authenticates the user U depending on whether the degree of similarity between the voice included in the first ambient information (ambient sound) acquired by the first ambient information acquisition unit 21a and the first authentication information (voice of the user U) registered in the storage unit 12 of the server 10 is equal to or greater than a predetermined degree.

[0066] Furthermore, the authentication unit 21f authenticates the user U based on the second ambient information acquired by the second ambient information acquisition unit 21b and the second authentication information registered in the storage unit 12 of the server 10. For example, the authentication unit 21f authenticates the user U depending on whether the degree of similarity between the user's facial features included in the second ambient information (ambient image) acquired by the second ambient information acquisition unit 21b and the second authentication information (user U's facial features) registered in the storage unit 12 of the server 10 is equal to or greater than a predetermined degree.

[0067] Depending on the analysis result of the surrounding environment by the environment analysis unit 21e, the authentication unit 21f varies the degree to which the first authentication information and the second authentication information are used (frequency, amount of use of authentication information) when authenticating the user U present around the communication robot 20. This can improve the possibility of successfully authenticating the user U present around the communication robot 20 using the first authentication information and the second authentication information depending on the surrounding environment of the communication robot 20.

[0068] For example, when the analysis result of the surrounding environment by the environment analysis unit 21e shows that the brightness around the communication robot 20 is equal to or lower than a predetermined brightness (i.e., dark), the authentication unit 21f uses the first authentication information (characteristic information about the user U's voice) more frequently than the second authentication information (characteristic information about the user U's facial features such as the user U's outline, eyes, nose, and mouth) when authenticating the user U around the communication robot 20. This can improve the possibility of successfully authenticating the user U around the communication robot 20 using the first authentication information and the second authentication information depending on the brightness around the communication robot 20. Note that when the analysis result of the surrounding environment by the environment analysis unit 21e shows that the brightness around the communication robot 20 is equal to or lower than a predetermined brightness, the authentication unit 21f may use the first authentication information of the first and second authentication information as information with high reliability for person authentication when authenticating the user U around the communication robot 20.

[0069] Furthermore, when the volume of the sound around the communication robot 20 is equal to or greater than a predetermined volume (i.e., noisy) as a result of the analysis of the surrounding environment by the environment analysis unit 21e, the authentication unit 21f uses the second authentication information (characteristic information about the user U's facial features such as the outline of the user U and the eyes, nose, mouth, etc.) more than the first authentication information (characteristic information about the user U's voice) when authenticating the user U around the communication robot 20. This makes it possible to improve the possibility of successfully authenticating the user around the communication robot 20 using the first authentication information and the second authentication information according to the sound around the communication robot 20.

[0070] Furthermore, when the volume of the voice of a user U present around the communication robot 20 is equal to or lower than a predetermined volume (i.e., low) as a result of the analysis of the surrounding environment by the environment analysis unit 21e, the authentication unit 21f increases the degree to which the second authentication information (characteristic information of the user U's facial features such as the outline of the user U and the eyes, nose, mouth, etc.) is used over the first authentication information (characteristic information of the user U's voice) when authenticating the user U present around the communication robot 20. This makes it possible to improve the possibility of successfully authenticating the user U using the first authentication information and the second authentication information depending on the volume of the voice of the user U present around the communication robot 20.

[0071] FIG. 7 is a flowchart showing an example of the registration control process (corresponding to a part of the "information processing method" of the present invention) performed by the communication robot 20 in this embodiment.

[0072] First, the first ambient information acquisition unit 21a acquires ambient sounds as first ambient information relating to the ambient environment of the communication robot 20 via the microphone 26 (step S100).

[0073] Next, the registration control unit 21c registers information based on the first ambient information about the user U acquired by the first ambient information acquisition unit 21a (characteristic information about the voiceprint of the user U) in the storage unit 12 of the server 10 as first authentication information for authenticating the user U (step S110). Upon completion of the processing of step S110, the communication robot 20 ends the registration control processing shown in FIG.

[0074] FIG. 8 is a flowchart showing an example of the registration control process performed by the communication robot 20 in this embodiment.

[0075] First, the second surrounding information acquisition unit 21b acquires a surrounding image as second surrounding information relating to the surrounding environment of the communication robot 20 via the camera 27 (step S200).

[0076] Next, the registration control unit 21c registers information based on the second surrounding information about the user U acquired by the second surrounding information acquisition unit 21b (information about the user U's outline and characteristics of facial features such as the eyes, nose, and mouth) in the storage unit 12 of the server 10 as second authentication information for authenticating the user U (step S210). Upon completion of the processing of step S210, the communication robot 20 ends the registration control processing shown in FIG. 8.

[0077] 9 is a flowchart showing an example of a registration promotion process (corresponding to a part of the "information processing method" of the present invention) performed by the communication robot 20 in this embodiment. Note that it is assumed that first authentication information for authenticating the user U has been registered in the storage unit 12 of the server 10 by the registration control unit 21c before the process of step S300 is executed.

[0078] First, the authentication unit 21f authenticates the user U based on the first surrounding information acquired by the first surrounding information acquisition unit 21a and the first authentication information registered in the storage unit 12 of the server 10 (step S300).

[0079] Next, the authentication unit 21f determines whether or not the authentication of the user U has been successful (step S310). If the determination result shows that the authentication of the user U has not been successful (step S310, NO), the communication robot 20 ends the registration promotion process shown in FIG.

[0080] On the other hand, if the authentication of the user U is successful (step S310, YES), the registration promotion unit 21d determines whether or not the second authentication information for authenticating the user U is registered in the storage unit 12 of the server 10 (step S320). If the determination result shows that the second authentication information is registered in the storage unit 12 of the server 10 (step S320, YES), the communication robot 20 ends the registration promotion process shown in Fig. 9. In this case, the authentication unit 21f authenticates the user U based on the second surrounding information acquired by the second surrounding information acquisition unit 21b and the second authentication information registered in the storage unit 12 of the server 10.

[0081] On the other hand, if the second authentication information is not registered in the storage unit 12 of the server 10 (step S320, NO), the registration promoting unit 21d prompts the user U to register the second authentication information (step S330). Upon completion of the processing of step S330, the communication robot 20 ends the registration control processing shown in FIG.

[0082] As described above in detail, in this embodiment, the communication robot 20 (information processing device) includes a first ambient information acquisition unit 21a, a second ambient information acquisition unit 21b, a registration control unit 21c, and a registration promotion unit 21d. The first ambient information acquisition unit 21a acquires first ambient information related to the ambient environment of the communication robot 20. The second ambient information acquisition unit 21b acquires second ambient information related to the ambient environment of the communication robot 20. The registration control unit 21c registers information based on the first ambient information about a user U (first user) acquired by the first ambient information acquisition unit 21a (characteristics of the user U's voiceprint) in the server 10 as first authentication information for authenticating the user U. When user U is successfully authenticated based on the first ambient information and first authentication information acquired by the first ambient information acquisition unit 21a, if information based on the second ambient information about user U acquired by the second ambient information acquisition unit 21b (features of user U's facial features such as the user's outline, eyes, nose, and mouth) has not been registered as second authentication information for authenticating user U, the registration promotion unit 21d prompts user U to register the second authentication information.

[0083] According to this embodiment configured as described above, when multiple pieces of authentication information (first authentication information, second authentication information) can be registered as information for authenticating user U, user U can be suitably guided in a direction that improves the authentication accuracy of user U.

[0084] In the above embodiment, if authentication of user U based on both the first authentication information and the second authentication information fails after the second authentication information is registered in the memory unit 12 of the server 10 following the first authentication information, the registration promotion unit 21d prompts user U to re-register the first and second authentication information for authenticating user U.

[0085] 10 is a diagram showing an example of a registration prompting screen displayed on the display unit 34 of the user terminal 30. As shown in FIG. 10, after the second authentication information is registered in the storage unit 12 of the server 10 following the first authentication information, if authentication of user U based on both the first authentication information and the second authentication information fails, the registration prompting unit 21d displays a display message 50 (in the illustrated example, "Please re-register the first authentication information and the second authentication information") on the display unit 34 of the user terminal 30, thereby prompting user U to re-register the first and second authentication information used to authenticate user U. This makes it possible to suitably prompt user U to re-register the first and second authentication information when authentication of user U based on both the first authentication information and the second authentication information fails.

[0086] 11, the control unit 21 of the communication robot 20 may further include a privacy setting unit 21g as a functional configuration. After the second authentication information is registered in the storage unit 12 of the server 10 following the first authentication information, if authentication of the user U based on one of the first authentication information and the second authentication information is successful, the privacy setting unit 21g sets the degree of privacy protection of the user U in information (e.g., utterance information) output from the communication robot 20 to a first degree, and if authentication of the user U based on the other of the first authentication information and the second authentication information is also successful thereafter, the privacy setting unit 21g sets the degree of privacy protection of the user U in information (e.g., utterance information) output from the communication robot 20 to a second degree, which is higher than the first degree. For example, when the degree of protecting the user U's privacy is set to a first level, there is a possibility that the user U's privacy information (e.g., the user U's favorite food, hobbies, and birthday) registered in the storage unit 12 of the server 10 will be included in the speech information output from the communication robot 20. However, when the degree of protecting the user U's privacy is set to a second level, there is no possibility that the user U's privacy information registered in the storage unit 12 of the server 10 will be included in the speech information output from the communication robot 20. This makes it possible to suitably vary the degree of protecting the user U's privacy depending on the success or failure of authentication of the user U based on the first authentication information and the second authentication information. Note that the communication robot 20 may acquire the user U's privacy information registered in the storage unit 12 of the server 10 upon startup, and delete the acquired user U's privacy information from its own storage unit 22 upon shutdown.

[0087] Furthermore, the above-described embodiments are merely examples of specific embodiments for carrying out the present invention, and the technical scope of the present invention should not be construed as being limited by these embodiments. In other words, the present invention can be carried out in various forms without departing from the gist or main features thereof.

[0088] <Summary> [General-purpose assignment] One of the objects of the present invention is to improve the accuracy of user authentication.

[0089] Issues corresponding to [Appendix 1] One of the objects of the present invention is to preferably guide a user in a direction that improves the accuracy of user authentication when a plurality of pieces of authentication information can be registered as information for authenticating the user. [Appendix 1] The information processing device of this embodiment includes a first ambient information acquisition unit that acquires first ambient information related to the ambient environment of the information processing device, a second ambient information acquisition unit that acquires second ambient information related to the ambient environment of the information processing device, a registration control unit that registers information based on the first ambient information acquired by the first ambient information acquisition unit about the first user as first authentication information for authenticating the first user, and a registration promotion unit that, when authentication of the first user is successful based on the first ambient information and the first authentication information acquired by the first ambient information acquisition unit, prompts the first user to register the second authentication information if information based on the second ambient information acquired by the second ambient information acquisition unit about the first user has not been registered as second authentication information for authenticating the first user. According to the above information processing device, when multiple pieces of authentication information (first authentication information, second authentication information) can be registered as information for authenticating a first user, the first user can be suitably guided in a direction that improves the authentication accuracy of the first user.

[0090] Issues corresponding to [Appendix 2] One object of the present invention is to prevent a first user from being prompted to register second authentication information when the surrounding environment of the information processing device is not suitable for registering second authentication information. [Appendix 2] An information processing device as described in Appendix 1, wherein when authentication of a first user is successful based on the first ambient information and first authentication information acquired by the first ambient information acquisition unit, the registration promotion unit does not prompt the first user to register second authentication information if the ambient environment of the information processing device based on the first or second ambient information acquired by the first or second ambient information acquisition unit satisfies a predetermined condition. This makes it possible to prevent the first user from being prompted to register the second authentication information when the surrounding environment of the information processing device is not suitable for registering the second authentication information.

[0091] Issues corresponding to [Appendix 3] An object of the present invention is to preferably prompt a first user to register second authentication information when the surrounding environment of an information processing device is suitable for registering second authentication information. [Appendix 3] An information processing device described in Appendix 1 or 2, wherein the registration promotion unit, when successfully authenticating the first user based on the first ambient information and first authentication information acquired by the first ambient information acquisition unit, prompts the first user to register second authentication information if the ambient environment of the information processing device based on the first or second ambient information acquired by the first or second ambient information acquisition unit changes from a state satisfying specified conditions to a state not satisfying the specified conditions. This makes it possible to preferably prompt the first user to register the second authentication information when the surrounding environment of the information processing device is suitable for registering the second authentication information.

[0092] Issues corresponding to [Appendix 4] One object of the present invention is to appropriately change whether or not to prompt the first user to register second authentication information depending on whether the surrounding environment of the information processing device is outdoors. [Appendix 4] An information processing device described in Appendix 2 or 3, wherein the specified condition is outdoors, and the registration promotion unit does not prompt the first user to register the second authentication information if the surrounding environment of the information processing device based on the first or second surrounding information acquired by the first or second surrounding information acquisition unit satisfies the specified condition, and prompts the first user to register the second authentication information if the surrounding environment of the information processing device does not satisfy the specified condition. This makes it possible to suitably change whether or not to prompt the first user to register the second authentication information depending on whether the surrounding environment of the information processing device is outdoors.

[0093] Issues corresponding to [Appendix 5] One object of the present invention is to appropriately change whether or not to prompt a first user to register second authentication information depending on whether or not there are multiple users around an information processing device. [Appendix 5] An information processing device described in any one of Appendices 1 to 4, wherein the first ambient information acquisition unit acquires ambient sounds of the information processing device as the first ambient information, the second ambient information acquisition unit acquires ambient images of the information processing device as the second ambient information, and the registration promotion unit does not prompt the first user to register second authentication information when it is determined that there are multiple users present around the information processing device based on the first or second ambient information acquired by the first or second ambient information acquisition unit, and then, after it is determined that there is one user present around the information processing device and a predetermined time has elapsed, it prompts the first user to register second authentication information when it is determined that the user present around the information processing device is the first user based on the first or second ambient information acquired by the first or second ambient information acquisition unit. This makes it possible to suitably change whether or not to prompt the first user to register the second authentication information depending on whether or not there are a plurality of users around the information processing device.

[0094] Issues corresponding to [Appendix 6] One object of the present invention is to appropriately change whether or not to prompt the first user to register second authentication information depending on the current time. [Supplementary Note 6] The information processing device according to any one of Supplementary Notes 1 to 5, wherein the registration promotion unit determines whether or not to promote the first user to register the second authentication information depending on the current time. This makes it possible to suitably change whether or not to prompt the first user to register the second authentication information depending on the current time.

[0095] Issues corresponding to [Appendix 7] One of the objects of the present invention is to preferably prompt a first user, whose voice is registered as first authentication information, to register second authentication information when the location of the first user is a suitable location for registering second authentication information. [Appendix 7] An information processing device described in any one of Appendices 1 to 6, wherein the registration control unit registers the voice of the first user based on first ambient information acquired by the first ambient information acquisition unit for the first user as first authentication information, and the registration promotion unit prompts the first user to register the second authentication information when it is determined that the first user is present at a predetermined position relative to the information processing device based on second ambient information acquired by the second ambient information acquisition unit for the first user. This makes it possible to preferably prompt the first user to register the second authentication information when the location of the first user whose voice is registered as the first authentication information is a location suitable for registering the second authentication information.

[0096] Issues corresponding to [Appendix 8] One object of the present invention is to preferably prompt a first user to register second authentication information when the location of the first user and the ambient sound of the information processing device are in a situation suitable for registering second authentication information. [Appendix 8] An information processing device described in any one of Appendices 1 to 7, wherein the first ambient information acquisition unit acquires ambient sounds of the information processing device as the first ambient information, the second ambient information acquisition unit acquires ambient images of the information processing device as the second ambient information, and the registration promotion unit prompts the first user to register second authentication information when it is determined based on the first and second ambient information acquired by the first and second ambient information acquisition units that the first user is present within a predetermined distance from the information processing device and the volume of the ambient sounds of the information processing device is below a predetermined volume. This makes it possible to suitably prompt the first user to register the second authentication information when the location of the first user and the ambient sound of the information processing device are in a situation suitable for registering the second authentication information.

[0097] Issues corresponding to [Appendix 9] One of the objects of the present invention is to improve the possibility of successfully authenticating a user present around an information processing device using the first authentication information and the second authentication information depending on the surrounding environment of the information processing device. [Appendix 9] An information processing device described in any one of Appendices 1 to 8, further comprising an environment analysis unit that analyzes the surrounding environment of the information processing device based on the first and second surrounding information acquired by the first and second surrounding information acquisition units, and an authentication unit that varies the degree to which the first authentication information and the second authentication information are used when authenticating a first user present around the information processing device depending on the analysis result of the surrounding environment. This makes it possible to improve the possibility of successfully authenticating a user present around the information processing device using the first authentication information and the second authentication information, depending on the surrounding environment of the information processing device.

[0098] Issues corresponding to [Appendix 10] One of the objects of the present invention is to improve the possibility of successfully authenticating a user present around an information processing device using the first authentication information and the second authentication information depending on the brightness around the information processing device. [Appendix 10] An information processing device as described in Appendix 9, wherein the first ambient information acquisition unit acquires ambient sounds of the information processing device as first ambient information, the second ambient information acquisition unit acquires ambient images of the information processing device as second ambient information, and when the brightness around the information processing device is below a predetermined brightness as a result of analyzing the ambient environment, the authentication unit uses the first authentication information to a greater extent than the second authentication information when authenticating a first user present around the information processing device. This makes it possible to improve the possibility of successfully authenticating a user present around the information processing device using the first authentication information and the second authentication information, depending on the brightness around the information processing device.

[0099] Issues corresponding to [Appendix 11] One of the objects of the present invention is to improve the possibility of successfully authenticating a user present around an information processing device using the first authentication information and the second authentication information depending on the ambient sounds around the information processing device. [Appendix 11] An information processing device as described in Appendix 9, wherein the first ambient information acquisition unit acquires ambient sounds of the information processing device as the first ambient information, the second ambient information acquisition unit acquires ambient images of the information processing device as the second ambient information, and when the volume of the ambient sounds of the information processing device is equal to or greater than a predetermined volume as a result of analyzing the ambient environment, the authentication unit uses the second authentication information to a greater extent than the first authentication information when authenticating a first user present around the information processing device. This makes it possible to improve the possibility of successfully authenticating a user present around the information processing device using the first authentication information and the second authentication information, depending on the ambient sound around the information processing device.

[0100] Issues corresponding to [Appendix 12] One of the objects of the present invention is to improve the possibility of successfully authenticating a user using first authentication information and second authentication information depending on the volume of the user's voice present around the information processing device. [Appendix 12] An information processing device as described in Appendix 9, wherein the first ambient information acquisition unit acquires ambient sounds of the information processing device as the first ambient information, the second ambient information acquisition unit acquires ambient images of the information processing device as the second ambient information, and the authentication unit, when the volume of the voice of the first user present around the information processing device is equal to or lower than a predetermined volume as a result of analyzing the ambient environment, uses the second authentication information to a greater extent than the first authentication information when authenticating the first user present around the information processing device. This makes it possible to improve the possibility of successfully authenticating a first user using the first authentication information and the second authentication information, depending on the volume of the voice of the first user present around the information processing device.

[0101] Issues corresponding to [Appendix 13] One object of the present invention is to preferably prompt a user to re-register the first and second authentication information when authentication of the user based on both the first authentication information and the second authentication information fails. [Appendix 13] An information processing device described in any one of Appendices 1 to 12, wherein the registration promotion unit prompts the first user to re-register the first and second authentication information for authenticating the first user if authentication of the first user based on both the first authentication information and the second authentication information fails after the second authentication information is registered. This makes it possible to preferably prompt the first user to re-register the first and second authentication information when authentication of the first user based on both the first authentication information and the second authentication information fails.

[0102] Issues corresponding to [Appendix 14] One of the objects of the present invention is to appropriately vary the degree to which the privacy of a user is protected depending on the success of authentication of the user based on the first authentication information and the second authentication information. [Appendix 14] An information processing device described in any one of Appendices 1 to 13, further comprising a privacy setting unit that, if authentication of the first user based on one of the first authentication information and the second authentication information is successful after the second authentication information is registered, sets a degree of protection of the privacy of the first user in information output from the information processing device regarding the first user to a first degree, and if authentication of the first user based on the other of the first authentication information and the second authentication information is also successful thereafter, sets a degree of protection of the privacy of the first user in information output from the information processing device regarding the first user to a second degree higher than the first degree. This makes it possible to suitably vary the degree to which the privacy of the first user is protected depending on the success or failure of authentication of the first user based on the first authentication information and the second authentication information.

[0103] Issues corresponding to [Appendix 15] One of the objects of the present invention is to preferably guide a user in a direction that improves the accuracy of user authentication when a plurality of pieces of authentication information can be registered as information for authenticating the user. [Appendix 15] In the information processing method of this embodiment, a processor acquires first ambient information related to the ambient environment of the information processing device, acquires second ambient information related to the ambient environment of the information processing device, registers information based on the first ambient information acquired about a first user as first authentication information for authenticating the first user, and when the processor successfully authenticates the first user based on the acquired first ambient information and the first authentication information, if information based on the second ambient information acquired about the first user is not registered as second authentication information for authenticating the first user, the processor prompts the first user to register the second authentication information. According to the above information processing method, when multiple pieces of authentication information (first authentication information, second authentication information) can be registered as information for authenticating a first user, the first user can be suitably guided in a direction that improves the authentication accuracy of the first user.

[0104] Issues corresponding to [Appendix 16] One of the objects of the present invention is to preferably guide a user in a direction that improves the accuracy of user authentication when a plurality of pieces of authentication information can be registered as information for authenticating the user. [Appendix 16] The information processing program of this embodiment causes a processor to acquire first ambient information related to the ambient environment of the information processing device, acquire second ambient information related to the ambient environment of the information processing device, register information based on the first ambient information acquired about a first user as first authentication information for authenticating the first user, and, when authentication of the first user is successful based on the acquired first ambient information and the first authentication information, if information based on the second ambient information acquired about the first user is not registered as second authentication information for authenticating the first user, execute a process to prompt the first user to register the second authentication information. According to the above information processing program, when multiple pieces of authentication information (first authentication information, second authentication information) can be registered as information for authenticating a first user, the first user can be suitably guided in a direction that improves the authentication accuracy of the first user. [Explanation of symbols]

[0105] 1: Information processing system, 10: Server, 11, 21, 31: Control unit, 12, 22, 32: Memory unit, 13, 23, 33: Communication unit, 14: Operation input unit, 15: Monitor, 16, 29, 39: System bus, 20: Communication robot, : Control unit, 21a: First surrounding information acquisition unit, 21b: Second surrounding information acquisition unit, 21c: Registration control unit, 21d: Registration promotion unit, 21e: Environment analysis unit, 21f: Authentication unit, 21g: Privacy setting unit, 24, 34: Display unit, 25, 35: Speaker, 26, 36: Microphone, 27, 37: Camera, 28, 38: Operation button, 30: User terminal, 40, 50: Display message, U: User

Claims

1. An information processing device including a first surrounding information acquisition unit, a second surrounding information acquisition unit, a registration control unit, and a registration promotion unit, the first surrounding information acquisition unit acquires first surrounding information related to a surrounding environment of the information processing device; the second surrounding information acquisition unit acquires second surrounding information related to a surrounding environment of the information processing device; the registration control unit registers information based on first surrounding information regarding a first user acquired by the first surrounding information acquisition unit as first authentication information for authenticating the first user; When the authentication of the first user is successful based on the first surrounding information acquired by the first surrounding information acquisition unit and the first authentication information, if information based on the second surrounding information acquired by the second surrounding information acquisition unit about the first user is not registered as second authentication information for authenticating the first user, the registration promotion unit prompts the first user to register the second authentication information. Information processing device.

2. When the authentication of the first user is successful based on the first surrounding information acquired by the first surrounding information acquisition unit and the first authentication information, the registration promotion unit does not prompt the first user to register the second authentication information if the surrounding environment of the information processing device based on the first or second surrounding information acquired by the first or second surrounding information acquisition unit satisfies a predetermined condition. The information processing device according to claim 1 .

3. When the authentication of the first user is successful based on the first surrounding information acquired by the first surrounding information acquisition unit and the first authentication information, if the surrounding environment of the information processing device based on the first or second surrounding information acquired by the first or second surrounding information acquisition unit changes from a state satisfying a predetermined condition to a state not satisfying the predetermined condition, the registration promotion unit prompts the first user to register the second authentication information. The information processing device according to claim 1 .

4. the predetermined condition is outdoors, the registration promotion unit does not prompt the first user to register the second authentication information when the surrounding environment of the information processing device based on the first or second surrounding information acquired by the first or second surrounding information acquisition unit satisfies the predetermined condition, and prompts the first user to register the second authentication information when the surrounding environment of the information processing device does not satisfy the predetermined condition; The information processing device according to claim 2 .

5. the first ambient information acquisition unit acquires ambient sound of the information processing device as the first ambient information; the second surrounding information acquisition unit acquires a surrounding image of the information processing device as the second surrounding information; When it is determined that there are multiple users around the information processing device based on the first or second surrounding information acquired by the first or second surrounding information acquisition unit, the registration promotion unit does not prompt the first user to register the second authentication information, and thereafter, after it is determined that there is only one user around the information processing device and a predetermined time has elapsed, when it is determined that the user around the information processing device is the first user based on the first or second surrounding information acquired by the first or second surrounding information acquisition unit, the registration promotion unit prompts the first user to register the second authentication information. The information processing device according to claim 1 .

6. the registration promoting unit determines whether to promote the first user to register the second authentication information depending on a current time. The information processing device according to claim 1 .

7. the registration control unit registers, as the first authentication information, a voice of the first user based on first surrounding information acquired by the first surrounding information acquisition unit about the first user; the registration promotion unit, when it is determined that the first user is present at a predetermined position with respect to the information processing device based on second surrounding information acquired by the second surrounding information acquisition unit for the first user, prompts the first user to register the second authentication information; The information processing device according to claim 1 .

8. the first ambient information acquisition unit acquires ambient sound of the information processing device as the first ambient information; the second surrounding information acquisition unit acquires a surrounding image of the information processing device as the second surrounding information; the registration promotion unit prompts the first user to register the second authentication information when it is determined that the first user is present within a predetermined distance from the information processing device and that a volume of an ambient sound of the information processing device is equal to or less than a predetermined volume based on the first and second ambient information acquired by the first and second ambient information acquisition units; The information processing device according to claim 1 .

9. further comprising an environment analysis unit and an authentication unit; the environment analysis unit analyzes a surrounding environment of the information processing device based on the first and second surrounding information acquired by the first and second surrounding information acquisition units; the authentication unit varies the degree to which the first authentication information and the second authentication information are used when authenticating the first user present around the information processing device, depending on the analysis result of the surrounding environment. The information processing device according to claim 1 .

10. the first ambient information acquisition unit acquires ambient sound of the information processing device as the first ambient information; the second surrounding information acquisition unit acquires a surrounding image of the information processing device as the second surrounding information; When the brightness of the surroundings of the information processing device is equal to or lower than a predetermined brightness as a result of analyzing the surrounding environment, the authentication unit uses the first authentication information more frequently than the second authentication information when authenticating the first user present around the information processing device. The information processing device according to claim 9 .

11. the first ambient information acquisition unit acquires ambient sound of the information processing device as the first ambient information; the second surrounding information acquisition unit acquires a surrounding image of the information processing device as the second surrounding information; when the volume of the ambient sound of the information processing device is equal to or greater than a predetermined volume as a result of analyzing the ambient environment, the authentication unit uses the second authentication information more frequently than the first authentication information when authenticating the first user present around the information processing device. The information processing device according to claim 9 .

12. the first ambient information acquisition unit acquires ambient sound of the information processing device as the first ambient information; the second surrounding information acquisition unit acquires a surrounding image of the information processing device as the second surrounding information; when the volume of the voice of the first user present around the information processing device is equal to or lower than a predetermined volume as a result of analyzing the surrounding environment, the authentication unit increases the degree to which the second authentication information is used compared to the first authentication information when authenticating the first user present around the information processing device; The information processing device according to claim 9 .

13. the registration promoting unit, when authentication of the first user based on both the first authentication information and the second authentication information fails after the second authentication information is registered, prompts the first user to re-register the first and second authentication information for authenticating the first user; The information processing device according to claim 1 .

14. A privacy setting unit is further provided, the privacy setting unit sets a degree of protecting the privacy of the first user in information output from the information processing device regarding the first user to a first degree when authentication of the first user based on one of the first authentication information and the second authentication information is successful after the second authentication information is registered, and thereafter, when authentication of the first user based on the other of the first authentication information and the second authentication information is also successful, sets a degree of protecting the privacy of the first user in information output from the information processing device regarding the first user to a second degree higher than the first degree. The information processing device according to claim 1 .

15. a processor acquires first ambient information relating to a ambient environment of the information processing device; a processor acquires second surrounding information relating to a surrounding environment of the information processing device; a processor registering information based on first surrounding information acquired about a first user as first authentication information for authenticating the first user; When the processor has successfully authenticated the first user based on the acquired first surrounding information and the first authentication information, if information based on the acquired second surrounding information about the first user has not been registered as second authentication information for authenticating the first user, the processor prompts the first user to register the second authentication information. Information processing methods.

16. The processor acquiring first ambient information relating to a ambient environment of the information processing device; acquiring second surrounding information relating to a surrounding environment of the information processing device; registering information based on first surrounding information acquired about a first user as first authentication information for authenticating the first user; When the authentication of the first user is successful based on the acquired first surrounding information and the first authentication information, if information based on the acquired second surrounding information about the first user is not registered as second authentication information for authenticating the first user, the first user is prompted to register the second authentication information. An information processing program that executes processing.

Images