Information processing device, information processing method, and program
Patent Information
- Application Number
- JP2025525492
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Priority Date
- 2023-06-06
- Filing Date
- 2023-06-06
- Publication Date
- 2026-03-05
AI Technical Summary
Existing information processing devices lack confidentiality when users confirm information, as they require unlocking the screen and displaying information on the device, making it visible to others.
An information processing system comprising a mobile terminal connected to an earphone that acquires and processes echo sound signals for biometric authentication, allowing confidential notifications to be transmitted as sound to the user while ensuring the information is not visible to others.
Enables users to confirm information with higher confidentiality by converting sensitive information into sound, which is audible only to the user, preventing others from accessing the information.
Abstract
Description
Information processing device, mobile terminal, information processing method, and storage medium
[0001] The present disclosure relates to an information processing device, a mobile terminal, an information processing method, and a storage medium.
[0002] A user uses an information processing device to send and receive information such as messages to and from other people. In such cases, the user needs to unlock the screen of the information processing device to check the received messages. Related technology is disclosed in Patent Literature 1.
[0003] Patent Document 1 discloses a technology in which an audio playback device has an audio output unit consisting of a speaker or the like, and plays back the audio of spoken text based on supplied audio data (paragraph 0063, etc.).
[0004] International Publication No. 2018 / 034169
[0005] As described above, when a user checks information using an information processing device, there has been a demand for a technology that allows the user to check information with higher confidentiality.
[0006] An object of this disclosure is to provide an information processing device, a mobile terminal, an information processing method, and a storage medium that solve the above-mentioned problems.
[0007] According to a first aspect of this disclosure, an information processing device includes a first terminal having a structure for being worn on a user's ear and acquiring a reflected signal of a signal output inside the ear, and includes a connection means for connecting to the first terminal which communicates information acquired from outside to the user while worn by the user, an authentication result acquisition means for acquiring a result of authentication performed using the reflected signal, a detection means for detecting acquisition of specified first information, and an execution means for outputting information regarding the execution of a specified process performed using the first information to the first terminal when the result of the authentication is successful authentication.
[0008] According to a second aspect of this disclosure, an information processing device includes a connection means for connecting a first terminal having a structure for being worn on a user's ear and for acquiring a reflected signal of a signal output inside the ear, and a second terminal for communicating information acquired from outside to the user while worn on the user, an authentication result acquisition means for acquiring a result of authentication performed using the reflected signal, a detection means for detecting acquisition of specified first information, and an execution means for outputting information regarding the execution of specified processing performed using the first information to the second terminal when the result of the authentication is successful.
[0009] According to a third aspect of this disclosure, a mobile terminal is a first terminal that has a structure for being worn on a user's ear and acquires a reflected signal of a signal output inside the ear, and includes: a connection means for connecting to the first terminal that communicates information acquired from outside to the user while worn by the user; an authentication result acquisition means for acquiring the result of authentication performed using the reflected signal; a detection means for detecting the acquisition of specified first information; and an execution means for outputting information regarding the execution of specified processing performed using the first information to the first terminal when the result of the authentication is successful authentication.
[0010] According to a fourth aspect of this disclosure, a mobile terminal includes a first terminal having a structure for being worn on a user's ear and for acquiring a reflected signal of a signal output inside the ear, and a second terminal that communicates information acquired from outside to the user while worn on the user; connection means for connecting the first terminal to the first terminal; authentication result acquisition means for acquiring a result of authentication performed using the reflected signal; detection means for detecting acquisition of specified first information; and execution means for outputting information regarding the execution of specified processing performed using the first information to the second terminal when the result of the authentication is successful authentication.
[0011] According to a fifth aspect of this disclosure, an information processing method includes a first terminal having a structure for being worn on a user's ear and acquiring a reflected signal of a signal output inside the ear, connecting to the first terminal that transmits information acquired from outside to the user while worn by the user, acquiring a result of authentication performed using the reflected signal, detecting acquisition of specified first information, and, if the result of the authentication is successful, outputting information regarding the execution of a specified process performed using the first information to the first terminal.
[0012] According to a fifth aspect of this disclosure, an information processing method connects a first terminal having a structure for being worn on a user's ear and for acquiring a reflected signal of a signal output inside the ear, and a second terminal that communicates information acquired from outside to the user while worn on the user, acquires the result of authentication performed using the reflected signal, detects acquisition of specified first information, and, if the result of the authentication is successful, outputs information regarding the execution of specified processing performed using the first information to the second terminal.
[0013] According to a fifth aspect of this disclosure, the program causes a computer of an information processing device to function as: a connection means for connecting to a first terminal that has a structure for being worn on a user's ear and acquires a reflected signal of a signal output inside the ear, the first terminal communicating information acquired from outside to the user while worn by the user; an authentication result acquisition means for acquiring the result of authentication performed using the reflected signal; a detection means for detecting the acquisition of specified first information; and an execution means for outputting information regarding the execution of specified processing performed using the first information to the first terminal when the result of the authentication is successful authentication.
[0014] According to a sixth aspect of this disclosure, the program causes a computer of an information processing device to function as a connection means connecting a first terminal having a structure for being worn on a user's ear and for acquiring a reflected signal of a signal output inside the ear, and a second terminal that communicates information acquired from outside to the user while worn on the user, an authentication result acquisition means acquiring the result of authentication performed using the reflected signal, a detection means detecting the acquisition of specified first information, and an execution means that, if the result of the authentication is successful, outputs information regarding the execution of specified processing performed using the first information to the second terminal.
[0015] According to a seventh aspect of this disclosure, an information processing device includes a first terminal that acquires biometric information of a user, a connection means for connecting to the first terminal that communicates information acquired from outside to the user while worn by the user, an authentication result acquisition means for acquiring a result of authentication performed using the biometric information, a detection means for detecting the acquisition of specified first information, and an execution means for outputting information regarding the execution of specified processing performed using the first information to the first terminal when the result of the authentication is successful authentication.
[0016] According to an eighth aspect of this disclosure, an information processing device includes a connection means for connecting a first terminal that acquires biometric information of a user to a second terminal that communicates information acquired from outside to the user while being worn by the user, an authentication result acquisition means for acquiring a result of authentication performed using the biometric information, a detection means for detecting acquisition of specified first information, and an execution means for outputting information regarding the execution of specified processing performed using the first information to the second terminal when the result of the authentication is successful authentication.
[0017] FIG. 1 is a schematic configuration diagram of an information processing system according to an embodiment of the present disclosure. FIG. 2 is a functional block diagram of an information processing system according to an embodiment of the present disclosure. FIG. 3 is a hardware configuration diagram of a mobile terminal according to an embodiment of the present disclosure. FIG. 4 is a functional block diagram of a mobile terminal and earphones according to an embodiment of the present disclosure. FIG. 5 is a first diagram showing a processing flow of a mobile terminal according to an embodiment of the present disclosure. FIG. 6 is a second diagram showing a processing flow of a mobile terminal according to an embodiment of the present disclosure. FIG. 7 is a functional block diagram of an information processing system according to an embodiment of the present disclosure. FIG. 8 is a functional block diagram of an information processing system according to an embodiment of the present disclosure. FIG. 9 is a third diagram showing a processing flow of a mobile terminal according to an embodiment of the present disclosure. FIG. 10 is a fourth diagram showing a processing flow of a mobile terminal according to an embodiment of the present disclosure. FIG. 11 is a functional block diagram of an information processing system according to an embodiment of the present disclosure. FIG. 12 is a fifth diagram showing a processing flow of a mobile terminal according to an embodiment of the present disclosure. FIG. 13 is a functional block diagram showing a minimum configuration of an information processing device according to an embodiment of the present disclosure. FIG. 14 is a diagram showing a processing flow by an information processing device with a minimum configuration according to an embodiment of the present disclosure.
[0018] FIG. 1 is a schematic diagram of an information processing system according to an embodiment of the present disclosure. The information processing system 100 is configured by at least a mobile terminal 1, which is an aspect of an information processing device, wirelessly connecting to an earphone 2, which is an aspect of a first terminal. The mobile terminal 1 may be a smartphone. The earphone 2 has a structure that can be worn in a user's ear. The earphone 2 also has a function of acquiring a reflected signal of a signal output into the user's ear and outputting the reflected signal to the mobile terminal 1. More specifically, the earphone 2 has a function of sending sound waves into the user's ear, acquiring an echo signal of the sound waves from the inner wall of the ear, etc., and outputting the echo signal to the mobile terminal 1. The earphone 2 also has a function of converting information acquired from outside into sound and transmitting it to the user. The mobile terminal 1 uses the echo signal as the user's biometric information to perform biometric authentication.
[0019] 2 is a functional block diagram of an information processing system according to an embodiment of the present disclosure. As shown in FIG. 2, the information processing system 100 may include a server 3. The server 3 outputs first information to the mobile terminal 1. The mobile terminal 1 outputs the first information acquired from the server 3 or second information generated by processing the first information to the earphones 2. The earphones 2 convert the first information or the second information into sound and transmit it to the user.
[0020] 3 is a hardware configuration diagram of a mobile terminal according to an embodiment of the present disclosure. As shown in FIG. 3, the mobile terminal 1 is a computer equipped with various hardware components, such as a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, a HDD (Hard Disk Drive) 104, a communication module 105, and a battery 106. The server 3 may also have similar functions. The earphones 2 are also small information processing devices that include some or all of the hardware components of the mobile terminal 1, and realize the functions of the earphones 2 using this hardware configuration.
[0021] 4 is a functional block diagram of a mobile terminal and earphones according to an embodiment of the present disclosure. The mobile terminal 1 performs the functions of a control unit 11, a communication connection unit 12, an authentication unit 13, an authentication result acquisition unit 14, a detection unit 15, an execution unit 16, and a storage unit 17 through the execution of a pre-stored program by a CPU 101, circuit operations, etc.
[0022] The control unit 11 controls each functional unit of the portable terminal 1. The communication connection unit 12 establishes a communication connection with the earphones 2 and transmits information to the earphones 2. The authentication unit 13 performs user authentication based on a signal containing biometric information acquired from the earphones 2. The detection unit 15 detects predetermined first information. The first information is, for example, information received from the server 3. If the result of authentication of the user wearing the earphones 2 is successful, the execution unit 16 transmits information regarding the execution of a predetermined process performed using the first information to the earphones 2. The storage unit 17 stores various information used by the portable terminal 1 for processing.
[0023] The earphone 2 performs the functions of a control unit 21, a communication unit 22, a sound output unit 23, and an authentication processing unit 24 by executing a program stored in advance, operating circuits, and the like.
[0024] The control unit 21 controls each function of the earphone 2. The communication unit 22 connects to and communicates with the mobile terminal 1. The sound output unit 23 outputs sound from the speaker based on a sound signal received from the outside. The authentication processing unit 24 sends sound waves into the ear, acquires echo signals of the sound waves reflected from the inner wall of the ear, and outputs the echo signals to the mobile terminal 1.
[0025] In the information processing system 100 described above, the mobile device 1 communicates with the earphones 2 and acquires the results of authentication performed using echo signals from within the ear. The mobile device 1 also detects the acquisition of predetermined first information, and if the authentication result is successful, outputs information regarding the execution of a predetermined process performed using the first information to the earphones 2. The earphones 2 are a device that conveys information acquired from an external source to a user while worn by the user. Therefore, by using this information processing system 100, the user can view information transmitted to them on the mobile device 1 with greater confidentiality. Below, details of the processes of the mobile device 1, the earphones 2, and the server 3 that constitute the information processing system 100 are described.
[0026] First Embodiment FIG. 5 is a first diagram showing the processing flow of a mobile device according to an embodiment of the present disclosure. First, the communication connection unit 12 of the mobile device 1 receives a connection signal output by the communication unit 22 of the earphone 2. Then, the communication connection unit 12 of the mobile device 1 establishes a communication connection with the communication unit 22 of the earphone 2 (step S101). This communication connection may use a known communication connection technology such as Bluetooth (registered trademark). When detecting a communication connection with the mobile device 1, the control unit 21 of the earphone 2 determines whether the earphone 2 is worn in the user's ear. For example, the earphone 2 may be provided with an infrared sensor, and the earphone 2 may be determined to be worn when the infrared sensor detects that the earphone 2 is in close proximity to the ear. Any technology may be used to determine whether the earphone 2 is worn in the user's ear.
[0027] When the control unit 21 of the earphone 2 determines that the earphone 2 is being worn in the user's ear, it instructs the authentication processing unit 24 to perform processing. The authentication processing unit 24 sends out sound waves from the speaker of the earphone 2. The authentication processing unit 24 acquires an echo sound signal and outputs it to the communication unit 22. The communication unit 22 transmits the echo sound signal to the mobile terminal 1.
[0028] The authentication unit 13 of the portable terminal 1 acquires the echo signal received by the communication connection unit 12 (step S102). The authentication unit 13 generates user biometric information based on the echo signal (step S103). The echo signal is a user-specific sound signal corresponding to the shape of the user's ear wall, etc., and the biometric information generated based on this signal is pre-recorded in the storage unit 17 of the portable terminal 1. The portable terminal 1 compares the biometric information generated based on the received acoustic signal with the biometric information pre-recorded in the storage unit 17 to calculate the degree of match (step S104). The authentication unit 13 determines whether the degree of match is equal to or greater than a predetermined threshold (step S105). If the degree of match is equal to or greater than the predetermined threshold, the authentication unit 13 determines that the authentication is successful. The authentication unit 13 outputs information indicating successful authentication, which is the authentication result, to the authentication result acquisition unit 14. If the authentication result is not successful, the authentication unit 13 does not need to output the authentication result information to the authentication result acquisition unit 14.
[0029] In the above-described processing, the authentication process is performed by the authentication unit 13 of the mobile device 1. However, the authentication processing unit 24 of the earphones 2 may also compare the biometric information generated based on the echo sound signal with biometric information previously stored inside the earphones 2 to calculate the degree of match, and determine that authentication is successful if the degree of match is equal to or greater than a predetermined threshold. In this case, the authentication processing unit 24 of the earphones 2 may output the authentication result to the communication unit 22, and the communication unit 22 may output the authentication result to the mobile device 1. In this case, the authentication unit 13 does not need to be provided in the mobile device 1, and the authentication result is acquired by the authentication result acquisition unit 14.
[0030] When the authentication result acquisition unit 14 acquires an authentication result indicating successful authentication, it reads setting information from the storage unit 17. The setting information stores information indicating whether or not to perform a confidentiality notification. The authentication result acquisition unit 14 determines whether the setting information stores information indicating whether or not to perform a confidentiality notification (step S106). If the setting information stores information indicating that a confidentiality notification is to be performed, the authentication result acquisition unit 14 instructs the detection unit 15 to start a confidentiality notification process. The confidentiality notification process is a process of transmitting predetermined information to a user via a device worn by the user, such as the earphones 2, so that the information cannot be seen by other users. Typically, a user unlocks the screen of the mobile terminal 1 and displays information stored in the mobile terminal 1 on the screen to confirm the information. However, there may be situations where the user does not want others to see the information. In such cases, the user inputs information indicating that a confidentiality notification is to be performed into the mobile terminal 1. In this case, the control unit 11 writes information indicating that a confidentiality notification is to be performed into the setting information. If the setting information stores information indicating that a confidentiality notification is not to be performed, the authentication result acquisition unit 14 does not need to instruct the detection unit 15 to start a confidentiality notification process. In this case, the user can unlock the screen and check the specified information displayed on the screen.
[0031] An example of information for which the mobile terminal 1 sends a confidential notification is message information sent from the server 3 to the mobile terminal 1. The message information may be email information. The message information may also be message information received from the server 3 by a predetermined message application program.
[0032] The detection unit 15 determines whether message information has been received from the server 3 (step S107). The detection unit 15 acquires information indicating whether message information has been received or the message information itself from a message application program in the mobile terminal 1 that handles message information. When the detection unit 15 acquires information indicating that message information has been received or the message information itself, the detection unit 15 determines to start processing of confidentiality notification. The detection unit 15 outputs the message information to the execution unit 16.
[0033] When the execution unit 16 acquires the message information, it reads the setting information from the storage unit 17. The setting information may include information regarding which of the information included in the message information to send to the earphones 2. The information regarding which of the information included in the message information to send to the earphones 2 may be information input and set by the user using the mobile terminal 1. The execution unit 16 generates processed information including one or more pieces of information included in the message information based on the setting information (step S108). For example, the execution unit 16 generates processed information including only the sender user name, or information about the sender user and the message body, included in the message information, based on the setting information. The execution unit 16 outputs the processed information to the communication connection unit 12. The communication connection unit 12 transmits the processed information to the earphones 2 (step S109).
[0034] The execution unit 16 may process the copied predetermined information included in the message information received from the server 3 into information that can be recognized by the earphones 2, and the processed information may include any information included in the message information. The execution unit 16 may instruct the communication connection unit 12 to send the processed information to the earphones 2. This processed information is second information generated based on the first information received from the server 3.
[0035] The communication unit 22 of the earphones 2 outputs the processed information received from the mobile terminal 1 to the sound output unit 23. The sound output unit 23 converts the text information included in the processed information into sound and outputs it from the speaker. If the processed information includes a sender user and a message body, the earphones 2 read out the sender user name and the message body. In other words, the above-described processing of the mobile terminal 1 is an example of an aspect in which the execution unit 16 identifies the read-out content of the message information based on the setting information stored in advance, and outputs processed information (second information) including the read-out content to the earphones 2 (first terminal).
[0036] After receiving the processed information, the earphone 2 may again determine whether the earphone 2 is worn in the user's ear, and if not, may stop outputting the audio based on the processed information from the speaker. The earphone 2 may also continuously determine whether the earphone 2 is worn in the user's ear at predetermined intervals, and if it determines that the earphone 2 is not worn in the user's ear, may notify the mobile terminal 1 to stop processing the confidential notification. In this case, the mobile terminal 1 does not need to transmit the second information (processed information) generated based on the first information to the speaker 2.
[0037] According to the above process, the mobile device 1 is connected to the earphone 2 (first terminal), which is configured to be worn on the user's ear and receives a reflected signal (echo signal) of a signal output to the user's ear. The earphone 2 transmits information acquired from an external source to the user while worn by the user, and obtains the result of authentication performed using the reflected signal. The mobile device 1 then detects the acquisition of message information (predetermined first information). If the authentication result is successful, the mobile device 1 outputs processed information (information related to the execution of a predetermined process) processed using the message information to the earphone 2. This process allows the user to confirm the sender user name and message text included in the processed information from the output of the speaker of the earphone 2, and can independently confirm the content of the message information received on the mobile device 1 without others being able to see the information. In other words, by using the information processing system 100 including such a mobile device 1, the user can view information sent to them on the mobile device 1 with greater confidentiality.
[0038] The execution unit 16 of the mobile device 1 may output the processed information to the earphones 2, or may instead output the sender user name, subject, or the like included in the processed information on the lock screen of the mobile device. The execution unit 16 of the mobile device 1 may automatically unlock the lock screen of the mobile device based on the acquisition of the first information. The execution unit 16 of the mobile device 1 may also automatically log in to the application screen using a message application program that received the first information.
[0039] In the above process, the execution unit 16 of the mobile device 1 generates processed information based on the setting information, including predetermined information such as the sender user name and the message body that is included in the message information, which is the first information. However, when the setting information includes sender information, the execution unit 16 may determine whether message information has been received from a sender user name that corresponds to the sender information, and generate and transmit processed information to the earphones 2 only when message information has been received from a sender user name that corresponds to the sender information included in the setting information.
[0040] Second Embodiment Fig. 6 is a second diagram showing the processing flow of a mobile terminal according to an embodiment of the present disclosure. Next, the processing flow of the mobile terminal 1 according to the second embodiment will be described. First, the communication connection unit 12 of the mobile terminal 1 receives a connection signal output by the communication unit 22 of the earphone 2, as described above. Then, the communication connection unit 12 of the mobile terminal 1 establishes a communication connection with the communication unit 22 of the earphone 2 (step S201).
[0041] When the control unit 11 detects a communication connection between the mobile terminal 1 and the earphone 2, it reads setting information from the storage unit 17. The setting information records information on whether or not to process a confidential notification. The control unit 11 determines whether the setting information records that a confidential notification is to be performed (step S202). If the setting information records that a confidential notification is to be performed, the control unit 11 instructs the detection unit 15 to start processing the confidential notification.
[0042] An example of information for which the mobile terminal 1 sends a confidential notification is message information sent from the server 3 to the mobile terminal 1. The message information may be email information. The message information may also be message information received from the server 3 by a predetermined message application program.
[0043] The detection unit 15 determines whether or not it has received a notification from the server 3 that message information received from another user is being stored in the server 3 (step S203). When the detection unit 15 has received a notification from the server 3 that message information received from another user is being stored in the server 3, it starts processing of confidentiality notification. The detection unit 15 outputs authentication start information to the communication connection unit 12. The communication connection unit 12 transmits the authentication start information to the earphones 2 (step S204).
[0044] The control unit 21 of the earphone 2 acquires authentication start information via the communication unit 22. The control unit 21 instructs the authentication processing unit 24 to perform processing. The authentication processing unit 24 emits sound waves from the speaker of the earphone 2. The authentication processing unit 24 acquires an echo sound signal and outputs it to the communication unit 22. The communication unit 22 transmits the echo sound signal to the mobile terminal 1.
[0045] The authentication unit 13 of the portable terminal 1 acquires the echo signal received by the communication connection unit 12 (step S205). The authentication unit 13 generates biometric information of the user based on the echo signal (step S206). The portable terminal 1 compares the biometric information generated based on the received acoustic signal with biometric information previously recorded in the storage unit 17 to calculate the degree of match (step S207). The authentication unit 13 determines whether the degree of match is equal to or greater than a predetermined threshold (step S208). If the degree of match is equal to or greater than the predetermined threshold, the authentication unit 13 determines that authentication is successful. The authentication unit 13 outputs information indicating successful authentication, which is the authentication result, to the authentication result acquisition unit 14. If the authentication result is not successful, the authentication unit 13 does not need to output information about the authentication result to the authentication result acquisition unit 14.
[0046] When the authentication result acquisition unit 14 acquires the information indicating successful authentication, it instructs a message application program in the mobile terminal 1 that handles message information to acquire message information from the server 3. The message application program transmits a transmission permission for the message information stored in the server 3 to the server 3 (step S209). In this case, the authentication result acquisition unit 14 is one aspect of a permission means that outputs a transmission permission to the sender of the message information (first information) based on the authentication result. When the server 3 receives the transmission permission from the mobile terminal 1, it transmits the message information stored for the mobile terminal 1 to the mobile terminal 1. The message application program receives the message information (step S210).
[0047] The detection unit 15 acquires information indicating whether message information has been received or the message information itself from a message application program in the mobile terminal 1 that handles message information. When the detection unit 15 acquires information indicating that message information has been received or the message information itself, the detection unit 15 determines to start processing of confidentiality notification. The detection unit 15 outputs the message information to the execution unit 16.
[0048] When the execution unit 16 acquires the message information, it reads the setting information from the storage unit 17. The setting information may include information regarding which of the information included in the message information to send to the earphones 2. The information regarding which of the information included in the message information to send to the earphones 2 may be information input and set by the user using the mobile terminal 1. The execution unit 16 generates processed information including one or more pieces of information included in the message information based on the setting information (step S211). For example, the execution unit 16 generates processed information including only the sender user name, or information about the sender user and the message body, included in the message information, based on the setting information. The execution unit 16 outputs the processed information to the communication connection unit 12. The communication connection unit 12 transmits the processed information to the earphones 2 (step S212).
[0049] The execution unit 16 may process the copied predetermined information included in the message information received from the server 3 into information that can be recognized by the earphones 2, and the processed information may include any information included in the message information. The execution unit 16 may instruct the communication connection unit 12 to send the processed information to the earphones 2. This processed information is second information generated based on the first information received from the server 3.
[0050] The communication unit 22 of the earphones 2 outputs the processed information received from the mobile terminal 1 to the sound output unit 23. The sound output unit 23 converts the text information included in the processed information into sound and outputs it from the speaker. If the processed information includes a sender user and a message body, the earphones 2 read out the sender user name and the message body. In other words, the above-described processing of the mobile terminal 1 is an example of an aspect in which the execution unit 16 identifies the read-out content of the message information based on the setting information stored in advance, and outputs processed information (second information) including the read-out content to the earphones 2 (first terminal).
[0051] According to the above process, the mobile device 1 is connected to the earphone 2 (first terminal), which is configured to be worn on the user's ear and receives a reflected signal (echo signal) of a signal output to the user's ear. The earphone 2 transmits information acquired from an external source to the user while worn by the user, and obtains the result of authentication performed using the reflected signal. The mobile device 1 then detects the acquisition of message information (predetermined first information). If the authentication result is successful, the mobile device 1 outputs processed information (information related to the execution of a predetermined process) processed using the message information to the earphone 2. This process allows the user to confirm the sender user name and message text included in the processed information from the output of the speaker of the earphone 2, and can independently confirm the content of the message information received on the mobile device 1 without others being able to see the information. In other words, by using the information processing system 100 including such a mobile device 1, the user can view information sent to them on the mobile device 1 with greater confidentiality.
[0052] Third Embodiment Figure 7 is a functional block diagram of an information processing system according to an embodiment of the present disclosure. In the first and second embodiments described above, the earphones 2 acquire a reflected signal (echo signal) of a signal output into the ear, and perform user authentication based on the reflected signal (echo signal). However, the earphones 2 may also include, for example, a fingerprint sensor or a voiceprint sensor, and authentication processing may be performed by the mobile terminal 1 or the earphones 2 using biometric information such as a fingerprint or voiceprint acquired by the earphones 2 based on the sensors.
[0053] In this case, the mobile terminal 1 connects to earphones 2 (first terminals) that acquire biometric information of the user and transmit information acquired from an external source to the user while the earphones 2 are worn by the user, and acquires the results of authentication performed using the biometric information. The mobile terminal 1 then detects the acquisition of predetermined first information (e.g., message information), and if the result of the authentication is successful, outputs information (processing information) related to the execution of a predetermined process performed using the first information to the earphones 2 (first terminal).
[0054] In this case, too, the user can check the sender user name and message text included in the processed information from the output of the speaker of the earphone 2, and can check the content of the message information received on the mobile terminal 1 by himself / herself, without the information being seen by others. In other words, by using the information processing system 100 having such a mobile terminal 1, the user can check the information sent to him / her on the mobile terminal 1 with a higher degree of confidentiality.
[0055] In the third embodiment, since there is no need to acquire reverberation signals from inside the ear, a head-mounted terminal 4 or headphones 5 may be communicatively connected to the mobile terminal 1 instead of the earphones 2 to form the information processing system 100. The headphones 5 have the same functions as the earphones described above. The head-mounted terminal 4 has a display 25 in addition to the functions of the earphones 2 described above.
[0056] When the mobile terminal 1 is connected to and communicates with the head-mounted terminal 4 instead of the earphones 2, the mobile terminal 1 transmits processing information to the head-mounted terminal 4. The control unit 21 of the head-mounted terminal 4 may display the sender user name and message body included in the processing information on a display 25 provided on the inner surface of the goggle part of the head-mounted terminal 4 (the inner surface of the goggle glasses that the user directly views with their eyes).
[0057] (Fourth Embodiment) FIG. 8 is a functional block diagram of an information processing system according to an embodiment of the present disclosure. In the above-described embodiments, examples of a terminal that acquires a user's biometric information and transmits the acquired information to the user while worn by the user have been described, including earphones 2, a head-mounted terminal 4, and headphones 5. However, the terminal may be another type of wearable device 5 that can be worn on a part of the body, such as an arm, waist, or leg. In this case, the wearable device 5 includes a vibration unit 26. When the portable terminal 1 is connected to and communicates with the wearable device 5, when the portable terminal 1 transmits processed information to the wearable device 5, the vibration unit 26 of the wearable device 5 may vibrate with a vibration pattern corresponding to the sender user name included in the processed information. The authentication processing unit 24 of the wearable device 5 may include a fingerprint sensor that acquires the user's fingerprint as biometric information for authentication processing and transmits it to the portable terminal 1.
[0058] Fifth Embodiment The execution unit 16 of the mobile terminal 1 may output an information request as second information to the first terminal (such as the earphones 2) based on the received first information, and may output response information transmitted by the first terminal based on the information request to another device. Below, an example will be described in which the earphones 2 pre-store card information, transmit the card information as response information to the mobile terminal 1, and the mobile terminal 1 transmits the response information to a specific device.
[0059] FIG. 9 is a functional block diagram of an information processing system according to an embodiment of the present disclosure. As shown in FIG. 9 , the information processing system 100 may be configured by connecting a mobile terminal 1 to an in-car device 6 and earphones 2. The in-car device 6 outputs first information to the mobile terminal 1. The mobile terminal 1 processes the first information acquired from the in-car device 6 to generate second information and outputs it to the earphone 2. The earphone 2 converts the second information into sound and conveys it to the user. The earphone 2 also transmits response information corresponding to the second information to the mobile terminal 1. The mobile terminal 1 transmits the response information to the in-car device 6. The first information is, for example, an inquiry signal based on the reception of an ETC signal. The second information is a request to send credit card information generated based on the inquiry signal. The earphone 2 stores a card number as credit card information in advance. The earphone 2 transmits the card number 2 to the mobile terminal 1 as response information. In response to the inquiry signal, the mobile terminal 1 transmits the card number acquired from the earphone 2 to the in-car device 6. The in-car device 6 communicates with the ETC system using the card number to perform payment processing for tolls on expressways, etc.
[0060] In the fifth embodiment, the hardware configuration of the mobile terminal 1, the in-car device 6, etc. is the same as the configuration shown in Fig. 3. In addition, in the sixth embodiment, the functional block diagram of the mobile terminal 1 and the earphone 2 is the same.
[0061] FIG. 10 is a third diagram showing the processing flow of a mobile terminal according to an embodiment of the present disclosure. First, the communication connection unit 12 of the mobile terminal 1 receives a connection signal output by the communication unit 22 of the earphone 2. Then, the communication connection unit 12 of the mobile terminal 1 establishes a communication connection with the communication unit 22 of the earphone 2 (step S301). As with the above, this communication connection may use a known communication connection technology such as Bluetooth (registered trademark). When detecting a communication connection with the mobile terminal 1, the control unit 21 of the earphone 2 determines whether the earphone 2 is worn in the user's ear. For example, the earphone 2 may be provided with an infrared sensor, and the earphone 2 may be determined to be worn when the infrared sensor detects proximity to the ear. Any technology may be used to determine whether the earphone 2 is worn in the user's ear.
[0062] When the control unit 21 of the earphone 2 determines that the earphone 2 is being worn in the user's ear, it instructs the authentication processing unit 24 to perform processing. The authentication processing unit 24 sends out sound waves from the speaker of the earphone 2. The authentication processing unit 24 acquires an echo sound signal and outputs it to the communication unit 22. The communication unit 22 transmits the echo sound signal to the mobile terminal 1.
[0063] The authentication unit 13 of the portable terminal 1 acquires the echo signal received by the communication connection unit 12 (step S302). The authentication unit 13 generates user biometric information based on the echo signal (step S303). The echo signal is a user-specific sound signal corresponding to the shape of the user's ear wall, etc., and the biometric information generated based on this signal is pre-recorded in the storage unit 17 of the portable terminal 1. The portable terminal 1 compares the biometric information generated based on the received acoustic signal with the biometric information pre-recorded in the storage unit 17 to calculate the degree of match (step S304). The authentication unit 13 determines whether the degree of match is equal to or greater than a predetermined threshold (step S305). If the degree of match is equal to or greater than the predetermined threshold, the authentication unit 13 determines that the authentication is successful. The authentication unit 13 outputs information indicating successful authentication, which is the authentication result, to the authentication result acquisition unit 14. If the authentication result is not successful, the authentication unit 13 does not need to output the authentication result information to the authentication result acquisition unit 14.
[0064] In the above-described processing, the authentication process is performed by the authentication unit 13 of the mobile device 1. However, the authentication processing unit 24 of the earphones 2 may also compare the biometric information generated based on the echo sound signal with biometric information previously stored inside the earphones 2 to calculate the degree of match, and determine that authentication is successful if the degree of match is equal to or greater than a predetermined threshold. In this case, the authentication processing unit 24 of the earphones 2 may output the authentication result to the communication unit 22, and the communication unit 22 may output the authentication result to the mobile device 1. In this case, the authentication unit 13 does not need to be provided in the mobile device 1, and the authentication result is acquired by the authentication result acquisition unit 14.
[0065] When the authentication result acquisition unit 14 acquires an authentication result indicating successful authentication, it reads setting information from the storage unit 17. The setting information records information on whether or not to issue a confidentiality notification. The authentication result acquisition unit 14 determines whether or not the setting information records that a confidentiality notification is to be issued (step S306). When the setting information records that a confidentiality notification is to be issued, the authentication result acquisition unit 14 instructs the detection unit 15 to start processing a confidentiality notification. When the setting information records information on not issuing a confidentiality notification, the authentication result acquisition unit 14 does not need to instruct the detection unit 15 to start processing a confidentiality notification.
[0066] When the in-vehicle device 6 communicates with the ETC system at a highway entrance or the like, it acquires the card number from the credit card inserted in the in-vehicle device 6 and transmits it to the ETC system. However, if a credit card is not inserted in the in-vehicle device 6, the in-vehicle device 6 cannot transmit the card number to the ETC system. The in-vehicle device 6 determines whether a credit card is inserted in the in-vehicle device 6. If a credit card is not inserted in the in-vehicle device 6, the in-vehicle device 6 transmits an inquiry signal to the mobile terminal 1. Note that the in-vehicle device 6 and the mobile terminal 1 may be connected for communication beforehand.
[0067] The detection unit 15 of the mobile terminal 1 determines whether an inquiry signal has been received (step S307). When the detection unit 15 acquires the inquiry signal, it determines to start processing of confidentiality notification. The detection unit 15 outputs the inquiry signal to the execution unit 16. When the execution unit 16 acquires the inquiry signal, it generates a transmission request for the credit card number (step S308). The execution unit 16 outputs the transmission request for the credit card number to the communication connection unit 12. The communication connection unit 12 transmits the transmission request to the earphones 2 (step S309). The transmission request is one aspect of second information (processed information) generated based on the reception of the inquiry signal, which is the first information.
[0068] The control unit 21 of the earphone 2 outputs the transmission request received by the communication unit 22 from the mobile terminal 1 to the sound output unit 23. The sound output unit 23 outputs a sound corresponding to the transmission request from the speaker. The sound corresponding to the transmission request may be, for example, "Your credit card number will be sent to the in-vehicle device." This allows the user to privately understand that the in-vehicle device 6 is obtaining credit card number information from the earphone 2.
[0069] The control unit 21 of the earphone 2 also reads the credit card number stored in the memory unit of the earphone. The control unit 21 outputs response information including the credit card number to the communication unit 22. The communication unit 22 transmits the response information to the mobile terminal 1. The execution unit 16 of the mobile terminal 1 receives the response information (step S310). The execution unit 16 of the mobile terminal 1 transmits the received response information to the in-vehicle device 6 (step S311).
[0070] The in-vehicle device 6 receives the response information. The in-vehicle device 6 transmits the credit card number included in the response information to the ETC system. As a result, even if a credit card is not inserted in the in-vehicle device 6, the credit card number recorded in the earphones 2 can be used to make payments for toll road passage using the ETC system instead of a credit card.
[0071] Sixth Embodiment When the execution unit 16 of the mobile terminal 1 detects sound as first information, the execution unit 16 may output second information (processed information) generated based on the sound to an output destination such as the earphones 2. For example, suppose that a sound is periodically emitted from a ticket gate installed at a station ticket gate. When the mobile terminal 1 detects the sound, the execution unit 16 reads the balance information stored in a cashless payment application program installed in the mobile terminal 1 and generates notification information including the balance information as processed information. The execution unit 16 transmits the notification information to the earphones 2. The earphones 2 read out the balance information included in the notification information and output it as audio from the speaker. Details of the processing of the sixth embodiment are described below.
[0072] Fig. 11 is a functional block diagram of an information processing system according to an embodiment of the present disclosure. As shown in Fig. 11, the information processing system 100 is configured by connecting a mobile terminal 1 to a ticket gate 7 and earphones 2. In the sixth embodiment, the hardware configuration of the mobile terminal 1 may be the same as the configuration shown in Fig. 3. Furthermore, the functional block diagrams of the mobile terminal 1 and the earphones 2 in the sixth embodiment are the same.
[0073] FIG. 12 is a fourth diagram showing the processing flow of a mobile terminal according to an embodiment of the present disclosure. First, the communication connection unit 12 of the mobile terminal 1 receives a connection signal output by the communication unit 22 of the earphone 2. Then, the communication connection unit 12 of the mobile terminal 1 establishes a communication connection with the communication unit 22 of the earphone 2 (step S401). As with the above, this communication connection may use a known communication connection technology such as Bluetooth (registered trademark). When detecting a communication connection with the mobile terminal 1, the control unit 21 of the earphone 2 determines whether the earphone 2 is worn in the user's ear. For example, the earphone 2 may be provided with an infrared sensor, and the earphone 2 may be determined to be worn when the infrared sensor detects proximity to the ear. Any technology may be used to determine whether the earphone 2 is worn in the user's ear.
[0074] When the control unit 21 of the earphone 2 determines that the earphone 2 is being worn in the user's ear, it instructs the authentication processing unit 24 to perform processing. The authentication processing unit 24 sends out sound waves from the speaker of the earphone 2. The authentication processing unit 24 acquires an echo sound signal and outputs it to the communication unit 22. The communication unit 22 transmits the echo sound signal to the mobile terminal 1.
[0075] The authentication unit 13 of the portable terminal 1 acquires the echo signal received by the communication connection unit 12 (step S402). The authentication unit 13 generates user biometric information based on the echo signal (step S403). The echo signal is a user-specific sound signal corresponding to the shape of the user's ear wall, etc., and the biometric information generated based on this signal is pre-recorded in the storage unit 17 of the portable terminal 1. The portable terminal 1 compares the biometric information generated based on the received acoustic signal with the biometric information pre-recorded in the storage unit 17 to calculate a degree of match (step S404). The authentication unit 13 determines whether the degree of match is equal to or greater than a predetermined threshold (step S405). If the degree of match is equal to or greater than the predetermined threshold, the authentication unit 13 determines that authentication is successful. The authentication unit 13 outputs information indicating successful authentication, which is the authentication result, to the authentication result acquisition unit 14. If the authentication result is not successful, the authentication unit 13 does not need to output the authentication result information to the authentication result acquisition unit 14.
[0076] In the above-described processing, the authentication process is performed by the authentication unit 13 of the mobile device 1. However, the authentication processing unit 24 of the earphones 2 may also compare the biometric information generated based on the echo sound signal with biometric information previously stored inside the earphones 2 to calculate the degree of match, and determine that authentication is successful if the degree of match is equal to or greater than a predetermined threshold. In this case, the authentication processing unit 24 of the earphones 2 may output the authentication result to the communication unit 22, and the communication unit 22 may output the authentication result to the mobile device 1. In this case, the authentication unit 13 does not need to be provided in the mobile device 1, and the authentication result is acquired by the authentication result acquisition unit 14.
[0077] When the authentication result acquisition unit 14 acquires an authentication result indicating successful authentication, it reads setting information from the storage unit 17. The setting information records information on whether or not to issue a confidentiality notification. The authentication result acquisition unit 14 determines whether or not to issue a confidentiality notification is recorded in the setting information (step S406). When the setting information records information on whether to issue a confidentiality notification, the authentication result acquisition unit 14 instructs the detection unit 15 to start processing a confidentiality notification. When the setting information records information on not issuing a confidentiality notification, the authentication result acquisition unit 14 does not need to instruct the detection unit 15 to start processing a confidentiality notification.
[0078] As described above, the ticket gate 7 periodically emits a sound. The detection unit 15 of the portable terminal 1 determines whether or not the sound emitted by the ticket gate 7 has been detected (step S407). When the detection unit 15 detects the sound, it determines to start processing the confidential notification. The detection unit 15 outputs the detected sound to the execution unit 16. When the execution unit 16 acquires the sound detection information, it requests the cashless payment application program to notify it of the remaining balance information. The cashless payment application program outputs the remaining balance information stored in a memory or the like to the execution unit 16. The execution unit 16 generates notification information including the remaining balance information as processed information (step S408). The execution unit 16 outputs the notification information to the communication connection unit 12. The communication connection unit 12 transmits the notification information to the earphones 2 (step S409). The notification information is one form of second information (processed information) generated based on the detection of the sound, which is the first information.
[0079] The control unit 21 of the earphone 2 outputs notification information received by the communication unit 22 from the mobile device 1 to the sound output unit 23. The sound output unit 23 outputs a corresponding sound from the speaker based on the balance information included in the notification information. The sound corresponding to the balance information may be, for example, "Your balance is 5,000 yen." This allows the user to confidentially know the balance information of the cashless payment application program on the mobile device 1.
[0080] Seventh Embodiment When the execution unit 16 of the portable terminal 1 detects first information indicating the launch of a predetermined application program, the execution unit 16 may output the results of the execution of the predetermined application program based on the detection of the first information to an output destination such as the earphones 2. For example, assume that the portable terminal 1 has a function of a text-to-speech application that reads aloud text from a book. When the portable terminal 1 detects the launch of the text-to-speech application program, the execution unit 16 automatically transmits audio information of the text being read aloud to the earphones 2 when the text-to-speech application starts reading the text from the point where playback was previously stopped. The earphones 2 output the audio information through the speaker. This process is also one aspect of a process in which the portable terminal 1 outputs information related to the execution of a predetermined process performed by the portable terminal 1 using the first information to the earphones 2. In other words, the first information corresponds to information indicating the launch of the text-to-speech application, and the execution of the predetermined process corresponds to transmitting audio information indicating that the text-to-speech application has started reading the text from the point where playback was previously stopped to the earphones 2. The process of the seventh embodiment will be described in detail below.
[0081] Fig. 13 is a functional block diagram of an information processing system according to an embodiment of the present disclosure. As shown in Fig. 13, the information processing system 100 is configured by connecting a mobile terminal 1 to earphones 2. In the seventh embodiment, the hardware configuration of the mobile terminal 1 may be the same as the configuration shown in Fig. 3. The functional block diagrams of the mobile terminal 1 and earphones 2 are also the same as in the sixth embodiment.
[0082] FIG. 14 is a fifth diagram showing the processing flow of a mobile terminal according to an embodiment of the present disclosure. First, the communication connection unit 12 of the mobile terminal 1 receives a connection signal output by the communication unit 22 of the earphone 2. Then, the communication connection unit 12 of the mobile terminal 1 establishes a communication connection with the communication unit 22 of the earphone 2 (step S501). As with the above, this communication connection may use a known communication connection technology such as Bluetooth (registered trademark). When detecting a communication connection with the mobile terminal 1, the control unit 21 of the earphone 2 determines whether the earphone 2 is worn in the user's ear. For example, the earphone 2 may be provided with an infrared sensor, and the earphone 2 may be determined to be worn when the infrared sensor detects proximity to the ear. Any technology may be used to determine whether the earphone 2 is worn in the user's ear.
[0083] When the control unit 21 of the earphone 2 determines that the earphone 2 is being worn in the user's ear, it instructs the authentication processing unit 24 to perform processing. The authentication processing unit 24 sends out sound waves from the speaker of the earphone 2. The authentication processing unit 24 acquires an echo sound signal and outputs it to the communication unit 22. The communication unit 22 transmits the echo sound signal to the mobile terminal 1.
[0084] The authentication unit 13 of the portable terminal 1 acquires the echo signal received by the communication connection unit 12 (step S502). The authentication unit 13 generates user biometric information based on the echo signal (step S503). The echo signal is a user-specific sound signal corresponding to the shape of the user's ear wall, etc., and the biometric information generated based on this signal is pre-recorded in the storage unit 17 of the portable terminal 1. The portable terminal 1 compares the biometric information generated based on the received acoustic signal with the biometric information pre-recorded in the storage unit 17 to calculate the degree of match (step S504). The authentication unit 13 determines whether the degree of match is equal to or greater than a predetermined threshold (step S505). If the degree of match is equal to or greater than the predetermined threshold, the authentication unit 13 determines that authentication is successful. The authentication unit 13 outputs information indicating authentication success, which is the authentication result, to the authentication result acquisition unit 14. If the authentication result is not successful, the authentication unit 13 does not need to output the authentication result information to the authentication result acquisition unit 14.
[0085] In the above-described processing, the authentication process is performed by the authentication unit 13 of the mobile device 1. However, the authentication processing unit 24 of the earphones 2 may also compare the biometric information generated based on the echo sound signal with biometric information previously stored inside the earphones 2 to calculate the degree of match, and determine that authentication is successful if the degree of match is equal to or greater than a predetermined threshold. In this case, the authentication processing unit 24 of the earphones 2 may output the authentication result to the communication unit 22, and the communication unit 22 may output the authentication result to the mobile device 1. In this case, the authentication unit 13 does not need to be provided in the mobile device 1, and the authentication result is acquired by the authentication result acquisition unit 14.
[0086] When the authentication result acquisition unit 14 acquires an authentication result indicating successful authentication, it reads setting information from the storage unit 17. The setting information records information on whether or not to issue a confidentiality notification. The authentication result acquisition unit 14 determines whether or not the setting information records that a confidentiality notification is to be issued (step S506). When the setting information records that a confidentiality notification is to be issued, the authentication result acquisition unit 14 instructs the detection unit 15 to start processing a confidentiality notification. When the setting information records information on not issuing a confidentiality notification, the authentication result acquisition unit 14 does not need to instruct the detection unit 15 to start processing a confidentiality notification.
[0087] The detection unit 15 of the mobile terminal 1 determines whether the mobile terminal 1 has detected the launch of a text-to-speech application program (step S507). The detection of the launch is an example of the detection of the acquisition of predetermined first information. When the detection unit 15 detects the launch of the text-to-speech application program, it determines to start processing of confidentiality notification. The detection unit 15 outputs the detection of the launch of the text-to-speech application program to the execution unit 16. When the execution unit 16 acquires information that the launch of the text-to-speech application program has been detected, it instructs the text-to-speech application to resume reading the text from the point where playback was previously stopped (step S508). The text-to-speech application program reads the point where playback was previously stopped from memory or the like, and begins reading from the text corresponding to that point. The execution unit 16 outputs audio information resulting from the reading to the communication connection unit 12. The communication connection unit 12 transmits the audio information to the earphones 2 (step S509).
[0088] The control unit 21 of the earphone 2 outputs the audio information received by the communication unit 22 from the mobile terminal 1 to the sound output unit 23. The sound output unit 23 outputs the audio information from the speaker. This allows the user to secretly listen to the reading of a text from the point where playback was previously stopped, simply by starting the text reading application on the mobile terminal 1.
[0089] Eighth Embodiment Fig. 15 is a functional block diagram showing the minimum configuration of an information processing device according to an embodiment of the present disclosure. Fig. 16 is a diagram showing a processing flow by an information processing device with the minimum configuration according to an embodiment of the present disclosure.
[0090] The information processing device 150 has at least the functions of a connection unit 151, an authentication result acquisition unit 152, a detection unit 153, and an execution unit 154. The mobile terminal 1 of the other embodiment described above is one aspect of the information processing device 150.
[0091] The connection unit 151 connects to a first terminal that has a structure for being worn on a user's ear and receives a reflected signal of a signal output to the inside of the ear, and transmits information acquired from an external source to the user while worn by the user (step S601). The authentication result acquisition unit 152 acquires the result of authentication performed using the reflected signal (step S602). The detection unit 153 detects the acquisition of predetermined first information (step S603). If the authentication result is successful, the execution unit 154 outputs information regarding the execution of a predetermined process performed using the first information to the first terminal (step S604).
[0092] The program of the mobile terminal 1 may be a program for realizing some of the above-mentioned functions, or may be a so-called differential file (differential program) that can realize the above-mentioned functions in combination with a program already stored in the computer system.
[0093] The information processing system 100 of this disclosure has been described above, but this disclosure is not limited to the above-described embodiment. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of this disclosure within the scope of this disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate.
[0094] Note that part or all of the above-described embodiments can be described as, but are not limited to, the following supplementary notes.
[0095] (Supplementary Note 1) An information processing device comprising: a first terminal having a structure for being worn on a user's ear and acquiring a reflected signal of a signal output inside the ear, said first terminal being worn by the user and transmitting information acquired from outside to the user; a connection means for connecting to said first terminal; an authentication result acquisition means for acquiring a result of authentication performed using said reflected signal; a detection means for detecting acquisition of predetermined first information; and an execution means for outputting information regarding the execution of a predetermined process performed using said first information to said first terminal when the result of said authentication is successful.
[0096] (Supplementary Note 2) The information processing device according to Supplementary Note 1, wherein the execution means outputs second information generated based on the first information to the first terminal when the result of the authentication is successful.
[0097] (Supplementary Note 3) The information processing device according to Supplementary Note 2, wherein the first information is message information, and the second information is processed information obtained by processing the message information.
[0098] (Supplementary Note 4) The information processing device according to Supplementary Note 3, further comprising: a permission unit that outputs a transmission permission to a sender of the first information based on a result of the authentication; and a detection unit that detects the first information from the sender based on the transmission permission.
[0099] (Supplementary Note 5) The information processing device according to Supplementary Note 3 or Supplementary Note 4, wherein the execution means identifies the content to be read out of the message information based on setting information stored in advance, and outputs the second information including the content to be read out to the first terminal.
[0100] (Supplementary Note 6) The information processing device described in Supplementary Note 2, wherein the detection means detects first information transmitted from another device, and the execution means outputs an information request corresponding to the first information to the first terminal as the second information, and outputs response information received from the first terminal based on the information request to the other device.
[0101] (Supplementary Note 7) The information processing device according to Supplementary Note 2, wherein the first information is sound, and the execution means outputs the second information generated based on the sound to the first terminal.
[0102] (Supplementary Note 8) An information processing device comprising: a connection means for connecting a first terminal having a structure for being worn on a user's ear and for acquiring a reflected signal of a signal output inside the ear, and a second terminal for communicating information acquired from outside to the user while worn on the user; an authentication result acquisition means for acquiring a result of authentication performed using the reflected signal; a detection means for detecting acquisition of predetermined first information; and an execution means for outputting information regarding the execution of a predetermined process performed using the first information to the second terminal when the result of the authentication is successful authentication.
[0103] (Supplementary Note 9) The information processing device according to Supplementary Note 8, wherein the execution means outputs second information generated based on the first information to the second terminal when the result of the authentication is successful.
[0104] (Supplementary Note 10) The information processing device according to Supplementary Note 9, wherein the first information is message information, and the second information is processed information obtained by processing the message information.
[0105] (Supplementary Note 11) The information processing device according to Supplementary Note 10, further comprising: a permission unit that outputs a transmission permission to a sender of the first information based on a result of the authentication; and a detection unit that detects the first information from the sender based on the transmission permission.
[0106] (Supplementary Note 12) The information processing device according to Supplementary Note 10 or Supplementary Note 11, wherein the execution means specifies the content to be read out of the message information based on setting information stored in advance, and outputs the second information including the content to be read out to the second terminal.
[0107] (Supplementary Note 13) The information processing device described in Supplementary Note 9, wherein the detection means detects first information transmitted from another device, and the execution means outputs an information request corresponding to the first information to the second terminal as the second information, and outputs response information received from the second terminal based on the information request to the other device.
[0108] (Supplementary Note 14) The information processing device according to Supplementary Note 9, wherein the first information is sound, and the execution means outputs the second information generated based on the sound to the second terminal.
[0109] (Supplementary Note 15) A mobile terminal comprising: a first terminal having a structure for being worn on a user's ear and acquiring a reflected signal of a signal output inside the ear, said first terminal being configured to communicate information acquired from outside to the user while worn by the user; a connection means for connecting to said first terminal; an authentication result acquisition means for acquiring a result of authentication performed using said reflected signal; a detection means for detecting acquisition of predetermined first information; and an execution means for outputting information regarding the execution of a predetermined process performed using said first information to said first terminal when the result of the authentication is successful authentication.
[0110] (Supplementary Note 16) The mobile terminal according to Supplementary Note 15, wherein the execution means outputs second information generated based on the first information to the first terminal when the result of the authentication is successful.
[0111] (Supplementary Note 17) The mobile terminal according to Supplementary Note 16, wherein the first information is message information, and the second information is processed information obtained by processing the message information.
[0112] (Supplementary Note 18) The mobile terminal according to Supplementary Note 17, further comprising: a permission unit that outputs a transmission permission to a sender of the first information based on a result of the authentication; and a detection unit that detects the first information from the sender based on the transmission permission.
[0113] (Supplementary Note 19) The mobile terminal according to Supplementary Note 17 or Supplementary Note 18, wherein the execution means identifies the content to be read out of the message information based on setting information stored in advance, and outputs the second information including the content to be read out to the first terminal.
[0114] (Supplementary Note 20) The mobile terminal according to Supplementary Note 16, wherein the detection means detects first information transmitted from another device, and the execution means outputs an information request corresponding to the first information to the first terminal as the second information, and outputs response information received from the first terminal based on the information request to the other device.
[0115] (Supplementary Note 21) The mobile terminal according to Supplementary Note 16, wherein the first information is sound, and the execution means outputs the second information generated based on the sound to the first terminal.
[0116] (Supplementary Note 22) A mobile terminal comprising: a connection means for connecting a first terminal having a structure for being worn on a user's ear and for acquiring a reflected signal of a signal output inside the ear, and a second terminal for communicating information acquired from outside to the user while worn on the user; an authentication result acquisition means for acquiring a result of authentication performed using the reflected signal; a detection means for detecting acquisition of predetermined first information; and an execution means for outputting information regarding the execution of a predetermined process performed using the first information to the second terminal when the result of the authentication is successful authentication.
[0117] (Supplementary Note 23) The mobile terminal according to Supplementary Note 22, wherein the execution means outputs second information generated based on the first information to the first terminal when the result of the authentication is successful.
[0118] (Supplementary Note 24) The mobile terminal according to Supplementary Note 23, wherein the first information is message information, and the second information is processed information obtained by processing the message information.
[0119] (Supplementary Note 25) The mobile terminal according to Supplementary Note 24, further comprising: a permission unit that outputs a transmission permission to a sender of the first information based on a result of the authentication; and a detection unit that detects the first information from the sender based on the transmission permission.
[0120] (Supplementary Note 26) The mobile terminal according to Supplementary Note 24 or Supplementary Note 25, wherein the execution means identifies the content to be read out of the message information based on setting information stored in advance, and outputs the second information including the content to be read out to the first terminal.
[0121] (Supplementary Note 27) The mobile terminal described in Supplementary Note 23, wherein the detection means detects first information transmitted from another device, and the execution means outputs an information request corresponding to the first information to the first terminal as the second information, and outputs response information received from the first terminal based on the information request to the other device.
[0122] (Supplementary Note 28) The mobile terminal according to Supplementary Note 23, wherein the first information is sound, and the execution means outputs the second information generated based on the sound to the first terminal.
[0123] (Supplementary Note 29) An information processing method comprising: a first terminal having a structure for being worn on a user's ear and acquiring a reflected signal of a signal output inside the ear; connecting to the first terminal which conveys information acquired from outside to the user while worn by the user; acquiring a result of authentication performed using the reflected signal; detecting acquisition of specified first information; and, if the result of the authentication is successful, outputting information regarding the execution of specified processing performed using the first information to the first terminal.
[0124] (Supplementary Note 30) The information processing method according to Supplementary Note 29, wherein, if a result of the authentication is successful, second information generated based on the first information is output to the first terminal.
[0125] (Supplementary Note 31) The information processing method according to Supplementary Note 30, wherein the first information is message information, and the second information is processed information obtained by processing the message information.
[0126] (Supplementary Note 32) The information processing method according to Supplementary Note 31, further comprising: outputting a transmission permission to a sender of the first information based on a result of the authentication; and detecting the first information from the sender based on the transmission permission.
[0127] (Supplementary Note 33) The information processing method according to Supplementary Note 31 or Supplementary Note 32, further comprising: specifying a readout content of the message information based on pre-stored setting information; and outputting the second information including the readout content to the first terminal.
[0128] (Supplementary Note 34) An information processing method according to Supplementary Note 30, comprising detecting first information transmitted from another device, outputting an information request corresponding to the first information to the first terminal as the second information, and outputting response information received from the first terminal based on the information request to the other device.
[0129] (Supplementary Note 35) The information processing method according to Supplementary Note 30, wherein the first information is sound, and the second information generated based on the sound is output to the first terminal.
[0130] (Supplementary Note 36) An information processing method comprising: connecting a first terminal having a structure for being worn on a user's ear and acquiring a reflected signal of a signal output inside the ear; and a second terminal which communicates information acquired from outside to the user while worn on the user; acquiring a result of authentication performed using the reflected signal; detecting acquisition of specified first information; and, if the result of the authentication is successful, outputting information relating to the execution of specified processing performed using the first information to the second terminal.
[0131] (Supplementary Note 37) The information processing method according to Supplementary Note 36, wherein, if the result of the authentication is successful, second information generated based on the first information is output to the second terminal.
[0132] (Supplementary Note 38) The information processing method according to Supplementary Note 37, wherein the first information is message information, and the second information is processed information obtained by processing the message information.
[0133] (Supplementary Note 39) The information processing method according to Supplementary Note 38, further comprising: outputting a transmission permission to a sender of the first information based on a result of the authentication; and detecting the first information from the sender based on the transmission permission.
[0134] (Supplementary Note 40) The information processing method according to Supplementary Note 38 or Supplementary Note 39, further comprising: specifying a readout content of the message information based on pre-stored setting information; and outputting the second information including the readout content to the second terminal.
[0135] (Supplementary Note 41) An information processing method as described in Supplementary Note 37, which includes detecting first information transmitted from another device, outputting an information request corresponding to the first information to the second terminal as the second information, and outputting response information received from the second terminal based on the information request to the other device.
[0136] (Supplementary Note 42) The information processing method according to Supplementary Note 37, wherein the first information is sound, and the second information generated based on the sound is output to the second terminal.
[0137] (Appendix 43) A program that causes a computer of an information processing device to function as: a connection means for connecting to a first terminal that has a structure for being worn on a user's ear and acquires a reflected signal of a signal output inside the ear, the first terminal communicating information acquired from outside to the user while worn by the user; an authentication result acquisition means for acquiring the result of authentication performed using the reflected signal; a detection means for detecting the acquisition of specified first information; and an execution means for outputting information regarding the execution of specified processing performed using the first information to the first terminal when the result of the authentication is successful.
[0138] (Supplementary Note 44) The program according to Supplementary Note 43, wherein the execution means outputs second information generated based on the first information to the first terminal when the result of the authentication is successful.
[0139] (Supplementary Note 45) The program according to Supplementary Note 44, wherein the first information is message information, and the second information is processed information obtained by processing the message information.
[0140] (Supplementary Note 46) The program according to Supplementary Note 45, further comprising: a permission means for outputting a transmission permission to a sender of the first information based on a result of the authentication; and a detection means for detecting the first information from the sender based on the transmission permission.
[0141] (Appendix 47) The program according to appendix 45 or appendix 46, wherein the execution means identifies the content to be read out of the message information based on setting information stored in advance, and outputs the second information including the content to be read out to the first terminal.
[0142] (Appendix 48) The program described in Appendix 44, wherein the detection means detects first information transmitted from another device, and the execution means outputs an information request corresponding to the first information to the first terminal as the second information, and outputs response information received from the first terminal based on the information request to the other device.
[0143] (Supplementary Note 49) The program according to Supplementary Note 44, wherein the first information is sound, and the execution means outputs the second information generated based on the sound to the first terminal.
[0144] (Supplementary Note 50) A program that causes a computer of an information processing device to function as: a connection means that connects a first terminal that has a structure for being worn on a user's ear and acquires a reflected signal of a signal output inside the ear, and a second terminal that communicates information acquired from outside to the user while worn on the user; an authentication result acquisition means that acquires the result of authentication performed using the reflected signal; a detection means that detects the acquisition of specified first information; and an execution means that, when the result of the authentication is successful, outputs information regarding the execution of specified processing performed using the first information to the second terminal.
[0145] (Supplementary Note 51) The program according to Supplementary Note 50, wherein the execution means outputs second information generated based on the first information to the second terminal when the result of the authentication is successful.
[0146] (Supplementary Note 52) The program according to Supplementary Note 51, wherein the first information is message information, and the second information is processed information obtained by processing the message information.
[0147] (Supplementary Note 53) The program according to Supplementary Note 52, further comprising: a permission means for outputting a transmission permission to a sender of the first information based on a result of the authentication; and a detection means for detecting the first information from the sender based on the transmission permission.
[0148] (Appendix 54) The program according to appendix 52 or appendix 53, wherein the execution means identifies the content to be read out of the message information based on setting information stored in advance, and outputs the second information including the content to be read out to the second terminal.
[0149] (Appendix 55) The program described in Appendix 51, wherein the detection means detects first information transmitted from another device, and the execution means outputs an information request corresponding to the first information to the second terminal as the second information, and outputs response information received from the second terminal based on the information request to the other device.
[0150] (Supplementary Note 56) The program according to Supplementary Note 51, wherein the first information is sound, and the execution means outputs the second information generated based on the sound to the second terminal.
[0151] (Supplementary Note 57) An information processing device comprising: a connection means for connecting to a first terminal that acquires biometric information of a user, the first terminal communicating information acquired from an external source to the user while worn by the user; an authentication result acquisition means for acquiring a result of authentication performed using the biometric information; a detection means for detecting acquisition of specified first information; and an execution means for outputting information regarding the execution of specified processing performed using the first information to the first terminal when the result of the authentication is successful authentication.
[0152] (Supplementary Note 58) The information processing device according to Supplementary Note 57, wherein the execution means outputs second information generated based on the first information to the first terminal when the result of the authentication is successful authentication.
[0153] (Supplementary Note 59) The information processing device according to Supplementary Note 58, wherein the first information is message information, and the second information is processed information obtained by processing the message information.
[0154] (Supplementary Note 60) The information processing device according to Supplementary Note 59, further comprising: a permission unit that outputs a transmission permission to a sender of the first information based on a result of the authentication; and a detection unit that detects the first information from the sender based on the transmission permission.
[0155] (Supplementary Note 61) The information processing device according to Supplementary Note 59 or Supplementary Note 60, wherein the execution means identifies the content to be read out of the message information based on setting information stored in advance, and outputs the second information including the content to be read out to the first terminal.
[0156] (Appendix 62) An information processing device as described in Appendix 58, wherein the detection means detects first information transmitted from another device, and the execution means outputs an information request corresponding to the first information to the first terminal as the second information, and outputs response information received from the first terminal based on the information request to the other device.
[0157] (Supplementary Note 63) The information processing device according to Supplementary Note 58, wherein the first information is sound, and the execution means outputs the second information generated based on the sound to the first terminal.
[0158] (Supplementary Note 64) An information processing device comprising: a connection means for connecting a first terminal that acquires biometric information of a user to a second terminal that communicates information acquired from outside to the user while worn by the user; an authentication result acquisition means for acquiring a result of authentication performed using the biometric information; a detection means for detecting acquisition of specified first information; and an execution means for outputting information regarding the execution of specified processing performed using the first information to the second terminal when the result of the authentication is successful authentication.
[0159] (Supplementary Note 65) The information processing device according to Supplementary Note 64, wherein the execution means outputs second information generated based on the first information to the second terminal when the result of the authentication is successful.
[0160] (Supplementary Note 66) The information processing device according to Supplementary Note 65, wherein the first information is message information, and the second information is processed information obtained by processing the message information.
[0161] (Supplementary Note 67) The information processing device according to Supplementary Note 66, further comprising: a permission means for outputting a transmission permission to a sender of the first information based on a result of the authentication; and a detection means for detecting the first information from the sender based on the transmission permission.
[0162] (Supplementary Note 68) The information processing device according to Supplementary Note 66 or Supplementary Note 67, wherein the execution means identifies the content to be read out of the message information based on setting information stored in advance, and outputs the second information including the content to be read out to the second terminal.
[0163] (Appendix 69) An information processing device as described in Appendix 65, wherein the detection means detects first information transmitted from another device, and the execution means outputs an information request corresponding to the first information to the second terminal as the second information, and outputs response information received from the second terminal based on the information request to the other device.
[0164] (Supplementary Note 70) The information processing device according to Supplementary Note 65, wherein the first information is sound, and the execution means outputs the second information generated based on the sound to the second terminal.
[0165] DESCRIPTION OF SYMBOLS 1... Mobile terminal (information processing device) 2... Earphone (first terminal) 4... Head-mounted terminal 5... Headphones 6... In-vehicle device 11... Control unit 12... Communication connection unit (connection means 151) 13... Authentication unit 14... Authentication result acquisition unit (authentication result acquisition means 152) 15... Detection unit (detection means 153) 16... Execution unit (execution means 154) 17... Memory unit 21... Control unit 22... Communication unit 23... Sound output unit 24... Authentication processing unit 25... Display 26... Vibration unit 100... Information processing system
Claims
1. a first terminal having a structure for being worn on a user's ear and for acquiring a reflected signal of a signal outputted to the inside of the ear, and a connection means for connecting with the first terminal that transmits information acquired from an external source to the user while being worn on the user; an authentication result acquisition means for acquiring a result of authentication performed using the reflected signal; a detection means for detecting acquisition of predetermined first information; an execution means for outputting, to the first terminal, information relating to execution of a predetermined process performed using the first information when the result of the authentication is successful; An information processing device comprising:
2. The execution means outputs second information generated based on the first information to the first terminal when the result of the authentication is successful. The information processing device according to claim 1 .
3. the first information is message information, The second information is processed information obtained by processing the message information. The information processing device according to claim 2 .
4. a permission means for outputting a transmission permission to a sender of the first information based on a result of the authentication; the detection means detects the first information from the sender based on the transmission permission. The information processing device according to claim 3 .
5. The execution means specifies the read-out content of the message information based on pre-stored setting information, and outputs the second information including the read-out content to the first terminal.
5. The information processing device according to claim 3.
6. the detecting means detects first information transmitted from another device; The execution means outputs an information request corresponding to the first information to the first terminal as the second information, and outputs response information received from the first terminal based on the information request to the other device. The information processing device according to claim 2 .
7. a first terminal that has a structure for being worn on a user's ear and that acquires a reflected signal of a signal output to the inside of the ear, and a second terminal that conveys information acquired from an external source to the user while being worn on the user; and a connection means that connects the first terminal and the second terminal to each other. an authentication result acquisition means for acquiring a result of authentication performed using the reflected signal; a detection means for detecting acquisition of predetermined first information; an execution means for outputting, to the second terminal, information relating to execution of a predetermined process performed using the first information when the result of the authentication is successful; An information processing device comprising:
8. a first terminal having a structure for being worn on a user's ear and for acquiring a reflected signal of a signal outputted to the inside of the ear, the first terminal being connected to the first terminal for transmitting information acquired from an external source to the user while being worn by the user; obtaining a result of authentication performed using the reflected signal; Detecting acquisition of predetermined first information; If the result of the authentication is successful, information regarding the execution of a predetermined process performed using the first information is output to the first terminal. Information processing methods.
9. The computer of the information processing device, a first terminal having a structure for being worn on a user's ear and for acquiring a reflected signal of a signal outputted to the inside of the ear, said first terminal transmitting information acquired from an external source to said user while being worn by said user; an authentication result acquisition means for acquiring a result of authentication performed using the reflected signal; a detection means for detecting acquisition of predetermined first information; an execution means for outputting, to the first terminal, information relating to execution of a predetermined process performed using the first information when the result of the authentication is successful; A program that functions as a
10. a first terminal for acquiring biometric information of a user, the first terminal being attached to the user and transmitting the acquired information to the user; and a connection means for connecting to the first terminal. an authentication result acquisition means for acquiring a result of authentication performed using the biometric information; a detection means for detecting acquisition of predetermined first information; an execution means for outputting, to the first terminal, information relating to execution of a predetermined process performed using the first information when the result of the authentication is successful; An information processing device comprising: