First device and system

Abstract

To provide a first device that enables visual confirmation of a user's condition.SOLUTION: A first device includes an input microphone, a first output unit that outputs audio, and an imaging unit. The first device is any one of earphones, headphones, and a headset. The imaging unit is configured such that an imaging surface of the imaging unit faces the lips and cheek area of a user when the first device is worn by the user.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a first device, such as an earphone. [Background technology]

[0002] Conventionally, headsets and the like have been proposed, as in Patent Document 1. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2023-12418 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, no consideration is given to visually checking the user's condition.

[0005] Therefore, an object of the present invention is to provide a first device or the like that allows visual confirmation of the condition of a user. [Means for solving the problem]

[0006] A first device according to the present invention includes an input microphone, a first output section that outputs sound, and an imaging section. The first device is one of an earphone, a headphone, and a headset. The imaging unit is configured such that, when the first device is worn by the user, an imaging surface of the imaging unit faces the lip and cheek area of ​​the user.

[0007] It becomes possible to obtain an image of the state of a user wearing a first device, such as an earphone, for example an image of the lips and cheek area of ​​the user wearing the first device.

[0008] Preferably, the first device is the earphone. The earphone includes an earpiece region and a nozzle region. The imaging unit is provided in the nozzle region.

[0009] It becomes possible to position the imaging unit in the vicinity of the user while the positional relationship with the user remains almost unchanged.

[0010] More preferably, in a learning mode, the first device generates a database containing combinations of the text information output from the first output unit corresponding to the voice read out by the user, based on the voice signal obtained by the input microphone and the image signal obtained by the imaging unit when the user reads out the voice, and generates a database containing combinations of the text information and the image signal based on the voice signal obtained by the input microphone and the image signal obtained by the imaging unit when the user reads out the voice. In a character recognition mode, the first device identifies a character corresponding to the image signal based on the database and the image signal obtained by the imaging unit.

[0011] Characters corresponding to the user's facial movements (especially the movements of the lips and cheeks) are recorded in a database, making it possible to identify the characters corresponding to those movements based on those movements, even without the user making a sound.

[0012] More preferably, in a call mode, the first device corresponds to a voice uttered by the user and identifies text information contained in a voice signal obtained by the input microphone. The database includes a combination of the specified character information and an image signal obtained by the imaging unit when the user utters the voice.

[0013] By utilizing a combination of character information contained in a voice signal during a call and an image signal during the call, it is possible to enrich the database and increase the number of characters that can be identified in a character recognition mode without frequently operating in a learning mode.

[0014] Also, preferably, the first device is either the headphones or the headset and includes a headband. The headband is provided with a detection unit that detects the state of the user's head. The head condition includes at least one of information regarding cerebral blood flow, brain waves, and head movement.

[0015] Using the detection unit provided on the headband, it becomes possible to grasp the state of the head of a user wearing the first device.

[0016] In addition, preferably, in a learning mode, the first device generates a database including combinations of the character information output from the first output unit corresponding to the voice read out by the user, based on the voice signal obtained by the input microphone and the image signal obtained by the imaging unit when the user reads out the voice, and the database includes the combinations of the character information and the image signal. In a character recognition mode, the first device identifies a character corresponding to the image signal based on the database and the image signal obtained by the imaging unit. Based on the information obtained by the detection unit, the first device stops the operation of the imaging unit.

[0017] A predetermined state (for example, a sleeping state) can be identified based on the state of the head, and when the predetermined state is reached, the operation of the imaging unit and the like can be stopped, thereby suppressing unnecessary power consumption.

[0018] In a preferred embodiment, at least one of a locked state of the first device and a locked state of a second device communicating with the first device is unlocked based on at least an image signal obtained by the imaging section.

[0019] This allows the user to easily determine whether to release the lock state through natural movements.

[0020] A system according to the present invention includes a first device having an input microphone, a first output section that outputs audio, and an imaging section, and a second device having a second output section. The imaging unit is configured such that, when the first device is worn by the user, an imaging surface of the imaging unit faces the lip and cheek area of ​​the user. The first device and the second device are connected wirelessly or by wire. In a learning mode, at least one of the first device and the second device generates a database that corresponds to the text information output from at least one of the first output unit and the second output unit and the voice read out by the user, and includes combinations of the text information and the image signals based on the voice signal obtained by the input microphone and the image signal obtained by the imaging unit when the user reads out the voice. At least one of the first device and the second device is in a character recognition mode and identifies a character corresponding to the image signal based on the database and the image signal obtained by the imaging unit.

[0021] Preferably, at least one of the first device and the second device, in a call mode, responds to a voice uttered by the user and identifies text information contained in a voice signal obtained by the input microphone. The database includes a combination of the specified character information and an image signal obtained by the imaging unit when the user utters the voice.

[0022] More preferably, at least one of the first device and the second device writes the characters identified in the character recognition mode on a text editor software.

[0023] By writing the identified characters in a text editor on the second device, the identified characters can be easily recorded. Also, by editing the characters written in the text editor, erroneously identified characters can be corrected. Effect of the Invention

[0024] As described above, according to the present invention, it is possible to provide a first device and the like that are capable of visually checking the condition of a user. [Brief description of the drawings]

[0025] [Figure 1]FIG. 1 is a configuration diagram of a system in a first embodiment. [Diagram 2] FIG. 11 is a configuration diagram of a system in a second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0026] The first embodiment will be described below with reference to the drawings (see FIG. 1). The embodiments are not limited to the following embodiments. In principle, the contents described in one embodiment are also applicable to other embodiments. The embodiments and modifications can be combined as appropriate.

[0027] The system 1 in the first embodiment includes a first device 10, a second device 20, and an external device 30.

[0028] (1st device 10) The first device 10 is a wireless earphone including an earpiece region and a nozzle region. The first device 10 has a first communication unit 11, a first operation unit 12, an input microphone 13, an output microphone 14, an imaging unit 15, a first control unit 16, and a first output unit 17.

[0029] The first communication unit 11, the first operation unit 12, the output microphone 14, the first control unit 16, and the first output unit 17 are provided in an earpiece area of ​​the first device 10. The input microphone 13 and the imaging section 15 are provided in the nozzle area of ​​the first device 10. However, any one of the first operation unit 12, the output microphone 14, and the first control unit 16 may be provided in the nozzle region of the first device 10. Furthermore, imaging section 15 may be provided in the earpiece area of ​​first device 10.

[0030] The first device 10 is made up of two devices, one for the right ear and one for the left ear. However, the first device 10 may be configured as only one for the right ear or the left ear.

[0031] (First communication unit 11) The first communication unit 11 communicates with a second communication unit 21 of the second device 20 by short-range wireless communication or the like. An audio signal obtained by the input microphone 13 and an image signal obtained by the imaging unit 15 are transmitted to the second device 20 via the first communication unit 11. The audio signal output from the first output unit 17 is transmitted from the second device 20 via the first communication unit 11.

[0032] (1st operation section 12) The first operation unit 12 is used to adjust the volume of the audio signal output from the first output unit 17, fast forward or rewind a song, turn on and off the noise canceling function, switch the usage mode, and the like. The usage modes of the first embodiment include a call mode for making a call using the second device 20, a music mode for outputting music from the second device 20, a character recognition mode, and a learning mode. In the character recognition mode, characters uttered by a user are identified based on the movement of at least one of the lips and cheeks when the user utters the characters. In the learning mode, the characters contained in the voice spoken by the user and the movement of at least one of the user's lips and cheeks when the user speaks the voice are identified to generate a database for use in the character recognition mode.

[0033] (Input microphone 13) The input microphone 13 generates a voice signal based on the voice uttered by the user wearing the first device 10. When the first device 10 is configured with two devices, one for the right ear and one for the left ear, the input microphone 13 may be provided only in either the first device 10 for the right ear or the first device 10 for the left ear.

[0034] (Output Microphone 14) The output microphone 14 generates an audio signal based on the sound around the first device 10 . The audio signal obtained by the output microphone 14 is used for noise canceling.

[0035] (Imaging unit 15) The imaging unit 15 captures a moving image of the face, particularly the lip and cheek areas, of a user wearing the first device 10, and generates an image signal corresponding to the captured moving image. The use of the image signal obtained by the imaging unit 15 will be described later. When the first device 10 is configured with two devices, one for the right ear and one for the left ear, the imaging unit 15 may be provided only in either the first device 10 for the right ear or the first device 10 for the left ear. For example, an input microphone 13 is provided at the tip of the nozzle region of one of the first device 10 for the right ear and the first device 10 for the left ear, and an imaging unit 15 is provided at the tip of the other nozzle region of the first device 10 for the right ear and the first device 10 for the left ear. The imaging surface of the imaging unit 15 faces the face of the user wearing the first device 10, particularly the lip and cheek area. Furthermore, the focal length f of the lens of the imaging unit 15 is approximately equal to the distance between the imaging unit 15 and the face of the user wearing the first device 10, particularly the lip and cheek areas (f≦10 cm).

[0036] (First control unit 16) The first control unit 16 controls each part of the first device 10 .

[0037] (Operation of the first control unit 16 in the call mode) In the call mode, the first control unit 16 transmits a voice signal obtained by the input microphone 13 to the second device 20 via the first communication unit 11. In addition, the first control unit 16 causes the first output unit 17 to output a sound based on the sound signal transmitted from the second device 20.

[0038] (Operation of the first control unit 16 in music mode) In the music mode, the first control unit 16 causes the first output unit 17 to output sound based on the audio signal transmitted from the second device 20.

[0039] When noise canceling is performed, the first control unit 16 generates a noise cancellation signal based on the audio signal obtained by the output microphone 14. The first control unit 16 superimposes the noise cancellation signal on the audio signal transmitted from the second device 20. The first control unit 16 causes the first output unit 17 to output audio based on the superimposed audio signal.

[0040] (Operation of the first control unit 16 in learning mode) In the learning mode, the first control unit 16 transmits the audio signal obtained by the input microphone 13 and the image signal obtained by the imaging unit 15 to the second device 20 via the first communication unit 11.

[0041] (Operation of the first control unit 16 in character recognition mode) In the character recognition mode, the first control unit 16 transmits an image signal obtained by the imaging unit 15 to the second device 20 via the first communication unit 11.

[0042] (First output unit 17) The first output section 17 includes at least one of a driver unit and a bone conduction vibrator, and outputs sound. The first output section 17 is disposed at a position facing the ear of a user wearing the first device 10.

[0043] (Second device 20) The second device 20 is a mobile terminal that communicates with the first device 10. The second device 20 has a second communication unit 21, a second operation unit 22, a second control unit 26, and a second output unit 27.

[0044] (Second communication unit 21) Second communication unit 21 communicates with first communication unit 11 of first device 10 by short-range wireless communication or the like. The second communication unit 21 communicates with an external device 30 such as a server via the network. The wireless communication means used for communication between the first communication unit 11 and the second communication unit 21, and the wireless communication means used for communication between the second communication unit 21 and the external device 30 may be IEEE802.15.1 (Bluetooth (registered trademark)), IEEE802.11 (wireless LAN), a mobile phone line, etc.

[0045] (Second operation section 22) The second operation unit 22 is used for adjusting the volume of the audio signal output from the first output unit 17, fast-forwarding or rewinding a song, turning on and off the noise canceling function, switching the usage mode, and the like.

[0046] (Second control unit 26) The second control unit 26 controls each part of the second device 20.

[0047] (Operation of second control unit 26 in call mode) In the call mode, second control unit 26 transmits and receives voice signals and the like to and from other communication terminals and first device 10 via second communication unit 21.

[0048] (Operation of second control unit 26 in music mode) In the music mode, the second control unit 26 transmits an audio signal to the second device 20 via the second communication unit 21.

[0049] (Operation of second control unit 26 in learning mode) In the learning mode, the second control unit 26 causes the second output unit 27 to display predetermined character information and instruction information to read out the predetermined character information within a predetermined time (for example, within 20 seconds).

[0050] In addition, the second control unit 26 causes the input microphone 13 to generate an audio signal based on the sound uttered by the user wearing the first device 10 by moving his / her lips within the predetermined time. The second control unit 26 causes the imaging unit 15 to generate an image signal based on a moving image of the lip and cheek areas of the user wearing the first device 10 within the predetermined time. When the specified text information matches the text information contained in the audio signal obtained by the input microphone 13, the second control unit 26 generates a database including a combination of the text information and image information of the lip and cheek areas at the time when the audio signal was produced, and records the database in the recording unit 38.

[0051] (Operation of second control unit 26 in character recognition mode) In the character recognition mode, the second control unit 26 identifies characters corresponding to the user's facial movements based on the image signal obtained by the imaging unit 15 and the database recorded in the recording unit 38, and writes the identified characters into the text editor software.

[0052] (Second output unit 27) The second output unit 27 is a display device, and displays support information including predetermined text information, particularly in the learning mode. The predetermined character information is processed in at least one of the following units: a character unit (e.g., "a" in Japanese), a word unit (e.g., "hon" in Japanese), a phrase unit (e.g., "watashi wa" in Japanese), and a sentence unit (e.g., "kyo, watashi wa, mega ga teta" in Japanese). The more combinations of text and image information there are, the more characters can be correctly identified in character recognition mode.

[0053] (External device 30) The external device 30 communicates with the second device 20 via the network. The external device 30 includes a third communication unit 31 and a recording unit .

[0054] (Third communication unit 31) The third communication unit 31 communicates with the second device 20 via the network.

[0055] (Record Section 38) The recording unit 38 records the database created in the learning mode. Furthermore, text editor software is installed in the recording unit 38. Moreover, the recording unit 38 records the files written by the text editor software. In the first embodiment, an example in which the recording unit 38 is provided in the external device 30 will be described. However, the recording unit 38 may be provided in the first device 10 or the second device 20.

[0056] (Operation of each part in learning mode) The second output unit 27 displays text information and instruction information. The text information includes text to be read aloud by the user. The instruction information includes an instruction to read out the characters included in the character information within a predetermined time period while first device 10 is being worn. During the predetermined time, an audio signal obtained by the input microphone 13 and an image signal obtained by the imaging unit 15 are transmitted to the second device 20 via the first communication unit 11. The second control unit 26 compares the characters included in the text information with the voice signal obtained by the input microphone 13, and judges whether or not the voice corresponding to the characters has been correctly uttered. If the character is pronounced correctly, the second control unit 26 records in the database, as an image signal corresponding to the character, the image signal obtained by the imaging unit 15 during the time period during which the sound corresponding to the character was pronounced within the specified time period. The data is recorded in the database by the recording unit 38.

[0057] (Operation of each part in character recognition mode) The imaging section 15 acquires an image signal when a user wearing the first device 10 moves his / her lips. The user may make a sound, or may not make a sound and simply move their lips in the same way as if they were making a sound. The acquired image signal is transmitted to the second device 20 via the first communication unit 11. The second control unit 26 identifies the character corresponding to the acquired image signal based on the database. The second control unit 26 starts the text editor software and writes the specified characters on the text editor software. When the lips are moved in the same manner as when uttering a plurality of characters (phrases, sentences, etc.), the plurality of characters are identified and written into the text editor software.

[0058] (Effect of providing the imaging unit 15 in the first device 10 such as an earphone) It becomes possible to obtain an image of the state of a user wearing a first device 10, such as an earphone, for example an image of the lips and cheek area of ​​a user wearing the first device 10.

[0059] (Effect of providing the imaging unit 15 in the nozzle area of ​​the earphone) It becomes possible to position the imaging unit 15 in the vicinity of the user while the positional relationship with the user remains almost unchanged.

[0060] (The effect of identifying characters corresponding to image signals) Characters corresponding to the user's facial movements (especially the movements of the lips and cheeks) are recorded in a database, making it possible to identify the characters corresponding to those movements based on those movements, even without the user making a sound.

[0061] (The effect of overwriting the database based on the audio during a call) By utilizing a combination of character information contained in a voice signal during a call and an image signal during the call, it is possible to enrich the database and increase the number of characters that can be identified in a character recognition mode without frequently operating in a learning mode.

[0062] (Effect of writing in a text editor) The identified characters can be easily recorded by writing the identified characters on the text editor software on the second device 20. In addition, the characters written on the text editor software can be edited to correct erroneously identified characters.

[0063] (Learning mode application example 1) In the first embodiment, an example has been described in which, in the learning mode, text information or the like is displayed on second output unit 27, and the user wearing first device 10 reads out the text information by moving his or her lips. However, in addition to or instead of the second output unit 27, the first output unit 17 may output the text information to be read aloud by voice.

[0064] (Learning mode application example 2) The learning mode may be performed during the talk mode. In this case, the imaging unit 15 operates even in the call mode, and the audio signal obtained by the input microphone 13 and the image signal obtained by the imaging unit 15 are transmitted to the second device 20 via the first communication unit 11. The second control unit 26 identifies the character corresponding to the audio signal obtained by the input microphone 13, and records in the database the image signal obtained by the imaging unit 15 during the time period when the audio signal corresponding to the character was emitted, as the image signal corresponding to the character. In identifying the characters corresponding to the voice signal obtained by the input microphone 13, it is desirable for the second control unit 26 to select characters that are highly likely and eliminate characters that are less likely based on the content of the call, the location information of the first device 10, etc. For example, when it is determined from the contents of the call that the call is in Japanese, the second control unit 26 identifies the relevant characters from within the Japanese language.

[0065] (Learning mode application example 3) In the learning mode, characters that are not specified as characters to be written on the text editor software, but are specified as operation instructions of the text editor software, may be recorded in the database. For example, when it is desired to operate a "line feed" function on the text editor software, an image signal including a predetermined action (movement of lips, etc.) is set and recorded in the database. In this case, in the character recognition mode, when the imaging unit 15 acquires an image signal including a predetermined operation, a "line feed" operation is performed on the text editor software.

[0066] (Learning mode application example 4) In the learning mode, an example has been described in which the user utters a voice corresponding to text information. However, the user may not make a sound corresponding to the text information, but may instead move his / her lips in a manner similar to that of making a sound corresponding to the text information.

[0067] (Example of switching between usage modes) The switching of the usage mode is not limited to manual operation via the first operating unit 12 and the second operating unit 22. For example, in the first device 10, when the power is on but no usage mode is selected, or when the first device 10 is in music mode, if characters can be identified from the image signal obtained by the imaging unit 15, the first control unit 16 or the second control unit 26 may automatically switch to the character recognition mode.

[0068] (Second embodiment, head movement detection) Next, a second embodiment will be described (see FIG. 2). The first device 10 of the second embodiment is a wireless headset that includes a headband and a microphone holding area. The input microphone 13 and the imaging unit 15 are provided in the microphone holding area and positioned so as to protrude forward beyond the other components constituting the headset (e.g., a headband) and the lips of a user wearing the first device 10. The headband of the first device 10 is provided with a detection unit 18. The detector 18 faces the head of a user wearing the first device 10 and detects the state of the user's head. The head condition includes at least one of information regarding the user's cerebral blood flow, brain waves, and head movement using weak near-infrared light.

[0069] (Operation of the first control unit 16 in character recognition mode) In the character recognition mode, the first control unit 16 transmits the image signal obtained by the imaging unit 15 and information regarding the head state obtained by the detection unit 18 to the second device 20 via the first communication unit 11.

[0070] (Operation of second control unit 26 in character recognition mode) In the character recognition mode, the second control unit 26 identifies characters corresponding to the user's facial movements based on the image signal obtained by the imaging unit 15 and the database recorded in the recording unit 38, and writes the identified characters into the text editor software. However, based on the information on the state of the head obtained by the detection unit 18, the first device 10 stops the operation of the imaging unit 15. Specifically, when it is determined that the user is asleep based on the information on the head state obtained by detection unit 18, first device 10 stops the operation of imaging unit 15 based on instruction information from second device 20. In other words, while the user is asleep, operations related to character recognition are stopped.

[0071] (Effect of detecting the state of the head) By using the detector 18 provided on the headband, it becomes possible to grasp the state of the head of a user wearing the first device 10.

[0072] (Effect of controlling character recognition stop) A predetermined state (for example, a sleeping state) can be identified based on the state of the head, and when the predetermined state is reached, the operation of the imaging unit 15 and the like can be stopped, thereby suppressing unnecessary power consumption.

[0073] (Effect of Providing the Imaging Unit 15 in the Front) Since the imaging unit 15 is provided at a position substantially opposite the user's lips, it becomes easier to identify the movement of the lips or cheeks corresponding to the spoken characters compared to a configuration in which the movement of the lips or cheeks is identified from the side or rear.

[0074] (Application example of the first device 10) In the first embodiment, an example has been described in which the first device 10 is a wireless earphone. In the second embodiment, an example has been described in which the first device 10 is a wireless headset. However, the first device 10 is not limited to a wireless earphone or a wireless headset, and may be a wired earphone, a wireless headphone, a wired headset, or the like. When the first device 10 is any of a wired earphone, a wired headphone, and a wired headset, the first device 10 and the second device 20 are connected by wire.

[0075] (Application example of the second device 20) In the first and second embodiments, an example has been described in which the second device 20 is a mobile terminal. However, the second device 20 is not limited to a mobile terminal, and may be a personal computer or the like.

[0076] (Examples of applications of the execution subject, such as character recognition) In the first and second embodiments, examples have been described in which the second device 20 performs tasks such as generating a database in the learning mode and identifying characters in the character recognition mode. However, the first device 10 may also perform tasks such as generating a database in the learning mode and identifying characters in the character recognition mode. In particular, when the first output unit 17 outputs the character information and instruction information in the learning mode, the second device 20 may be omitted. Furthermore, if the first device 10 has a call function, even if the second device 20 is not present, additional data can be added to the database in the call mode. When the second device 20 is omitted, the first device 10 communicates with the external device 30 via the network.

[0077] (Application example using the imaging unit 15) In the first and second embodiments, an example has been described in which image information obtained by the imaging unit 15 (information regarding the movement of at least one of the user's lips and cheeks) is used to identify characters corresponding to the movement. However, the image information obtained by the imaging unit 15 may be used for other purposes. For example, it may be used to unlock at least one of the first device 10 and the second device 20. In the learning mode, image information corresponding to the unlocking (information regarding a predetermined movement of at least one of the user's lips and cheeks) is recorded in a database. At least when the first device 10 and the second device 20 start to be used, it is determined whether or not the image information acquired by the imaging unit 15 matches the image information corresponding to the unlocking recorded in the database, and if they match, the locked state of at least one of the first device 10 and the second device 20 is released. In this case, the determination may be made by either the first control unit 16 of the first device 10 or the second control unit 26 of the second device 20.

[0078] (Effect of unlocking the device based on image signals) This allows the user to easily determine whether to release the lock state through natural movements.

[0079] Although some embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are within the scope of the invention and its equivalents as described in the claims, as well as the scope and spirit of the invention. [Explanation of symbols]

[0080] 1 System 10 1st device 11 First Communications Department 12 1st operation section 13 Input Microphone 14 Output Microphone 15 Imaging unit 16 First Control Section 17 First output section 18 Detection unit 20 Second device 21 Second Communications Department 22 2nd operation section 26 Second Control Section 27 Second output section 30 External equipment 31 Third Communications Department 38 Recording Section

Claims

1. An input microphone, A first output unit that outputs audio; A first device including an imaging unit, the first device is any one of an earphone, a headphone, and a headset; A first device, wherein the imaging unit is configured such that an imaging surface of the imaging unit faces the user's lips and cheek area when the first device is worn by the user.

2. the first device is the earphone; The earphone includes an earpiece region and a nozzle region, The first device according to claim 1 , wherein the imaging unit is provided in the nozzle region.

3. the first device, in a learning mode, generates a database including combinations of character information and image signals corresponding to the voice read by the user and output from the first output unit, based on a voice signal obtained by the input microphone and an image signal obtained by the imaging unit when the user reads the voice; The first device according to claim 1 or 2, wherein in a character recognition mode, the first device identifies a character corresponding to the image signal based on the database and the image signal obtained by the imaging unit.

4. The first device, in a call mode, identifies text information included in a voice signal obtained by the input microphone in response to a voice uttered by the user; The first device according to claim 3 , wherein the database includes a combination of the specified character information and an image signal obtained by the imaging unit when the user utters the voice.

5. the first device is one of the headphones and the headset and includes a headband; The headband is provided with a detection unit that detects a state of the user's head, The first device according to claim 1 or claim 2, wherein the head condition includes at least one of information regarding cerebral blood flow, brain waves, and head movement.

6. the first device, in a learning mode, generates a database including combinations of character information and image signals corresponding to the voice read by the user and output from the first output unit, based on a voice signal obtained by the input microphone and an image signal obtained by the imaging unit when the user reads the voice; the first device, in a character recognition mode, identifies a character corresponding to the image signal based on the database and the image signal obtained by the imaging unit; The first device according to claim 1 or 2, wherein the first device stops an operation of the imaging unit based on the information obtained by the detection unit.

7. The first device according to claim 1 or claim 2, wherein at least one of a locked state of the first device and a locked state of a second device communicating with the first device is unlocked based on at least an image signal obtained by the imaging unit.

8. a first device having an input microphone, a first output unit that outputs audio, and an imaging unit; a second device having a second output; The imaging unit is configured such that an imaging surface of the imaging unit faces a lip and cheek area of ​​the user when the first device is worn by the user, The first device and the second device are connected wirelessly or by wire, At least one of the first device and the second device generates, in a learning mode, a database including combinations of character information and image signals corresponding to the voice read by the user, the character information being output from at least one of the first output unit and the second output unit, based on a voice signal obtained by the input microphone and an image signal obtained by the imaging unit when the user reads the voice, A system in which at least one of the first device and the second device, in a character recognition mode, identifies a character corresponding to the image signal based on the database and the image signal obtained by the imaging unit.

9. At least one of the first device and the second device, in a call mode, identifies text information included in a voice signal obtained by the input microphone in response to a voice uttered by the user; The system according to claim 8 , wherein the database includes a combination of the specified character information and an image signal obtained by the imaging unit when the user utters the voice.

10. 10. The system according to claim 8, wherein at least one of the first device and the second device writes the character identified in the character recognition mode on a text editor software.

Images