Learning support device, learning support method, and program

Abstract

To provide a recording device that allows a device body to be used in combination with external audio input means and audio output means such as earphones with a microphone.SOLUTION: A learning support device 10 includes a main body microphone 18M and a main body speaker 19S provided on a device main body, and a CPU 11 that accepts an operation to identify either the main body microphone 18M or an earphone microphone (earphone with a microphone) 21 in response to the establishment of a connection between the external earphone microphone (earphone with the microphone) 21 and the device main body.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a recording device that inputs a user's voice into a device and records it. [Background technology]

[0002] In a device such as an audio device equipped with an audio input / output means, when an earphone with a microphone or an earphone without a microphone is inserted into an external connection terminal for audio input / output, in the case of an earphone with a microphone, both audio input and audio output are automatically switched from the microphone and speaker of the device body to the microphone and earphone of the earphone with a microphone, and in the case of an earphone without a microphone, audio output is automatically switched from the speaker of the device body to the earphone without a microphone.

[0003] Conversely, when an earphone with a microphone or the like is removed from the external connection terminal, audio input / output automatically switches to the microphone and speaker of the device itself. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2003-058977 A Summary of the Invention [Problem to be solved by the invention]

[0005] Conventionally, there are microphone-equipped earphones with various specifications and characteristics, such as makers and types.

[0006] However, it is not assumed that a user will use the device main body in any combination with an external audio input means and audio output means, such as an earphone with a microphone.

[0007] The present invention has been made in consideration of such problems, and aims to provide a recording device that allows the device body to be used in combination with external audio input and output means, such as earphones with a microphone. [Means for solving the problem]

[0008] The recording device of the present invention comprises a first audio input unit and a first audio output unit provided in the device main body, and a control unit which, when it detects that an external second audio input unit has been inserted into the device main body, causes a display unit to display an audio input identification unit that allows a user to identify either the first audio input unit or the second audio input unit. [Brief description of the drawings]

[0009] [Figure 1] 1 is a block diagram showing the configuration of an electronic circuit of a learning support device 10 according to an embodiment of the sound recording device of the present invention. [Diagram 2] A figure showing the correspondence between the current state of audio input / output according to the setting data stored in the main body / earphone microphone setting data memory unit 12d of the learning support device 10 and the external connection status data stored in the external connection status data memory unit 12e, and the state of audio input / output after changing the connection to the external connection terminal 20. [Diagram 3] 13 is a diagram showing a main unit / earphone microphone setting screen GMs displayed on a display unit 17 in response to a user operation of the learning support device 10. FIG. [Figure 4] 13 is a diagram showing an earphone / microphone setting window Wc that is displayed on a display unit 17 when an earphone / microphone 21 is inserted in the learning support device 10. FIG. [Diagram 5] 5 is a flowchart showing a microphone selection process in response to a user operation of the learning support device 10. [Figure 6] 13 is a diagram showing an earphone microphone symbol EM and a main body microphone symbol BM displayed on a user voice recording screen GR in response to a microphone selection process of the learning support device 10. FIG. [Figure 7]FIG. 2 is a diagram showing an example of a learning support process based on pronunciation lesson data 12c1 by the learning support device 10. [Figure 8] 10 is a flowchart showing a microphone selection process in response to a user operation of the learning support device 10 according to a modified example. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0011] FIG. 1 is a block diagram showing the configuration of an electronic circuit of a learning support device 10 according to an embodiment of the recording device of the present invention.

[0012] The electronic circuit of the learning support device 10 includes a CPU 11, which is a computer. The CPU 11 controls the operation of each part of the circuit according to a learning support processing program 12a prestored in a storage unit 12 such as a flash ROM, or a learning support processing program 12a read from an external storage medium 13 such as a memory card by a storage medium reading unit 14 and stored in the storage unit 12, or a learning support processing program 12a downloaded from a Web server (here, a program server) 30 on a communication network N via a communication unit 15 and stored in the storage unit 12.

[0013] The CPU 11 is connected to the memory unit 12, recording medium reading unit 14, and communication unit 15 via data and control buses, as well as to a key input unit 16, a display unit 17 with a touch panel, an audio input unit 18, and an audio output unit 19.

[0014] The voice input unit 18 includes a main body microphone 18M (first voice input means) for inputting the voice of the user or the like.

[0015] The audio output unit 19 includes a main speaker 19S (first audio output means) that outputs audio based on audio data stored in the storage unit 12 or recorded.

[0016] The audio input unit 18 and the audio output unit 19 are provided with a shared external connection terminal (EX) 20, and the user connects an earphone microphone (earphone with microphone) 21 (second audio input means / second audio output means), or an earphone (earphone without microphone) 22 (second audio output means), or an external speaker 23 (second audio output means) to the external connection terminal (EX) 20 of the learning support device 10 as necessary. Note that in this specification, for simplicity, the earphone microphone 21, the earphone 22, or the external speaker 23 may be collectively referred to as an "external audio input / output device".

[0017] Here, the connection between the external connection terminal 20 of the learning support device 10 and the external audio input / output device may be via a wired cable such as an audio cable or a universal serial bus (USB), or may be via wireless communication such as Bluetooth (registered trademark) or Wi-Fi (registered trademark). 1, in the case of connection via an audio cable, a connection between the learning support device 10 and the external audio input / output device is established by physically inserting a connection terminal of the external audio input / output device into the external connection terminal 20 of the learning support device 10. Conversely, the connection between the learning support device 10 and the external audio input / output device is released by physically removing the connection terminal of the external audio input / output device from the external connection terminal 20 of the learning support device 10.

[0018] Furthermore, in the case of connection via a USB cable, a connection between the learning support device 10 and the external audio input / output device is established after a predetermined communication process is performed between them by physically inserting the connection terminal (USB terminal) of the external audio input / output device into the external connection terminal 20 of the learning support device 10. The connection between the learning support device 10 and the external audio input / output device is released by physically removing the connection terminal of the external audio input / output device from the external connection terminal 20 of the learning support device 10.

[0019] Furthermore, in the case of a connection via wireless communication such as Bluetooth (registered trademark) or Wi-Fi (registered trademark), a connection between the learning support device 10 and the external audio input / output device is established after a process of pairing the two is performed. The connection between the learning support device 10 and the external audio input / output device is released when either the learning support device 10 or the external audio input / output device is turned off, when an operation for disconnecting is performed in either the learning support device 10 or the external audio input / output device, or when wireless communication between the learning support device 10 and the external audio input / output device is interrupted due to radio wave conditions.

[0020] In the following, an example will be described in which the learning support device 10 and the external audio input / output device are connected via an audio cable, but as described above, it goes without saying that the connection between the learning support device 10 and the external audio input / output device may be a connection via a wired cable other than an audio cable, or a connection via wireless communication. In addition, in this specification and the attached drawings, establishing a connection between the learning support device 10 and the external audio input / output device may be expressed as inserting, inserting, or attaching the external audio input / output device to the learning support device 10. Conversely, disconnecting the connection between the learning support device 10 and the external audio input / output device may be expressed as unplugging, pulling out, or removing the external audio input / output device from the learning support device 10.

[0021] The earphone microphone (earphone with microphone) 21 includes an earphone 21s (second audio output means) that outputs the audio output from the audio output unit 19, and a microphone 21m (second audio input means) that inputs the audio of a user or the like.

[0022] The audio output from the main body speaker 19S and the audio output from the earphone 21s of the earphone microphone 21, or the earphone 22, or the external speaker 23 is automatically switched upon detection of establishment of connection (insertion) of the earphone microphone 21, the earphone 22, or the external speaker 23 to the external connection terminal 20.

[0023] On the other hand, audio input through the main body microphone 18M and audio input through the microphone 21m of the earphone microphone 21 are switched according to the setting data of [main body microphone] or [earphone microphone] set in accordance with user operation in the main body / earphone microphone setting data memory unit 22d described below, regardless of whether the earphone microphone 21 is connected (plugged in) to the external connection terminal 20, and audio input through only one of them is exclusively selected.

[0024] The memory unit 12 stores, in addition to the learning support processing program 12a, a voice recognition processing program 12b, and also includes a learning content memory unit 12c, a main unit / earphone microphone setting data memory unit 12d, an external connection status data memory unit 12e, a recorded voice data memory unit 12f, a judgment result data memory unit 12g, and a display data memory unit 12h.

[0025] The learning support processing program 12a stores a system program that controls the overall operation of the learning support device 10, a program for communicating with an external electronic device via the communication unit 15, and a program for executing learning functions according to the learning content data stored in the learning content storage unit 12c together with the voice recognition processing program 12b.

[0026] The learning content storage unit 12c stores learning content data such as pronunciation lesson data 12c1, response lesson data 12c2, and the like.

[0027] The pronunciation lesson data 12c1 has, for example, text data and audio data corresponding to words and sentences that serve as model pronunciation lessons, and has the function of displaying the text data of the words or sentences on the display unit 17, outputting the audio data from the audio output unit 19, and then analyzing the user's audio data input from the audio input unit 18, and displaying the judgment results such as the quality of pronunciation on the display unit 17.

[0028] The response lesson data 12c2 has, for example, text data and voice data corresponding to the other person who is a model for the response lesson and the user himself / herself, and has a function of displaying the text data of the other person's question, etc. on the display unit 17, outputting the voice data from the voice output unit 19, and then analyzing the user's voice data input from the voice input unit 18 and displaying the judgment result, such as whether the voice was correct or incorrect, on the display unit 17.

[0029] The algorithm for analyzing and determining the user's voice data required for processing the pronunciation lesson data 12c1 and the response lesson data 12c2 is generated based on the specifications and acoustic characteristics of the main microphone 18M and the microphone 21m of the earphone microphone (earphone with microphone) 21, which is an original product of this learning support device 10.

[0030] Therefore, in the pronunciation lessons and conversation lessons, the use of genuine main body microphone 18M or earphone microphone 21, whose recording specifications and acoustic characteristics are known in advance, allows the user's voice data to be analyzed more accurately than when a non-genuine microphone 21m of an earphone microphone (earphone with a microphone) 21 or other external microphone is used, and ultimately allows for a more accurate judgment result to be obtained.

[0031] In addition to the pronunciation lesson data 12c1 and the response lesson data 12c2, the learning content memory unit 12c also stores various learning content data that require the user to read and write text data and listen to model voice data, but do not require the user to input or analyze voice data.

[0032] The main body / earphone microphone setting data storage unit 12d identifies and stores the setting data [main body / earphone microphone], depending on user operation, as to whether the user's voice data is to be input from the main body microphone 18M or from the microphone 21m of the earphone microphone (earphone with microphone) 21.

[0033] The external connection status data storage unit 12e detects the current connection status of the external connection terminal 20 by the CPU 11, and stores the status as a status in which the earphone microphone (earphone with microphone) 21 is connected (microphone-equipped plugged-in status), or a status in which the earphone (earphone without microphone) 22 is connected (microphone-less (speaker) plugged-in status), or a status in which no connection is established (disconnected status; unplugged status).

[0034] The recorded voice data storage unit 12f records and stores user voice data input from the voice input unit 19 by the CPU 11.

[0035] The judgment result data storage unit 12g stores data on the judgment result obtained by analyzing the user's voice data in accordance with the processing by the CPU 11 in accordance with the pronunciation lesson data 12c1 and the response lesson data 12c2.

[0036] The display data storage unit 22h stores display data, for example in a bitmap format, which the CPU 11 causes the display unit 12 to display in response to the operation of the learning support device .

[0037] In the learning support device 10 configured in this manner, the CPU 11 controls the operation of each part of the circuit in accordance with the instructions written in the learning support processing program 12a and the voice recognition processing program 12c, and the software and hardware operate in cooperation to realize a learning support function according to the learning content data (12c), including a switching function between the main body microphone 18M and the earphone microphone 21, as described in the operation explanation below.

[0038] Next, the operation of the learning support device 10 having the above configuration will be described.

[0039] Figure 2 is a diagram showing the correspondence between the current state of audio input / output according to the setting data stored in the main body / earphone microphone setting data storage unit 12d of the learning support device 10 and the external connection status data stored in the external connection status data storage unit 12e, and the state of audio input / output after changing the connection to the external connection terminal 20.

[0040] FIG. 3 is a diagram showing a main unit / earphone microphone setting screen GMs displayed on the display unit 17 in response to a user operation of the learning support device 10. As shown in FIG.

[0041] 3, the main body / earphone microphone setting screen GMs displays an item [Main Body] for setting audio input (recording) to the main body microphone 19M, and an item [Earphone Microphone] for setting to the microphone 21m of the earphone microphone 21, and either the [Main Body] or [Earphone Microphone] item is selected and specified by operating the cursor Cu. At this time, a message urging the user to use a genuine product is displayed on the main body / earphone microphone setting screen GMs, stating "If an earphone microphone is used, it will affect the judgment results, so please use a genuine microphone."

[0042] As shown in FIG. 2, the learning support device 10 of this embodiment has three types of audio input / output modes [A], [B], and [C] when setting data [main unit] for inputting audio data from the main unit microphone 18M is stored in the main unit / earphone microphone setting data storage unit 12d, and has three types of audio input / output modes [D], [E], and [F] when setting data [earphone microphone] for inputting audio data from the earphone microphone 21 is stored.

[0043] Each audio input / output mode [A] to [F] will be explained below.

[0044] Mode [A]: When the setting data is [main unit] and the earphone microphone (earphone with microphone) 21 is connected (plugged in with microphone), the user's voice data is input (recorded) from the main unit microphone 18M, and the voice data to be played is output (played) from the earphone 21s of the earphone microphone 21.

[0045] Mode [B]: When the setting data is [main unit] and the earphone (earphone without microphone) 22 (or external speaker 23) is connected (no microphone (speaker) plugged in), the user's voice data is input (recorded) from the main unit microphone 18M, and the voice data to be played is output (played) from the earphone 22 or the external speaker 23.

[0046] Mode [C]: Setting data [main unit], when nothing is connected (disconnected from any external audio input / output devices; unplugged), the user's voice data is input (recorded) from the main unit microphone 18M, and the voice data to be played is output (played) from the main unit speaker 19S.

[0047] Mode [D]: Setting data [earphone microphone], when the earphone microphone (earphone with microphone) 21 is connected (plugged in with microphone), the user's voice data is input (recorded) from microphone 21m of the earphone microphone 21, and the voice data to be played is output (played) from earphone 21s of the earphone microphone 21.

[0048] Mode [E]: When the setting data is [earphone microphone] and the earphone (earphone without microphone) 22 (or external speaker 23) is connected (no microphone (speaker) plugged in), the user's voice data cannot be input (recorded), and the voice data to be played is output (played) from the earphone 22 or the external speaker 23.

[0049] Mode [F]: When the setting data is [earphone microphone] and nothing is connected (disconnected from any external audio input / output device; unplugged), the user's voice data cannot be input (recorded), and the voice data to be played is output (played) from the main speaker 19S.

[0050] A case where the connection to the external connection terminal 20 is changed in each of the audio input / output modes [A] to [F] will be described.

[0051] FIG. 4 shows an earphone / microphone setting window Wc that is displayed on the display unit 17 when the earphone / microphone 21 is inserted and a connection is established in the learning support device 10 in mode [C] in which audio input (recording) is set to [main unit].

[0052] When the earphone microphone 21 or the earphone 22 (external speaker 23) is unplugged and disconnected from the mode [A] or [B], the mode changes to the mode [C]. At this time, the audio data to be played is switched from being output only to the user from the earphone 21s or the earphone 22 of the earphone microphone 21 to being output (played) from the main speaker 19S, so the output (playback) is temporarily stopped in consideration of the user missing the audio and the impact on the surroundings. In addition, when the user unplugs the earphone microphone 21 or the earphone 22 (external speaker 23) to disconnect, the input (recording) of the user's voice from the main microphone 18M is also temporarily stopped in consideration of discontinuity of the voice uttered by the user.

[0053] When the earphone microphone (earphone with microphone) 21 is inserted and a connection is established in the mode [C], an earphone microphone setting window Wc is displayed on the display unit 17, as shown in Fig. 4. The setting window Wc displays a message inquiring about changing the setting from the main body microphone 18M to the earphone microphone 21, "Do you want to set the microphone setting to the earphone microphone? [Yes / No]", as well as a message encouraging the user to use a genuine product, "If an earphone microphone is used, it will affect the judgment results, so please use a genuine microphone".

[0054] Here, for example, if the earphone microphone 21 that was inserted and connected is an original product, and the user operates the cursor Cu to select and specify [Yes] in the setting window Wc, the mode changes to [D], and the setting data of the main body / earphone microphone setting data storage unit 12d is changed to the setting data for [earphone microphone].

[0055] On the other hand, for example, if the user operates the cursor Cu to select and specify [No] in the setting window Wc because the earphone microphone 21 that was inserted and connected is a non-genuine product, the mode changes to [A], and the setting data stored in the main unit / earphone microphone setting data storage unit 12d remains as [main unit].

[0056] At this time, the audio data to be played back is switched from output from the main body speaker 19S to output (playback) from the earphone 21s of the earphone microphone 21, so the output (playback) is temporarily stopped in consideration of the user missing the audio. Also, as the user inserts the earphone microphone 21 to establish a connection, input (recording) of the user's voice from the earphone microphone 21 or the main body microphone 18M is temporarily stopped in consideration of discontinuities in the voice uttered by the user.

[0057] Also, when the earphone (earphone without microphone) 22 is inserted from the mode [C] and a connection is established, the mode changes to the mode [B]. At this time, the audio data to be played back is simply switched from being output from the main speaker 19S to being output (played) only to the user by the earphone 22, so the output (playback) continues as is, but the output (playback) may be paused in consideration of the user missing audio. Also, when the user inserts the earphone 22 to establish a connection, the input (recording) of the user's voice from the main microphone 18M is paused in consideration of discontinuities in the voice uttered by the user.

[0058] When the earphone microphone 21 is unplugged from the mode [D] to disconnect, the mode changes to the mode [C], and the setting data of the main unit / earphone microphone setting data storage unit 12d is changed to the setting data of [main unit]. At this time, the audio data to be played is switched from being output only to the user from the earphone 21s of the earphone microphone 21 to being output (played) from the main unit speaker 19S, so the output (playback) is paused in consideration of the user missing the sound and the impact on the surroundings. In addition, when the user unplugs the earphone microphone 21 to disconnect, the input (recording) of the user's voice from the main unit microphone 18M is also paused in consideration of discontinuity of the voice uttered by the user.

[0059] When the earphone 22 (external speaker 23) is removed and disconnected from the mode [E], the mode changes to the mode [F]. At this time, the audio data to be played is switched from being output only to the user from the earphone 22 to being output (played) from the main speaker 19S, so the output (playback) is temporarily stopped in the same way as when the mode changes to the mode [C]. Note that input (recording) of the user's voice is no longer possible.

[0060] When the earphone microphone (earphone with microphone) 21 is inserted and a connection is established in the mode [F], a setting window Wc for the earphone microphone is displayed on the display unit 17, as shown in Fig. 4. The setting window Wc displays a message "Do you want to set the microphone to the earphone microphone? [Yes / No]" inquiring whether or not the earphone microphone 21 needs to be set from the main body microphone 18M, as well as a message urging the user to use a genuine product, "If an earphone microphone is used, it will affect the judgment results, so please use a genuine microphone."

[0061] Here, for example, if the earphone microphone 21 that was inserted and connected is an original product, and the user operates the cursor Cu to select and specify [Yes] in the setting window Wc, the mode changes to [D], and the setting data stored in the main body / earphone microphone setting data storage unit 12d remains as [earphone microphone].

[0062] On the other hand, for example, if the user operates the cursor Cu to select [No] in the setting window Wc because the earphone microphone 21 that was inserted and connected is a non-genuine product, the mode changes to [A], and the setting data of the main unit / earphone microphone setting data storage unit 12d is changed to the setting data of [main unit].

[0063] At this time, the audio data to be played back is switched from output from the main body speaker 19S to output (playback) from the earphone 21s of the earphone microphone 21, so the output (playback) is temporarily stopped in the same way as when the mode changes from [C] to [D] or [A]. Also, input (recording) of the user's voice from the earphone microphone 21 or the main body microphone 18M is temporarily stopped.

[0064] Also, when the earphone (earphone without microphone) 22 is inserted and a connection is established in the mode [F], the mode changes to the mode [E]. At this time, the audio data to be played back is simply switched from output from the main body speaker 19S to output (playback) only to the user via the earphone 22, as in the case of changing from mode [C] to mode [B], so the output continues as is, but the output (playback) may be temporarily stopped in consideration of the user missing audio. Note that input (recording) of the user's audio is no longer possible.

[0065] FIG. 5 is a flowchart showing a microphone selection process in response to a user operation of the learning support device 10. As shown in FIG.

[0066] FIG. 6 is a diagram showing an earphone microphone symbol EM and a main microphone symbol BM displayed on a user voice recording screen GR in response to the microphone selection process of the learning support device 10. As shown in FIG.

[0067] For example, in a situation where a user is studying based on the learning content data stored in the learning content memory unit 12c, when the user establishes a connection (inserts) the earphone microphone 21 to the external connection terminal 20 of the audio input unit 18 and the audio output unit 19, the CPU 11 causes the display unit 17 to display the setting window Wc for the earphone microphone, as shown in FIG. 4 (step S1).

[0068] When the setting data in the main body / earphone microphone setting data storage unit 12d is [Main body], if the user selects and specifies the item [Yes] to be set for the earphone microphone in the setting window Wc for the earphone microphone because the earphone microphone 21 inserted into the external connection terminal 20 and established connection is an original product (step S2 (YES)), the CPU 11 changes the setting data stored in the main body / earphone microphone setting data storage unit 12d from [Main body] to [Earphone microphone] and sets the state (mode [D]) in which the user's voice can be input (recorded) from microphone 21m of the earphone microphone 21 (step S3).

[0069] Then, during the learning support process based on the learning content data, the CPU 11 needs to record the voice spoken by the user. For example, when the CPU 11 causes the display unit 17 to display a user voice recording screen GR as shown in FIG. 6, the CPU 11 displays an earphone microphone symbol EM and a recording message "Recording with earphone microphone" me1 on the screen GR, together with a recording time indicator TR, as shown in FIG. 6 (A) (step S4).

[0070] On the other hand, in the setting window Wc for the earphone microphone (see FIG. 4), if the user selects and specifies the item [No] that is not to be set for the earphone microphone because the earphone microphone 21 inserted into the external connection terminal 20 and established connection is a non-genuine product (step S2 (NO)), the CPU 11 keeps the setting data stored in the main unit / earphone microphone setting data storage unit 12d in [main unit] and sets the state (mode [A]) in which the user's voice can be input (recorded) from the main unit microphone 18M (step S5).

[0071] Then, during the learning support process based on the learning content data, the CPU 11 needs to record the voice uttered by the user. For example, when the CPU 11 causes the display unit 17 to display a user voice recording screen GR as shown in FIG. 6, the CPU 11 displays, on the screen GR, a built-in microphone symbol BM and a recording message "Recording with built-in microphone" me2, as shown in FIG. 6 (B), together with a recording time indicator TR (step S6).

[0072] Also, when the setting data of the main body / earphone microphone setting data storage unit 12d is [earphone microphone], when the user establishes a connection (inserts) of the earphone microphone 21 to the external connection terminal 20 of the audio input unit 18 and the audio output unit 19, the CPU 11 displays the setting window Wc for the earphone microphone on the display unit 17, as shown in FIG. 4 (step S1).

[0073] In the earphone microphone setting window Wc, since the earphone microphone 21 inserted into the external connection terminal 20 and established connection is an original product, when the user selects and specifies the item [Yes] to be set for the earphone microphone (step S2 (YES)), the CPU 11 maintains the setting data stored in the main body / earphone microphone setting data storage unit 12d as [earphone microphone] and sets the state (mode [D]) in which the user's voice can be input (recorded) from the microphone 21m of the earphone microphone 21 (step S3).

[0074] Then, during the learning support process based on the learning content data, the CPU 11 needs to record the voice spoken by the user. For example, when the CPU 11 causes the display unit 17 to display a user voice recording screen GR as shown in FIG. 6, the CPU 11 displays an earphone microphone symbol EM and a recording message "Recording with earphone microphone" me1 on the screen GR, together with a recording time indicator TR, as shown in FIG. 6 (A) (step S4).

[0075] On the other hand, in the earphone microphone setting window Wc (see FIG. 4), if the user selects and specifies that the earphone microphone 21 inserted into the external connection terminal 20 and established connection is a non-genuine product and therefore does not want to set it as an earphone microphone (set it as the main unit microphone) by selecting [No] (step S2 (NO)), the CPU 11 changes the setting data stored in the main unit / earphone microphone setting data storage unit 12d from [earphone microphone] to [main unit], and sets the device in a state (mode [A]) in which the user's voice can be input (recorded) from the main unit microphone 18M (step S5).

[0076] Then, during the learning support process based on the learning content data, the CPU 11 needs to record the voice uttered by the user. For example, when the CPU 11 causes the display unit 17 to display a user voice recording screen GR as shown in FIG. 6, the CPU 11 displays, on the screen GR, a built-in microphone symbol BM and a recording message "Recording with built-in microphone" me2, as shown in FIG. 6 (B), together with a recording time indicator TR (step S6).

[0077] FIG. 7 is a diagram showing an example of the learning support process performed by the learning support device 10 based on the pronunciation lesson data 12c1.

[0078] Here, it is assumed that the main body / earphone microphone setting data (12d) is [main body] and the state is one of the audio input / output modes [A], [B], and [C].

[0079] When pronunciation lesson data 12c1 is selected in a list screen (not shown) of learning content data 12c1, 12c2, ... displayed on display unit 17 in response to a user operation, CPU 11 causes display unit 17 to display a pronunciation lesson initial screen G1 showing the selection options "Judge by word" and "Judge by sentence", as shown in Figure 7 (A).

[0080] When the "Judge by Sentence" item is selected in response to user operation on the pronunciation lesson initial screen G1, the CPU 11 causes the display unit 17 to display a model screen G2 showing the model sentence "Do you like it?" and a pronunciation request message "Please pronounce following the model sentence", as shown in Figure 7 (B), and causes the audio output unit 19 to output (play) audio data of the model pronunciation of the model sentence "Do you like it?"

[0081] When the output (playback) of the model voice data corresponding to the model screen G2 is completed, the CPU 11 causes the display unit 17 to display a user voice recording screen G3 showing a recording message "Recording" as shown in Fig. 7(C), and prompts the user to pronounce the voice in accordance with the model pronunciation. At this time, the main body microphone symbol BM is displayed on the user voice recording screen G3, and the user is notified that recording is currently being performed using the main body microphone 18M.

[0082] When recording of the voice pronounced by the user is completed, the CPU 11 displays a user voice analysis screen G4 showing the analysis in progress message "Analyzing", as shown in Figure 7 (D), and performs voice recognition on the user's voice data recorded in the recorded voice data storage unit 12f. It also analyzes the pronunciation quality, etc. by comparing it with the voice data of the model pronunciation and judges it as a score, and stores the judgement result score in the judgement result data storage unit 12g.

[0083] Then, the CPU 11 causes the display unit 17 to display a pronunciation judgment screen G5 showing the score of the judgment result (e.g., "84 points") stored in the judgment result data storage unit 12g, as shown in Figure 7 (E).

[0084] When [Next Sentence] is selected from among the multiple items displayed on the pronunciation judgment screen G5 in response to a user operation, the CPU 11 causes the display unit 17 to display the next model screen G2, which displays the next model sentence, "Can I take your order?", as well as a pronunciation request message, as shown in Figure 7 (F), and causes the audio data of the model pronunciation to be output (played) from the audio output unit 19.

[0085] In this way, among the learning content data stored in the learning content memory unit 12c, at least the pronunciation lesson data 12c1 and the response lesson data 12c2 require recording and analyzing the voice data pronounced by the user. Therefore, using the genuine main body microphone 18M or earphone microphone 21, whose recording specifications and acoustic characteristics are known in advance, enables more accurate analysis of the user's voice data than using the microphone 21m of a non-genuine earphone microphone (earphone with a microphone) 21 or other external microphones, and ultimately enables more accurate determination results to be obtained.

[0086] For this reason, in the learning support device 10 of this embodiment, when the earphone microphone 21 is inserted into the external connection terminal 20 of the audio input unit 18 and the audio output unit 19 and a connection is established, it is necessary to display a setting window Wc for the earphone microphone so that the voice data spoken by the user can be recorded by an original microphone.

[0087] Therefore, according to the learning support device 10 having the above-described configuration, when the CPU 11 detects that an earphone microphone (earphone with microphone) 21 has been connected (inserted) to the external connection terminal 20 of the audio input unit 18 and the audio output unit 19, it displays on the display unit 17 an earphone microphone setting window Wc that recommends the use of an original microphone and allows the user to specify whether or not to set the earphone microphone 21 as the target for audio input.

[0088] As a result, even when learning in accordance with the learning content (12c) involves listening to audio for learning from the earphone microphone 21, in order to more accurately analyze the user's voice that needs to be input (recorded) and obtain more accurate judgment results, the state can be switched in response to the user's operation to a voice input state from the earphone microphone 21 when the earphone microphone 21 is an original product, and to a voice input state from the main microphone 18M when the earphone microphone 21 is not an original product.

[0089] Furthermore, according to the learning support device 10 having the above-described configuration, when the CPU 11 is inputting (recording) the user's voice from the main body microphone 18M, it displays this fact by displaying the main body microphone symbol BM and the recording message "Recording with main body microphone" me2, and when the CPU 11 is inputting (recording) the user's voice from the earphone microphone 21, it displays this fact by displaying the earphone microphone symbol EM and the recording message "Recording with earphone microphone" me1.

[0090] This makes it easy to know whether the user's voice is being input from main body microphone 18M or earphone microphone 21 in a situation where the user's voice needs to be input (recorded).

[0091] Furthermore, according to the learning support device 10 having the above configuration, regardless of whether the target for audio input is set to the main body microphone 18M or the earphone microphone 21 based on the main body / earphone microphone setting data (12d), when the CPU 11 detects the removal (disconnection) of the earphone microphone 21, earphone 22, or external speaker 23 that is inserted into and connected to the external connection terminal 20 of the audio input unit 18 and audio output unit 19, the CPU 11 can automatically switch the target for audio output from the earphone microphone 21, earphone 22, or external speaker 23 to the main body speaker 19S.

[0092] (Modification) FIG. 8 is a flowchart showing a microphone selection process in response to a user operation of the learning support device 10 according to a modified example.

[0093] In the embodiment, in the microphone selection process in response to user operation described with reference to FIG. 5, regardless of whether the setting data in main unit / earphone microphone setting data storage unit 12d is set to [main unit] or [earphone microphone], when the earphone microphone 21 is connected (inserted) to the external connection terminal 20, the setting window Wc for the earphone microphone shown in FIG. 4 is displayed on the display unit 17, and the user is allowed to select whether or not to set the microphone to the earphone microphone depending on whether the earphone microphone 21 that has been inserted and connected is an original product.

[0094] In contrast, as shown in the microphone selection process in response to user operation of the modified example in FIG. 8, when the earphone microphone 21 is connected (inserted) to the external connection terminal 20, the CPU 11 determines whether the setting data in the main body / earphone microphone setting data storage unit 12d is set to [main body] (step S0), and if it is set to [main body] (step S0 (YES)), as in the above embodiment, the setting window Wc for the earphone microphone shown in FIG. 4 is displayed on the display unit 17, and the user is allowed to select whether or not to set the microphone setting to the earphone microphone depending on whether the earphone microphone 21 that has been inserted and connected is a genuine product (step S1).

[0095] Then, when the setting data of the main body / earphone microphone setting data storage unit 12d is set to [earphone microphone] (step S0 (NO)), the CPU 11 may be configured to maintain the setting data of [earphone microphone] (steps S3, S4) without displaying the setting window Wc for the earphone microphone. In this case, if the earphone microphone 21 that has been inserted and connected is a genuine product, the voice data of the set user can be analyzed more accurately without requiring the user to take the trouble of setting the earphone microphone, and thus a more accurate determination result can be obtained.

[0096] In addition, each of the processing methods by the learning support device 10 described in the above embodiment, i.e., the input / output mode setting and switching process shown in FIG. 2, and the microphone selection process in response to user operation shown in the flowchart of FIG. 5 or FIG. 8, can be distributed by storing it on a recording medium such as a memory card (ROM card, RAM card, etc.), a magnetic disk (floppy (registered trademark) disk, hard disk, etc.), an optical disk (CD-ROM, DVD, etc.), or a semiconductor memory as a program that can be executed by a computer.

[0097] In addition, the program data for realizing each of the above techniques can be transmitted over the communication network N in the form of program code, and by importing this program data into a computer of an electronic device connected to the communication network N via a communication unit, it is possible to realize a learning support function including the microphone switching function described above.

[0098] The present invention is not limited to the above-mentioned embodiment, and various modifications can be made in the implementation stage without departing from the gist of the invention. Furthermore, the above-mentioned embodiment includes inventions at various stages, and various inventions can be extracted by appropriate combinations of the disclosed constituent elements. For example, even if some constituent elements are deleted from all the constituent elements shown in the embodiment, or some constituent elements are combined in a different form, if the problem described in the "Problem to be Solved by the Invention" column can be solved and the effect described in the "Effect of the Invention" column can be obtained, the configuration in which the constituent elements are deleted or combined can be extracted as the invention.

[0099] The invention as originally claimed in the present application is set forth below.

[0100] [Appendix 1] a first audio input unit and a first audio output unit provided in a device body; a control unit that accepts an operation to specify either the first audio input unit or the second audio input unit in response to a connection being established between an external second audio input unit and a device body; A recording device equipped with [Appendix 2] The control unit is when the operation for identifying the first voice input unit is accepted and voice input is executed by the first voice input unit, a first identification indication corresponding to the first voice input unit is displayed on a display unit; when the operation for identifying the second voice input unit is accepted and voice input is executed by the second voice input unit, a second identification indication corresponding to the second voice input unit and different from the first identification indication is displayed on the display unit. 2. A recording device as described in Appendix 1. [Appendix 3] The control unit is when the operation for identifying the first voice input unit is received, regardless of a state in which the second voice input unit is connected to the device body, the device prohibits voice input through the second voice input unit and allows voice input through the first voice input unit. 2. A recording device as described in claim 1 or claim 2. [Appendix 4] The control unit is Regardless of whether the voice input unit specified by the received operation is the first voice input unit or the second voice input unit, accepting an operation to specify either the first audio input unit or the second audio input unit when the second audio input unit changes from a disconnected state to a connected state with the device body; 4. A recording device according to any one of claims 1 to 3. [Appendix 5] The control unit is displaying, on a display unit, a voice input identification unit that allows a user to identify either the first voice input unit or the second voice input unit when the second voice input unit changes from a disconnected state to a connected state with the device body after receiving the operation to identify the first voice input unit; when the second voice input unit changes from a disconnected state to a connected state with the device body after the operation for identifying the second voice input unit is accepted, the voice input identifying unit is not displayed on a display unit. 4. A recording device according to any one of claims 1 to 3. [Appendix 6] The control unit is after receiving the operation to specify either the first audio input unit or the second audio input unit, when an external second audio output unit that has been in a state of connection established with the device body becomes in a state of disconnection from the device body, automatically allowing the first audio output unit to output audio; 6. A recording device according to any one of claims 1 to 5. [Explanation of symbols]

[0101] 10. Learning support devices 11. CPU 12...Storage section 12a…Learning support processing program 12b…Speech recognition processing program 12c…Learning content storage section 12d…Main unit / earphone / microphone setting data storage section 12e...External connection status data storage section 12f…Recorded voice data storage section 12g…Judgment result data storage section 12h: Display data storage section 17...Display section 18 ... Audio input section 18M…Built-in microphone 19 ... Audio output section 19S…Main speaker 20...External connection terminal 21 ... Earphones with microphone (earphones with microphone) 22 ... Earphones (earphones without microphone) 23 ...External speaker GMs…Main unit / earphone / microphone setting screen Wc …Settings window for earphone microphone EM...Earphone microphone symbol BM … Built-in microphone symbol me1…Message during recording with earphone microphone me2...Message being recorded using the built-in microphone.

Claims

1. a first audio input unit and a first audio output unit provided in a device body; a control unit that accepts an operation to specify either the first audio input unit or the second audio input unit in response to a connection being established between an external second audio input unit and a device body; A recording device equipped with

2. The control unit is when the operation for identifying the first voice input unit is accepted and voice input is executed by the first voice input unit, a first identification indication corresponding to the first voice input unit is displayed on a display unit; when the operation for identifying the second voice input unit is accepted and voice input is executed by the second voice input unit, a second identification indication corresponding to the second voice input unit and different from the first identification indication is displayed on the display unit; 2. The recording device according to claim 1.

3. The control unit is when the operation for identifying the first voice input unit is received, regardless of a state in which the second voice input unit is connected to the device body, the input of voice by the second voice input unit is prohibited and the input of voice by the first voice input unit is permitted.

3. The recording device according to claim 1 or 2.

4. The control unit is Regardless of whether the voice input unit specified by the received operation is the first voice input unit or the second voice input unit, accepting an operation to specify either the first audio input unit or the second audio input unit when the second audio input unit changes from a disconnected state to a connected state with the device body; 4. The recording device according to claim 1.

5. The control unit is when the second audio input unit changes from a disconnected state to a connected state with the device body after the operation for identifying the first audio input unit is received, displaying on a display unit an audio input identification unit that allows a user to identify either the first audio input unit or the second audio input unit; when the second voice input unit changes from a disconnected state to a connected state with the device body after the operation for identifying the second voice input unit is accepted, the voice input identifying unit is not displayed on a display unit.

4. The recording device according to claim 1.

6. The control unit is when an external second audio output unit that has been in a state of connection establishment with the device main body becomes in a state of disconnection from the device main body after the operation for identifying either the first audio input unit or the second audio input unit is accepted, automatically allowing the first audio output unit to output audio.

6. The recording device according to claim 1.

Images