Simultaneous interpretation system

Abstract

The present invention relates to a simultaneous interpretation system, and more specifically to a simultaneous interpretation system configured to interpret inputted speech of a first language to generate speech of a second language and text of the second language, and then output the speech and text of the second language through a speaker and a display.

Description

simultaneous interpretation system

[0001] The present invention relates to a simultaneous interpretation system, and more particularly, to a simultaneous interpretation system configured to interpret an input first language voice to generate a second language voice and second language text, and then output the same through a speaker and a display.

[0002]

[0003] Simultaneous interpretation service is a service that converts the content spoken in a first language into a second language and outputs it. This simultaneous interpretation system is configured to translate a sentence spoken by a user into a second language after the user has finished speaking it, and output the sentence in the second language as text or voice.

[0004] Recently, interpretation and translation services using smartphone apps have been provided, providing convenience to users traveling abroad and also relieving the inconvenience of language barriers experienced by those who are not fluent in a foreign language when conversing with foreigners.

[0005] However, when receiving this conventional interpretation service, the user inputs his / her voice through the microphone of the smartphone and the translated voice is output, but when wanting to translate the voice spoken by the other party, he / she has to change the selected language in the menu every time he / she converses and then hand the smartphone to the other party, which is inconvenient.

[0006] Therefore, there is a need to develop a simultaneous interpretation device that allows for natural conversation as if in a real conversation with a foreigner who speaks a different language.

[0007]

[0008] A simultaneous interpretation system according to one embodiment of the present invention aims to solve the above-described problems by achieving the following solutions.

[0009] The purpose is to provide a simultaneous interpretation system that facilitates easy communication between users speaking different languages ​​by utilizing a smart terminal and an interpretation terminal configured to communicate with the smart terminal.

[0010] The problems solved by the present invention are not limited to those mentioned above, and other problems not mentioned can be clearly understood by a person having ordinary knowledge in the relevant technical field from the description below.

[0011]

[0012] A simultaneous interpretation system according to one embodiment of the present invention comprises: a smart terminal having an interpretation application installed thereon and including a first display, a first microphone, a first speaker, and a first control unit; and an interpretation terminal configured to be capable of wireless communication with the smart terminal and including a second display, a second microphone, a second speaker, and a second control unit; wherein a first language and a second language are mutually interpreted between the smart terminal and the interpretation terminal via the interpretation application and transmitted in both directions through the wireless communication.

[0013] When a voice of a first language is input through the first microphone of the smart terminal, it is preferable that characters of a second language interpreted from the first language are output on the second display of the interpretation terminal, or that a voice of a second language interpreted from the first language is output on the second speaker of the interpretation terminal.

[0014] When a voice of a second language is input through the second microphone of the interpretation terminal, it is preferable that the first language interpreted from the second language is output as text on the first display of the smart terminal, or that the voice of the first language interpreted from the second language is output on the first speaker of the smart terminal.

[0015] When a voice in a first language is input into the first microphone of the smart terminal, characters in the first language are output on the first display of the smart terminal, and when a voice in a second language is input into the second microphone of the interpretation terminal, characters in the second language are output on the second display of the interpretation terminal, and it is preferable that the user of the smart terminal and the user of the interpretation terminal can each confirm what they said in characters.

[0016] It is preferable that during a period in which at least one of the first speaker and the second speaker is activated, the first control unit and the second control unit deactivate the first microphone and the second microphone, respectively, so that no sound is input to the first microphone and the second microphone.

[0017] It is preferable that the smart terminal and the interpretation terminal are each provided with a first microphone activation means and a second microphone activation means, and that when the first microphone activation means of the smart terminal is operated, the first microphone of the smart terminal is activated, and when the second microphone activation means of the interpretation terminal is operated, the second microphone of the interpretation terminal is activated.

[0018] It is preferable that the first microphone activation means and the second microphone activation means are configured as buttons that can be input by the user.

[0019]

[0020] *It is preferable that the smart terminal further includes a gyro sensor or an acceleration sensor, and the first microphone activating means is the gyro sensor or the acceleration sensor, and when a user shakes the smart terminal, the first microphone is activated by the first microphone activating means or the second microphone is activated by the second microphone activating means based on at least one of the shaking angle or the number of shakings.

[0021] The first microphone and the second microphone are automatically activated alternately, but when one of the first microphone activating means and the second microphone activating means is operated, it is preferable that the microphone of the terminal in which the microphone activating means is operated is immediately activated regardless of the order in which the first microphone and the second microphone are automatically activated alternately.

[0022] When a voice is input into the microphone of the smart terminal or interpretation terminal, the interpreted voice or text is output to the interpretation terminal or smart terminal, and it is preferable that the microphone of the terminal from which the interpreted voice or text was output last among the smart terminal and the interpretation terminal is automatically activated.

[0023] It is preferable that the time at which the microphone of the terminal output last is automatically activated is, in the case of the smart terminal, the time at which output from the first speaker of the smart terminal ends, and in the case of the interpretation terminal, the time at which output from the second speaker of the interpretation terminal ends.

[0024] When the activation of the first speaker is terminated, the first microphone is automatically activated, and the time at which the first speaker is terminated is calculated by calculating the time at which the data of the first language interpreted in the interpretation application is transmitted to the first control unit of the smart terminal, and it is preferable that voice reception of the first microphone of the smart terminal and the first microphone of the interpretation application are activated simultaneously.

[0025] When the activation of the second speaker is terminated, the second microphone is automatically activated, and the time at which the second speaker is terminated is calculated by calculating the time at which the data of the second language interpreted in the interpretation application is transmitted to the second control unit of the interpretation terminal via wireless communication, and it is preferable that the voice reception of the second microphone of the interpretation terminal and the second microphone of the interpretation application are activated simultaneously.

[0026] When the first microphone of the smart terminal and the second microphone of the interpretation terminal are automatically activated alternately, it is preferable that a microphone activation indication is displayed on the display of the terminal with the activated microphone.

[0027] When the first microphone of the smart terminal and the second microphone of the interpretation terminal are automatically activated alternately, it is preferable that a microphone activation sound is output to the speaker of the terminal with the activated microphone.

[0028] The time for which voice input is possible through the first microphone or the second microphone is set in advance, and it is preferable that the time for which voice input is possible be displayed on the first display or the second display while voice input is in progress through the first microphone or the second microphone.

[0029] If voice input through the microphone of either the smart terminal or the interpretation terminal is interrupted for a preset period of time before the voice input time expires, it is preferable that the microphone of either terminal is automatically deactivated, interpretation of the input voice is executed, and at least one of the interpreted text and voice is output to the other terminal.

[0030] It is preferable that the above voice input possible time be output to at least one of the first display and the second display as a number or figure that decreases in real time as time passes.

[0031] The above interpretation application includes a first interpretation application and a second interpretation application, the first interpretation application mutually interprets a first language and a second language, and the second interpretation application preferably transmits interpretation data generated by the first interpretation application to the interpretation terminal via wireless communication, or receives a second language input from the second microphone via wireless communication and transmits the received interpretation data to the first interpretation application.

[0032] It is preferable that the second interpretation application is run in the background of the first interpretation application, and the first interpretation application mutually interprets the first language and the second language inputted through the microphone of the smart terminal or the interpretation terminal to generate interpretation data, and the second interpretation application mutually transmits the interpretation data of the smart terminal and the interpretation terminal through wireless communication.

[0033] It is preferable that the first interpretation application interprets a first language inputted through a first microphone of the smart terminal into a second language, and the second interpretation application transmits the interpreted data to the interpretation terminal via wireless communication so that the voice of the second language and the text of the second language are output to the second speaker and second display of the interpretation terminal, respectively.

[0034] It is preferable that the second interpretation application transmits the second language inputted by the interpretation terminal through the second microphone to the first interpretation application through the wireless communication, and the first interpretation application interprets the received second language into the first language and outputs the voice and text of the first language to the first speaker and the first display.

[0035] It is preferable that the above interpretation terminal further includes a Wi-Fi module, and that the interpretation application of the smart terminal transmits and receives interpretation data to and from an external server via a Wi-Fi network generated by the interpretation terminal.

[0036] It is preferable that the first interpretation application transmits and receives interpretation data from an external server via the Wi-Fi module of the interpretation terminal, and the second interpretation application transmits and receives interpretation data between the smart terminal and the interpretation terminal via wireless communication.

[0037] It is preferable that the first microphone and the second microphone are activated simultaneously, the terminals from which the first language and the second language are output are each designated in advance, and when the language input in the interpretation application is the first language, the interpretation application interprets the first language into the second language, and the second language is output on the display and speaker of the terminal designated as the terminal from which the second language is output among the smart terminal and the interpretation terminal, and when the language input in the interpretation application is the second language, the interpretation application interprets the second language into the first language, and the first language is output on the display and speaker of the terminal designated as the terminal from which the first language is output among the smart terminal and the interpretation terminal.

[0038] The criteria for executing the above interpretation application is to detect the input language voice first among the first and second languages ​​and execute interpretation of the corresponding language, and it is preferable that the interpreted language be output from the display and speaker of the terminal for which the interpreted language is designated in advance.

[0039] The criteria for executing the above interpretation application is to detect which of the first and second microphones inputs the voice first, execute interpretation of the language generated in the terminal equipped with the microphone into which the voice was input first, and output the interpreted language from the display and speaker of the terminal equipped with the remaining microphone.

[0040] It is preferable that the first microphone and the second microphone be deactivated during the time when the interpreted language is output through the speaker and display of either the smart terminal or the interpretation terminal.

[0041] After the interpreted language is output through the speaker and display of one of the smart terminal and interpretation terminal, it is preferable that the first microphone and the second microphone be reactivated.

[0042] It is preferable that the above smart terminal and interpretation terminal each include a first microphone activating means and a second microphone activating means, and when either of the first microphone activating means and the second microphone activating means is operated, the microphone of the terminal having the operated microphone activating means is activated, and the microphone of the other terminal is deactivated.

[0043] It is preferable that a plurality of the above interpretation terminals are provided, the smart terminal is connected to the plurality of the above interpretation terminals via wireless communication, and the plurality of interpretation terminals each receive input in different languages ​​simultaneously.

[0044] It is preferable that the first language input through the first microphone of the smart terminal is simultaneously interpreted into the second-1 language to the second-N language and then transmitted to the first interpretation terminal to the Nth interpretation terminal, respectively, and that the interpreted text and voice of the second-1 language to the second-N language are output to the first interpretation terminal to the Nth interpretation terminal, respectively.

[0045] When the second language is input through the second microphone of the first interpretation terminal among the first interpretation terminal to the Nth interpretation terminal, the smart terminal preferably interprets the second language into the first language and outputs it to the first display and the first speaker, and the second interpretation terminal to the Nth interpretation terminal, which are the remaining interpretation terminals other than the first interpretation terminal, preferably interpret the second language into the second language to the second language, respectively, and outputs it to the second display and the second speaker provided in each interpretation terminal.

[0046] It is preferable that both the first microphone of the smart terminal and the second microphones of the plurality of interpretation terminals are activated simultaneously, and that while a designated language is input from one of the first microphone and the plurality of second microphones and the interpretation is being performed, the input from the remaining microphones is blocked.

[0047] It is preferable that the wireless communication between the smart terminal and the interpretation terminal is connected to a first audio profile and a second audio profile, respectively, and that the first audio profile is such that a first language input from a microphone of the smart terminal is interpreted into a second language and output through a speaker of the interpretation terminal, and that the second audio profile is such that a second language input from a microphone of the interpretation terminal is interpreted into a first language and output through a speaker of the smart terminal.

[0048] It is preferable that the first audio profile is an A2DP profile, and the second audio profile is an HSP or HFP profile.

[0049] It is preferable that the interpretation terminal further includes a second body equipped with a second display, and a through hole for connection with the second microphone is formed in an area of ​​the second body facing the front of the second display or in the upper surface of the upper part of the second display.

[0050] It is preferable that when a second language character is captured with a camera equipped in the interpretation application of the smart terminal, the character is interpreted and the interpreted first language character is simultaneously output on the display of the smart terminal and the interpretation terminal.

[0051]

[0052] The wearable simultaneous interpretation system according to the present invention is configured so that when one user inputs a voice in a first language through a smart terminal including a first display, the voice and text of a second language interpreted from the first language are output to the speaker and display of the interpretation terminal of the other user, respectively, so that the other user can easily check the interpreted voice and text in real time.

[0053] The effects of the present invention are not limited to those mentioned above, and other effects not mentioned can be clearly understood by a person having ordinary knowledge in the relevant technical field from the description below.

[0054]

[0055] Figure 1 is a conceptual diagram schematically illustrating a simultaneous interpretation system according to the present invention.

[0056] Figure 2 is a block diagram schematically illustrating the detailed configuration of a smart terminal among the configurations of a simultaneous interpretation system according to the present invention.

[0057] Figure 3 is a block diagram schematically illustrating the detailed configuration of an interpretation terminal among the configurations of a simultaneous interpretation system according to the present invention.

[0058] Figure 4 is a conceptual diagram of a simultaneous interpretation system when multiple interpretation terminals are provided.

[0059]

[0060] Hereinafter, a preferred embodiment of the present invention will be described in detail with reference to the attached drawings. Regardless of the drawing numbers, identical or similar components will be given the same reference numbers and redundant descriptions thereof will be omitted.

[0061] Furthermore, when describing the present invention, detailed descriptions of related known technologies will be omitted if they are deemed to obscure the gist of the present invention. Furthermore, it should be noted that the attached drawings are intended solely to facilitate understanding of the spirit of the present invention and should not be construed as limiting the spirit of the present invention.

[0062]

[0063] Hereinafter, a simultaneous interpretation system according to one embodiment of the present invention will be described with reference to FIGS. 1 to 4.

[0064] A simultaneous interpretation system according to one embodiment of the present invention is configured to include a smart terminal (100) and an interpretation terminal (200) as shown in FIG. 1.

[0065] A smart terminal (100) is a device such as a smartphone or tablet PC that has input / output functions, can install various applications as needed, and is configured to communicate with the outside world.

[0066] The smart terminal (100) is equipped with a first display (110), a first microphone (120), a first speaker (130), a first control unit (140), etc. configured to enable touch input as shown in FIG. 2, and an interpretation application is installed in the smart terminal (100).

[0067] The interpretation terminal (200) is configured to enable wireless communication with the smart terminal (100), and is equipped with a second display (210), a second microphone (220), a second speaker (230), and a second control unit (240), as shown in FIG. 3.

[0068] Between the smart terminal (100) and the interpretation terminal (200), the first language and the second language are mutually interpreted and transmitted in both directions through wireless communication via the interpretation application installed on the smart terminal (100).

[0069] Specifically, when a voice of a first language is input into the first microphone (120) of the smart terminal (100), characters of a second language interpreted from the first language are output on the second display (210) of the interpretation terminal (200), or voice of a second language interpreted from the first language is output on the second speaker (230) of the interpretation terminal (200).

[0070] Conversely, when a voice in a second language is input into the second microphone (220) of the interpretation terminal (200), the first language interpreted into the second language is output as text on the first display (110) of the smart terminal (100), or the voice in the first language interpreted into the second language is output on the first speaker (130) of the smart terminal (100).

[0071] In addition, the simultaneous interpretation system according to one embodiment of the present invention has a function that allows the user of the smart terminal (100) and the interpretation terminal (200) to check whether the terminal properly recognized what the user said.

[0072] Specifically, when a voice of a first language is input into the first microphone (120) of the smart terminal (100), characters of the first language are output on the first display (110) of the smart terminal (100), and when a voice of a second language is input into the second microphone (220) of the interpretation terminal (200), characters of the second language are output on the second display (210) of the interpretation terminal (200).

[0073] Meanwhile, if a user of a smart terminal (100) and a user of an interpretation terminal (200) speak at the same time, or if a user inputs a voice through a microphone while an interpreted voice is being output from the speakers of the smart terminal (100) and the interpretation terminal (200), proper interpretation may not be performed in the simultaneous interpretation system.

[0074] In order to overcome these problems, a simultaneous interpretation system according to one embodiment of the present invention can be configured such that while a voice is output to at least one of a first speaker (130) of a smart terminal (100) and a second speaker (230) of an interpretation terminal (200), the first control unit (140) of the smart terminal (!00) deactivates the first microphone (120), and the second control unit (240) of the interpretation terminal (200) deactivates the second microphone (220), so that no sound is input to the first microphone (120) and the second microphone (220).

[0075] In addition, the smart terminal (100) and the interpretation terminal (200) may be equipped with a first microphone activation means (150) and a second microphone activation means (250), respectively, as shown in FIGS. 2 and 3.

[0076] At this time, when the first microphone activation means (150) of the smart terminal (100) is operated, the first microphone (120) of the smart terminal (100) is activated, and when the second microphone activation means (250) of the interpretation terminal (200) is operated, the second microphone (220) of the interpretation terminal (200) is activated.

[0077] Here, the first microphone activation means (150) and the second microphone activation means (250) may be configured as buttons that can be input by the user, and further, if a gyro sensor or an acceleration sensor is provided in the smart terminal (100), the first microphone activation means (150) may be a gyro sensor or an acceleration sensor.

[0078] At this time, when the user shakes the smart terminal (100), it is also possible to activate the first microphone (120) by the gyro sensor or acceleration sensor, and in particular, when the user shakes the smart terminal (100), the first microphone (120) may be activated by the first microphone activation means (150) or the second microphone (220) may be activated by the second microphone activation means (250) based on at least one of the shaking angle or the number of shakings.

[0079] Meanwhile, a simultaneous interpretation system according to one embodiment of the present invention may be configured to automatically activate the first microphone (120) of the smart terminal (100) and the second microphone (220) of the interpretation terminal (200) alternately.

[0080] At this time, when either of the first microphone activation means (150) and the second microphone activation means (250) is operated, the microphone of the terminal in which the microphone activation means is operated can be activated immediately, regardless of the order in which the first microphone (120) and the second microphone (220) are automatically activated alternately.

[0081] In addition, as previously explained, when a voice is input into the microphone of the smart terminal (100) or the interpretation terminal (200), the interpreted voice or text is output to the interpretation terminal (200) or the smart terminal (200). At this time, the microphone of the terminal from which the interpreted voice or text was output last among the smart terminal (100) and the interpretation terminal (200) can be automatically activated.

[0082] In this case, it is preferable that the time at which the microphone of the terminal that was output most recently is automatically activated is, in the case of a smart terminal (100), the time at which output from the first speaker (130) of the smart terminal (100) ends, and in the case of an interpretation terminal (200), the time at which output from the second speaker (230) of the interpretation terminal (200) ends.

[0083] In addition, when the activation of the first speaker (130) is terminated, the first microphone (120) is automatically activated, and the time at which the first speaker (130) is terminated is calculated by the time at which the data of the first language interpreted in the interpretation application is terminated from being transmitted to the first control unit (140) of the smart terminal (100), and at this time, the voice reception of the first microphone (120) of the smart terminal (100) and the first microphone (120) of the interpretation application are simultaneously activated.

[0084] Likewise, when the activation of the second speaker (230) is terminated, the second microphone (220) is automatically activated, but the time at which the second speaker (230) is terminated is calculated and executed by the time at which the data of the second language interpreted in the interpretation application is transmitted to the second control unit (240) of the interpretation terminal (200) via wireless communication. At this time, the voice reception of the second microphone (220) of the interpretation terminal (200) and the second microphone (220) of the interpretation application are simultaneously activated.

[0085] In particular, when the first microphone (120) and the second microphone (220) are automatically activated alternately as described above, a microphone activation indication may be displayed on the display of the terminal with the microphone activated so that users can check which microphone is activated.

[0086] Additionally, when the first microphone (120) of the smart terminal (100) and the second microphone (220) of the interpretation terminal (200) are automatically activated alternately, it is also possible to output a microphone activation sound from the speaker of the terminal in which the microphone is activated.

[0087] In particular, considering that it is difficult to ensure stable operation of the system if the activation time of the microphone is set to unlimited, the time for which voice input is possible through the first microphone (120) or the second microphone (220) can be set in advance.

[0088] At this time, while voice input is in progress through the first microphone (120) or the second microphone (220), the voice input possible time can be displayed on the first display (110) or the second display (210).

[0089] In particular, when voice input through the microphone of either the smart terminal (100) or the interpretation terminal (200) is interrupted for a preset period of time before the voice input time expires, it is preferable that the microphone of either terminal is automatically deactivated and interpretation of the input voice is executed so that at least one of the interpreted text and voice is output to the other terminal.

[0090] Additionally, the voice input possible time may be output as a number or picture that decreases in real time as time passes, on at least one of the first display (110) and the second display (210).

[0091] Meanwhile, as described above, an interpretation application is installed in the smart terminal (100) of the simultaneous interpretation system according to one embodiment of the present invention, and this interpretation application includes a first interpretation application and a second interpretation application.

[0092] The first interpretation application performs a function of mutually interpreting a first language and a second language, and the second interpretation application performs a function of transmitting interpretation data generated by the first interpretation application to an interpretation terminal (200) via wireless communication or receiving a second language input from a second microphone (220) of the interpretation terminal (200) via wireless communication and transmitting the received data to the first interpretation application.

[0093] The second interpretation application is run in the background of the first interpretation application, and the first interpretation application mutually interprets the voices of the first language and the second language inputted into the first microphone (120) of the smart terminal (100) or the second microphone (220) of the interpretation terminal (200) to generate interpretation data, and the second interpretation application is configured to mutually transmit the interpretation data of the smart terminal (100) and the interpretation terminal (200) through wireless communication.

[0094] Specifically, the first interpretation application interprets a first language input into the first microphone (120) of the smart terminal (100) into a second language, and the second interpretation application transmits the interpreted data to the interpretation terminal (200) via wireless communication, so that the voice of the second language and the text of the second language are output to the second speaker (230) and the second display (210) of the interpretation terminal (200), respectively.

[0095] Likewise, the second interpretation application transmits the second language inputted through the second microphone (220) to the first interpretation application via wireless communication, and the first interpretation application interprets the received second language into the first language and outputs the voice and text of the first language to the first speaker (130) and the first display (110).

[0096] In addition, the interpretation terminal (200) may further include a Wi-Fi module (260) capable of establishing a Wi-Fi network as illustrated in FIG. 3, and the interpretation application of the smart terminal (100) may transmit and receive interpretation data to and from an external server through the Wi-Fi network created by the interpretation terminal (100).

[0097] In addition, it is preferable that the first interpretation application installed on the smart terminal (100) transmits and receives interpretation data from an external server through the Wi-Fi module (260) of the interpretation terminal (100), and the second interpretation application transmits and receives interpretation data between the smart terminal (100) and the interpretation terminal (200) through wireless communication.

[0098] Meanwhile, the smart terminal (100) and the interpretation terminal (200) can pre-designate the language to be output, i.e., the language of the user using the terminal, and at this time, the first microphone (120) of the smart terminal (100) and the second microphone (220) of the interpretation terminal (200) can be configured to be activated simultaneously.

[0099] When the language input in the interpretation application is a first language, the interpretation application is configured to interpret the first language into a second language, and the second language is output on the display and speaker of the terminal designated as the terminal that outputs the second language among the smart terminal (100) and the interpretation terminal (200), and when the language input in the interpretation application is a second language, the interpretation application is configured to interpret the second language into a first language, and the first language is output on the display and speaker of the terminal designated as the terminal that outputs the first language among the smart terminal (100) and the interpretation terminal (200).

[0100] In this case, the standard for executing the interpretation application is to detect the input language voice first among the first and second languages ​​and execute interpretation of the corresponding language, and the interpreted language can be configured to be output from the display and speaker of the terminal for which the interpreted language is designated in advance.

[0101] In addition, the standard for executing the interpretation application is to detect which of the first microphone (120) and the second microphone (220) inputs the voice first, and execute the interpretation of the language generated in the terminal equipped with the microphone in which the voice was input first, and output the interpreted language from the display and speaker of the terminal equipped with the remaining microphone.

[0102] At this time, while the interpreted language is output through the speaker and display of either the smart terminal (100) or the interpretation terminal (200), the first microphone (120) and the second microphone (220) are deactivated, and after the interpreted language is output through the speaker and display of either the smart terminal (100) or the interpretation terminal (200), the first microphone (120) and the second microphone (220) are preferably activated again.

[0103] Meanwhile, as described above, the smart terminal (100) and the interpretation terminal (200) may each include a first microphone activation means (150) and a second microphone activation means (250). When either of the first microphone activation means (150) and the second microphone activation means (250) is operated, the microphone of the terminal equipped with the operated microphone activation means may be activated, and the microphone of the other terminal may be deactivated.

[0104] A simultaneous interpretation system according to one embodiment of the present invention may be equipped with a smart terminal (100) and a plurality of interpretation terminals (200) for multiple simultaneous interpretation, and the smart terminal (100) is connected to the plurality of interpretation terminals (200) via wireless communication.

[0105] Figure 4 illustrates a simultaneous interpretation system composed of one smart terminal (100) and three interpretation terminals (200), and the three interpretation terminals (200a, 200b, 200c) are configured to be able to input different languages ​​simultaneously.

[0106] At this time, the first language input into the first microphone (120) of the smart terminal (100) is simultaneously interpreted into the second-first language, the second-second language, and the second-third language, and then transmitted to the first interpretation terminal (200a), the second interpretation terminal (200b), and the third interpretation terminal (200c), and the interpreted text and voice of the second-first language to the second-third language are output to the first interpretation terminal (200a) to the third interpretation terminal (200c), respectively.

[0107] In addition, when the 2-1 language is input into the second microphone (220) of the first interpretation terminal (200a) among the first to third interpretation terminals (200c), the smart terminal (100) may interpret the 2-1 language into the first language and output it to the first display and the first speaker, and the second interpretation terminal (200b) and the third interpretation terminal (200c) may be configured to interpret the 2-1 language into the 2-2 language or the 2-3 language, respectively, and output it to the second display (210) and the second speaker (230) provided in the second interpretation terminal (200b) and the third interpretation terminal (200c), respectively.

[0108] In addition, it is preferable that both the first microphone (120) of the smart terminal (100) and the second microphone (220) of the plurality of interpretation terminals (200a, 200b, 200c) are activated simultaneously, and that the remaining microphones are configured to be blocked from inputting while a designated language is input from one of the first microphone (120) and the plurality of second microphones (220) and interpretation is being performed.

[0109] Meanwhile, wireless communication between the smart terminal (100) and the interpretation terminal (200) can be connected to a first audio profile and a second audio profile, respectively. The first audio profile is a first language input from the first microphone (120) of the smart terminal (100) that is interpreted into a second language and output to the second speaker (230) of the interpretation terminal (200), and the second audio profile is a second language input from the second microphone (220) of the interpretation terminal (200) that is interpreted into the first language and output to the first speaker (130) of the smart terminal (100).

[0110] At this time, it is preferable that the first audio profile is A2DP (Advanced Audio Distribution Profile) and the second audio profile is HSP (headset profile) or HFP (Handsfree profile).

[0111] Meanwhile, the interpretation terminal (200) may further include a second body equipped with a second display (110), and a through hole for connection to a second microphone (220) may be formed in an area of ​​the second body facing the front of the second display (110) or in the upper surface of the top of the second display (110).

[0112] Furthermore, if a second language character is captured with a camera equipped in the interpretation application of the smart terminal (100), the character is interpreted and the interpreted first language character is simultaneously output on the display of the smart terminal (100) and the interpretation terminal (200).

[0113]

[0114] While the present invention has been described in detail using preferred embodiments, the scope of the present invention is not limited to the specific embodiments described above, and should be interpreted in accordance with the appended claims. Furthermore, those skilled in the art will appreciate that numerous modifications and variations are possible without departing from the scope of the present invention.

Claims

1. A smart terminal having an interpretation application installed and including a first display, a first microphone, a first speaker, and a first control unit; and An interpretation terminal configured to enable wireless communication with the smart terminal and including a second display, a second microphone, a second speaker, and a second control unit; Including, A simultaneous interpretation system characterized in that a first language and a second language are mutually interpreted through the interpretation application between the smart terminal and the interpretation terminal and transmitted in both directions through the wireless communication.

2. In claim 1, When the first language voice is input into the first microphone of the above smart terminal, A simultaneous interpretation system characterized in that the characters of the second language interpreted from the first language are output on the second display of the interpretation terminal, or the voice of the second language interpreted from the first language is output on the second speaker of the interpretation terminal.

3. In claim 1, When a second language voice is input through the second microphone of the above interpretation terminal, A simultaneous interpretation system characterized in that a first language interpreted into a second language is output as text on a first display of the smart terminal, or a first language interpreted into a second language is output as voice on a first speaker of the smart terminal.

4. In claim 1, When a voice in a first language is input into the first microphone of the smart terminal, characters in the first language are output on the first display of the smart terminal. When a second language voice is input through the second microphone of the above interpretation terminal, characters of the second language are output on the second display of the above interpretation terminal. A simultaneous interpretation system characterized in that the user of the smart terminal and the user of the interpretation terminal can each confirm what they said in text.

5. In claim 1, A simultaneous interpretation system characterized in that, during a period in which at least one of the first speaker and the second speaker is activated, the first control unit and the second control unit deactivate the first microphone and the second microphone, respectively, so that no sound is input to the first microphone and the second microphone.

6. In claim 1, The above smart terminal and the above interpretation terminal are each provided with a first microphone activation means and a second microphone activation means, When the first microphone activation means of the smart terminal is operated, the first microphone of the smart terminal is activated. A simultaneous interpretation system characterized in that the second microphone of the interpretation terminal is activated when the second microphone activation means of the interpretation terminal is operated.

7. In claim 6, A simultaneous interpretation system characterized in that the first microphone activation means and the second microphone activation means are configured as buttons that can be input by a user.

8. In claim 6, The above smart terminal further includes a gyro sensor or an acceleration sensor, The above first microphone activation means is the gyro sensor or acceleration sensor, A simultaneous interpretation system characterized in that when a user shakes the smart terminal, the first microphone is activated by the first microphone activation means or the second microphone is activated by the second microphone activation means based on at least one of the shaking angle or the number of shakings.

9. In claim 6, The first and second microphones are automatically activated alternately, A simultaneous interpretation system characterized in that when one of the first microphone activating means and the second microphone activating means is operated, the microphone of the terminal in which the microphone activating means is operated is immediately activated regardless of the order in which the first microphone and the second microphone are automatically activated alternately.

10. In claim 6, When voice is input into the microphone of the above smart terminal or interpretation terminal, the interpreted voice or text is output to the interpretation terminal or smart terminal. A simultaneous interpretation system characterized in that the microphone of the terminal from which the interpreted voice or text was last output among the smart terminal and the interpretation terminal is automatically activated.

11. In claim 10, A simultaneous interpretation system characterized in that the time at which the microphone of the terminal that was output most recently is automatically activated is, in the case of the smart terminal, the time at which output from the first speaker of the smart terminal ends, and in the case of the interpretation terminal, the time at which output from the second speaker of the interpretation terminal ends.

12. In claim 11, When the activation of the first speaker is terminated, the first microphone is automatically activated. A simultaneous interpretation system characterized in that the time at which the first speaker ends is calculated by the time at which the data of the first language interpreted in the interpretation application ends being transmitted to the first control unit of the smart terminal, and voice reception of the first microphone of the smart terminal and the first microphone of the interpretation application are simultaneously activated.

13. In claim 11, When the activation of the second speaker is terminated, the second microphone is automatically activated. A simultaneous interpretation system characterized in that the time at which the second speaker ends is calculated by the time at which the data of the second language interpreted in the interpretation application ends being transmitted to the second control unit of the interpretation terminal via wireless communication, and voice reception of the second microphone of the interpretation terminal and the second microphone of the interpretation application are simultaneously activated.

14. In claim 10, A simultaneous interpretation system characterized in that when the first microphone of the smart terminal and the second microphone of the interpretation terminal are automatically activated alternately, a microphone activation indication is output on the display of the terminal whose microphone is activated.

15. In claim 10, A simultaneous interpretation system characterized in that when the first microphone of the smart terminal and the second microphone of the interpretation terminal are automatically activated alternately, a microphone activation sound is output to the speaker of the terminal whose microphone is activated.

16. In claim 1, The time for which voice input is possible through the first or second microphone is preset. A simultaneous interpretation system characterized in that the voice input possible time is displayed on the first display or the second display while voice input is in progress through the first microphone or the second microphone.

17. In claim 16, A simultaneous interpretation system characterized in that, if voice input through the microphone of one of the smart terminal and the interpretation terminal is interrupted for a preset period of time before the voice input time expires, the microphone of one of the terminals is automatically deactivated, interpretation of the input voice is executed, and at least one of the interpreted text and voice is output to the other terminal.

18. In claim 16, A simultaneous interpretation system characterized in that the voice input possible time is output on at least one of the first display and the second display as a number or picture that decreases in real time as time passes.

19. In claim 1, The above interpretation application includes a first interpretation application and a second interpretation application, The above first interpretation application mutually interprets the first language and the second language, A simultaneous interpretation system characterized in that the second interpretation application transmits the interpretation data generated by the first interpretation application to the interpretation terminal via wireless communication, or receives the second language input from the second microphone via wireless communication and transmits it to the first interpretation application.

20. In claim 19, The above second interpretation application runs in the background of the above first interpretation application, The above first interpretation application generates interpretation data by mutually interpreting the first language and the second language inputted through the microphone of the smart terminal or the interpretation terminal, A simultaneous interpretation system characterized in that the second interpretation application transmits interpretation data between the smart terminal and the interpretation terminal through wireless communication.

21. In claim 19, The above first interpretation application interprets a first language inputted through the first microphone of the smart terminal into a second language, A simultaneous interpretation system characterized in that the second interpretation application transmits the interpreted data to the interpretation terminal via wireless communication so that the voice of the second language and the text of the second language are output to the second speaker and second display of the interpretation terminal, respectively.

22. In claim 19, The second interpretation application receives the second language input through the second microphone of the interpretation terminal through the wireless communication and then transmits it to the first interpretation application. A simultaneous interpretation system characterized in that the first interpretation application interprets the received second language into the first language and outputs the voice and text of the first language to the first speaker and the first display.

23. In claim 19, The above interpretation terminal further includes a Wi-Fi module, A simultaneous interpretation system characterized in that the interpretation application of the above smart terminal transmits and receives interpretation data to and from an external server through a Wi-Fi network generated by the above interpretation terminal.

24. In claim 23, The above first interpretation application transmits and receives interpretation data from an external server through the Wi-Fi module of the interpretation terminal, A simultaneous interpretation system characterized in that the second interpretation application transmits and receives interpretation data between the smart terminal and the interpretation terminal via wireless communication.

25. In claim 1, The first microphone and the second microphone are activated simultaneously, and the terminals from which the first language and the second language are output are each pre-designated. If the language input in the above interpretation application is a first language, the interpretation application interprets the first language into a second language, and the second language is output on the display and speaker of the terminal designated as the terminal from which the second language is output among the smart terminal and interpretation terminal. A simultaneous interpretation system characterized in that, when the language input in the interpretation application is a second language, the interpretation application interprets the second language into a first language, and the first language is output on the display and speaker of a terminal designated as a terminal from which the first language is output among the smart terminal and the interpretation terminal.

26. In claim 25, A simultaneous interpretation system characterized in that the standard for executing the above interpretation application is to detect the first input language voice among the first and second languages ​​and execute interpretation of the corresponding language, and the interpreted language is output from the display and speaker of a terminal for which the interpreted language is designated in advance.

27. In claim 25, A simultaneous interpretation system characterized in that the criteria for executing the above interpretation application detects which of the first microphone and the second microphone inputs voice first, executes interpretation of the language generated in the terminal equipped with the microphone into which the voice was input first, and outputs the interpreted language from the display and speaker of the terminal equipped with the remaining microphone.

28. In claim 25, A simultaneous interpretation system characterized in that the first microphone and the second microphone are deactivated during the time when the interpreted language is output through the speaker and display of one of the smart terminal and the interpretation terminal.

29. In claim 25, A simultaneous interpretation system characterized in that the first microphone and the second microphone are reactivated after the interpreted language is output through the speaker and display of one of the smart terminal and the interpretation terminal.

30. In claim 25, The above smart terminal and interpretation terminal each include a first microphone activation means and a second microphone activation means, A simultaneous interpretation system characterized in that when either of the first microphone activating means and the second microphone activating means is operated, the microphone of the terminal equipped with the operated microphone activating means is activated, and the microphone of the other terminal is deactivated.

31. In claim 1, A plurality of the above interpretation terminals are provided, and the smart terminal is connected to the plurality of the above interpretation terminals by wireless communication, A simultaneous interpretation system characterized by having multiple interpretation terminals that simultaneously receive input from different languages.

32. In claim 31, A simultaneous interpretation system characterized in that the first language input through the first microphone of the smart terminal is simultaneously interpreted into the second-1 language to the second-N language and then transmitted to the first interpretation terminal to the Nth interpretation terminal, respectively, and the interpreted text and voice of the second-1 language to the second-N language are output to the first interpretation terminal to the Nth interpretation terminal, respectively.

33. In claim 31, When the second language is input through the second microphone of the first interpretation terminal among the first interpretation terminals to the Nth interpretation terminals, the smart terminal interprets the second language into the first language and outputs it to the first display and the first speaker. A simultaneous interpretation system characterized in that the remaining interpretation terminals, excluding the first interpretation terminal, the second interpretation terminal to the Nth interpretation terminal, interpret the 2-1 language into the 2-2 language to the 2-N language, respectively, and output the result to the second display and second speaker provided in each interpretation terminal.

34. In claim 31, A simultaneous interpretation system characterized in that both the first microphone of the smart terminal and the second microphones of the plurality of interpretation terminals are activated simultaneously, and while a designated language is input from one of the first microphone and the plurality of second microphones and the interpretation is performed, the input from the remaining microphones is blocked.

35. In claim 1, The wireless communication between the above smart terminal and the above interpretation terminal is connected to the first audio profile and the second audio profile, respectively. The above first audio profile is a first language input from the microphone of the smart terminal, which is interpreted into a second language and output through the speaker of the interpretation terminal. The second audio profile is a simultaneous interpretation system characterized in that a second language input from the microphone of the interpretation terminal is interpreted into a first language and output through the speaker of the smart terminal.

36. In claim 35, A simultaneous interpretation system, characterized in that the first audio profile is an A2DP profile and the second audio profile is an HSP or HFP profile.

37. In claim 1, Further comprising a second body equipped with a second display of the above interpretation terminal, A simultaneous interpretation system characterized in that a through hole for connection to the second microphone is formed in an area of ​​the second body facing the front of the second display or in the upper surface of the upper part of the second display.

38. In claim 1, A simultaneous interpretation system characterized in that when a second language character is captured with a camera equipped in the interpretation application of the smart terminal, the character is interpreted and the interpreted first language character is simultaneously output on the display of the smart terminal and the interpretation terminal.

Images