Interpretation relay system, terminal, relay device, and apparatus for interpretation relay system

Abstract

We provide an interpretation relay system that allows for easy interpretation. [Solution] The interpretation relay system comprises a first terminal having a PTT key that modulates and transmits an audio signal in response to its activation, a second terminal having an interpretation request key that requests an interpretation of an audio signal, demodulating the audio signal and outputting an audio signal when it receives an audio signal from the first terminal, and transmitting a predetermined identification signal to the relay when the interpretation request key is activated to request an interpretation of an audio signal, and a relay having an interpretation audio storage device that, upon receiving an audio signal from the first terminal, translates the received audio signal from the language of the audio signal to the target language using an interpretation engine, stores it in the interpretation audio storage device, and reads the interpretation audio signal from the interpretation audio storage device and transmits it in response to an identification signal from the second terminal. The second terminal demodulates the interpretation audio signal and outputs an audio signal when it receives an interpretation audio signal from the relay.

Description

Technical Field

[0001] The present invention relates to an interpretation relay system for performing interpretation between different languages, a terminal device for the interpretation relay system, and a relay device for the interpretation relay system.

Background Art

[0002] A method and apparatus for providing an interpretation function that can provide an interpretation function using earphones are invented in Patent Document 1.

[0003] The method and apparatus for providing an interpretation function according to the conventional example invented in the Patent Document 1 are (A) An interpretation function providing method executed by an electronic device, (B) A step of receiving an application execution signal generated in a first earphone device or a second earphone device forming an earphone pair with the first earphone device, (C) A step of executing an application corresponding to the received application execution signal, (D) A step of providing an interpretation function into another language for the voice received through one of the first earphone device and the second earphone device according to the control of the executed application, and (E) A step of transmitting the result translated into the other language to the other one of the first earphone device and the second earphone device (F) The first earphone device and the second earphone device constitute an earphone pair worn on the left and right ears, (G) The step of providing the interpretation function includes converting the voice of the first language input through the first earphone device and received by the electronic device into text of the second language and displaying it on the display of the electronic device, and converting the voice of the second language input through the second earphone device and received by the electronic device into text of the first language and displaying it on the display of the electronic device.

[0004] In the conventional interpretation function providing device configured as described above, interpretation functions can be provided using earsets.

[0005] With the recent increase in foreign workers, Japanese and foreign workers are often working together at construction sites and other locations. When using radios as a means of communication, differences in native languages ​​make accurate communication difficult. Therefore, a useful technology to address this is to route radio calls through a voice translation engine, as in conventional examples, and communicate using automatically translated audio in a specific language. [Prior art documents] [Patent Documents]

[0006] [Patent Document 1] Patent No. 6985113 [Overview of the Initiative] [Problems that the invention aims to solve]

[0007] However, while there are no problems with one-on-one conversations in conventional examples, the following issues arise when using radio communication to connect multiple people, especially when the sender and receiver are a mix of Japanese and foreign nationals.

[0008] (Problem 1) While it is possible to achieve this by equipping the relay with an interpretation engine and translating the relayed audio, interpretation is not necessary between users of the same language, but is necessary between users of multiple languages. Switching between these modes of communication using settings or dialing would result in a significant time lag, making it impractical for urgent wireless calls. (Problem 2) The above problem can be solved by equipping all wireless terminals with an interpretation engine to translate received audio, but this is costly. (Problem 3) If a translation engine is installed in a repeater, it cannot be implemented with incompatible radio equipment (for example, simplex low-power radios or digital simple radios), and if the signal goes through a repeater, multiple frequencies will be occupied for both uplink and downlink. (Issue 4) Simple everyday conversations such as "OK" and "STOP," and brief communication with someone who has learned some of another language, do not require interpretation. If all simple conversations are interpreted, the time lag due to the processing time required for interpretation becomes a problem, especially in cases where communication requires urgency. (Challenge 5) In the case of interpretation only, the audio is machine-generated, making it impossible to identify the sender.

[0009] The object of the present invention is to solve the above problems and provide an interpretation relay system that can turn interpretation on and off extremely easily compared to conventional examples, a terminal for the interpretation relay system, a relay for the interpretation wireless system, and an apparatus for the interpretation relay system. [Means for solving the problem]

[0010] An interpretation relay system according to one aspect of the present invention is: An interpretation relay system in which a first terminal, a second terminal, and a relay device are capable of communicating with each other, The first terminal having at least a PTT key, the first terminal modulating and transmitting an audio signal in response to the PTT key being turned on, The second terminal has at least an interpretation request key for requesting an interpretation of an audio signal, and when it receives an audio signal from the first terminal, it demodulates the audio signal and outputs the audio signal, and when it requests an interpretation of the audio signal, it turns on the interpretation request key to transmit a predetermined identification signal to the relay, A relay having an interpreter voice storage device, when it receives an audio signal from the first terminal, (1) Using an interpretation engine that translates the received audio signal from the language of the audio signal to a predetermined target language, the audio signal is translated into an interpreted audio signal and stored in the interpreted audio storage device, and then, in response to an identification signal from the second terminal, the interpreted audio signal is read from the interpreted audio storage device and transmitted, (2) After converting the received audio signal into text data of the audio signal and storing it in a data storage device, in response to an identification signal from the second terminal, the text data of the audio signal is read from the data storage device, and the read audio signal text data is translated into an interpreted audio signal using an interpreting engine that translates from the language of the audio signal text data to a predetermined target language, and the interpreted audio signal is transmitted. (3) Convert the received audio signal into text data of the audio signal, translate the text data of the audio signal into text data of an interpreted audio signal using an interpreting engine from the language of the text data of the audio signal to a predetermined target language, store it in the data storage device, and then, in response to an identification signal from the second terminal, read the text data of the interpreted audio signal from the data storage device, convert it into the interpreted audio signal, and transmit it. The relay device performs one of the following: When the second terminal receives the translated audio signal from the relay, it demodulates the translated audio signal and outputs the audio signal. [Effects of the Invention]

[0011] Therefore, according to one aspect of the present invention, the interpretation relay system can be turned on and off much more easily than in conventional examples by turning on the interpretation request key. [Brief explanation of the drawing]

[0012] [Figure 1] This is a block diagram showing an example configuration of a wireless interpretation relay system according to an embodiment. [Figure 2] Figure 1 is a block diagram showing an example of the configuration of the wireless device 1. [Figure 3] This is a block diagram showing an example configuration of repeater 2 in Figure 1. [Figure 4] Figure 2 is a flowchart showing the transmission and reception process by wireless device 1. [Figure 5] Figure 3 is a flowchart showing the relay process by repeater 2. [Figure 6] It is a timing chart showing an operation example of the interpreting wireless relay system of FIG. 1. [Figure 7] It is a diagram showing Use Example 1 using the interpreting wireless relay system of FIG. 1, and is a block diagram showing a use example from Japanese to Japanese. [Figure 8] It is a diagram showing Use Example 2 using the interpreting wireless relay system of FIG. 1, and is a block diagram showing a use example from Japanese to foreigner.

Embodiments for Carrying Out the Invention

[0013] Hereinafter, embodiments and modification examples according to the present invention will be described with reference to the drawings. Note that the same or similar components are denoted by the same reference numerals.

[0014] (Findings of the Inventor) As described above, in the conventional example, there were the above problems. As a solution to this, by installing an interpreting engine for each wireless device of the terminal, a language suitable for the user can be set in advance. However in that case, installing an interpreting engine for each wireless device of the terminal increases the cost, and in addition, if the network is not connected, there are restrictions on the interpreting ability and supported languages, so there was a problem that the hurdle for introduction becomes high. To solve these problems, a translation request key is provided in the operation unit of the wireless device, and an interpreting wireless relay system using the translation request key is proposed.

[0015] Note that the wireless devices 1-1 and 1-2 and the repeater 2 are within the line-of-sight range, and it is assumed that the wireless devices 1-1 and 1-2 can communicate without the relay of the repeater 2. Also, the repeater  2 can communicate with the wireless devices 1-1 and 1-2.

[0016] Here, the radio has at least a push-to-talk key (hereinafter referred to as the PTT key) 11 and an interpretation request key 12. The PTT key 11 is used, for example, for normal voice calls between Japanese people, and the interpretation request key 12 is used, for example, for interpreted voice calls from Japanese people to foreigners, and is used for interpreted voice calls that activate the interpretation processing unit 26 of the repeater 2. When the repeater 2 receives a voice call signal from radio 1-1, it generates an interpreted voice in advance using the interpretation processing unit 26 and stores the signal data in the interpreted voice memory 26m. Then, in response to the interpretation request key 12 of radio 1-2 being turned on, it wirelessly transmits an identification radio signal modulated with an identification signal to the repeater 2. In response, the repeater 2 reads the data of the interpreted voice signal from the interpretation voice memory 26m and wirelessly transmits the voice radio signal modulated with the interpreted voice signal to radios 1-1 and 1-2. The identification signal is, for example, data in a predetermined bit sequence or an in-band analog signal of a predetermined frequency.

[0017] (Embodiment) Figure 1 is a block diagram showing an example configuration of a wireless interpretation relay system according to an embodiment. In Figure 1, the wireless interpretation relay system comprises a relay 2, which is a wireless relay unit having an interpretation processing unit 26, and a plurality of wireless devices 1-1, 1-2 (collectively denoted by reference numeral 1) wirelessly connected to the relay 2. Here, each wireless device 1 is equipped with the following PTT key 11 and interpretation request key 12 on its operation unit. (1) PTT key 11: This is the voice transmission key used by radio 1-1 to transmit wirelessly to radio 1-2. (2) Interpretation request key 12: This is a key used by the user of radio 1-2 to request an interpreted audio signal of the audio signal they received immediately before.

[0018] Furthermore, the translation processing unit 26 of the repeater 2 includes, for example, a translation engine unit from Japanese to English, but it may also be a translation engine unit for different languages, from source language A to destination language B, and may be configured to be changeable by user settings. The operation of the wireless translation relay system in Figure 1 will be described in detail later with reference to Figures 6 to 8.

[0019] Figure 2 is a block diagram showing an example configuration of the wireless device 1 in Figure 1.

[0020] In Figure 2, the radio 1 comprises a control unit 10 having a memory 10m for storing settings, a PTT key 11 and an interpreter request key 12 on the operation unit, a microphone 13, an audio signal amplification unit 14, a modulation transmission unit 15, an identification signal generation unit 16, an antenna 17, a circulator 41, a reception demodulation unit 18, an audio signal amplification unit 19, and a speaker 42.

[0021] When radio 1 is transmitting, if the PTT key 11 is turned on, the user's voice input to the microphone 13 is converted into an audio signal and output to the modulation transmission unit 15 via the audio signal amplification unit 14. The control unit 10 modulates a predetermined radio signal according to the input audio signal using a predetermined digital modulation method or a predetermined analog modulation method, amplifies the modulated audio radio signal, and then transmits it from the antenna 17 to the repeater 2 and other radios 1 via the circulator 41. When the PTT key 11 is turned off, the transmission of the audio radio signal is stopped. In response, the repeater 2 performs translation processing on the demodulated audio signal of the received audio radio signal and stores it in the translated audio memory 26m.

[0022] When the radio 1 receives a signal, if a user different from the user who previously transmitted the voice signal (or the same user as the user who previously transmitted the voice signal) requests interpretation, the interpretation request key 12 is turned on, and the control unit 10 controls the identification signal generation unit 16 to generate an identification signal and output it to the modulation transmission unit 15. The control unit 10 modulates a predetermined identification radio signal according to the input identification signal using a predetermined digital modulation method or a predetermined analog modulation method, amplifies the modulated identification radio signal, and then transmits it from the antenna 17 to the repeater 2 via the circulator 41.

[0023] When the repeater 2 receives an identification radio signal from the receiving radio 1, it reads the pre-stored translation voice signal data from the translation voice memory 26m, modulates it, and then transmits the translation voice radio signal to the receiving radio 1.

[0024] Furthermore, the receiving and demodulating unit 18 receives voice radio signals (including interpreter voice radio signals) transmitted from other radios 1 or repeaters 2 via the antenna 17 and circulator 41, demodulates the voice radio signals into voice signals, and outputs them to the speaker 42 via the voice signal amplification unit 19, so that the voice corresponding to the received voice signal is output from the speaker 42.

[0025] Figure 3 is a block diagram showing an example configuration of repeater 2 in Figure 1.

[0026] In Figure 3, the repeater 2 is configured to include a control unit 20 having a memory 20m for storing settings, an antenna 21, a receiving demodulation unit 22, an audio signal amplification unit 23, an identification signal detection unit 24, an interpretation processing unit 26, a modulation transmission unit 27, and an antenna 28. The interpretation processing unit 26 includes an interpretation engine unit that performs interpretation between different languages, for example, from Japanese to English, and an interpretation audio memory (interpretation audio storage device) 26m that stores the interpreted audio signal data. Here, when the received radio signal contains a predetermined identification signal, the interpretation processing unit 26 reads the interpreted audio signal data from the interpretation audio memory 26m and transmits the interpreted audio radio signal to the radio 1.

[0027] In Figure 3, the receiver / demodulator 22 demodulates the audio radio signal received by the antenna 21 into an audio signal and outputs it to the translation processing unit 26 via the audio signal amplification unit 23.

[0028] In the repeater 2, when receiving a voice radio signal, the control unit 20 activates the interpretation processing unit 26. Specifically, the interpretation processing unit 26 interprets (translates) the demodulated voice signal from the received voice radio signal into voice signal data of a predetermined different language and stores it in the interpreted voice memory 26m. Next, when an identification radio signal is received from the radio 1, the data of the interpreted voice signal stored in the interpreted voice memory 26m is read and sent to the modulation transmission unit 27. In response, the modulation transmission unit 27 modulates the radio signal having a predetermined radio frequency according to the input voice signal using a predetermined digital modulation method or a predetermined analog modulation method, amplifies it, and transmits the voice radio signal from the antenna 28 to the other party's radio 1. The data of the interpreted voice signal in the interpreted voice memory 26m is erased when the next voice call is received or after a predetermined time has elapsed, for example, 30 seconds.

[0029] In the repeater 2 described above, antennas 21 and 28 may be shared by connecting the input terminal of the receiving / demodulating unit 22 and the output terminal of the modulation / transmitting unit 27 to the same antenna via a circulator or the like.

[0030] Figure 4 is a flowchart showing the transmission and reception process by the wireless device 1 in Figure 2.

[0031] In step S1 of Figure 4, the initialization process is performed. Specifically, the modulation transmission unit 15 is set to stop transmission, the receiving demodulation unit 18 is set to stop outputting the audio signal because there is no signal received, and the PTT key 11 and the interpreter request key 12 are set to OFF. Next, in step S2, it is determined whether the interpreter request key 12 is ON or OFF. If YES, the process proceeds to step S3; otherwise, the process proceeds to step S6. In step S3, the modulation transmission unit 15 generates an identification radio signal modulated with the identification signal and starts wireless transmission. In step S4, it is determined whether the transmission of the identification radio signal is complete. If YES, the process proceeds to step S5; otherwise, the process returns to step S4. Furthermore, in step S5, the wireless transmission of the identification radio signal is stopped, and the process returns to step S2.

[0032] In step S6, it is determined whether the PTT key 11 is turned on or not. If it is YES, the process proceeds to step S7; otherwise, it proceeds to step S10. In step S7, the modulation transmitter 15 modulates the voice signal and begins wireless transmission. Next, in step S8, it is determined whether the PTT key 11 is turned on or not. If it is YES, the process returns to step S8; otherwise, the process proceeds to step S9. Furthermore, in step S9, the modulation transmitter 15 stops wirelessly transmitting the voice radio signal and returns to step S2.

[0033] In step S10, the receiver / demodulator 18 determines whether or not there is a signal received. If it is YES, the process proceeds to step S11; otherwise, it returns to step S2. In step S11, the receiver / demodulator 18 demodulates the received audio radio signal into an audio signal and outputs it. The receiver / demodulator 18 determines whether or not there is a signal received. If it is YES, the process returns to step S12; otherwise, the process proceeds to step S13. Furthermore, in step S13, the receiver / demodulator 18 stops outputting the audio signal and returns to step S2.

[0034] Figure 5 is a flowchart showing the relay process by repeater 2 in Figure 3.

[0035] In step S21 of Figure 5, initialization processing is performed. Specifically, the modulation transmission unit 27 is set to stop transmission, and the reception demodulation unit 22 is set to no signal. Next, in step S22, it is determined whether or not there is a signal in the reception demodulation unit 22. If it is YES, the process proceeds to step S23; otherwise, the process returns to step S22. In step S23, the identification signal detection unit 24 determines whether or not it has detected a predetermined identification signal from the received signal demodulated by the reception demodulation unit 22. If it is NO, the process proceeds to step S24; otherwise, the process proceeds to step S27. In step S24, the received audio signal is translated into a different predetermined language by the translation engine unit of the translation processing unit 26, and then the data of the translated audio signal is stored in the translated audio memory 26m.

[0036] Next, in step S25, it is determined whether or not there is a signal received by the receiving demodulation unit 22, that is, whether or not the transmitted radio audio signal has finished. If the answer is NO, the process proceeds to step S26; otherwise, it returns to step S25. In step S26, the translation processing unit 26 stops saving the data of the translated audio signal to the translated audio memory 26m and returns to step S22.

[0037] In step S27, the interpreter voice memory 26m outputs the stored interpreter voice signal data, and the modulation transmission unit 27 modulates the interpreter voice signal and transmits it wirelessly. Next, in step S28, it is determined whether the output of the stored interpreter voice signal data is complete. If the answer is YES, the process proceeds to step S29; otherwise, the process returns to step S28. Furthermore, in step S29, the interpreter voice memory 26m stops outputting the stored interpreter voice signal data, the modulation transmission unit 27 stops wirelessly transmitting the interpreter voice wireless signal, and the process returns to step S22.

[0038] Figure 6 is a timing chart showing an example of the operation of the wireless interpreter relay system shown in Figure 1.

[0039] In Figure 6, when the user of radio 1-1 turns on the PTT key 11 and an audio signal is transmitted from radio 1-1, radio 1-2 demodulates and outputs the audio signal. The repeater 2 prepares and stores the data for the translated audio signal by interpreting the received and demodulated audio signal and storing it in the translated audio memory 26m, regardless of the presence or absence of an identification signal. Conversely, when the user of radio 1-2 turns on the interpretation request key 12 and an identification radio signal is transmitted from radio 1-1, the interpretation processing unit 26 in the repeater 2 reads the data for the translated audio signal stored in the translated audio memory 26m, modulates the interpreted audio signal to radio 1-2 along with an interpretation start notification sound, and transmits it wirelessly. Therefore, radio 1-2 can receive the translated audio signal initially accompanied by an interpretation start notification sound from the repeater 2. Note that initially including an interpretation start notification sound is optional.

[0040] Figure 7 is a diagram showing Example 1 of use with the wireless interpretation relay system shown in Figure 1, and is a block diagram illustrating an example of use from Japanese to Japanese.

[0041] In Figure 7, when radio 1-1 transmits with the PTT 11 turned on, the received voice signal is translated and stored in the translated voice memory 26m. However, if the translation request key 12 by the user of radio 1-2 is not turned on within a predetermined time and remains off, the call is completed. On the other hand, the user of radio 1-2 receives the voice signal and outputs it. In this case, the user of radio 1-2 does not need to turn on the translation request key 12 and only receives the untranslated voice signal. Therefore, the voice signal in which Japanese person A says "start work" on radio 1-1 is received by radio 1-2 and output as is, and can be heard and received by Japanese person B. In this case, since both are Japanese, no particular problems occur.

[0042] Figure 8 is a diagram showing example 2 of the use of the wireless interpretation relay system shown in Figure 1, and is a block diagram illustrating an example of use from a Japanese person to a foreigner.

[0043] In Figure 8, when radio 1-1 transmits with the PTT key 11 turned on, the translation processing of repeater 2 is activated, and the data of the translated audio signal, which is the received audio signal, is stored in the translated audio memory 26m. Radio 1-2 receives the direct wave radio audio signal, and the foreigner hears the Japanese voice message "Start work." Subsequently, when the foreigner turns on the translation request key 12, repeater 2 reads the data of the translated audio signal from the translated audio memory 26m and transmits a modulated translated audio radio signal to radios 1-1 and 1-2. Therefore, after the translation voice start notification sound, radio 1-2 receives and outputs the translated audio signal "Get to Work," which is translated from "Start work," and can be heard by the foreigner. At this time, radio 1-1 can also receive and hear the translated audio signal.

[0044] In other words, after Japanese person A says "Start work," the foreigner can turn on the interpretation request key 12 to receive the interpretation audio signal. At this time, the user of radio 1-1 can also hear the interpretation audio signal and recognize that interpretation was needed.

[0045] In the repeater 2 according to the above embodiment, the received audio signal is processed for translation and stored in the translated audio memory 26m, and the stored translated audio signal is transmitted to the radios 1-1 and 1-2 in response to the reception of an identification signal by turning on the translation request key 12.

[0046] In this embodiment, although a repeater 2 is used, simultaneous communication via the repeater is not performed. Therefore, by using the same frequency for both transmission and reception, communication may be possible even with wireless devices that do not support repeater 2.

[0047] According to the above embodiments, the aforementioned problems 1 to 5 can be solved as follows. (Problem 1) Regarding the inconvenience and time lag during switching, since it only requires operating the interpretation request key 12 on radio 1, no switching is necessary. Also, for example, the user's language can be registered on radio 1, and the repeater will automatically select the language based on the identification signal corresponding to the language, so no switching is necessary during operation. (Issue 2) Regarding equipment costs, since only repeater 2 is equipped with the translation engine unit, it is not necessary to install a translation engine unit in each radio 1. (Issue 3) Regarding compatibility with incompatible repeater 2 models, simultaneous relay communication is not performed, so transmission and reception are possible on the same frequency as radio 1. (Task 4) Regarding the option of not needing an interpreter, if an interpreter is not needed, the interpreter will not start unless the interpreter request key 12 is pressed. Furthermore, the recipient can choose whether or not an interpreter is needed. (Issue 5) Regarding the identification of the sender, since the message is received directly in the sender's voice before interpretation, it is possible to identify the sender.

[0048] As explained above, by turning on the PTT key 11, the repeater 2 performs translation processing, and by turning on the translation request key 12, it can automatically transmit the translated audio signal, which can then be received by the radio 1.

[0049] (modified version) For example, by providing multiple interpretation request keys 12 with different target languages ​​and correspondingly providing multiple types of identification signals, a configuration that supports multiple languages ​​can be realized. That is, multiple identification signals corresponding to multiple interpretation languages ​​can be generated, and the system can interpret the multiple identification signals into an interpretation audio signal in one of the multiple target languages.

[0050] Furthermore, the interpreter request key 12 may be used in conjunction with the transmission PTT key 11, and may be used with a different operation than the PTT operation used for transmission (for example, pressing and holding the PTT key 11 for transmission, and pressing the PTT key 11 briefly for interpreter requests). The aforementioned pressing and holding are examples of using a single key to perform different operations or functions (PTT key 11 and interpreter request key 12) depending on the on-time. Different operations may also include pressing the key once in a row within a predetermined time, or pressing it twice in a row within a predetermined time.

[0051] Note that radio units 1-1 and 1-2 may be separate devices (transmitter and receiver), or they may be configured as an integrated transceiver.

[0052] In the embodiments described above, two radios 1 are equipped with a PTT key 11 and an interpreter request key 12. However, the present invention is not limited to this, and at least some of the radios 1 among the multiple radios 1 may not be equipped with an interpreter request key 12. In other words, a radio may be provided without an interpreter request key 12, as needed. Furthermore, a radio 1 equipped with an interpreter request key 12 may be configured without a PTT key 11.

[0053] Furthermore, the repeater 2 may be a system in which multiple repeaters are connected by a wired network (e.g., an IP network) or a wireless network. In other words, the repeater 2 may be a mixture of wireless and wired media.

[0054] In the embodiments described above, a wireless communication medium is used as the transmission medium, but the present invention is not limited to this, and a wired interpretation relay system may be configured using a wired communication medium such as an IP network. In this case, the wireless device becomes a terminal device such as a smartphone or tablet, and the relay device becomes a server device such as a cloud server device. With a wired interpretation relay system using these devices, the PTT key 11 instantly selects voice communication without interpretation, and the interpretation request key 12 selects voice communication with interpretation, enabling smooth communication between parties who speak the same language or different languages. Furthermore, since it is not necessary to install an interpretation engine in all terminal devices, the cost up to implementation can be significantly reduced, lowering the barrier to implementation.

[0055] In other words, two patterns are envisioned for wireless communication routes: (1) using existing wireless devices equipped with the interpretation processing unit 26 (e.g., low-power radios), the case being from terminal A to a repeater and from the repeater to terminal B; and (2) using an IP wireless device (e.g., a wireless application on a smartphone) and a cloud server device equipped with the interpretation processing unit 26, the case being from terminal A to the cloud server device and from the cloud server device to terminal B.

[0056] In the above embodiment, in the processing of the interpretation processing unit 26 in Figure 3, for example, in the case of interpretation from Japanese to English, the following three processes are performed. (Process 1) Perform speech recognition on Japanese audio and convert it into Japanese text. (Process 2) Translate the Japanese text into English text. (Process 3) Convert the English text into English audio signal data using speech synthesis. The interpreter audio memory 26m according to this embodiment stores the audio data after interpretation, and the data stored here is the data after processing (process 3) described above. Although it is actually necessary for each to be stored in a buffer memory, this is omitted in the above description.

[0057] However, the present invention is not limited to this, and in order to reduce the load on the translation engine of the translation processing unit 26, instead of performing all of the processes 1 to 3 immediately, for example, (A) Only the data from Process 1 may be stored in memory, and when an interpretation request is received, the data from Process 1 may be read and Processes 2 and 3 may be executed. (B) Alternatively, only the data from process 2 may be stored in memory, and when an interpretation request is received, the data from process 2 may be read and process 3 may be performed.

[0058] In the above interpretation relay system, (1) A first functional block that performs operations of the first terminal device, such as the transmission operation of the radio 1, (2) A second functional block that performs operations of the second terminal, such as the receiving operation of the radio 1, (3) A third functional block that performs the operation of the repeater 2, A device may be configured with at least one of these functional blocks, or with multiple functional blocks that are different from each other.

[0059] Here, a function block switch may be provided for selecting at least one, or a combination of, the first, second, and third function blocks. In addition, in the device of the translation relay system, means with the same function, such as antennas 17, 21, 28, modulation transmission units 15, 27, reception demodulation units 18, 22, and control units 10, 20, may be shared and selectively switched using the function blocks. [Industrial applicability]

[0060] As detailed above, we can provide an interpretation relay system that allows interpretation to be turned on and off extremely easily compared to conventional examples, a terminal for the interpretation relay system, and a relay device for the interpretation relay system. [Explanation of Symbols]

[0061] 1,1-1,1-2 Radio 2 Repeaters 10 Control Unit 10m memory 11. Push-to-talk key (PTT key) on the control panel 12. Interpretation request key on the control panel 13 Microphone 14. Audio signal amplification section 15 Modulation Transmission Section 16 Identification signal generation unit 17 Antenna 18 Receiving and demodulating section 19 Audio signal amplification section 20 Control Unit 20m memory 21 Antennas 22 Receiving and demodulating section 23 Audio signal amplification section 24 Identification signal detection unit 26 Interpretation Processing Section 26m Interpreter Voice Memory 27 Modulation Transmission Section 28 Antennas 41 Circulator 42 speakers

Claims

1. An interpretation relay system in which a first terminal, a second terminal, and a relay device are capable of communicating with each other, The first terminal having at least a PTT key, the first terminal modulating and transmitting an audio signal in response to the PTT key being turned on, The second terminal has at least an interpretation request key for requesting an interpretation of an audio signal, and when it receives an audio signal from the first terminal, it demodulates the audio signal and outputs the audio signal, and when it requests an interpretation of the audio signal, it turns on the interpretation request key to transmit a predetermined identification signal to the relay, A relay having an interpreter voice storage device, when it receives an audio signal from the first terminal, (1) Translating the received audio signal from the language of the audio signal to a predetermined target language using an interpretation engine and storing it in the interpretation audio storage device, and then reading the interpretation audio signal from the interpretation audio storage device and transmitting it in response to an identification signal from the second terminal, (2) After converting the received audio signal into text data of the audio signal and storing it in a data storage device, in response to an identification signal from the second terminal, the text data of the audio signal is read from the data storage device, and the read audio signal text data is translated into an interpreted audio signal using an interpreting engine that translates from the language of the audio signal text data to a predetermined target language, and the interpreted audio signal is transmitted. (3) Convert the received audio signal into text data of the audio signal, translate the text data of the audio signal into text data of an interpreted audio signal using an interpreting engine from the language of the text data of the audio signal to a predetermined target language, store it in the data storage device, and then, in response to an identification signal from the second terminal, read the text data of the interpreted audio signal from the data storage device, convert it into the interpreted audio signal, and transmit it. The relay device performs one of the following: The second terminal, upon receiving the interpreted audio signal from the relay, demodulates the interpreted audio signal and outputs the audio signal. Interpretation relay system.

2. The first terminal, upon receiving the interpreted audio signal from the relay, demodulates the interpreted audio signal and outputs the audio signal. The interpretation relay system according to claim 1.

3. The first terminal and the second terminal are wireless devices that perform wireless communication. The aforementioned repeater is at least one wireless repeater, or multiple repeaters that combine wireless and wired connections. The aforementioned interpretation relay system is an interpretation wireless relay system. The interpretation relay system according to claim 1.

4. The first terminal and the second terminal are terminals that perform wireless or wired communication, The aforementioned repeater is at least one wireless repeater, or multiple repeaters that combine wireless and wired connections. The interpretation relay system according to claim 1.

5. A terminal for an interpretation relay system according to any one of claims 1 to 4, The first terminal is configured to be able to perform the operation described above. Terminal device.

6. A terminal for an interpretation relay system according to any one of claims 1 to 4, The second terminal is configured to be able to perform the operation described above. Terminal device.

7. A terminal for an interpretation relay system according to any one of claims 1 to 4, The first terminal and the second terminal are configured to be able to perform the operations described above. Terminal device.

8. A relay device for an interpretation relay system according to any one of claims 1 to 4, The repeater is configured to be able to perform the operation of the repeater. Repeater.

9. An apparatus for an interpretation relay system according to any one of claims 1 to 4, A first functional block that performs the operation of the first terminal, A second functional block that performs the operation of the second terminal, A third functional block that performs the operation of the repeater, A device comprising at least one of the functional blocks, or a plurality of functional blocks that are different from each other.

10. The apparatus according to claim 9, further comprising a function block selection switch for selecting at least one or more distinct function blocks from the first function block, the second function block, and the third function block.

Images