Narrowband transmission line communication system
The communication system converts voice to text for transmission over narrowband lines, addressing bandwidth congestion and distance limitations, ensuring stable and accurate communication.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- ATR ADVANCED TELECOMM RES INST INT
- Filing Date
- 2024-10-02
- Publication Date
- 2026-04-14
AI Technical Summary
Existing communication systems face challenges in maintaining stable and high-precision voice communication over narrowband transmission lines, especially when voice communication and large data transfers like image information are simultaneous or multiple voice communications are concurrent, due to bandwidth congestion and reduced transmission distances.
A communication system utilizing a transmitting device with an audio input unit, speech recognition text acquisition processing, and digital signal communication, and a receiving device with digital signal communication and voice synthesis, converting voice to text data for transmission over narrowband paths, reducing data volume and congestion.
Enables stable and high-precision communication over narrowband transmission lines by reducing data volume, minimizing packet loss, and extending transmission distance, even with simultaneous voice and data transfers or multiple voice communications.
Smart Images

Figure 2026064267000001_ABST
Abstract
Description
[Technical Field]
[0001] This invention relates to communication technology using narrowband transmission lines. [Background technology]
[0002] In recent years, natural disasters such as earthquakes, tsunamis, typhoons, and torrential rains have been increasing worldwide. When a disaster occurs, people in the affected area gather information on the extent of the damage and evacuation plans in order to ensure their own safety, confirm the safety of their family, friends, and acquaintances, and protect their property. Based on the information they gather, they assess the situation and take action.
[0003] For example, this could involve receiving evacuation information transmitted by local governments via disaster prevention radio or other means immediately after a disaster, and then evacuating to a designated shelter.
[0004] Furthermore, disaster response organizations such as local governments, police, fire departments, medical institutions, and the Self-Defense Forces rush to disaster sites in teams, assess the extent of the damage, and carry out rescue and recovery work while communicating with each other as team members. They also promote disaster response in an organized manner by sharing the acquired disaster information both within and outside their organizations. As a result, there is a surge in demand for communication services, including telephones and the internet, in and around disaster areas, leading to network congestion and difficulty in connecting. In addition, disasters can cause communication lines and networks to become inaccessible, resulting in disruptions to communication services provided by telecommunications companies.
[0005] Information and communication devices have been developed that enable the construction of systems that allow for information gathering and sharing even in environments where communication services provided by telecommunications companies are disrupted, such as during disasters (see, for example, Patent Document 1). [Prior art documents] [Patent Documents]
[0006] [Patent Document 1] Japanese Patent Publication No. 2023-157788 [Overview of the Initiative] [Problems that the invention aims to solve]
[0007] Generally, when performing voice communication over an IP network, the VoIP (Voice over IP) method requires a bandwidth of 40kbps or more to be secured for the duration of communication. However, in the methods described in prior art documents, the wireless LAN between the system and the user terminal typically experiences a decrease in transmission speed as the distance between the system and the user terminal increases, making it impossible to obtain the transmission speed necessary for voice communication. Therefore, there is a problem that the transmission distance for voice communication is limited to tens of meters with a typical wireless LAN. Furthermore, as in the technology disclosed in the prior art documents, when image data transfer or other methods are used in conjunction with voice communication, or when multiple voice communications are performed in parallel, the transmission bandwidth becomes congested, further reducing the transmission distance.
[0008] Thus, when voice communication and large data transfers such as image information are performed simultaneously, or when multiple voice communications are performed concurrently using the same transmission path, the transmission bandwidth of the transmission path is exceeded, leading to challenges such as a shortened transmission distance and increased packet loss, which can cause voice communication to be interrupted.
[0009] Therefore, in view of the above problems, the present invention aims to realize a communication system for narrowband transmission lines that can achieve stable and high-precision communication using a narrowband transmission line, even when voice communication and large data transfer such as image information are performed simultaneously, or when multiple voice communications are performed concurrently using the same transmission line. [Means for solving the problem]
[0010] To solve the above problems, a representative example (one aspect) of the invention disclosed in this application is a communication system for a narrowband transmission line that performs communication over a narrowband transmission line, comprising a transmitting device and a receiving device.
[0011] The transmitting device comprises a first communication terminal device and a first narrowband communication device.
[0012] The receiving device is a receiving device that communicates with the transmitting device via a narrowband transmission path, and comprises a second communication terminal device and a second narrowband communication device.
[0013] The first communication terminal device of the transmitting device comprises an audio input unit, an audio recognition text acquisition processing unit, and a first digital signal communication unit.
[0014] The audio input unit is a functional unit that can receive audio signals.
[0015] The speech recognition text acquisition processing unit performs speech recognition processing on the audio signal input to the input unit and acquires text data corresponding to the audio signal.
[0016] The first digital signal communication unit has a communication interface function that enables it to send and receive digital signals, and generates a digital signal for transmission that includes text data acquired by the speech recognition text acquisition processing unit.
[0017] The first narrowband communication device of the transmitting device converts the digital signal for transmission into a communication signal that can be transmitted over a narrowband transmission path, and transmits the converted communication signal to the second narrowband communication device.
[0018] The second narrowband communication device of the receiving device receives the communication signal transmitted from the first narrowband communication device and acquires a signal corresponding to the digital signal for transmission from the communication signal as the received digital signal.
[0019] The second communication terminal device of the receiving device comprises a second digital signal communication unit, a voice synthesis processing unit, and a voice output unit.
[0020] The second digital signal communication unit has a communication interface function that enables it to send and receive digital signals, receives a digital signal, and acquires text data from the received digital signal. [Effects of the Invention]
[0021] According to the present invention, even when voice communication and large data transfers such as image information are performed simultaneously, or when multiple voice communications are performed concurrently using the same transmission path, a communication system for narrowband transmission paths can be realized that achieves stable and high-precision communication using a narrowband transmission path. [Brief explanation of the drawing]
[0022] [Figure 1] A schematic diagram of the narrowband transmission line communication system 1000 according to the first embodiment. [Figure 2] A schematic diagram of the communication terminal device Dev1 (transmitter side) of the narrowband transmission line communication system 1000 according to the first embodiment. [Figure 3] A schematic diagram of the communication terminal device Dev2 (receiving side) of the narrowband transmission line communication system 1000 according to the first embodiment. [Figure 4] A communication sequence diagram of the processing performed in the narrowband transmission line communication system 1000. [Figure 5] A schematic diagram of the narrowband transmission line communication system 2000 according to the second embodiment. [Figure 6] A schematic diagram of the communication terminal device Dev1 (transmitter side) of the narrowband transmission line communication system 2000 according to the second embodiment. [Figure 7] A schematic diagram of the communication terminal device Dev2 (receiving side) of the narrowband transmission line communication system 2000 according to the second embodiment. [Figure 8] A communication sequence diagram of the processing performed by the Narrowband Transmission Line Communication System 2000. [Figure 9] A schematic diagram of the narrowband transmission line communication system 3000 according to the third embodiment. [Figure 10] A schematic diagram of the communication terminal device Dev1 (transmitter side) of the narrowband transmission line communication system 3000 according to the third embodiment. [Figure 11] A schematic diagram of the communication terminal device Dev2 (receiving side) of the narrowband transmission line communication system 3000 according to the third embodiment. [Figure 12] A communication sequence diagram of the processing performed by the narrowband transmission line communication system 3000. [Figure 13] A schematic diagram of the narrowband transmission line communication system 4000 according to the fourth embodiment. [Figure 14] A schematic diagram of the communication terminal device Dev1 (transmitter side) of the narrowband transmission line communication system 4000 according to the third embodiment. [Figure 15] A schematic diagram of the communication terminal device Dev2 (receiving side) of the narrowband transmission line communication system 4000 according to the third embodiment. [Figure 16] A communication sequence diagram of the processing performed by the narrowband transmission line communication system 4000. [Figure 17] This figure schematically shows an example of the display of a communication terminal device when the narrowband transmission line communication systems 2000 and 3000 of the second and third embodiments are combined in the narrowband transmission line communication system 4000. [Figure 18] A schematic diagram of the narrowband transmission line communication system 5000 according to the fifth embodiment. [Figure 19] A schematic diagram of the narrowband transmission line communication system 6000 according to the sixth embodiment. [Figure 20] A schematic diagram of the narrowband transmission line communication system 6000A according to the sixth embodiment. [Figure 21] A schematic diagram of the narrowband transmission line communication system 7000 according to the seventh embodiment. [Figure 22] A schematic diagram of the communication terminal device Dev1D of the narrowband transmission line communication system 7000 according to the seventh embodiment. [Figure 23] A schematic diagram of a narrowband transmission line communication system 7000A according to a modified example of the seventh embodiment. [Figure 24] A schematic configuration diagram of the communication terminal device Dev1Da of the narrowband transmission line communication system 7000A according to a modified example of the seventh embodiment. [Figure 25] A schematic configuration diagram of the communication terminal device Dev2D of the narrowband transmission line communication system 7000A according to a modified example of the seventh embodiment. [Figure 26]A schematic diagram of the communication system 8000 for narrowband transmission lines according to the eighth embodiment. [Figure 27] A schematic diagram of the communication terminal device Dev2E of the narrowband transmission line communication system 8000 according to the seventh embodiment. [Figure 28] A schematic diagram of the narrowband transmission line communication system 9000 according to the ninth embodiment. [Figure 29] A schematic diagram of the communication terminal device Dev1F of the narrowband transmission line communication system 9000 according to the ninth embodiment. [Figure 30] A schematic diagram of the communication terminal device Dev2F of the narrowband transmission line communication system 9000 according to the ninth embodiment. [Figure 31] A schematic diagram of the narrowband transmission line communication system 10000 according to the 10th embodiment. [Figure 32] A schematic configuration diagram of the communication terminal device Dev1G of the narrowband transmission line communication system 10000 according to the 10th embodiment. [Figure 33] A schematic diagram of the communication terminal device Dev2G of the narrowband transmission line communication system 10000 according to the 10th embodiment. [Figure 34] A diagram showing the CPU bus configuration. [Modes for carrying out the invention]
[0023] [First Embodiment] The first embodiment will be described below with reference to the drawings.
[0024] <1.1: Configuration of a communication system for narrowband transmission lines> Figure 1 is a schematic diagram of the narrowband transmission line communication system 1000 according to the first embodiment.
[0025] Figure 2 is a schematic diagram of the communication terminal device Dev1 (transmitter side) of the narrowband transmission line communication system 1000 according to the first embodiment.
[0026] Figure 3 is a schematic diagram of the communication terminal device Dev2 (receiving side) of the narrowband transmission line communication system 1000 according to the first embodiment.
[0027] The narrowband transmission line communication system 1000 is a system that can perform voice communication using a narrowband transmission line, and for example, as shown in Figure 1, it comprises (1) a transmitting device consisting of a communication terminal device Dev1 and a narrowband communication device DevCom1, and (2) a receiving device consisting of a narrowband communication device DevCom2 and a communication terminal device Dev2.
[0028] As shown in Figure 2, the communication terminal device Dev1 comprises an audio input unit 11, an audio recognition text acquisition processing unit 12, and a digital signal communication unit 13.
[0029] The audio input unit 11 receives external audio (for example, the audio of words spoken by a user), performs A / D conversion (analog-to-digital conversion) on the input audio (audio signal Di.audio), and obtains a digital audio signal. The audio input unit 11 then outputs the obtained digital audio signal as data D11 to the speech recognition text acquisition processing unit 12. The audio input unit 11 can be implemented using, for example, a microphone, an A / D converter, etc.
[0030] The speech recognition text acquisition processing unit 12 receives data D11 (digital audio signal) output from the audio input unit 11, performs speech recognition processing on the data D11, acquires character information corresponding to the data D11 (digital audio signal), and executes a process (speech recognition text acquisition process) to acquire text (text data (data obtained by converting an audio signal into text data)) corresponding to the acquired character information. The speech recognition text acquisition processing unit 12 then outputs the text data acquired by the speech recognition text acquisition process as data D12 to the digital signal communication unit 13.
[0031] The digital signal communication unit 13 receives the data D12 output from the speech recognition text acquisition processing unit 12 and generates digital data for transmission (digital signal for transmission) that includes the data D12. The digital signal communication unit 13 then outputs the digital data for transmission generated as described above as data Dtx.digit to the narrowband communication device DevCom1.
[0032] As shown in Figure 1, the narrowband communication device DevCom1 comprises a modulator Dcom11 and a narrowband wireless communication device DCom12.
[0033] Modulator DCom11 receives the digital data Dtx.digit for transmission output from the digital signal communication unit 13 of the communication terminal device Dev1, and modulates the digital data Dtx.digit to obtain an analog signal for transmission (for example, an analog signal that can be transmitted over a telephone line (analog modulated signal)). Modulator DCom11 then outputs the analog signal for transmission obtained above as the analog signal Dtx.analog to the narrowband wireless communication device DCom12. Modulator DCom11 modulates the digital data Dtx.digit for transmission so that the communication speed is a communication speed that can be transmitted over a narrowband transmission line (for example, 40kbps or less) to obtain the analog signal for transmission.
[0034] The narrowband radio transceiver DCom12 receives the transmit analog signal Dtx.analog output from the modulator DCom11, performs RF modulation on the transmit analog signal Dtx.analog, and generates a radio wave signal (wireless communication signal) that can be used for wireless communication. The narrowband radio transceiver DCom12 then radiates the generated radio wave signal (wireless communication signal) into space via a wireless communication antenna (outputs it to a narrowband transmission path) (transmits the generated radio wave signal (wireless communication signal)).
[0035] As shown in Figure 1, the narrowband communication device DevCom2 comprises a narrowband wireless communication device DCom21 and a demodulator Dcom22.
[0036] The narrowband radio transceiver DCom21 receives the radio wave signal (radiation signal) transmitted (radiated) from the transmitting narrowband radio transceiver DCom12 via a radio communication antenna, performs RF demodulation processing on the received radio wave signal (radiation signal), and obtains the RF demodulated signal (a signal equivalent to the transmission analog signal Dtx.analog). Then, the narrowband radio transceiver DCom21 outputs the RF demodulated signal (a signal equivalent to the transmission analog signal Dtx.analog) obtained as described above as the demodulated signal Drx.analog to the demodulator DCom22.
[0037] The demodulator Dcom22 receives the demodulated signal Drx.analog output from the narrowband radio transceiver DCom21, performs demodulation processing on the demodulated signal Drx.analog (the process of demodulating the signal modulated by the modulator DCom11 and returning it to the original signal), and obtains the demodulated digital data Drx.digit (data equivalent to the digital data Dtx.digit for transmission). The demodulator DCom22 then outputs the demodulated digital data Drx.digit obtained through the above process to the communication terminal device Dev2.
[0038] As shown in Figure 3, the communication terminal device Dev2 comprises a digital signal communication unit 21, a voice synthesis processing unit 22, and a voice output unit 23.
[0039] The digital signal communication unit 21 receives the demodulated digital data Drx.digit output from the demodulator DCom22 of the narrowband communication device DevCom2, and acquires (extracts) the transmission digital data (transmission digital signal) contained in the demodulated digital data Drx.digit. The digital signal communication unit 21 then outputs the transmission digital data acquired through the above process (digital data generated by the transmitting communication terminal device Dev1 (text data (data converted from an audio signal to text data))) as data D21 to the speech synthesis processing unit 22.
[0040] The speech synthesis processing unit 22 receives data D21 (text data) output from the digital signal communication unit 21, performs a process to synthesize the text contained in data D21 into an audio signal (speech synthesis process), and obtains an audio signal (audio data) corresponding to the text data of data D21. The speech synthesis processing unit 22 then outputs the audio signal (audio data) obtained by the above process as data D22 to the audio output unit 23.
[0041] The audio output unit 23 receives data D22 (audio signal (audio data)) output from the speech synthesis processing unit 22 and outputs audio based on the data D22 (audio signal) to the outside. For example, the audio output unit 23 is implemented using a speaker, and by driving the speaker with the audio signal (data D22), it outputs audio corresponding to the audio signal (data D22) from the speaker.
[0042] <1.2: Operation of communication systems for narrowband transmission lines> The operation of the narrowband transmission line communication system 1000 configured as described above will be explained below with reference to the diagrams.
[0043] Figure 4 is a communication sequence diagram of the processing performed in the narrowband transmission line communication system 1000.
[0044] The operation of the narrowband transmission line communication system 1000 will be described below with reference to the communication sequence diagram in Figure 4.
[0045] (Step SA1): In step SA1, the transmitting communication terminal device Dev1 executes the call initiation process. Specifically, the communication terminal device Dev1 executes a process to enable external audio (for example, the voice of words spoken by the user) to be input to the audio input unit 11 (a process to activate the function of the audio output unit). For example, the user can launch a predetermined application or program to enable external audio (for example, the voice of words spoken by the user) to be input to the audio input unit 11. Alternatively, the microphone of the audio input unit 11 can be kept in an active state at all times, and the communication terminal device Dev1 executes the call initiation process by acquiring predetermined words spoken by the user (for example, a trigger word) (for example, the user saying "contact, contact") via the microphone.
[0046] (Step SA2): When the call initiation process is executed, the control unit (not shown) that controls each functional part of the communication terminal device Dev1 activates the speech recognition text acquisition processing unit 12 of the communication terminal device Dev1 (making it possible to perform the speech recognition text acquisition process) (step SA2). Then, when the speech recognition text acquisition processing unit 12 is ready to perform the speech recognition text acquisition process, the control unit of the communication terminal device Dev1 notifies the user that recognition has started (a process to inform the user that the speech recognition text acquisition process is ready to be performed (for example, the communication terminal device Dev1 sounds a predetermined sound (for example, a beep), the communication terminal device Dev1 displays a message on its screen indicating that the speech recognition text acquisition process is ready to be performed, etc.)) (step SA2).
[0047] (Step SA3): Then, in step SA3, the following processes (steps SA31 to SA36) are executed.
[0048] (Step SA31): Step SA31 executes the voice data input process. Specifically, the following processes are performed.
[0049] The user utters a predetermined phrase (for example, "I have found a person in need of rescue"), and the audio of that phrase is input to the audio input unit 11 of the communication terminal device Dev1 (input to the audio input unit 11 as data Di.audio). The audio input unit 11 then performs A / D conversion on the input audio (audio signal) to obtain a digital audio signal. The audio input unit 11 then outputs the obtained digital audio signal as data D11 to the speech recognition text acquisition processing unit 12.
[0050] (Step SA32): In step SA32, the speech recognition text acquisition process is executed. Specifically, the following processes are performed.
[0051] The speech recognition text acquisition processing unit 12 of the communication terminal device Dev1 receives data D11 (digital voice signal) output from the voice input unit 11, performs speech recognition processing on the data D11, and acquires character information corresponding to the data D11 (for example, the character information "Person in need of rescue has been found"). The speech recognition text acquisition processing unit 12 then executes a process (speech recognition text acquisition process) to acquire text (text data (data obtained by converting the voice signal into text data)) corresponding to the acquired character information. The speech recognition text acquisition processing unit 12 then outputs the text data acquired by the speech recognition text acquisition process (for example, the text data "Person in need of rescue has been found") as data D12 to the digital signal communication unit 13.
[0052] The digital signal communication unit 13 receives the data D12 output from the speech recognition text acquisition processing unit 12 and generates digital data for transmission (digital signal for transmission) that includes the data D12. The digital signal communication unit 13 then outputs the digital data for transmission generated as described above as data Dtx.digit to the narrowband communication device DevCom1.
[0053] (Step SA33): In step SA33, the text data transmission process is executed. Specifically, the following processes are performed.
[0054] The modulator DCom11 of the transmitting narrowband communication device DevCom1 receives the transmission digital data Dtx.digit output from the digital signal communication unit 13 of the communication terminal device Dev1, and modulates the transmission digital data Dtx.digit to obtain a transmission analog signal (for example, an analog signal that can be transmitted over a telephone line (analog modulated signal)). The modulator DCom11 then outputs the transmission analog signal obtained above as a transmission analog signal Dtx.analog to the narrowband wireless communication device DCom12. The modulator DCom11 modulates the transmission digital data Dtx.digit so that the communication speed is a communication speed that can be communicated over a narrowband transmission line (for example, 40kbps or less) to obtain the transmission analog signal.
[0055] Then, the narrowband radio transceiver DCom12 of the transmitting narrowband communication device DevCom1 receives the transmit analog signal Dtx.analog output from the modulator DCom11, performs RF modulation on the transmit analog signal Dtx.analog, and generates a radio wave signal (wireless communication signal) that can be used for wireless communication.Then, the narrowband radio transceiver DCom12 radiates the generated radio wave signal (wireless communication signal) into space via a wireless communication antenna (outputs it to a narrowband transmission path) (transmits the generated radio wave signal (wireless communication signal)).
[0056] (Step SA34): In step SA34, the text data reception process is executed. Specifically, the following processes are performed.
[0057] The receiving narrowband communication device DevCom2 receives the radio wave signal (wireless communication signal) transmitted (radiated) from the transmitting narrowband wireless communication device DCom12 via a wireless communication antenna, performs RF demodulation processing on the received radio wave signal (wireless communication signal), and obtains the RF demodulated signal (a signal equivalent to the transmitting analog signal Dtx.analog). Then, the narrowband wireless communication device DCom21 outputs the RF demodulated signal (a signal equivalent to the transmitting analog signal Dtx.analog) obtained above as a demodulated signal Drx.analog to the demodulator DCom22.
[0058] The demodulator Dcom22 receives the demodulated signal Drx.analog output from the narrowband radio transmitter DCom21, performs demodulation processing on the demodulated signal Drx.analog (the process of demodulating the signal modulated by the modulator DCom11 and returning it to the original signal), and obtains the demodulated digital data (data equivalent to the digital data Dtx.digit for transmission) Drx.digit. The demodulator DCom22 then outputs the demodulated digital data Drx.digit obtained through the above process to the digital signal communication unit 21 of the communication terminal device Dev2.
[0059] (Step SA35): In step SA35, speech synthesis processing is performed. Specifically, the following processes are performed.
[0060] The digital signal communication unit 21 of the receiving communication terminal device Dev2 receives the demodulated digital data Drx.digit output from the demodulator DCom22 of the narrowband communication device DevCom2, and acquires (extracts) the transmission digital data (transmission digital signal) contained in the demodulated digital data Drx.digit. The digital signal communication unit 21 then outputs the transmission digital data acquired through the above process (digital data generated by the transmitting communication terminal device Dev1 (text data (data obtained by converting an audio signal into text data))) as data D21 to the speech synthesis processing unit 22.
[0061] The speech synthesis processing unit 22 receives data D21 (text data (for example, the text data "A person in need of rescue has been found")) output from the digital signal communication unit 21, performs a process to synthesize the text contained in data D21 into an audio signal (speech synthesis process), and obtains an audio signal (audio data) corresponding to the text data of data D21 (for example, the text data "A person in need of rescue has been found"). The speech synthesis processing unit 22 then outputs the audio signal (audio data) obtained by the above process as data D22 to the audio output unit 23.
[0062] (Step SA36): In step SA36, audio playback processing is performed. Specifically, the following processes are performed.
[0063] The audio output unit 23 of the receiving communication terminal device Dev2 receives data D22 (audio signal (audio data)) output from the voice synthesis processing unit 22 and outputs audio based on said data D22 (audio signal) to the outside. For example, the audio output unit 23 is implemented using a speaker, and by driving the speaker with the audio signal (data D22), it outputs audio corresponding to the audio signal (data D22) from the speaker. As a result, audio corresponding to the audio input to the receiving communication terminal device Dev1 is output from the speaker of the audio output unit 23 (audio is played back).
[0064] In addition, in the narrowband transmission line communication system 1000, the processing in step SA3 may be performed repeatedly.
[0065] (Step SA4): In step SA4, the transmitting communication terminal device Dev1 executes call termination processing. For example, the user terminates a designated application or program, thereby deactivating the state that allows external audio (e.g., the voice of the user speaking) to be input to the voice input unit 11. Alternatively, the voice input unit 11 acquires a designated word spoken by the user (e.g., a trigger word) (e.g., the user saying "end") via the microphone, and the communication terminal device Dev1 executes call termination processing.
[0066] (Step SA5): When the call termination process is executed, the control unit (not shown) that controls each functional part of the communication terminal device Dev1 deactivates the speech recognition text acquisition processing unit 12 of the communication terminal device Dev1 (terminates the speech recognition text acquisition process) (step SA5).
[0067] Summary As described above, in the narrowband transmission line communication system 1000, the transmitting communication terminal device Dev1 converts the voice spoken by the user into text data for speech recognition text acquisition processing, and transmits a wireless communication signal containing this text data from the transmitting narrowband communication device DevCom1 to the receiving narrowband communication device DevCom2. The receiving narrowband communication device DevCom2 then receives the wireless communication signal transmitted from the transmitting narrowband communication device DevCom1, extracts the text data contained in the wireless communication signal, and the extracted text data is synthesized into speech by the receiving communication terminal device Dev2 and played back as speech. In this way, the narrowband transmission line communication system 1000 only needs to transmit and receive text data, which has a dramatically smaller data capacity compared to voice data (because it transmits and receives a wireless communication signal containing text data), so voice communication can be performed using a narrowband transmission line.
[0068] In other words, the narrowband transmission line communication system 1000 can achieve stable, high-precision communication (e.g., voice communication, voice communication accompanied by image transmission) using a narrowband transmission line, even when voice communication and large data transfers such as image information are performed simultaneously, or when multiple voice communications are performed concurrently using the same transmission line. With the narrowband transmission line communication system 1000, it is only necessary to send small amounts of text data (e.g., character data packets) intermittently, so the risk of voice communication being interrupted due to congestion of packets circulating on the transmission line making periodic packet transmission difficult is reduced, thus enabling stable communication. Furthermore, with the narrowband transmission line communication system 1000, by only sending small amounts of text data intermittently, the receiving side can acquire the text data and play back the speech synthesized from that text data. Therefore, voice communication (high-precision voice communication) at a level (accuracy) comparable to normal voice communication can be achieved using a narrowband transmission line with an extremely small amount of data compared to the amount of data required for normal voice communication. Furthermore, in the narrowband transmission line communication system 1000, text data is transmitted from the transmitting side to the receiving side. For example, by recording and verifying this text data at the receiving side, accurate (high-precision) communication can be achieved.
[0069] Here, we will explain the difference in data volume between sending audio data and sending text data.
[0070] ≪1: Regarding voice bandwidth in a VOIP environment≫ First, let's explain the voice bandwidth in a VoIP environment.
[0071] In VoIP environments, G.711 and G.729 are the most commonly used protocols. The amount of digitized audio data for each protocol is 64kbps (G.711) and 8kbps (G.729).
[0072] Furthermore, digitized audio data is typically divided into 20ms segments to fit into IP packets. This means that one second of audio per call ultimately becomes 50 packets (considering latency and transmission efficiency, typical VoIP devices divide the data into IP packets every 20ms).
[0073] Therefore, the size of the audio data per packet can be calculated as follows. (G.711): 64kbps÷50pps(packet per second) = 1,280bit(160byte) / packet (G.729): 8kbps÷50pps(packet per second) = 160bit(20byte) / packet The header size for each layer protocol per packet is as follows (assuming the L2 protocol is Ethernet): 18 byte(Ethernet) + 20 byte(IP) + 8 byte(UDP) + 12 byte(RTP) = 58 byte / packet Adding the audio data size calculated above, we get the following: (G.711): 58 bytes / packet + 160 bytes / packet = 218 bytes / packet (G.729): 58 bytes / packet + 20 bytes / packet = 78 bytes / packet As mentioned above, 50 packets per second are generated per call, so the final audio bandwidth per call is as follows: (G.711): 218 byte / packet × 50 pps(packet per second) = 87.2 kbps / call (G.729): 78 byte / packet ×50 pps(packet per second) = 31.2 kbps / call The above represents the minimum bandwidth required in environments using each codec.
[0074] In actual environments, it is preferable to assume a value with some margin of safety as the minimum required bandwidth, as shown below. (G.711): 100 kbps / call (G.729): 40 kbps / call ≪2: On the speed at which people speak and the length of sentences≫ Next, I will explain the relationship between speaking speed and sentence length.
[0075] The speaking speed that people find easy to listen to is generally said to be around 300 characters per minute. Converted to 5 characters per second, this is 5 characters / second. Assuming that one character is represented by 2 bytes (16 bits), this translates to 80 bits / second for text information. Over one minute, this is 4800 bits / minute.
[0076] Note that the payload during packetization (assuming a TCP overhead of 20 bytes) 18 byte(Ethernet) + 20 byte(IP) + 20 byte(TCP) = 58 byte / packet (Here, text information transfer is TCP-based, and since it's not RTP, we'll use UDP → TCP (overhead of 20 bytes), without RTP.)
[0077] The standard average number of characters per sentence is "30 to 40 characters".
[0078] In that case, the amount of information is, 40 characters × 2 bytes = 80 bytes = 640 bits This is the result.
[0079] If we send the text data by dividing it into sentences, then the sentence interval would be 40 characters / 5 characters / second = 8 seconds.
[0080] Therefore, when sending 640 bits (80 bytes) of data, Overhead 58 bytes + Payload 80 bytes = 138 bytes = 1104 bits This means the packet will be sent every 8 seconds (assuming it can be sent one sentence at a time).
[0081] ≪3: Conclusion≫ From the above, assuming an average of 40 characters and a speech time of 8 seconds, the amount of data transferred, including overhead, would be 138 bytes (1104 bits). Therefore, the transfer rate (required communication speed) is: 1104 bits / 8 sec = 138 bps This is the result.
[0082] If you want to send voice data for the same amount of time (8 seconds) as sending a single sentence, and the voice data transmission speed is 40kbps, then 40kbps × 8 seconds = 320kbit (40kbyte) of data is required.
[0083] Therefore, the ratio of the transfer rate when transferring text data to the transfer rate when transferring audio data is: 138 bps / 40 kbps = 3.45 × 10 -3 Therefore, when using a transfer method that converts data to text, the amount of data transferred can be reduced to (3.45 / 1000) (a reduction of 1 / 250 or less) compared to transferring audio data.
[0084] The narrowband transmission line communication system 1000 employs a transfer method that converts data into text, which drastically reduces the amount of data that needs to be transferred (communication speed) compared to transferring voice data. As a result, even when transferring large amounts of data such as voice communication and image information simultaneously, or when multiple voice communications are performed concurrently using the same transmission line, stable and highly accurate communication (for example, voice communication, voice communication accompanied by image transmission) can be achieved using a narrowband transmission line.
[0085] In the narrowband transmission line communication system 1000, by processing as described above, the requirement to maintain a constant transmission bandwidth of 40kbps for voice communication can be reduced to transmitting approximately 40 bytes in bursts for each sentence (usually around 8 seconds). In other words, the amount of information required for transmission in the same amount of time can be reduced to less than 1 / 250. This makes it possible to extend the transmission distance or increase the amount of information that can be exchanged in parallel using the same transmission line.
[0086] [Second Embodiment] Next, a second embodiment will be described. Parts similar to those in the above embodiment are denoted by the same reference numerals, and detailed descriptions are omitted.
[0087] In the first embodiment of the narrowband transmission line communication system 2000, the transmitting and receiving sides were fixed, but in the second embodiment of the narrowband transmission line communication system 2000, half-duplex communication is possible.
[0088] <2.1: Configuration of a communication system for narrowband transmission lines> Figure 5 is a schematic diagram of the narrowband transmission line communication system 2000 according to the second embodiment.
[0089] Figure 6 is a schematic diagram of the communication terminal device Dev1 (transmitter side) of the narrowband transmission line communication system 2000 according to the second embodiment.
[0090] Figure 7 is a schematic diagram of the communication terminal device Dev2 (receiving side) of the narrowband transmission line communication system 2000 according to the second embodiment.
[0091] The narrowband transmission line communication system 2000 is a system that enables voice communication using a narrowband transmission line in half-duplex communication mode, and for example, as shown in Figure 5, it comprises (1) a communication terminal device Dev1A and a narrowband communication device DevCom1A, and (2) a narrowband communication device DevCom2A and a communication terminal device Dev2A.
[0092] As shown in Figure 6, the communication terminal device Dev1A includes an audio input unit 11, an audio recognition text acquisition processing unit 12, a digital signal communication unit 13A, an audio synthesis processing unit 14, and an audio output unit 15.
[0093] The voice input unit 11 and the voice recognition text acquisition processing unit 12 have the same configuration and functions as the voice input unit 11 and the voice recognition text acquisition processing unit 12 of the communication terminal device Dev1 of the first embodiment.
[0094] The digital signal communication unit 13A can switch between a transmit mode and a receive mode in order to perform half-duplex communication (for example, the transmit mode and receive mode are switched by a control unit (not shown) that controls each functional part of the communication terminal device Dev1A). In transmit mode, the digital signal communication unit 13A receives data D12 output from the speech recognition text acquisition processing unit 12, similar to the digital signal communication unit 13 of the first embodiment, and generates transmit digital data (transmit digital signal) including said data D12. The digital signal communication unit 13A then outputs the transmit digital data generated above as data Dtx.digit to the narrowband communication device DevCom1A.
[0095] In reception mode, the digital signal communication unit 13A receives data D2rx.digit output from the narrowband communication device DevCom1A and acquires (extracts) the digital data for transmission (digital signal for transmission) (data transmitted from the narrowband communication device DevCom2A) contained in data D2rx.digit. The digital signal communication unit 13A then outputs the digital data for transmission (digital data generated by the transmitting communication terminal device Dev2A (text data (data obtained by converting an audio signal into text data))) acquired through the above process as data D13 to the speech synthesis processing unit 14.
[0096] Furthermore, the digital signal communication unit 13A is capable of outputting a control signal to the narrowband communication device DevCom1A for switching between transmission mode and reception mode in order to perform half-duplex communication (for example, the above control signal is included in the data Dtx.digit and output to the narrowband communication device DevCom1A).
[0097] The speech synthesis processing unit 14 receives data D13 (text data) output from the digital signal communication unit 13A, performs a process to synthesize the text contained in data D13 into an audio signal (speech synthesis process), and obtains an audio signal (audio data) corresponding to the text data of data D13. The speech synthesis processing unit 14 then outputs the audio signal (audio data) obtained by the above process as data D14 to the audio output unit 15.
[0098] The audio output unit 15 receives data D14 (audio signal (audio data)) output from the speech synthesis processing unit 14 and outputs audio based on said data D14 (audio signal) to the outside. For example, the audio output unit 15 is implemented using a speaker, and by driving the speaker with the audio signal (data D14), it outputs audio corresponding to the audio signal (data D14) from the speaker.
[0099] As shown in Figure 5, the narrowband communication device DevCom1A comprises a modulator / demodulator Dcom11A and a narrowband wireless communication device DCom12A.
[0100] The modulator / demodulator DCom11A receives the digital data Dtx.digit for transmission output from the digital signal communication unit 13A of the communication terminal device Dev1A, and a control signal for setting the communication mode (this control signal may be included in the data Dtx.digit). (1) When the control signal for setting the communication mode is in the transmission mode, the modulator / demodulator DCom11A sets the communication mode to the transmission mode and modulates the digital data Dtx.digit for transmission output from the digital signal communication unit 13A to obtain an analog signal for transmission (for example, an analog signal that can be transmitted over a telephone line (analog modulated signal)). The modulator / demodulator DCom11A then outputs the analog signal for transmission obtained above as the analog signal Dtx.analog for transmission to the narrowband wireless communication device DCom12. The modulator / demodulator DCom11A modulates the digital data Dtx.digit for transmission so that the communication speed is a communication speed that can be transmitted over a narrowband transmission line (for example, 40kbps or less) to obtain the analog signal for transmission. (2) When the control signal for setting the communication mode is in receive mode, the modulator / demodulator DCom11A sets the communication mode to receive mode, inputs the demodulated signal D2rx.analog output from the narrowband radio transmitter DCom12A, performs demodulation processing on the demodulated signal D2rx.analog (the process of demodulating the signal modulated by the modulator / demodulator DCom22A and returning it to the original signal), and obtains the demodulated digital data (data equivalent to the digital data for transmission D2tx.digit) D2rx.digit. The modulator / demodulator DCom11A then outputs the demodulated digital data D2rx.digit obtained by the above process to the communication terminal device Dev1A.
[0101] The narrowband radio transceiver DCom12A receives the transmit analog signal Dtx.analog output from the modulator / demodulator DCom11A, and a control signal to set the communication mode (this control signal may be input from the communication terminal device Dev1A, or it may be included in the transmit analog signal Dtx.analog). (1) When the control signal for setting the communication mode is in the transmit mode, the narrowband radio transceiver DCom12A sets the communication mode to transmit mode, performs RF modulation on the transmit analog signal Dtx.analog output from the modulator / demodulator DCom11A, and generates a radio wave signal (wireless communication signal) that can be used for wireless communication. The narrowband radio transceiver DCom12A then radiates the generated radio wave signal (wireless communication signal) into space via the wireless communication antenna (outputs it to the narrowband transmission path) (transmits the generated radio wave signal (wireless communication signal)). (2) When the control signal for setting the communication mode is set to receive mode, the narrowband radio transceiver DCom12A sets the communication mode to receive mode, receives the radio wave signal (radiation signal) transmitted (radiated) from the narrowband radio transceiver DCom21A via the radio communication antenna, performs RF demodulation processing on the received radio wave signal (radiation signal), and obtains the RF demodulated signal (a signal corresponding to the transmission analog signal D2tx.analog). The narrowband radio transceiver DCom12A then outputs the RF demodulated signal obtained above (a signal corresponding to the transmission analog signal D2tx.analog) as the demodulated signal D2rx.analog to the modulator / demodulator DCom11A.
[0102] As shown in Figure 5, the narrowband communication device DevCom2A comprises a narrowband wireless communication transceiver DCom21A and a modulator / demodulator Dcom22A.
[0103] The narrowband radio transceiver DCom21A receives the transmit analog signal D2tx.analog output from the modulator / demodulator DCom22A, and a control signal to set the communication mode (this control signal may be input from the communication terminal device Dev2A, or it may be included in the transmit analog signal D2tx.analog). (1) When the control signal for setting the communication mode is in the transmit mode, the narrowband radio transceiver DCom21A sets the communication mode to transmit mode, performs RF modulation on the transmit analog signal D2tx.analog output from the modulator / demodulator DCom22A, and generates a radio wave signal (wireless communication signal) that can be used for wireless communication. The narrowband radio transceiver DCom21A then radiates the generated radio wave signal (wireless communication signal) into space via the wireless communication antenna (outputs it to the narrowband transmission line) (transmits the generated radio wave signal (wireless communication signal)). (2) When the control signal for setting the communication mode is set to receive mode, the narrowband radio transceiver DCom21A sets the communication mode to receive mode, receives the radio wave signal (radiation signal) transmitted (radiated) from the narrowband radio transceiver DCom12A via the radio communication antenna, performs RF demodulation processing on the received radio wave signal (radiation signal), and obtains the RF demodulated signal (a signal equivalent to the transmission analog signal Dtx.analog). The narrowband radio transceiver DCom21A then outputs the RF demodulated signal (a signal equivalent to the transmission analog signal Dtx.analog) obtained as described above as the demodulated signal Drx.analog to the modulator / demodulator DCom22A.
[0104] The modulator / demodulator DCom22A receives the digital data D2tx.digit for transmission output from the digital signal communication unit 21A of the communication terminal device Dev2A, and a control signal for setting the communication mode (this control signal may be included in the data D2tx.digit). (1) When the control signal for setting the communication mode is in the transmission mode, the modulator / demodulator DCom22A sets the communication mode to the transmission mode and modulates the digital data D2tx.digit for transmission output from the digital signal communication unit 21A to obtain an analog signal for transmission (for example, an analog signal that can be transmitted over a telephone line (analog modulated signal)). The modulator / demodulator DCom22A then outputs the analog signal for transmission obtained above as the analog signal D2tx.analog for transmission to the narrowband wireless communication device DCom21A. The modulator / demodulator DCom22A modulates the digital data D2tx.digit for transmission so that the communication speed is a communication speed that can be transmitted over a narrowband transmission line (for example, 40kbps or less) to obtain an analog signal for transmission. (2) When the control signal for setting the communication mode is in receive mode, the modulator / demodulator DCom22A sets the communication mode to receive mode, inputs the demodulated signal Drx.analog output from the narrowband radio transmitter DCom21A, performs demodulation processing on the demodulated signal Drx.analog (the process of demodulating the signal modulated by the modulator / demodulator DCom11A and returning it to the original signal), and obtains the demodulated digital data (data equivalent to the digital data for transmission Dtx.digit) Drx.digit. The modulator / demodulator DCom22A then outputs the demodulated digital data Drx.digit obtained by the above process to the communication terminal device Dev2A.
[0105] As shown in Figure 7, the communication terminal device Dev2A comprises a digital signal communication unit 21A, a speech synthesis processing unit 22, a speech output unit 23, a speech input unit 24, and a speech recognition text acquisition processing unit 25.
[0106] The speech synthesis processing unit 22 and the speech output unit 23 have the same configuration and functions as the speech synthesis processing unit 22 and the speech output unit 23 of the communication terminal device Dev2 of the first embodiment, respectively.
[0107] The digital signal communication unit 21A can switch between transmission mode and reception mode to perform half-duplex communication (for example, the transmission mode and reception mode are switched by a control unit (not shown) that controls each functional part of the communication terminal device Dev2A). In transmission mode, the digital signal communication unit 21A receives data D24 output from the speech recognition text acquisition processing unit 25 and generates digital data for transmission (digital signal for transmission) including the data D24. The digital signal communication unit 21A then outputs the digital data for transmission generated above as data D2tx.digit to the narrowband communication device DevCom2A.
[0108] In reception mode, the digital signal communication unit 21A receives the data Drx.digit output from the narrowband communication device DevCom2A and acquires (extracts) the digital data for transmission (digital signal for transmission) (data transmitted from the narrowband communication device DevCom1A) contained in the data Drx.digit. The digital signal communication unit 21A then outputs the digital data for transmission (digital data generated by the transmitting communication terminal device Dev1A (text data (data obtained by converting an audio signal into text data))) acquired through the above process as data D21 to the speech synthesis processing unit 22.
[0109] Furthermore, the digital signal communication unit 21A is capable of outputting a control signal to the narrowband communication device DevCom2A for switching between transmission mode and reception mode in order to perform half-duplex communication (for example, the above control signal is included in the data D2tx.digit and output to the narrowband communication device DevCom2A).
[0110] The audio input unit 24 receives external audio (for example, the audio of words spoken by a user), performs A / D conversion (analog-to-digital conversion) on the input audio (audio signal D2i.audio), and obtains a digital audio signal. The audio input unit 24 then outputs the obtained digital audio signal as data D23 to the speech recognition text acquisition processing unit 25. The audio input unit 24 can be implemented using, for example, a microphone, an A / D converter, etc.
[0111] The speech recognition text acquisition processing unit 25 receives data D23 (digital audio signal) output from the audio input unit 24, performs speech recognition processing on the data D23, acquires character information corresponding to the data D23 (digital audio signal), and executes a process (speech recognition text acquisition process) to acquire text (text data (data obtained by converting an audio signal into text data)) corresponding to the acquired character information. The speech recognition text acquisition processing unit 25 then outputs the text data acquired by the speech recognition text acquisition process as data D24 to the digital signal communication unit 21A.
[0112] <2.2: Operation of communication systems for narrowband transmission lines> The operation of the narrowband transmission line communication system 2000, configured as described above, will be explained below with reference to the diagrams.
[0113] Figure 8 is a communication sequence diagram of the processes performed by the narrowband transmission line communication system 2000.
[0114] The operation of the narrowband transmission line communication system 2000 will be described below with reference to the communication sequence diagram in Figure 8.
[0115] (Step SB1): In step SB1, the transmitting communication terminal device Dev1A executes the call initiation process. Specifically, the communication terminal device Dev1A executes a process to enable external audio (for example, the audio of words spoken by the user) to be input to the audio input unit 11 (a process to activate the function of the audio output unit). For example, the user can launch a predetermined application or program to enable external audio (for example, the audio of words spoken by the user) to be input to the audio input unit 11. Alternatively, the microphone of the audio input unit 11A is kept in an active state and, by acquiring predetermined words spoken by the user (for example, a trigger word) (for example, the user saying "contact, contact") via the microphone, the communication terminal device Dev1A executes the call initiation process.
[0116] (Step SB2): When the call initiation process is executed, the control unit (not shown) that controls each functional part of the communication terminal device Dev1A activates the speech recognition text acquisition processing unit 12 of the communication terminal device Dev1A (makes it possible to perform the speech recognition text acquisition process) (step SB2). Then, when the speech recognition text acquisition processing unit 12 is ready to perform the speech recognition text acquisition process, the control unit of the communication terminal device Dev1A sends a recognition start notification to the user (a process to inform the user that the speech recognition text acquisition process is ready to perform (for example, the communication terminal device Dev1A sounds a predetermined sound (for example, a beep), the communication terminal device Dev1 displays a message on the display screen indicating that the speech recognition text acquisition process is ready to perform, etc.)) (step SB2).
[0117] Furthermore, the control unit of the communication terminal device Dev1A sets the communication mode to transmit mode and sends (outputs) a control signal from the communication terminal device Dev1A to the narrowband communication device DevCom1A instructing it to set the communication mode to transmit mode. The narrowband communication device DevCom1A then sets the communication mode to transmit mode in accordance with the control signal (step SB2).
[0118] (Step SB3): Then, in step SB3, the following processes (steps SB31 to SB36) are executed.
[0119] (Step SB31): In step SB31, audio data input processing is performed. Specifically, the following processes are executed.
[0120] The user utters a predetermined phrase (for example, "I have found a person in need of rescue"), and the audio of that phrase is input to the audio input unit 11 of the communication terminal device Dev1A (input to the audio input unit 11 as data Di.audio). The audio input unit 11 then performs A / D conversion on the input audio (audio signal) to obtain a digital audio signal. The audio input unit 11 then outputs the obtained digital audio signal as data D11 to the speech recognition text acquisition processing unit 12.
[0121] (Step SB32): In step SB32, the speech recognition text acquisition process is executed. Specifically, the following processes are performed.
[0122] The speech recognition text acquisition processing unit 12 of the communication terminal device Dev1A receives data D11 (digital voice signal) output from the voice input unit 11, performs speech recognition processing on the data D11, and acquires character information corresponding to the data D11 (for example, the character information "Person in need of rescue has been found"). The speech recognition text acquisition processing unit 12 then executes a process (speech recognition text acquisition process) to acquire text (text data (data obtained by converting the voice signal into text data)) corresponding to the acquired character information. The speech recognition text acquisition processing unit 12 then outputs the text data acquired by the speech recognition text acquisition process (for example, the text data "Person in need of rescue has been found") as data D12 to the digital signal communication unit 13A.
[0123] The digital signal communication unit 13A receives the data D12 output from the speech recognition text acquisition processing unit 12 and generates digital data for transmission (digital signal for transmission) that includes the data D12. The digital signal communication unit 13A then outputs the digital data for transmission generated as data Dtx.digit to the narrowband communication device DevCom1A.
[0124] (Step SB33): In step SB33, the text data transmission process is executed. Specifically, the following processes are performed.
[0125] The modulator / demodulator DCom11A of the narrowband communication device DevCom1A receives the digital data Dtx.digit for transmission output from the digital signal communication unit 13 of the communication terminal device Dev1, and modulates the digital data Dtx.digit to obtain an analog signal for transmission (for example, an analog signal that can be transmitted over a telephone line (analog modulated signal)). The modulator / demodulator DCom11A then outputs the analog signal for transmission obtained above as the analog signal Dtx.analog to the narrowband wireless communication device DCom12A. The modulator / demodulator DCom11A modulates the digital data Dtx.digit for transmission so that the communication speed is a communication speed that can be transmitted over a narrowband transmission line (for example, 40kbps or less) to obtain the analog signal for transmission.
[0126] The narrowband radio transceiver DCom12A of the narrowband communication device DevCom1A receives the transmit analog signal Dtx.analog output from the modulator / demodulator DCom11A, performs RF modulation on the transmit analog signal Dtx.analog, and generates a radio wave signal (wireless communication signal) that can be used for wireless communication. The narrowband radio transceiver DCom12A then radiates the generated radio wave signal (wireless communication signal) into space via a wireless communication antenna (outputs it to a narrowband transmission path) (transmits the generated radio wave signal (wireless communication signal)).
[0127] (Step SB34): In step SB34, the text data reception process is executed. Specifically, the following processes are performed.
[0128] The narrowband communication device DevCom2A receives the radio wave signal (radiation signal) transmitted (radiated) from the narrowband wireless communication device DCom12A via a wireless communication antenna, performs RF demodulation processing on the received radio wave signal (radiation signal), and obtains the RF demodulated signal (a signal equivalent to the transmission analog signal Dtx.analog). Then, the narrowband wireless communication device DCom21A outputs the RF demodulated signal obtained above (a signal equivalent to the transmission analog signal Dtx.analog) as the demodulated signal Drx.analog to the modulator / demodulator DCom22A.
[0129] The modulator / demodulator Dcom22A receives the demodulated signal Drx.analog output from the narrowband radio transmitter DCom21A, performs demodulation processing on the demodulated signal Drx.analog (the process of demodulating the signal modulated by the modulator / demodulator DCom11A and returning it to the original signal), and obtains the demodulated digital data Drx.digit (data equivalent to the digital data Dtx.digit for transmission). The modulator / demodulator DCom22A then outputs the demodulated digital data Drx.digit obtained through the above process to the digital signal communication unit 21A of the communication terminal device Dev2A.
[0130] (Step SB35): In step SB35, speech synthesis processing is performed. Specifically, the following processes are executed.
[0131] The digital signal communication unit 21A of the communication terminal device Dev2A receives the demodulated digital data Drx.digit output from the modulator / demodulator DCom22A of the narrowband communication device DevCom2A, and acquires (extracts) the transmission digital data (transmission digital signal) contained in the demodulated digital data Drx.digit. The digital signal communication unit 21 then outputs the transmission digital data acquired through the above process (digital data generated by the transmitting communication terminal device Dev1A (text data (data obtained by converting an audio signal into text data))) as data D21 to the speech synthesis processing unit 22.
[0132] The speech synthesis processing unit 22 receives data D21 (text data (for example, the text data "A person in need of rescue has been found")) output from the digital signal communication unit 21A, performs a process to synthesize the text contained in data D21 into an audio signal (speech synthesis process), and obtains an audio signal (audio data) corresponding to the text data of data D21 (for example, the text data "A person in need of rescue has been found"). The speech synthesis processing unit 22 then outputs the audio signal (audio data) obtained by the above process as data D22 to the audio output unit 23.
[0133] (Step SB36): In step SB36, audio playback processing is performed. Specifically, the following processes are performed.
[0134] The audio output unit 23 of the receiving communication terminal device Dev2A receives data D22 (audio signal (audio data)) output from the voice synthesis processing unit 22 and outputs audio based on said data D22 (audio signal) to the outside. For example, the audio output unit 23 is implemented using a speaker, and by driving the speaker with the audio signal (data D22), it outputs audio corresponding to the audio signal (data D22) from the speaker. As a result, audio corresponding to the audio input to the receiving communication terminal device Dev1A is output from the speaker of the audio output unit 23 (audio is played back).
[0135] In addition, in the narrowband transmission line communication system 1000, the processing in step SB3 may be performed repeatedly.
[0136] (Step SB4): In step SB4, the transmitting communication terminal device Dev1A executes call termination processing. For example, the user may trigger a switch in communication mode from transmission mode to reception mode by executing call notification processing using a predetermined application or program. Alternatively, the voice input unit 11 may acquire a predetermined word spoken by the user (for example, a trigger word) (for example, the user saying "end") via the microphone, causing the communication terminal device Dev1A to execute call termination processing.
[0137] (Step SB5): When the call termination process is executed, the control unit (not shown) that controls each functional part of the communication terminal device Dev1A deactivates the speech recognition text acquisition processing unit 12 of the communication terminal device Dev1A (terminating the speech recognition text acquisition process), notifies the user that the speech recognition process has stopped (recognition termination notification), and sends (outputs) a control signal to the narrowband communication device DevCom1A to switch the communication mode to receive mode, thereby switching the communication mode of the narrowband communication device DevCom1A to receive mode (step SB5).
[0138] (Step SB6): In step SB6, the call response initiation process is executed. Specifically, the following processes are performed:
[0139] In step SB4, the communication terminal device Dev1A performs call termination processing, and data (signals) notifying the termination of this call processing are sent from the communication terminal device Dev1A and the narrowband communication device DevCom1A to the narrowband communication device DevCom2A and the communication terminal device Dev2A (for example, a trigger word indicating termination notification (e.g., "Please," "Call ended," etc.) is notified from the communication terminal device Dev1A and the narrowband communication device DevCom1A to the narrowband communication device DevCom2A and the communication terminal device Dev2A through the same processing as in step SB3). As a result, the communication terminal device Dev2A can determine that the call with communication terminal device Dev1A has ended and that it is ready to switch the communication mode of the communication terminal device Dev2A and the narrowband communication device DevCom2A from receive mode to transmit mode.
[0140] Then, the communication terminal device Dev2A switches the communication mode from receiving mode to transmitting mode and starts the speech recognition text acquisition process (activating the speech recognition text acquisition processing unit). The communication terminal device Dev2A also outputs a control signal to the narrowband communication device DevCom2A instructing it to switch the communication mode from receiving mode to transmitting mode, and the narrowband communication device DevCom2A switches the communication mode from receiving mode to transmitting mode in accordance with the control signal.
[0141] (Step SB71): In step SB71, voice data input processing is performed on the communication terminal device Dev2A. Specifically, the following processes are performed.
[0142] The user utters a predetermined word (for example, the word "understood" or a word indicating acknowledgment), and the sound of that word is input to the audio input unit 24 of the communication terminal device Dev2A (input to the audio input unit 11 as data D2i.audio). The audio input unit 24 then performs A / D conversion on the input sound (audio signal) to obtain a digital audio signal. The audio input unit 24 then outputs the obtained digital audio signal as data D23 to the speech recognition text acquisition processing unit 25.
[0143] (Step SB72): In step SB72, the speech recognition text acquisition process is executed on the communication terminal device Dev2A. Specifically, the following processes are executed.
[0144] The speech recognition text acquisition processing unit 25 of the communication terminal device Dev2A receives data D23 (digital voice signal) output from the voice input unit 24, performs speech recognition processing on the data D23, and acquires character information corresponding to data D11 (digital voice signal) (for example, the character information "understood"). The speech recognition text acquisition processing unit 25 then executes a process (speech recognition text acquisition process) to acquire text (text data (data obtained by converting a voice signal into text data)) corresponding to the acquired character information. The speech recognition text acquisition processing unit 25 then outputs the text data acquired by the speech recognition text acquisition process (for example, the text data of "understood") as data D24 to the digital signal communication unit 21A.
[0145] The digital signal communication unit 21A receives data D24 output from the speech recognition text acquisition processing unit 25 and generates digital data for transmission (digital signal for transmission) that includes the data D24. The digital signal communication unit 21A then outputs the digital data for transmission generated above as data D2tx.digit to the narrowband communication device DevCom2A.
[0146] (Step SB73): In step SB73, the text data transmission process is executed on the communication terminal device Dev2A. Specifically, the following processes are executed.
[0147] The DCom22A modulator / demodulator of the narrowband communication device DevCom2A receives the digital data D2tx.digit for transmission output from the digital signal communication unit 21A of the communication terminal device Dev2A, and modulates the said digital data D2tx.digit to obtain an analog signal for transmission (for example, an analog signal that can be transmitted over a telephone line (analog modulated signal)). The DCom22A modulator / demodulator then outputs the analog signal for transmission obtained above as the analog signal D2tx.analog to the narrowband wireless communication device DCom21A. The DCom22A modulator / demodulator performs modulation on the digital data D2tx.digit for transmission so that the communication speed is a communication speed that can be transmitted over a narrowband transmission line (for example, 40kbps or less), and obtains an analog signal for transmission.
[0148] The narrowband radio transceiver DCom21A of the narrowband communication device DevCom2A receives the transmit analog signal D2tx.analog output from the modulator / demodulator DCom22A, performs RF modulation on the transmit analog signal D2tx.analog, and generates a radio wave signal (wireless communication signal) that can be used for wireless communication. The narrowband radio transceiver DCom21A then radiates the generated radio wave signal (wireless communication signal) into space via a wireless communication antenna (outputs it to a narrowband transmission path) (transmits the generated radio wave signal (wireless communication signal)).
[0149] (Step SB74): In step SB74, the narrowband communication device DevCom1A performs text data reception processing. Specifically, the following processes are performed:
[0150] The narrowband communication device DevCom1A receives the radio wave signal (radiation signal) transmitted (radiated) from the narrowband wireless communication device DCom21A via a wireless communication antenna, performs RF demodulation processing on the received radio wave signal (radiation signal), and obtains the RF demodulated signal (a signal equivalent to the transmission analog signal D2tx.analog). Then, the narrowband wireless communication device DCom12A outputs the RF demodulated signal obtained above (a signal equivalent to the transmission analog signal D2tx.analog) as a demodulated signal D2rx.analog to the modulator / demodulator DCom11A.
[0151] The modulator / demodulator Dcom11A receives the demodulated signal D2rx.analog output from the narrowband radio transmitter DCom12A, performs demodulation processing on the demodulated signal D2rx.analog (the process of demodulating the signal modulated by the modulator / demodulator DCom22A and returning it to the original signal), and obtains the demodulated digital data D2rx.digit (data equivalent to the digital data for transmission D2tx.digit). Then, the modulator / demodulator DCom11A outputs the demodulated digital data D2rx.digit obtained through the above process to the digital signal communication unit 13A of the communication terminal device Dev1A.
[0152] (Step SB75): In step SB75, speech synthesis processing is performed on the communication terminal device Dev1A. Specifically, the following processes are performed.
[0153] The digital signal communication unit 13A of the communication terminal device Dev1A receives the demodulated digital data D2rx.digit output from the modulator / demodulator DCom11A of the narrowband communication device DevCom1A, and acquires (extracts) the transmission digital data (transmission digital signal) contained in the demodulated digital data D2rx.digit. The digital signal communication unit 13A then outputs the transmission digital data acquired through the above process (digital data generated by the communication terminal device Dev2A (text data (data obtained by converting an audio signal into text data))) as data D13 to the speech synthesis processing unit 14.
[0154] The speech synthesis processing unit 14 receives data D13 (text data (for example, the text data "understood")) output from the digital signal communication unit 13A, performs a process to synthesize the text contained in data D13 into an audio signal (speech synthesis process), and obtains an audio signal (audio data) corresponding to the text data of data D13 (for example, the text data "understood"). Then, the speech synthesis processing unit 14 outputs the audio signal (audio data) obtained by the above process as data D14 to the audio output unit 15.
[0155] (Step SB76): In step SB76, audio playback processing is performed on the communication terminal device Dev1A. Specifically, the following processes are performed.
[0156] The audio output unit 15 of the communication terminal device Dev1A receives data D14 (audio signal (audio data)) output from the voice synthesis processing unit 14 and outputs audio based on said data D14 (audio signal) to the outside. For example, the audio output unit 15 is implemented using a speaker, and by driving the speaker with the audio signal (data D14), it outputs audio corresponding to the audio signal (data D14) from the speaker. As a result, audio corresponding to the audio input to the communication terminal device Dev2A is output from the speaker of the audio output unit 15 (audio is played back).
[0157] In the narrowband transmission line communication system 2000, the processing in step SB7 may be performed repeatedly.
[0158] In addition, in the narrowband transmission line communication system 2000, the receiving mode may be switched again to execute the processing of steps SB1 to SB7.
[0159] Summary As described above, the Narrowband Transmission Line Communication System 2000 enables voice communication using a narrowband transmission line via half-duplex communication between communication terminal device Dev1A and communication terminal device Dev2A. In other words, in the Narrowband Transmission Line Communication System 2000, the transmitting communication terminal device converts the voice spoken by the user into text data for speech recognition text acquisition processing, and transmits a wireless communication signal containing this text data from the transmitting narrowband communication device to the receiving narrowband communication device. The receiving narrowband communication device then receives the wireless communication signal transmitted from the transmitting narrowband communication device, extracts the text data contained in the wireless communication signal, and the extracted text data is synthesized into speech by the receiving communication terminal device and played back as voice. Furthermore, since the transmitting and receiving sides can be switched in the Narrowband Transmission Line Communication System 2000, half-duplex communication can be performed between communication terminal device Dev1A and communication terminal device Dev2A.
[0160] Thus, in the narrowband transmission line communication system 2000, voice communication can be performed using a narrowband transmission line, as it only requires sending and receiving text data, which has a dramatically smaller data capacity compared to voice data, using half-duplex communication (since it sends and receives wireless communication signals that include text data).
[0161] In other words, the Narrowband Transmission Line Communication System 2000 can achieve stable, high-precision communication (e.g., voice communication) using a narrowband transmission line, even when simultaneously performing voice communication and large data transfers such as image information, or when multiple voice communications are performed concurrently using the same transmission line.
[0162] In the above description, in the narrowband transmission line communication system 2000, in the response processing, text data acquired by speech recognition processing is sent from the receiving side to the transmitting side, and speech synthesis is performed by the communication terminal device Dev1A on the transmitting side (the side that received the response) to play back the speech (playback of the response speech). However, the system is not limited to this, and for example, in the narrowband transmission line communication system 2000, when a response is spoken, the receiving side communication terminal device Dev2A generates a reception confirmation signal indicating that it has detected the response utterance, the transmitting side communication terminal device Dev1A receives this reception confirmation signal, and when the communication terminal device Dev1 receives the reception confirmation signal, speech synthesis processing unit 14 of the communication terminal device Dev1A synthesizes speech corresponding to the reception confirmation and plays back the speech.
[0163] Furthermore, in the narrowband transmission line communication system 2000, in order to mitigate the problem of delay, for example, in the case of sequential recognition using silent sections as delimiters in speech recognition processing, a part of the recognition result (such as the end) that has been transmitted before the most recent silent section may change when recognizing the subsequent part. In such cases, when synthesizing speech on the receiving side, it is possible to go back to the point where the change occurred and play it back.
[0164] Furthermore, in the narrowband transmission line communication system 2000, a configuration that allows the use of silent sections and explicit delimiters in combination may be adopted. In this case, the system may display to the receiving side whether a delimiter has been issued or whether speech is continuing and sequential recognition is in progress, so that the receiving side can determine whether the other party's speech has ended.
[0165] [Third Embodiment] Next, a third embodiment will be described. Note that parts similar to those in the above embodiments are denoted by the same reference numerals, and detailed descriptions are omitted.
[0166] In the third embodiment of the narrowband transmission line communication system 3000, in addition to the functions of the first embodiment of the narrowband transmission line communication system 1000, the transmitting side can acquire location information and time information and transmit the acquired information to the receiving side.
[0167] <3.1: Configuration of a communication system for narrowband transmission lines> Figure 9 is a schematic diagram of the narrowband transmission line communication system 3000 according to the third embodiment.
[0168] Figure 10 is a schematic diagram of the communication terminal device Dev1 (transmitter side) of the narrowband transmission line communication system 3000 according to the third embodiment.
[0169] Figure 11 is a schematic diagram of the communication terminal device Dev2 (receiving side) of the narrowband transmission line communication system 3000 according to the third embodiment.
[0170] The narrowband transmission line communication system 3000 is a system that can perform voice communication with added location and time information using a narrowband transmission line, and for example, as shown in Figure 9, it comprises (1) a communication terminal device Dev1B and a narrowband communication device DevCom1, and (2) a narrowband communication device DevCom2 and a communication terminal device Dev2B.
[0171] The narrowband communication devices DevCom1 and DevCom2 have the same configuration and functions as the narrowband communication devices DevCom1 and DevCom2 of the first embodiment.
[0172] As shown in Figure 10, the communication terminal device Dev1B includes a voice input unit 11, a voice recognition text acquisition processing unit 12, a digital signal communication unit 13B, a location information acquisition unit 16, and a time information acquisition unit 17.
[0173] The voice input unit 11 and the voice recognition text acquisition processing unit 12 have the same configuration and functions as the voice input unit 11 and the voice recognition text acquisition processing unit 12 of the communication terminal device Dev1 of the first embodiment.
[0174] The location information acquisition unit 16 has, for example, a GPS function (positioning function), and acquires the location information of the communication terminal device Dev1B using this function. The location information acquisition unit 16 then outputs the data including the acquired location information of the communication terminal device Dev1B as data D12A to the digital signal communication unit 13B.
[0175] The time information acquisition unit 17 has, for example, a time acquisition function, which allows it to acquire the time (time information) when voice input processing and voice recognition text acquisition processing are performed in the communication terminal device Dev1B. The time information acquisition unit 17 then outputs the data containing the acquired time information as data D12B to the digital signal communication unit 13B.
[0176] The digital signal communication unit 13B receives data D12 output from the speech recognition text acquisition processing unit 12, data D12A output from the location information acquisition unit 16, and data D12B output from the time information acquisition unit 17, and generates digital data for transmission (digital signal for transmission) including the data D12, D12A, and D12B. The digital signal communication unit 13 then outputs the digital data for transmission generated above as data Dtx.digit to the narrowband communication device DevCom1.
[0177] As shown in Figure 11, the communication terminal device Dev2B includes a digital signal communication unit 21B, a speech synthesis processing unit 22, a speech output unit 23, a text data extraction unit 26A, a location information extraction unit 26B, a time information extraction unit 26C, a map information storage unit 27, and an information display unit 28.
[0178] The speech synthesis processing unit 22 and the speech output unit 23 have the same configuration and functions as the speech synthesis processing unit 22 and the speech output unit 23 of the communication terminal device Dev2 of the first embodiment, respectively.
[0179] The digital signal communication unit 21B receives the demodulated digital data Drx.digit output from the demodulator DCom22 of the narrowband communication device DevCom2, and acquires (extracts) the transmission digital data (transmission digital signal) contained in the demodulated digital data Drx.digit. The digital signal communication unit 21B then outputs the transmission digital data acquired through the above process (digital data generated by the transmitting communication terminal device Dev1 (data including text data, location information, and time information)) as data D20 to the text data extraction unit 26A, the location information extraction unit 26B, and the time information extraction unit 26C.
[0180] The text data extraction unit 26A receives data D20 output from the digital signal communication unit 21B, extracts text data from the data D20, and outputs the data containing the extracted text data as data D21 to the speech synthesis processing unit 22.
[0181] The location information extraction unit 26B receives the data D20 output from the digital signal communication unit 21B, extracts location information from the data D20, and outputs the data containing the extracted location information as data D21A to the information display unit 28.
[0182] The time information extraction unit 26C receives the data D20 output from the digital signal communication unit 21B, extracts time information from the data D20, and outputs the data containing the extracted time information as data D21B to the information display unit 28.
[0183] The map information storage unit 27 is a storage unit that stores map information and outputs data D21C containing map information to the information display unit 28.
[0184] The information display unit 28 receives data D21 output from the text data extraction unit 26A, data D21A output from the location information extraction unit 26B, data D21B output from the time information extraction unit 26C, and data D21C output from the map information storage unit 27. The information display unit 28 (1) obtains text data from data D21, (2) obtains location information from data D21A at the time the text data was obtained by the transmitting side, (3) obtains time information from data D21B at the time the text data was obtained by the transmitting side, and (4) obtains map data of the vicinity (surroundings) of the location information from data D21C.
[0185] The information display unit 28 then generates display data to display on the built-in display unit of the communication terminal device Dev2B or an external display device the following data obtained as described above: (1) text data (text corresponding to the voice of the transmitting side), (2) time information when the text data was obtained, and (3) location when the text data was obtained, on the map data near (around) the location information. The information display unit 28 then uses this display data to display the data from (1) to (3) above on the built-in display unit of the communication terminal device Dev2B or an external display device.
[0186] <3.2: Operation of communication systems for narrowband transmission lines> The operation of the narrowband transmission line communication system 3000, configured as described above, will be explained below with reference to the diagrams.
[0187] Figure 12 is a communication sequence diagram of the processing performed by the narrowband transmission line communication system 3000.
[0188] The operation of the narrowband transmission line communication system 3000 will be described below with reference to the communication sequence diagram in Figure 12.
[0189] (Steps SC1, SC2): In steps SC1 and SC2, the same processes as in steps SA1 and SA2 of the first embodiment are executed, respectively.
[0190] (Step SC3): In step SC3, the following processes (steps SA31 to SA3b) are executed.
[0191] (Steps SC31, SC32): In steps SC31 and SC32, the same processes as in steps SA31 and SA32 of the first embodiment are performed, respectively.
[0192] (Step SC33): In step SC33, the location information acquisition process is executed. Specifically, the following processes are performed.
[0193] The location information acquisition unit 16 has, for example, a GPS function (positioning function), and acquires the location information of the communication terminal device Dev1B using this function. The location information acquisition unit 16 then outputs the data including the acquired location information of the communication terminal device Dev1B as data D12A to the digital signal communication unit 13B.
[0194] (Step SC34): In step SC34, the time information acquisition process is executed. Specifically, the following processes are performed.
[0195] The time information acquisition unit 17 has, for example, a time acquisition function, which allows it to acquire the time (time information) when voice input processing and voice recognition text acquisition processing are performed in the communication terminal device Dev1B. The time information acquisition unit 17 then outputs the data containing the acquired time information as data D12B to the digital signal communication unit 13B.
[0196] (Step SC35): In step SC35, data synthesis processing (the process of generating digital signals for transmission) is performed. Specifically, the following processes are performed.
[0197] The digital signal communication unit 13B generates digital data for transmission (transmission digital signal) including the data D12 output from the voice recognition text acquisition processing unit 12, the data D12A output from the position information acquisition unit 16, and the data D12B output from the time information acquisition unit 17 (data synthesis processing). Then, the digital signal communication unit 13 outputs the generated digital data for transmission to the narrowband communication device DevCom1 as the data Dtx.digit.
[0198] (Step SC36): In step SC36, data transmission processing is executed. Specifically, the following processing is executed.
[0199] The modulator DCom11 of the narrowband communication device DevCom1 on the transmission side inputs the digital data for transmission Dtx.digit output from the digital signal communication unit 13B of the communication terminal device Dev1B, and performs modulation processing on the digital data for transmission Dtx.digit to obtain an analog signal for transmission (for example, an analog signal (analog modulation signal) that can be transmitted via a telephone line). Then, the modulator DCom11 outputs the obtained analog signal for transmission to the narrowband wireless communication unit DCom12 as the analog signal for transmission Dtx.analog. Note that the modulator DCom11 performs modulation processing on the digital data for transmission Dtx.digit so that the communication speed is a communication speed that can be communicated on a narrowband transmission path (for example, 40 kbps or less) to obtain an analog signal for transmission.
[0200] Then, the narrowband wireless communication unit DCom12 of the narrowband communication device DevCom1 on the transmission side inputs the analog signal for transmission Dtx.analog output from the modulator DCom11, performs RF modulation processing on the analog signal for transmission Dtx.analog, and generates a radio wave signal (wireless communication signal) that can be wirelessly communicated. Then, the narrowband wireless communication unit DCom12 radiates the generated radio wave signal (wireless communication signal) into space via an antenna for wireless communication (outputs it to a narrowband transmission path) (transmits the generated radio wave signal (wireless communication signal)).
[0201] (Step SC37): In step SC37, data reception processing is performed. Specifically, the following processes are executed.
[0202] The receiving narrowband communication device DevCom2 receives the radio wave signal (wireless communication signal) transmitted (radiated) from the transmitting narrowband wireless communication device DCom12 via a wireless communication antenna, performs RF demodulation processing on the received radio wave signal (wireless communication signal), and obtains the RF demodulated signal (a signal equivalent to the transmitting analog signal Dtx.analog). Then, the narrowband wireless communication device DCom21 outputs the RF demodulated signal (a signal equivalent to the transmitting analog signal Dtx.analog) obtained above as a demodulated signal Drx.analog to the demodulator DCom22.
[0203] The demodulator Dcom22 receives the demodulated signal Drx.analog output from the narrowband radio transmitter DCom21, performs demodulation processing on the demodulated signal Drx.analog (the process of demodulating the signal modulated by the modulator DCom11 and returning it to the original signal), and obtains the demodulated digital data (data equivalent to the digital data for transmission Dtx.digit) Drx.digit. The demodulator DCom22 then outputs the demodulated digital data Drx.digit obtained through the above process to the digital signal communication unit 21B of the communication terminal device Dev2B.
[0204] (Step SC38): In step SC38, the data extraction process is executed. Specifically, the following processes are performed.
[0205] The digital signal communication unit 21B receives the demodulated digital data Drx.digit output from the demodulator DCom22 of the narrowband communication device DevCom2, and acquires (extracts) the transmission digital data (transmission digital signal) contained in the demodulated digital data Drx.digit. The digital signal communication unit 21B then outputs the transmission digital data acquired through the above process (digital data generated by the transmitting communication terminal device Dev1 (data including text data, location information, and time information)) as data D20 to the text data extraction unit 26A, the location information extraction unit 26B, and the time information extraction unit 26C.
[0206] The text data extraction unit 26A receives data D20 output from the digital signal communication unit 13B, extracts text data from the data D20, and outputs the data containing the extracted text data as data D21 to the speech synthesis processing unit 22.
[0207] The location information extraction unit 26B receives the data D20 output from the digital signal communication unit 13B, extracts location information from the data D20, and outputs the data containing the extracted location information as data D21A to the information display unit 28.
[0208] The time information extraction unit 26C receives the data D20 output from the digital signal communication unit 13B, extracts time information from the data D20, and outputs the data containing the extracted time information as data D21B to the information display unit 28.
[0209] (Step SC39): In step SC39, speech synthesis processing is performed. Specifically, the following processes are executed.
[0210] The speech synthesis processing unit 22 receives data D21 (text data) output from the text data extraction unit 26A, performs a process to synthesize the text contained in data D21 into an audio signal (speech synthesis process), and obtains an audio signal (audio data) corresponding to the text data of data D21 (for example, the text data "A person in need of rescue has been found"). The speech synthesis processing unit 22 then outputs the audio signal (audio data) obtained by the above process as data D22 to the audio output unit 23.
[0211] (Step SC3a): In step SC3a, audio playback processing is performed. Specifically, the following processes are executed.
[0212] The audio output unit 23 of the receiving communication terminal device Dev2B receives data D22 (audio signal (audio data)) output from the voice synthesis processing unit 22 and outputs audio based on said data D22 (audio signal) to the outside. For example, the audio output unit 23 is implemented using a speaker, and by driving the speaker with the audio signal (data D22), it outputs audio corresponding to the audio signal (data D22) from the speaker. As a result, audio corresponding to the audio input to the receiving communication terminal device Dev1 is output from the speaker of the audio output unit 23 (audio is played back).
[0213] (Step SC3b): In step SC3b, the information display process is executed. Specifically, the following processes are performed.
[0214] The information display unit 28 receives data D21 output from the text data extraction unit 26A, data D21A output from the location information extraction unit 26B, data D21B output from the time information extraction unit 26C, and data D21C output from the map information storage unit 27. The information display unit 28 (1) obtains text data from data D21, (2) obtains location information from data D21A at the time the text data was obtained by the transmitting side, (3) obtains time information from data D21B at the time the text data was obtained by the transmitting side, and (4) obtains map data of the vicinity (surroundings) of the location information from data D21C.
[0215] The information display unit 28 then generates display data to display on the built-in display unit of the communication terminal device Dev2B or an external display device the following data obtained as described above: (1) text data (text corresponding to the voice of the transmitting side), (2) time information when the text data was obtained, and (3) location when the text data was obtained, on the map data near (around) the location information. The information display unit 28 then uses this display data to display the data from (1) to (3) above on the built-in display unit of the communication terminal device Dev2B or an external display device.
[0216] (Steps SC4, SC5): In steps SC4 and SC5, the same processes as in steps SA4 and SA5 of the first embodiment are performed, respectively.
[0217] Summary As described above, the narrowband transmission line communication system 3000, in addition to the functions of the narrowband transmission line communication system 1000 of the first embodiment, can transmit not only text data but also data including location information and time information when the text data was acquired, from the transmitting communication terminal device Dev1B to the receiving communication terminal device Dev1B.
[0218] That is, in the communication system 3000 for narrowband transmission lines, it is possible to transmit and receive text data, which has a significantly smaller data volume compared to voice data (transmit and receive a wireless communication signal including text data). Furthermore, it is possible to transmit the position information and time information when voice is emitted from the communication terminal device Dev1B on the transmitting side to the communication terminal device Dev1B on the receiving side.
[0219] Thus, in the communication system 3000 for narrowband transmission lines, even when simultaneously performing large data transfers such as voice communication and image information, or when multiple voice communications are carried out simultaneously and in parallel using the same transmission line, stable and highly accurate communication (for example, voice communication and communication of additional information (position information, time information)) can be achieved using the narrowband transmission line.
[0220] Note that in the communication system 3000 for narrowband transmission lines, (1) adding a functional unit or device on the receiving side to the functional unit or device on the transmitting side, and (2) adding a functional unit or device on the transmitting side to the functional unit or device on the receiving side, and performing processing in the same manner as in the second embodiment, semi-duplex communication may be performed.
[0221] [Fourth Embodiment] Next, the fourth embodiment will be described. For parts that are the same as those in the above embodiments, the same reference numerals are used and detailed descriptions are omitted.
[0222] In the communication system 4000 for narrowband transmission lines of the fourth embodiment, in addition to the functions of the communication system 1000 for narrowband transmission lines of the first embodiment, it is possible to acquire sender information by recognizing the sender on the transmitting side and transmit the acquired sender information to the receiving side.
[0223] <4.1: Configuration of Communication System for Narrowband Transmission Line> FIG. 13 is a schematic configuration diagram of a communication system 4000 for narrowband transmission lines according to the fourth embodiment.
[0224] FIG. 14 is a schematic configuration diagram of a communication terminal device Dev1 (transmitting side) of the communication system 4000 for narrowband transmission lines according to the third embodiment.
[0225] Figure 15 is a schematic diagram of the communication terminal device Dev2 (receiving side) of the narrowband transmission line communication system 4000 according to the third embodiment.
[0226] The narrowband transmission line communication system 4000 is a system that can perform voice communication with caller information added using a narrowband transmission line, and for example, as shown in Figure 13, it comprises (1) a communication terminal device Dev1C and a narrowband communication device DevCom1, and (2) a narrowband communication device DevCom2 and a communication terminal device Dev2C.
[0227] The narrowband communication devices DevCom1 and DevCom2 have the same configuration and functions as the narrowband communication devices DevCom1 and DevCom2 of the first embodiment.
[0228] As shown in Figure 14, the communication terminal device Dev1C comprises an audio input unit 11, an audio recognition text acquisition processing unit 12, a digital signal communication unit 13C, a caller information storage unit DB1, and a caller recognition processing unit 18.
[0229] The voice input unit 11 and the voice recognition text acquisition processing unit 12 have the same configuration and functions as the voice input unit 11 and the voice recognition text acquisition processing unit 12 of the communication terminal device Dev1 of the first embodiment.
[0230] The caller information storage unit DB1 is a storage unit for storing caller information (for example, the user's voice characteristics and ID data to identify the user). In accordance with a command from the caller recognition processing unit, it outputs the caller information stored in the caller information storage unit DB1 (for example, the user's voice characteristics and ID data to identify the user) as data D11A to the caller recognition processing unit 18.
[0231] The caller recognition processing unit 18 receives data D11 (voice data) output from the voice input unit 11, performs voice analysis processing on the data D11 (voice data), and, while referring to the data in the caller information storage unit DB1, recognizes (identifies) the caller who emitted the voice (performs caller recognition processing). Then, the caller recognition processing unit 18 outputs data containing the information of the caller identified by the above processing (information for identifying the caller) as data D12C to the digital signal communication unit 13C.
[0232] The digital signal communication unit 13C receives data D12 output from the speech recognition text acquisition processing unit 12 and data D12C output from the caller recognition processing unit 18, and generates digital data for transmission (digital signal for transmission) including data D12 and D12C. The digital signal communication unit 13 then outputs the digital data for transmission generated above as data Dtx.digit to the narrowband communication device DevCom1.
[0233] As shown in Figure 15, the communication terminal device Dev2C comprises a digital signal communication unit 21C, a voice synthesis processing unit 22A, a voice output unit 23, a caller information extraction unit 26D, a voice data storage unit DB2, and an information display unit 28A.
[0234] The speech synthesis processing unit 22 and the speech output unit 23 have the same configuration and functions as the speech synthesis processing unit 22 and the speech output unit 23 of the communication terminal device Dev2 of the first embodiment, respectively. In addition, the text data extraction unit 26A has the same configuration and functions as the text data extraction unit 26A of the third embodiment.
[0235] The digital signal communication unit 21C receives the demodulated digital data Drx.digit output from the demodulator DCom22 of the narrowband communication device DevCom2, and acquires (extracts) the transmission digital data (transmission digital signal) contained in the demodulated digital data Drx.digit. The digital signal communication unit 21C then outputs the transmission digital data acquired through the above process (digital data generated by the transmitting communication terminal device Dev1 (including text data and sender information)) as data D20 to the text data extraction unit 26A and the sender information extraction unit 26D.
[0236] The caller information extraction unit 26D receives the data D20 output from the digital signal communication unit 21C, extracts caller information from the data D20, and outputs the data containing the extracted caller information as data D21D to the voice data storage unit DB2 and the information display unit 28.
[0237] The voice data storage unit DB2 is a storage unit that stores voice data (for example, data on the feature quantities of the user's voice) and receives data D21D output from the caller information extraction unit 26D. The voice data storage unit DB2 reads the voice data corresponding to the caller information contained in data D21D and outputs the read voice data as data D21E to the voice synthesis processing unit 22A.
[0238] The speech synthesis processing unit 22A receives data D21 (text data) output from the text data extraction unit 26A and data D21E output from the speech data storage unit DB2. The speech synthesis processing unit 22A performs a process (speech synthesis processing) to synthesize the text contained in data D21 into a speech signal (a speech signal that reproduces the speech characteristics of the caller) based on the speech data (caller's voice data) in data D21E, and obtains a speech signal (audio data) corresponding to the text data of data D21. Then, the speech synthesis processing unit 22A outputs the audio signal (audio data) obtained by the above process as data D22 to the audio output unit 23.
[0239] The information display unit 28A receives the data D21D output from the caller information extraction unit 26D. The information display unit 28 obtains caller information from the data D21D and generates display data to display the obtained caller information on the built-in display unit of the communication terminal device Dev2B or on an external display device. The information display unit 28A then uses this display data to display the caller information on the built-in display unit of the communication terminal device Dev2B or on an external display device.
[0240] <4.2: Operation of communication systems for narrowband transmission lines> The operation of the narrowband transmission line communication system 4000, configured as described above, will be explained below with reference to the diagrams.
[0241] Figure 16 is a communication sequence diagram of the processing performed by the narrowband transmission line communication system 4000.
[0242] The operation of the narrowband transmission line communication system 4000 will be described below with reference to the communication sequence diagram in Figure 16.
[0243] (Steps SD1, SD2): In steps SD1 and SD2, the same processes as in steps SA1 and SA2 of the first embodiment are executed, respectively.
[0244] (Step SD3): In step SD3, the following processes (steps SD31 to SD3a) are executed.
[0245] (Steps SD31, SD32): In steps SD31 and SD32, the same processes as in steps SA31 and SA32 of the first embodiment are performed, respectively.
[0246] (Step SD33): In step SD33, caller recognition processing is performed. Specifically, the following processes are performed.
[0247] The caller recognition processing unit 18 of the communication terminal device Dev1C receives data D11 (voice data) output from the voice input unit 11, performs voice analysis processing on the data D11 (voice data), and, while referring to the data of the caller information storage unit DB1, recognizes (identifies) the caller who emitted the voice (performs caller recognition processing). Then, the caller recognition processing unit 18 outputs data containing the information of the caller identified by the above processing (information for identifying the caller) as data D12C to the digital signal communication unit 13C.
[0248] (Step SD34): In step SD34, data synthesis processing (the process of generating digital signals for transmission) is performed. Specifically, the following processes are performed.
[0249] The digital signal communication unit 13C receives data D12 output from the speech recognition text acquisition processing unit 12 and data D12C output from the caller recognition processing unit 18, and generates digital data for transmission (digital signal for transmission) including data D12 and D12C. The digital signal communication unit 13 then outputs the digital data for transmission generated above as data Dtx.digit to the narrowband communication device DevCom1.
[0250] (Step SD35): In step SD35, the data transmission process is executed. Specifically, the following processes are performed.
[0251] The modulator DCom11 of the transmitting narrowband communication device DevCom1 receives the transmission digital data Dtx.digit output from the digital signal communication unit 13C of the communication terminal device Dev1B, and modulates the transmission digital data Dtx.digit to obtain a transmission analog signal (for example, an analog signal that can be transmitted over a telephone line (analog modulated signal)). The modulator DCom11 then outputs the transmission analog signal obtained above as a transmission analog signal Dtx.analog to the narrowband wireless communication device DCom12. The modulator DCom11 modulates the transmission digital data Dtx.digit so that the communication speed is a communication speed that can be communicated over a narrowband transmission line (for example, 40kbps or less), and obtains the transmission analog signal.
[0252] Then, the narrowband radio transceiver DCom12 of the transmitting narrowband communication device DevCom1 receives the transmit analog signal Dtx.analog output from the modulator DCom11, performs RF modulation on the transmit analog signal Dtx.analog, and generates a radio wave signal (wireless communication signal) that can be used for wireless communication.Then, the narrowband radio transceiver DCom12 radiates the generated radio wave signal (wireless communication signal) into space via a wireless communication antenna (outputs it to a narrowband transmission path) (transmits the generated radio wave signal (wireless communication signal)).
[0253] (Step SD36): In step SD36, data reception processing is performed. Specifically, the following processes are executed.
[0254] The receiving narrowband communication device DevCom2 receives the radio wave signal (wireless communication signal) transmitted (radiated) from the transmitting narrowband wireless communication device DCom12 via a wireless communication antenna, performs RF demodulation processing on the received radio wave signal (wireless communication signal), and obtains the RF demodulated signal (a signal equivalent to the transmitting analog signal Dtx.analog). Then, the narrowband wireless communication device DCom21 outputs the RF demodulated signal (a signal equivalent to the transmitting analog signal Dtx.analog) obtained above as a demodulated signal Drx.analog to the demodulator DCom22.
[0255] The demodulator Dcom22 receives the demodulated signal Drx.analog output from the narrowband radio transmitter DCom21, performs demodulation processing on the demodulated signal Drx.analog (the process of demodulating the signal modulated by the modulator DCom11 and returning it to the original signal), and obtains the demodulated digital data (data equivalent to the digital data Dtx.digit for transmission) Drx.digit. The demodulator DCom22 then outputs the demodulated digital data Drx.digit obtained through the above process to the digital signal communication unit 21C of the communication terminal device Dev2C.
[0256] (Step SD37): In step SD37, the data extraction process is executed. Specifically, the following processes are performed.
[0257] The digital signal communication unit 21C receives the demodulated digital data Drx.digit output from the demodulator DCom22 of the narrowband communication device DevCom2 and acquires (extracts) the transmission digital data (transmission digital signal) contained in the demodulated digital data Drx.digit. The digital signal communication unit 21B then outputs the transmission digital data acquired through the above process (digital data generated by the transmitting communication terminal device Dev1 (data including text data, location information, and time information)) as data D20 to the text data extraction unit 26A and the sender information extraction unit 26D.
[0258] The text data extraction unit 26A receives data D20 output from the digital signal communication unit 13C, extracts text data from the data D20, and outputs the data containing the extracted text data as data D21 to the speech synthesis processing unit 22A.
[0259] The caller information extraction unit 26D receives the data D20 output from the digital signal communication unit 21C, extracts caller information from the data D20, and outputs the data containing the extracted caller information as data D21D to the voice data storage unit DB2 and the information display unit 28.
[0260] (Step SD38): In step SD38, speech synthesis processing is performed. Specifically, the following processes are executed.
[0261] The voice data storage unit DB2 receives data D21D output from the caller information extraction unit 26D, reads the voice data corresponding to the caller information contained in the data D21D, and outputs the read voice data as data D21E to the voice synthesis processing unit 22A.
[0262] The speech synthesis processing unit 22A receives data D21 (text data) output from the text data extraction unit 26A and data D21E output from the speech data storage unit DB2. The speech synthesis processing unit 22A performs a process (speech synthesis processing) to synthesize the text contained in data D21 into a speech signal (a speech signal that reproduces the speech characteristics of the caller) based on the speech data (caller's voice data) in data D21E, and obtains a speech signal (audio data) corresponding to the text data of data D21. Then, the speech synthesis processing unit 22A outputs the audio signal (audio data) obtained by the above process as data D22 to the audio output unit 23.
[0263] (Step SD39): In step SD39, audio playback processing is performed. Specifically, the following processes are performed.
[0264] The audio output unit 23 of the receiving communication terminal device Dev2B receives data D22 (audio signal (audio data)) output from the voice synthesis processing unit 22 and outputs audio based on said data D22 (audio signal) to the outside. For example, the audio output unit 23 is implemented using a speaker, and by driving the speaker with the audio signal (data D22), it outputs audio corresponding to the audio signal (data D22) from the speaker. As a result, audio corresponding to the audio input to the receiving communication terminal device Dev1 is output from the speaker of the audio output unit 23 (audio is played back).
[0265] (Step SD3a): In step SD3a, information display processing is performed. Specifically, the following processes are performed.
[0266] The information display unit 28A acquires caller information from the data D21D output from the caller information extraction unit 26D, and generates display data for displaying the acquired caller information on the built-in display unit of the communication terminal device Dev2B or an external display device. The information display unit 28A then uses this display data to display the caller information on the built-in display unit of the communication terminal device Dev2B or an external display device.
[0267] (Steps SD4, SD5): In steps SD4 and SD5, the same processes as in steps SA4 and SA5 of the first embodiment are performed, respectively.
[0268] Summary As described above, the narrowband transmission line communication system 4000, in addition to the functions of the narrowband transmission line communication system 1000 of the first embodiment, can transmit data including not only text data but also caller information (information of the user who spoke the voice corresponding to the text data) from the transmitting communication terminal device Dev1B to the receiving communication terminal device Dev1B. Furthermore, in the narrowband transmission line communication system 4000, the receiving communication terminal device Dev1B performs speech synthesis processing based on the caller information, so the voice played back by the receiving communication terminal device Dev1B will be similar to the caller's voice. For this reason, it becomes easy to recognize (identify) the caller simply by listening to the voice played back by the receiving communication terminal device Dev1B. In addition, since the caller information is displayed on the receiving communication terminal device Dev1B, the caller can be reliably recognized (identified).
[0269] Thus, the narrowband transmission line communication system 4000 can transmit and receive text data, which has a dramatically smaller data capacity compared to voice data (it can transmit and receive wireless communication signals that include text data), and furthermore, information about the user (sender) who made the voice call can also be transmitted from the transmitting communication terminal device Dev1B to the receiving communication terminal device Dev1B.
[0270] Thus, the narrowband transmission line communication system 3000 can achieve stable and high-precision communication (for example, communication of voice and additional information (sender information)) using a narrowband transmission line, even when voice communication and large data transfers such as image information are performed simultaneously, or when multiple voice communications are performed concurrently using the same transmission line.
[0271] In addition, in the narrowband transmission line communication system 4000, half-duplex communication may be performed by (1) adding a receiving function unit and device to the transmitting function unit and device, and (2) adding a transmitting function unit and device to the receiving function unit and device, and performing processing in the same manner as in the second embodiment.
[0272] Furthermore, while the above description explains the case in which the narrowband transmission line communication system 4000 performs voice synthesis similar to the caller's voice based on caller information in the communication terminal device Dev2C, it is not limited to this. For example, the narrowband transmission line communication system 4000 may detect the caller's gender and have the communication terminal device Dev2C synthesize a voice of the detected gender.
[0273] Furthermore, the narrowband transmission line communication system 4000 may be combined with the narrowband transmission line communication system 3000 of the third embodiment. This allows location information and time information to be displayed on the receiving communication terminal device, in addition to the functions of the narrowband transmission line communication system 4000.
[0274] Figure 17 schematically shows an example of the display of a communication terminal device when the narrowband transmission line communication systems 2000 and 3000 of the second and third embodiments are combined in the narrowband transmission line communication system 4000. As can be seen from Figure 17, the user's location information is clearly displayed on the map on the display of the communication terminal device, and the time information, caller information, and spoken text are clearly displayed. Furthermore, when performing half-duplex communication in the narrowband transmission line communication system, a beep sound may be emitted to notify the user when the transmission mode and reception mode are switched, as schematically shown in Figure 17.
[0275] Furthermore, in the narrowband transmission line communication system 4000, when the narrowband transmission line communication systems 2000 and 3000 of the second and third embodiments are combined, a command may be sent from the transmitting side to the receiving side (the command may be sent attached to the transmission data), and the communication terminal device on the receiving side may execute the contents instructed by the command (for example, the text of what a specific caller has said may be displayed in characters of a predetermined color to clearly distinguish the caller).
[0276] [Fifth Embodiment] Next, the fifth embodiment will be described. For the parts that are the same as those in the above embodiments, the same reference numerals are given and the detailed description is omitted.
[0277] In the narrowband transmission line communication system 1000 of the first embodiment, one-to-one communication was basic, but in the narrowband transmission line communication system 5000 of the fifth embodiment, many-to-many communication can be realized.
[0278] <5.1: Configuration of Narrowband Transmission Line Communication System> FIG. 18 is a schematic configuration diagram of a narrowband transmission line communication system 5000 according to the fifth embodiment.
[0279] As shown in FIG. 18, the narrowband transmission line communication system 5000 includes N (N: natural number) user terminal devices STA (1-1) ~STA (1-N) and an access point wireless communication device AP1, a server device Svr1, a narrowband communication device DevCom1, a narrowband communication device DevCom2, a server device Svr2, an access point wireless communication device AP1, and M (M: natural number) user terminal devices STA (2-1) ~STA (2-M) and.
[0280] The N (N: natural number) user terminal devices STA (1-1) ~STA (1-N) each have the configuration and functions of the communication terminal device Dev1 of the first embodiment. Note that the digital signal communication unit 13 of the user terminal device STA (1-k) (k: natural number, 1≦k≦N) is a functional unit that can communicate by wireless LAN, and transmits the data Dtx.digit to the access point wireless communication device AP1. Note that the data Dtx.digit (1-k) (k: natural number, 1≦k≦N) transmitted from the user terminal device STA to the access point wireless communication device AP1 is denoted as data Dtx.digit (1-k) . Note that the data Dtx.digit (1-k) is assumed to include the data of the destination.
[0281] The access point wireless communication device AP1 is connected to the user terminal device STA (1-1) ~STA (1-N) Each of these is a wireless communication device (access point) that can communicate with each of them via Wi-Fi. Furthermore, the access point wireless communication device AP1 is connected to the server device Svr1, and the user terminal device STA (1-k) Data Dtx.digit received from (k: natural number, 1 ≤ k ≤ N) (1-k) Send this to the server device Svr1.
[0282] Server device Svr1 has server functionality and is connected to access point wireless communication device AP1, and further connected to narrowband communication device DevCom1. Server device Svr1 receives data Dtx.digit from access point wireless communication device AP1. (1-k) It can receive (input) the following data: Server device Svr1 receives the data Dtx.digit from access point wireless communication device AP1. (1-k) The system generates aggregated data DAtx.digit (data containing one or more Dtx.digits, aggregated), and outputs this data DAtx.digit to the narrowband communication device DevCom1.
[0283] The narrowband communication device DevCom1 has the same configuration and functions as the narrowband communication device DevCom1 of the first embodiment. The data input from the server device Svr1 to the modulator of the narrowband communication device DevCom1 is denoted as dataDAtx.digit, and the signal obtained by modulating dataDAtx.digit by modulator Dcom11 is denoted as signalDAtx.analog.
[0284] The narrowband communication device DevCom2 has the same configuration and functions as the narrowband communication device DevCom2 of the first embodiment. The signal output from the narrowband wireless radio transmitter DCom21 of the narrowband communication device DevCom2 to the demodulator DCom22 is denoted as signal DArx.analog, and the data obtained by demodulating signal DArx.analog is denoted as data DArx.digit.
[0285] Server device Svr2 has server functionality and is connected to the access point wireless communication device AP2, and further connected to the narrowband communication device DevCom2. Server device Svr1 receives the data DArx.digit output from the demodulator DCom22 of the narrowband communication device DevCom2, and receives the data Drx.digit contained in (aggregated from) the data DArx.digit. (1-k) (Data Dtx.digit (1-k) The server device Svr2 acquires (separates and acquires) the data corresponding to the above Drx.digit. (1-k) This is output to the access point wireless communication device AP2.
[0286] The access point wireless communication device AP2 is connected to the user terminal device STA (2-1) ~STA (2-M) This is a wireless communication device (access point) that can communicate with each of (M: natural number) via wireless LAN. Furthermore, the access point wireless communication device AP2 is connected to the server device Svr2, and the data Drx.digit is output from the server device Svr2. (1-k) Enter the data Drx.digit. Then, the access point wireless communication device AP2 will input the data Drx.digit. (1-k) The destination data is obtained, and the data Drx.digit is sent to the obtained destination via wireless LAN. (1-k) Send.
[0287] M user terminal devices STA (M: natural number) (2-1) ~STA (2-M) Each of these has the configuration and functions of the communication terminal device Dev2 of the first embodiment. (2-k) The digital signal communication unit 21 (k: natural number, 1 ≤ k ≤ M) is a functional unit that can communicate via wireless LAN, and sends data addressed to itself via Drx.digit (1-k) This is received from the access point wireless communication device AP2.
[0288] <5.2: Operation of communication systems for narrowband transmission lines> The operation of the narrowband transmission line communication system 5000, configured as described above, will be explained below.
[0289] For the sake of clarity, in the narrowband transmission line communication system 5000, (1) User terminal device STA (1-1) and user terminal device STA (2-1) Communication between, (2) User terminal device STA (1-2) and user terminal device STA (2-2) Communication between, (3) User terminal device STA (1-3) and user terminal device STA (2-3) Communication between, The following explains an example of when this might be executed.
[0290] (5.2.1: Processing on the sender side) User Terminal Device STA (1-1) Then, the processes of steps SA1 and SA2 are executed in the same manner as the process of the communication terminal device Dev1 in the first embodiment.
[0291] And then, the user terminal device STA (1-1) The speech recognition text acquisition processing unit 12 receives data D11 (digital audio signal) output from the audio input unit 11, performs speech recognition processing on the data D11, and acquires character information corresponding to the data D11 (for example, the character information "Person in need of rescue has been found"). The speech recognition text acquisition processing unit 12 then executes a process (speech recognition text acquisition process) to acquire text (text data (data obtained by converting the audio signal into text data)) corresponding to the acquired character information. The speech recognition text acquisition processing unit 12 then outputs the text data acquired by the speech recognition text acquisition process (for example, the text data "Person in need of rescue has been found") as data D12 to the digital signal communication unit 13.
[0292] And then, the user terminal device STA (1-1)The digital signal communication unit 13 receives the data D12 output from the speech recognition text acquisition processing unit 12 and generates digital data for transmission (digital signal for transmission) including the data D12. The digital signal communication unit 13 then outputs the digital data for transmission generated above to data Dtx.digit (1-1) The data is then transmitted via Wi-Fi to the access point wireless communication device AP1. Note that the data is Dtx.digit. (1-1) The recipient is STA (2-1) The data includes evidence that this is the case.
[0293] User Terminal Device STA (1-2) In the above, the same process is performed on the user terminal device STA. (1-2) From the digital signal communication unit 13, data Dtx.digit is transmitted via wireless LAN. (1-2) The data Dtx.digit is sent to the access point wireless communication device AP1. (1-2) The recipient is STA (2-2) The data includes evidence that this is the case.
[0294] User Terminal Device STA (1-3) In the above, the same process is performed on the user terminal device STA. (1-3) From the digital signal communication unit 13, data Dtx.digit is transmitted via wireless LAN. (1-3) The data Dtx.digit is sent to the access point wireless communication device AP1. (1-3) The recipient is STA (2-3) The data includes evidence that this is the case.
[0295] The access point wireless communication device AP1 is connected to the user terminal device STA (1-1) ~STA (1-3) From there, data Dtx.digit (1-1) ~Dtx.digit (1-3) It receives this via Wi-Fi. The access point wireless communication device AP1 then receives Dtx.digit (1-1) ~Dtx.digit (1-3)Send this to the server device Svr1.
[0296] Server device Svr1 receives Dtx.digit from access point wireless communication device AP1. (1-1) ~Dtx.digit (1-3) The data is received (input) and aggregated into data DAtx.digit(={Dtx.digit (1-1) ,Dtx.digit (1-2) ,Dtx.digit (1-3) It generates}) and outputs the generated data DAtx.digit to the narrowband communication device DevCom1.
[0297] The modulator DCom11 of the transmitting narrowband communication device DevCom1 receives the transmission digital data DAtx.digit output from the server device Svr1 and performs modulation processing on the transmission digital data DAtx.digit to obtain a transmission analog signal (for example, an analog signal that can be transmitted over a telephone line (analog modulated signal)). The modulator DCom11 then outputs the transmission analog signal obtained above as the transmission analog signal DAtx.analog to the narrowband wireless communication device DCom12. The modulator DCom11 performs modulation processing on the transmission digital data Dtx.digit so that the communication speed is a communication speed that can be transmitted over a narrowband transmission line (for example, 40kbps or less) and obtains the transmission analog signal.
[0298] Then, the narrowband radio transceiver DCom12 of the transmitting narrowband communication device DevCom1 receives the transmit analog signal DAtx.analog output from the modulator DCom11, performs RF modulation on the transmit analog signal DAtx.analog, and generates a radio wave signal (wireless communication signal) that can be used for wireless communication. The narrowband radio transceiver DCom12 then radiates the generated radio wave signal (wireless communication signal) into space via a wireless communication antenna (outputs it to a narrowband transmission path) (transmits the generated radio wave signal (wireless communication signal)).
[0299] (5.2.2: Processing on the receiving end) The receiving narrowband communication device DevCom2 receives the radio wave signal (wireless communication signal) transmitted (radiated) from the transmitting narrowband wireless communication device DCom12 via a wireless communication antenna, performs RF demodulation processing on the received radio wave signal (wireless communication signal), and obtains the RF demodulated signal (a signal equivalent to the transmitting analog signal DAtx.analog). Then, the narrowband wireless communication device DCom21 outputs the RF demodulated signal (a signal equivalent to the transmitting analog signal DAtx.analog) obtained above as a demodulated signal DArx.analog to the demodulator DCom22.
[0300] The demodulator Dcom22 receives the demodulated signal DArx.analog output from the narrowband radio transceiver DCom21, performs demodulation processing on the demodulated signal DArx.analog (the process of demodulating the signal modulated by the modulator DCom11 and returning it to the original signal), and obtains the demodulated digital data DArx.digit (data equivalent to the digital data DAtx.digit for transmission). The demodulator DCom22 then outputs the demodulated digital data DArx.digit obtained through the above process to the server device Svr2.
[0301] The server device Svr2 receives the data DArx.digit output from the demodulator DCom22 of the narrowband communication device DevCom2, and the data Drx.digit contained within (aggregated from) the data DArx.digit. (1-1) ~Drx.digit (1-3) (Data Dtx.digit (1-1) ~Dtx.digit (1-3) The server device Svr2 acquires (separates and acquires) the data corresponding to the above Drx.digit. (1-1) ~Drx.digit (1-3) This is output to the access point wireless communication device AP2.
[0302] The access point wireless communication device AP2 receives data Drx.digit output from the server device Svr2. (1-k)Enter the data Drx.digit. Then, the access point wireless communication device AP2 will input the data Drx.digit. (1-1) ~Drx.digit (1-3) The destination data is obtained, and the data Drx.digit is sent to the obtained destination via wireless LAN. (1-1) ~Drx.digit (1-3) Send the data. Here, the data Drx.digit (1-1) ~Drx.digit (1-3) The recipients of these messages are, respectively, the user terminal device STA. (2-1) ~STA (2-3) Therefore, the access point wireless communication device AP2 will send data Drx.digit (1-1) ~Drx.digit (1-3) Each of these is connected via wireless LAN to the user terminal device STA (2-1) ~STA (2-3) Send to [destination].
[0303] User Terminal Device STA (2-1) The digital signal communication unit 21 receives the data Drx.digit transmitted from the access point wireless communication device AP2. (2-1) Enter the demodulated digital data Drx.digit (2-1) The digital data for transmission (digital signal for transmission) contained in the signal is acquired (extracted). The digital signal communication unit 21 then outputs the digital data for transmission acquired through the above process (digital data generated by the transmitting communication terminal device Dev1 (text data (data obtained by converting the voice signal into text data))) as data D21 to the voice synthesis processing unit 22.
[0304] User Terminal Device STA (2-1)The voice synthesis processing unit 22 inputs the data D21 (text data (for example, the text data of "A person in need of rescue has been found")) output from the digital signal communication unit 21, performs a process (voice synthesis process) of synthesizing the text included in the data D21 into a voice signal, and obtains a voice signal (voice data) corresponding to the text data of the data D21 (for example, the text data of "A person in need of rescue has been found"). Then, the voice synthesis processing unit 22 outputs the voice signal (voice data) obtained by the above process to the voice output unit 23 as the data D22.
[0305] User terminal device STA (2-1) The voice output unit 23 of the user terminal device STA inputs the data D22 (voice signal (voice data)) output from the voice synthesis processing unit 22, and outputs the voice based on the data D22 (voice signal) to the outside. For example, the voice output unit 23 is realized by using a speaker, and drives the speaker with the voice signal (data D22) to output the voice corresponding to the voice signal (data D22) from the speaker. Thereby, the voice corresponding to the voice input to the communication terminal device Dev1 on the receiving side is output (played back) from the speaker of the voice output unit 23.
[0306] User terminal device STA (2-2) In the user terminal device STA, the received data from the wireless communication device AP2 for the access point is set as the data Drx.digit (2-2) and the same process as above is performed, and the voice synthesized from the text data included in the data Drx.digit (2-2) is played back from the speaker of the voice output unit 23 of the user terminal device STA. (2-2) In the user terminal device STA, the received data from the wireless communication device AP2 for the access point is set as the data Drx.digit
[0307] User terminal device STA (2-3) and the same process as above is performed, and the voice synthesized from the text data included in the data Drx.digit (2-3) is played back from the speaker of the voice output unit 23 of the user terminal device STA. (2-3) In the user terminal device STA, the received data from the wireless communication device AP2 for the access point is set as the data Drx.digit (2-3) is played back from the speaker of the voice output unit 23 of the user terminal device STA.
[0308] By processing as described above, in the communication system 5000 for narrowband transmission lines, (1) communication between user terminal devices STA (1-1) and user terminal device STA (2-1) and the communication between them, (2) communication between user terminal devices STA (1-2) and user terminal device STA (2-2) and the communication between them, (3) communication between user terminal devices STA (1-3) and user terminal device STA (2-3) and the communication between them, can be executed.
[0309] <<Summary>> As described above, in the communication system 5000 for narrowband transmission lines, communication can be performed between a plurality of user terminal devices on the transmission side and a plurality of user terminal devices on the reception side.
[0310] In the communication system 5000 for narrowband transmission lines, since text data with a significantly smaller data capacity compared to voice data can be transmitted and received (wireless communication signals including text data can be transmitted and received), even in a situation where only a narrowband transmission line can be secured, a plurality of communication connections can be established and stable and highly accurate communication can be realized.
[0311] That is, in the communication system 5000 for narrowband transmission lines, even when performing large data transfers such as voice communication and image information simultaneously, or when a plurality of voice communications are carried out simultaneously in parallel using the same transmission line, stable and highly accurate communication (for example, voice communication and communication of additional information (sender information)) can be realized using the narrowband transmission line.
[0312] Furthermore, in the narrowband transmission line communication system 5000, half-duplex communication may be performed by (1) adding a receiving-side functional unit and device to the transmitting-side functional unit and device, and (2) adding a transmitting-side functional unit and device to the receiving-side functional unit and device, and performing processing in the same manner as in the second embodiment. As a result, even in situations where only a narrowband transmission line can be secured, the narrowband transmission line communication system 5000 can establish multiple communication connections (half-duplex communication connections) and realize stable, high-precision communication (half-duplex communication).
[0313] Furthermore, although the above describes the case where communication takes place between three user terminal devices on the transmitting and receiving sides, it is not limited to this, and in the narrowband transmission line communication system 5000, the user terminal device STA (1-1) ~STA (1-N) Any number of devices (N or less) and user terminal device STA (2-1) ~STA (2-M) Communication may be performed between any number of devices (M or less).
[0314] [Sixth Embodiment] Next, a sixth embodiment will be described. Note that parts similar to those in the above embodiments are denoted by the same reference numerals, and detailed descriptions are omitted.
[0315] The fifth embodiment of the narrowband transmission line communication system 5000 was a system that performed communication between one narrowband communication device (transmitter) and one narrowband communication device (receiver), but the sixth embodiment of the narrowband transmission line communication system 6000 is a system that performs communication (one-to-N communication, broadcast communication) between one narrowband communication device (transmitter) and multiple narrowband communication devices (receiver).
[0316] Figure 19 is a schematic diagram of the narrowband transmission line communication system 6000 according to the sixth embodiment.
[0317] Figure 20 is a schematic diagram of the narrowband transmission line communication system 6000A according to the sixth embodiment.
[0318] The sixth embodiment of the narrowband transmission line communication system 6000 comprises a transmitting narrowband communication device group DevComG_0 and n (n: natural number) receiving narrowband communication device groups DevComG_1 to DevComG_n. Radio waves (wireless communication signals) transmitted from the transmitting narrowband communication device group DevComG_0 are received by each of the n (n: natural number) receiving narrowband communication device groups DevComG_1 to DevComG_n (broadcast communication).
[0319] The transmitting narrowband communication device group DevComG_0 has multiple user terminal devices STA (1-i) The system comprises (i: natural number, i ≤ N), an access point wireless communication device AP1, a server device Svr1, and a narrowband communication device DevCom1. The transmitting narrowband communication device group DevComG_0 has the same configuration and functions as the transmitting device group in the fifth embodiment.
[0320] The receiving narrowband communication device group DevComG_j (j: natural number, 1 ≤ j ≤ n) consists of multiple user terminal devices STA (j-k) (k: natural number, k≦M (j) M (j) The narrowband communication device group DevComG_j (where j is a natural number, 1 ≤ j ≤ n) comprises a wireless communication device AP2 for access points, a server device Svr2, and a narrowband communication device DevCom2. Each receiving narrowband communication device group DevComG_j (where j is a natural number, 1 ≤ j ≤ n) has the same configuration and function as the receiving device group in the fifth embodiment.
[0321] In the narrowband transmission line communication system 5000 configured as described above, the transmitting narrowband communication device group DevComG_0 performs the same processing as in the fifth embodiment and transmits a wireless communication signal (broadcast signal) from the narrowband communication device DevCom1 to the receiving narrowband communication device group DevComG_j (j: natural number, 1≦j≦n).
[0322] Each receiving narrowband communication device group DevComG_j (j: natural number, 1≦j≦n) performs the same processing as the receiving device group in the fifth embodiment, receives the wireless communication signal transmitted from the narrowband communication device DevCom1 of the transmitting narrowband communication device group DevComG_0, and reproduces the data contained in the wireless communication signal (audio playback is performed on the user terminal device of the narrowband communication device group DevComG_j).
[0323] Summary As described above, the narrowband transmission line communication system 5000 can perform communication (one-to-many communication, broadcast communication) between one narrowband communication device (transmitter) and multiple narrowband communication devices (receivers).
[0324] The Narrowband Transmission System 6000 can transmit and receive text data, which has a dramatically smaller data capacity than voice data (it can transmit and receive wireless communication signals that include text data). Therefore, even in situations where only a narrowband transmission line can be secured, as described above, the voice from the receiving end can be transmitted to a large number of receiving devices via broadcast communication, resulting in stable and highly accurate communication.
[0325] Furthermore, in the narrowband transmission line communication system 6000, half-duplex communication may be performed by (1) adding a receiving-side functional unit and device to the transmitting-side functional unit and device, and (2) adding a transmitting-side functional unit and device to the receiving-side functional unit and device, and performing processing in the same manner as in the second embodiment. As a result, the narrowband transmission line communication system 6000 can switch between the transmitting and receiving sides and achieve stable, high-precision communication (half-duplex communication) through half-duplex communication.
[0326] Furthermore, in the narrowband transmission line communication system 6000, an identifier (ID) that identifies the transmitting device may be set in order to identify the transmitting device, and a signal including this identifier (ID) may be broadcast. Then, the receiving device (for example, a user terminal device) can easily identify the source (transmitting device) by displaying an indication of the transmitting device based on this identifier (ID).
[0327] Furthermore, if the receiving device receives text data from a device with a predetermined identifier (ID) (the transmitting device), and confirms the speech synthesis of the text data, or confirms the content of the text data, it may send a signal (delivery confirmation signal) from the receiving device to the transmitting device to indicate that it has been confirmed. This allows the transmitting device to be certain that the content it intended to communicate has been confirmed by the receiving device.
[0328] Furthermore, in the narrowband transmission line communication system 6000, an identifier (ID) that identifies the transmitting device may be set in order to identify the transmitting device, and a signal including this identifier (ID) may be broadcast. Then, the receiving device (for example, a user terminal device) can easily identify the source (transmitting device) by displaying an indication of the transmitting device based on this identifier (ID).
[0329] Furthermore, in the narrowband transmission line communication system 6000, each group of devices was configured such that a server device and a wireless communication device for access points were connected to the narrowband communication device. However, the system is not limited to this configuration. For example, as shown in Figure 20, each group of devices may be configured such that a communication terminal device (a device having the same configuration and functions as the communication terminal devices Dev1 and Dev2 of the first embodiment) is connected to the narrowband communication device (see the narrowband transmission line communication system 6000A in Figure 20). This allows the voice data (text-converted data) input to the transmitting communication terminal device Dev1 to be broadcast to multiple transmitting device groups DevComGA_1 to DevComGA_n, and the voice can be played back on the communication terminal device Dev2 of each device group.
[0330] [Seventh Embodiment] Next, a seventh embodiment will be described. Note that parts similar to those in the above embodiments are denoted by the same reference numerals, and detailed descriptions are omitted.
[0331] In the first embodiment of the narrowband transmission line communication system 1000, the communication terminal device Dev1 converted speech to text and transmitted the converted text data. However, in the seventh embodiment of the narrowband transmission line communication system 7000, the speech input to the communication terminal device was converted to text, the text obtained through the conversion was summarized, and the summarized text was transmitted.
[0332] Figure 21 is a schematic diagram of the narrowband transmission line communication system 7000 according to the seventh embodiment.
[0333] Figure 22 is a schematic diagram of the communication terminal device Dev1D of the narrowband transmission line communication system 7000 according to the seventh embodiment.
[0334] The narrowband transmission line communication system 7000 of the seventh embodiment has a configuration in which the communication terminal device Dev1 is replaced with the communication terminal device Dev1D in the narrowband transmission line communication system 1000 of the first embodiment. Otherwise, the narrowband transmission line communication system 7000 of the seventh embodiment is the same as the narrowband transmission line communication system 1000 of the first embodiment.
[0335] As shown in Figure 22, the communication terminal device Dev1D has a configuration in which a summary processing unit 12a is added to the communication terminal device Dev1 of the first embodiment.
[0336] The summarization processing unit 12a receives data D12 (text data obtained by converting speech to text) output from the speech recognition text acquisition processing unit 12, performs summarization processing (processing to summarize the text data of D12 (text data that makes up a sentence)) on the data D12, and obtains data (summarized text data) that is a summary of the text data of D12. Then, the summarization processing unit 12a outputs the summarized text data obtained by the above summarization processing as data D12D to the digital signal communication unit 13.
[0337] The processing from the digital signal communication unit 13 onward is the same as in the first embodiment.
[0338] As described above, the narrowband transmission line communication system 7000 of the seventh embodiment converts the voice input to the communication terminal device into text, summarizes the text obtained through the text conversion, and transmits the summarized text. As a result, the narrowband transmission line communication system 7000 can further reduce the amount of communication compared to the narrowband transmission line communication system 1000 of the first embodiment.
[0339] In addition, in the narrowband transmission line communication system 7000, half-duplex communication may be performed by (1) adding a receiving function unit and device to the transmitting function unit and device, and (2) adding a transmitting function unit and device to the receiving function unit and device, and performing processing in the same manner as in the second embodiment.
[0340] ≪Variations≫ Next, a modified example of the seventh embodiment will be described. Note that parts similar to those in the above embodiments are denoted by the same reference numerals, and detailed descriptions are omitted.
[0341] Figure 23 is a schematic diagram of a narrowband transmission line communication system 7000A according to a modified example of the seventh embodiment.
[0342] Figure 24 is a schematic configuration diagram of the communication terminal device Dev1Da of the narrowband transmission line communication system 7000A according to a modified example of the seventh embodiment.
[0343] Figure 25 is a schematic diagram of the communication terminal device Dev2D of the narrowband transmission line communication system 7000A according to a modified example of the seventh embodiment.
[0344] The narrowband transmission line communication system 7000A, a modified version of the seventh embodiment, has a configuration in which the communication terminal device Dev1D is replaced with the communication terminal device Dev1Da and the communication terminal device Dev2 is replaced with the communication terminal device Dev2D, compared to the narrowband transmission line communication system 7000 of the seventh embodiment. Otherwise, the narrowband transmission line communication system 7000A, a modified version of the seventh embodiment, is the same as the narrowband transmission line communication system 7000 of the seventh embodiment.
[0345] As shown in Figure 24, the communication terminal device Dev1Da has a configuration in which the summarization processing unit 12a is replaced with the intent interpretation processing unit 12b in the communication terminal device Dev1D of the seventh embodiment.
[0346] The intent interpretation processing unit 12b receives data D12 (text data obtained by converting speech to text) output from the speech recognition text acquisition processing unit 12, and performs intent interpretation processing (processing to interpret the intent of the text data D12 (text data that makes up a sentence)) on the data D12. In other words, the intent interpretation processing unit 12b stores sentence patterns of predetermined intents along with pattern identifiers (reference numbers), interprets the intent of the text data D12 (text data that makes up a sentence), determines which pattern it belongs to (or is similar to), and obtains the pattern identifier (reference number) of the sentence pattern to which it belongs (or is similar to). Then, the intent interpretation processing unit 12b outputs the data containing the pattern identifier (reference number) of the sentence pattern obtained above as data D12E to the digital signal communication unit 13.
[0347] The digital signal communication unit 13 has the same configuration and functions as the digital signal communication unit 13 of the first embodiment, generates digital signal data (communication data) Dtx.digit including data D12E acquired from the intent interpretation processing unit 12b, and outputs the digital signal data (communication data) Dtx.digit to the narrowband communication device DevCom1.
[0348] The processing in the narrowband communication devices DevCom1 and DevCom2 is the same as in the first embodiment.
[0349] As shown in Figure 25, the communication terminal device Dev2D has a configuration in which the intent interpretation text acquisition processing unit 22a is added to the communication terminal device Dev2 of the first embodiment.
[0350] The intent interpretation text acquisition processing unit 22a receives data D20a (data including the pattern identifier (reference number) of the text pattern acquired on the transmitting side) output from the digital signal communication unit 21, and performs intent interpretation text acquisition processing using the data D20a. In other words, the intent interpretation text acquisition processing unit 22a stores text patterns of a predetermined intent along with their pattern identifiers (reference numbers), and acquires the text pattern corresponding to the pattern identifier (reference number) of the text pattern in data D20a. Then, the intent interpretation text acquisition processing unit 22a outputs the text data of the acquired text pattern as data D21 to the speech synthesis processing unit 22. The processing from the speech synthesis processing unit 22 onward is the same as in the first embodiment.
[0351] As described above, in the narrowband transmission line communication system 7000A, a modified example of the seventh embodiment, the voice input to the communication terminal device is converted to text, and the text pattern identifier (reference number) corresponding to the text obtained through text conversion is transmitted to the receiving side. The receiving communication terminal device then obtains the text data of the sentence corresponding to the text pattern identifier (reference number) contained in the received data, and performs voice playback by speech synthesis of the said text data.
[0352] As a result, the communication system 7000A for narrowband transmission lines can further reduce the amount of data transmitted compared to the communication system 1000 for narrowband transmission lines of the first embodiment and the communication system 7000 for narrowband transmission lines of the seventh embodiment.
[0353] In addition, in the narrowband transmission line communication system 7000A, half-duplex communication may be performed by (1) adding a receiving function unit and device to the transmitting function unit and device, and (2) adding a transmitting function unit and device to the receiving function unit and device, and performing processing in the same manner as in the second embodiment.
[0354] [Eighth Embodiment] Next, an eighth embodiment will be described. Note that parts similar to those in the above embodiments (including modified examples) are denoted by the same reference numerals, and detailed descriptions are omitted.
[0355] The eighth embodiment of the narrowband transmission line communication system 8000 is a system that adds a translation function (text translation function) to the narrowband transmission line communication system 1000 of the first embodiment.
[0356] Figure 26 is a schematic diagram of the communication system 8000 for narrowband transmission lines according to the eighth embodiment.
[0357] Figure 27 is a schematic diagram of the communication terminal device Dev2E of the narrowband transmission line communication system 8000 according to the seventh embodiment.
[0358] The eighth embodiment of the narrowband transmission line communication system 8000 has a configuration in which the communication terminal device Dev2 is replaced with the communication terminal device Dev2E in the first embodiment of the narrowband transmission line communication system 1000. Otherwise, the eighth embodiment of the narrowband transmission line communication system 8000 is the same as the first embodiment of the narrowband transmission line communication system 1000.
[0359] As shown in Figure 27, the communication terminal device Dev2E has a configuration in which a translation processing unit 22b is added to the communication terminal device Dev2 of the first embodiment.
[0360] The translation processing unit 22b receives data D21 (text data) output from the digital signal communication unit 21 and performs a process to translate the text data D21 into a predetermined language. Then, the translation processing unit 22b outputs the text data obtained by the translation process (text data translated into the predetermined language) as data D21F to the speech synthesis processing unit 22. The processing from the speech synthesis processing unit 22 onward is the same as in the first embodiment.
[0361] As described above, in the narrowband transmission line communication system 8000, a modified example of the eighth embodiment, the receiving communication terminal device can convert the audio text data (original language text data) input by the transmitting communication terminal device into text data of a predetermined target language using the translation processing unit 22b, synthesize the text data into speech, and play back the speech.
[0362] In addition, in the narrowband transmission line communication system 7000A, half-duplex communication may be performed by (1) adding a receiving function unit and device to the transmitting function unit and device, and (2) adding a transmitting function unit and device to the receiving function unit and device, and performing processing in the same manner as in the second embodiment.
[0363] [Ninth Embodiment] Next, a ninth embodiment will be described. Note that parts similar to those in the above embodiments (including modified examples) are denoted by the same reference numerals, and detailed descriptions are omitted.
[0364] In the first embodiment of the narrowband transmission line communication system 1000, the communication terminal device Dev1 converts speech to text using speech recognition processing and transmits the data converted to text by speech recognition processing (text data). However, in addition to the above functions, the ninth embodiment of the narrowband transmission line communication system 9000 can also transmit text data manually entered by the user.
[0365] Figure 28 is a schematic diagram of the communication system 9000 for narrowband transmission lines according to the ninth embodiment.
[0366] Figure 29 is a schematic diagram of the communication terminal device Dev1F of the narrowband transmission line communication system 9000 according to the ninth embodiment.
[0367] Figure 30 is a schematic diagram of the Dev2F communication terminal device of the narrowband transmission line communication system 9000 according to the ninth embodiment.
[0368] The ninth embodiment of the narrowband transmission line communication system 9000 has a configuration in which, in the first embodiment of the narrowband transmission line communication system 1000, communication terminal device Dev1 is replaced with communication terminal device Dev1F and communication terminal device Dev2 is replaced with communication terminal device Dev2F. Otherwise, the ninth embodiment of the narrowband transmission line communication system 9000 is the same as the first embodiment of the narrowband transmission line communication system 1000.
[0369] As shown in Figure 29, the communication terminal device Dev1F has a configuration in which a text input unit 11a is added to the communication terminal device Dev1 of the first embodiment, and the digital signal communication unit 13 is replaced with a digital signal communication unit 13D.
[0370] The text input unit 11a is a functional unit that allows the user to manually input text data. The user manually inputs the text data of the voice input into the voice input unit 11 using the text input unit 11a. The text input unit 11a then outputs the input text data as data D12F to the digital signal communication unit 13D.
[0371] In addition to the functions of the digital signal communication unit 13 in the first embodiment, the digital signal communication unit 13D can also receive data from the text input unit 11a. Similar to the first embodiment, the digital signal communication unit 13D generates digital data Dtx.digit for transmission, which includes the data D12 output from the speech recognition text acquisition processing unit 12, and outputs the digital data Dtx.digit for transmission to the narrowband communication device DevCom1.
[0372] Furthermore, the digital signal communication unit 13D receives the data D12F output from the text input unit 11a, generates the digital data Dtx.digit for transmission which includes the data D12F, and outputs the digital data Dtx.digit for transmission to the narrowband communication device DevCom1.
[0373] In other words, the digital signal communication unit 13D is (1) Digital data for transmission Dtx.digit (which contains the text data D12 obtained by the speech recognition text acquisition process) (t0) The following is output to the narrowband communication device DevCom1, and then, (2) The digital data for transmission, Dtx.digit, which includes the data D12F output from the text input unit 11a (this is Dtx.digit (t1)The text (represented as ) is output to the narrowband communication device DevCom1. This allows the user (speaker) to input correct text data (correct text data that is different from the correct text data corresponding to the speech) from the text input unit 11a, and output that text data (correct text data of the words spoken by the user) to the narrowband communication device DevCom1 if incorrect text data (incorrect text data that is different from the correct text data that corresponds to the speech) is acquired during the speech recognition text acquisition process.
[0374] (Processing at time step t0 (Dtx.digit (t0) Processing for)): The modulator Dcom11 of the narrowband communication device DevCom1 outputs data Dtx.digit (t0) When input is received, the same processing as in the first embodiment is performed, and the data Dtx.digit (t0) From signal Dtx.analog (t0) The signal is acquired and output to the narrowband wireless communication device DCom12. The narrowband wireless communication device DCom12 receives the signal Dtx.analog. (t0) It transmits a wireless communication signal that has been RF modulated.
[0375] The narrowband radio transmitter DCom21 of the narrowband communication device DevCom2 receives a radio communication signal from the narrowband communication device DevCom1, performs RF demodulation on the signal, and outputs the signal Drx.analog (t0) The signal is acquired and output to the demodulator DCom22. The demodulator DCom22 then receives the signal Drx.analog. (t0) Demodulation is performed on the data Drx.digit (t0) The data is retrieved and output to the communication terminal device Dev2F.
[0376] As shown in Figure 30, the communication terminal device Dev2F has a configuration in which an information display unit 28B is added to the communication terminal device Dev2 of the first embodiment.
[0377] The digital signal communication unit 21 receives the data Drx.digit output from the narrowband communication device DevCom2.(t0) Enter the data, retrieve the text data from that data, and put the retrieved text data into data D21 (this D21 (t0) (This is written as) and is output to the speech synthesis processing unit 22 and the information display unit 28B.
[0378] The speech synthesis processing unit 22 and the speech output unit 23 perform the same processing as in the first embodiment, and data D21 (t0) It synthesizes the corresponding audio and plays it back.
[0379] The information display unit 28B displays data D21 (t0) Enter the data D21 (t0) The text data is displayed on the built-in display unit of the Dev2F communication terminal device or on an external display device.
[0380] (Processing at time step t1 (Dtx.digit) (t1) Processing for)): The modulator Dcom11 of the narrowband communication device DevCom1 outputs data Dtx.digit (t1) When input is received, the same processing as in the first embodiment is performed, and the data Dtx.digit (t1) From signal Dtx.analog (t1) The signal is acquired and output to the narrowband wireless communication device DCom12. The narrowband wireless communication device DCom12 receives the signal Dtx.analog. (t1) It transmits a wireless communication signal that has been RF modulated.
[0381] The narrowband radio transmitter DCom21 of the narrowband communication device DevCom2 receives a radio communication signal from the narrowband communication device DevCom1, performs RF demodulation on the signal, and outputs the signal Drx.analog (t1) The signal is acquired and output to the demodulator DCom22. The demodulator DCom22 then receives the signal Drx.analog. (t1) Demodulation is performed on the data Drx.digit (t1) The data is retrieved and output to the communication terminal device Dev2F.
[0382] The digital signal communication unit 21 of the communication terminal device Dev2F receives the data Drx.digit output from the narrowband communication device DevCom2. (t1) Enter the data, retrieve the text data from that data, and put the retrieved text data into data D21 (this D21 (t1) (This is written as) and is output to the speech synthesis processing unit 22 and the information display unit 28B.
[0383] The speech synthesis processing unit 22 and the speech output unit 23 perform the same processing as in the first embodiment, and data D21 (t1) It synthesizes the corresponding audio and plays it back.
[0384] The information display unit 28B displays data D21 (t1) The input is used to display the text data of the data D21 on the built-in display unit of the communication terminal device Dev2F or on an external display device.
[0385] As described above, the ninth embodiment of the narrowband transmission line communication system 7000 converts the voice input to the transmitting communication terminal device into text using speech recognition processing, transmits the text data obtained through the text conversion to the receiving side, and then allows the user to manually input the correct text data of the spoken words into the transmitting communication terminal device and transmit that text data to the receiving side. The receiving communication terminal device can then display both (1) the text data obtained by the speech recognition processing on the transmitting side and (2) the correct data of the text data (the correct text data of the spoken words (the text data manually entered by the user)) on its speech synthesis, speech playback, and display unit. Therefore, even if the accuracy of the speech recognition text acquisition processing on the transmitting communication terminal device is poor, the correct data (accurate text data of the spoken words) can be reliably transmitted from the transmitting side to the receiving side.
[0386] In addition, in the narrowband transmission line communication system 9000, half-duplex communication may be performed by (1) adding a receiving function unit and device to the transmitting function unit and device, and (2) adding a transmitting function unit and device to the receiving function unit and device, and performing processing in the same manner as in the second embodiment.
[0387] [Tenth Embodiment] Next, a tenth embodiment will be described. Note that parts similar to those in the above embodiments (including modified examples) are denoted by the same reference numerals, and detailed descriptions are omitted.
[0388] In the first embodiment of the narrowband transmission line communication system 1000, the communication terminal device Dev1 converts speech to text using speech recognition processing and transmits the data converted to text by speech recognition processing (text data). However, in addition to the above functions, the tenth embodiment of the narrowband transmission line communication system 10000 can transmit image data or compressed image data (for example, data obtained by image compression processing or image data with resized data size (for example, thumbnail image data)) along with the text data.
[0389] Figure 31 is a schematic diagram of the narrowband transmission line communication system 10000 according to the 10th embodiment.
[0390] Figure 32 is a schematic diagram of the communication terminal device Dev1G of the narrowband transmission line communication system 10000 according to the 10th embodiment.
[0391] Figure 33 is a schematic diagram of the Dev2G communication terminal device of the narrowband transmission line communication system 10000 according to the 10th embodiment.
[0392] The narrowband transmission line communication system 10000 of the tenth embodiment has a configuration in which, in the narrowband transmission line communication system 1000 of the first embodiment, communication terminal device Dev1 is replaced with communication terminal device Dev1G and communication terminal device Dev2 is replaced with communication terminal device Dev2G. Otherwise, the narrowband transmission line communication system 10000 of the tenth embodiment is the same as the narrowband transmission line communication system 1000 of the first embodiment.
[0393] As shown in Figure 32, the communication terminal device Dev1G has a configuration in which an image input processing unit 11b is added to the communication terminal device Dev1 of the first embodiment, and the digital signal communication unit 13 is replaced with a digital signal communication unit 13E.
[0394] The image input processing unit 11b receives image data and either (1) outputs the data including the image data as data D12G to the digital signal communication unit 13E, or (2) performs image compression processing on the input image data (for example, image compression processing using orthogonal transformation or processing to resize (reduce) the image size (for example, processing to acquire thumbnail image data)), and outputs the data after image compression processing as data D12G to the digital signal communication unit 13E. In addition to the functions of the digital signal communication unit 13 in the first embodiment, the digital signal communication unit 13E receives data D12G from the image input processing unit 11b. The digital signal communication unit 13E generates transmission digital data Dtx.digit, which includes data D12 output from the speech recognition text acquisition processing unit 12 and data D12G, and outputs the transmission digital data Dtx.digit to the narrowband communication device DevCom1.
[0395] Furthermore, the digital signal communication unit 13E may monitor the status of the narrowband transmission path and, if it determines that the narrowband transmission path is congested, instruct the image input processing unit 11b to change the processing details of the image compression process (for example, the compression ratio or resizing ratio) so that the compression size is appropriate. The image input processing unit 11b may then change (determine) the processing details of the image compression process in response to this instruction.
[0396] As shown in Figure 33, the communication terminal device Dev2G has a configuration in which the digital signal communication unit 21 is replaced with a digital signal communication unit 21E and an image acquisition processing unit 29 is added, compared to the communication terminal device Dev2 of the first embodiment.
[0397] In addition to the functions of the digital signal communication unit 21, the digital signal communication unit 21E acquires image data D21_img contained in the data Drx.digit and outputs the acquired data D21_img to the image acquisition processing unit 29.
[0398] The image acquisition processing unit 29 receives the data D21_img output from the digital signal communication unit 21E. If the data D21_img is (uncompressed) image data, it acquires the image data as output data Do.img and outputs it, for example, to an internal or external display unit (not shown). On the other hand, if the data D21_img is compressed image data (compressed image data), the image acquisition processing unit 29 performs image decompression processing to acquire the processed data (image data). The image acquisition processing unit 29 then outputs the acquired data, for example, to an internal or external display unit (not shown).
[0399] As described above, the communication system 7000 for narrowband transmission lines of the 10th embodiment can transmit text data, image data, or compressed image data (for example, data obtained by image compression processing, or image data with resized data size (for example, thumbnail image data)) from the transmitting communication terminal device to the receiving transmitting device.
[0400] In addition, in the narrowband transmission line communication system 10000, half-duplex communication may be performed by (1) adding a receiving function unit and device to the transmitting function unit and device, and (2) adding a transmitting function unit and device to the receiving function unit and device, and performing processing in the same manner as in the second embodiment.
[0401] [Other embodiments] In the above embodiments (including modified examples), any two or more embodiments (modified examples) may be combined to realize a communication system for a narrowband transmission line and a communication terminal device.
[0402] In the above embodiments (including modifications), the case where the narrowband transmission path is a wireless transmission path has been described, but the invention is not limited to this, and the narrowband transmission path may be a wired transmission path or a transmission path that combines wired and wireless connections.
[0403] Furthermore, in the communication system for narrowband transmission lines of the above embodiment (including modified versions), data compression / decompression processing may be performed during communication between the transmitting and receiving sides, or encrypted communication may be performed.
[0404] Furthermore, although the above embodiments (including modifications) describe the case where the transmission path is narrowband, the invention is not limited to this. For example, the communication processing method used in the narrowband transmission path communication system of the present invention may be applied to a communication system using a wideband transmission path. In other words, since the amount of information required for voice communication can be dramatically reduced in the narrowband transmission path communication system of the present invention, applying the communication processing method used in the narrowband transmission path communication system of the present invention to a communication system using a wideband transmission path makes it possible to send and receive more information than before.
[0405] Furthermore, in the narrowband transmission line communication system and communication terminal device described in the above embodiments (including modified examples), each block may be individually integrated into a single chip using semiconductor devices such as LSIs, or it may be integrated into a single chip including part or all of the blocks.
[0406] Although we have used the term LSI here, depending on the degree of integration, they may also be called IC, system LSI, super LSI, or ultra LSI.
[0407] Furthermore, the method of integrated circuit implementation is not limited to LSIs; it may also be implemented using dedicated circuits or general-purpose processors. After LSI manufacturing, FPGAs (Field Programmable Gate Arrays) that can be programmed, or reconfigurable processors that allow for the reconfiguration of the connections and settings of circuit cells inside the LSI, may also be used.
[0408] Furthermore, some or all of the processing of each functional block in each of the above embodiments (including modified versions) may be implemented by a program. And some or all of the processing of each functional block in each of the above embodiments is performed by a central processing unit (CPU) in a computer. The programs for each of these processes are stored in a storage device such as a hard disk or ROM, and are read from the ROM or RAM and executed.
[0409] Furthermore, each of the processes in the above embodiments (including modified versions) may be implemented by hardware, or by software (including cases where it is implemented together with an OS (operating system), middleware, or a predetermined library). Moreover, it may be implemented by a mixed process of software and hardware.
[0410] Furthermore, for example, when each functional unit of the above embodiment (including modified examples) is implemented by software, the hardware configuration shown in Figure 34 (for example, a hardware configuration in which a CPU (which may be a GPU), ROM, RAM, input unit, output unit, etc. are connected by a bus) may be used to implement each functional unit by software processing.
[0411] Furthermore, when each of the functional units of the above embodiments (including modified examples) is implemented by software, the software may be implemented using a single computer having the hardware configuration shown in Figure 34, or it may be implemented by distributed processing using multiple computers.
[0412] Furthermore, the execution order of the processing method in the above embodiments is not necessarily limited to the description of the embodiments, and the execution order can be changed without departing from the spirit of the invention. Also, in the processing method in the above embodiments, some steps may be executed in parallel with other steps without departing from the spirit of the invention.
[0413] A computer program that causes a computer to execute the method described above, and a computer-readable recording medium on which such program is recorded, are included in the scope of the present invention. Examples of computer-readable recording media include flexible disks, hard disks, CD-ROMs, MOs, DVDs, DVD-ROMs, DVD-RAMs, high-capacity DVDs, next-generation DVDs, and semiconductor memory.
[0414] The above-mentioned computer program is not limited to one recorded on the above-mentioned recording medium, but may also be transmitted via telecommunications lines, wireless or wired communication lines, networks such as the Internet, etc.
[0415] It should be noted that the specific configuration of the present invention is not limited to the embodiments described above, and various changes and modifications are possible without departing from the spirit of the invention.
[0416] [Note] The present invention can also be expressed as follows.
[0417] The first invention is a communication system for a narrowband transmission line that performs communication using a narrowband transmission line, comprising a transmitting device and a receiving device.
[0418] The transmitting device comprises a first communication terminal device and a first narrowband communication device.
[0419] The receiving device is a receiving device that communicates with the transmitting device via a narrowband transmission path, and comprises a second communication terminal device and a second narrowband communication device.
[0420] The first communication terminal device of the transmitting device comprises an audio input unit, an audio recognition text acquisition processing unit, and a first digital signal communication unit.
[0421] The audio input unit is a functional unit that can receive audio signals.
[0422] The speech recognition text acquisition processing unit performs speech recognition processing on the audio signal input to the input unit and acquires text data corresponding to the audio signal.
[0423] The first digital signal communication unit has a communication interface function that enables it to send and receive digital signals, and generates a digital signal for transmission that includes text data acquired by the speech recognition text acquisition processing unit.
[0424] The first narrowband communication device of the transmitting device converts the digital signal for transmission into a communication signal that can be transmitted over a narrowband transmission path, and transmits the converted communication signal to the second narrowband communication device.
[0425] The second narrowband communication device of the receiving device receives the communication signal transmitted from the first narrowband communication device and acquires a signal corresponding to the digital signal for transmission from the communication signal as the received digital signal.
[0426] The second communication terminal device of the receiving device comprises a second digital signal communication unit, a voice synthesis processing unit, and a voice output unit.
[0427] The second digital signal communication unit has a communication interface function that enables it to send and receive digital signals, receives a digital signal, and acquires text data from the received digital signal.
[0428] In this narrowband transmission line communication system, the transmitting communication terminal device (first communication terminal device) converts the voice uttered by the user into text data for speech recognition text acquisition processing, and transmits a wireless communication signal containing this text data from the transmitting narrowband communication device (first narrowband communication device) to the receiving narrowband communication device (second narrowband communication device). The receiving narrowband communication device then receives the communication signal transmitted from the transmitting narrowband communication device, extracts the text data contained in the communication signal, and performs predetermined processing (e.g., speech synthesis) on the extracted text data at the receiving communication terminal device (second communication terminal device). Thus, in this narrowband transmission line communication system, it is only necessary to send and receive text data, which has a dramatically smaller data capacity compared to voice data (because it sends and receives a communication signal containing text data), so stable and highly accurate communication (e.g., voice communication) can be performed using a narrowband transmission line (e.g., a transmission line with a communication speed that can be communicated on a narrowband transmission line (e.g., 40kbps or less)).
[0429] In other words, this narrowband transmission line communication system can achieve stable, high-precision communication (e.g., voice communication) even when simultaneously performing voice communication and large data transfers such as image information, or when multiple voice communications are performed concurrently using the same transmission line.
[0430] A "narrowband transmission path" is, for example, a transmission path that can secure communication speeds ranging from a few kbps to a few Mbps.
[0431] The second invention is the first invention, and the second narrowband communication device further comprises: a speech synthesis processing unit that performs speech synthesis processing on the text data acquired by the second digital signal communication unit and acquires a speech signal; and a speech output unit that outputs speech based on the speech signal acquired by the speech synthesis processing unit. In this narrowband transmission line communication system, the transmitting communication terminal device (first communication terminal device) converts the voice uttered by the user into text data for speech recognition text acquisition processing, and transmits a wireless communication signal containing this text data from the transmitting narrowband communication device (first narrowband communication device) to the receiving narrowband communication device (second narrowband communication device). The receiving narrowband communication device then receives the communication signal transmitted from the transmitting narrowband communication device, extracts the text data contained in the communication signal, and uses the extracted text data for speech synthesis and playback by the receiving communication terminal device (second communication terminal device). Thus, in this narrowband transmission line communication system, it is only necessary to send and receive text data, which has a dramatically smaller data capacity compared to voice data (because it sends and receives a communication signal containing text data), so voice communication can be performed using a narrowband transmission line (for example, a transmission line with a communication speed that can be communicated on a narrowband transmission line (for example, 40kbps or less)).
[0432] In other words, this narrowband transmission line communication system can achieve stable, high-precision communication (e.g., voice communication) even when simultaneously performing voice communication and large data transfers such as image information, or when multiple voice communications are performed concurrently using the same transmission line.
[0433] The third invention is the first invention, wherein the second communication terminal device further comprises an information display unit that displays text data acquired by the second digital signal communication unit.
[0434] As a result, in this narrowband transmission line communication system, the second communication terminal device can display the text data transmitted from the transmitting side, and the words spoken by the transmitting side can be confirmed from the text data.
[0435] The fourth invention is the first invention, wherein the first communication terminal device further comprises a location information acquisition unit that acquires location information of the first communication terminal device.
[0436] The first digital signal communication unit of the first communication terminal device generates a digital signal for transmission that includes text data acquired by the speech recognition text acquisition processing unit and location information.
[0437] The second communication terminal device further comprises a location information extraction unit, a map information storage unit that stores map data, and an information display unit.
[0438] The location information extraction unit extracts location information from the signal received by the second digital signal communication unit of the second communication terminal device.
[0439] The information display unit obtains map data from the map information storage unit that corresponds to the location information extracted by the location information extraction unit, and generates display data that displays the location corresponding to the location information on the obtained map data.
[0440] As a result, in this narrowband transmission line communication system, the second communication terminal device can display the location information of the transmitting communication terminal device on map data.
[0441] The fifth invention is the first invention, wherein the first communication terminal device further comprises a time information acquisition unit that acquires time information of the first communication terminal device.
[0442] The first digital signal communication unit of the first communication terminal device generates a digital signal for transmission that includes the text data acquired by the speech recognition text acquisition processing unit and the time information of when the text data was acquired.
[0443] The second communication terminal device further comprises a time information extraction unit and an information display unit.
[0444] The time information extraction unit extracts time information from the signal received by the second digital signal communication unit of the second communication terminal device.
[0445] The information display unit generates display data to display the time information extracted by the time information extraction unit.
[0446] As a result, in this narrowband transmission line communication system, the second communication terminal device can display time information about when voice was input on the transmitting side.
[0447] The sixth invention is the second invention, the first communication terminal device further comprising: a caller information storage unit that stores the voice characteristics of the caller; and a caller information acquisition unit that acquires caller information by performing voice analysis processing on a voice signal input to a voice input unit based on the voice characteristics stored in the caller information storage unit.
[0448] The first digital signal communication unit of the first communication terminal device generates a digital signal for transmission that includes the text data acquired by the speech recognition text acquisition processing unit and caller information.
[0449] The second communication terminal device further comprises a caller information extraction unit and a voice data storage unit.
[0450] The caller information extraction unit extracts caller information from the signal received by the second digital signal communication unit of the second communication terminal device.
[0451] The speech synthesis processing unit retrieves voice data corresponding to the caller from the voice data storage unit based on the caller information extracted by the caller information extraction unit, and performs speech synthesis processing on the text data based on the voice data.
[0452] As a result, in this narrowband transmission line communication system, the second communication terminal device can display the sender information of the transmitting communication terminal device.
[0453] The seventh invention is the sixth invention, wherein the speech synthesis processing unit identifies the gender of the caller based on the caller information extracted by the caller information extraction unit, and performs speech synthesis processing on the text data so that a voice that reproduces the voice characteristics of the identified gender is reproduced.
[0454] As a result, in this narrowband transmission line communication system, the second communication terminal device can perform speech synthesis processing based on the gender of the sender in the transmitting communication terminal device, and reproduce speech that has speech features corresponding to the sender's gender.
[0455] The eighth invention is the first invention, wherein the first communication terminal device further comprises a summarization processing unit that performs summarization processing on text data acquired by a speech recognition text acquisition processing unit and acquires summarized text data.
[0456] The first digital signal communication unit of the first communication terminal device generates a digital signal for transmission that includes the summarized text data acquired by the summarization processing unit as text data.
[0457] As a result, this narrowband transmission line communication system only needs to send and receive summarized text data, further reducing the amount of data that needs to be transmitted.
[0458] The ninth invention is the first invention, wherein the first communication terminal device further comprises an intent interpretation processing unit that performs intent interpretation processing on text data acquired by a speech recognition text acquisition processing unit and acquires reference number data that reflects the intent interpretation result.
[0459] The first digital signal communication unit of the first communication terminal device generates a digital signal for transmission that includes the reference number data acquired by the intent interpretation processing unit as text data.
[0460] The second communication terminal device further includes an intent interpretation text acquisition processing unit.
[0461] The intent interpretation text acquisition processing unit acquires reference number data from the signal received by the second digital signal communication unit of the second communication terminal device, and acquires text data corresponding to the acquired reference number data.
[0462] The speech synthesis processing unit performs speech synthesis processing on the text data acquired by the intent interpretation text acquisition processing unit.
[0463] As a result, this narrowband transmission line communication system only needs to send and receive a reference number indicating the intent interpretation of the speech-recognized text data, thus further reducing the amount of communication data required.
[0464] The tenth invention is the second invention, wherein the second communication terminal device further comprises a translation processing unit.
[0465] The translation processing unit obtains translated text data by performing a translation process on the text data contained in the signal received by the second digital signal communication unit of the second communication terminal device into a predetermined target language.
[0466] The speech synthesis processing unit performs speech synthesis processing on the translated text data obtained by the translation processing unit.
[0467] As a result, in this narrowband transmission line communication system, the receiving communication terminal device can use translated text data translated into a predetermined target language to perform speech synthesis and speech playback.
[0468] The eleventh invention is the second invention, wherein the first communication terminal device further comprises a text input unit on which a user can input text.
[0469] The first digital signal communication unit of the first communication terminal device generates a digital signal for transmission that includes text data acquired by the speech recognition text acquisition processing unit and / or text data input to the text input unit.
[0470] The second communication terminal device further includes an information display unit.
[0471] The information display unit extracts speech recognition text data, which is text data acquired by the speech recognition text acquisition processing unit, and / or manually entered text data, which is text data entered into the text input unit, from the signal received by the second digital signal communication unit of the second communication terminal device.
[0472] The speech synthesis processing unit performs speech synthesis on speech recognition text data and / or manually entered text data.
[0473] The information display unit generates display data for displaying speech recognition text data and / or manually entered text data.
[0474] As a result, in this narrowband transmission line communication system, the voice input to the transmitting communication terminal is converted into text using speech recognition processing, and the converted text data is sent to the receiving side. Subsequently, the user can manually input the correct text data of the spoken words into the transmitting communication terminal and send that text data to the receiving side. The receiving communication terminal can then display both (1) the text data obtained by the speech recognition processing on the transmitting side and (2) the correct text data (the correct text data of the spoken words (the text data manually entered by the user)) on its speech synthesis, speech playback, and display unit. Therefore, even if the accuracy of the speech recognition text acquisition processing on the transmitting communication terminal is poor, the correct data (accurate text data of the spoken words) can be reliably transmitted from the transmitting side to the receiving side.
[0475] The twelfth invention is the first invention, further comprising an image input processing unit that inputs image data and outputs the image data or compressed image data of the image data to a first digital signal communication unit.
[0476] The first digital signal communication unit of the first communication terminal device generates a digital signal for transmission that includes text data acquired by the speech recognition text acquisition processing unit and / or image data or image compression data acquired by the image input processing unit.
[0477] The second communication terminal device further includes an image acquisition processing unit.
[0478] The image acquisition process involves acquiring image data or compressed image data from the signal received by the second digital signal communication unit of the second communication terminal device.
[0479] This allows this narrowband transmission line communication system to transmit not only text data but also image data, or compressed image data (for example, data obtained through image compression processing, or image data with resized data size (for example, thumbnail image data)) from the transmitting communication terminal device to the receiving transmitting device.
[0480] The 13th invention is a communication system for a narrowband transmission line that can perform broadcast communication, (1) A transmitting device used in a narrowband transmission line communication system which is one of the inventions of the second to twelfth inventions, (2) A receiving device used in a narrowband transmission line communication system which is an invention of any of the second to twelfth inventions, It is equipped with.
[0481] Then, a signal transmitted from one transmitting device is received by each of the multiple receiving devices.
[0482] This allows this narrowband transmission line communication system to broadcast a signal transmitted from one transmitting device and receive it on multiple receiving devices.
[0483] The fourteenth invention is the thirteenth invention, wherein the transmitting device transmits a device identifier that identifies itself from the first digital signal communication unit.
[0484] When the receiving device performs speech synthesis or speech playback using text data transmitted from the transmitting device, it sends a delivery confirmation signal to the transmitting device indicating that it has confirmed that speech synthesis or speech playback using text data has been performed.
[0485] This enables authenticated broadcast communication in this narrowband transmission line communication system. In other words, the receiving communication terminal can easily identify the source (transmitting device) by displaying, for example, an indication of the transmitting device based on the device identifier.
[0486] The 15th invention is a communication system for a narrowband transmission line that performs half-duplex communication using a narrowband transmission line, comprising a first device and a second device.
[0487] The first device is A first transmitting-side functional unit, which is a functional unit of a first communication terminal device used in a narrowband transmission line communication system that is an invention of any of the first to twelfth inventions, A first receiving-side functional unit, which is a functional unit of a second communication terminal device used in a narrowband transmission line communication system that is an invention of any of the first to twelfth inventions, A first control unit that sets the communication mode to either transmission mode or reception mode, A first narrowband half-duplex communication device capable of transmitting and receiving over a narrowband transmission path, It is equipped with.
[0488] The second device is A second transmitting-side functional unit, which is a functional unit of a first communication terminal device used in a narrowband transmission line communication system that is an invention of any of the first to twelfth inventions, A second receiving-side functional unit, which is a functional unit of a second communication terminal device used in a narrowband transmission line communication system that is an invention of any of the first to twelfth inventions, A second control unit that sets the communication mode to either transmission mode or reception mode, A second narrowband half-duplex communication device capable of transmitting and receiving via a narrowband transmission path, It is equipped with. (1) When the first control unit sets the communication mode to transmit mode, or when the second control unit sets the communication mode to receive mode, The first device is The first transmitting function unit is set to the operating state. The first narrowband half-duplex communication device is set to a state where it can transmit signals. The second device is The second receiving function unit is set to the operating state. The second narrowband half-duplex communication device is set to a state where it can receive signals. (2) When the first control unit sets the communication mode to receive mode, or when the second control unit sets the communication mode to transmit mode, The first device is The first receiving function unit is set to the operating state. The first narrowband half-duplex communication device is set to a state where it can receive signals. The second device is The second transmitting function unit is set to the operating state. The second narrowband half-duplex communication device is brought into a state where it can transmit signals.
[0489] As a result, this narrowband transmission line communication system enables half-duplex communication between the first and second devices.
[0490] The sixteenth invention is a communication system for a narrowband transmission line that performs communication using a narrowband transmission line, comprising a transmitting device and a receiving device.
[0491] The transmitting device is Multiple first communication terminal devices, A communication device for a first access point that can communicate with multiple first communication terminal devices, A first server device connected to a communication device for access points, First narrowband communication device connected to the first server device and It is equipped with.
[0492] The receiving device is A receiving device that communicates with a transmitting device via a narrowband transmission path, Multiple second communication terminal devices, A communication device for a second access point that can communicate with multiple second communication terminal devices, A second server device connected to the communication device for the access point, The second narrowband communication device is connected to the first server device. It is equipped with.
[0493] Each of the first communication terminal devices is: An audio input section that can receive audio signals, A speech recognition text acquisition processing unit performs speech recognition processing on the audio signal input to the input unit and acquires text data corresponding to the audio signal. A first digital signal communication unit has a communication interface function capable of sending and receiving digital signals, and generates a digital signal for transmission that includes text data acquired by a speech recognition text acquisition processing unit, It is equipped with.
[0494] The communication device for the first access point receives signals from one or more first communication terminal devices and transmits the received signals to the first server device.
[0495] The first server device generates an aggregated digital transmission signal by aggregating signals from one or more first communication terminal devices received from the first access point communication device.
[0496] The first narrowband communication device of the transmitting device converts the aggregated digital transmission signal into a communication signal that can be transmitted over a narrowband transmission path, and transmits the converted communication signal to the second narrowband communication device.
[0497] The second narrowband communication device of the receiving device receives the communication signal transmitted from the first narrowband communication device and acquires a signal corresponding to the digital signal for transmission from the communication signal as a received aggregated digital signal.
[0498] The second server device separates the received aggregated digital signals according to their destination.
[0499] The communication device for the second access point separates the received aggregated digital signal for each destination and transmits the acquired received digital signal to the destination.
[0500] The second communication terminal device of the receiving device is, It has a communication interface function capable of sending and receiving digital signals, is separated by a second access point communication device, and includes a second digital signal communication unit that receives a receiving digital signal to which the device is destined and acquires text data from the received digital signal.
[0501] This narrowband transmission line communication system enables communication between multiple user terminal devices on the transmitting side and multiple user terminal devices on the receiving side.
[0502] This narrowband transmission line communication system can transmit and receive text data, which has a dramatically smaller data capacity than voice data (it can transmit and receive wireless communication signals that include text data). Therefore, even in situations where only a narrowband transmission line can be secured, it is possible to establish multiple communication connections and achieve stable, high-precision communication.
[0503] In other words, this narrowband transmission line communication system can achieve stable and high-precision communication (for example, communication of voice and additional information (sender information)) even when voice communication and large data transfers such as image information are performed simultaneously, or when multiple voice communications are performed concurrently using the same transmission line.
[0504] The 17th invention is the 16th invention, wherein the second communication terminal device further comprises a speech synthesis processing unit that performs speech synthesis processing on text data acquired by the second digital signal communication unit and acquires a speech signal, and a speech output unit that outputs speech based on the speech signal acquired by the speech synthesis processing unit.
[0505] This narrowband transmission line communication system can transmit and receive text data, which has a dramatically smaller data capacity than voice data (it can transmit and receive wireless communication signals that include text data). Therefore, even in situations where only a narrowband transmission line can be secured, it is possible to establish multiple communication connections and achieve stable, high-precision communication.
[0506] In other words, this narrowband transmission line communication system can achieve stable and high-precision communication (for example, communication of voice and additional information (sender information)) even when voice communication and large data transfers such as image information are performed simultaneously, or when multiple voice communications are performed concurrently using the same transmission line.
[0507] The 18th invention is a transmitting device used in a narrowband transmission line communication system which is one of the inventions from the 1st to the 12th.
[0508] This makes it possible to realize a transmitting device used in a narrowband transmission line communication system that is one of the inventions from the first to the twelfth invention.
[0509] The 19th invention is a receiving device used in a narrowband transmission line communication system which is one of the inventions from the 1st to the 12th.
[0510] This makes it possible to realize a receiving device used in a narrowband transmission line communication system that is one of the inventions from the first to the twelfth invention.
[0511] The 20th invention is a first communication terminal device used in a narrowband transmission line communication system which is one of the inventions from the 1st to the 12th.
[0512] This makes it possible to realize a first communication terminal device used in a narrowband transmission line communication system, which is an invention of any of the first to twelfth inventions.
[0513] The 21st invention is a second communication terminal device used in a narrowband transmission line communication system which is one of the inventions from the 1st to the 12th inventions.
[0514] This makes it possible to realize a second communication terminal device used in a narrowband transmission line communication system, which is an invention of any of the first to twelfth inventions. [Explanation of symbols]
[0515] 1000, 2000, 3000, 4000, 5000, 6000, 6000A, 7000, 7000A, 8000, 9000, 10000 Narrowband Transmission Line Communication System 11, 11A Audio Input Section 11b Image input processing unit 12. Speech Recognition Text Acquisition Processing Unit 12a Summary Processing Unit 12b Intent Interpretation Processing Unit 13, 13A, 13B, 13C, 13D Digital signal communication section 14. Speech Synthesis Processing Unit 15 Audio output section 16 Location information acquisition section 17. Time Information Acquisition Unit 18. Caller Recognition Processing Unit 21, 21A, 21B, 21C, 21D, 21E Digital signal communication section 22A Speech Synthesis Processing Unit 22a Intent Interpretation Text Acquisition Processing Unit 22b Translation Processing Unit 23 Audio output section 26B Location information extraction section 26C Time information extraction section 26D Caller Information Extraction Unit 27 Map Information Storage Unit 28, 28A, 28B Information display section 29 Image acquisition processing unit
Claims
1. A narrowband transmission line communication system that performs communication using a narrowband transmission line, A transmitting device comprising a first communication terminal device and a first narrowband communication device, A receiving device that communicates with the transmitting device via the aforementioned narrowband transmission path, comprising a second communication terminal device and a second narrowband communication device, Equipped with, The first communication terminal device of the transmitting device is An audio input section that can receive audio signals, A speech recognition text acquisition processing unit performs speech recognition processing on the audio signal input to the input unit and acquires text data corresponding to the audio signal. A first digital signal communication unit has a communication interface function capable of sending and receiving digital signals, and generates a digital signal for transmission that includes the text data acquired by the speech recognition text acquisition processing unit, Equipped with, The first narrowband communication device of the transmitting device is The digital signal for transmission is converted into a communication signal that can be transmitted over the narrowband transmission path, and the converted communication signal is transmitted to the second narrowband communication device. The second narrowband communication device of the receiving device is The communication signal transmitted from the first narrowband communication device is received, and a signal corresponding to the digital signal for transmission is obtained from the communication signal as a received digital signal. The second communication terminal device of the receiving device is It has a communication interface function capable of sending and receiving digital signals, and includes a second digital signal communication unit that receives the received digital signal and acquires text data from the received digital signal. A communication system for narrowband transmission lines.
2. The second narrowband communication device is A speech synthesis processing unit performs speech synthesis processing on the text data acquired by the second digital signal communication unit and acquires a speech signal. Based on the audio signal acquired by the audio synthesis processing unit, an audio output unit outputs audio, Furthermore, A communication system for a narrowband transmission line according to claim 1.
3. The second communication terminal device is The system further includes an information display unit that displays the text data acquired by the second digital signal communication unit. A communication system for a narrowband transmission line according to claim 1.
4. The first communication terminal device is The system further includes a location information acquisition unit that acquires location information of the first communication terminal device, The first digital signal communication unit of the first communication terminal device is: The speech recognition text acquisition processing unit generates a digital signal for transmission that includes the text data acquired and the location information. The second communication terminal device is It further comprises a location information extraction unit, a map information storage unit that stores map data, and an information display unit. The aforementioned location information extraction unit, The second digital signal communication unit of the second communication terminal device extracts the location information from the signal it receives, The aforementioned information display unit is Map data of the area surrounding the location corresponding to the location information extracted by the location information extraction unit is obtained from the map information storage unit, and display data is generated such that the location corresponding to the location information is displayed on the obtained map data. A communication system for a narrowband transmission line according to claim 1.
5. The first communication terminal device is The system further comprises a time information acquisition unit that acquires time information of the first communication terminal device, The first digital signal communication unit of the first communication terminal device is: The speech recognition text acquisition processing unit generates a digital signal for transmission that includes the text data acquired and the time information when the text data was acquired. The second communication terminal device is It further comprises a time information extraction unit and an information display unit, The aforementioned time information extraction unit, The second digital signal communication unit of the second communication terminal device extracts the time information from the signal it receives, The aforementioned information display unit is The time information extraction unit generates display data for displaying the time information extracted by the time information extraction unit. A communication system for a narrowband transmission line according to claim 1.
6. The first communication terminal device is A caller information storage unit that stores the voice characteristics of the caller, A caller information acquisition unit acquires caller information by performing voice analysis processing on the voice signal input to the voice input unit based on the voice feature quantities stored in the caller information storage unit, Furthermore, The first digital signal communication unit of the first communication terminal device is: The speech recognition text acquisition processing unit generates a digital signal for transmission that includes the text data acquired and the caller information. The second communication terminal device is It further includes a caller information extraction unit and an audio data storage unit, The aforementioned caller information extraction unit, The second digital signal communication unit of the second communication terminal device extracts the caller information from the signal it receives, The aforementioned speech synthesis processing unit, Based on the caller information extracted by the caller information extraction unit, voice data corresponding to the caller is obtained from the voice data storage unit, and speech synthesis processing is performed on the text data based on the voice data. A communication system for a narrowband transmission line according to claim 2.
7. The aforementioned speech synthesis processing unit, Based on the caller information extracted by the caller information extraction unit, the gender of the caller is identified, and speech synthesis processing is performed on the text data so that speech is reproduced that reproduces the voice characteristics of the identified gender. A communication system for a narrowband transmission line according to claim 6.
8. The first communication terminal device is The system further includes a summarization processing unit that performs summarization processing on the text data acquired by the speech recognition text acquisition processing unit and acquires summarized text data. The first digital signal communication unit of the first communication terminal device is: The summarization processing unit generates a digital signal for transmission that includes the summarization text data acquired by the summarization processing unit as text data. A communication system for a narrowband transmission line according to claim 1.
9. The first communication terminal device is The system further comprises an intent interpretation processing unit that performs intent interpretation processing on the text data acquired by the aforementioned speech recognition text acquisition processing unit and acquires reference number data that reflects the intent interpretation result, The first digital signal communication unit of the first communication terminal device is: The reference number data acquired by the intent interpretation processing unit is included as text data in a digital signal for transmission, The second communication terminal device is Further equipped with an intent interpretation text acquisition processing unit, The aforementioned intent interpretation text acquisition processing unit, The second digital signal communication unit of the second communication terminal device acquires the reference number data from the signal it receives, and acquires text data corresponding to the acquired reference number data. The aforementioned speech synthesis processing unit, The text data obtained by the intent interpretation text acquisition processing unit is subjected to speech synthesis processing. A communication system for a narrowband transmission line according to claim 2.
10. The second communication terminal device is Further equipped with a translation processing unit, The aforementioned translation processing unit The second digital signal communication unit of the second communication terminal device performs a translation process on the text data contained in the received signal into a predetermined target language, thereby obtaining translated text data. The aforementioned speech synthesis processing unit, The translated text data obtained by the translation processing unit is subjected to speech synthesis processing. A communication system for a narrowband transmission line according to claim 2.
11. The first communication terminal device is It also includes a text input area where the user can enter text, The first digital signal communication unit of the first communication terminal device is: The speech recognition text acquisition processing unit generates a digital signal for transmission that includes the text data acquired and / or the text data input to the text input unit. The second communication terminal device is It also includes an information display unit, The aforementioned information display unit is From the signals received by the second digital signal communication unit of the second communication terminal device, the speech recognition text data, which is text data acquired by the speech recognition text acquisition processing unit, and / or the manually input text data, which is text data input to the text input unit, are extracted. The aforementioned speech synthesis processing unit, Speech synthesis is performed on the speech recognition text data and / or the manually entered text data. The aforementioned information display unit is To generate display data for displaying the aforementioned speech recognition text data and / or the aforementioned manually entered text data, A communication system for a narrowband transmission line according to claim 2.
12. The first communication terminal device is The system further includes an image input processing unit that inputs image data and outputs the image data or compressed image data of the image data to the first digital signal communication unit, The first digital signal communication unit of the first communication terminal device is: The speech recognition text acquisition processing unit generates a digital signal for transmission that includes the text data acquired by the speech recognition text acquisition processing unit and / or the image data or image compression data acquired by the image input processing unit. The second communication terminal device is Further equipped with an image acquisition processing unit, The aforementioned image acquisition process is as follows: The second digital signal communication unit of the second communication terminal device acquires the image data or the image compression data from the signal it receives. A communication system for a narrowband transmission line according to claim 1.
13. A communication system for a narrowband transmission line that can perform broadcast communication, One transmitting device used in a narrowband transmission line communication system according to any one of claims 2 to 12, A plurality of receiving devices used in a narrowband transmission line communication system according to any one of claims 2 to 12, Equipped with, Each of the plurality of receiving devices receives the signal transmitted from the one transmitting device. A communication system for narrowband transmission lines.
14. The transmitting device is, The first digital signal communication unit transmits a device identifier that identifies the device itself, The receiving device is, When speech synthesis and playback are performed using text data transmitted from the transmitting device, a delivery confirmation signal is sent to the transmitting device to indicate that speech synthesis and playback have been performed using the text data. A communication system for a narrowband transmission line according to claim 13.
15. A narrowband transmission line communication system that performs half-duplex communication using a narrowband transmission line, The first device and The second device, Equipped with, The first apparatus is A first transmitting-side functional unit which is a functional unit of the first communication terminal device used in the narrowband transmission line communication system according to any one of claims 1 to 12, A first receiving-side functional unit which is a functional unit of the second communication terminal device used in the narrowband transmission line communication system according to any one of claims 1 to 12, A first control unit that sets the communication mode to either transmission mode or reception mode, A first narrowband half-duplex communication device capable of transmitting and receiving over a narrowband transmission path, Equipped with, The second device is A second transmitting-side functional unit which is a functional unit of the first communication terminal device used in the narrowband transmission line communication system according to any one of claims 1 to 12, A second receiving-side functional unit which is a functional unit of the second communication terminal device used in the narrowband transmission line communication system according to any one of claims 1 to 12, A second control unit that sets the communication mode to either transmission mode or reception mode, A second narrowband half-duplex communication device capable of transmitting and receiving via a narrowband transmission path, Equipped with, (1) When the first control unit sets the communication mode to the transmission mode, or the second control unit sets the communication mode to the reception mode, The first apparatus is The first transmitting function unit is set to the operating state. The first narrowband half-duplex communication device is set to a state where it can transmit a signal. The second device is The second receiving function unit is set to the operating state, The second narrowband half-duplex communication device is set to a state where it can receive signals. (2) When the first control unit sets the communication mode to receive mode, or the second control unit sets the communication mode to transmit mode, The first apparatus is The first receiving function unit is set to the operating state, The first narrowband half-duplex communication device is set to a state where it can receive signals. The second device is The second transmitting function unit is set to the operating state. The second narrowband half-duplex communication device is brought into a state where it can transmit signals. A communication system for narrowband transmission lines.
16. A narrowband transmission line communication system that performs communication using a narrowband transmission line, Multiple first communication terminal devices, A communication device for a first access point that can communicate with the aforementioned plurality of first communication terminal devices, A first server device connected to the aforementioned access point communication device, The first narrowband communication device connected to the first server device and A transmitting device equipped with, A receiving device that communicates with the transmitting device via the aforementioned narrowband transmission path, Multiple second communication terminal devices, A communication device for a second access point that can communicate with the aforementioned plurality of second communication terminal devices, A second server device connected to the aforementioned access point communication device, The second narrowband communication device is connected to the first server device. A receiving device equipped with, Equipped with, Each of the first communication terminal devices is: An audio input section that can receive audio signals, A speech recognition text acquisition processing unit performs speech recognition processing on the audio signal input to the input unit and acquires text data corresponding to the audio signal. A first digital signal communication unit has a communication interface function capable of sending and receiving digital signals, and generates a digital signal for transmission that includes the text data acquired by the speech recognition text acquisition processing unit, Equipped with, The communication device for the first access point is, The first server device receives signals from one or more of the first communication terminal devices and transmits the received signals to the first server device. The first server device is A consolidated digital transmission signal is generated by aggregating signals from one or more first communication terminal devices received from the first access point communication device. The first narrowband communication device of the transmitting device is The aggregated digital signal is converted into a communication signal that can be transmitted over the narrowband transmission path, and the converted communication signal is transmitted to the second narrowband communication device. The second narrowband communication device of the receiving device is The communication signal transmitted from the first narrowband communication device is received, and a signal corresponding to the transmission digital signal is obtained from the communication signal as a received aggregated digital signal. The second server device is The received aggregated digital signal is separated for each transmission destination, The communication device for the second access point is, The received digital signals, obtained by separating the aggregated received digital signals for each destination, are transmitted to the destinations. The second communication terminal device of the receiving device is, The device has a communication interface function capable of sending and receiving digital signals, is separated by the second access point communication device, and includes a second digital signal communication unit that receives the received digital signal to which the device is the destination and acquires text data from the received digital signal. A communication system for narrowband transmission lines.
17. The second communication terminal device is, A speech synthesis processing unit performs speech synthesis processing on the text data acquired by the second digital signal communication unit and acquires a speech signal. Based on the audio signal acquired by the audio synthesis processing unit, an audio output unit outputs audio, Furthermore, A communication system for a narrowband transmission line according to claim 16.
18. The transmitting device used in a narrowband transmission line communication system according to any one of claims 1 to 12.
19. The receiving device used in a narrowband transmission line communication system according to any one of claims 1 to 12.
20. The first communication terminal device used in a narrowband transmission line communication system according to any one of claims 1 to 12.
21. The second communication terminal device used in a narrowband transmission line communication system according to any one of claims 1 to 12.
Citation Information
Patent Citations
Information communication device and information communication control program
JP2023157788A