Communication system, information terminal device, server, communication method, and communication program

Abstract

To provide a communication system for allowing people who speak different languages to naturally communicate with each other, an information terminal device, a server, a method, and a program.SOLUTION: A method in a communication system 20 includes: receiving a beacon ID identifying the beacon device when a short-range communication unit 431 of a first information terminal device 400 establishes communication with a beacon device 300; transmitting, by a communication unit 432,to a server device 500, the beacon ID and a first language which is a language type stored in a storage unit 120; transmitting, by a communication unit 530 of the server, the first language to a second information terminal device 600 corresponding to the beacon ID received from the first information terminal device; receiving, by a communication unit 632 of the second information terminal device, the first language from the server; receiving, by a voice input / output unit 240, an input of voice; converting, by a character conversion unit 211, the voice into characters; translating, by a translation unit 212, the converted characters into characters in the first language received from the server; and displaying, by a display unit 260, the translated characters.SELECTED DRAWING: Figure 5

Description

[Technical Field]

[0001] The present invention relates to a communication system, an information terminal device, a server, communication Methods, and communication Regarding the program. [Background technology]

[0002] In recent years, domestic inbound demand has expanded, with people from various countries visiting Japan for tourism. Many translation devices and translation systems have been provided to enable smooth communication with these visitors. One of these systems is a two-way speech translation system that executes a process of synthesizing speech translated from a first language into a second language, and a process of synthesizing speech translated from the second language into the first language (Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2023-022150 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the technology described in Patent Document 1 requires travelers to first operate a two-way speech translation system and speak in their own language, which makes it difficult for Japanese speakers to start a natural conversation with travelers.

[0005] The present invention has been made in view of the above, and provides a communication system, an information terminal device, a server, and a method for communicating with people who speak different languages ​​in a natural way. communication Methods, and communication The purpose is to provide a program. [Means for solving the problem]

[0006] In order to solve the above-mentioned problems, When the first information terminal device is able to communicate with the beacon device, it receives a beacon ID that identifies the beacon device, and transmits the received beacon ID and a first language, which is a language type to be stored in the storage unit of the first information terminal device, to the server, and the server transmits the first language to the second information terminal device corresponding to the beacon ID received from the first information terminal device, and the second information terminal device receives the first language from the server, accepts voice input, converts the voice into characters, translates the converted characters into characters in the first language received from the server, and displays the translated characters. It is characterized by: [Effects of the Invention]

[0007] According to the present invention configured as described above, it is possible to achieve the effect that people who speak different languages ​​can communicate naturally. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a block diagram showing a configuration of a communication system 10 according to a first embodiment. [Figure 2] 10 is a flowchart showing a translation processing procedure executed by the information terminal device 100 and the information terminal device 200. [Figure 3] FIG. 2 is an explanatory diagram showing an example of the flow of translation processing in the first embodiment. [Figure 4] 10 is a flowchart showing a translation processing procedure executed by the information terminal device 100 and the information terminal device 200 in low-power wireless communication or the like. [Figure 5] FIG. 10 is a block diagram showing a configuration of a communication system 20 according to a second embodiment. [Figure 6] 10 is a flowchart showing a translation processing procedure executed by the beacon device 300, the information terminal device 400, the server 500, and the information terminal device 600. [Figure 7] FIG. 10 is an explanatory diagram showing an example of the flow of translation processing in the second embodiment. [Figure 8] 10 is a flowchart showing a translation processing procedure executed by the beacon device 300, the information terminal device 400, the server 500, and the information terminal device 600. [Figure 9] FIG. 10 is an explanatory diagram illustrating an example of the flow of a translation process. [Figure 10] FIG. 10 is a block diagram showing a configuration of a communication system 30 according to a third embodiment. [Figure 11] 10 is a flowchart showing the procedure of a translation process executed by an information terminal device 700, a server 800, and an information terminal device 900. [Figure 12] FIG. 11 is an explanatory diagram showing an example of the flow of translation processing in the third embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] The following describes the communication system, information terminal device, server, and communication Methods, and communication The following description is an example of an embodiment of the present application, and includes a communication system, an information terminal device, a server, and a communication method according to the present application. communication Methods, and communication The program is not limited to these examples.

[0010] Example 1 1 is a block diagram showing a configuration of a communication system 10 according to Example 1. The communication system 10 includes an information terminal device 100 and an information terminal device 200.

[0011] The information terminal device 100 is a computer operated by a foreign language speaker such as a foreign tourist (hereinafter also referred to as the first speaker), and may be a wearable device, smartphone, tablet device, personal computer (hereinafter also referred to as a PC), etc. The information terminal device 200 is a computer operated by a Japanese speaker (hereinafter also referred to as the second speaker) who converses with the first speaker, and may be a wearable device, smartphone, tablet device, PC, etc., like the information terminal device 100. As an example, the wearable device is a vest worn by the first speaker or the second speaker, and the display unit is placed in a position that is easily visible to the conversation partner, such as on the chest of the vest.

[0012] 1, the information terminal device 100 includes a control unit 110, a storage unit 120, a short-range communication unit 130, an audio input / output unit 140, an operation unit 150, and a display unit 160. The control unit 110 reads out programs and the like stored in the storage unit 120 and executes the read out programs to control each unit of the information terminal device 100 and transmit data to each unit.

[0013] The storage unit 120 stores a first language, which is a language type spoken by a first speaker, and a second language, which is a language type spoken by a second speaker who is a conversation partner. The short-range communication unit 130 receives the second language transmitted from the information terminal device 200 and stores it in the storage unit 120. The storage unit 120 stores operation programs for controlling each unit, application programs, various control information, intermediate files, etc.

[0014] The short-range communication unit 130 transmits a first language to the information terminal device 200 and receives a second language from the information terminal device 200. The short-range communication may be infrared communication (IrDA: Infrared Data Association), BLE (Bluetooth Low Energy) communication, low-power wireless communication (half-duplex communication method in the same frequency band), or communication based on WPAN (Wireless Personal Area Network) technology such as Z-Wave (registered trademark) or ZigBee (registered trademark).

[0015] The audio input / output unit 140 receives input of audio uttered by the first speaker, acquired from a microphone or the like. The audio input / output unit 140 outputs audio from a speaker, earphones, headphones or the like. The operation unit 150 receives operations for the information terminal device 100. The display unit 160 is a display or the like that displays characters, images and the like. The operation unit 150 and the display unit 160 may be a touch panel or the like configured by superimposing a liquid crystal display and a touch sensor.

[0016] The control unit 110 will now be described. The control unit 110 includes a character conversion unit 111 and a translation unit 112. The character conversion unit 111 converts the speech of the first speaker received from the speech input / output unit 140 into characters in a first language. The translation unit 112 translates the characters in the first language converted by the character conversion unit 111 into characters in a second language.

[0017] Next, the configuration of information terminal device 200 operated by the second speaker will be described. Information terminal device 200 includes control unit 210, storage unit 220, short-range communication unit 230, audio input / output unit 240, operation unit 250, and display unit 260. Information terminal device 200 is almost identical to information terminal device 100 and has almost the same functions, so the description of each unit of information terminal device 100 will be referred to, and the following will describe the parts that differ from information terminal device 100.

[0018] The storage unit 220 stores the first language transmitted from the information terminal device 100, and stores the second language, which is the language type spoken by the second speaker. The short-range communication unit 230 receives the first language transmitted from the information terminal device 100 and stores it in the storage unit 220. The voice input / output unit 240 accepts input of the voice uttered by the second speaker obtained from a microphone or the like.

[0019] The character conversion unit 211 converts the voice of the second speaker received from the voice input / output unit 240 into characters in the second language. The translation unit 212 translates the characters in the second language converted by the character conversion unit 211 into characters in the first language.

[0020] The translation process executed in the communication system 10 configured as described above will be described. Fig. 2 is a flowchart showing the procedure of the translation process executed by the information terminal device 100 and the information terminal device 200. This flowchart explains processing using infrared communication, BLE communication, etc.

[0021] As advance preparations for information terminal device 100 and information terminal device 200, operation unit 150 of information terminal device 100 accepts input of a first language (step S201) and stores the accepted first language in memory unit 120. Operation unit 250 of information terminal device 200 accepts input of a second language (step S202) and stores the accepted second language in memory unit 220.

[0022] When the information terminal device 100 and the information terminal device 200 enter each other's communication range for short-range communication, the short-range communication unit 130 and the short-range communication unit 230 execute connection processing (step S203). The short-range communication unit 130 transmits the first language (step S204), and the short-range communication unit 230 receives the first language and stores the received first language in the storage unit 220 (step S205). FIG. 3 is an explanatory diagram showing an example of the flow of translation processing in the first embodiment. For example, as shown in (1) and (2) in FIG. 3, the information terminal device 100 transmits "English" as the first language, and "English" is stored as the first language in the storage unit 220 of the information terminal device 200.

[0023] Returning to Fig. 2, the short-range communication unit 230 transmits the second language (step S206). The short-range communication unit 130 receives the second language and stores the received second language in the storage unit 120 (step S207). As shown in (3) and (4) of Fig. 3, "Japanese" is transmitted from the information terminal device 200 as the second language, and "Japanese" is stored as the second language in the storage unit 120 of the information terminal device 100.

[0024] In the information terminal device 200, the voice input / output unit 240 determines whether voice input has been received (step S208). As shown in (5) of FIG. 3, the voice input of "hello" uttered by the second speaker is received. If it is determined that voice input has been received (step S208: Yes), the character conversion unit 211 converts the voice in the second language into characters in the second language (step S209). If it is determined that voice input has not been received (step S208: No), the system waits for voice input in step S208.

[0025] The translation unit 212 translates the converted characters of the second language into characters of the first language (step S210). The display unit 260 displays the characters of the first language (step S211). As shown in (6) of FIG. 3, the display unit 260 displays the characters "Hello.", which are the translation of the speech "Hello" uttered by the second speaker. The speech input / output unit 240 determines whether the speech input has ended (step S212). If it determines that the speech input has not ended (step S212: No), it waits for speech input in step S208. If it determines that the speech input has ended (step S212: Yes), it stores "Not set" in the first language of the storage unit 220 and ends the process. The determination of whether the speech input ends may be made based on whether speech input has been received within a predetermined time or whether short-range communication with the information terminal device 100 is possible.

[0026] The voice input / output unit 140 of the information terminal device 100 determines whether voice input has been received (step S213). For example, as shown in (7) of FIG. 3, the voice input of "Hello" uttered by the first speaker is received. If it is determined that voice input has been received (step S213: Yes), the character conversion unit 111 converts the voice in the first language into characters in the first language (step S214). If it is determined that voice input has not been received (step S213: No), the information terminal device 100 waits for voice input in step S213.

[0027] The translation unit 112 translates the converted characters of the first language into characters of the second language (step S215). The display unit 160 displays the characters of the second language (step S216). As shown in (8) of FIG. 3, the display unit 160 displays the characters "Hello.", which are the translation of the voice "Hello" uttered by the first speaker. The voice input / output unit 140 determines whether the voice input has ended (step S217). If it determines that the voice input has not ended (step S217: No), the voice input is awaited in step S213. If it determines that the voice input has ended (step S217: Yes), "Not set" is stored in the second language of the storage unit 120, and the process ends.

[0028] Regarding the voice input in the above-mentioned steps S208 and S213, after the information terminal device 200 stores the first language in the memory unit 220 and the information terminal device 100 stores the second language in the memory unit 120, either the first speaker or the second speaker may speak first, and thereafter the first and second speakers may speak alternately or one may speak continuously.

[0029] In this way, when the information terminal device 100 operated by the first speaker who is a foreign language speaker approaches the information terminal device 200, the words spoken by the second speaker who is a Japanese speaker are translated into the first language that the first speaker understands and displayed, without the first speaker having to perform any operation himself.

[0030] This allows visitors to hear the language of the country they are visiting while seeing text translated into a language they can understand, so they can enjoy Japanese while easily communicating with Japanese speakers, just like when subtitles are displayed in a TV drama.Japanese speakers can also easily communicate with others by speaking to them in Japanese, without having to worry about what language the other person understands.

[0031] In the above-described embodiment, processing in infrared communication, BLE communication, etc. has been described, but processing in low-power wireless communication will now be described. Fig. 4 is a flowchart showing the translation processing procedure executed by the information terminal device 100 and the information terminal device 200 in low-power wireless communication, etc.

[0032] As advance preparations for information terminal device 100 and information terminal device 200, operation unit 150 of information terminal device 100 accepts input of a first language (step S401) and stores the accepted first language in memory unit 120. Operation unit 250 of information terminal device 200 accepts input of a second language (step S402) and stores the accepted second language in memory unit 220.

[0033] The short-range communication unit 130 of the information terminal device 100 transmits the first language (step S403). The short-range communication unit 130 transmits the first language, for example, in Morse code or another method representing the first language. The short-range communication unit 230 of the information terminal device 200 transmits the second language (step S404). Like the short-range communication unit 130, the communication unit 230 also transmits the second language in Morse code or another method representing the second language.

[0034] The voice input / output unit 240 of the information terminal device 200 determines whether voice input has been received (step S405). If it is determined that voice input has been received (step S405: Yes), the short-range communication unit 230 stops transmitting the second language (step S406). The short-range communication unit 230 receives the first language transmitted from the information terminal device 100 (step S407) and stores the first language in the storage unit 220 (step S408). Because low-power wireless communication is a half-duplex communication method using the same frequency band, radio waves from one device can be received by stopping transmission from the other device. If it is determined that voice input has not been received (step S405: No), the unit waits for voice input in step S405.

[0035] The character conversion unit 211 converts the received speech in the second language into characters in the second language (step S409). The translation unit 212 translates the converted characters in the second language into the first language (step S410). The display unit 260 displays the characters in the first language (step S411). The speech input / output unit 240 determines whether or not speech input has ended (step S412). If it is determined that speech input has not ended (step S412: No), the process waits for speech input in step S405. After receiving the first language, the processes of steps S406 to S408 are not executed, and step S409 and subsequent steps are executed. If it is determined that speech input has ended (step S412: Yes), "Not set" is stored in the first language in the storage unit 220, and the process ends. Whether or not speech input has ended may be determined based on whether speech input has been received within a predetermined time.

[0036] In the information terminal device 100, the voice input / output unit 140 determines whether voice input has been received (step S413). If it is determined that voice input has been received (step S413: Yes), the short-range communication unit 130 stops transmitting the first language (step S414). The short-range communication unit 130 receives the second language transmitted from the information terminal device 200 (step S415) and stores the second language in the storage unit 120 (step S416). If it is determined that voice input has not been received (step S413: No), vinegar Step S413 waits for voice input.

[0037] The character conversion unit 111 converts the received speech in the first language into characters in the first language (step S417). The translation unit 112 translates the converted characters in the first language into the second language (step S418). The display unit 160 displays the characters in the second language (step S419). The speech input / output unit 140 determines whether or not the speech input has ended (step S420). If it is determined that the speech input has not ended (step S420: No), the unit waits for speech input in step S413. After receiving the second language, the processing in steps S414 to S416 is not executed, and step S417 and subsequent steps are executed. If it is determined that the speech input has ended (step S420: Yes), the processing ends. Whether or not the speech input has ended may be determined based on whether or not speech input has been received within a predetermined time.

[0038] In this way, by using low-power wireless communication, information terminal device 100 and information terminal device 200 can transmit each other's first and second languages, which are their respective language types, allowing foreign language speakers and Japanese speakers who speak a variety of languages ​​to converse freely.

[0039] As Modification 1, an example will be described in which the short-range communication unit 130 of the information terminal device 100 has only the function of transmitting the first language, and the short-range communication unit 230 of the information terminal device 200 has only the function of receiving the first language. In this case, the storage unit 120 of the information terminal device 100 stores the first language and the second language in advance, and the storage unit 220 of the information terminal device 200 stores the second language in advance.

[0040] In variant example 1, when the short-range communication unit 130 and the short-range communication unit 230 perform infrared communication, the first language transmitted from the information terminal device 100 is received by the short-range communication unit 230 of the information terminal device 200 and stored in the memory unit 220 without performing the connection process (step S203) shown in FIG. 2.

[0041] Similarly, when the communication unit is a low-output line communication unit, the first language transmitted from the information terminal device 100 is received by the short-range communication unit 230 of the information terminal device 200 and stored in the memory unit 220 without determining whether or not voice input from the speaker has been accepted.

[0042] By performing translation processing with such a configuration, it is possible to display text translated into the first language from words spoken in the second language by a second speaker on information terminal device 200 with a simpler configuration than that of Figure 1, and it is also possible to display text translated into the second language from words spoken in the first language by a first speaker on information terminal device 100.

[0043] Furthermore, if the information terminal device 100 or the information terminal device 200 is a smartphone or the like and is connected to a server via a network not shown in FIG. 1, the voice or the characters converted from the voice and the language type may be sent to the server, and the voice or characters received by the server may be translated into voice or characters of the received language type and sent to the information terminal device 100 or the information terminal device 200.

[0044] In addition to the above-described processing, when the information terminal device 200 operated by a Japanese speaker receives a first language from the information terminal device 100 operated by a foreign language speaker, a notification indicating that the first language has been received may be output to the information terminal device 200 by a text message, a sound such as a chime, or the like, or by turning on a light. A similar notification may also be given when the information terminal device 100 receives a second language.

[0045] The second language indicating the language type understood by the Japanese speaker may be, instead of Japanese (standard language), a dialect such as Japanese (Tsugaru dialect) or Japanese (Kagoshima dialect). The foreign language speaker (first speaker) is not limited to a foreign language speaker, but may also be, for example, a speaker of a Japanese dialect.

[0046] <Example 2> 5 is a block diagram showing a configuration of a communication system 20 according to Example 2. The communication system 20 includes a beacon device 300, an information terminal device 400, a server 500, and an information terminal device 600.

[0047] The beacon device 300 is a device that transmits light or radio waves called a beacon. The beacon device 300 transmits a beacon signal including a beacon ID that identifies the beacon at a predetermined period. The beacon device 300 is arranged in association with the information terminal device 600. For example, it may be held by the operator of the information terminal device 600, or may be integrated with the information terminal device 600 or arranged near the information terminal device 600.

[0048] The information terminal device 400 is a computer operated by a foreign language speaker, similar to the information terminal device 100 of the first embodiment, and may be a wearable device, a smartphone, a tablet device, a PC, or the like. The information terminal device 400 includes a control unit 110, a storage unit 120, a short-range communication unit 431, a communication unit 432, an audio input / output unit 140, an operation unit 150, and a display unit 160. Since the information terminal device 400 shares some of the configuration with the information terminal device 100, for the functions of the same reference numerals, please refer to the description of each unit of the information terminal device 100, and the description here will be omitted.

[0049] When the information terminal device 400 enters the communication range of the beacon device 300 and becomes communicable, the short-distance communication unit 431 receives a beacon signal transmitted by the beacon device 300. The short-distance communication unit 431 acquires a beacon ID from the beacon signal.

[0050] The communication unit 432 transmits the first language stored in the storage unit 120, the beacon ID acquired from the beacon signal of the beacon device 300, and the terminal ID for identifying the information terminal device 400 to the server 500 via the network N. The network N is any communication network such as the Internet, an intranet, a LAN (Local Area Network), a VPN (Virtual Private Network), a mobile communication network, or a combination thereof, and some or all of them may be wired or wireless.

[0051] The server 500 transmits and receives data to and from the information terminal device 400 and the information terminal device 600 via the network N. The server 500 includes a control unit 510, a storage unit 520, and a communication unit 530. The storage unit 520 stores a beacon ID and a terminal ID for identifying the information terminal device 600 in association with each other. The communication unit 530 receives the first language, the beacon ID, and the terminal ID of the information terminal device 400 transmitted from the information terminal device 400. The control unit 510 acquires the terminal ID for identifying the information terminal device 600 associated with the beacon ID from the storage unit 520, and the communication unit 530 transmits the first language to the information terminal device 600 associated with the terminal ID.

[0052] The information terminal device 600 is a computer operated by a Japanese speaker and has the same functions as the information terminal device 200 and the information terminal device 400 described in the first embodiment, and may be a wearable device, a smartphone, a tablet device, a PC, or the like. The information terminal device 600 includes a control unit 210, a storage unit 220, a short-range communication unit 631, a communication unit 632, an audio input / output unit 240, an operation unit 250, and a display unit 260. The information terminal device 600 has almost the same functions as the information terminal device 200, and therefore, a description thereof will be omitted here. The short-range communication unit 631 and the communication unit 632 have the same functions as the short-range communication unit 431 and the communication unit 432 of the information terminal device 400. Therefore, the description of the short-range communication unit 431 and the communication unit 432 should be referred to, and a description thereof will be omitted here.

[0053] The translation process executed in the communication system 20 configured as described above will be explained. Fig. 6 is a flowchart showing the translation process procedure executed by the beacon device 300, the information terminal device 400, the server 500 and the information terminal device 600.

[0054] As advance preparations for information terminal device 400 and information terminal device 600, operation unit 150 of information terminal device 400 accepts input of a first language and a second language (step S601) and stores the accepted first language and second language in storage unit 120. Operation unit 250 of information terminal device 600 accepts input of a second language (step S602) and stores the accepted second language in storage unit 220.

[0055] The short-range communication unit 431 of the information terminal device 400 receives a beacon signal transmitted from the beacon device 300 (step S603). FIG. 7 is an explanatory diagram showing an example of the flow of the translation process of the second embodiment. As shown in FIG. 7(1), when the information terminal device 400 enters the communication range of the beacon device 300, it receives a beacon signal. The short-range communication unit 431 acquires a beacon ID from the beacon signal (step S604). Instead of acquiring the beacon ID from the beacon signal, the beacon ID (or the terminal ID of the information terminal device 600) may be acquired by capturing an image of a QR code (registered trademark) with a camera (not shown). The communication unit 432 transmits the first language, the beacon ID, and the terminal ID of the information terminal device 400 to the server 500 (step S605). As shown in FIG. 7(2), the first language “English”, the beacon ID, and the terminal ID of the information terminal device 400 are transmitted to the server 500.

[0056] The communication unit 530 of the server 500 receives the beacon ID and acquires the terminal ID associated with the received beacon ID from the storage unit 520 (step S606). The communication unit 530 transmits the first language to the information terminal device 600 associated with the terminal ID (step S607). As shown in FIG. 7(3), the communication unit 530 transmits the first language, "English", to the information terminal device 600. The communication unit 530 associates the terminal ID of the information terminal device 400 with the terminal ID corresponding to the beacon ID and stores them in the storage unit 520 (step S608). As a result, the information terminal device 400 operated by the first speaker and the information terminal device 600 operated by the second speaker are identified and are set in a paired state.

[0057] The communication unit 632 of the information terminal device 600 stores the first language transmitted from the server 500 in the storage unit 220 (step S609). As shown in FIG. 7(4), the first language "English" is stored in the storage unit 220. Since the processing of steps S610 to S613 for translating speech is the same as the processing of steps S208 to S211 described in FIG. 2, please refer to the description in FIG. 2 and the description here will be omitted.

[0058] The information terminal device 400 executes a process of translating the voice uttered by the first speaker into characters of the second language. The process of step S614 to step S617 for translating the voice is the same as the process of step S213 to step S216 described in FIG. 2, so refer to the description in FIG. 2 and the description here will be omitted. The short-distance communication unit 431 judges whether or not a beacon signal has been received within a certain time (step S618). If it is judged that a beacon signal has been received within a certain time (step S618: Yes), that is, if the information terminal device 400 has not left the beacon device 300 and is present within a communication range where a beacon signal can be received, it waits for voice input in step S614.

[0059] If it is determined that a beacon signal has not been received within a certain time period (step S618: No), the communication unit 432 transmits to the server 500 a message that a beacon signal has not been received (step S619), and ends the process. If the server 500 receives from the information terminal device 400 a message that a beacon signal has not been received, the server 500 deletes the terminal ID of the information terminal device 400 associated with the terminal ID of the information terminal device 600 from the storage unit 520 (step S620). This cancels the pairing between the information terminal device 400 and the information terminal device 600, and the information terminal device 600 can be paired with a new information terminal device 400 that has received a beacon signal.

[0060] In this way, a foreign language speaker simply approaches a Japanese speaker, and the translated text of the Japanese spoken by the Japanese speaker is displayed on the Japanese speaker's device. The foreign language speaker can also speak in their own language, and the translated text into Japanese can be displayed on the display. This allows both the foreign language speaker and the Japanese speaker to communicate in their own language without worrying about whether they can understand the language of the other person. For example, Japanese speakers working in souvenir shops or convenience stores can easily talk to travelers even if they do not understand the language they understand. By listening to the local language, foreign language speakers can enjoy the atmosphere of traveling abroad, while also being able to check the translated text in their own language without having to launch an application program or operate a smartphone or other device to translate it themselves, allowing them to enjoy their trip without stress.

[0061] As a first modification, a connection request may be transmitted and received between the information terminal device 400 and the beacon device 300, and connection processing may be executed between the information terminal device 400 and the beacon device 300. After the connection processing is completed, the beacon device 300 transmits the beacon ID to the information terminal device 400, so that the information terminal device 400 can reliably acquire the beacon ID.

[0062] Modification 2 will be described. Instead of displaying the characters obtained by translating the speech uttered by the foreign language speaker on the display unit 160 such as a display in step S617, the translated characters may be transmitted to the information terminal device 600 via the server 500, read out by a reading unit (not shown), and output from earphones, headphones, or the like of the voice input / output unit 240.

[0063] In the above-described embodiment, the translation process is performed by the information terminal device 400 and the information terminal device 600, but instead of performing the translation by the information terminal device 400 and the information terminal device 600, characters translated into the first language or the second language by the server 500 may be transmitted to the information terminal device 400 and / or the information terminal device 600.

[0064] Modification 3 will now be described. Information terminal device 600 of Modification 3 is not a device operated by a Japanese speaker, but a digital signage device (so-called electronic billboard) installed on the walls or pillars of buildings, sidewalks, roads, plazas, parks, etc., and outputs various contents. Information terminal device 600 has an output unit 660 instead of display unit 260. Output unit 660 outputs various contents such as images, videos, VR (Virtual Reality), audio, music, SNS (Social Networking Service) messages, chat, etc., instead of or in addition to text.

[0065] FIG. 8 is a flowchart showing a translation processing procedure executed by the beacon device 300, the information terminal device 400, the server 500 and the information terminal device 600.

[0066] As advance preparations for information terminal device 400 and information terminal device 600, operation unit 150 of information terminal device 400 accepts input of a first language (step S801) and stores the accepted first language in storage unit 120. Operation unit 250 of information terminal device 600 accepts input of a second language (step S802) and stores the accepted second language in storage unit 220. At this point, "Not set" is stored as the first language in storage unit 220. Output unit 660 of information terminal device 600 outputs the content (step S803). For example, if "Not set" is set as the first language and "Japanese" is set as the second language, the output language is determined to be "Japanese" and content including Japanese characters and audio is output. The output language is the language type of the content when the content is output by information terminal device 600.

[0067] The short-distance communication unit 431 of the information terminal device 400 receives a beacon signal transmitted from the beacon device 300 (step S804). FIG. 9 is an explanatory diagram showing an example of the flow of the translation process. When a plurality of information terminal devices 400-1 to 3 enter within the communication range of the beacon device 300, as shown in (1) of FIG. 9, each of the information terminal devices 400-1 to 3 receives a beacon signal. The short-distance communication unit 431 of the information terminal device 400 acquires a beacon ID from the beacon signal (step S805). The communication unit 432 transmits the first language and the beacon ID to the server 500 (step S806). As shown in FIG. 9 (2), each of the information terminal devices 400-1 to 3 transmits the first language and the beacon ID to the server 500.

[0068] The communication unit 530 of the server 500 transmits the retransmission time in the first language and the beacon ID to the information terminal device 400 (step S807). Note that if the retransmission time is preset in the information terminal device 400, the server 500 does not need to transmit the retransmission time. The communication unit 432 of the information terminal device 400 determines whether the retransmission time has elapsed (step S808). If it is determined that the retransmission time has not elapsed (step S808: No), the communication unit 432 waits for the retransmission time to elapse in step S808. If it is determined that the retransmission time has elapsed (step S808: Yes), the communication unit 432 determines whether a beacon signal has been received (step S809). If it is determined that a beacon signal has been received (step S809: Yes), the communication unit 530 transmits the first language and the beacon ID in step S806. If it is determined that a beacon signal has not been received (step S809: No), the communication unit 432 ends the process. In this way, by sending the first language and beacon ID to the server again when the retransmission time has elapsed and a beacon signal has been received, it can be determined that the foreign language speaker who is the operator of the information terminal device 400 is still staying in the vicinity of the information terminal device 600.

[0069] The communication unit 530 of the server 500 receives the first language and the beacon ID, and acquires the terminal ID of the information terminal device 600 associated with the beacon ID from the storage unit 520 (step S810). The communication unit 530 transmits the first language to the information terminal device 600 associated with the beacon ID (step S811). As shown in FIG. 9(3), the communication unit 530 transmits the first language received from each of the information terminal devices 400-1 to 400-3 to the information terminal device 600.

[0070] The communication unit 632 of the information terminal device 600 receives the first language, and the control unit 210 counts the language types (step S812). The control unit 210 determines whether a predetermined time has elapsed using a timer (step S813). If it determines that the predetermined time has not elapsed (step S813: No), the control unit 210 receives the first language from the server 100. If it determines that the predetermined time has elapsed (step S813: Yes), the control unit 210 stores the first language (step S814). More specifically, the control unit 210 stores the most frequently used language type among the language types of the first language received within the predetermined time as the first language. If the language type of the first language is not received within the predetermined time, the control unit 210 stores "Not set" as the first language. In FIG. 9, as shown in (4), "English," which is the most frequently used language type of the information terminal devices 400-1 to 400-3, as the first language.

[0071] The control unit 210 determines whether to change the language type of the content (step S815). More specifically, it determines whether the current output language matches the language type set for the first language. If the first language is set to "Not Set," it determines whether the current output language matches the language type set for the second language. If it is determined that the language type of the content should be changed (step S815: Yes), the translation unit 212 translates the content into the output language (step S816). The output unit 660 outputs the content for a predetermined time (step S817). For example, as shown in FIG. 9(5), the content translated into "English" is displayed. If it is determined that the language type of the content should not be changed (step S815: No), the content is output as is without being translated. Note that the content output in step S817 returns to step S811 and receives the first language without waiting for the predetermined time to elapse.

[0072] In this way, when the owner of information terminal device 400 who understands a language other than Japanese approaches information terminal device 600 that is displaying guidance using Japanese characters, audio, video, etc., the content output from information terminal device 600 is translated into content in a language understood by the owner of information terminal device 400 and output. Also, when multiple people who own information terminal device 400 approach information terminal device 600, the content is translated and output in the language type that is most commonly understood by the owners of information terminal device 400.

[0073] A description will be given of a variation of the above-mentioned variation 3. Instead of translating the content only into the language type with the most number of languages, as in the above-mentioned embodiment, the content may be translated into all languages ​​in descending order of the number of languages ​​set by foreign language speakers, and the translated content may be output at predetermined intervals.

[0074] 8, the short-range communication unit 431 acquires the radio wave intensity of the beacon signal in addition to the beacon ID. In step S806, the communication unit 432 transmits the radio wave intensity to the server 500 in addition to the first language and the beacon ID, and in step S811, transmits the first language and the radio wave intensity to the information terminal device 600. In step S814, the language type of the information terminal device 400 that transmitted the strongest radio wave intensity instead of the most common language type is set as the first language. Thereby, the content can be translated in a language type that the holder of the information terminal device 400 that is closest to the beacon device 300 understands.

[0075] In the above-described modification, the information terminal device 600 counts the language type and sets the language type of the first language, but this may also be executed by the server 500. Furthermore, instead of translating the content in the information terminal device 600, the server 500 may translate the content and output the translated content in the information terminal device 600. Furthermore, instead of translating the content, the content may be replaced with content created in the output language and output. Furthermore, in this modification as well, instead of a beacon signal, a QR code may be captured by a camera to acquire a beacon ID or the terminal ID of the information terminal device 600.

[0076] In this way, by possessing an information terminal device 400 that receives beacon signals, foreign language speakers can, instead of or in addition to being able to converse freely with Japanese speakers, have the content output by the digital signage device output in a language that the foreign language speaker himself or herself understands.

[0077] Example 3 10 is a block diagram showing a configuration of a communication system 30 according to a third embodiment. The communication system 30 includes an information terminal device 700, a server 800, and an information terminal device 900. The information terminal device 700, the server 800, and the information terminal device 900 are connected via a network N.

[0078] The information terminal device 700 is a computer operated by a foreign language speaker, and may be a wearable device, a smartphone, a tablet device, a PC, or the like. The information terminal device 700 includes a control unit 110, a storage unit 120, a communication unit 432, an audio input / output unit 140, an operation unit 150, a display unit 160, and a camera 770. The information terminal device 700 shares some of the same configuration with the information terminal device 100 and the information terminal device 400. Since the same reference numerals have almost the same functions, the explanation of the respective units of the information terminal device 100 and the information terminal device 400 will be referred to, and the following explanation will focus on the differences.

[0079] The camera 770 captures an image of a QR code displayed on the display unit 260 of the information terminal device 900 or a printed QR code. The QR code includes a terminal ID for identifying the information terminal device 900, a URL (Uniform Resource Locator) for accessing a web page, and the like.

[0080] The communication unit 732 transmits a request for a web page specified by the URL read from the QR code and the terminal ID for identifying the information terminal device 900 to the server 800. The communication unit 732 receives the web page. The communication unit 732 transmits the voice uttered by the foreign language speaker received by the voice input / output unit 140 to the server 800.

[0081] Server 800 includes a control unit 810, a storage unit 820, and a communication unit 830. Communication unit 830 receives a web page request and a terminal ID for identifying information terminal device 900, both transmitted from information terminal device 700, and transmits the web page. Control unit 810 acquires the language type included in the web page request. Communication unit 830 transmits the language type to information terminal device 900 corresponding to the terminal ID, and transmits the audio transmitted from information terminal device 700 to information terminal device 900.

[0082] The information terminal device 900 is a computer operated by a Japanese speaker, such as a wearable device, a smartphone, a tablet device, or a PC. The information terminal device 900 includes a control unit 210, a storage unit 220, a communication unit 632, an audio input / output unit 240, an operation unit 250, and a display unit 260. The information terminal device 900 has almost the same functions as the information terminal devices 200 and 600 of the first and second embodiments, and therefore will not be described here.

[0083] The translation process executed by the information terminal device 700, server 800, and information terminal device 900 of the communication system 30 configured as described above will be described below. Fig. 11 is a flowchart showing the procedure of the translation process executed by the information terminal device 700, server 800, and information terminal device 900.

[0084] The camera 770 of the information terminal device 700 captures an image of the QR code (step S1101). FIG. 12 is an explanatory diagram showing an example of the flow of translation processing in the third embodiment. As shown in FIG. 12(1), the camera 770 of the information terminal device 700 captures an image of the QR code displayed on the display unit 260 of the information terminal device 900. Returning to FIG. 11, the camera 770 acquires information (the URL of the web page and the terminal ID of the information terminal device 900) from the QR code (step S1102). The communication unit 732 transmits a request for the web page specified by the acquired URL, the terminal ID of the information terminal device 900, and the terminal ID of the information terminal device 700 to the server 800 (step S1103). The request for the web page includes the language type (first language) set in the web browser displaying the web page. As shown in FIG. 12(2), a web page request, the terminal ID of the information terminal device 900 (second speaker) and the terminal ID of the information terminal device 700 (first speaker) are transmitted to the server 800.

[0085] The communication unit 830 of the server 800 receives the web page request, the terminal ID of the information terminal device 900, and the terminal ID of the information terminal device 700, and stores the received terminal ID of the information terminal device 900 in association with the terminal ID of the information terminal device 700 in the storage unit 820 (step S1104). This results in the information terminal device 900 and the information terminal device 700 being paired. The communication unit 830 transmits the first language transmitted from the information terminal device 700 to the information terminal device 900 corresponding to the terminal ID (step S1105). As shown in FIG. 12(3), the first language: English is transmitted to the information terminal device 900. The communication unit 632 of the information terminal device 900 receives the language type and stores the received language type in the storage unit 220 (step S1106).

[0086] The communication unit 830 of the server 800 transmits a web page for accepting voice input to the information terminal device 700 (step S1107). As shown in FIG. 12(4), the web page is transmitted to the information terminal device 700. The communication unit 732 of the information terminal device 700 receives the web page, and the display unit 160 displays the received web page in a web browser (step S1108). The operation unit 150 accepts voice in the first language input from a microphone or the like in accordance with an instruction from a menu displayed on the web page (step S1109). The communication unit 732 transmits the voice in the first language and the terminal ID of the information terminal device 700 to the server 800 (step S1110). As shown in FIG. 12(5), the English voice received from the web page and the terminal ID are transmitted to the server 800.

[0087] The communication unit 830 of the server 800 receives the audio in the first language and the terminal ID of the information terminal device 700, and acquires the terminal ID corresponding to the received terminal ID of the information terminal device 700 from the storage unit 820 (step S1111). The communication unit 830 transmits the audio in the first language to the information terminal device 900 associated with the terminal ID (step S1112). As shown in FIG. 12(6), the audio in English is transmitted to the information terminal device 900.

[0088] The communication unit 632 of the information terminal device 900 receives the speech in the first language, and the translation unit 212 translates the received speech in the first language into speech in the second language which is stored in the storage unit 220 (step S1113). The speech input / output unit 240 outputs the translated speech in the second language from a headset or the like (step S1114). As shown in FIG. 12 (7), Japanese speech is output. If speech is input from a Japanese speaker, the speech input / output unit 240 executes speech translation processing (step S1115). The speech translation processing is similar to the processing of steps S208 to S212 in FIG. 2, so please refer to the flowchart and explanation of steps S208 to S212 and will not be described here.

[0089] Operation unit 150 of information terminal device 700 determines whether an instruction to end has been given on the web page (step S1116). If it is determined that an instruction to end has not been given on the web page (step S1116: No), voice input is accepted in step S1109. If it is determined that an instruction to end has been given on the web page (step S1116: Yes), communication unit 732 transmits to server 800 a message that voice input has ended and the terminal ID of information terminal device 700 (step S1117). Then, the process ends.

[0090] The communication unit 830 of the server 800 receives the notification that the voice input has ended and the terminal ID of the information terminal device 700, and deletes the terminal ID of the information terminal device 700 corresponding to the terminal ID of the information terminal device 900 stored in the storage unit 820 (step S1118). As a result, the information terminal device 900 operated by the Japanese speaker has no interlocutor, and can be paired with another foreign language speaker.

[0091] In this way, a foreign language speaker can obtain the language type set in the web browser of information terminal device 700 simply by capturing the QR code, so that the words spoken by the foreign language speaker are translated into Japanese and output as Japanese audio from the Japanese speaker's information terminal device 900, without the foreign language speaker having to set the language type themselves. Additionally, audio uttered by the Japanese speaker is also translated into characters in a language that the foreign language speaker understands and displayed. This allows foreign language speakers to easily communicate with Japanese speakers without having to download an application program in advance or set the language type themselves.

[0092] In a modified example, the processes of steps S1110 to S1112 may be performed by transmitting and receiving audio peer-to-peer between the information terminal device 700 and the information terminal device 900 using the WebRTC (Web Real-Time Communication) mechanism, without using the server 800.

[0093] The hardware configuration of the information terminal device 100, information terminal device 200, information terminal device 400, server 500, information terminal device 600, information terminal device 700, server 800, and information terminal device 900 according to the above-described embodiments is a typical computer including one or more processors such as a central processing unit (CPU), a micro-processing unit (MPU), or a graphics processing unit (GPU), and equipped with external storage devices such as read-only memory (ROM), random access memory (RAM), hard disk drives (HDDs), flash memory, and solid state drives (SSDs), and a communication control device, etc. The above-described configuration and functions are realized by the CPU or the like reading and running programs stored in the ROM, RAM, HDD, etc. The control unit may be an electronic circuit such as an application specific integrated circuit (ASIC) or programmable logic device (PLD).

[0094] The programs that run on information terminal device 100, information terminal device 200, information terminal device 400, server 500, information terminal device 600, information terminal device 700, server 800, and information terminal device 900 may be stored on a computer connected to a network such as the Internet and provided by downloading via the network, or may be recorded in an installable or executable file on a computer-readable recording medium such as a CD-ROM, DVD, USB memory, or SD card and provided. Furthermore, the programs that realize the above-mentioned functions and processes may be provided in the form of an API (Application Programming Interface), SaaS (Software as a Service), or cloud computing.

[0095] The present invention is not limited to the above-described embodiments, and does not necessarily have to be physically configured as illustrated. Furthermore, the present invention can be configured by functionally or physically dividing, integrating, replacing, modifying, or deleting all or part of the components described in each of the first to third embodiments and the modified examples in any unit according to various loads, usage conditions, etc. [Explanation of symbols]

[0096] 100...information terminal device, 110...control unit, 111...character conversion unit, 112...translation unit, 120...storage unit, 130...near-field communication unit, 140...voice input / output unit, 150...operation unit, 160...display unit, 200...information terminal device, 210...control unit, 211...character conversion unit, 212...translation unit, 220...storage unit, 230...near-field communication unit, 240...voice input / output unit, 250...operation unit, 260...display unit, 300 ...Beacon device, 400...information terminal device, 431...short-range communication unit, 432...communication unit, 500...server, 510...control unit, 520...storage unit, 530...communication unit, 600...information terminal device, 631...short-range communication unit, 632...communication unit, 700...information terminal device, 732...communication unit, 770...camera, 800...server, 810...control unit, 820...storage unit, 830...communication unit, 900...information terminal device

Claims

1. A communication system comprising a first information terminal device, a server, a second information terminal device, and a beacon device arranged in association with the second information terminal device, The first information terminal device A first receiving means for receiving a beacon ID for identifying the beacon device when communication with the beacon device is possible; a first transmitting means for transmitting the beacon ID received by the first receiving means and a first language, which is a language type to be stored in a storage unit of the first information terminal device, to the server; The server a language transmitting means for transmitting the first language to the second information terminal device corresponding to the beacon ID received from the first information terminal device; The second information terminal device second receiving means for receiving the first language from the server; a voice receiving means for receiving voice input; a character conversion means for converting the voice into characters; a translation means for translating the characters converted by the character conversion means into characters in the first language received by the second receiving means; a display means for displaying the characters translated by the translation means; A communication system comprising:

2. When communication with the beacon device is possible, a server that connects to a first information terminal device that transmits a beacon ID that identifies the beacon device received from the beacon device and a first language that is a language type to be stored in a storage unit via a network, a language transmitting means for transmitting the first language to a second information terminal device corresponding to the beacon ID received from the first information terminal device;

3. When communication with the beacon device is possible, a beacon ID that identifies the beacon device received from the beacon device and a first language that is a language type to be stored in a storage unit are received from a first information terminal device via a network. receiving means for receiving the first language from the server; a voice receiving means for receiving voice input; a character conversion means for converting the voice received by the voice receiving means into text; a translation means for translating the characters converted by the character conversion means into characters in the first language received by the receiving means; a display means for displaying the characters translated by the translation means; An information terminal device comprising:

4. An information terminal device connected to a server via a network, A receiving means for receiving a beacon ID for identifying the beacon device from the beacon device when communication with the beacon device is possible; a transmitting means for transmitting the beacon ID received by the receiving means and the language type to be stored in a storage unit to the server; An information terminal device comprising:

5. 5. The information terminal device according to claim 4, further comprising: a QR code acquisition means for acquiring the beacon ID by capturing an image of a QR code including the beacon ID with an imaging means, instead of receiving the beacon ID from the beacon device with the receiving means.

6. When communication with the beacon device is possible, a server connected to a first information terminal device that transmits a beacon ID that identifies the beacon device received from the beacon device and a first language that is a language type to be stored in a storage unit via a network, and a second information terminal device that connects to the server via a network, The server a language transmitting means for transmitting the first language to the second information terminal device corresponding to the beacon ID received from the first information terminal device; The second information terminal device receiving means for receiving the first language from the server; a translation means for setting the first language as an output language and translating the content into the set output language when it is determined that the current output language does not match the first language; an output means for outputting the content translated by the translation means; A communication system comprising:

7. The second information terminal device The communication system according to claim 6 , wherein when a plurality of the first languages ​​are received within a predetermined time, the language type that is most frequently used among the first languages ​​is set as the output language.

8. The second information terminal device The communication system according to claim 6, wherein when a plurality of first languages ​​and radio wave intensities are received within a predetermined time, the first language corresponding to the strongest radio wave intensity among the first languages ​​is set as the output language.

9. A communication system comprising a first information terminal device, a server, and a second information terminal device, the first information terminal device, An imaging means for imaging the QR code; a first transmission means for acquiring a URL of a web page and a terminal ID for identifying the second information terminal device, both of which are included in the QR code, and transmitting the terminal ID and a first terminal ID for identifying the first information terminal device to a web page specified by the acquired URL; The server a storage means for storing the first terminal ID and the terminal ID received from the first information terminal device in association with each other; a language transmitting means for transmitting a first language included in the web page request received from the first information terminal device to the second information terminal device corresponding to the terminal ID received from the first information terminal device, The second information terminal device a storage means for storing the first language received from the server in a storage unit; the first information terminal device, a voice receiving means for receiving voice input; a second transmitting means for transmitting the voice received by the voice receiving means and the first terminal ID to the server, The server a third transmitting means for transmitting the voice received from the first information terminal device to the second information terminal device corresponding to the terminal ID associated with the first terminal ID; The second information terminal device a voice receiving means for receiving the voice from the server; a translation means for translating the speech in the first language received by the speech receiving means into speech in a second language stored in a storage unit; an output means for outputting the speech translated by the translation means; A communication system comprising:

10. a server connected to a first information terminal device via a network, the server capturing an image of a QR code, acquiring a URL of a web page and a terminal ID for identifying an information terminal device, both of which are included in the QR code, and transmitting the terminal ID and a first terminal ID for identifying the information terminal device to a web page specified by the acquired URL; a storage means for storing the first terminal ID and the terminal ID received from the first information terminal device in association with each other; a language transmitting means for transmitting a first language included in the web page request received from the first information terminal device to a second information terminal device corresponding to the terminal ID received from the first information terminal device; a voice transmitting means for transmitting the voice received from the first information terminal device to the second information terminal device corresponding to the terminal ID associated with the first terminal ID; A server comprising:

11. An information terminal device connected to a server via a network, which receives from a first information terminal device a terminal ID for identifying the information terminal device acquired from a QR code, a first language stored in a storage unit, and a first terminal ID for identifying the information terminal device, a voice receiving means for receiving the voice received by the first information terminal device from the server; a translation means for translating the speech in the first language received by the speech receiving means into speech in a second language stored in a storage unit; an output means for outputting the speech translated by the translation means; An information terminal device comprising:

12. When communication with the beacon device is possible, a first information terminal device that transmits a beacon ID that identifies the beacon device received from the beacon device and a first language that is a language type to be stored in a storage unit is a method executed by a computer connected via a network, A communication method including a language transmitting step of transmitting the first language to a second information terminal device corresponding to the beacon ID received from the first information terminal device.

13. A method executed by a computer that connects to a server via a network and receives from a first information terminal device a beacon ID that identifies the beacon device and a first language that is a language type to be stored in a memory unit when communication with the beacon device becomes possible, receiving the first language from the server; a voice receiving step of receiving voice input; a character conversion step of converting the voice received in the voice receiving step into characters; a translation step of translating the characters converted by the character conversion step into characters of the first language received by the receiving step; a display step of displaying the characters translated by the translation step; Communication methods including.

14. A method executed by a computer connected to a server via a network, comprising: When communication with the beacon device becomes possible, a receiving step of receiving a beacon ID identifying the beacon device from the beacon device; a transmitting step of transmitting the beacon ID and the language type to be stored in the storage unit received in the receiving step to the server; Communication methods including.

15. A communication method as described in claim 14, including a QR code acquisition step in which, instead of receiving the beacon ID from the beacon device in the receiving step, the beacon ID is acquired by capturing an image of a QR code including the beacon ID in an imaging step.

16. A method executed by a computer connected via a network to a first information terminal device that transmits a beacon ID that identifies the beacon device and a first language that is a language type to be stored in a memory unit when communication with the beacon device becomes possible, the method comprising: receiving the first language; a translation step of setting the first language as an output language and translating the content in the set output language when it is determined that the current output language does not match the first language; an output step of outputting the content translated by the translation step; Communication methods including.

17. A method executed by a computer connected to a first information terminal device via a network, the method comprising: capturing an image of a QR code; acquiring a URL of a web page and a terminal ID for identifying an information terminal device, the URL being included in the QR code; and transmitting the terminal ID and a first terminal ID for identifying the information terminal device to a web page specified by the acquired URL, the method comprising: a storage unit that stores the first terminal ID and the terminal ID received from the first information terminal device in association with each other, a language transmitting step of transmitting a first language included in the web page request received from the first information terminal device to a second information terminal device corresponding to the terminal ID received from the first information terminal device; a voice transmission step of transmitting the voice received from the first information terminal device to the second information terminal device corresponding to the terminal ID associated with the first terminal ID; Communication methods including.

18. A method executed by a computer connected via a network to a server that receives from a first information terminal device a terminal ID that identifies the information terminal device obtained from a QR code, a first language to be stored in a memory unit, and a first terminal ID that identifies the information terminal device, comprising: a voice receiving step of receiving the voice received by the first information terminal device from the server; a translation step of translating the speech in the first language received by the speech receiving step into speech in a second language stored in a storage unit; an output step of outputting the speech translated by the translation step; Communication methods including.

19. A communication program for causing a computer to execute the communication method according to any one of claims 12 to 18.

Images