Information processing system, information processing method, and program

JPWO2025104850A1Active Publication Date: 2025-05-22TELENET CORP
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
JP2023571446
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-11-15
Publication Date
2025-05-22
Estimated Expiration
2043-11-15

AI Technical Summary

Technical Problem

Existing systems for one-to-many or one-to-one communication do not appropriately control user interfaces based on the diverse settings of multiple functions across devices, leading to inconsistent user experiences.

Method used

An information processing system that controls communication terminals to adjust display screens and audio outputs based on setting information, including recording, transcription, and interpretation settings, ensuring consistent user interface experiences across devices.

Benefits of technology

Enables appropriate display and audio output control based on device settings, providing consistent user interfaces and functional adaptations for multiple communication devices.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader

Abstract

According to one aspect of the present invention, an information processing system is provided. The information processing system controls communication from one of a plurality of communication terminals to another communication terminal other than the one of the plurality of communication terminals. The information processing system controls the other communication terminal to change a display screen during communication based on setting information in the other communication terminal. The setting information includes information on whether to enable a recording function and whether to enable a transcription function.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an information processing system, an information processing method, and a program. [Background technology]

[0002] Patent Document 1 discloses a signal processing device capable of reducing information transmission errors in a system that realizes one-to-many group simultaneous voice communication. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2019-4392 A Summary of the Invention [Problem to be solved by the invention]

[0004] In a system that performs one-to-many or one-to-one communication, each device that constitutes the system may have multiple functions. In such a case, the settings for each of the multiple functions may differ for each device. In such a case, it is required to appropriately control the user interface of each device.

[0005] However, Patent Document 1 does not disclose any appropriate control of the user interface in accordance with the settings of each of the multiple functions. [Means for solving the problem]

[0006] According to one aspect of the present invention, there is provided an information processing system that controls communication from one of a plurality of communication terminals to another communication terminal other than the one of the plurality of communication terminals, the other communication terminal being one or more communication terminals, and controls the other communication terminal to change its display screen during communication based on setting information in the other communication terminal, the setting information including information on whether or not to enable a recording function and whether or not to enable a transcription function, and when the setting information of a communication terminal of a user communicating with a user of the one communication terminal indicates that the recording function is disabled and the transcription function is disabled, the information processing system controls so that the display screen of the communication terminal of the communicating user includes text information indicating the contents of the chat.

[0007] According to another aspect of the present invention, in the information processing system, the setting information further includes information on whether or not to enable a simultaneous interpretation setting, and an information processing system is provided in which the audio output at the other communication terminal is controlled in accordance with the information on whether or not to enable a simultaneous interpretation setting included in the setting information at the other communication terminal.

[0008] According to another aspect of the present invention, there is provided an information processing system that controls a communication terminal having setting information including information for enabling simultaneous interpretation setting so that, following output of speech in an original language by a speaker, speech interpreted in a language selected in the communication terminal is output.

[0009] According to another aspect of the present invention, an information processing system is provided in which the text information is displayed on the display screen in a manner that makes it possible to distinguish whether it is text information about the content of a chat that has been sent or text information about the content of a chat that has been received.

[0010] According to another aspect of the present invention, an information processing system is provided which, when the setting information of a communication terminal of a user communicating with a user of the one communication terminal indicates that the recording function is enabled and the transcription function is disabled, controls the display screen of the communication terminal of the communicating user to include text information indicating the contents of the chat and a waveform graph indicating that audio is being recorded.

[0011] According to another aspect of the present invention, an information processing system is provided which, when the setting information of a communication terminal of a user communicating with a user of the one communication terminal indicates that a recording function is enabled and a transcription function is enabled, controls so that the display screen of the communication terminal of the communicating user includes text information indicating the contents of the chat and text information that is the result of transcribing the voice.

[0012] According to another aspect of the present invention, an information processing system is provided in which the text information is displayed on the display screen in a manner that makes it possible to distinguish whether the text information is the result of transcription of transmitted voice or the text information is the result of transcription of received voice.

[0013] According to another aspect of the present invention, an information processing system is provided in which the setting information further includes language information which is language information, and the character information is character information translated into a language indicated by the language information included in the setting information.

[0014] According to another aspect of the present invention, an information processing system is provided in which the setting information further includes language information which is language information, and the text information is text information indicating the content of the chat translated into a language indicated by the language information included in the setting information.

[0015] According to another aspect of the present invention, the other communication terminal is a plurality of communication terminals, and the other communication terminal is configured to receive the information based on setting information of each of the other communication terminals. other An information processing system is provided that controls a plurality of communication terminals so as to change their display screens during communication.

[0016] An information processing method executed by an information processing system is provided, which controls communication from one of a plurality of communication terminals to another communication terminal other than the one of the plurality of communication terminals, and controls the other communication terminal to change its display screen during communication based on setting information in the other communication terminal, the setting information including information on whether or not to enable a recording function and whether or not to enable a transcription function, and when the setting information of a communication terminal of a user communicating with a user of the one communication terminal indicates that the recording function is disabled and the transcription function is disabled, controls so that text information indicating the contents of the chat is included on the display screen of the communication terminal of the user communicating.

[0017] According to another aspect of the present invention, there is provided a program for causing a computer to function as the information processing system. Effect of the Invention

[0018] In the information system according to the present invention, it is possible to control each of the devices constituting the system so that an appropriate display screen is displayed on each of the multiple devices based on the setting information in each of the devices. [Brief description of the drawings]

[0019] [Figure 1] FIG. 1 is a diagram showing an example of a system configuration of an information processing system according to the present invention. [Diagram 2] FIG. 2 is a diagram showing an example of a hardware configuration of a server device according to the present invention. [Diagram 3] FIG. 3 is a diagram showing an example of a hardware configuration of a telephone device according to the present invention. [Figure 4] FIG. 4 is a diagram showing an example of a setting screen for setting setting information according to the present invention. [Diagram 5] FIG. 5 is a sequence diagram showing an example of information processing related to call control and the like according to the present invention. [Figure 6] FIG. 6 is a diagram showing an example of a screen transition of the caller's telephone device according to the present invention. [Figure 7] FIG. 7 is a diagram (part 1) showing an example of a screen of the recipient's telephone device according to the present invention. [Figure 8] FIG. 8 is a diagram (part 2) showing an example of a screen of the recipient's calling device according to the present invention. [Figure 9] FIG. 9 is a diagram (part 3) showing an example of a screen of the recipient's telephone device according to the present invention. [Figure 10] FIG. 10 is a diagram (part 4) showing an example of a screen of the recipient's telephone device according to the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0020] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described with reference to the drawings. Various characteristic features shown in the following embodiments can be combined with each other.

[0021] <Embodiment 1> 1. System configuration diagram Fig. 1 is a diagram showing an example of a system configuration of an information processing system 1000. As shown in Fig. 1, the information processing system 1000 includes a server device 100, a plurality of calling devices 110, and a plurality of base stations 120 as a system configuration.

[0022] The calling device 110 is connected to the network 150 via the base station 120. The server apparatus 100 and the multiple calling devices 110 are communicatively connected to each other via the base station 120 and the network 150. Similarly, the multiple calling devices 110 are communicatively connected to each other via the base station 120 and the network 150. The calling device 110 is an example of a communication terminal.

[0023] The server device 100 is a server that provides a function for performing push-to-talk between the call devices 110. More specifically, the server device 100 controls calls between the one-to-many call devices 110 shown in the first embodiment, and controls the display screens of the call devices 110, etc.

[0024] As described below, the server device 100 translates the speaker's voice into multiple languages ​​and transmits and receives the interpreted voice to each of the multiple calling devices 110. The server device 100 also translates text information input at the calling device 110 into multiple languages ​​and transmits and receives the translated text information to each of the multiple calling devices 110. The server device 100 also controls the display of the screen of each of the multiple calling devices 110.

[0025] In the first embodiment, the control of the screen display and screen transition of the calling device 110 will be described as being performed by the control unit 210. More specifically, in the first embodiment, the server device 100 generates a screen for the calling device 110 and transmits it to the calling device 110. The calling device 110 displays the screen received from the server device 100.

[0026] The calling device 110 is an IP radio used by a user. The IP radio is a device that converts voice into packets and performs data communication using radio waves from a mobile phone. The information processing system 1000 includes a plurality of calling devices 110, and the following description will be given assuming that each of the calling devices 110 is used by a user who speaks a different native language. Each of the multiple users communicates using voice and text information via the calling device 110.

[0027] The information processing system recited in the claims may be composed of multiple devices or may be composed of one device. When the information processing system recited in the claims is composed of one device, an example of the device is the server device 100. When the information processing system recited in the claims is composed of multiple devices, an example of the multiple devices is multiple server devices to which multiple functions of the server device 100 of the first embodiment are respectively assigned, or the server device 100 and at least one of the multiple call devices 110. 2. Hardware Configuration (1) Hardware Configuration of Server Device 100

[0028] FIG. 2 is a diagram illustrating an example of a hardware configuration of the server device 100. As shown in FIG. As shown in FIG. 2, the server device 100 includes, as its hardware configuration, a control unit 210, a storage unit 220, and a communication unit 230.

[0029] The control unit 210 is a CPU (Central Processing Unit) or the like, and controls the entire server device 100 .

[0030] The memory unit 220 is any one of an HDD (Hard Disk Drive), a ROM (Read Only Memory), a RAM (Random Access Memory), an SSD (Solid State Drive), etc., or any combination of these, and stores programs and data used when the control unit 210 executes processing based on the programs (e.g., setting information described below, audio files, transcribed text information, translated text information), etc.

[0031] The storage unit 220 is an example of a storage medium. In the present specification, the data used when the control unit 210 executes processing based on a program is described as being stored in the storage unit 220, but the data may be stored in a storage unit of another device that can communicate with the server device 100. In other words, the data may be stored in a storage unit of any device as long as the control unit 210 can refer to the data.

[0032] The control unit 210 executes processing based on a program stored in the memory unit 220, thereby realizing the functions of the server device 100 and the processing of the server device 100 in the sequence diagram shown in Figure 5 described later.

[0033] The communication unit 230 connects the server device 100 to the network 150, and controls communication with other devices (a plurality of call devices 110).

[0034] (2) Hardware Configuration of the Telephone Device 110 3 is a diagram showing an example of a hardware configuration of the calling device 110. The calling device 110 includes, as the hardware configuration, a control unit 310, a storage unit 320, an audio input unit 330, an audio output unit 340, an input / output unit 350, and a communication unit 360.

[0035] The control unit 310 is a CPU or the like, and controls the entire calling device 110. The storage unit 320 is any one of a ROM, a RAM, and an SSD, or any combination thereof, and stores programs, data used when the control unit 310 executes processing based on the programs, and the like. The control unit 310 executes processing based on the programs stored in the storage unit 320, thereby realizing the functions of the calling device 110. The storage unit 320 is an example of a storage medium.

[0036] The voice input unit 330 is a microphone or the like that inputs the voice of the operator. The voice output unit 340 is a speaker or the like that outputs the voice of the communication partner. The input / output unit 350 is a touch panel display or the like that inputs user operations to the control unit 310 and displays the results of processing by the control unit 310.

[0037] The communication unit 360 connects the calling device 110 to the network 150 via the base station 120, and controls communication with other devices (eg, the server device 100, other calling devices 110, etc.). In the following description, the call device 110 of the sender is also called call device 110A, and the call device 110 of the recipient is also called call device 110B, but both have the same hardware configuration as that shown in FIG.

[0038] 3. Information Processing (1) Setting information The user sets the setting information via his / her own calling device 110. The setting information set via the screen of the calling device 110 is transmitted from the calling device 110 to the server device 100, and is held and managed in the storage unit 220 or the like of the server device 100. Fig. 4 is a diagram showing an example of a setting screen for setting the setting information.

[0039] A user sets the setting information via a setting screen as shown in Fig. 4. When the setting information is set via the setting screen, the calling device 110 transmits a PTT number for identifying the calling device 110 and the setting information to the server device 100 in association with each other. When the server device 100 receives the PTT number for identifying the calling device 110 and the setting information from the calling device 110, the server device 100 stores the setting information in the storage unit 220 or the like in association with the PTT number.

[0040] As shown in Figure 4, the setting information includes recording, transcription, simultaneous interpretation mode, and language information. The recording information sets whether the recording function is ON or OFF. ON indicates enabled. OFF indicates disabled. The same applies below.

[0041] The transcription information sets whether the transcription function is ON or OFF. The simultaneous interpretation mode information sets whether the simultaneous interpretation mode is ON or OFF. The language information sets the language of interpretation and translation. The user selects a desired language from multiple languages ​​presented on the screen of the call device 110. Information on the selected language (e.g., Japanese, Thai, English, etc.) is included in the setting information.

[0042] When recording is ON, the conversation via the calling device 110 is recorded in the server device 100. When recording is OFF, no recording is performed. When transcription is ON, the conversation via the calling device 110 is transcribed. When transcription is OFF, no transcription is performed.

[0043] When the simultaneous interpretation mode is ON, the conversation via the call device 110 is interpreted, and the interpreted voice is output from the call device 110. The interpretation is performed in a language indicated by the language information included in the setting information. Therefore, when the simultaneous interpretation mode is ON, the interpreted voice is output from the call device 110 immediately after the voice in the original language of the conversation partner.

[0044] (2) Sequence diagram Fig. 5 is a sequence diagram showing an example of information processing related to call control, etc. In Fig. 5, calling device 110A is calling device 110 used by the caller. Call device 110B is calling device 110 used by the call recipient. The "···" after calling device 110B in Fig. 5 indicates that there are multiple calling devices 110B.

[0045] In the first embodiment, the control unit 210 generates a screen to be displayed on the calling device 110 based on operations and / or setting information on the screen of the calling device 110, and transmits the screen to the corresponding calling device 110. Such processing performed by the control unit 210 is an example of screen display control.

[0046] The caller operates the handset device 110A, selects a group to be the call partner, and performs a predetermined operation. Then, a call request is transmitted from the handset device 110A to the server device 100. The call request includes a call ID for identifying the call and a PTT (Push to Talk) number of the call partner included in the selected group. The PTT number is information for identifying each handset device 110. When the caller selects a group, the PTT number of the call partner included in the group is acquired and included in the call request.

[0047] Note that instead of selecting a group, the caller may select multiple call partners from contacts, or may select multiple call partners from a call history. However, in the following description, for the sake of simplicity, the caller selects a GUI component of a group displayed on the screen of the call device 110A to display multiple groups on the screen, and selects a group from the displayed groups.

[0048] 6 is a diagram showing an example of a screen transition of the caller's telephone device 110A. A screen 510 is a home screen, that is, a screen that is normally displayed. When the caller selects a group button 511 on the screen 510, the screen of the call device 110A transitions from the screen 510 to a screen 520. The screen 520 is a group selection screen.

[0049] When the caller selects a group on screen 520 (group A is selected in the example of FIG. 6), the screen of telephone device 110A transitions from screen 520 to screen 530. Screen 530 is a screen that includes a list of members included in the selected group. If there are too many members to fit on one screen, a scroll bar is displayed. The caller can check the members that do not fit on one screen by operating the scroll bar.

[0050] The PTT button 531 is a button that the caller selects (or presses) when talking. The PTT button 531 is kept selected while the caller is talking. After the caller's voice call ends, the other members in the group select the PTT button displayed on their own calling devices 110 to make a voice call.

[0051] When a group is selected on the screen 520 and a PTT button 531 is selected on the screen 530, in sequence SQ401, the control unit 310 of the handset device 110A transmits a call request to the server device 100. The call request also includes the PTT number of the caller who transmitted the call request. The control unit 210 of the server device 100 receives the call request from the handset device 110A.

[0052] When a call request is received, in sequence SQ402, the control unit 210 identifies the caller based on the PTT number of the caller included in the call request. The control unit 210 also identifies multiple recipients based on multiple PTT numbers of the call recipients (i.e., recipients) included in the call request.

[0053] In sequence SQ403, the control unit 210 identifies and acquires the setting information of the caller based on the PTT number of the caller included in the call request. The control unit 210 also identifies and acquires the setting information of each of the multiple recipients based on the multiple PTT numbers of the recipients included in the call request.

[0054] In sequence SQ404, the control unit 210 executes call control. More specifically, the control unit 210 acquires a token of the handset device 110 of each PTT number based on the PTT number of each of the multiple recipients. The token is information that identifies each handset device 110.

[0055] In sequence SQ405, the control unit 210 transmits call information, which is a PTT call, to each of the handset devices 110 using each of the tokens. For the sake of simplicity, the present embodiment will be described assuming that the server device 100 provides a plurality of functions. However, the plurality of server devices may share and execute each of the plurality of functions provided by the server device 100 of the first embodiment.

[0056] When the calling device 100 receives the call information, the control unit 310 outputs a ringing tone via the audio output unit 340. The user who hears the ringing tone performs a predetermined operation, such as selecting a mark for answering the call on the screen displayed on the input / output unit 350. When the predetermined operation is accepted via the screen displayed on the input / output unit 350, in sequence SQ406, the control unit 310 joins the call and transmits information indicating that the user has joined the call to the server apparatus 100.

[0057] Upon receiving the information indicating that the call has been joined, in sequence SQ407, the control unit 210 of the server device 100 controls communication (e.g., sending and receiving voice data, sending and receiving text information, displaying a screen, etc.) between the calling device 110A and the calling device 110B that sent the information indicating that the call has been joined.

[0058] For example, the control unit 210 controls one-to-many communication from one of the multiple call devices (e.g., the call device 110A) to multiple other call devices (e.g., the multiple call devices 110B) other than the one of the multiple call devices.

[0059] Screen 540 in Fig. 6 shows an example of a screen during a call by a caller. Screen 540 shows who is speaking and who is listening in the group. Screen 550 in Fig. 6 shows an example of a screen during a call. If the simultaneous interpretation mode is ON for even one user in the group, status 551 indicating that interpretation is in progress is displayed on the screens of all users in the group. When chat icon 552 is selected, the screen of call device 110A transitions from screen 550 to screen 560. Screen 560 shows an example of a detailed display screen.

[0060] In sequence SQ408, control unit 210 stores the voice data of the call in storage unit 220, etc., based on the setting information of each user included in the group. For example, if the recording information of the setting information of even one of the users included in the group is set to ON, the voice data of the call of the group is stored in storage unit 220, etc.

[0061] In sequence SQ409, the control unit 210 transcribes the recorded voice data based on the setting information of each user included in the group. More specifically, if the transcription information of the setting information is set to ON for even one of the users included in the group, the contents of the call are transcribed based on the voice data of the call of the group.

[0062] Transcription is the process of turning the contents of a conversation into text based on audio data. For example, if the recorded audio data is English audio data, the text is transcribed into English. If the recorded audio data is Japanese audio data, the text is transcribed into Japanese. After that, the control unit 210 translates the transcribed text into the language indicated by the language information based on the language information in the setting information in which the transcription information was ON. The control unit 210 stores the transcribed and translated data in the storage unit 220 or the like.

[0063] In sequence SQ410, the control unit 210 converts the transcribed text into voice data based on the setting information of each user included in the group. If the transcribed text is in Japanese, it is converted into Japanese voice data. If the transcribed text is in Thai, it is converted into Thai voice data.

[0064] In sequence SQ411, the control unit 210 transmits the converted voice data to the corresponding handset device 110B in the group as the voice of the interpreter. As a result, the handset device 110B whose setting information is the simultaneous interpretation mode ON outputs the voice in the original language, and then outputs the voice interpreted in the set language. This process is an example of a process of controlling the output of voice in each of the other multiple handset devices according to information on whether or not to enable the simultaneous interpretation setting contained in the setting information of each of the other multiple handset devices. This process is also an example of a process of controlling the output of voice in the original language, which is the original language of the speaker, followed by the output of voice translated in the language selected in the handset device in the handset device in the setting information including information on enabling the simultaneous interpretation setting.

[0065] (3) Display screen control The control unit 210 controls the display of the display screen during a call for each of the multiple call devices 110B based on the setting information for each of the multiple call devices 110B. This process is an example of a process for controlling to change the display screen during communication for each of the other multiple call devices based on the setting information for each of the other multiple call devices.

[0066] The control of the screen display by the control unit 210 will be described below using the screen on the receiver side. FIG. 7 is a diagram (part 1) showing an example of a screen of the recipient's telephone device. Screen 600 in Figure 7 is an example of a screen on the receiving side with the settings: recording OFF, transcription OFF, and simultaneous interpretation mode OFF. The voice is heard in the original language of the sender. Because recording is OFF, only chat text 610 from users in the group is displayed.

[0067] Control by the control unit 210 to display a screen such as that shown in Fig. 7 is an example of a process of controlling so that, when the setting information of the calling device of a user communicating with a user of one calling device indicates that the recording function and the transcription function are disabled, text information indicating the chat contents is included in the display screen of the calling device of the communicating user. The text information is text information indicating the chat contents translated into a language indicated by the language information included in the setting information.

[0068] FIG. 8 is a diagram (part 2) showing an example of the screen of the recipient's telephone device. 8 is an example of a screen on the receiving side with the settings: recording ON, transcription OFF, and simultaneous interpretation mode OFF. The voice is heard in the original language of the sender. Because recording is ON, a waveform graph 710 showing the voice is displayed, and chat text 720 is also displayed.

[0069] A background image 730 of the waveform graph 710 indicates that it is the waveform graph 710 of the voice of the recipient. A background image 740 of the waveform graph indicates that it is the waveform graph of the voice of the sender. A background image 750 of the chat text 720 indicates that the chat text is received chat text. In other words, the control unit 210 displays the voice waveform graph on the screen in such a way that it is possible to distinguish whether it is the voice of the sender or the voice of the recipient by using the background image.

[0070] Similarly, the control unit 210 displays the chat text on the screen in such a way that it is possible to distinguish whether the chat text is the content of a chat by a sender or the content of a chat by a receiver by using a background image. This is an example of the text information being displayed on the display screen in such a way that it is possible to distinguish whether the text information is the text information of a chat that has been sent or the text information of a chat that has been received.

[0071] The control unit 210 may make it possible to distinguish whether a message is from the sender or the receiver by the color of the background image, or may make it possible to distinguish whether a message is from the sender or the receiver by the pattern, shape, or the like of the background image. Furthermore, the control unit 210 may distinguish whether a message is from the sender or the receiver by the color of the waveform graph itself, the color of the character string of the chat text, or the like, without being limited to the background image. In other words, as long as it is possible to distinguish whether a waveform graph or chat text is from the sender or the receiver, the waveform graph or chat text may be displayed in any manner.

[0072] Control by the control unit 210 to display a screen such as that shown in Figure 8 is an example of a process in which, when the setting information of the calling device of a user communicating with a user of one calling device indicates that the recording function is enabled and the transcription function is disabled, the display screen of the calling device of the communicating user includes text information indicating the contents of the chat and a waveform graph indicating that audio is being recorded.

[0073] FIG. 9 is a diagram (part 3) showing an example of the screen of the recipient's telephone device. Screen 800 in Fig. 9 is an example of a screen on the receiving side where the setting information is recording ON, transcription ON, simultaneous interpretation mode OFF, and language information is Japanese. The voice is heard in the original language of the sender. Since transcription is ON, a character string 810 translated into the language set in the language information (Japanese in the example of Fig. 9) is displayed.

[0074] Because recording is ON, a waveform graph showing the voice is displayed, and chat text is also displayed. The chat text is also displayed as a character string 820 translated into the language set in the language information (Japanese in the example of FIG. 9). The control unit 210 displays the translated character string on the screen using a background image so that it is possible to distinguish whether it is a transcription of the voice by the sender or a transcription of the voice by the recipient. This is an example of text information being displayed on the display screen so that it is possible to distinguish whether it is text information that is the result of transcription of the transmitted voice or text information that is the result of transcription of the received voice.

[0075] Control by the control unit 210 to display a screen such as that shown in Fig. 9 is an example of a process of controlling so that, when the setting information of the calling device of a user communicating with a user of one calling device indicates that the recording function and the transcription function are enabled, text information indicating the contents of the chat and character information resulting from the transcription of the voice are included on the display screen of the calling device of the communicating user. The character information is character information translated into the language indicated by the language information included in the setting information.

[0076] In addition, when the setting information includes recording ON, transcription ON, simultaneous interpretation mode ON, and language information is Japanese, the screen example of the call device 110B is the same as that in Fig. 9. However, in this case, the voice translated into the set language (Japanese in the example of Fig. 9) following the original language is output from the call device 110B.

[0077] FIG. 10 is a diagram (part 4) showing an example of the screen of the recipient's telephone device. 10 is an example of a screen on the receiving side where the setting information is: recording ON, transcription ON, simultaneous interpretation mode OFF, and language information is Thai. The voice is heard in the original language of the sender.

[0078] Because transcription is ON, a character string 910 translated into the language set in the language information (Thai in the example of FIG. 10) is displayed. Because recording is ON, a waveform graph showing the audio is displayed, and the chat text is also displayed. A character string 920 translated into the language set in the language information (Thai in the example of FIG. 10) for the chat text is also displayed.

[0079] In addition, when the setting information includes recording ON, transcription ON, simultaneous interpretation mode ON, and language information is Thai, the screen example of the call device 110B is the same as that of Fig. 10. However, in this case, the voice translated into the set language (Thai in the example of Fig. 10) following the original language is output from the call device 110B.

[0080] As described above, according to the first embodiment, it is possible to control each of the multiple calling devices 110B to display an appropriate display screen based on the setting information in each of the multiple calling devices 110B. The control of the display screen of the calling device 110A by the control unit 210 is similar to the control of the display screen of the calling device 110B. The control unit 210 controls the display screen of the calling device 110A based on the setting information of the calling device 110A.

[0081] (Variation 1) Modification 1 of embodiment 1 will be described below. In modification 1, differences from embodiment 1 will be mainly described. In the first embodiment, the control unit 210 of the server apparatus 100 generates a screen for the calling device 110 and transmits it to the calling device 110 .

[0082] However, without being limited thereto, the control unit 210 may prepare data necessary for the screen based on setting information or an operation via the screen of the calling device 110, and the control unit 210 may transmit the prepared data to the corresponding calling device 110 as appropriate. Then, the calling device 110 may generate and display a screen based on the data received from the server device 100. According to the first modification, the same effects as those of the first embodiment can be achieved.

[0083] (Variation 2) Modification 2 of embodiment 1 will be described below. In modification 2, differences from embodiment 1 will be mainly described. In the first embodiment, the communication between the handset device 110A and the multiple handset devices 110B by the control unit 210, that is, one-to-many communication, has been described as an example.

[0084] However, the present invention is not limited to this, and the same applies to one-to-one communication between the call device 110A and the call device 110B by the control unit 210. Even in this embodiment, the control unit 210 controls the display screen of the call device 110A based on the setting information of the call device 110A, and controls the display screen of the call device 110B based on the setting information of the call device 110B.

[0085] According to the second modification, it is possible to control the calling device 110A and the calling device 110B so that appropriate display screens are displayed on the calling device 110A and the calling device 110B, respectively, based on the setting information on the calling device 110A and the calling device 110B, respectively.

[0086] (Other variations) The following describes other modifications of embodiment 1. In the other modifications, the differences from embodiment 1 will be mainly described. A part of the processing performed by the server apparatus 100 in the first embodiment may be executed by each of the multiple telephone devices 110. In the first embodiment, the communication between the call devices 110 is described using IP wireless as an example, but the communication is not limited thereto. Any communication standard may be used as long as communication between the call devices 110 and between the call device 110 and the server device 100 is possible.

[0087] Furthermore, the call device 110 is not limited to an IP telephone, but may be a tablet computer. Any device may be used as long as it is capable of making calls and exchanging text information between devices. The device may be portable or may be installed at a predetermined location such as a counter.

[0088] Finally, various embodiments according to the present disclosure have been described, but these are presented as examples and are not intended to limit the scope of the invention. The new embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the gist of the invention. The embodiments and their modifications are included within the scope and gist of the invention, and are included within the scope of the invention and its equivalents described in the claims. The first embodiment and each of the modifications described above can be combined in any combination. [Explanation of symbols]

[0089] 100: Server device 110: Telephone device 120:Base station 150: Network 210: Control section 220: Storage section 230: Communications Department

Claims

1. An information processing system, comprising: Controlling communication from one of a plurality of communication terminals to another communication terminal other than the one of the plurality of communication terminals; the other communication terminal is one or more communication terminals, Controlling the other communication terminal so as to change a display screen during communication based on setting information in the other communication terminal; The setting information includes: Whether to enable the recording function, Whether to enable the transcription feature, Contains information on The setting information of a communication terminal of a user who is in communication with the user of the first communication terminal is Disable recording function, Disable transcription feature, If the user indicates "chat", control is performed so that text information indicating the chat contents is displayed on the display screen of the communication terminal of the user who is communicating. Information processing system.

2. In the information processing system according to claim 1, The setting information further includes: Contains information on whether or not to enable simultaneous interpretation settings. controlling audio output in the other communication terminal according to information on whether or not a simultaneous interpretation setting is enabled, the information being included in the setting information in the other communication terminal; Information processing system.

3. In the information processing system according to claim 2, In a communication terminal having setting information including information enabling simultaneous interpretation setting, control is performed so that speech interpreted in a language selected in the communication terminal is output following speech output in an original language by a speaker; Information processing system.

4. In the information processing system according to claim 1, the text information is displayed on the display screen in such a manner that it can be distinguished whether it is text information of the contents of an originating chat or text information of the contents of a received chat; Information processing system.

5. In the information processing system according to claim 1, The setting information of a communication terminal of a user who is in communication with the user of the first communication terminal is Enable recording function, Disable transcription feature, If the user has already started chatting, the display screen of the communication terminal of the user in communication is controlled to display text information indicating the chat contents and a waveform graph indicating that the voice is being recorded. Information processing system.

6. In the information processing system according to claim 1, The setting information of a communication terminal of a user who is in communication with the user of the first communication terminal is Enable recording function, Enable the transcription feature, If the user has a voice message, the display screen of the communication terminal of the user in communication is controlled to display text information indicating the chat contents and text information resulting from the voice transcription. Information processing system.

7. In the information processing system according to claim 6, The text information is displayed on the display screen in a manner that allows identification as to whether the text information is a result of transcription of transmitted voice or a result of transcription of received voice. Information processing system.

8. In the information processing system according to claim 6, The setting information further includes: It contains information about the language, which is information about the language, the character information is character information translated into a language indicated by language information included in the setting information; Information processing system.

9. In the information processing system according to claim 1, The setting information further includes: Further included is information about language, which is information about language; The text information is text information indicating chat contents translated into a language indicated by language information included in the setting information. Information processing system.

10. 2. The information processing system according to claim 1, the other communication terminal is a plurality of communication terminals, Controlling the other communication terminals so as to change a display screen during communication based on setting information in each of the other communication terminals; Information processing system.

11. An information processing method executed by an information processing system, comprising: Controlling communication from one of a plurality of communication terminals to another communication terminal other than the one of the plurality of communication terminals; Controlling the other communication terminal so as to change a display screen during communication based on setting information in the other communication terminal; The setting information includes: Whether to enable the recording function, Whether to enable the transcription feature, Contains information on The setting information of a communication terminal of a user who is in communication with the user of the first communication terminal is Disable recording function, Disable transcription feature, If the user indicates "chat", control is performed so that text information indicating the chat contents is displayed on the display screen of the communication terminal of the user who is communicating. Information processing methods.

12. A program comprising: Computer, A program for causing the information processing system according to any one of claims 1 to 10 to function as such.