Information processing system, information processing method, and program

Abstract

According to one embodiment of the present invention, provided is an information processing system. The information processing system controls communication from one communication terminal among a plurality of communication terminals to another communication terminal other than the one communication terminal among the plurality of communication terminals. The control is performed so as to change a display screen during communication of the other communication terminal on the basis of setting information in the other communication terminal. The setting information includes information on whether or not to enable a recording function and whether or not to enable a transcription function.

Description

Information processing system, information processing method and program

[0001] The present invention relates to an information processing system, an information processing method, and a program.

[0002] Patent Document 1 discloses a signal processing device that can reduce information transmission errors in a system that realizes one-to-many group simultaneous voice communication.

[0003] JP 2019-4392 A

[0004] In a system that performs one-to-many or one-to-one communication, each device constituting the system may have multiple functions. In such a case, the settings for each of the multiple functions may differ for each device. In such a case, it is necessary to appropriately control the user interface of each device. However, Patent Document 1 does not disclose how to appropriately control the user interface in accordance with the settings for each of the multiple functions.

[0005] According to one aspect of the present invention, there is provided an information processing system. The information processing system controls communication from one of a plurality of communication terminals to another communication terminal other than the one of the plurality of communication terminals. The information processing system controls the other communication terminal to change its display screen during communication based on setting information of the other communication terminal. The setting information includes information on whether to enable a recording function and whether to enable a transcription function.

[0006] According to another aspect of the present invention, in the information processing system, the setting information further includes information on whether or not to enable simultaneous interpretation settings, and the information processing system is configured to control the audio output at the other communication terminal depending on the information on whether or not to enable simultaneous interpretation settings included in the setting information at the other communication terminal.

[0007] According to another aspect of the present invention, in the information processing system, a communication terminal having setting information including information for enabling simultaneous interpretation setting is configured to control the output of speech in the original language by the speaker, followed by the output of speech interpreted in the language selected in the communication terminal.

[0008] According to another aspect of the present invention, the information processing system is configured such that, if the setting information of the communication terminal of a user currently communicating with the user of the first communication terminal indicates that the recording function is disabled and the transcription function is disabled, the display screen of the communication terminal of the currently communicating user is controlled to include text information indicating the contents of the chat.

[0009] According to another aspect of the present invention, in the information processing system, the text information is configured to be displayed on the display screen in a manner that allows identification of whether it is text information about the content of a chat that has been sent or text information about the content of a chat that has been received.

[0010] According to another aspect of the present invention, if the setting information of the communication terminal of a user currently communicating with the user of the first communication terminal indicates that the recording function is enabled and the transcription function is disabled, the display screen of the communication terminal of the currently communicating user is controlled to include text information indicating the contents of the chat and a waveform graph indicating that audio is being recorded.

[0011] According to another aspect of the present invention, the information processing system is configured to control the display screen of the communication terminal of the user currently communicating with the user of the first communication terminal so that, when the setting information of the communication terminal of the user currently communicating with the user of the first communication terminal indicates that the recording function is enabled and the transcription function is enabled, the display screen of the communication terminal of the user currently communicating with the user includes text information indicating the contents of the chat and text information that is the result of transcribing the voice.

[0012] According to another aspect of the present invention, in the information processing system, the text information is configured to be displayed on the display screen in a manner that allows identification of whether the text information is the result of transcription of transmitted voice or the result of transcription of received voice.

[0013] According to another aspect of the present invention, in the information processing system, the setting information further includes language information, which is language information, and the character information is configured to be character information translated into a language indicated by the language information included in the setting information.

[0014] According to another aspect of the present invention, in the information processing system, the setting information further includes language information, which is language information, and the text information is text information indicating the content of the chat translated into a language indicated by the language information included in the setting information.

[0015] According to another aspect of the present invention, in the information processing system, the other communication terminal is a plurality of communication terminals, and is configured to control the display screen of each of the other communication terminals during communication based on setting information in each of the other communication terminals.

[0016] According to another aspect of the present invention, there is provided an information processing method executed by an information processing system, which controls communication from one of a plurality of communication terminals to another communication terminal other than the one of the plurality of communication terminals, and controls the other communication terminal to change its display screen during communication based on setting information in the other communication terminal, and the setting information is configured to include information on whether to enable a recording function and whether to enable a transcription function.

[0017] According to another aspect of the present invention, the present invention is configured as a program for causing a computer to function as the information processing system.

[0018] In the information system according to the present invention, it is possible to control the display of an appropriate display screen on each of the plurality of devices constituting the system based on the setting information of each of the devices.

[0019] FIG. 1 is a diagram showing an example of the system configuration of an information processing system according to the present invention. FIG. 2 is a diagram showing an example of the hardware configuration of a server device according to the present invention. FIG. 3 is a diagram showing an example of the hardware configuration of a calling device according to the present invention. FIG. 4 is a diagram showing an example of a setting screen for setting setting information according to the present invention. FIG. 5 is a sequence diagram showing an example of information processing related to call control, etc. according to the present invention. FIG. 6 is a diagram showing an example of screen transitions of a calling device of a caller according to the present invention. FIG. 7 is a diagram (part 1) showing an example of a screen of a calling device of a call recipient according to the present invention. FIG. 8 is a diagram (part 2) showing an example of a screen of a calling device of a call recipient according to the present invention. FIG. 9 is a diagram (part 3) showing an example of a screen of a calling device of a call recipient according to the present invention. FIG. 10 is a diagram (part 4) showing an example of a screen of a calling device of a call recipient according to the present invention.

[0020] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention will be described below with reference to the accompanying drawings. Various features shown in the following embodiments can be combined with each other.

[0021] <First Embodiment> 1. System Configuration Diagram Fig. 1 is a diagram showing an example of the system configuration of an information processing system 1000. As shown in Fig. 1, the information processing system 1000 includes, as a system configuration, a server device 100, a plurality of call devices 110, and a plurality of base stations 120.

[0022] The call device 110 is connected to the network 150 via the base station 120. The server device 100 and the multiple call devices 110 are communicatively connected via the base station 120 and the network 150. Similarly, the multiple call devices 110 are communicatively connected to each other via the base station 120 and the network 150. The call device 110 is an example of a communication terminal.

[0023] The server device 100 is a server that provides a function for performing push-to-talk between the call devices 110. More specifically, the server device 100 controls calls between the one-to-many call devices 110 shown in the first embodiment, and controls the display screens of the call devices 110.

[0024] As will be described later, the server device 100 also translates the speaker's voice into multiple languages ​​and transmits and receives the interpreted voice to each of the multiple call devices 110. The server device 100 also translates text information input to the call device 110 into multiple languages ​​and transmits and receives the translated text information to each of the multiple call devices 110. The server device 100 also controls the display of the screens of each of the multiple call devices 110.

[0025] In the first embodiment, the control of the screen display and screen transition of the call device 110 will be described as being performed by the control unit 210. More specifically, in the first embodiment, the server device 100 generates a screen for the call device 110 and transmits it to the call device 110. The call device 110 displays the screen received from the server device 100.

[0026] The call device 110 is an IP radio used by a user. The IP radio is a device that converts voice into packets and performs data communication using radio waves from a mobile phone. The information processing system 1000 includes multiple call devices 110, and the following description will be given assuming that users who speak different languages ​​as their native languages ​​use each of the call devices 110. Each of the multiple users communicates using voice and text information via the call device 110.

[0027] The claimed information processing system may be configured with multiple devices or with one device. When the claimed information processing system is configured with one device, an example of the device is the server device 100. When the claimed information processing system is configured with multiple devices, an example of the multiple devices is multiple server devices to which multiple functions of the server device 100 of the first embodiment are respectively assigned, or the server device 100 and at least one or more call devices 110 among the multiple call devices 110. 2. Hardware Configuration (1) Hardware Configuration of the Server Device 100

[0028] Fig. 2 is a diagram illustrating an example of the hardware configuration of the server device 100. As illustrated in Fig. 2, the server device 100 includes, as its hardware configuration, a control unit 210, a storage unit 220, and a communication unit 230.

[0029] The control unit 210 is a CPU (Central Processing Unit) or the like, and controls the entire server device 100 .

[0030] The storage unit 220 is any one of a hard disk drive (HDD), a read only memory (ROM), a random access memory (RAM), a solid state drive (SSD), etc., or any combination thereof, and stores programs and data used when the control unit 210 executes processing based on the programs (for example, setting information, audio files, transcribed text information, translated text information, etc., as described below).

[0031] The storage unit 220 is an example of a storage medium. Although the description in this specification assumes that the data used when the control unit 210 executes processing based on a program is stored in the storage unit 220, the data may also be stored in a storage unit of another device that can communicate with the server device 100. In other words, the data may be stored in a storage unit of any device as long as the control unit 210 can refer to the data.

[0032] The control unit 210 executes processing based on the program stored in the memory unit 220, thereby realizing the functions of the server device 100 and the processing of the server device 100 in the sequence diagram shown in Figure 5 described below.

[0033] The communication unit 230 connects the server device 100 to the network 150 and controls communication with other devices (plurality of call devices 110).

[0034] (2) Hardware Configuration of Call Device 110 Fig. 3 is a diagram illustrating an example of the hardware configuration of the call device 110. The call device 110 includes, as its hardware configuration, a control unit 310, a storage unit 320, an audio input unit 330, an audio output unit 340, an input / output unit 350, and a communication unit 360.

[0035] The control unit 310 is a CPU or the like, and controls the entire call device 110. The storage unit 320 is any one of a ROM, a RAM, an SSD, or any combination thereof, and stores programs, data used when the control unit 310 executes processing based on the programs, and the like. The control unit 310 executes processing based on the programs stored in the storage unit 320, thereby realizing the functions of the call device 110. The storage unit 320 is an example of a storage medium.

[0036] The voice input unit 330 is a microphone or the like that inputs the voice of the operator. The voice output unit 340 is a speaker or the like that outputs the voice of the communication partner. The input / output unit 350 is a touch panel display or the like that inputs user operations to the control unit 310 and displays the results of processing by the control unit 310, etc.

[0037] The communication unit 360 connects the calling device 110 to the network 150 via the base station 120 and controls communication with other devices (e.g., the server device 100, other calling devices 110, etc.). Note that, hereinafter, the calling device 110 of the sender will also be referred to as calling device 110A, and the calling device 110 of the recipient will also be referred to as calling device 110B, but both have the same hardware configuration as that shown in FIG. 3.

[0038] 3. Information Processing (1) Setting Information A user sets setting information via his / her own calling device 110. The setting information set via the screen of the calling device 110 is transmitted from the calling device 110 to the server device 100, and is stored and managed in the storage unit 220 or the like of the server device 100. Fig. 4 is a diagram showing an example of a setting screen for setting the setting information.

[0039] A user sets setting information via a setting screen such as that shown in Fig. 4. When the setting information is set via the setting screen, the call device 110 associates a PTT number that identifies the call device 110 with the setting information and transmits the associated information to the server device 100. When the server device 100 receives the PTT number that identifies the call device 110 and the setting information from the call device 110, the server device 100 stores the setting information in the storage unit 220 or the like in association with the PTT number.

[0040] As shown in Figure 4, the setting information includes information on recording, transcription, simultaneous interpretation mode, and language. The recording information specifies whether the recording function is ON or OFF. ON indicates enabled. OFF indicates disabled. The same applies below.

[0041] The transcription information sets whether the transcription function is ON or OFF. The simultaneous interpretation mode information sets whether the simultaneous interpretation mode is ON or OFF. The language information sets the language for interpretation and translation. The user selects a desired language from multiple languages ​​presented on the screen of the call device 110. Information on the selected language (e.g., Japanese, Thai, English, etc.) is included in the setting information.

[0042] When recording is ON, the conversation via the call device 110 is recorded in the server device 100. When recording is OFF, no recording is performed. When transcription is ON, the conversation via the call device 110 is transcribed. When transcription is OFF, no transcription is performed.

[0043] When the simultaneous interpretation mode is ON, the conversation via the call device 110 is interpreted, and the interpreted audio is output from the call device 110. The interpretation is performed in the language indicated by the language information included in the setting information. Therefore, when the simultaneous interpretation mode is ON, the audio in the original language of the conversation partner is followed by the interpreted audio output from the call device 110.

[0044] (2) Sequence Diagram Fig. 5 is a sequence diagram showing an example of information processing related to call control, etc. In Fig. 5, call device 110A is the call device 110 used by the caller. Call device 110B is the call device 110 used by the call recipient. The "..." after call device 110B in Fig. 5 indicates that there are multiple call devices 110B.

[0045] In the first embodiment, the description will be given assuming that the control unit 210 generates a screen to be displayed on the call device 110 based on operations and / or setting information on the screen of the call device 110 and transmits the generated screen to the corresponding call device 110. Such processing performed by the control unit 210 is an example of screen display control.

[0046] The caller operates the handset device 110A, selects a group to call, and performs a predetermined operation. Then, a call request is sent from the handset device 110A to the server device 100. The call request includes a call ID that identifies the call and a PTT (Push to Talk) number of the caller included in the selected group. The PTT number is information that identifies each handset device 110. When the caller selects a group, the PTT number of the caller included in that group is obtained and included in the call request.

[0047] Instead of selecting a group, the caller may select multiple call partners from contacts or from a call history. However, for the sake of simplicity, the following description will be given assuming that the caller selects a group GUI component displayed on the screen of the call device 110A to display multiple groups on the screen, and then selects a group from the displayed groups.

[0048] 6 is a diagram showing an example of screen transitions on the caller's handset device 110A. Screen 510 is a home screen, i.e., a screen that is normally displayed. When the caller selects group button 511 on screen 510, the screen of call device 110A transitions from screen 510 to screen 520. Screen 520 is a group selection screen.

[0049] When the caller selects a group on screen 520 (group A is selected in the example of FIG. 6 ), the screen of call device 110A transitions from screen 520 to screen 530. Screen 530 is a screen that displays a list of members included in the selected group. If there are too many members to fit on one screen, a scroll bar is displayed. The caller can view the members that do not fit on one screen by operating the scroll bar.

[0050] The PTT button 531 is a button that the caller selects (or presses) when talking. The PTT button 531 remains selected while the caller is talking. After the caller's voice call ends, other members in the group select the PTT button displayed on their own call devices 110 to make voice calls.

[0051] When a group is selected on screen 520 and PTT button 531 is selected on screen 530, in sequence SQ401, control unit 310 of handset device 110A transmits a call request to server device 100. The call request also includes the PTT number of the caller who transmitted the call request. Control unit 210 of server device 100 receives the call request from handset device 110A.

[0052] Upon receiving the call request, in sequence SQ402, the control unit 210 identifies the caller based on the caller's PTT number included in the call request. The control unit 210 also identifies multiple recipients based on multiple PTT numbers of the call recipients (i.e., recipients) included in the call request.

[0053] In sequence SQ403, the control unit 210 identifies and acquires the setting information of the caller based on the caller's PTT number included in the call request. The control unit 210 also identifies and acquires the setting information of each of the multiple recipients based on the multiple recipients' PTT numbers included in the call request.

[0054] In sequence SQ404, the control unit 210 executes call control. More specifically, the control unit 210 acquires tokens for the handset devices 110 corresponding to the PTT numbers of the multiple recipients. The tokens are information that identifies the handset devices 110.

[0055] In sequence SQ405, the control unit 210 uses each token to transmit call information, which is a PTT call, to each of the handset devices 110. For simplicity of explanation, the present embodiment will be described assuming that the server device 100 provides multiple functions. However, each of the multiple server devices may share and execute each of the multiple functions provided by the server device 100 of embodiment 1.

[0056] When the call device 100 receives the call information, the control unit 310 outputs a ringing tone via the audio output unit 340. The user who hears the ringing tone performs a predetermined operation, such as selecting a mark to answer the call, on the screen displayed on the input / output unit 350. When the predetermined operation is accepted via the screen displayed on the input / output unit 350, in sequence SQ406, the control unit 310 joins the call and transmits information indicating that the user has joined the call to the server apparatus 100.

[0057] Upon receiving information indicating that the call has been joined, in sequence SQ407, the control unit 210 of the server device 100 controls communication (e.g., sending and receiving voice data, sending and receiving text information, displaying a screen, etc.) between the call device 110A and the call device 110B that sent the information indicating that the call has been joined.

[0058] For example, the control unit 210 controls one-to-many communication from one of the plurality of call devices (e.g., call device 110A) to a plurality of other call devices (e.g., a plurality of call devices 110B) other than the one of the plurality of call devices.

[0059] Screen 540 in Fig. 6 shows an example of a screen displayed when a caller is in the middle of a call. Screen 540 shows who is speaking and who is listening in the group. Screen 550 in Fig. 6 shows an example of a screen displayed during a call. If simultaneous interpretation mode is ON for even one user in the group, status 551 indicating that interpretation is in progress is displayed on the screens of all users in the group. When chat icon 552 is selected, the screen of call device 110A transitions from screen 550 to screen 560. Screen 560 shows an example of a detailed display screen.

[0060] In sequence SQ408, control unit 210 stores the voice data of the call in storage unit 220, etc., based on the setting information of each user included in the group. For example, if the recording information of the setting information of even one user included in the group is set to ON, the voice data of the call of that group is stored in storage unit 220, etc.

[0061] In sequence SQ409, control unit 210 transcribes the recorded voice data based on the setting information of each user included in the group. More specifically, if the transcription information in the setting information of even one user included in the group is set to ON, the content of the call is transcribed based on the voice data of the call of that group.

[0062] Transcription is the process of turning the contents of a conversation into text based on audio data. For example, if the recorded audio data is English audio data, the transcription is performed in English. If the recorded audio data is Japanese audio data, the transcription is performed in Japanese. Then, the control unit 210 translates the transcribed text into the language indicated by the language information based on the language information in the setting information where the transcription information was ON. The control unit 210 stores the transcribed and translated data in the storage unit 220 or the like.

[0063] In sequence SQ410, the control unit 210 converts the transcribed text into audio data based on the setting information of each user included in the group. If the transcribed text is in Japanese, it is converted into Japanese audio data. If the transcribed text is in Thai, it is converted into Thai audio data.

[0064] In sequence SQ411, the control unit 210 transmits the converted audio data as the interpreted audio to the corresponding handset device 110B in the group. As a result, the handset device 110B, whose setting information indicates the simultaneous interpretation mode ON, outputs audio in the original language, followed by audio interpreted in the set language. This process is an example of a process for controlling the audio output of each of the other handset devices in accordance with information on whether the simultaneous interpretation setting is enabled, which is included in the setting information of each of the other handset devices. This process is also an example of a process for controlling a handset device, whose setting information includes information enabling the simultaneous interpretation setting, to output audio in the original language (the original language of the speaker), followed by audio translated into the language selected for the handset device.

[0065] (3) Control of Display Screen The control unit 210 controls the display of the display screen during a call for each of the multiple call devices 110B based on the setting information for each of the multiple call devices 110B. This process is an example of a process for controlling the change of the display screen during communication for each of the other multiple call devices based on the setting information for each of the other multiple call devices.

[0066] The following describes the control of the screen display by the control unit 210 using the screen on the recipient's side. FIG. 7 is a diagram (part 1) showing an example of the screen of the recipient's calling device. Screen 600 in FIG. 7 is an example of the screen on the recipient's side with the settings information of recording OFF, transcription OFF, and simultaneous interpretation mode OFF. The audio is heard in the sender's original language. Because recording is OFF, only chat text 610 from users in the group is displayed.

[0067] 7 is an example of a process of controlling the display screen of the calling device of a user currently communicating with a user of one calling device to include text information indicating the content of the chat when the setting information of the calling device of the user currently communicating with the user of one calling device indicates that the recording function and the transcription function are disabled. The text information is text information indicating the content of the chat translated into a language indicated by the language information included in the setting information.

[0068] 8 is a diagram (part 2) showing an example of a screen on the recipient's call device. Screen 700 in FIG. 8 is an example of a screen on the receiving side with the settings: recording is ON, transcription is OFF, and simultaneous interpretation mode is OFF. The audio is heard in the sender's original language. Because recording is ON, a waveform graph 710 showing the audio is displayed, and chat text 720 is also displayed.

[0069] The background image 730 of the waveform graph 710 indicates that it is the waveform graph 710 of the voice of the recipient. The background image 740 of the waveform graph indicates that it is the waveform graph of the voice of the sender. The background image 750 of the chat text 720 indicates that the chat text is received chat text. In other words, the control unit 210 displays the voice waveform graph on the screen in a manner that allows the user to distinguish, by the background image, whether the voice is the voice of the sender or the voice of the recipient.

[0070] Similarly, the control unit 210 displays the chat text on the screen in a manner that allows the user to distinguish whether the chat text is from a sender or a receiver, using a background image. This is an example of displaying text information on the display screen in a manner that allows the user to distinguish whether the text information is from a sent chat or a received chat.

[0071] The control unit 210 may make it possible to distinguish between a message from the sender and a message from the receiver based on the color of the background image, or may make it possible to distinguish between a message from the sender and a message from the receiver based on the pattern or shape of the background image. Furthermore, the control unit 210 may distinguish between a message from the sender and a message from the receiver based on the color of the waveform graph itself, the color of the characters in the chat text, or the like, in addition to the background image. In other words, the waveform graph and chat text may be displayed in any manner as long as it is possible to distinguish between a message from the sender and a message from the receiver.

[0072] The control unit 210 controls the display of a screen such as that shown in Figure 8, which is an example of a process in which, when the setting information of the call device of a user currently communicating with the user of one call device indicates that the recording function is enabled and the transcription function is disabled, the display screen of the call device of the user currently communicating includes text information indicating the contents of the chat and a waveform graph indicating that audio is being recorded.

[0073] 9 is a diagram (part 3) showing an example of a screen on the recipient's call device. Screen 800 in FIG. 9 is an example of a screen on the receiving side where the setting information is recording ON, transcription ON, simultaneous interpretation mode OFF, and language information is Japanese. The voice is heard in the sender's original language. Because transcription is ON, a character string 810 translated into the language set in the language information (Japanese in the example of FIG. 9) is displayed.

[0074] Because recording is ON, a waveform graph showing the audio is displayed, and chat text is also displayed. A character string 820 is also displayed, translating the chat text into the language set in the language information (Japanese in the example of FIG. 9 ). The control unit 210 displays the translated character string on the screen using a background image so that it is possible to distinguish whether it is a transcription of the voice of the sender or the receiver. This is an example of displaying text information on the display screen so that it is possible to distinguish whether it is text information that is the result of transcription of the transmitted voice or text information that is the result of transcription of the received voice.

[0075] 9 is an example of a process in which, when the setting information of the call device of a user currently communicating with a user of one call device indicates that the recording function and the transcription function are enabled, the display screen of the call device of the currently communicating user includes text information indicating the content of the chat and character information resulting from the transcription of the voice. The character information is character information translated into the language indicated by the language information included in the setting information.

[0076] Note that even when the setting information includes recording ON, transcription ON, simultaneous interpretation mode ON, and language information is Japanese, the example screen of call device 110B will be the same as that shown in Fig. 9. However, in this case, speech translated into the set language (Japanese in the example shown in Fig. 9) following the original language is output from call device 110B.

[0077] 10 is a diagram (part 4) showing an example of a screen on the recipient's calling device. Screen 900 in FIG. 10 is an example of a screen on the receiving side where the setting information is recording ON, transcription ON, simultaneous interpretation mode OFF, and language information is Thai. The audio is heard in the sender's original language.

[0078] Because transcription is ON, a character string 910 translated into the language set in the language information (Thai in the example of FIG. 10) is displayed. Because recording is ON, a waveform graph showing the audio is displayed, and chat text is also displayed. A character string 920 translated into the language set in the language information (Thai in the example of FIG. 10) for the chat text is also displayed.

[0079] Note that even when the setting information includes recording ON, transcription ON, simultaneous interpretation mode ON, and language information is Thai, the example screen of call device 110B is the same as that shown in Fig. 10. However, in this case, speech that has been translated into the set language (Thai in the example shown in Fig. 10) following the original language is output from call device 110B.

[0080] As described above, according to the first embodiment, it is possible to control the display of an appropriate display screen on each of the plurality of call devices 110B based on the setting information of each of the plurality of call devices 110B. The control of the display screen of the call device 110A by the control unit 210 is similar to the control of the display screen of the call device 110B. The control unit 210 controls the display screen of the call device 110A based on the setting information of the call device 110A.

[0081] (Modification 1) Modification 1 of embodiment 1 will be described. Modification 1 will mainly describe differences from embodiment 1. In embodiment 1, it has been described that the control unit 210 of the server device 100 generates a screen for the calling device 110 and transmits it to the calling device 110.

[0082] However, the present invention is not limited to this, and the control unit 210 may prepare data necessary for the screen based on setting information, operations via the screen of the calling device 110, etc., and the control unit 210 may transmit the prepared data to the corresponding calling device 110 as appropriate. The calling device 110 may then generate and display a screen based on data received from the server device 100. According to the first modification, the same effects as those of the first embodiment can be achieved.

[0083] (Modification 2) Modification 2 of embodiment 1 will be described. Modification 2 will be mainly described with respect to differences from embodiment 1. In embodiment 1, the communication between the call device 110A and multiple call devices 110B by the control unit 210, i.e., one-to-many communication, has been described as an example.

[0084] However, this is not limiting, and the same applies to communication between the call device 110A and the call device 110B, i.e., one-to-one communication, by the control unit 210. Even in this mode, the control unit 210 controls the display screen of the call device 110A based on the setting information of the call device 110A, and also controls the display screen of the call device 110B based on the setting information of the call device 110B.

[0085] According to the second modification, it is possible to control the call device 110A and the call device 110B so that an appropriate display screen is displayed on each of the call device 110A and the call device 110B based on the setting information of each of the call device 110A and the call device 110B.

[0086] (Other Modifications) Other modifications of the first embodiment will be described. In these other modifications, differences from the first embodiment will be mainly described. A part of the processing by the server device 100 of the first embodiment may be executed by each of the multiple call devices 110. Furthermore, in the first embodiment, IP wireless communication has been described as an example of communication between the call devices 110, but the present invention is not limited to this. Any communication standard may be used as long as communication between the call devices 110 and between the call device 110 and the server device 100 is possible.

[0087] Furthermore, the call device 110 is not limited to an IP telephone, but may be a tablet computer or the like. Any device may be used as long as it is capable of making calls and exchanging text information between devices. The device may be portable or may be installed in a predetermined location such as a counter.

[0088] Finally, while various embodiments according to the present disclosure have been described, these are presented as examples and are not intended to limit the scope of the invention. The novel embodiments can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. The embodiments and their modifications are within the scope and spirit of the invention, and are also within the scope of the invention and its equivalents as set forth in the claims. Embodiment 1 and the above-described modifications can be combined in any combination.

[0089] 100: Server device 110: Call device 120: Base station 150: Network 210: Control unit 220: Storage unit 230: Communication unit

Claims

1. An information processing system, which controls communication from one of a plurality of communication terminals to another communication terminal other than the one of the plurality of communication terminals, the other communication terminal being one or more communication terminals, and controls to change a display screen of the other communication terminal during communication based on setting information in the other communication terminal, the setting information including information on whether or not to enable a recording function, and whether or not to enable a transcription function.

2. An information processing system as described in claim 1, wherein the setting information further includes information on whether or not a simultaneous interpretation setting is enabled, and the audio output in the other communication terminal is controlled according to the information on whether or not a simultaneous interpretation setting is enabled, which is included in the setting information in the other communication terminal.

3. An information processing system according to claim 2, wherein in a communication terminal having setting information including information for enabling simultaneous interpretation setting, control is performed so that speech interpreted in a language selected in the communication terminal is output following speech output in the original language by the speaker.

4. An information processing system as claimed in any one of claims 1 to 3, wherein, when the setting information of the communication terminal of a user currently communicating with a user of the first communication terminal indicates that the recording function is disabled and the transcription function is disabled, the display screen of the communication terminal of the currently communicating user is controlled to include text information indicating the contents of the chat.

5. An information processing system according to claim 4, wherein the text information is displayed on the display screen in a manner that makes it possible to distinguish whether the text information is text information about the contents of an outgoing chat or text information about the contents of a received chat.

6. An information processing system as claimed in any one of claims 1 to 5, wherein, when the setting information of the communication terminal of a user currently communicating with a user of the first communication terminal indicates that the recording function is enabled and the transcription function is disabled, the display screen of the communication terminal of the currently communicating user is controlled to include text information indicating the contents of the chat and a waveform graph indicating that audio is being recorded.

7. An information processing system as claimed in any one of claims 1 to 6, wherein, when the setting information of the communication terminal of a user currently communicating with a user of the first communication terminal indicates that a recording function is enabled and a transcription function is enabled, the display screen of the communication terminal of the currently communicating user is controlled to include text information indicating the contents of the chat and text information resulting from the transcription of the voice.

8. An information processing system according to claim 7, wherein the text information is displayed on the display screen in a manner that makes it possible to distinguish whether the text information is the result of transcription of transmitted voice or the text information is the result of transcription of received voice.

9. An information processing system according to claim 7, wherein the setting information further includes language information which is language information, and the character information is character information translated into a language indicated by the language information included in the setting information.

10. An information processing system according to claim 4, wherein the setting information further includes language information which is language information, and the text information is text information indicating chat content translated into a language indicated by the language information included in the setting information.

11. An information processing system according to any one of claims 1 to 10, wherein the other communication terminal is a plurality of communication terminals, and the information processing system controls to change the display screen of each of the other communication terminals during communication based on setting information in each of the other communication terminals.

12. An information processing method executed by an information processing system, comprising: controlling communication from one of a plurality of communication terminals to another communication terminal other than the one of the plurality of communication terminals; and controlling the other communication terminal to change a display screen during communication based on setting information in the other communication terminal, the setting information including information on whether or not to enable a recording function, and whether or not to enable a transcription function.

13. A program for causing a computer to function as an information processing system according to any one of claims 1 to 11.

Images