System, method, program, and information processing device
The system converts user voice to text and processed audio for diverse real-time communication, addressing limitations in existing systems by reducing data processing load and enabling translation and conversation generation.
Patent Information
- Application Number
- JP2023099280
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-06-16
- Publication Date
- 2024-12-26
AI Technical Summary
Existing communication systems lack diversity and real-time capabilities in user interactions, particularly in systems that support communication between users via avatars in VR spaces.
A system that converts user voice into text information, performs processing on the text, and outputs the processed audio information to other users, enabling diverse real-time communication through voice chat.
Enables real-time communication in diverse forms by reducing data processing load and allowing for translation and generation of conversation content, enhancing user experience.
Smart Images

Figure 2024179936000001_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to a system, a method, a program, and an information processing device. [Background technology]
[0002] Recently, systems that support communication between users have been developed. For example, Patent Document 1 discloses a system that records, as video or audio, a conversation between users via avatars in a VR space. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 6980946 A Summary of the Invention [Problem to be solved by the invention]
[0004] On the other hand, the above technology has room for improvement in terms of real-time communication and diversity.
[0005] An object of the present disclosure is to provide technology that enables diverse communication in real time. [Means for solving the problem]
[0006] The present disclosure provides a system that executes processing to realize communication between users via voice chat, the system executing the steps of accepting voice uttered by a user, converting voice information about the accepted voice into text information, performing a predetermined processing on the text information and then converting it into voice information, and outputting the converted voice information to other users. Effect of the Invention
[0007] According to the present disclosure, real-time communication can be carried out in a more diverse manner. [Brief description of the drawings]
[0008] [Figure 1] FIG. 2 is a diagram illustrating an example of processing performed by the system 1. [Diagram 2] FIG. 2 is a block diagram showing the hardware configuration of the system 1. [Diagram 3] 2 is a block diagram showing the functional configuration of the terminal device 10. FIG. [Figure 4] FIG. 2 is a block diagram showing the functional configuration of the server 20. [Diagram 5] 2 is a diagram showing the structure of a database stored in a storage unit 180 of a terminal device 10. FIG. [Figure 6] FIG. 2 is a flow diagram illustrating the processing flow of the system 1. [Figure 7] FIG. 11 is a block diagram showing the functional configuration of a server 20 in a second embodiment. [Figure 8] FIG. 11 is a diagram illustrating an example of processing of the system 1 in the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0009] Hereinafter, an embodiment of the present disclosure will be described with reference to the drawings. In the following description, the same components are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.
[0010] <1. First embodiment> (1-1. Overview of System 1) An overview of the functions (hereinafter also referred to as the functions) provided by the system 1 will be described with reference to Fig. 1. As shown in Fig. 1, the system 1 includes a plurality of terminal devices 10 and a server 20. Users of the system 1 communicate with each other in real time by voice chat (voice calls made over a network) by using their respective terminal devices 10.
[0011] When the terminal device 10 receives a voice uttered by a user, it converts the voice information about the voice into text information and transmits it to the server 20. The server 20 performs a predetermined process, such as a translation process, on the received text information and transmits the translated text information to another terminal device 10. The other terminal device 10 converts the received text information into voice information and outputs it to the user as voice.
[0012] In this way, in the system 1, the voice uttered by the user is converted into text information and data is transmitted and received, so that the processing required for transmitting and receiving data can be reduced. Also, since voice information is converted into text information, processing such as translation can be performed, and real-time communication can be carried out in a more diverse manner. Details are described below.
[0013] (1-2. Hardware configuration of System 1) Fig. 2 is a block diagram showing an example of a hardware configuration of the system 1. The system 1 includes a plurality of terminal devices 10 and a server 20. The terminal devices 10 and the server 20 are communicatively connected via a network 30. In the example shown in Fig. 2, the system 1 includes three terminal devices 10, but the number of terminal devices 10 is not limited to this example and may be two, or may be four or more.
[0014] In this embodiment, a collection of multiple devices may be one server 20. The method of allocating multiple functions required to realize the server 20 according to this embodiment to one or multiple pieces of hardware can be appropriately determined in consideration of the processing capacity of each piece of hardware and / or the specifications required for the server 20.
[0015] The terminal device 10 may be realized as a tablet terminal, a mobile terminal such as a smartphone, etc. The terminal device 10 includes a communication IF (Interface) 12, an input device 13, an output device 14, a memory 15, a storage 16, and a processor 19.
[0016] The communication IF 12 is an interface for inputting and outputting signals so that the terminal device 10 can communicate with an external device.
[0017] The input device 13 is a device (for example, a touch panel, a microphone, etc.) for receiving an input operation from a user.
[0018] The output device 14 is a device (such as a display and a speaker) for presenting information to a user.
[0019] The memory 15 is for temporarily storing programs and data to be processed by the programs, and is a volatile memory such as a DRAM (Dynamic Random Access Memory).
[0020] The storage 16 is for storing data, and is, for example, a flash memory or a hard disk drive (HDD).
[0021] The processor 19 is hardware for executing an instruction set written in a program, and is composed of an arithmetic unit, a register, peripheral circuits, and the like.
[0022] The server 20 is a computer capable of communicating with the terminal device 10 via a network 30 such as the Internet, and is realized as a so-called cloud server. The server 20 includes a communication IF 22, an input / output IF 23, a memory 25, a storage 26, and a processor 29.
[0023] The input / output IF is an interface for connecting an input / output device when performing some input operation on the server 20 or when outputting information from the server 20.
[0024] The communication IF 22, memory 25, storage 26 and processor 29 are configured similarly to the communication IF 12, memory 15, storage 16 and processor 19 of the terminal device 10, and therefore description thereof will not be repeated.
[0025] (1-3. Functional configuration of terminal device 10) Fig. 3 is a block diagram showing an example of a functional configuration of the terminal device 10. As shown in Fig. 3, the terminal device 10 includes an input device 13, an output device 14, a communication unit 150, a voice processing unit 170, a storage unit 180, a position information sensor 190, and a control unit 200. The blocks included in the terminal device 10 in Fig. 2 are electrically connected to each other, for example, by a bus or the like.
[0026] The communication unit 150 performs processing such as modulation and demodulation processing for the terminal device 10 to communicate with other devices. The communication unit 150 performs transmission processing on a signal generated by the control unit 200 and transmits the signal to the outside (for example, another terminal device 10). The communication unit 150 performs reception processing on a signal received from the outside and outputs the signal to the control unit 200.
[0027] The input device 13 is a device for inputting instructions or information by a user who operates the terminal device 10. The input device 13 is realized, for example, by a touch-sensitive device 131 or the like in which instructions are input by touching an operation surface. The input device 13 may include a keyboard or a mouse. The input device 13 converts instructions or information input by a user into an electrical signal, and outputs the electrical signal to the control unit 200. The input device 13 may include, for example, a receiving port that receives an electrical signal input from an external input device.
[0028] The output device 14 is a device for presenting information to a user who operates the terminal device 10. The output device 14 is realized, for example, by a display 141 or the like. The display 141 displays data according to the control of the control unit 200. The display 141 is realized, for example, by an LCD (Liquid Crystal Display) or an organic EL (Electro-Luminescence) display or the like.
[0029] The audio processing unit 170 performs, for example, digital-analog conversion processing of an audio signal. The audio processing unit 170 converts a signal provided from the microphone 171 into a digital signal and provides the converted signal to the control unit 200. The audio processing unit 170 also provides the audio signal to the speaker 172. The audio processing unit 170 is realized, for example, by a processor for audio processing. The microphone 171 accepts audio input and provides an audio signal corresponding to the audio input to the audio processing unit 170. The speaker 172 converts the audio signal provided from the audio processing unit 170 into audio and outputs the audio to the outside of the terminal device 10.
[0030] The storage unit 180 is realized by, for example, the memory 15 and the storage 16, and stores data and programs used by the terminal device 10. The storage unit 180 stores, for example, a user database (DB: DataBase) 181, an avatar database 182, and a performance database 183.
[0031] The user database 181 is a database for storing user information. The user database 181 stores information about the user who uses the terminal device 10. As an example, the user database 181 may be configured so that a record is generated when the user performs user registration work using software that provides this function installed in the terminal device 10. The data structure of the user database 181 will be described in detail later.
[0032] The avatar database 182 is a database for storing information on avatars associated with users. An avatar is a virtual character that functions as an avatar of a user, and is configured to play a role in the system 1 of transmitting various information by voice on behalf of the user. The avatar database 182 stores information set for each avatar. As an example, the avatar database 182 may be configured to generate a record when a user registers avatar information using software installed in the terminal device 10 to execute this function. The data structure of the avatar database 182 will be described in detail later.
[0033] The effect database 183 is a database for storing information on effects set for each avatar. In this embodiment, various parameters such as tone and pitch of voice can be set for the voice emitted by the avatar as an effect. The effect database 183 stores information on effects that can be set for the avatar. As an example, the effect database 183 may be designed to generate a record prepared as an initial setting when software for executing this function is installed in the terminal device 10. In addition to the initial setting record, an additional record may be generated when the user sets the effect information. The data structure of the effect database 183 will be described in detail later.
[0034] The position information sensor 190 is a sensor that detects the position of the terminal device 10, and is, for example, a GPS (Global Positioning System) module. The GPS module is a receiving device used in a satellite positioning system. In the satellite positioning system, signals are received from at least three or four satellites, and the current position of the terminal device 10 equipped with the GPS module is detected based on the received signals. Note that the position information sensor 190 may be a satellite positioning system other than GPS, for example, a system called a GNSS (Global Navigation Satellite System).
[0035] The control unit 200 is realized by the processor 19 reading a program stored in the storage unit 180 and executing instructions included in the program. The control unit 200 controls the operation of the terminal device 10. The control unit 200 operates according to the program to fulfill the functions of an operation reception unit 201, a transmission / reception unit 202, a display control unit 203, a voice reception unit 204, a voice conversion unit 205, and a voice output unit 206.
[0036] The operation reception unit 201 performs processing for receiving instructions or information input from the input device 13. Specifically, for example, the operation reception unit 201 receives information based on instructions input from the touch-sensitive device 131 or the like.
[0037] The transmitting / receiving unit 202 performs processing for the terminal device 10 to transmit and receive data to and from an external device in accordance with a communication protocol.
[0038] A display control unit 203 controls the display of information for the user on the output device 14 represented by a display 141 .
[0039] The voice receiving unit 204 receives a voice uttered by a user. Specifically, for example, the input of the voice uttered by the user may be detected by the microphone 171 of the terminal device 10, and the voice signal may be subjected to digital-to-analog conversion processing in the voice processing unit 170, so that the voice uttered by the user may be received by the voice receiving unit 204.
[0040] The voice conversion unit 205 converts voice information about the voice accepted by the voice acceptance unit 204 into text information. In addition, the voice acceptance unit 204 converts text information received from the server 20 into voice information. The conversion process between voice information and text information may employ existing voice recognition technology. As an example, the voice conversion unit 205 may perform DNN-HMM type voice recognition, or may perform voice recognition in an end-to-end model using deep learning.
[0041] The audio output unit 206 outputs the audio information converted by the audio conversion unit 205. Specifically, for example, the audio output unit 206 provides the audio information converted by the audio conversion unit 205 to the audio processing unit 170. The audio processing unit 170 provides the speaker 172 with an audio signal corresponding to the received audio information. The speaker 172 converts the audio signal provided from the audio processing unit 170 into audio and outputs it to the outside of the terminal device 10.
[0042] (1-4. Functional configuration of server 20) 4, the server 20 includes a communication unit 210, a storage unit 220, and a control unit 230. The blocks included in the server 20 in FIG 4 are electrically connected to each other via a bus or the like, for example.
[0043] The communication unit 210 performs processing for the server 20 to communicate with external devices.
[0044] The storage unit 220 is realized by, for example, the memory 25 and the storage 26, and stores data and programs used by the server 20.
[0045] The control unit 230 is realized by the processor 29 reading a program stored in the storage unit 220 and executing instructions included in the program. The control unit 230 includes a transmission / reception module 231 and a translation module 232 by operating according to the program.
[0046] The transmission / reception module 231 performs processing for the server 20 to transmit and receive data to and from external devices in accordance with a communication protocol.
[0047] The translation module 232 translates the text information received by the server 20. The translation of the text information can use existing machine translation technology. For example, the translation module 232 may translate the text information using existing software or libraries that perform neural machine translation using deep learning.
[0048] (1-5. Data Structure) 5, the data structure of the database used in the system 1 will be described. Note that the data structure described below is merely an example, and does not exclude the possession of other databases and data items.
[0049] FIG. 5 is a diagram showing an example of the data structures of the user database 181, the avatar database 182, and the performance database 183 stored in the storage unit 180 of the terminal device 10. As shown in FIG.
[0050] As shown in FIG. 5, a record of the user database 181 includes an item "user ID", an item "user name", an item "age", an item "gender", an item "registration date and time", and the like.
[0051] The item “user ID” is identification information for identifying a user, and is a primary key for uniquely identifying a record in the user database 181.
[0052] The item "user name" is information about the name of the user. The user name may be the user's real name, or may be information that does not identify the user, such as a nickname.
[0053] The item "age" is information about the user's age.
[0054] The item "gender" is information about the gender of the user.
[0055] The item "registration date" is information about the date on which the record was registered in the user database.
[0056] The user may use software that provides this function installed in the terminal device 10 to register user information and add records to the user database 181.
[0057] The records of the avatar database 182 include an item "avatar ID", an item "avatar name", an item "age", an item "gender", an item "corresponding user", an item "corresponding performance", and the like.
[0058] The item “avatar ID” is identification information for identifying an avatar, and is a primary key for uniquely identifying a record in the avatar database 182 .
[0059] The item "avatar name" is information about the name of the avatar.
[0060] The item "age" is information about the age of the avatar.
[0061] The item "gender" is information about the gender of the avatar.
[0062] The item “Corresponding User” is information for identifying a user to be registered in association with an avatar, and the item “User ID” of user database 181 is held as an external key. In this embodiment, one avatar is associated with one user and stored in avatar database 182.
[0063] The item “corresponding effect” is identification information for identifying the effect applied to the avatar, and the item “effect ID” of effect database 183 is held as an external key. In this manner, information on the effects applied to each avatar is stored in avatar database 182.
[0064] As an example, the specifications may be such that, when software that provides this function is installed in the terminal device 10, the avatar database 182 having records prepared as initial settings is generated. The software may also be used by a user to update the contents of each item in the records of the avatar database 182. The software may also be used by a user to newly register information about an avatar and add a record to the avatar database 182.
[0065] The records of the performance database 183 include an item "performance ID", an item "tone of voice", an item "pitch of voice", an item "ending of speech", and the like.
[0066] The item “effect ID” is identification information for identifying the effect applied to the avatar, and is a primary key for uniquely identifying a record in the effect database 183 .
[0067] The item "tone of voice" is information about the tone of the avatar's voice, and more specifically, information about the waveform of the sound waves of the voice produced by the avatar.
[0068] The item "Voice Pitch" is information about the pitch of the avatar's voice, specifically, information about the frequency of the sound waves of the voice produced by the avatar.
[0069] The item "Ending" is information about words that can be added to the end of an avatar's utterance. Specifically, it is information about words that can be added to the end of an utterance, such as "It's ~", "It's ~", or "It's ~".
[0070] (1-6. Processing flow) An example of the processing of the system 1 will be described below with reference to Fig. 6. In the following description, the system 1 includes, as the terminal devices 10, a terminal device 10A and a terminal device 10B.
[0071] In step S111, the operation reception unit 201 of the terminal device 10A receives a selection of an avatar from the user. As an example, the user may select a performance (tone of voice, pitch of voice, ending of speech, etc.) to be added to the speech of the avatar in conjunction with the selection of the avatar. When the operation reception unit 201 receives the selection of the avatar and the performance from the user, it adds a record to the avatar database 182 of the storage unit 180.
[0072] In step S112, the voice receiving unit 204 of the terminal device 10A receives a voice uttered by the user. The voice receiving unit 204 may be configured to acquire voice information about the voice uttered by the user when a predetermined condition is satisfied. For example, the voice receiving unit 204 may acquire voice information about the voice uttered by the user on the condition that the user performs a predetermined operation on the terminal device 10. Specifically, a button or the like for accepting voice is displayed on the display 141 of the terminal device 10, and the voice receiving unit 204 may acquire voice information about the voice uttered by the user on the condition that the user presses the button.
[0073] Alternatively, the voice receiving unit 204 may be configured to acquire voice information about a voice uttered by a user on the condition that the user has made a specific statement. For example, the voice receiving unit 204 may be configured to acquire voice information about a voice uttered by a user when the user has made a statement such as a predetermined sentence, keyword, or password. As another example, the voice receiving unit 204 may be configured to acquire voice information about a voice uttered by a user on the condition that the user has called out the name of an avatar associated with the user.
[0074] In step S113, the speech conversion unit 205 of the terminal device 10A converts the speech received from the user into text information.
[0075] In step S114, the transmitting / receiving unit 202 of the terminal device 10A transmits the text information converted by the speech conversion unit 205 to the server 20. In step S121, the transmitting / receiving module 231 of the server 20 receives the text information from the terminal device 10A.
[0076] In step S122, the translation module 232 of the server 20 performs a translation process on the received text information. As an example, the translation module 232 performs the translation process on the text information using existing software or a library that performs machine translation.
[0077] In step S123, the transmitting / receiving module 231 of the server 20 transmits the text information to the terminal device 10 A. In step S131, the transmitting / receiving unit 202 of the terminal device 10 B receives the text information from the server 20.
[0078] In step S132, the voice conversion unit 205 of the terminal device 10B converts the text information received from the server 20 into voice information. In step S133, the voice output unit 206 of the terminal device 10B outputs the converted voice information to the voice processing unit 170, thereby outputting it from the speaker 172.
[0079] (1-7.Summary) As described above, in this embodiment, the system 1 executes a process for realizing communication between users through voice chat, and executes the steps of accepting voices uttered by the users, converting voice information about the accepted voices into text information, converting the text information into voice information after performing a predetermined process on the text information, and outputting the converted voice information to other users. In this way, it becomes possible to carry out real-time communication in a more diverse manner.
[0080] Furthermore, the system 1 executes a step of transmitting and receiving text information between the terminal device 10 and the server 20. In this manner, it is possible to reduce the load in transmitting and receiving data between computers.
[0081] Furthermore, in the system 1, a translation process is executed on the text information as a predetermined process. In this way, it becomes possible to translate the received voice information, thereby realizing a variety of communication.
[0082] <2. Second embodiment> A second embodiment of the present disclosure will be described with reference to Fig. 7 and Fig. 8. As shown in Fig. 7, the second embodiment differs from the first embodiment in that the control unit 230 of the server 20 includes a generation module 233 instead of the translation module 232. The following description will focus on the differences from the first embodiment.
[0083] The generation module 233 generates the contents of a conversation between avatars (hereinafter also referred to as conversation contents) based on the text information. In this embodiment, the generation module 233 performs natural language processing on the text information received from the terminal device 10 to generate the contents of a conversation between avatars. The conversation contents generated by the generation module 233 are transmitted to the terminal device 10 as text information. The terminal device 10 converts the text information into voice and outputs it to the user.
[0084] 8, in the second embodiment, in steps S112 to S114, the terminal device 10A and the terminal device 10B both convert the voice received from the user into text information and transmit it to the server 20. When the server 20 receives the text information in step S121, the server 20 performs a generation process in step S122.
[0085] In the generation process, the conversation content between the avatars is generated as text information based on the text information received from the terminal device 10A and the terminal device 10B. In step S123, when the generated conversation content is transmitted to the terminal devices 10A and 10B, it is converted into voice information in the terminal device 10 and output as voice.
[0086] In this way, the user can experience listening to a conversation between avatars generated based on the user's own utterances as if listening to a radio, thereby improving the user experience.
[0087] <3 Other embodiments> Although the embodiment and its modified examples of the present invention have been described above, the application of the present disclosure is not limited to the above. For example, the control unit 230 of the server 20 may have both the translation module 232 and the generation module 233, and the translation module 232 may translate the content of a conversation between avatars generated by the generation module 233.
[0088] In addition, in the above embodiment, since voice chat is assumed, the speaker and the listener are the same person, but the present invention is not limited to this embodiment, and the speaker and the listener may be different people. As an example, the technical idea of the present disclosure may be applied to a case where multiple speakers participate in audio distribution using the Internet, such as a podcast.
[0089] In the above embodiment, synchronous communication using voices with a user as a speaker is assumed, but the present invention is not limited to this. For example, there may be a plurality of virtual characters with no corresponding user as a speaker, and the voices emitted by the characters may be computer-synthesized voices.
[0090] In the above embodiment, lip sync information for reproducing the mouth movement of the avatar may be transmitted to the server 20 together with the voice data. In this case, the terminal device 10 that has received the voice data from the user analyzes the voice data and generates lip sync information related to the mouth movement. Specifically, the lip sync information may include information on the width and height of the mouth shape for the input voice, and / or information on the ratio of each phoneme included in the input voice. In addition, subtitle information corresponding to the voice may be transmitted to the server 20 together with the voice data. In this case, the terminal device 10 that has received the voice data from the user analyzes the voice data and generates subtitle information. The generation of lip sync information or subtitle information based on the analysis of the voice data can be performed using well-known technology. The server 20 transmits the received lip sync information or subtitle information to the terminal device 10, and the terminal device 10 reproduces the mouth movement of the avatar in accordance with the output of the voice data, or displays subtitles.
[0091] In addition, sharing of specific information via communication lines is mainly performed via a WAN such as the Internet, but between information processing devices, communication may also be performed only via short-range wireless communication such as Bluetooth (registered trademark) and infrared communication without using a WAN.
[0092] In addition, in the above embodiment, an example of a form in which each function is provided by the terminal device 10 or the server 20 is described, but this is not limited to this form, and some or all of the functions may be provided by the terminal device 10, the server 20, or both the terminal device 10 and the server 20 in a form different from the above embodiment.
[0093] In addition, in the above embodiment, each step described as being executed by the terminal device 10 may be executed by the server 20, and each step described as being executed by the server 20 may be executed by the terminal device 10.
[0094] Furthermore, the present invention may be realized as a program that causes an information processing device to execute the functions of the above-mentioned terminal device 10 or server 20, or as a computer-readable non-transitory recording medium that stores the program.
[0095] <Additional Notes> The matters described in the above embodiments will be supplemented below. (Appendix 1) A system having a computer with a processor and executing processes to realize communication between users via voice chat, the system executing the steps of: accepting voice uttered by a user; converting voice information about the accepted voice into text information; performing a specified process on the text information and then converting it into voice information; and outputting the converted voice information to other users. (Appendix 2) 2. The system of claim 1, further comprising the step of transmitting the text information between computers. (Appendix 3) The system of claim 1, wherein the predetermined processing is a translation processing performed on the text information. (Appendix 4) The system of claim 1, wherein the outputting step outputs to other users in the voice of an avatar corresponding to the user. (Appendix 5) 5. The system of claim 4, further comprising: receiving a selection of the avatar from a user. (Appendix 6) The system according to claim 1, wherein the predetermined process executes a step of generating a conversation between avatars based on the text information and converting the generated conversation into voice information. (Appendix 7) The system of claim 6, further comprising: a translation unit configured to translate the generated avatar's conversation content.
[0096] Although several embodiments of the present disclosure have been described above, these embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and modifications are within the scope of the invention and its equivalents as described in the claims, as well as the scope and spirit of the invention. [Explanation of symbols]
[0097] 1: system, 10: terminal device, 13: input device, 14: output device, 15: memory, 16: storage, 19: processor, 20: server, 25: memory, 26: storage, 29: processor, 30: network, 131: touch-sensitive device, 141: display, 150: communication unit, 170: audio processing unit, 171: microphone, 172: speaker, 180: memory unit, 181: user database, 182: avatar database, 183: performance database, 190: position information sensor, 200: control unit, 201: operation reception unit, 202: transmission / reception unit, 203: display control unit, 204: audio reception unit, 205: audio conversion unit, 206: audio output unit, 210: communication unit, 220: memory unit, 230: control unit, 231: transmission / reception module, 232: translation module, 233: generation module.
Claims
1. A system including a computer having a processor, the system executing a process for realizing communication between users through voice chat, receiving speech uttered by a user; converting the received voice information about the voice into text information; A step of converting the text information into audio information after performing a predetermined process on the text information; and outputting the converted voice information to another user.
2. 2. The system of claim 1, further comprising the step of transmitting said text information between computers.
3. The system according to claim 1 , wherein the predetermined process comprises executing a translation process on the text information.
4. The system according to claim 1 , wherein in the outputting step, the voice of an avatar corresponding to the user is output to the other users.
5. The system of claim 4 , further comprising: accepting a selection of the avatar from a user.
6. The system according to claim 1 , wherein the predetermined process includes a step of generating a conversation between avatars based on the text information and converting the generated conversation into voice information.
7. The system according to claim 6 , further comprising: a translation process for the generated conversation content of the avatar.
8. A method implemented on a computer having a processor and a memory, the processor performing all of the steps performed in any one of claims 1 to 7.
9. A program causing a computer having a processor and a memory to execute all of the steps executed in the invention according to any one of claims 1 to 7.
10. 8. An information processing apparatus comprising a control unit and a storage unit, the control unit executing all of the steps executed in the invention according to any one of claims 1 to 7.
Citation Information
Patent Citations
JP6980946A
