Methods, systems, and computer programs for providing translation results of dialogue messages
The system addresses the challenge of real-time translation in instant messengers by recognizing languages and displaying translated messages within the dialogue space as a single interface, ensuring smooth communication for users with different languages.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- LINE PLUS
- Filing Date
- 2022-03-24
- Publication Date
- 2026-06-19
AI Technical Summary
Existing instant messenger systems do not effectively translate dialogue messages in real-time between users with different languages, disrupting the dialogue context and user experience.
A computer system that recognizes user and message languages, provides translated messages within the dialogue space, and displays original and translated texts as a single interface, while ensuring translations are only visible to the intended user.
Enhances user experience by maintaining dialogue context and providing seamless language translation without disrupting the conversation flow.
Smart Images

Figure 0007876305000008 
Figure 0007876305000009 
Figure 0007876305000010
Abstract
Description
Technical Field
[0001] The following description relates to a technology for providing translation results of dialogue messages.
Background Art
[0002] An instant messenger, which is a common communication tool, is software that can send and receive messages and data in real time. A user can register an interlocutor on the messenger and exchange messages in real time with the interlocutors in the dialogue list.
[0003] Since such a messenger function can be used not only on a PC but also in a mobile environment of a mobile communication terminal, the popularity of using messengers has increased rapidly.
[0004] For example, Patent Document 1 (publication date: September 30, 2002) discloses a mobile messenger service system and method for a mobile communication terminal using a wireless communication network, which can provide a messenger service to a mobile messenger installed on the mobile communication terminal.
Prior Art Documents
Patent Documents
[0005]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0006] It is possible to recognize the user language and the language of the received message, and provide a translated message in the dialogue space according to the recognized language.
[0007] For each message, the original text and the translated text can be integrated and displayed as a single message UI.
[0008] The translated version of an received message can be displayed only to the user, without being communicated to the sender of the message.
[0009] The translated version of received messages can be displayed in an inline view upon user request.
[0010] It is possible to provide a function that offers a translated version of the message entered in the message input window of the dialogue space and immediately sends the translated version. [Means for solving the problem]
[0011] A message processing method to be performed by a computer system, wherein the computer system includes at least one processor configured to execute computer-readable instructions contained in memory, and the message processing method includes the steps of: the at least one processor recognizing a language associated with a dialogue space based on translation-related options set for the dialogue space and a dialogue context; and the at least one processor providing at least one translated sentence in the recognized language for a message received or entered into the dialogue space.
[0012] In one aspect, the recognition step may include the step of recognizing the user language, which is the language used by the user of the computer system in the dialogue space, and the step of recognizing at least one target language among the receiving languages, which is the language of the received message, that corresponds to the translation-related option.
[0013] In other words, if the receiving language, which is the language of the received message, is different from the user language, which is the language used by the user of the computer system, the step of providing the received message may display the translated result in at least one language, including the user language, as the translated text of the received message on the dialogue space.
[0014] In other respects, the step of providing the service may include the step of combining the original text of the received message and at least one translated text and displaying them as a single speech bubble interface on the dialogue space.
[0015] In other respects, the display step may include displaying a display element for identifying at least one of the original text or the translated text in order to distinguish the original text from the translated text.
[0016] In other respects, the display step may provide an interface for at least one of the operations of deletion, modification, and concealment to at least one of the original text or the translated text.
[0017] In other respects, the steps of providing the service may include, in response to a message received in the dialogue space, displaying a speech bubble interface on the dialogue space containing the original text of the received message, and, in accordance with a user request for the received message, adding at least one translated version of the received message to the speech bubble interface and displaying it together with the original text as a single message.
[0018] Furthermore, from another perspective, the translated text may not be communicated to other users included in the dialogue space, but may only be displayed on the user's screen.
[0019] According to another aspect, the translated text is received from a dedicated translation bot included in the dialogue space or a server associated with the dialogue space, and the translated text may be included as additional information for the received message or the identifier of the received message may be included in the translated text and transmitted to the computer system.
[0020] According to another aspect, the translated text may include the result translated in the computer system by using a translation library constructed in the local database of the computer system.
[0021] According to still another aspect, the providing step may include providing, for a message input by a user of the computer system in a message input window of the dialogue space, a result translated into at least one of the recognized languages, and transmitting, in accordance with a message transmission request of the user, the translated result instead of the input message to other users included in the dialogue space.
[0022] There is provided a computer program recorded on a computer-readable storage medium for causing a computer system to execute the message processing method.
[0023] There is provided a computer system including at least one processor configured to execute computer-readable instructions included in a memory, the at least one processor including a language recognition unit that recognizes a language associated with the dialogue space based on translation-related options and a dialogue context set for the dialogue space, and a message processing unit that processes to provide at least one translated text in the recognized language for a message received or input in the dialogue space. [[ID=z18]]
Brief Description of the Drawings
[0024] [Figure 1]A diagram showing an example of a network environment in one embodiment of the present invention. [Figure 2] A block diagram showing an example of a computer device in one embodiment of the present invention. [Figure 3] A diagram showing an example of components that can be included in a processor of a computer device in one embodiment of the present invention. [Figure 4] A flowchart showing an example of a message processing method that can be executed by a computer device in one embodiment of the present invention. [Figure 5] An illustrative diagram for explaining an example of a message translation process in one embodiment of the present invention. [Figure 6] An illustrative diagram for explaining another example of a message translation process in one embodiment of the present invention. [Figure 7] An illustrative diagram for explaining still another example of a message translation process in one embodiment of the present invention. [Figure 8] An illustrative diagram for explaining yet another example of a message translation process in one embodiment of the present invention. [Figure 9] A diagram showing an example of an interface screen for displaying a message translation result in one embodiment of the present invention. [Figure 10] A diagram showing an example of an interface screen for displaying a message translation result in one embodiment of the present invention. [Figure 11] A diagram showing an example of an interface screen for displaying a message translation result in one embodiment of the present invention. [Figure 12] A diagram showing an example of an interface screen for displaying a message translation result in one embodiment of the present invention. [Figure 13] A diagram showing an example of an interface screen for displaying a message translation result in one embodiment of the present invention. [Figure 14] A diagram showing an example of an interface screen for displaying a message translation result in one embodiment of the present invention. [Figure 15] This figure shows an example of an interface screen for displaying message translation results in one embodiment of the present invention. [Modes for carrying out the invention]
[0025] Embodiments of the present invention will be described in detail below with reference to the accompanying drawings.
[0026] Embodiments of the present invention relate to a technique for providing translation results of dialogue messages.
[0027] Embodiments including those specifically disclosed herein can recognize the user language and the language of the received message, and provide a message translation in the dialogue space in the recognized language, thereby achieving considerable advantages in various aspects such as ease of use, dialogue efficiency, and quality of service.
[0028] Figure 1 is a diagram showing an example of a network environment in one embodiment of the present invention. The network environment in Figure 1 shows an example that includes multiple electronic devices 110, 120, 130, 140, multiple servers 150, 160, and a network 170. Figure 1 is merely an example for the purpose of explaining the invention, and the number of electronic devices and servers is not limited to what is shown in Figure 1.
[0029] The multiple electronic devices 110, 120, 130, and 140 may be fixed or mobile terminals implemented by a computer system. Examples of the multiple electronic devices 110, 120, 130, and 140 include smartphones, mobile phones, navigation systems, PCs (personal computers), notebook PCs, digital broadcasting terminals, PDAs (Personal Digital Assistants), PMPs (Portable Multimedia Players), tablets, game consoles, wearable devices, IoT (Internet of Things) devices, VR (Virtual Reality) devices, and AR (Augmented Reality) devices. As an example, Figure 1 shows a smartphone as an example of electronic device 110, but in embodiments of the present invention, electronic device 110 may mean one of a variety of physical computer systems that can communicate with other electronic devices 120, 130, 140 and / or servers 150, 160 via a network 170 using substantially wireless or wired communication methods.
[0030] The communication method is not limited, and may include not only communication methods that utilize communication networks that can be included in network 170 (for example, mobile communication networks, wired internet, wireless internet, broadcasting networks, satellite networks, etc.), but also short-range wireless communication between devices. For example, network 170 may include one or more arbitrary networks such as PAN (personal area network), LAN (local area network), CAN (campus area network), MAN (metropolitan area network), WAN (wide area network), BBN (broadband network), and the Internet. Furthermore, network 170 may include, but is not limited to, one or more network topologies, including bus networks, star networks, ring networks, mesh networks, star-bus networks, tree or hierarchical networks.
[0031] Servers 150 and 160 may each be implemented by one or more computer devices that communicate with multiple electronic devices 110, 120, 130, and 140 via a network 170 to provide commands, code, files, content, services, etc. For example, server 150 may be a system that provides a first service to multiple electronic devices 110, 120, 130, and 140 connected via the network 170, and server 160 may be a system that provides a second service to multiple electronic devices 110, 120, 130, and 140 connected via the network 170. As a more specific example, server 150 may provide the multiple electronic devices 110, 120, 130, and 140 as a first service through an application, which is a computer program installed and executed on the multiple electronic devices 110, 120, 130, and 140, with the service targeted by that application (for example, a messaging service). As another example, server 160 may provide a second service that distributes files for installing and running the aforementioned application to multiple electronic devices 110, 120, 130, and 140.
[0032] Figure 2 is a block diagram showing an example of a computer device in one embodiment of the present invention. Each of the above-mentioned electronic devices 110, 120, 130, and 140, as well as each of the servers 150 and 160, may be realized by the computer system 200 shown in Figure 2.
[0033] Such a computer system 200 may include memory 210, a processor 220, a communication interface 230, and an input / output interface 240, as shown in Figure 2. Memory 210 is a computer-readable storage medium and may include RAM (random access memory), ROM (read-only memory), and persistent mass storage devices such as disk drives. Here, persistent mass storage devices such as ROM and disk drives may be included in the computer system 200 as separate persistent storage devices distinct from memory 210. Memory 210 may also store an operating system and at least one program code. Such software components may be loaded into memory 210 from a computer-readable storage medium separate from memory 210. Such a separate computer-readable storage medium may include computer-readable storage media such as floppy disks, disks, tapes, DVD / CD-ROM drives, and memory cards. In other embodiments, software components may be loaded into memory 210 through a communication interface 230, which is not a computer-readable storage medium. For example, software components may be loaded into the memory 210 of the computer system 200 based on computer programs installed by files received via the network 170.
[0034] The processor 220 may be configured to process computer program instructions by performing basic arithmetic, logic, and input / output operations. Instructions may be provided to the processor 220 by memory 220 or a communication interface 230. For example, the processor 220 may be configured to execute instructions received according to program code recorded in a storage device such as memory 210.
[0035] The communication interface 230 may provide a function for the computer system 200 to communicate with other electronic devices (for example, the memory devices described above) via the network 170. For example, requests, instructions, data, files, etc., generated by the processor 220 of the computer system 200 according to program code stored in a memory device such as memory 210 may be transmitted to other devices via the network 170 under the control of the communication interface 230. Conversely, signals, instructions, data, files, etc., from other devices may be received by the computer system 200 via the network 170 through the communication interface 230 of the computer system 200. Signals, instructions, data, etc., received via the communication interface 230 may be transmitted to the processor 220 or memory 210, and files, etc., may be stored in storage media (persistent memory devices described above) that the computer system 200 may further include.
[0036] The input / output interface 240 may be a means for interface with the input / output device 250. For example, the input device may include a microphone, keyboard, or mouse, and the output device may include a display or speaker. In another example, the input / output interface 240 may be a means for interface with a device that integrates input and output functions into one, such as a touchscreen. The input / output device 250 may consist of the computer system 200 and one device.
[0037] In other embodiments, the computer system 200 may include fewer or more components than those shown in Figure 2. However, it is not necessary to explicitly show most of the conventional components in the figure. For example, the computer system 200 may be implemented to include at least some of the input / output devices 250 described above, and may further include other components such as transceivers and databases.
[0038] The following describes specific embodiments of a method and system for providing translation results of dialogue messages.
[0039] This embodiment relates to a technique for providing translated text of dialogue messages in a dialogue space.
[0040] In this specification, "dialogue space" may encompass all communication spaces on the internet, such as messenger chat rooms and community channels on various social networking services (SNS). For example, dialogue spaces may include not only chat rooms where individuals chat after adding each other as friends using phone numbers or IDs, but also open chats where users can chat immediately via links such as URLs without going through the friend-adding process, and chat rooms that include official accounts, which are accounts in the form of bots that provide various services and content. However, the definition is not limited to these, and can be expanded to include any space where people with common interests or environments can communicate using various communication functions such as chat, bulletin board posts, posts, messages, and comments. In the following embodiments, a messenger dialogue space will be used as an example.
[0041] Figure 3 is a block diagram showing an example of components that a computer device processor may include in one embodiment of the present invention, and Figure 4 is a flowchart showing an example of a method that a computer device may perform in one embodiment of the present invention.
[0042] The computer system 200 according to this embodiment may be configured with a message processing system implemented on a computer. For example, the message processing system may be implemented as an independently operating program, or it may be configured as an in-app (in-app) version of a specific application and be capable of operating on the specific application.
[0043] Based on instructions provided by an application installed on the computer system 200, the message processing system implemented on the computer system 200 may execute the message processing method shown in Figure 4.
[0044] To execute the message processing method shown in Figure 4, the processor 220 of the computer system 200 may include, as shown in Figure 3, a setting unit 310, a language recognition unit 320, and a message processing unit 330 as components. Depending on the embodiment, the components of the processor 220 may be selectively included in or excluded from the processor 220. Also, depending on the embodiment, the components of the processor 220 may be separated or merged to represent the functions of the processor 220.
[0045] Such a processor 220 and its components may control the computer system 200 to execute steps 410 to 430 of the message processing method shown in Figure 4. For example, the processor 220 and its components may be implemented to execute instructions from the operating system code contained in the memory 210 and the code of at least one program.
[0046] Here, the components of the processor 220 may be representations of different functions of the processor 220 that are executed by the processor 220 according to instructions provided by program code stored in the computer system 200 (for example, instructions provided by an application executed on the computer system 200). For example, the setting unit 310 may be used as a functional representation of the processor 220 that controls the computer system 200 according to the above-mentioned instructions so that the computer system 200 sets translation-related options.
[0047] The processor 220 may read necessary instructions from memory 210, which is loaded with instructions related to the control of the computer system 200. In this case, the instructions read may include instructions for controlling the processor 220 to execute steps 410 to 430 described below.
[0048] Referring to Figure 4, in step 410, the settings unit 310 may set translation and related options for the dialogue space. As an example, the settings unit 310 may set a language recognition option as one of the translation and related options. The language recognition option sets the target language for recognition and may include an automatic language recognition option that recognizes all languages used in the dialogue space and provides message translation, and a specified language recognition option that selectively recognizes only the language specified by the user and provides message translation. In other words, the automatic language recognition option may provide a translation into the user language for all incoming messages in a language different from the language used by the user (hereinafter referred to as the "user language"), and the specified language recognition option may provide a translation into the user language or the language specified by the user only for incoming messages in the language specified by the user. The user language is the language that the user primarily uses in the messenger and may be the result of automatic recognition from the dialogue context, a language directly set by the user, or obtained from language information set on the messenger or terminal. The settings unit 310 may also set the scope of application for translation and related options. For example, translation and related options may be divided into a global setting method that applies common settings to all dialogue spaces on the messenger, and an individual setting method that sets translation and related options for each dialogue space. If a single dialogue space has options applied as both a global setting and an individual setting, the individual setting option may take precedence over the global setting option.
[0049] In step 420, the language recognition unit 320 may recognize the user language in the dialogue space and the language of the received message (hereinafter referred to as the "receiving language"). For example, the language recognition unit 320 may recognize the user language and / or at least one receiving language from the context contained in the dialogue space. In this case, the language recognition unit 320 may recognize the user language and the receiving language based on the translation and associated options set by the user. For example, the language recognition unit 320 may select and recognize a language specified by the user from among the receiving languages. In this way, the receiving language may be directly recognized on the client side where the messenger is installed based on the context of the received message, or, depending on the embodiment, the receiving language may be recognized using the language code contained in the received message. The client on the message sending side may attach the language code corresponding to the language of the message to the message and transmit it, or the messenger server (for example, server 150) may recognize the language of the message in the process of transmitting messages between clients, and then attach the recognized language code to the message and transmit it to the client. The entity that attaches the language code to the message may be determined according to the entity that performs the translation. For example, if server 150 provides the translation, server 150 may add a language code to the message before transmission. If the client performs the translation directly, a language code is not required, or the client sending the message may add a language code to the message before transmission.
[0050] In step 430, the message processing unit 330 may display the translation result of a message in the dialogue space based on the language recognized in step 420. If the user language and the receiving language are different in the dialogue space, the message processing unit 330 may provide the message translation on the dialogue space. In this case, the message translation may include the result of translation into one language or two or more languages. The message processing unit 330 may provide the message translation for the target languages set by the user as options associated with translation. As an example, the message processing unit 330 may combine the translated text of the received message, which has been translated into the user language, with the original message text and display them as a single message unit, i.e., as a single callout interface. As another example, the message processing unit 330 may first display the original text of the received message, and then, upon user request, combine the translated text and the original text of the message and display them as a single callout interface.
[0051] A dedicated bot included in the dialogue space may provide message translations in conjunction with a translation platform, or, if the server 150 provides translation functionality, it may directly translate messages and provide translations during the process of transmitting messages between clients. The bot or server 150 may classify message translations by language and select and transmit them only to users who need translation results for each language. Instead of providing message translations to all users included in the dialogue space, message translations may be transmitted only to users who use a language different from the original language of the message, or only to users who have set the original language of the message as the language to be recognized. Depending on the embodiment, if libraries necessary for translation are built in a local database on the client for each language, the bot or server 150 may provide message translations via offline translation based on translation and related options set by the user on the client side, without intervention from the bot or server 150. Similarly, offline translated texts may not be transmitted to the other party in the dialogue space but may be bundled with the original message and displayed internally on the client so that only users who need translation results can view the translations.
[0052] In the case of translated received messages, the translation may include not only the result in the user's language but also the result in a language specified by the user. For example, if a user who speaks Korean receives a message written in Japanese, the received message may be provided with a Korean translation, or in addition to the Korean translation, a translation into English, a language previously specified by the user.
[0053] Furthermore, when a user enters a message into the message input window of the dialogue space, the message processing unit 330 may provide a translated version of the input message in at least one receiving language. The translated version of the input message can also be provided by a dedicated bot or server 150 included in the dialogue space, or can be obtained through the client's offline translation. The message processing unit 330 may display the translated version of the input message in an area adjacent to the message input window, while the original text of the input message is entered into the message input window. In other words, the message processing unit 330 provides a function to automatically display the translation result of the input message when a message to be sent to the dialogue space is entered, and to send the translated message in place of the input message. In this case, when providing the translation result of the input message, editing functions may be provided for modifying or deleting the translation result, or for adding translation results.
[0054] In the case of translated input messages, the result may include not only the translation into the language used by the conversation partner, i.e., the receiving language, but also the translation into the language specified by the user. For example, when a user who speaks Korean converses with a user who speaks Japanese, a message entered in Korean may be provided with a Japanese translation. In this case, if the user has previously specified English as an additional language, an English translation may also be provided. Furthermore, if users who speak Korean, Japanese, and English are participating in the conversation space, when a user who speaks Korean enters a message, a translation into both Japanese and English may be provided, or a translation into the language of the most recently received message among Japanese and English, or into the language of the message identified by a mention or reply function.
[0055] Figures 5-8 are illustrative diagrams illustrating the message translation process in one embodiment of the present invention.
[0056] In Figures 5-8, client A (501) is assumed to be the terminal of user A who uses Korean, and client B (502) is assumed to be the terminal of user B who uses Japanese, illustrating the process of user B sending a message to user A. Server 150 may manage the language information used by user A and user B respectively, as well as translation-related option information, for the dialogue space in which user A and user B participate.
[0057] Figure 5 is an illustrative diagram illustrating an example of the message translation process in one embodiment of the present invention.
[0058] Referring to Figure 5, when user B sends a message written in Japanese in a dialogue space in which user A and user B are participating, client B (502) transmits a request to send the message to server 150 (S51).
[0059] In response to a message transmission request from client B(502), server 150 transmits the message received from client B(502) to the terminal of user A, who is participating in the dialogue space, i.e., client A(501) (S52).
[0060] Server 150 may request a message translation server (for example, 160) to translate the message transmitted from client B (502) into at least one language, based on user A's language information and option information (S53). For example, server 150 may request that a message written in Japanese be translated into Korean, which is user A's language.
[0061] Server 160, in accordance with the request of Server 150, may translate the message transmitted from Client B (502), and once the translation is complete, it may request Server 150 to send the translated message (S54).
[0062] Server 150 may transmit the translated message received from Server 160 to Client A (501) and Client B (502) (S55-S56). In other words, Server 150 may transmit the Korean translation of the Japanese original message sent by User B to Client A (501) and Client B (502).
[0063] When displaying a message sent by user B in the corresponding dialogue space, client A (501) and client B (502) may combine the original message and the translated message, that is, the Japanese original and the Korean translation, and display them as a single speech bubble interface (S57-S58).
[0064] Depending on the embodiment, if client B (502) internally determines that a translation result is not necessary based on user B's language information and option information, the process of combining and displaying the original and translated text of the message (S57) may be omitted even if a translated message is received.
[0065] As another example, server 150 may provide translations only to users participating in the dialogue space who use a language different from the language of the received message. For example, if user C, who uses Japanese, is participating in the dialogue space along with users A and B, the Korean translation may not be sent to users B and C who use Japanese, but only to user A, who needs the translation.
[0066] Server 150 may transmit the original and translated messages at different times, or at the same time. Server 150 may transmit the original message first, and then, once the message translation is complete, transmit the translated message including the identifier of the message corresponding to the original. In this case, the client may display the original message first in the dialogue space, and then, upon receiving the translated message, use the identifier included in the translated message to identify the message corresponding to the original, and then combine the translated message with the corresponding message for display. As another example, Server 150 may delay the transmission of the original message and transmit both the original and translated messages simultaneously once the message translation is complete. In this case, Server 150 may transmit the translated message as additional information to the original message.
[0067] If server 150 voluntarily supports message translation, the process is similar to the one described above, but server 150 may provide the translation results directly to the client instead of the dedicated translation server 160.
[0068] Figure 6 is an illustrative diagram illustrating another example of the message translation process in one embodiment of the present invention.
[0069] Referring to Figure 6, when user B sends a message written in Japanese in a dialogue space in which user A and user B are participating, client B (502) transmits a request to send the message to server 150 (S61).
[0070] In response to a message transmission request from client B(502), server 150 transmits the message received from client B(502) to the terminal of user A, who is participating in the dialogue space, i.e., client A(501) (S62).
[0071] If client A (501) determines that a message sent by client B (502) requires translation based on user A's language information and translation-related option information, client A (501) may request server 160 to translate it into at least one language (S63).
[0072] Server 160 may, in accordance with the request of client A(501), translate the message received by client A(501) from client B(502), and once the translation is complete, transmit the translated message to client A(501) (S64).
[0073] When client A (501) displays a message sent by user B in the corresponding dialogue space, it may combine the original message and the translated message, that is, combine the Japanese original and the Korean translation into one and display it as a speech bubble interface (S65).
[0074] Client B (502), like Client A (501), may determine whether message translation is necessary based on User B's language information and option information. If it is determined that a translation is not necessary, the message translation process will not proceed.
[0075] In other words, each client receiving the message can determine whether message translation is necessary, proceed with the message translation process individually if the user is using a different language than the other party, and provide the translation result only to the user on the client side.
[0076] Figure 7 is an illustrative diagram illustrating yet another example of the message translation process in one embodiment of the present invention.
[0077] Referring to Figure 7, when user B sends a message written in Japanese in a dialogue space in which user A and user B are participating, client B (502) transmits a request to send the message to server 150 (S71).
[0078] In response to a message transmission request from client B(502), server 150 transmits the message received from client B(502) to the terminal of user A, who is participating in the dialogue space, i.e., client A(501) (S72).
[0079] Client A (501) may translate the message sent by Client B (502) into at least one language based on User A's language information and translation-related option information (S73-S74). Client A (501) has a Japanese DB 70 built in its local database that includes a translation library between Korean and Japanese, and may use the Japanese DB 70 to translate the original message written in Japanese into Korean, which is User A's language.
[0080] Client A (501) may voluntarily translate the message received from Client B (502) using offline translation with the Japanese DB (70), and display the original text and the translated text as a single callout interface (S75). In other words, when Client A (501) displays the message sent by User B in the corresponding dialogue space, it may combine the original message and the translated message, that is, the Japanese original text and the Korean translation, and display them together as a callout interface.
[0081] Therefore, each client receiving the message can determine whether message translation is necessary, and if the user is using a different language than the other party, the translation result may be provided only to the client-side user via automatic translation.
[0082] Figure 8 is an illustrative diagram illustrating yet another example of the message translation process in one embodiment of the present invention.
[0083] Figure 8 is an illustrative diagram showing the sequence of operations in which translation is performed first during the message input process before the translated message is sent, unlike the process in Figures 5-7 where translation proceeds after the original message is sent.
[0084] Referring to Figure 8, when user B enters a message to send to user A in a dialogue space in which user A and user B are participating, client B (502) may transmit a translation request for the message along with the message entered by user B to server 160 (S81).
[0085] Server 160, in accordance with the request of client B(502), translates the message transmitted from client B(502), and once the translation is complete, may transmit the translated message to client B(502) (S82).
[0086] Client B (502) may receive a translated message from Server 160 in response to a message entered by User B and display it in the corresponding dialogue space (S83).
[0087] Client B (502), in accordance with User B's request, transmits the request to send the translated message received from Server 160 to Server 150 (S84).
[0088] In response to a message transmission request from client B(502), server 150 transmits the translated message received from client B(502) to the terminal of user A, who is participating in the dialogue space, i.e., client A(501) (S85).
[0089] Therefore, as soon as a message is entered into the dialogue space on each client, the translation result is automatically displayed, allowing the translated message (not the original message) to be sent immediately.
[0090] In the above-described embodiment, if a translation library is built in the client-side local database, this may take the place of the server 160 and provide translations for input messages through offline translation using the internal database.
[0091] Figures 9-15 show examples of interface screens for displaying message translation results in one embodiment of the present invention.
[0092] Figures 9-15 show screens of a conversation between user A, who speaks Korean, and user B, who speaks Japanese.
[0093] In the following, we will assume a situation where User B sends the message "Thank you for your hard work" to User A.
[0094] Referring to Figure 9, the dialogue space 90 contains the original message "Thank you for your hard work" and its Korean translation.
number
[0095] In this embodiment, as shown in Figure 9, the message processing unit 330 displays the original message "Thank you for your hard work" and the translated message in the dialogue space 900.
number
[0096] As another example, the message processing unit 330 may display a speech bubble interface 910 containing the original message "Thank you for your hard work," as shown in Figure 10. In this case, for messages in a language different from the user's language, the message processing unit 330 may activate and display a "Translate" menu 1011 adjacent to the speech bubble interface 910 to request message translation. When a user request is entered, in other words, when the "Translate" menu 1011 is selected, the message processing unit 330 may display the translated message in an inline view format. In this case, the message processing unit 330 displays the translated message in the speech bubble interface 910.
number
[0097] The message processing unit 330 processes the original message "Thank you for your hard work" and the translated message.
number
[0098] Furthermore, the message processing unit 330 processes the original message "Thank you for your hard work" and the translated message.
number
[0099] Translation of the original message "Thank you for your hard work"
number
number
[0100] Furthermore, this embodiment provides an improved message input UX that allows users to directly send messages created in the other party's language to the dialogue space without using separate services. The message processing unit 330 may provide a translation function for the input message if the language of the message entered by the user in the dialogue space is different from the language of the other party participating in the dialogue space, or if it is determined that translation is necessary based on options related to translation for the dialogue space.
[0101] Referring to Figure 15, when User A enters a message into the message input window 1550 that it intends to send to User B in the dialogue space 900, the message processing unit 330 may display a translated message in User B's language or a language specified by User A in the message translation window 1560, which is an area adjacent to the message input window 1550. Depending on the embodiment, the translation of the input message may be performed by a translation bot or server 150 participating in the dialogue space 900, or by offline translation on the client. In response to User A's message sending request, the message processing unit 330 may provide a function to send the translated text displayed in the message translation window 1560 as is, or to send it after making modifications, instead of the message entered in the message input window 1550.
[0102] Therefore, the message processing unit 330 may immediately send the message displayed in the message translation window 1560, that is, the message translated into the recipient's language or a specified language, instead of the message entered in the message input window 1550 as the original message.
[0103] Thus, according to embodiments of the present invention, the user language and the language of the received message can be recognized, and a message translation can be provided in the dialogue space based on the recognized language. At this time, the original message and the message translation can be bundled and displayed as a single message UI, and the message translation can be displayed only to users who need the translation result based on the language used in the dialogue space and the translation and related options. Furthermore, a function can be provided to provide a translation during the process of entering a message in the message input window of the dialogue space, and to send the translation immediately instead of the original text.
[0104] The above-described apparatus may be implemented by hardware components, software components, and / or combinations of hardware and software components. For example, the apparatus and components described in the embodiments may be implemented using one or more general-purpose or special-purpose computers, such as processors, controllers, ALUs (arithmetic logic units), digital signal processors, microcomputers, FPGAs (field programmable gate arrays), PLUs (programmable logic units), microprocessors, or various devices capable of executing and responding to instructions. The processing unit may execute an operating system (OS) and one or more software applications running on the OS. The processing unit may also respond to software execution, access data, record, manipulate, process, and generate data. For convenience of understanding, it may be described as if a single processing unit is used, but those skilled in the art will understand that the processing unit may include multiple processing elements and / or multiple types of processing elements. For example, the processing unit may include multiple processors or one processor and one controller. Other processing configurations, such as parallel processors, are also possible.
[0105] Software may include computer programs, code, instructions, or a combination of one or more of these, which may configure a processing unit to operate as desired, or which may instruct the processing unit independently or collectively. Software and / or data may be embodied in any kind of machine, component, physical device, computer storage medium, or device for interpretation based on the processing unit or for providing instructions or data to the processing unit. Software may be distributed across a network of computer systems, stored and executed in a distributed manner. Software and data may be stored in one or more computer-readable storage media.
[0106] The method according to the embodiment may be implemented in the form of program instructions executable by various computer means and stored on a computer-readable medium. Here, the medium may continuously store computer-executable programs or may temporarily store them for execution or download. Furthermore, the medium may be various storage or storage means in the form of a combination of one or more hardware components, and is not limited to a medium directly connected to a computer system, but may be distributed on a network. Examples of mediums include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and ROMs, RAMs, flash memories, etc., which may be configured to store program instructions. Another example of a medium is a storage or storage medium managed by an application store that distributes applications or other sites, servers that supply or distribute various software.
[0107] As described above, embodiments have been explained based on limited embodiments and drawings, but those skilled in the art will be able to make various modifications and variations from the above description. For example, the described technique may be performed in a different order than described, and / or the components of the described system, structure, apparatus, circuit, etc. may be combined or assembled in a different manner than described, or opposed or replaced by other components or equivalents, and still achieve suitable results.
[0108] Therefore, even if the embodiment is different, if it is equivalent to the claims, it falls within the scope of the attached claims. [Explanation of symbols]
[0109] 220: Processor 310: Settings section 320:Language recognition department 330: Message Processing Unit
Claims
1. A message processing method performed by a computer system, The computer system includes at least one processor configured to execute computer-readable instructions contained in memory, The aforementioned message processing method is: The steps include: the at least one processor recognizing the language associated with the dialogue space based on translation-related options set for the dialogue space and the dialogue context; and the at least one processor providing at least one translated text in the recognized language for a message received or entered into the dialogue space. Includes, The aforementioned step of providing is The process includes the step of combining the original text of the message with the at least one translated text and displaying the original text and the at least one translated text through a message interface. The aforementioned message interface consists of a single message form that includes the source text and at least one translated text, The display step involves displaying a first operation interface configured to manipulate the source text and a second operation interface configured to manipulate at least one translated text within the message interface, respectively. A message processing method wherein the original text and the at least one translated text can be operated individually through the first and second operating interfaces, respectively.
2. The aforementioned recognition stage is, The message processing method according to claim 1, comprising the steps of: recognizing a user language which is the language used by the user of the computer system in the dialogue space; and recognizing at least one target language which corresponds to the translation-related option among the receiving languages which is the language of the received message.
3. The aforementioned step of providing is The message processing method according to claim 1, characterized in that, if the receiving language, which is the language of the received message, is different from the user language, which is the language used by the user of the computer system, the result of translating the received message into at least one language including the user language is displayed on the dialogue space as the translated text of the received message.
4. The message processing method according to claim 1, wherein the message interface is a speech bubble interface.
5. The aforementioned display step is, The message processing method according to claim 4, characterized in that a display element is displayed for identifying at least one of the original text or the translated text in order to distinguish between the original text and the translated text.
6. The first operation interface includes an interface for operations that include at least one of deletion, modification, or concealment operations on the original text, The message processing method according to claim 4, wherein the second operation interface includes an interface for operations that include at least one of deletion, modification, or concealment operations on the at least one translated text.
7. The aforementioned step of providing is A message processing method according to claim 1, comprising the steps of: displaying a speech bubble interface containing the original text of a message received in the dialogue space; and, in accordance with a user request for the received message, adding at least one translated version of the received message to the speech bubble interface, thereby displaying the original text and the at least one translated version in a single message within the speech bubble interface.
8. The message processing method according to claim 3, characterized in that the translated text is not transmitted to other users included in the dialogue space, but is displayed only on the user's screen.
9. The message processing method according to claim 3, characterized in that the translated text is received from a dedicated translation bot included in the dialogue space or from a server associated with the dialogue space, and the translated text is included as additional information to the received message, or the identifier of the received message is included in the translated text and transmitted to the computer system.
10. The message processing method according to claim 3, characterized in that the translated text includes the result of translation performed by the computer system using a translation library built in the local database of the computer system.
11. The aforementioned step of providing is The message processing method according to claim 1, comprising the steps of: providing a translated result in at least one of the recognized languages for a message entered by a user of the computer system into a message input window of the dialogue space; and sending the translated result to other users included in the dialogue space in place of the entered message, in accordance with a message sending request from the user.
12. A computer program that causes a computer system to execute the message processing method described in any one of claims 1 to 11.
13. A computer system, It includes at least one processor configured to execute computer-readable instructions contained in memory, The aforementioned at least one processor is It functions as a language recognition unit that recognizes a language associated with a dialogue space based on translation-related options set for the dialogue space and the dialogue context, and as a message processing unit that processes messages received or input into the dialogue space to provide at least one translated sentence in the recognized language. The message processing unit, The original text of the message and the at least one translated text are combined and displayed through a message interface. The aforementioned message interface consists of a single message form that includes the source text and at least one translated text, The message processing unit displays a first operation interface configured to manipulate the source text and a second operation interface configured to manipulate at least one translated text within the message interface. A computer system in which the original text and the at least one translated text can be operated individually through the first and second operating interfaces, respectively.
14. The language recognition unit, The user language, which is the language used by the user of the computer system, is recognized in the aforementioned dialogue space. The computer system according to claim 13, characterized in that it recognizes at least one target language corresponding to the translation-related option among the receiving languages which are the language of the received message.
15. The message processing unit, The computer system according to claim 13, characterized in that, if the receiving language, which is the language of the received message, is different from the user language, which is the language used by the user of the computer system, the result of translating the received message into at least one language including the user language is displayed on the dialogue space as the translated text of the received message.
16. The message processing unit, The computer system according to claim 13, characterized in that the message interface is a speech bubble interface.
17. The message processing unit, After displaying a speech bubble interface containing the original text of the received message in the dialogue space, The computer system according to claim 13, characterized in that, in accordance with a user request for the received message, at least one translated version of the received message is added to the speech bubble interface, and the original text and the at least one translated version are displayed in a single message within the speech bubble interface.
18. The computer system according to claim 15, characterized in that the translated text is received from a dedicated translation bot included in the dialogue space or from a server associated with the dialogue space, is not transmitted to other users included in the dialogue space, and is displayed only on the user's screen.
19. The computer system according to claim 15, characterized in that the translated text includes the result of translation performed by the computer system using a translation library built in the local database of the computer system.
20. The message processing unit, The computer system provides a translated result in at least one of the recognized languages for a message entered by the user in the message input window of the dialogue space. The computer system according to claim 13, characterized in that, in response to a message sending request from the user, it sends the translated result to other users included in the dialogue space in place of the entered message.