Method, system and computer program for expressing emotions in interactive messages using gestures

Abstract

To provide a method, a system, and a computer program for expressing emotion in a dialog message by use of gestures.SOLUTION: A message expression method includes: a step of receiving input of a message for performing transmission by a chat room; a step of recognizing gestures for the message and converting them into animation information; a step of transmitting the message and the animation information to an electronic device of another user included in the chat room via a server; and a step of displaying the message as a transmitted message of the chat room while animation effect provided by the animation information is applied to the message.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The following description relates to techniques for expressing a user's emotions in a dialogue message. [Background technology]

[0002] Instant messenger, a common communication tool, is software that allows users to send and receive messages and data in real time. When a user registers a conversation partner on the messenger, they can exchange messages with the people registered in the conversation list in real time.

[0003] Such messenger functions are widely used not only on PCs but also in mobile environments such as mobile communication terminals.

[0004] For example, Patent Document 1 (Publication date: September 30, 2002) discloses a mobile messenger service system and method for a mobile terminal using a wireless communication network, which can provide a messenger service between mobile messengers installed on the mobile terminal.

[0005] As the use of instant messengers becomes more widespread, the functions they provide are becoming more diverse, and they now not only support the sharing of various information and content such as photos, videos, files, contacts, locations, schedules, notifications, and polls, but also link with other services such as game and video services. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] Korean Patent Publication No. 10-2002-0074304 Summary of the Invention [Problem to be solved by the invention]

[0007] Gestures and emotional expressions are matched, and gestures can be used to express the user's emotions in conversation messages.

[0008] Gestures for conversation messages being input can be recognized, and animation effects corresponding to the gestures can be applied to the corresponding messages. [Means for solving the problem]

[0009] Provided is a method of presenting a message executed by a computer device, the computer device including at least one processor configured to execute computer-readable instructions contained in a memory, the method of presenting a message including the steps of: receiving, by the at least one processor, an input of a message to be sent in a chat room; recognizing, by the at least one processor, gestures for the message and converting them into animation information; transmitting, by the at least one processor, both the message and the animation information to electronic devices of other users included in the chat room via a server; and displaying, by the at least one processor, the message as a message to be sent in the chat room, while applying an animation effect based on the animation information to the message.

[0010] According to one aspect, the converting step may include converting the gesture touch input into custom animation information by storing the gesture touch input in chronological order.

[0011] According to another aspect, the converting step may include converting the touch input by the gesture into custom animation information by storing the touch input by the gesture in chronological order if a predefined animation exists for the gesture, and converting the touch input by the gesture into custom animation information if a predefined animation does not exist for the gesture.

[0012] According to another aspect, the converting into the custom animation information may generate custom animation data including a touch coordinate sequence in which touch coordinates at a certain time interval are stored in chronological order.

[0013] According to another aspect, the converting into the custom animation information may generate custom animation data including a touch type sequence in which touch types at a certain time interval are stored in chronological order.

[0014] According to another aspect, the message expression method may further include setting, by the at least one processor, a gesture recognition area for recognizing the gesture when a keyboard is activated in the chat room.

[0015] According to another aspect, the message expressing method may further include setting a gesture recognition area for recognizing the gesture when a preview of the message is performed in the chat room by the at least one processor.

[0016] According to yet another aspect, the animation information may be transmitted to the other user's electronic device after data optimization is performed on the server.

[0017] According to another aspect, the animation information may be exchanged with similar animation information at the server and transmitted to the electronic devices of the other users.

[0018] According to yet another aspect, the message may be converted into an animation file message type by the server using the animation information before being sent to the electronic device of the other user.

[0019] A computer program is provided that is recorded on a non-transitory computer-readable recording medium for causing the computer system to execute the message representation method.

[0020] A computer device is provided that includes at least one processor implemented to execute computer-readable instructions contained in a memory, the at least one processor including a message input unit that receives input of a message to be sent in a chat room, a gesture conversion unit that recognizes gestures for the message and converts them into animation information, a message sending unit that sends both the message and the animation information to electronic devices of other users included in the chat room via a server, and a message display unit that displays the message as a message sent in the chat room, applying an animation effect based on the animation information to the message. [Brief description of the drawings]

[0021] [Figure 1] FIG. 1 illustrates an example of a network environment in accordance with an embodiment of the present invention. [Diagram 2] 2 is a block diagram illustrating the internal configuration of an electronic device and a server according to an embodiment of the present invention. FIG. [Diagram 3] FIG. 2 illustrates example components that may be included in a processor of an electronic device in accordance with an embodiment of the present invention. [Figure 4] 4 is a flowchart illustrating an example of a method that can be performed by an electronic device in accordance with an embodiment of the present invention. [Diagram 5]FIG. 2 illustrates examples of predefined animation types for each gesture in accordance with one embodiment of the present invention. [Figure 6] 10 is an exemplary diagram illustrating a process of setting an area for recognizing a gesture in a chat room according to an embodiment of the present invention; [Figure 7] 11A and 11B are diagrams illustrating an example of a user interface screen for explaining a process of expressing a user's emotion using a gesture on a stamp input as a conversation message in an embodiment of the present invention. [Figure 8] 11A and 11B are diagrams illustrating an example of a user interface screen for explaining a process of expressing a user's emotion using a gesture on a stamp input as a conversation message in an embodiment of the present invention. [Figure 9] 11A and 11B are diagrams illustrating an example of a user interface screen for explaining a process of indicating a user's emotion using gestures in text input as a dialogue message in an embodiment of the present invention. [Figure 10] 11A and 11B are diagrams illustrating an example of a user interface screen for explaining a process of indicating a user's emotion using gestures in text input as a dialogue message in an embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0022] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[0023] An embodiment of the present invention relates to a technology for expressing, in a conversation message, the emotion of a user who has sent the message.

[0024] Embodiments including those specifically disclosed herein can match gestures with emotional expressions and utilize gestures to actively express a user's emotions in a conversation message.

[0025] Fig. 1 is a diagram showing an example of a network environment in one embodiment of the present invention. The network environment in Fig. 1 shows an example including a plurality of electronic devices 110, 120, 130, 140, a plurality of servers 150, 160, and a network 170. Fig. 1 is merely an example for explaining the invention, and the number of electronic devices and the number of servers are not limited to those shown in Fig. 1.

[0026] The electronic devices 110, 120, 130, and 140 may be fixed terminals or mobile terminals realized by computer devices. Examples of the electronic devices 110, 120, 130, and 140 include smartphones, mobile phones, navigation systems, personal computers (PCs), notebook PCs, digital broadcasting terminals, personal digital assistants (PDAs), portable multimedia players (PMPs), tablets, game consoles, wearable devices, internet of things (IoT) devices, virtual reality (VR) devices, and augmented reality (AR) devices. As an example, FIG. 1 shows a smartphone as an example of the electronic device 110, but in the embodiment of the present invention, the electronic device 110 may mean one of various physical computer devices that can communicate with other electronic devices 120, 130, and 140 and / or servers 150 and 160 via a network 170 using a substantially wireless or wired communication method.

[0027] The communication method is not limited, and may include not only a communication method using a communication network (such as a mobile communication network, a wired Internet, a wireless Internet, a broadcast network, a satellite network, etc.) that the network 170 can include, but also short-range wireless communication between devices. For example, the network 170 may include any one or more of a personal area network (PAN), a local area network (LAN), a campus area network (CAN), a metropolitan area network (MAN), a wide area network (WAN), a broadband network (BBN), the Internet, etc. Furthermore, the network 170 may include any one or more of a network topology including, but not limited to, a bus network, a star network, a ring network, a mesh network, a star-bus network, a tree or a hierarchical network, etc.

[0028] Each of the servers 150 and 160 may be realized by one or more computer devices that communicate with the multiple electronic devices 110, 120, 130, and 140 via the network 170 to provide instructions, codes, files, contents, services, and the like. For example, the server 150 may be a system that provides a first service to the multiple electronic devices 110, 120, 130, and 140 connected via the network 170, and the server 160 may be a system that provides a second service to the multiple electronic devices 110, 120, 130, and 140 connected via the network 170. As a more specific example, the server 150 may provide a service (e.g., a messenger service, for example) targeted by an application, which is a computer program installed and executed in the multiple electronic devices 110, 120, 130, and 140, as a first service to the multiple electronic devices 110, 120, 130, and 140. As another example, the server 160 may provide, as a second service, a service of distributing files for installing and executing the above-mentioned application to the multiple electronic devices 110, 120, 130, and 140.

[0029] Fig. 2 is a block diagram for explaining the internal configuration of an electronic device and a server in an embodiment of the present invention. In Fig. 2, the internal configuration of electronic device 110 and the internal configuration of server 150 are explained as examples of electronic devices. In addition, other electronic devices 120, 130, 140 and server 160 may have the same or similar internal configuration as electronic device 110 or server 150 described above.

[0030] The electronic device 110 and the server 150 may include memories 211 and 221, processors 212 and 222, communication modules 213 and 223, and input / output interfaces 214 and 224. The memories 211 and 221 may be non-transitory computer-readable recording media and may include persistent mass storage devices such as random access memory (RAM), read only memory (ROM), disk drives, solid state drives (SSD), flash memories, and the like. Here, persistent mass storage devices such as ROM, SSD, flash memories, and disk drives may be included in the electronic device 110 and the server 150 as persistent storage devices separate from the memories 211 and 221. In addition, the memories 211 and 221 may store an operating system and at least one program code (for example, a browser installed and executed in the electronic device 110, or a code for an application installed in the electronic device 110 to provide a specific service, etc.). Such software components may be loaded from a computer-readable recording medium separate from the memories 211 and 221. Such another computer-readable recording medium may include a computer-readable recording medium such as a floppy drive, a disk, a tape, a DVD / CD-ROM drive, a memory card, etc. In another embodiment, the software components may be loaded into the memory 211, 221 through a communication module 213, 223 that is not a computer-readable recording medium. For example, at least one program may be loaded into the memory 211, 221 based on a computer program (for example, the above-mentioned application) that is installed by a file provided via the network 170 by a developer or a file distribution system that distributes an installation file of the application (for example, the above-mentioned server 160).

[0031] The processors 212, 222 may be configured to process instructions of a computer program by performing basic arithmetic, logic, and input / output operations. The instructions may be provided to the processors 212, 222 by the memory 211, 221 or the communication modules 213, 223. For example, the processors 212, 222 may be configured to execute instructions received according to program code stored in a storage device such as the memory 211, 221.

[0032] The communication modules 213 and 223 may provide a function for the electronic device 110 and the server 150 to communicate with each other via the network 170, or may provide a function for the electronic device 110 and / or the server 150 to communicate with other electronic devices (for example, the electronic device 120) or other servers (for example, the server 160). For example, a request generated by the processor 212 of the electronic device 110 according to a program code recorded in a recording device such as the memory 211 may be transmitted to the server 150 via the network 170 under the control of the communication module 213. Conversely, a control signal, an instruction, a content, a file, etc. provided under the control of the processor 222 of the server 150 may be received by the electronic device 110 through the communication module 213 of the electronic device 110 via the communication module 223 and the network 170. For example, control signals, instructions, content, files, etc. from the server 150 received through the communication module 213 may be transmitted to the processor 212 or memory 211, and the content, files, etc. may be recorded on a recording medium (the above-mentioned permanent recording device) that the electronic device 110 may further include.

[0033] The input / output interface 214 may be a means for interfacing with the input / output device 215. For example, the input device may include devices such as a keyboard, a mouse, a microphone, and a camera, and the output device may include devices such as a display, a speaker, and a haptic feedback device. As another example, the input / output interface 214 may be a means for interfacing with a device in which functions for input and output are integrated into one, such as a touch screen. The input / output device 215 may be configured as one device together with the electronic device 110. Also, the input / output interface 224 of the server 150 may be a means for interfacing with a device for input or output (not shown) that may be connected to the server 150 or may be included in the server 150. As a more specific example, when the processor 212 of the electronic device 110 processes the instructions of the computer program loaded in the memory 211, a service screen or content configured using data provided by the server 150 or the electronic device 120 may be displayed on a display through the input / output interface 214.

[0034] Also, in other embodiments, the electronic device 110 and the server 150 may include more components than those in FIG. 2. However, it is not necessary to clearly show most of the conventional technical components in the figure. For example, the electronic device 110 may be realized to include at least some of the above-mentioned input / output devices 215, and may further include other components such as a transceiver, a GPS (Global Positioning System) module, a camera, various sensors, a database, etc. As a more specific example, if the electronic device 110 is a smartphone, various components such as an acceleration sensor, a gyro sensor, a camera module, various physical buttons, a button using a touch panel, an input / output port, a vibrator for vibration, etc., which are generally included in a smartphone, may be realized to be further included in the electronic device 110.

[0035] Specific embodiments of a method and system for expressing emotions in dialogue messages using gestures are described below.

[0036] FIG. 3 is a block diagram illustrating an example of components that may be included in a processor of an electronic device in one embodiment of the present invention, and FIG. 4 is a flowchart illustrating an example of a method that may be performed by an electronic device in one embodiment of the present invention.

[0037] A message expression system implemented by a computer may be configured in the electronic device 110 according to the present embodiment. For example, the message expression providing system may be implemented in the form of an independently operating program, or may be configured in the form of an in-app of a specific application so as to be operable on the specific application, and may provide a messenger service in conjunction with the server 150 in some cases.

[0038] Based on instructions provided by an application installed on the electronic device 110, the message presentation system implemented in the electronic device 110 may perform the message presentation method illustrated in FIG.

[0039] To execute the message expression method according to Fig. 4, the processor 212 of the electronic device 110 may include, as components, a message input unit 310, a gesture conversion unit 320, a message sending unit 330, and a message display unit 340, as shown in Fig. 3. Depending on the embodiment, the components of the processor 212 may be selectively included or excluded in the processor 212. Also, depending on the embodiment, the components of the processor 212 may be separated or combined for expressing the functions of the processor 212.

[0040] Such processor 212 and components of processor 212 may control electronic device 110 to execute steps 410 to 430 included in the message representation method of Fig. 4. For example, processor 212 and components of processor 212 may be realized to execute instructions according to the code of an operating system and the code of at least one program included in memory 211.

[0041] Here, the components of the processor 212 may represent different functions of the processor 212 that are executed by the processor 212 according to instructions provided by a program code recorded in the electronic device 110 (for example, instructions provided by an application executed by the electronic device 110). For example, the message input unit 310 may be used as a functional representation of the processor 212 that controls the electronic device 110 according to the above-mentioned instructions so that the electronic device 110 inputs a dialogue message into a message input window of a chat room.

[0042] The processor 212 may read necessary instructions from the memory 211 loaded with instructions related to the control of the electronic device 110. In this case, the read instructions may include instructions for controlling the processor 212 to execute steps 410 to 430 described below.

[0043] 4, in step 410, the message input unit 310 may receive an input of a conversation message (hereinafter, referred to as an "outgoing message") for sending text or a stamp input or selected by a user of the electronic device 110 in a chat room of a messenger installed in the electronic device 110. At this time, a preview may be provided for the text or stamp input or selected for sending the message.

[0044] In this specification, a stamp is an image-based means of expression that can be used to express a user's feelings or intentions in a messenger, and may refer to various graphic content generated by images, flash, animation, etc.

[0045] A preview of text may be provided by directly inputting the text into a message input window of a chat room by typing using a keyboard, whereas a stamp may be selected from a recommendation list related to the text input into the message input window, or directly selected from a stamp screen providing a full list, and a preview may be provided by overlaying a preview layer of the stamp in a predetermined position in the chat room, for example, in the message input window or an area adjacent to the message input window.

[0046] In operation 420, the gesture conversion unit 320 may recognize a gesture input for an outgoing message and convert the recognized gesture into animation information. If a touch is recognized on a preview screen of a text or stamp input or selected as an outgoing message, the gesture conversion unit 320 may analyze the recognized touch gesture and generate animation information corresponding to the gesture. In this case, the animation information may include an animation effect corresponding to the gesture as an effect applicable to the message.

[0047] For example, the gesture conversion unit 320 may recognize a gesture for a text or stamp preview and convert the recognized gesture into a predefined animation. For example, referring to FIG. 5, animation effects 502 such as vibration, destruction, expansion, contraction, fade in, fade out, etc. may be predefined according to a gesture type 501, and an animation matching table may be constructed for each gesture. The gesture conversion unit 320 may convert the gesture into predefined animation type information according to the gesture for the text or stamp preview.

[0048] As another example, the gesture conversion unit 320 may recognize a gesture for a text or stamp preview, and convert the gesture into a custom animation reflecting a trajectory or pattern of the recognized gesture. The gesture conversion unit 320 may generate a custom animation by storing a user's touch input at a certain time interval in chronological order. For example, the gesture conversion unit 320 may generate custom animation data consisting of a touch coordinate sequence such as [time 1, touch coordinate (100, 200)], [time 2, touch coordinate (200, 200)], [time 3, touch coordinate (300, 200)], and [time 4, touch coordinate (400, 200)] as touch coordinates at each time. Alternatively, the gesture conversion unit 320 may generate custom animation data consisting of a touch type sequence such as [time 1, swipe left], [time 2, swipe right], [time 3, long click], and [time 4, double tap] as touch types at each time.

[0049] As another example, the gesture conversion unit 320 may recognize a gesture for a text or stamp preview, and convert the recognized gesture into a defined animation if a predefined animation exists for the recognized gesture, or convert the recognized gesture into a custom animation that directly reflects the trajectory or pattern of the recognized gesture if a predefined animation does not exist.

[0050] 4 again, in step 430, when a message transmission request is input from the user of the electronic device 110, the message transmission unit 330 may transmit both the outgoing message input in step 410 and the animation information converted in step 420 to the server 150 for transmission to the other party in the chat room. In the case of a predefined animation, animation type information may be transmitted together with the outgoing message, and in the case of a custom animation, animation data generated by a touch input sequence by a gesture may be transmitted together with the outgoing message. The server 150 may transmit the information transmitted from the electronic device 110 (the outgoing message and the animation information) to the electronic devices of other users included in the chat room (for example, at least one of the electronic devices 120, 130, and 140).

[0051] In step 440, the message display unit 340 may apply an animation effect to the outgoing message by using the animation information transmitted together with the outgoing message when displaying the outgoing message transmitted to the electronic device of another user in the chat room. Similarly, when displaying a conversation message received from the electronic device of another user (hereinafter, referred to as a "received message") in the chat room, the message display unit 340 may apply an animation effect to the received message by using the received animation information when both the received message and animation information are received.

[0052] The electronic device of the other user displays the outgoing message transmitted from the electronic device 110 on the screen, and may provide animation effects to the outgoing message using the animation information transmitted together with the outgoing message. In the case of predefined animations, animation data required to show each type of animation is included in the messenger installed in the electronic device. On the other hand, in the case of custom animations, animation effects may be played using animation data transmitted from the electronic device 110.

[0053] According to an embodiment, the server 150 may perform an efficiency operation for optimizing data, such as compressing data, reducing the length of data, or exchanging the data with other data, before transmitting data transmitted from the electronic device 110 to the electronic device of the conversation partner. For example, as an efficiency operation in terms of traffic, if animation data transmitted from the electronic device 110 exceeds a certain size, it may be exchanged for a similar animation having a smaller data size and transmitted. As another example, the server 150 may convert the outgoing message and animation information transmitted from the electronic device 110 into a new message type, that is, an animation message, and transmit the converted message. In other words, the server 150 may reflect animation data corresponding to a gesture of the user of the electronic device 110 in the outgoing message transmitted from the electronic device 110, and convert the message type itself into an animation file (e.g., a GIF file, etc.) before transmitting the message.

[0054] In the present embodiment, a user gesture for a dialogue message being input is used to express an animation effect corresponding to the gesture in the dialogue message, thereby making it possible to express various emotions in the dialogue message.

[0055] 6 to 10 are exemplary views showing user interface screens for illustrating a process of expressing a user's emotion in a conversation message using gestures according to an embodiment of the present invention.

[0056] Referring to FIG. 6, the processor 212 may activate and display a keyboard 610 when a user of the electronic device 110 selects a message entry window in a chat room 600 of a messenger installed on the electronic device 110.

[0057] When the keyboard 610 is activated in the chat room 600, the processor 212 may set an area in the chat room 600 where a gesture can be recognized (hereinafter, referred to as a "gesture recognition area") 620. For example, the processor 212 may set as the gesture recognition area 620 a partial area in the chat room 600, or an area including at least a part of a message input window or a keyboard input window, or an area adjacent to a message input window or a keyboard input window.

[0058] The gesture recognition area 620 is a transparent layer that is responsible for recognizing user gestures on text or stamps that are entered or selected as an outgoing message.

[0059] Although it has been described that the gesture recognition area 620 is set when the keyboard 610 is activated in the chat room 600, this is not limited thereto, and the gesture recognition area 620 may be set when a stamp screen (not shown) that provides a stamp list for stamp selection in the chat room 600 is activated, or when a preview is performed for text or stamps created for sending a message.

[0060] An example of a process of expressing a user's emotion using gestures on a stamp selected for sending a message will be described below.

[0061] 7, when a user selects a stamp 730 as a message to be sent to a partner in the chat room 600, the processor 212 may provide a preview of the stamp 730 and recognize a touch gesture input in the gesture recognition area 620. For example, when a user inputs a left-right swipe gesture 731 for moving the stamp 730 left and right in the gesture recognition area 620, the processor 212 may convert the left-right swipe gesture 731 into animation information of a shaking effect by expressing a kind of impatient emotion. In this case, when a predefined animation exists for the left-right swipe gesture 731, the processor 212 may generate animation data consisting of type information of the corresponding animation, and when a predefined animation does not exist, the processor 212 may generate custom animation data consisting of a touch input sequence in which the touch input of the gesture input by the user is directly reflected.

[0062] When the user inputs a gesture for stamp 730 and then inputs the send button, processor 212 may release gesture recognition area 620 in chat room 600 and simultaneously transmit to server 150 animation information generated based on the user gesture along with stamp information (e.g., a stamp identifier) ​​corresponding to stamp 730.

[0063] The processor 212 displays the stamp 730 sent by the user as a conversation message in the chat room 600, and at this time, the stamp 730 may be given an animation effect 732 of shaking from side to side using animation information corresponding to a left / right swipe gesture 731 to show the user's emotion. In the case of a predefined animation for the left / right swipe gesture 731, the stamp 730 may be given an animation effect 732 of shaking from side to side with a predefined size and speed, and in the case of a custom animation, the stamp 730 may be given an animation effect 732 of shaking from side to side with the size and speed of the gesture input by the user.

[0064] 8, when a user selects a stamp 830 as a message to be sent to a partner in the chat room 600, the processor 212 may provide a preview of the stamp 830 and recognize a touch gesture input in the gesture recognition area 620. For example, when a user inputs a double tap gesture 831 in which the user touches the stamp 830 simultaneously with multiple fingers in the gesture recognition area 620, the processor 212 may convert the double tap gesture 831 into animation information of a destruction effect as a kind of anger emotion. In this case, when a predefined animation exists for the double tap gesture 831, the processor 212 may generate animation data consisting of type information of the corresponding animation, and when a predefined animation does not exist, the processor 212 may generate custom animation data consisting of a touch input sequence in which the touch input of the gesture input by the user is directly reflected.

[0065] When the user inputs a gesture for stamp 830 and then inputs the send button, processor 212 may release gesture recognition area 620 in chat room 600 and simultaneously transmit to server 150 animation information generated based on the user gesture together with stamp information corresponding to stamp 830.

[0066] The processor 212 displays the stamp 830 sent by the user as a conversation message in the chat room 600, and at this time, the processor 212 may show the user's emotion by providing an animation effect 832 in which the stamp 830 is destroyed using animation information corresponding to the double tap gesture 831. In the case of a predefined animation for the double tap gesture 831, the processor 212 may provide an animation effect 832 in which the stamp 830 is destroyed in a predefined pattern, and in the case of a custom animation, the processor 212 may provide an animation effect 832 in which the stamp 830 is destroyed in the gesture pattern input by the user.

[0067] In addition, when the user inputs an upper end drag while previewing the stamp, an animation effect of the stamp enlarging or fading in may be applied, and when the user inputs a lower end drag, an animation effect of the stamp shrinking or fading out may be applied, thereby expressing the user's emotions.

[0068] An example of a process for expressing a user's emotion using gestures in text input for sending a message will be described below.

[0069] 9, when a user inputs text 940 as a message to be sent to a partner in the chat room 600, the processor 212 may display the input text 940 in a message input window at the same time as the user inputs the text 940, and may recognize a touch gesture input in the gesture recognition area 620. For example, when a user inputs a left-right swipe gesture 941 for moving the text 940 left and right in the gesture recognition area 620, the processor 212 may convert the left-right swipe gesture 941 into animation information of a swinging effect as a kind of impatient emotion. In this case, when a predefined animation exists for the left-right swipe gesture 941, the processor 212 may generate animation data composed of type information of the corresponding animation, and when a predefined animation does not exist, the processor 212 may generate custom animation data composed of a touch input sequence in which the touch input of the gesture input by the user is directly reflected.

[0070] When the user inputs a gesture for text 940 and then inputs the send button, processor 212 may release gesture recognition area 620 in chat room 600 and simultaneously transmit animation information generated based on the user gesture together with message information including text 940 to server 150.

[0071] The processor 212 displays the text 940 sent by the user as a dialogue message in the chat room 600, and at this time, the animation effect 942 of shaking the text 940 from side to side may be provided to show the user's emotion by using animation information corresponding to the left / right swipe gesture 941. In the case of a predefined animation for the left / right swipe gesture 941, the animation effect 942 of shaking the text 940 from side to side may be provided in a predefined direction and speed, and in the case of a custom animation, the animation effect 942 of shaking the text 940 from side to side may be provided in the direction and speed of the gesture input by the user.

[0072] 10, when a user inputs text 1040 as a message to be sent to a partner in the chat room 600, the processor 212 may display the input text 1040 in a message input window at the same time as the input of the text 1040, and may recognize a touch gesture input in the gesture recognition area 620. For example, when a user inputs a double tap gesture 1041 in which the user simultaneously touches the text 1040 in the gesture recognition area 620 with multiple fingers, the processor 212 may convert the double tap gesture 1041 into animation information of a destruction effect as a kind of anger emotion. In this case, when a predefined animation exists for the double tap gesture 1041, the processor 212 may generate animation data consisting of type information of the corresponding animation, and when a predefined animation does not exist, the processor 212 may generate custom animation data consisting of a touch input sequence in which the touch input of the gesture input by the user is directly reflected.

[0073] When the user inputs a gesture for text 1040 and then inputs the send button, processor 212 may release gesture recognition area 620 in chat room 600 and simultaneously transmit animation information generated based on the user gesture together with message information including text 1040 to server 150.

[0074] The processor 212 displays the text 1040 sent by the user as a dialogue message in the chat room 600, and at this time, may show the user's emotion by providing an animation effect 1042 in which the text 1040 is destroyed using animation information corresponding to the double tap gesture 1041. In the case of a predefined animation for the double tap gesture 1041, the animation effect 1042 in which the text 1040 is destroyed in a predefined pattern may be provided, and in the case of a custom animation, the animation effect 1042 in which the text 1040 is destroyed in the same gesture pattern as input by the user may be provided.

[0075] In addition, when a user inputs an upper end drag on text entered in the message input window, an animation effect may be applied in which the text is enlarged or faded in, and when a user inputs a lower end drag, an animation effect may be applied in which the text is reduced or faded out, thereby expressing the user's emotions.

[0076] In the case of text, depending on the animation type, an animation effect can be applied to the text directly, or the text can be converted into an image and then an animation effect can be applied. For example, a destruction animation effect 1042 of text 1040 can be expressed by first converting the text 1040 into an image and then shattering the converted image into pieces.

[0077] In the above, vibration, destruction, expansion, contraction, fade-in, fade-out, etc. are described as examples of animations, but the animations should not be limited to these and any effect that can be applied to a dialogue message (stamp or message) can be applied.

[0078] In this manner, according to an embodiment of the present invention, by applying an animation effect corresponding to a gesture input during message creation to the message, gestures and emotional expressions can be matched, and a conversation message that more effectively expresses the user's emotions can be exchanged using gestures.

[0079] The above-mentioned devices may be realized by hardware components, software components, and / or a combination of hardware and software components. For example, the devices and components described in the embodiments may be realized using one or more general-purpose or special-purpose computers, such as a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or various devices capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications that run on the OS. The processing device may also respond to the execution of the software to access, record, manipulate, process, and generate data. For convenience of understanding, a single processing device may be described as being used, but those skilled in the art will understand that the processing device may include multiple processing elements and / or multiple types of processing elements. For example, the processing device may include multiple processors or one processor and one controller. Other processing configurations, such as parallel processors, are also possible.

[0080] The software may include computer programs, codes, instructions, or a combination of one or more of these, and may configure a processing device to operate as desired or instruct the processing device, either independently or collectively. The software and / or data may be embodied in any type of machine, component, physical device, computer storage medium, or device to be interpreted by the processing device or to provide instructions or data to the processing device. The software may be distributed and stored or executed in a distributed manner on computer systems connected by a network. The software and data may be stored on one or more computer-readable storage media.

[0081] The method according to the embodiment may be realized in the form of program instructions executable by various computer means and recorded on a computer-readable medium. Here, the medium may be one that continuously records a computer-executable program or one that temporarily records the program for execution or download. The medium may be one of various recording or storage means in the form of a single or multiple hardware devices combined, and may not be limited to a medium directly connected to a certain computer system, but may be one that is distributed over a network. Examples of the medium include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and ROMs, RAMs, flash memories, etc., configured to record program instructions. Other examples of the medium include recording media or storage media managed by application stores that distribute applications, or sites, servers, etc. that supply or distribute various other software.

[0082] Although the embodiments have been described based on the limited embodiments and drawings as above, those skilled in the art will be able to make various modifications and variations from the above description. For example, the described techniques may be performed in an order different from that described, and / or the components of the described systems, structures, devices, circuits, etc. may be combined or combined in a manner different from that described, or may be counterbalanced or replaced by other components or equivalents, and still achieve suitable results.

[0083] Therefore, different embodiments are within the scope of the appended claims provided they are equivalent to the claims. [Explanation of symbols]

[0084] 212: Processor 310: Message input section 320: Gesture conversion unit 330: Message sending unit 340: Message display section

Claims

1. 1. A method for rendering a message implemented by a computer device, comprising: The computing device includes at least one processor configured to execute computer-readable instructions contained in a memory; The message expression method includes: receiving, by said at least one processor, an input of a message to be transmitted in a chat room; recognizing and converting gestures in response to the message into animation information by the at least one processor; transmitting, by said at least one processor, both said message and said animation information via a server to electronic devices of other users in said chat room; and displaying the message as an outgoing message in the chat room by the at least one processor, the message being displayed with an animation effect according to the animation information being applied to the message. Including, The method of expressing a message further includes setting, by the at least one processor, a gesture recognition area for recognizing the gesture when a keyboard is activated in the chat room.

2. The converting step comprises: and converting the gesture touch input into custom animation information by storing the gesture touch input in chronological order. The method of claim 1 , comprising:

3. The converting step comprises: If a predefined animation exists for the gesture, converting the predefined animation into type information; and If the predefined animation does not exist for the gesture, converting the touch input of the gesture into custom animation information by storing the touch input in chronological order. The method of claim 1 , comprising:

4. The step of converting into custom animation information comprises: Generate custom animation data consisting of a touch coordinate sequence in which touch coordinates at a certain time interval are stored in chronological order.

3. The method of claim 2, wherein the message is represented by a message.

5. The step of converting into custom animation information comprises: Creating custom animation data consisting of a touch type sequence in which touch types at a certain time interval are stored in chronological order 3. The method of claim 2, wherein the message is represented by a message.

6. The message expression method includes: setting, by the at least one processor, the gesture recognition area for recognizing the gesture when a preview for the message is performed in the chat room. The method of claim 1 further comprising:

7. The animation information is transmitted to the electronic device of the other user after data optimization is performed on the server.

2. The method of claim 1, wherein the message is represented by a message.

8. The animation information is exchanged with similar animation information in the server and then transmitted to the electronic device of the other user.

2. The method of claim 1, wherein the message is represented by a message.

9. The message is converted into an animation file message type by the server using the animation information, and then transmitted to the electronic device of the other user.

2. The method of claim 1, wherein the message is represented by a message.

10. A computer program product that causes a computer device to execute the message representation method according to any one of claims 1 to 9.

11. 1. A computing device comprising: At least one processor configured to execute computer readable instructions contained in the memory. Including, The at least one processor a message input unit for receiving input of a message to be sent in the chat room; a gesture conversion unit that recognizes a gesture for the message and converts it into animation information; a message sending unit that sends both the message and the animation information to electronic devices of other users included in the chat room via a server; and a message display unit that displays the message as an outgoing message in the chat room, and applies an animation effect according to the animation information to the message. Including, The at least one processor The computer device further includes setting a gesture recognition area for recognizing the gesture when a keyboard is activated in the chat room.

12. The gesture conversion unit is The touch input by the gesture is converted into custom animation information by storing the touch input in chronological order. The computer device according to claim 11 .

13. The gesture conversion unit is If a predefined animation exists for the gesture, convert it into type information of the predefined animation; If the predefined animation does not exist for the gesture, converting the touch input of the gesture into custom animation information by storing the touch input in chronological order. The computer device according to claim 11 .

14. The gesture conversion unit is Generate custom animation data consisting of a touch coordinate sequence in which touch coordinates at a certain time interval are stored in chronological order.

13. The computer device of claim 12.

15. The gesture conversion unit is Creating custom animation data consisting of a touch type sequence in which touch types at a certain time interval are stored in chronological order 13. The computer device of claim 12.

16. The at least one processor setting a gesture recognition area for recognizing the gesture when a preview of the message is performed in the chat room; The computer device according to claim 11 .

17. The animation information is transmitted to the electronic device of the other user after data optimization is performed on the server. The computer device according to claim 11 .

18. The message is converted into an animation file message type by the server using the animation information, and then transmitted to the electronic device of the other user. The computer device according to claim 11 .

Images