Image work device and method via image sharing-based communication, and collaboration system via image sharing-based communication
The image sharing-based communication device and method address the inefficiencies in webtoon production by enabling real-time collaborative editing through keyword-matched work commands, improving collaboration efficiency and digital comic quality within the webtoon industry.
Patent Information
- Application Number
- PCT/KR2023/018175
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-01
- Filing Date
- 2023-11-13
- Publication Date
- 2024-11-07
AI Technical Summary
The webtoon industry faces challenges in improving work environment and efficiency due to a lack of systemization in webtoon production, with existing platforms primarily focusing on consumer perspectives and not adequately supporting collaborative work processes among creators.
An image sharing-based communication device and method that allows multiple collaborators to check and modify webtoon works in real-time by matching keywords with corresponding work commands, enabling easy and accurate editing and correction through a shared image interface.
Enhances collaboration efficiency by ensuring work continuity, improving the quality of digital comics, and facilitating quick corrections and improvements, even in complex collaborative environments, by directly integrating communication and collaboration within the platform.
Smart Images

Figure KR2023018175_07112024_PF_FP_ABST
Abstract
Description
Image work device and method through image sharing-based communication, and collaboration system through image sharing-based communication
[0001] The present invention relates to an image work device and method through image sharing-based communication, and a collaborative system through image sharing-based communication, and more specifically, to an image work device and method through image sharing-based communication required in collaborative work of authoring images through collaboration, and a collaborative system through image sharing-based communication.
[0002] In recent years, the market size of most content industries has increased due to the continued K-content Hallyu craze, the world's highest digital device penetration rate, and social distancing measures. Among them, the webtoon industry, while notably small in absolute sales and exports compared to the content industry as a whole, has been recording a notably high average annual growth rate.
[0003] In particular, the growth of the webtoon industry is directly linked to the growth of digital comics, and especially, due to the global COVID-19 pandemic, the consumption of offline distribution channels for printed comics has shrunk, leading to a decrease in demand. As a result, the share of digital comics in the entire comics market has exceeded 50%, and the global digital comics market is estimated to reach a size of 3.3 billion dollars (3.6 trillion won) in 2023.
[0004] Meanwhile, while the webtoon market is growing, it remains stuck in a content-driven growth phase based on the creativity of individual webtoon artists, and it is true that there is a lack of consideration for improving the work environment and enhancing work efficiency through systematization of the entire webtoon production process.
[0005] Of course, some large domestic companies are trying to systematize webtoon production through platform development, but this is limited to the role of a platform for digital comics serialization services, so it only considers the position of the users who receive serialization services, and it is difficult to see it as considering the position of the authors, who can actually help improve the working environment and work efficiency of webtoon artists, and ultimately improve the quality of digital comics.
[0006] Accordingly, considering the nature of webtoon production, where multiple authors collaborate to produce results, it is requested that measures be sought to enable collaborators to check webtoon works together in real time and to modify / edit or supplement / improve webtoon works through easy and simple communication, thereby improving the work efficiency of webtoon authors and thus the quality of the webtoon industry as a whole.
[0007] (Patent Document 1) 1. Korean Patent No. 10-2224527 (Published on April 7, 2021, Webtoon Providing Platform Device and Method)
[0008] (Patent Document 2) 2. Korean Patent No. 10-2316473 (Announced on October 21, 2021, Participatory Translation Device for Comics and Participatory Translation Method Using the Same)
[0009] The present invention has been devised to solve the above problems, and the purpose of the present invention is to provide an image work device and method through image sharing-based communication, which allows collaborators to modify / edit or supplement / improve webtoon works through easy and simple communication while checking the webtoon works together in real time, and a collaboration system through image sharing-based communication.
[0010] The image work method through image sharing-based communication of the present invention for achieving the above purpose comprises the steps of: providing a shared image to a first terminal that executes an operation related to collaboration on a shared image or a second terminal connected to the first terminal via a network by using a matching relationship between a plurality of work commands and keywords corresponding to each of the work commands; displaying a first message input through the first terminal; and, if the first message corresponds to at least one keyword among the plurality of keywords, executing a work command matching the keyword.
[0011] The method may include the step of providing a shared image including displaying the shared image on a screen of the first terminal or the second terminal.
[0012] In the present invention, the step of executing at least one task command matching a keyword may include the step of activating the keyword in a selectable state and displaying a shortcut item on the screen; and the step of executing a task command matching the selected keyword when the keyword is selected.
[0013] The step of displaying the first message input through the first terminal may include displaying the first message at the selected specific point when a specific point on the shared image is selected and the first message is input through the first terminal.
[0014] The first message corresponding to at least one keyword among the plurality of keywords may mean that the first message includes one keyword among the plurality of keywords. Prior to the step of displaying the shortcut item, the step of highlighting the keyword included in the first message may further be included.
[0015] In the present invention, the shared image is a webtoon image, and the work commands are commands used when working on the webtoon image, and may include at least one of execution of a shared image work program, color adjustment of a shared image being worked on in the shared image work program, brightness adjustment, saturation adjustment, transparency adjustment, object insertion, object size change, and object position change.
[0016] The step of executing a work command matching a keyword may include, when there are multiple work commands matching the keyword, selecting one work command from among the multiple work commands by considering the properties of the selected specific point, and executing the selected work command.
[0017] In the present invention, selecting one of the plurality of work commands by considering the properties of a specific point may include a step of selecting one of the plurality of work commands by considering the location of the specific point where the first message is displayed or the meaning of the keyword.
[0018] Selecting one of the plurality of work commands by considering the properties of a specific point may be selecting one of the plurality of work commands by further considering the shared image displayed on the screen and the location of the specific point, or the shared image displayed on the screen and the meaning of the keyword.
[0019] In the present invention, when a second message is input as a reply to a first message, the second message may be displayed together with the first message in a form that is related to the first message; when it is determined that another one of the plurality of keywords is included in the second message, the step of activating the other keyword in a selectable state to display a shortcut item for a task command matching the other one of the keywords; and when the other one of the keywords is selected, the step of additionally executing a task command matching the other one of the keywords.
[0020] The step of highlighting one keyword may be further included before activating another keyword to be selectable.
[0021] The step of additionally executing a work command may include a step of executing a work command related to a previously executed work command among a plurality of work commands matching the keyword.
[0022] In order to achieve the above another object, the image work device through image sharing-based communication of the present invention includes a display unit for displaying a shared image on a screen; a storage unit for storing a plurality of work commands and keywords matching each of the work commands; an input unit for receiving a user's operation; and a control unit for displaying a first message input through the input unit on the screen, determining whether the first message corresponds to at least one keyword among the plurality of keywords, and executing a work command matching the at least one keyword.
[0023] The control unit may execute a task command matching at least one keyword by activating the keyword in a selectable state, displaying a shortcut item on the screen, and executing a task command matching the selected keyword when the keyword is selected through an operation of the user.
[0024] When a specific point on the shared image is selected and a first message is input through the input unit, the control unit can display the first message at the selected specific point.
[0025] The first message may correspond to at least one keyword among the plurality of keywords, which may be because the first message includes one keyword among the plurality of keywords. Displaying a shortcut item may highlight and display the keyword included in the first message.
[0026] The control unit may select one of the plurality of work commands by considering the location of the specific point where the first message is displayed, the meaning of the keyword, the location of the specific point and the shared image displayed on the screen, or the meaning of the keyword and the shared image displayed on the screen.
[0027] The control unit, when a second message is input as a reply to the first message, displays the second message together with the first message in a form that is related to the first message; when it is determined that the second message includes another one of the plurality of keywords, activates the other keyword in a selectable state to display a shortcut item for a task command matching the other one of the keywords; and when the other one of the keywords is selected, the task command matching the other one of the keywords can be additionally executed.
[0028] Prior to activating the other keyword in a selectable state, the control unit may highlight the other keyword included in the above.
[0029] Additional execution of the above work command includes executing a work command related to a previously executed work command among a plurality of work commands matching the above keyword.
[0030] In order to achieve another object described above, the collaborative system through image sharing-based communication of the present invention comprises: a first terminal for displaying an image; a second terminal for sharing the image with the first terminal and displaying the image; and a server for causing a message to be displayed on the image of the first terminal and the image of the second terminal at a point selected by either of the first terminal and the second terminal and a message input thereon at the point.
[0031] In addition, if at least one of the first terminal and the second terminal determines that the message includes one of the plurality of keywords that are mutually matched with the plurality of work commands, the keyword is highlighted, the keyword is activated in a selectable state so that it becomes a shortcut item for the work command matched with the keyword, and when the keyword is selected, the work command can be executed.
[0032] In order to achieve the above object, according to one embodiment of the present invention, a method for working with images through image sharing-based communication includes: a step of matching a plurality of keywords with a plurality of work commands; a step of displaying a shared image on a screen; a step of displaying a first message at a specific point on the image when a specific point is selected and a first message is input; a step of highlighting a keyword when it is determined that one of the plurality of keywords is included in the first message; a step of activating the keyword in a selectable state so that it becomes a shortcut item for a work command matched to the keyword; and a step of executing the work command when the keyword is selected.
[0033] And, the matching step may match one keyword to multiple work commands, and the step of executing the work commands may execute a work command corresponding to an attribute of the specific point among the multiple work commands matched to the keyword.
[0034] In addition, the image operation method through image sharing-based communication according to the present embodiment may further include the steps of: when a second message is input as a reply to the first message, displaying the second message together with the first message in a form that is related to the first message; when it is determined that another one of the plurality of keywords is included in the second message, highlighting the other keyword; activating the other keyword in a selectable state so that it becomes a shortcut item for a task command matched to the other keyword; and when the other keyword is selected, additionally executing a task command matched to the other keyword.
[0035] And, the step of additionally executing the above work command may execute a work command related to a work command that has already been executed among a plurality of work commands matching the above keyword.
[0036] Meanwhile, an image work device through image sharing-based communication according to an embodiment of the present invention for achieving the above object includes: a display unit for displaying a shared image on a screen; a storage unit for storing a plurality of keywords and a plurality of work commands so as to be matched with each other; an input unit for receiving a user's operation; and a control unit for controlling the display unit to display the first message at the specific point when a specific point on the image is selected and a first message is input through the input unit, and for highlighting the keyword and activating the keyword in a selectable state so that it becomes a shortcut item for a work command matching the keyword, and for executing the work command when the keyword is selected.
[0037] In addition, the storage unit can store a keyword by matching it to a plurality of work commands, and the control unit can cause a work command corresponding to an attribute of the specific point among the plurality of work commands matched to the keyword to be executed.
[0038] In addition, the control unit may cause, when a second message is input as a reply to the first message through the input unit, the second message to be displayed together with the first message in a form that is related to the first message, and when it is determined that another one of the plurality of keywords is included in the second message, cause the other keyword to also be highlighted, cause the other keyword to be activated in a selectable state so that it becomes a shortcut item for a work command matched to the other keyword, and when the other keyword is selected, cause a work command matched to the other keyword to be additionally executed, but may cause a work command related to a work command that has already been executed among the plurality of work commands matched to the keyword to be additionally executed.
[0039] By enabling collaborators to communicate while sharing images in real time, compared to communicating through phone calls or separate messengers unrelated to webtoon production, it becomes easier, simpler, more accurate, and faster to specify the modifications / edits requested by each other, and to supplement / improve the images in real time.
[0040] Additionally, since communication for webtoon production collaboration and webtoon collaboration work are not separated, but can be directly linked to collaborative work within communication, continuity of work can be ensured, improving the work efficiency of collaborators and enabling rapid completion of collaborative results.
[0041] Furthermore, even in situations where immediate modification / editing is difficult, by revisiting the history of communication based on images, you can check what comments were made on what part later and reflect them when modifying / editing without having to record a separate modification request.
[0042] In addition, since the history is divided and recorded for each part of the image that needs to be modified / edited, even in situations where multiple collaborators exchange various comments on various parts of the image, it is possible to clearly identify which part of the image the comment should be reflected in.
[0043] FIG. 1 is a diagram illustrating an integrated collaboration system for image sharing-based communication according to one embodiment of the present invention.
[0044] FIG. 2 is a block diagram illustrating the configuration of an image working device through image sharing-based communication according to one embodiment of the present invention.
[0045] FIG. 3 is a flowchart illustrating an image working method through image sharing-based communication according to one embodiment of the present invention.
[0046] FIG. 4 is a flowchart for explaining an image working method when a reply message is input as an image working method through image sharing-based communication according to one embodiment of the present invention.
[0047] Figure 5 is a drawing provided to explain an example of the execution process of a work command according to keyword selection.
[0048] Figure 6 is a drawing provided to explain another example of the execution process of a work command according to keyword selection.
[0049] Figure 7 is a diagram illustrating an example of providing message history through a shared image.
[0050] Figure 8 is a diagram illustrating another example of providing message history through a shared image.
[0051] The present invention will now be described in more detail with reference to the drawings. The embodiments presented below are provided as examples to ensure that the spirit of the present invention is fully conveyed to those skilled in the art. The present invention is not limited to the embodiments described below and may be embodied in other forms.
[0052] FIG. 1 is a diagram illustrating an integrated collaboration system for image sharing-based communication according to one embodiment of the present invention.
[0053] The collaborative system through image sharing-based communication according to the present embodiment may be one of the system modules built within a platform for providing convenience in collaborative webtoon production, and the modules within the platform may include, in addition to the collaborative module for providing convenience in collaborative webtoon production, a matching module for recruiting and matching writers for collaboration, a contract module for coordinating contract terms and drafting a contract online for contracting with matched writers, a publishing module including a work plan and content introduction, and a revenue distribution module for automatically distributing sales proceeds in the system.
[0054] For this purpose, a collaboration system through image sharing-based communication according to this embodiment is composed of a first terminal (100), a second terminal (200), and a server (300).
[0055] In this embodiment, the subject of collaboration is digital content, including webtoons, animations, computer graphics, real-life videos, synthetic videos, and music content, with no specific limitations. This embodiment primarily focuses on the creation, editing, or modification of webtoons.
[0056] Collaboration also refers to the joint work performed by multiple stakeholders involved in digital content. These stakeholders share messages about editing, creating, and modifying digital content through networked devices. These networked devices can be desktop computers, tablets, or mobile devices connected to the Internet.
[0057] The first terminal (100) and the second terminal (200) are terminals used by each writer who has gathered for collaboration, and can be implemented in various forms such as a mobile phone, tablet PC, desktop, or a terminal dedicated to webtoon production.
[0058] In this embodiment, the first terminal (100) is a device that receives a message or command from the first copyright holder. In addition, the object of collaboration can be displayed and played through the screen of the terminal. When the object of collaboration is a webtoon, some images of the webtoon can be displayed through the screen of the first terminal. In this embodiment, the “shared image” may be an initial image that is the object of collaboration, or an image obtained as an (intermediate) result of the collaboration. Multiple editing tasks may be performed on the “shared image,” and while the editing tasks are performed, the “shared image” may be updated and displayed on the screen of the first terminal or the second terminal. In this embodiment, the shared image may be displayed on the screens of both the first terminal and the second terminal, or may be displayed on the screens of only some terminals.
[0059] The server (300) may be constructed by a total platform operator as described above, or may be constructed by an operator who provides only collaborative system modules rather than all types of system modules, and may serve as a bridge for communication between the first terminal (100) and the second terminal (200) and may serve as a role of providing tools or programs required by the first terminal (100) and the second terminal (200) when creating webtoons.
[0060] That is, the first terminal (100) can communicate with the second terminal (200) through the server (300) and collaborate in the production of a webtoon.
[0061] According to another embodiment of the present invention, collaborative processes related to webtoon creation or editing may be performed by a processor of a first terminal, a processor of a second terminal, or a processor located on a server. Of course, operations related to receiving messages from each terminal and editing shared images through touch screen manipulation may be performed by a processor embedded in each terminal.
[0062] The process related to collaboration on shared images can be implemented in the form of software or an application running on a processor of a first or second terminal, or a server. Information about multiple work commands related to collaboration and keywords corresponding to each work command, particularly matching information between the work commands and keywords, is pre-stored in the memory of the first terminal, the second terminal, or the server. The author can input necessary information regarding the shared image in the form of a message through his or her terminal. Each terminal or server can determine whether words included in the message are related to previously stored keywords. For example, this determination can be made by considering the similarity between words in the input message and stored keywords. As another example, words related to the work commands contained in the input message can be extracted through semantic interpretation of the input message, and these words can be matched with previously stored keywords. For this purpose, it is preferable that a neural network for natural language semantic interpretation be implemented in the first terminal, the second terminal, or the server.
[0063] The first terminal receives a first message from a user performing a collaboration-related task, and the second terminal receives a second message from another user. The message may be in text format or in voice format. Additionally, the message may be specifically entered by the user through touch operation.
[0064] Editing and modifying operations on shared images can be performed via the processor of the first terminal, the processor of the second terminal, or the processor of the server. If the currently input message contains words that are identical or similar to previously stored keywords (keywords related to the task command), the processor performs a task corresponding to the keywords.
[0065] In this embodiment, the shared image may be displayed commonly on the screens of the first terminal and the second terminal, or may be displayed only on some of them, which may vary depending on the specifications and usage environment of the terminal.
[0066] The processor (which may be a processor of a first terminal, a second terminal, or a server) may, when a word included in an input message is similar to a previously stored keyword, display the word by highlighting the word or performing visual processing. In addition, the processor may further display shortcut items for previously stored keywords corresponding to specific words in the input message on the screen. When a shortcut item is selected through a user's touch operation or touch input, the selected keyword and a task command already matched with the keyword may be executed.
[0067] Messages entered by users can be displayed on the terminal screen by overlapping the shared image. In particular, messages repeatedly entered by multiple users can be displayed in chronological order.
[0068] Specifically, the user of the first terminal can select a specific point in the shared image through touch operation and enter a message related to the selected point. The specific point refers to an area of the shared image that the user wishes to edit.
[0069] In embodiments of the present invention, the task command matching a pre-stored keyword may be singular or plural. If there are multiple task commands for the selected keyword, the processor may select one task command by considering the attributes of the specific point where the message was input. Here, the attribute of the specific point may refer to a specific location selected during the message input process. For example, in the case of a webtoon image of a human character, the specific point may be a specific part, such as a hair or the palm of a hand.
[0070] Additionally, the processor may select one of the plurality of work commands and execute the selected work command by considering the location of the specific point where the first message is displayed and the meaning of the matched keyword.
[0071] Additionally, keywords associated with a single input message may be singular or plural. When multiple keywords are involved, the processor may perform task commands based on the order of the words contained in the message. Furthermore, through semantic interpretation of the message, the processor may first determine the order of tasks required by the input message and then execute the tasks according to the determined order.
[0072] When a second message is input via a second terminal as a reply to the first message, the processor (whether of the first terminal, the second terminal, or the server) may display the second message along with the first message in a form that is related to the first message. For example, the messages may be displayed in chronological order.
[0073] If the processor determines that the second message includes another one of the plurality of keywords, the processor may activate the other keyword (a keyword for an additional work command) in a selectable state and display a shortcut item for a work command matching the other keyword on the terminal screen. If the other keyword is selected, the processor additionally executes the work command matching the other keyword.
[0074] FIG. 2 is a block diagram illustrating the configuration of an image working device through image sharing-based communication according to one embodiment of the present invention.
[0075] The image work device through image sharing-based communication according to the present embodiment can be implemented as at least one of the first terminal (100) or the second terminal (200), and can be one of the aforementioned mobile phones, tablet PCs, desktops, and dedicated webtoon production terminals owned by webtoon collaboration workers.
[0076] An image work device through image sharing-based communication according to this embodiment may be composed of an input unit (110), a display unit (120), a control unit (130), and a storage unit (140).
[0077] The input unit (110) is provided for the purpose of receiving various commands from collaborative workers. This input unit (110) may exist in various forms, such as a mouse, keyboard, touch screen, or touch pen.
[0078] The display unit (120) serves to display images through a screen. In particular, the display unit (120) can enable the first terminal (100) to display the same image as the second terminal (200) through the screen. The identical image shared and displayed in this way may be at least a portion of a page of a webtoon work jointly created or at least a portion of a character / background / object used in the webtoon work.
[0079] Meanwhile, the control unit (130) changes the content displayed on the display unit (120) based on the command of the collaborative worker received through the input unit (110).
[0080] First, the control unit (130) functions to display an image through the display unit (120) when a command to share a page of a webtoon image being worked on collaboratively is input from one of the collaborative workers through the input unit (110).
[0081] Here, the sharing command may be input from the first terminal (100) or the second terminal (200), and regardless of which terminal the sharing command is input through, the corresponding terminal and the counterpart terminal display a collaboration image through the display unit (120) so that the shared image is displayed on each screen.
[0082] In addition, when a command is input to select a specific point among the webtoon images being worked on collaboratively from one of the collaborating workers through the input unit (110) and input a message at that point, the control unit (130) controls the display unit (120) so that a message pointing to that point is generated and displayed. This also ensures that, regardless of which terminal is used to select a point and input a message, the control command of each control unit (130) is executed so that the message is generated and displayed at that point equally on both the terminal in question and the counterpart terminal, and this is made possible by the control command being transmitted to the server (300).
[0083] That is, when a specific point is selected in the first terminal (100) and a message is entered at that point, coordinate information and message content information for that specific point are transmitted to the server (300), and the server (300) transmits this to the second terminal (200) used by the collaborative worker, causing the control unit of the second terminal (200) to display the message at that point, and vice versa.
[0084] Here, the fact that a message pointing to that point is generated and displayed can be understood as having a shape in which the tail of the speech bubble containing the message points to that point.
[0085] In addition, here, a specific point will correspond to an area where a collaborator wants to comment on a webtoon work image, and a message input by selecting a specific point will be a comment message about at least one of the shape, appearance, color, size, and position of an object drawn at the specific point. The specific point can be selected through an input unit (110) having properties such as a mouse, a touch pen, or a touchpad, and a comment can be input through an input unit (110) having properties such as a keyboard or a touchpad with a key layout displayed.
[0086] Meanwhile, when a command to input a reply message for a message previously input through the input unit (110) from one of the collaborative workers is input, the control unit (130) controls the display unit (120) to generate and display a reply message in a form that is related to the previously input message. Here, the form that is related to the previously input message may mean a form in which the tail of the speech bubble containing the reply message points to the speech bubble containing the previously input message. In this case, regardless of which terminal the reply message is input through, the control command of each control unit (130) is executed so that a reply message pointing to the existing message is generated and displayed equally on both the terminal in question and the counterpart terminal, and this is also made possible by the control command being transmitted to the server (300).
[0087] Here, it has been explained that the reply message is generated in a form that points to the speech bubble containing the previously entered message through the tail of the speech bubble containing the reply message. However, this is merely an example for the convenience of explanation, and it can be implemented in any form as long as it exists in a form that has a relevance to the existing message, even if it does not necessarily point to the speech bubble containing the existing message. For example, if it is placed below the existing message, it can be understood as a reply to the existing speech bubble even without a pointing direction or location, and in other cases, there can be various forms of relevance.
[0088] Moreover, if the initial speech bubble containing the input message can indicate a relevance to a point specified by a collaborator, it can be implemented in a form that has other relevance even if the speech bubble's tail does not necessarily point to that point.
[0089] Meanwhile, the storage unit (140) serves to store multiple keywords and multiple work commands in a mutually matched state, and for this purpose, it may have data in the form of a table that organizes the matching relationship between keywords and work commands.
[0090] Here, the work command is a command used when working on a webtoon image, and may include executing an image work program, adjusting the color of an image being worked on in the image work program, adjusting brightness, adjusting saturation, adjusting transparency, inserting an object, changing the size of an object, changing the position of an object, etc., or the like of an image shared between the first terminal (100) and the second terminal (200).
[0091] Additionally, the keyword may be a word that simply abbreviates or organizes these commands, and the keyword may be preset by the server (300) and commonly used, or may be individually set by the first terminal (100) or the second terminal (200).
[0092] That is, the storage unit (140) stores a matching relationship between keywords and work commands, such as ‘the keyword ‘XXX’ is a work command to change the color of an image.’
[0093] If a preset keyword is included in the input message, the control unit (130) highlights the keyword to distinguish it from non-keyword characters, links the keyword to a work command so that the work command matching the keyword can be executed immediately, and makes the keyword selectable so that when selected, the work command can be executed immediately.
[0094] According to another embodiment of the present invention, the storage unit (140) of the present embodiment may be implemented to store a number of work commands and keywords matching each of the work commands, and further store matching relationships between the work commands and the keywords.
[0095] The control unit (130) can display a first message input through the input unit on the screen, determine whether the first message corresponds to at least one keyword among the plurality of keywords, and execute a work command matching the at least one keyword. The control unit exists in each of the first terminal, the second terminal, or the server, and can be implemented in various forms such as a processor, a microcontroller, or a central processing unit.
[0096] Below, the process of working with images through image sharing-based communication will be described in more detail with reference to Fig. 3.
[0097] FIG. 3 is a flowchart illustrating an image working method through image sharing-based communication according to one embodiment of the present invention.
[0098] In the following, for a simpler and clearer explanation, it is assumed that the server (300) is excluded from the communication process between the first terminal (100) and the second terminal (200). In reality, it can be understood that the server (300) mediates or participates in the communication between the first terminal (100) and the second terminal (200).
[0099] First, the first terminal (100) and the second terminal (200) match keywords and work commands and store them in the storage unit (140). This matching can be done according to the settings made by the server (300) as described above, or can be self-configured by the user of each terminal. That is, if self-configuration is enabled, different work commands can be issued to each terminal for the same keyword.
[0100] Thereafter, when the first terminal (100) receives a command to share an image with the second terminal (200) through the input unit (110) (S415), the first terminal (100) transmits the image to the second terminal (200) (S420), and the first terminal (100) and the second terminal (200) each display the corresponding shared image on the screen (S425, S430).
[0101] At this time, if a specific point is first selected in the second terminal (200) and a first message for that point is input (S435), the coordinate information for that point and the content information for the input first message are transmitted to the first terminal (100) (S440).
[0102] The first terminal (100) checks whether the first message contains a keyword based on the received first message information (S445), and links the work command to the keyword based on the received point information and the first message information so that the first message is generated and displayed (S455).
[0103] Likewise, the second terminal (200) sharing the image checks whether the first message contains a keyword based on the first message information (S450), and links the work command to the keyword based on the branch information and the first message information so that the first message is generated and displayed (S460).
[0104] Since the first specific point was selected and the first message was entered by the second terminal (200), the first message may be generated and displayed first by the second terminal (200), and thus the order of steps S445, S455, S450, and S460 is irrelevant.
[0105] At this time, the first terminal (100) and the second terminal (200) may have information agreed upon in advance between each other regarding the location / shape at which the first message is displayed or the form in which it is related to a specific point, so that the message can be generated and displayed based on the rules agreed upon in advance between each other.
[0106] In addition, when the first terminal (100) and the second terminal (200) share coordinate information for a specific point and content information of the input first message, the image information for the message generated first by one of the terminals can also be shared, thereby making it possible to make the appearance of the messages displayed on both screens identical.
[0107] In addition, it is possible to implement a system in which the shape and size of messages can be changed according to the settings of the user possessing the corresponding terminal to reflect each individual's preferences, so that the shape and size of the messages do not have to be identical. Accordingly, the messages exchanged between the first terminal (100) and the second terminal (200) can be processed in various ways, such as being processed as speech bubbles or being included entirely within a single speech bubble.
[0108] Thereafter, when a keyword is selected from either the first terminal (100) or the second terminal (200), the work command related to the point is executed only on the terminal that selected the keyword, or when the keyword is selected from only one terminal, the work command related to the point is executed on both terminals (S465, S470).
[0109] Meanwhile, a processing method for a case where a second message is entered as a response to a first message before or after a work command is executed and the second message also contains a keyword will be described with reference to FIG. 4.
[0110] FIG. 4 is a flowchart for explaining an image working method when a reply message is input as an image working method through image sharing-based communication according to one embodiment of the present invention.
[0111] For simplicity of explanation, it is assumed that the shared image and the first message for collaboration described in FIG. 3 are already displayed identically on the first terminal (100) and the second terminal (200) (S425, S430, S455, S460).
[0112] Thereafter, when a second message is input as a response to the first message from the first terminal (100) (S505), the first terminal (100) transmits content information about the second message to the second terminal (200) (S510).
[0113] The second terminal (200) checks whether the second message contains a keyword based on the received second message information (S520), and links a work command to the keyword based on the second message information so that the second message is generated and displayed (S530).
[0114] Likewise, the first terminal (100) sharing the image checks whether the second message contains a keyword based on the second message information (S515), and links the work command to the keyword based on the second message information so that the second message is generated and displayed (S525).
[0115] Since the second message was entered by the first terminal (100), the second message may be generated and displayed first in the first terminal (100), and thus the order of steps S515, S525, S520, and S530 is irrelevant.
[0116] At this time, the first terminal (100) and the second terminal (200) may have information agreed upon in advance between each other regarding the location / shape in which the second message, which is a reply message, is displayed or the form in which it has a relationship with the first message, which is the initial message, so that the message can be generated and displayed based on the rules agreed upon in advance between each other.
[0117] In addition, when the first terminal (100) and the second terminal (200) share information about a reply message to the first message and information about the content of the second message that was input, the image information about the message that one of them created first can also be shared, so that the appearance of the messages displayed on both screens can be made identical.
[0118] In addition, it is possible to implement a system in which the shape and size of messages can be changed according to the settings of the user possessing the corresponding terminal to reflect each individual's preferences, so that the shape and size of the messages do not have to be identical. Accordingly, the messages exchanged between the first terminal (100) and the second terminal (200) can be processed in various ways, such as being processed as speech bubbles or being included entirely within a single speech bubble.
[0119] Thereafter, when a keyword is selected in either the first terminal (100) or the second terminal (200), a work command related to a work command already being executed is additionally executed only in the terminal where the keyword is selected, or when a keyword is selected in either terminal, a work command related to a work command already being executed in both terminals is additionally executed (S535, S540).
[0120] Here, a task command related to a task command already being executed refers to a task command that is interrelated or continuous. For example, if the task command being initially executed means "running an editing program," then task commands related to or continuous with "running an editing program" could include adjusting the color, brightness, saturation, transparency, inserting objects, resizing objects, or changing the position of objects in an image being worked on or shared while the editing program is running.
[0121] Meanwhile, in the above, it is assumed that two collaborating workers select a specific point on an image that needs to be modified or discussed and exchange comments related to that point in the form of replies. However, this is merely an example for the convenience of explanation, and the technical idea of the present invention can be applied as is even when three or more collaborating workers exchange comments related to a specific point.
[0122] Likewise, the technical idea of the present invention can be applied to cases where multiple specific points exist, in which case, multiple message sets composed of multiple messages will exist. Even if multiple message sets composed of multiple messages exist, when a keyword existing in one message set is selected, a work command corresponding to the property of a specific point related to the message set will be executed, and when a keyword existing in another message set is selected, a work command corresponding to the property of a point related to the other message set will be executed.
[0123] For example, if the first set of messages is about the facial color of the main character among the shared images, the keyword 'color' included in the first set of messages is used to execute a work command related to editing the facial color of the main character, whereas if the second set of messages is about the background color among the shared images, the keyword 'color' included in the second set of messages is used to execute a work command related to editing the background color, not the facial color of the main character, even though they are the same keywords.
[0124] Figure 5 is a drawing provided to explain an example of the execution process of a work command according to keyword selection.
[0125] As described above, when a webtoon image is shared and a specific point is selected from a collaborator named A and a first message (M1) is entered, the first message (M1) is displayed using the tail of a speech bubble, etc. to indicate its relevance to the specific point.
[0126] At this time, if there is a preset keyword in the first message (M1), the keyword in the first message (M1) is highlighted and displayed, and the keyword in the first message (M1) is displayed in a state where a linked work command can be executed by clicking on it.
[0127] Afterwards, a first message (M1) is selected from a collaborator named B to confirm that it is a reply message to the first message (M1), and when a second message (M2) is input, the second message (M2) is displayed in a state indicating its relevance to the first message (M1) using the tail of a speech bubble, etc.
[0128] At this time, if there is a preset keyword in the second message (M2), the keyword in the second message (M2) is highlighted and displayed, and the keyword in the second message (M2) is displayed in a state where a linked work command can be executed by clicking on it.
[0129] If the keyword present in the first message (M1) is the keyword 'line', and the keyword 'line' matches the work command 'execution of the editing program', and a specific object exists at a point where the first message (M1) indicates a relevance on the shared image, then when collaborator A or collaborator B selects the keyword 'line', 'execution of the editing program' matching the keyword 'line' can be executed, and at the same time, after the program is executed, the specific object present at the point where the first message (M1) indicates a relevance can be selected (S605).
[0130] In addition, if the keyword existing in the second message (M2) is the keyword 'thickness', and the keyword 'thickness' matches the work command of opening the 'thickness UP / DOWN adjustment window', and the second message (M2) shows a relationship with the first message (M1) on the shared image, when collaborator A or collaborator B selects the keyword 'thickness', the 'thickness UP / DOWN adjustment window' matching the keyword 'thickness' can be opened (S610).
[0131] Afterwards, when collaborator A or collaborator B adjusts the thickness of the selected object, the 'line', by adjusting the open 'thickness UP / DOWN adjustment window', the thickness of the 'line' is changed on both the shared screen of collaborator A and the shared screen of collaborator B (S610).
[0132] In this way, communication for webtoon production collaboration and webtoon collaboration work are not separated, but can be directly linked to collaborative work within communication, ensuring continuity of work, improving the work efficiency of collaborators, and enabling the rapid completion of collaborative results.
[0133] Figure 6 is a drawing provided to explain another example of the execution process of a work command according to keyword selection.
[0134] As described above, when a webtoon image is shared and a specific point is selected from a collaborator named A and a first message (M1) is entered, the first message (M1) is displayed using the tail of a speech bubble, etc. to indicate its relevance to the specific point.
[0135] Afterwards, a first message (M1) is selected from a collaborator named B to confirm that it is a reply message to the first message (M1), and when a second message (M2) is input, the second message (M2) is displayed in a state indicating its relevance to the first message (M1) using the tail of a speech bubble, etc.
[0136] At this time, if there is a preset keyword in the second message (M2), the keyword in the second message (M2) is highlighted and displayed, and the keyword in the second message (M2) is displayed in a state where a linked work command can be executed by clicking on it.
[0137] Unlike the embodiment described in Fig. 5, even if the keyword does not exist in the first message (M1), which is the initial message, if a message generated after the first message (M1) contains a keyword, a work command corresponding to the keyword can be executed.
[0138] Additionally, unlike the embodiment described in FIG. 5, keywords and task commands may be matched one-to-many so that one keyword can batch process various complex tasks such as executing an editing program, selecting an object, and opening a color palette.
[0139] That is, if the keyword existing in the second message (M2) is the keyword 'color', and the keyword and the task command are matched one-to-many so that the keyword 'color' can execute multiple tasks such as 'run editor program', 'select object', and 'open color palette' in batches, then when collaborator A or collaborator B selects the keyword 'color', the task commands 'run editor program', 'select object', and 'open color palette' that match the keyword 'color' can be executed (S705).
[0140] Afterwards, when collaborator A or collaborator B selects a color from the open color palette, the color of the selected object is changed on both the shared screen of collaborator A and the shared screen of collaborator B (S710).
[0141] This also ensures that communication for webtoon production collaboration and webtoon collaboration work are not separated, but rather can be directly linked to collaborative work within communication, thereby ensuring continuity of work, improving the work efficiency of collaborators, and enabling the rapid completion of collaborative results.
[0142] Figure 7 is a diagram illustrating an example of providing message history through a shared image.
[0143] In the illustrated example, it is assumed that each message within the shared image is expressed in its own speech bubble, resulting in four different speech bubble sets. In reality, messages exchanged between each other are displayed within each speech bubble, but for the sake of simplicity of explanation, the content of the messages is omitted in the drawing and only information about the subject who sent the message is displayed.
[0144] As illustrated in the set of speech bubbles (S1) at the bottom left, when a collaborator A selects a specific point and inputs a message, a speech bubble containing the message is generated, and the speech bubble is generated with a tail pointing to the specific point. Then, when a collaborator B inputs a reply message to the message, a speech bubble containing the reply message is generated with a tail pointing to the original speech bubble from the bottom of the original speech bubble.
[0145] In this way, it becomes possible to identify which speech balloons are related to which initial speech balloons through the tails of the second and subsequent speech balloons, and it becomes possible to provide an intuitive way to identify which point of work the speech balloon set (S1) is a comment on through the tails of the initial speech balloons.
[0146] Here, if the speech bubble set (S1) contains a keyword, the tail of the first speech bubble can be used to distinguish whether the task command matching the keyword is a task command for an object located at a certain point, and the task command performs a task that affects only the objects related to the speech bubble set (S1).
[0147] The set of speech bubbles (S2) in the top center, unlike the set of speech bubbles (S1), signifies three or more collaborators discussing a single task. This approach is certainly possible when three or more people are involved, and by clearly organizing and expressing opinions in collaborative projects like this, it promotes faster work and higher quality results.
[0148] Here too, if the speech bubble set (S2) contains a keyword, the tail of the first speech bubble can be used to distinguish which object the action command matching the keyword is for, and the action command will only affect the objects related to the speech bubble set (S2).
[0149] The speech bubble set (S3) on the right side is different from the speech bubble set (S1) in that it assumes that the other party first selects a specific point and inputs a message. In this case, a speech bubble containing the message is created, and the speech bubble is created with a tail pointing to the specific point.
[0150] For example, if A is a worker who draws a picture and B is a worker who reviews it, it would be common for A to share the results of his work, and for B to select a point, request a correction, and make a comment. However, conversely, A could also first ask for an opinion on that point. In this way, the speech bubble set (S3) is an example to explain that there is no restriction on who creates the initial speech bubble.
[0151] Here too, if the speech bubble set (S3) contains a keyword, the tail of the first speech bubble can be used to distinguish which object the action command matching the keyword is for, and the action command will only affect the objects related to the speech bubble set (S3).
[0152] The last set of speech bubbles in the lower right corner (S4) assumes a situation where no reply message has been sent yet, and also assumes a case where the shape that makes it relevant to a specific point becomes an arrow that comes off the speech bubble.
[0153] Here too, if the speech bubble set (S3) contains a keyword, the tail of the first speech bubble can be used to distinguish which object the action command matching the keyword is for, and the action command will only affect the objects related to the speech bubble set (S3).
[0154] Even in cases where there are various forms like this, it would be sufficiently transformable as long as it could only show the relationship with a specific point.
[0155] In this way, multiple sets of speech bubbles are created within a single image, and the speech bubbles within the set of speech bubbles correspond to comments related to the work at the point pointed to by the initial speech bubble. Therefore, even without performing a separate classification task for the various comments received regarding the work results, it is possible to identify the subject and history of each comment by region within the image.
[0156] Additionally, by matching keywords and work commands, communication for webtoon production collaboration and webtoon collaboration work are not separated, but can be directly linked to collaborative work within the communication, ensuring continuity of work, improving the work efficiency of collaborators, and enabling rapid completion of collaborative results.
[0157] Figure 8 is a diagram illustrating another example of providing message history through a shared image.
[0158] In the illustrated example, it is assumed that four different sets of speech bubbles are created within the shared image, with each message not being distinguished by a speech bubble for each message, but by a speech bubble for each set of messages. In reality, messages exchanged between each speech bubble are displayed within each speech bubble, but for the sake of simplicity of explanation, the contents of the messages are omitted in the drawing and only information about the subject who sent the message is displayed.
[0159] As shown in the speech bubble (B1) at the bottom left, when a collaborator A selects a specific point and inputs a message, a speech bubble (B1) containing the message is created, and the speech bubble (B1) is created with a tail pointing to the specific point. Thereafter, when a collaborator B inputs a reply message to the message, the reply message does not have a separate speech bubble, but is displayed within the existing speech bubble (B1) and is input below the initial message that was previously input, thereby establishing a message set with the existing message.
[0160] In this way, it is possible to provide an intuitive way to know which point of work the speech bubble (B1) containing the corresponding message set is a comment on through the tail of the speech bubble (B1).
[0161] The speech bubble (B2) at the top center, unlike the speech bubble (B1), signifies three or more collaborators discussing a single task. This approach is certainly possible when three or more people are involved, and by clearly organizing and expressing opinions in collaborative projects like this, it promotes faster work and higher quality results.
[0162] In this case, since there are too many comments from collaborators and the size of the speech bubble cannot be increased indefinitely, it can be implemented so that the message history can be understood through the scroll bar (S) on the right.
[0163] The speech bubble (B3) on the right side is different from the speech bubble (B1) in that it assumes that the other party first selects a specific point and enters a message. In this case, a speech bubble containing the message is also created, and the speech bubble is created with a tail pointing to the specific point.
[0164] For example, if A is a worker who draws a picture and B is a worker who reviews it, it would be common for A to share the results of his work, and for B to select a point, request corrections, and make comments. However, conversely, A could also first ask for opinions on that point. In this way, the speech bubble (B3) is an example to explain that there is no restriction on who initially creates the speech bubble.
[0165] The speech bubble at the bottom right (B4) assumes a situation where no reply message has been sent yet, and also assumes a case where the shape that makes it relevant to a specific point becomes an arrow that comes off the speech bubble.
[0166] In the above embodiment, it is possible to provide an intuitive way to know which point of work each speech bubble (B1, B2, B3, B4) is a comment on through the tail of each speech bubble containing a message set, as described in FIG. 7.
[0167] According to another embodiment of the present invention, a method for displaying a message history for image sharing-based communication may include the steps of: displaying a shared image on a screen; when a first point on the image is selected and a first message is input, displaying a first speech bubble including the first message at the first point; and when a second message is input as a reply to the first message, displaying the second message together with the first message within the first speech bubble.
[0168] Here, the step of displaying the first speech balloon may be implemented such that the tail of the first speech balloon points to the first point, and the step of displaying the second message may be implemented such that, if neither the first message nor the second message is displayed within the first speech balloon, the first speech balloon may be expanded to a preset allowable range so that the second message is displayed together with the first message.
[0169] If the first message and the second message are not both displayed even when the first speech bubble is expanded to a preset allowable range, a scroll bar may be implemented to display a portion of the first message and the second message within the preset allowable range and to allow the user to check the remaining portion of the first message and the second message around the first speech bubble.
[0170] In addition, the method may further include a step of selecting a second point different from the first point and, when a third message is input, displaying a second speech bubble containing the third message at the second point on the image; and a step of displaying the fourth message together with the third message within the second speech bubble when a fourth message is input as a reply to the third message.
[0171] In this embodiment, the first speech balloon and the second speech balloon are displayed together on the image, so that the user can respectively understand the message history regarding the first point and the message history regarding the second point.
[0172] In this way, multiple speech bubbles are created within a single image, a set of messages is included within the speech bubbles, and the messages that make up the set of messages correspond to comments related to the work at the point pointed to by the speech bubbles. Therefore, even without performing a separate classification task for the various comments received regarding the work results, it is possible to identify the subject and history of each comment by region within the image.
[0173] Additionally, by matching keywords and work commands, communication for webtoon production collaboration and webtoon collaboration work are not separated, but can be directly linked to collaborative work within the communication, ensuring continuity of work, improving the work efficiency of collaborators, and enabling rapid completion of collaborative results.
[0174] Although the preferred embodiments of the present invention have been illustrated and described above, the present invention is not limited to the specific embodiments described above, and various modifications may be made by those skilled in the art without departing from the spirit or scope of the present invention as claimed in the claims. Furthermore, such modifications should not be understood individually from the technical idea or prospect of the present invention.
[0175] [Explanation of symbols]
[0176] 100: Terminal 1 200: Terminal 2
[0177] 300: Server 110: Input
[0178] 120: Display section 130: Control section
[0179] 140: Storage
[0180] M1: First message M2: My message
[0181] S1, S2, S3, S4: Speech bubble sets 1,2,3,4
[0182] B1, B2, B3, B4: Speech bubbles 1,2,3,4
[0183] S: Scroll bar
Claims
1. A step of providing a shared image to a first terminal that performs an operation related to collaboration on a shared image or a second terminal connected to the first terminal via a network by using a matching relationship between a plurality of work commands and keywords corresponding to each of the work commands; A step of displaying a first message input through the first terminal; and An image processing method through image sharing-based communication, comprising the step of executing a task command matching the keyword when the first message corresponds to at least one keyword among the plurality of keywords.
2. In the first paragraph, the step of providing the shared image includes displaying the shared image on the screen of the first terminal or the second terminal, The step of executing at least one work command matching the above keyword is: A step of activating the above keyword in a selectable state and displaying a shortcut item on the screen; and A method for working with images through image sharing-based communication, comprising the step of executing a work command matching the selected keyword when the keyword is selected.
3. In the second paragraph, the step of displaying the first message input through the first terminal is: A method for working with images through image sharing-based communication, comprising: selecting a specific point on the shared image, and displaying the first message at the selected specific point when a first message is input through the first terminal.
4. In paragraph 3, A method for working with images through image sharing-based communication, characterized in that the first message corresponds to at least one keyword among the plurality of keywords, wherein the first message includes one keyword among the plurality of keywords, and further includes a step of highlighting the keyword included in the first message prior to the step of displaying the shortcut item.
5. In the first paragraph, the shared image is an editable image, The above work commands are commands used in the image editing work, and include at least one of execution of a shared image work program, color adjustment, brightness adjustment, saturation adjustment, transparency adjustment, object insertion, object size change, and object position change of the shared image or the shared image being worked on in the shared image work program, and an image work method through communication based on image sharing.
6. In the third paragraph, the step of executing a work command matching the keyword is: If there are multiple work commands matching the above keywords, An image processing method through image sharing-based communication, comprising the steps of selecting one of the plurality of work commands by considering the properties of the selected specific point, and executing the selected work command.
7. In paragraph 6, selecting one of the plurality of work commands by considering the properties of the specific point is as follows: An image processing method through image sharing-based communication, characterized in that one of the plurality of work commands is selected by considering the location of a specific point where the first message is displayed or the meaning of the keyword.
8. In paragraph 6, selecting one of the plurality of work commands by considering the properties of the specific point is as follows: The shared image displayed on the screen above and the location of the specific point above, or A method for working with images through image sharing-based communication, characterized in that one of the plurality of work commands is selected by further considering the shared image displayed on the screen and the meaning of the keyword.
9. In paragraph 2, A step of displaying, when a second message is entered as a reply to the first message, the second message together with the first message in a form that is related to the first message; If it is determined that the second message includes another one of the plurality of keywords, a step of activating the other keyword in a selectable state to display a shortcut item for a work command matching the other keyword; and A method for working with images through communication based on image sharing, characterized in that it further includes a step of additionally executing a work command matching the other keyword when the other keyword is selected.
10. In paragraph 9, Before activating the other keyword above as selectable, Further comprising the step of highlighting another keyword included above, The steps to additionally execute the above work command are: An image processing method through image sharing-based communication, characterized in that a work command related to a previously executed work command is executed among a plurality of work commands matching the above keyword.
11. A display unit that displays the shared image on the screen; A storage unit that stores a plurality of work commands and keywords matching each of the work commands; An input section for receiving user input; and The first message entered through the above input section is displayed on the above screen, An image processing device through image sharing-based communication, comprising a control unit that determines whether the first message corresponds to at least one keyword among the plurality of keywords and executes a work command matching the at least one keyword.
12. In paragraph 11, An image work device through communication based on image sharing, characterized in that the control unit executes a work command matching at least one keyword by activating the keyword in a selectable state, displaying a shortcut item on the screen, and executing a work command matching the selected keyword when the keyword is selected through an operation of the user. An image work device through image sharing-based communication, characterized in that the control unit displays the first message on the screen by, when a specific point on the shared image is selected and the first message is input through the input unit, displaying the first message at the selected specific point.
13. In paragraph 12, An image work device through image sharing-based communication, characterized in that the first message corresponds to at least one keyword among the plurality of keywords, wherein the first message includes one keyword among the plurality of keywords, and the displaying of the shortcut item highlights and displays the keyword included in the first message.
14. In paragraph 11, the shared image is an editable image, The above work commands are commands used in the image editing work, and include at least one of execution of a shared image work program, color adjustment, brightness adjustment, saturation adjustment, transparency adjustment, object insertion, object size change, and object position change of the shared image or the shared image being worked on in the shared image work program, and an image work device through communication based on image sharing.
15. A first terminal displaying an image; A second terminal that displays the image by sharing the image with the first terminal; and A server that, when a specific point on the image is selected by one of the first terminal and the second terminal and a message is input, causes the message to be displayed on the image of the first terminal and the image of the second terminal at the point, respectively; At least one of the first terminal and the second terminal, A collaboration system through image sharing-based communication, characterized in that when it is determined that the message includes one of the plurality of keywords that are mutually matched with the plurality of work commands, the keyword is highlighted, the keyword is activated in a selectable state to become a shortcut item for the work command matched to the keyword, and when the keyword is selected, the work command is executed.
Citation Information
Patent Citations
Display apparatus
KR1020220056107A
Method of providing instant investment means, and computer program recorded on record-medium for executing method thereof
KR102442335B1
Gantry crane assembly for boom post rotating with boompost automatic up and down unit
KR102484730B1
Method and apparatus for viewpoint collaboration
US20050060656A1
KR20220097619A
