Content providing method and system
Patent Information
- Application Number
- JP2024145413
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-08-28
- Filing Date
- 2024-08-27
- Publication Date
- 2025-03-12
- Estimated Expiration
- 2044-08-27
AI Technical Summary
【0013】 本発明によるコンテンツ提供方法及びシステムは、ユーザ情報に基づいて画像を編集して提供することにより、コンテンツを構成する画像にユーザ情報を挿入することができる。
Smart Images

Figure 2025033005000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a method and system for providing content into which user information is inserted for copyright protection of the content. [Background technology]
[0002] As technology advances, the use of digital devices is increasing. In particular, electronic devices (e.g., smartphones, tablet PCs, etc.) are equipped with a variety of functions, including not only communication functions such as phone calls and text messages, but also Internet surfing, listening to music, and watching video content.
[0003] As electronic devices have become more popular, content consumption has increased dramatically. A representative example of such content is content made up of visualized images (e.g., webtoon content).
[0004] As the consumption of such content increases, various methods for protecting the copyright of the content are being actively researched. As a representative example, a method for protecting the copyright of the content by providing the content using a digital watermark and a fingerprint is known.
[0005] Meanwhile, recently, there have been many cases of content copyright infringement through illegally capturing or filming content, editing it into videos or images, and distributing them.
[0006] Therefore, in order to protect the copyright of content consisting of visual information (eg, images), there is a need for a method for inserting information about a user into the content. Summary of the Invention [Problem to be solved by the invention]
[0007] The present invention relates to a content providing method and system for copyright protection of content provided in the form of images.
[0008] The present invention also relates to a content providing method and system capable of protecting copyrights in response to various illegal copying and distribution methods.
[0009] Thus, the present invention can be implemented so that information about a user can be inferred from content provided to a user terminal. [Means for solving the problem]
[0010] A content providing method according to the present invention may include the steps of receiving a viewing request for content from a user terminal, confirming user information relating to a user account logged in to the user terminal, editing a plurality of scene images constituting the content based on the user information, and providing the content including the edited plurality of scene images to the user terminal.
[0011] Meanwhile, a content providing system according to the present invention includes a communication unit that receives a viewing request for content from a user terminal, and a control unit that confirms user information related to a user account logged in to the user terminal, and the control unit can edit a plurality of scene images that constitute the content based on the user information, and provide the content including the edited plurality of scene images to the user terminal.
[0012] Meanwhile, a program according to the present invention is a program executed by one or more processors in an electronic device and stored on a computer-readable recording medium, the program including commands for executing the steps of receiving a request to view content from a user terminal, confirming user information relating to a user account logged in to the user terminal, editing a plurality of scene images that constitute the content based on the user information, and providing the content including the edited plurality of scene images to the user terminal. Effect of the Invention
[0013] The content providing method and system according to the present invention edits and provides an image based on user information, thereby making it possible to insert user information into an image constituting the content.
[0014] Here, in the present invention, user information can be inserted into content simply by deleting or editing images, making it possible to detect various types of illegal duplication and distribution of content (such as screen captures and camera shots).
[0015] On the other hand, various embodiments of the present invention allow for the area of the image that contains important content to be retained and editing only performed on other areas, thereby preventing distortion of important content. [Brief description of the drawings]
[0016] [Figure 1] 1 is a block diagram illustrating a content providing system according to the present invention; [Diagram 2] 2 is a flowchart illustrating a content providing method according to the present invention. [Diagram 3] FIG. 13 is a conceptual diagram for explaining that content that has been edited differently is provided depending on user information. [Figure 4] 1 is a conceptual diagram for explaining a content editing method according to the present invention; [Diagram 5] 1 is a conceptual diagram for explaining a content editing method according to the present invention; [Figure 6] 1 is a conceptual diagram for explaining a content editing method according to the present invention; [Figure 7] 1 is a conceptual diagram for explaining a content editing method according to the present invention; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0017] Hereinafter, the embodiments disclosed in this specification will be described in detail with reference to the attached drawings. However, the same or similar components are denoted by the same or similar reference numerals regardless of the drawing numbers, and the description thereof will be omitted. The suffixes "module" and "part" of components used in the following description are given or mixed to facilitate the preparation of the specification, and do not have any significance or usefulness in themselves. In addition, when describing the embodiments disclosed in this specification, if it is determined that a specific description of related publicly known technology may obscure the gist of the embodiments disclosed in this specification, the detailed description thereof will be omitted. Note that the attached drawings are merely for the purpose of making the embodiments disclosed in this specification easily understandable, and the technical ideas disclosed in this specification are not limited by the attached drawings, and it should be understood that any modifications, equivalents, or alternatives included in the ideas and technical scope of the present invention are included in the present invention.
[0018] Terms including ordinal numbers such as first, second, etc. are used to describe various components, but the components are not limited to the terms. The terms are used only to distinguish one component from another.
[0019] When a component is said to be "coupled" or "connected" to another component, it should be understood that the component may be directly coupled or connected to the other component, and that there may be additional components in between. In contrast, when a component is said to be "directly coupled" or "directly connected" to another component, it should be understood that there are no additional components in between.
[0020] Singular expressions include plural expressions unless otherwise specified.
[0021] As used herein, terms such as "comprise" and "have" are intended to specify the presence of features, numbers, steps, operations, components, parts, or combinations thereof set forth in the specification, but should not be understood to preclude the presence or additional possibility of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.
[0022] The present invention relates to a content providing method and system capable of providing original content by editing it differently based on content information so as to identify those who copy (e.g., photograph, record, capture, etc.) content and illegally distribute it.
[0023] As content consumption increases, there are a growing number of cases of illegal distribution of content (particularly paid product-type content, such as viewing tickets or electronic money (ex: cookies, etc.)).
[0024] There is active research being conducted on technologies (e.g., watermarks) that insert the ID information of users who illegally distribute content (e.g., images that make up the content) to identify the leaker, but leakers are aware of the existence of watermarks and continue to attempt to circumvent them.
[0025] In particular, if the content is leaked as "video" by being photographed, recorded or captured, it can be difficult to extract complete information from the watermark if video manipulation attacks using a camera (e.g., various signal attacks or geometric deformations) are applied to the content.
[0026] Therefore, the present invention proposes a technique for editing and providing content based on user information.
[0027] More specifically, in the present invention, different edits can be made to the original content based on different user information of the users viewing (or using) the content, and each of the user terminals can display content having a different visual appearance (e.g., resolution or horizontal x vertical ratio) based on the different edits made to the original content.
[0028] Therefore, if the content provided in the present invention is leaked, the user who leaked the content can be found by comparing the leaked content with the original content and extracting the user information reflected in the leaked content.
[0029] Hereinafter, a method and system for providing content according to the present invention will be described with reference to the accompanying drawings. Fig. 1 is a block diagram for explaining a content providing system according to the present invention. Fig. 2 is a flow chart for explaining a content providing method according to the present invention, Fig. 3 is a conceptual diagram for explaining that differently edited content is provided according to user information, and Figs. 4, 5, 6 and 7 are conceptual diagrams for explaining a content editing method according to the present invention.
[0030] As shown in FIG. 1, a content providing system 100 according to the present invention may include at least one of a communication unit 110, a storage unit 120, and a control unit .
[0031] The communication unit 110 may be configured to communicate with at least one of the user terminal 1 and the content server 2.
[0032] Upon receiving a content browsing request from the user terminal 1, the communication unit 110 can edit the content based on the user information and provide the edited content to the user terminal 1.
[0033] The user terminal 1 is an electronic device capable of using content, and there is no restriction on the type of the device. For example, the user terminal 1 may be a mobile phone, a smart phone, a notebook computer, a laptop computer, a slate PC, a tablet PC, an ultrabook, a desktop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation system, a wearable device (e.g., a smartwatch, smart glass, or a head mounted display (HMD)), or the like.
[0034] The communication unit 110 can receive content from the content server 2 in order to provide the content to the user terminal 1.
[0035] The content server 2 can be understood as a server that provides a content service. The content server 2 may include at least one of a cloud server 2a that executes a series of functions for controlling the content service and a database (DB) 2b in which a plurality of contents are stored.
[0036] In the present invention, the content stored in the database 2b is called “original content.” Original content can be understood as content that has not been edited based on user information.
[0037] In contrast, in the present invention, the content provided to the user terminal 1 will be described as "edited content 3."
[0038] The content described in this invention is composed of "multiple scene images." The scene images constitute an episode or story of the content, and the order of the scene images may correspond to the order in which they make up the episode. The order of the scene images constituting the first story of an episode may correspond to the first order, the order of the scene images constituting the next story of an episode may correspond to the second order, and the order of the scene images constituting the next story of an episode may correspond to the third order.
[0039] In the present invention, at least some of the multiple scene images constituting the original content can be edited and provided to the user terminal 1. As shown in Fig. 1, the user terminal 1 may sequentially display the multiple edited scene images 3a, 3b in accordance with the scene order.
[0040] Meanwhile, the content server 2 can execute a function of editing original content based on user information and providing the edited content 3 to the user terminal 1. That is, the content providing system 100 according to the present invention can correspond to one function of the content server 2. Therefore, the storage unit 120 described below can be used in conjunction with the database 2b of the content server 2, and the control unit 130 can be used in conjunction with the cloud server 2a.
[0041] The storage unit 120 may store various information for providing the edited content 3. The storage unit 120 may store user accounts and user information matched to the user accounts.
[0042] The user account can be understood as a user account subscribed to a content service (or a content providing system). The user information matched to each user account may include at least one of user account information (e.g., ID), a user name, a nickname, identification code information (e.g., a hash code generated by a hash function), and unique information that can identify a user.
[0043] Furthermore, the storage unit 120 may store editing code information (see FIG. 4) that is the basis for editing the content based on the user information.
[0044] In the edit code information, different edit codes may be matched for each character constituting the user information. For example, as shown in Fig. 4, assume that 26 lowercase alphabetical characters are set as characters constituting the user information. In the edit code information, different edit codes may be matched for each lowercase alphabetical character (from a to z).
[0045] Here, the editing code can be understood as information that defines an editing style for the original content. More specifically, the editing code can be understood as information that defines which scene image, among the multiple scene images that constitute the original content, is edited in which editing style. For example, the editing code "{0,1,-1}" that is matched to the lowercase alphabet "h" can be understood as being defined to perform an editing corresponding to "0" (ex: maintain, Nothing) for the first scene image, an editing corresponding to "1" (ex: pixel insertion, Insertion) for the second scene image, and an editing corresponding to "-1" (ex: pixel deletion, Removal) for the third scene image.
[0046] Furthermore, as described above, at least a part of the storage unit 120 may represent the database 2b of the content server 2. That is, in the present invention, the storage unit 120 may be understood to be sufficient as long as it is a space in which information related to the present invention is stored, and there is no restriction on the physical space.
[0047] Meanwhile, the storage unit 120 may be configured to control the overall operation of the content providing system 100 according to the present invention. It can be understood that the communication unit 110 and the storage unit 120 are controlled by the control unit 130. Hereinafter, a method for editing and providing original content based on user information will be described in detail.
[0048] In the present invention, a process of receiving a request to view content from a user terminal can be performed (S210, see FIG. 2).
[0049] The control unit 130 can receive, from the user terminal 1, a request to view a specific piece of content among a plurality of pieces of content provided in the content service.
[0050] A variety of requests for viewing content are made from the user terminal 1.
[0051] As an example, based on the selection of information about a specific piece of content (e.g., a thumbnail) on a service page that includes information about each of a plurality of pieces of content (e.g., a thumbnail, a title, etc.), the communication unit 110 can receive a viewing request for the specific piece of content from the user terminal 1.
[0052] As another example, based on a selection of one of multiple episodes that make up a specific content on a service page related to the specific content, the communication unit 110 can receive a viewing request for the specific episode from the user terminal 1.
[0053] In the present invention, a request to view an episode that constitutes a particular piece of content can be explained as a request to view the content.
[0054] In addition, in the present invention, a process of checking user information related to a user account logged into the user terminal can be performed (S220, see FIG. 2).
[0055] The control unit 130 can check the user information of the user account that has logged in to the user terminal 1 based on receiving a browsing request for specific content from the user terminal 1.
[0056] If the user terminal 1 is not logged in, the control unit 130 provides a login page to the user terminal 1, allowing the user to proceed with logging in.
[0057] As mentioned above, the user information may include at least one of user account information (e.g., ID), username, nickname, identification code information (e.g., hash code generated by a hash function), and unique information that can identify the user.
[0058] In the present invention, a process of editing a plurality of scene images constituting the content requested to be viewed can be performed based on user information (S230, see FIG. 2).
[0059] The editing process can be understood as a process of inserting the user information into the content by editing the plurality of scene images. The control unit 130 can insert the user information into the plurality of scene images by editing the plurality of scene images according to an editing code that matches characters constituting the user information.
[0060] The control unit 130 can identify an editing style for each of the identified scene images based on the editing code matched to the characters constituting the user information.
[0061] The editing code is information that defines an editing style for editing performed on each of a plurality of scene images, and different editing styles may exist and be matched with each other for each code value constituting the editing code.
[0062] Also, in the present invention, each of the plurality of scene images can be edited using one of different first to third editing styles. The first editing style may be an editing style for inserting additional pixels into a scene image to be edited among the plurality of scene images, the second editing style may be an editing style for deleting some pixels of the scene image to be edited among the plurality of scene images, and the third editing style may be an editing style for maintaining the scene image to be edited among the plurality of scene images.
[0063] For example, in the present invention, a code value of "1" may be matched to a first editing style, a code value of "-1" may be matched to a second editing style, and a code value of "0" may be matched to a third editing style.
[0064] Here, the scene image can be edited using any one of the following editing styles: i) editing that adds pixels to the scene image (first editing style), ii) editing that deletes pixels that make up a specific area of the scene image from the scene image (second editing style), and iii) editing that leaves the scene image as it is without editing it (third editing style).
[0065] The editing of adding pixels in the first editing style may be editing of adding a pixel line to the scene image in the horizontal direction of the scene image, or adding a pixel line to the scene image in the vertical direction of the scene image.
[0066] Here, the pixel line may be composed of a plurality of pixels. As an example, when a first editing style in which 10 pixel lines are added in the horizontal direction is applied to a specific scene image composed of 250 horizontal pixels and 400 vertical pixels, the specific scene image is composed of 260 horizontal pixels and 400 vertical pixels. In this case, the horizontal x vertical ratio of the scene image before editing is changed from 5:8 before editing to 13 x 20 after editing. That is, the horizontal x vertical ratio of the scene image (or the ratio of the scene image, the ratio of the size of the scene image) is changed by the first editing. As another example, when a first editing style in which 10 pixel lines are added in the vertical direction is applied to a specific scene image composed of 250 horizontal pixels and 400 vertical pixels, the specific scene image is composed of 250 horizontal pixels and 410 vertical pixels. In this case, the horizontal x vertical ratio of the scene image before editing (or the ratio of the scene image, the ratio of the size of the scene image) is changed from 5:8 before editing to 25 x 41 after editing.
[0067] Meanwhile, when editing to add pixels is performed according to the first editing style, the control unit 130 may generate the added pixels using pixels in an area adjacent to the area where the pixels are to be added. The control unit 130 may add pixels of the same or similar color as the pixels in the area adjacent to the area where the pixels are to be added to the scene image.
[0068] Meanwhile, the editing for deleting pixels by the second editing style may be editing for deleting some pixel lines of the scene image in the horizontal direction of the scene image, or editing for deleting some pixel lines of the scene image in the vertical direction of the scene image. As described above, the pixel lines may be composed of a plurality of pixels. As an example, when the second editing style for deleting 10 pixel lines in the horizontal direction is applied to a specific scene image composed of 250 horizontal pixels and 400 vertical pixels, the specific scene image is composed of 240 horizontal pixels and 400 vertical pixels. In this case, the horizontal x vertical ratio of the scene image before editing is changed from 5:8 before editing to 3 x 5 after editing. That is, the horizontal x vertical ratio of the scene image (or the ratio of the scene image, the ratio of the size of the scene image) is changed by the second editing. As another example, when the second editing style for deleting 10 pixel lines in the vertical direction is applied to a specific scene image composed of 250 horizontal pixels and 400 vertical pixels, the specific scene image is composed of 250 horizontal pixels and 390 vertical pixels. In this case, the width x height ratio of the scene image before editing (or the ratio of the scene image, the ratio of the size of the scene image) is changed from 5:8 before editing to 25 x 39 after editing.
[0069] In the third editing style, scene images are left unchanged, and the scene images before and after editing are the same. In this case, the number and ratio of the scene images before and after editing are all the same.
[0070] In this manner, when editing is performed on a plurality of scene images to be edited, the aspect ratio of at least some of the plurality of scene images after editing can be made different from the aspect ratio of at least some of the scene images before editing.
[0071] On the other hand, which of the plurality of scene images has its aspect ratio changed can be made to differ depending on the user information.
[0072] Thus, in the present invention, the aspect ratio of at least some of the multiple scene images is changed, and as a result, the size of at least some of the multiple scene images is changed. In the present invention, this is expressed as resizing the scene images. In the present invention, editing of the scene images can also be understood as resizing of the scene images. The term "editing" can be used in a modified form such as "resizing" or "retargeting".
[0073] The control unit 130 can edit each of the multiple scene images by combining the above-mentioned first to third editing styles based on the user information, as will be described in more detail later.
[0074] Such editing results in a plurality of edited scene images being provided to the user terminal, the plurality of scene images being configured to include user information.
[0075] Meanwhile, for each edit code, the degree of pixels (or pixel lines) to be deleted or inserted may be predefined. For example, when the types of code values are 0, 1, and -1, the code value 1 indicating the insertion of a pixel and the code value -1 indicating the deletion of a pixel may have a predefined degree (amount or number) of pixels to be deleted or inserted according to each code value. For example, the code value 1 corresponds to the addition of 10 pixel lines, and the code value -1 corresponds to the deletion of 10 pixel lines.
[0076] In addition, when the types of code values are diversified, the degree of adding or deleting pixel lines can be further diversified. For example, when the types of code values are -2, -1, 0, 1, and 2, the code value 2 corresponds to adding 20 pixel lines, the code value 1 corresponds to adding 10 pixel lines, the code value -1 corresponds to deleting 10 pixel lines, and the code value -2 corresponds to deleting 20 pixel lines.
[0077] In this way, each code value determines an editing level regarding how and to what extent a scene image is edited (how many pixels are added or deleted), and the control unit 130 can edit a plurality of scene images constituting the content based on a preset editing level matched to each code value. Meanwhile, an editing level can also be understood as the number of lines of pixels constituting an area to be edited in a scene image.
[0078] Furthermore, even if the control unit 130 receives a viewing request for the same content, the control unit 130 can edit a plurality of scene images constituting the original content using editing codes that match each piece of user information, based on the fact that the user information is different.
[0079] As an example, assume that the first user information (ex:ID) is "honggd" as shown in (b) of FIG. 3. The control unit 130 may edit the scene image 310 according to an editing style (second editing style) that removes some pixels of the scene image 310 constituting the original content based on the first user information. The edited scene image 320 may have a visual appearance in which the area corresponding to the removed pixels is reduced compared to the original scene image 310 (the area corresponding to L2 is smaller than the area corresponding to L1).
[0080] As another example, assume that the second user information (ex:ID) is "kimstar" as shown in (c) of FIG. 3. The control unit 130 may edit the scene image 310 according to an editing style (second editing style) of additionally inserting some pixels of the scene image 310 constituting the original content into the scene image 310 based on the second user information. That is, the control unit 130 may perform an editing on the original content different from an editing of removing the original content based on the first user information. In this case, the edited scene image 330 may have a visual appearance with an increased area (the area corresponding to L3 is larger than the areas corresponding to L1 and L2) compared to the original scene image 310 and the scene image 320 from which pixels have been deleted.
[0081] In addition, in the present invention, a process of providing edited content to a user terminal can be performed (S240, see FIG. 2).
[0082] The control unit 130 can provide the user terminal 1 with content made up of edited scene images based on the fact that at least some of the plurality of scene images have been edited based on the user information.
[0083] In the present invention, even if the same content is requested to be viewed, differently edited content based on different user information can be provided to each user terminal 1. The differently edited content may be displayed with different visual appearances (e.g., different resolutions, different aspect ratios, different width x height ratios) on the user terminal 1.
[0084] For example, when original content 310 that has not been edited based on user information is provided (see (a) of FIG. 3), when content 320 that has been edited with pixels deleted based on first user information (e.g., “ID:honggd”) is provided (see (b) of FIG. 3), and when content 330 that has been edited with pixels inserted based on second user information (e.g., “ID:kimstar”) is provided (see (c) of FIG. 3), the contents 310, 320, and 330 having different visual appearances are each displayed on the user terminal.
[0085] In this way, in the present invention, content having different visual appearances is provided according to the information of the user viewing the content, and if content is illegally copied (e.g. captured or photographed) and leaked and distributed, the leaker can be located based on the degree of editing of the leaked content.
[0086] Meanwhile, the control unit 130 can combine the first editing style, the second editing style, and the third editing style based on user information to edit a plurality of scene images constituting the content. As a result, content having different visual appearances can be provided to the user terminal. It can be determined based on user information which of the first to third editing styles is used to edit each of the plurality of scene images constituting the content.
[0087] The user information is composed of at least one character, and a content providing system (or a storage unit) that provides the content may store and exist first matching information in which a different code is matched for each different character, and second matching information in which any one of the first editing style, the second editing style, and the third editing style is matched for each different code value that constitutes the code. Here, different editing styles may be matched for different code values. At least one of the first matching information and the second matching information may exist as table type information. The control unit 130 may perform editing that reflects the user information on a plurality of scene images by referring to at least one of the first matching information and the second matching information.
[0088] The control unit 130 can check a specific editing code corresponding to the user information based on the first matching information, and edit the plurality of scene images according to an editing style that matches each of the code values constituting the specific editing code. The control unit 130 can edit the plurality of scene images by referring to the editing code corresponding to the user information.
[0089] In this manner, the control unit 130 can provide the user terminal with content composed of a plurality of scene images having different visual appearances based on at least one of the following differences: i) the character type of the characters constituting the user information, ii) the number of characters (or the length of the string), iii) the editing code matched to the characters, and iv) the number of digits (number) of the editing code.
[0090] On the other hand, the edit code shown in FIG. 4 can be set by the administrator of the system 100 or by the control unit 130.
[0091] The editing code can be understood as information that defines which of the above-mentioned first to third editing styles is to be used to edit the original content. The editing code can also be understood as information that defines which editing style is to be used to edit a scene image of a given order among a plurality of scene images that constitute the content requested to be viewed.
[0092] The control unit 130 can perform editing on consecutive scene images, the number of which corresponds to the number of digits constituting the editing code, in an editing style that matches the code value constituting each digit.
[0093] For example, when the editing code has three digits as shown in Fig. 4, the control unit 130 can perform editing on three consecutive scene images (e.g., a first scene image, a second scene image, and a third scene image). In this case, the control unit 130 can edit the first scene image in an editing style matched to the first code value, edit the second scene image in an editing style matched to the second code value, and edit the third scene image in an editing style matched to the third code value.
[0094] Each of the code values (e.g., "0", "1", "-1") constituting the edit code may be matched with any one of a plurality of edit styles. For example, the code value "1" may be matched with an edit style (or a first edit style) in which pixels constituting a specific region in the scene image are added and inserted into the scene image, the code value "-1" may be matched with an edit style (or a second edit style) in which pixels constituting a specific region in the scene image are deleted from the scene image, and the code value "0" may be matched with an edit style (or a third edit style) in which the scene image is not edited and is maintained as it is.
[0095] Meanwhile, the control unit 130 may determine the number of digits (scenes) of the edit code based on the number of characters (characters) and the number of editing styles (stages) available for configuring the user information as shown in the following formula. In the present invention, the determination of the number of digits of the edit code may be understood as the number of scene images to be edited to reflect one character. That is, the control unit 130 may determine the minimum number of scene images required to express all characters available for configuring the user information.
[0096]
number
[0097] For example, if the user information is the English alphabet, the number of alphabets is 26. The control unit 130 can determine at least one of the type of code value and the number of scene images that can express all of the 26 alphabets based on the above formula. Here, the type of code value (e.g., 1, -1, 0) (or the number of types) that matches the editing style corresponds to stage in the above formula, and the number of scene images required to express the user information corresponds to scenes. If the type of code value is specified, the control unit 130 can determine the number of scene images so that all of the user information can be expressed by referring to the above formula. For example, if the code value is specified to three types, 1, -1, and 0, a minimum of three scene images are required to express the 26 alphabets (3^3=27). In contrast, if the number of scene images is specified, the control unit 130 can determine the type of code value (or the number of types) so that all of the user information can be expressed by referring to the above formula. For example, if the number of scene images is specified to three, a minimum of three code value types are required to express the 26 alphabets (3^3=27).
[0098] The control unit 130 can determine at least one of the number of code value types (stage) and the number of scene images (scenes) so that the number of characters configured to express user information is within the number of code value types (stage)^the number of scene images (scenes) derived by the above formula.
[0099] For example, when there are three types of code values, 0, 1, and -1, a minimum of three scene images are required to express "a" among the user information that can be expressed by the alphabet. Here, the number of scene images can be understood as the number of code values (number of digits) that constitute the edited code. In this case, the edited code may be composed of three digits. In an edited code composed of three digits, each code digit is composed of one of 0, 1, or -1, and a total of 27 edited codes can be combined, in which case all 26 alphabets can be expressed.
[0100] Meanwhile, in the above example, an example of expressing 26 characters has been described. As another example, in order to express 45 characters, three types of code values (for example, 0, 1, -1) and four scene images (four-digit editing code) are needed to express each of the 45 characters (3^4=81).
[0101] As described above, the control unit 130 inserts the user information into the plurality of scene images that constitute the content by editing the plurality of scene images, where the number of the plurality of scene images is determined based on the number of characters that constitute the user information.
[0102] That is, the number of multiple scene images required for inserting user information varies depending on the number of characters that make up the user information.
[0103] For example, if the number of code values (number of digits in the editing code) required to express different characters (unit characters) is three (or three digits), and the number of characters constituting the user information is four (for example, ID: abcd corresponding to the user information), the number of the plurality of scene images required to insert the user information is 12. That is, "three scene images" are required to express each character (unit character), and therefore, to express a four-digit character, 12 scene images are required, which corresponds to "3" scene images required to express the unit character x "4", the number of characters constituting the user information.
[0104] In this way, the number of digits in the editing code (the number of code values) is the minimum number of scene images required to express one character; for example, three scene images are required to express one alphabetical character, and nine scene images are required to express three alphabetical characters.
[0105] On the other hand, the number of types of code values and the number of scene images (the number of digits of the editing code and the number of code values) differ depending on the number of characters that can be used to configure the user information.
[0106] The control unit 130 can identify the number of scene images required to insert the user information based on the number of characters that make up the user information, and edit the scene images that make up the content requested to be viewed, which correspond to the number, in order to insert the user information.
[0107] Furthermore, the control unit 130 can specify an editing style to be applied to each of the plurality of scene images by a code value constituting an editing code corresponding to the user information.
[0108] The control unit 130 can edit each of the multiple scene images specified as the scene images to be edited, based on the editing style of the code values constituting the editing code corresponding to the user information.
[0109] For example, as shown in FIG. 5, assume that the user information is "honggd" which is composed of six characters. As described above, in the case of six characters, 18 scene images are required to express the user information once. The control unit 130 can insert the user information using 18 consecutive scene images. Here, three scene images are required to express one character, and since the user information is six characters, a total of 18 scene images are required. Therefore, the control unit 130 can edit into a total of 18 scene images to express the user information "honggd".
[0110] The control unit 130 may check the editing code matched to each character based on at least one of the first matching information and the second matching information, and edit the scene images according to the editing style matched to the code value of the editing code, where each digit of the editing code may correspond to the arrangement order of the scene images to be edited.
[0111] For example, if the editing code 81 of the first character 31 "h" is {0, 1, -1}, the control unit 130 can edit the first scene image (first scene image) 21 of the three consecutive scene images in an editing style that matches the code value "0" placed in the first digit (e.g., the third editing style, Nothing, which keeps the scene image as is), edit the second scene image (second scene image) 22 in an editing style that matches the code value "1" (e.g., the first editing style, which inserts a specific pixel into the scene image), and edit the third scene image (third scene image) 23 in an editing style that matches the code value "-1" (e.g., the second editing style, which deletes a specific pixel from the scene image). Also, based on the editing code of the second character 32, 'o' being {-1, -1, 1}, the control unit 130 can edit the fourth scene image 24 in an editing style (second editing style for deleting pixels) matching the code value '-1', edit the fifth scene image (not shown) in an editing style (second editing style for deleting pixels) matching the code value '-1', and edit the sixth scene image (not shown) in an editing style (first editing style for inserting pixels) matching the code value '1'. In this manner, the control unit 130 can perform editing on a total of 18 scene images to express the user information 'honggd'. Meanwhile, the control unit 130 can insert user information into the whole or part of the content by repeatedly editing the scene images constituting the content in units of the number of scene images (e.g., 18) required to express the user information.
[0112] On the other hand, the control unit 130 can select and edit an area of the scene image that is relatively less important, so as not to prevent the user from using the content and to prevent the user from noticing that the content has been edited. The control unit 130 can prevent editing from being performed on an area of the scene image that includes content (or graphic objects) that is highly important (also called an "edit restricted area"), and can allow editing to be performed on an area that includes objects that are less important (also called an "edit target area").
[0113] The low-importance or high-importance area in the scene image can be determined based on various criteria. For example, the control unit 130 can specify the area to be edited based on user information using the pixel energy of each of the pixels constituting the scene image as a criterion. In the present invention, energy can also be referred to as energy level. The control unit 130 can specify the area with a low energy level in each scene image by a content transformation-based retargeting technique such as seam carving, and specify it as the area to be edited.
[0114] Here, the "pixel energy" can be understood as the complexity of a pixel. For example, the control unit 130 can obtain (calculate or calculate) the pixel energy based on at least one of the magnitude of the pixel's gradient, entropy, visual saliency, and gaze movement.
[0115] The control unit 130 can calculate the sum of pixel energies of pixels forming a line in one direction in the scene image and detect the line with the smallest sum of pixel energies. The control unit 130 can specify the region (or pixel) corresponding to the line with the smallest sum of detected pixel energies as the region to be edited (or pixel to be edited).
[0116] 6, a specific line 510 in which the sum of pixel energies of pixels forming a horizontal line is the smallest can be detected in the scene image 410. The control unit 130 can specify a region (or pixels) corresponding to the detected line 510 as a region (pixels) to be edited.
[0117] As another example, areas of low importance (areas to be edited) or areas of high importance (areas restricted from editing) in a scene image can be determined based on at least one of the type of graphic object or the content (or meaning) of the graphic object contained in the scene image.
[0118] The control unit 130 may prevent editing from being performed on an area including an important graphic object or an area including a graphic object corresponding to important content (or meaning), i.e., an object having high importance. The type of an important graphic object or the content (or meaning) of the graphic object may be based on a preset criterion.
[0119] The control unit 130 can specify an area including an important graphic object (or an important graphic object) in a scene image as an editing restricted area based on a preset criterion, and can perform editing on other areas (edit target areas). The control unit 130 can control so that pixels including an important graphic object are not detected (specified) as an area (or line) to be edited. That is, pixels including an important graphic object can become an editing restricted area.
[0120] For example, as shown in Fig. 6, when the preset criteria are set for important objects such as objects corresponding to a speech bubble 412, a character 413, and a face 414, the control unit 130 can set the area including the objects 412, 413, and 414 as an editing restricted area, and set other areas as an editing target area. The control unit 130 can perform editing on areas not including the objects 412, 413, and 414. In this way, when a tree image 411, a speech bubble 412, a character 413, and a face 414 are included in the scene image 410, the control unit 130 can set an editing target area based on an important object based on the above-mentioned energy level or the preset criteria.
[0121] Furthermore, the control unit 130 can edit regions of the scene image with low pixel energy (ie, regions to be edited) according to an editing code matched to the user information.
[0122] When an editing code for "deleting" low-energy pixels is matched to the user information, the control unit 130 can perform editing to delete low-energy pixels 510. For example, as shown in (a) of Fig. 7, an edited scene image 420 can include a shortened tree trunk 421 in which low-energy pixels have been deleted.
[0123] When an editing code for "inserting" a pixel with low energy into a scene image is matched to the user information, the control unit 130 can perform editing by copying (duplicating) the pixel with low energy and inserting it into the scene image. For example, as shown in (b) of Fig. 7, a plurality of copied pixels with low energy 530 can be inserted into the edited scene image 430. The edited scene image 430 can include a tree trunk 431 that has been lengthened by inserting a pixel with low energy.
[0124] As described above, the content providing method and system according to various embodiments of the present invention can insert user information into an image constituting content by editing and providing an image based on user information.
[0125] Here, in the present invention, user information can be inserted into content simply by deleting or editing images, making it possible to detect various types of illegal duplication and distribution of content (such as screen captures and camera shots).
[0126] On the other hand, various embodiments of the present invention allow for the area of the image that contains important content to be retained and editing only performed on other areas, thereby preventing distortion of important content.
[0127] The present invention described above can be realized as computer readable codes or commands on a program recording medium, that is, the present invention can be provided in the form of a program.
[0128] The computer-readable medium includes any kind of recording device in which data read by a computer system is stored. Examples of the computer-readable medium include a hard disk drive (HDD), a solid state disk (SSD), a silicon disk drive (SDD), a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, and an optical data storage device.
[0129] The computer-readable medium also includes a storage location, including a server or cloud storage location that can be accessed by an electronic device via communication, in which case the computer can download the program according to the present invention from the server or cloud storage location via wired or wireless communication.
[0130] Furthermore, in the present invention, the above-mentioned computer is an electronic device equipped with a processor, that is, a CPU (Central Processing Unit), and the type of the processor may be any.
[0131] However, the above detailed description should not be interpreted as limiting in any respect, but should be considered as illustrative. The scope of the present invention should be determined by reasonable interpretation of the claims, and all modifications within the equivalent scope of the present invention are included in the present invention.
Claims
1. receiving a request for viewing content from a user terminal; confirming user information related to a user account logged into the user terminal; editing a plurality of scene images constituting the content based on the user information; and providing the content including the edited scene images to the user terminal.
2. The content providing method according to claim 1, characterized in that when the plurality of scene images are edited, the aspect ratio of at least some of the plurality of scene images after editing is different from the aspect ratio of the at least some of the scene images before editing.
3. 3. The content providing method according to claim 2, wherein which of the plurality of scene images has had its aspect ratio changed varies depending on the user information.
4. Each of the plurality of scene images is edited in any one of a first editing style, a second editing style, and a third editing style, the first editing style is an editing style for inserting a pixel into a scene image to be edited among the plurality of scene images; the second editing style is an editing style for deleting some pixels of a scene image to be edited from among the plurality of scene images; 2. The content providing method according to claim 1, wherein the third editing style is an editing style in which a scene image that is a target of editing among the plurality of scene images is maintained.
5. The content providing method according to claim 4, characterized in that in the step of editing the plurality of scene images, the plurality of scene images are edited by combining the first editing style, the second editing style, and the third editing style based on the user information.
6. The content providing method according to claim 5, characterized in that the editing style in which each of the plurality of scene images is to be edited, among the first editing style, the second editing style, and the third editing style, is determined based on the user information.
7. The content providing system for providing the content includes: First matching information in which a different editing code is matched for each different character that can be set as the user information; and second matching information exists in which any one of the first editing style, the second editing style, and the third editing style is matched for each different code value constituting the edit code; The method of claim 6, wherein different editing styles are matched to the different code values.
8. the edit code includes a plurality of code values arranged in different digits; The method of claim 7, wherein the number of the plurality of code values constituting the edit code is determined according to the number of different characters.
9. 9. The content providing method according to claim 8, wherein the number of the plurality of code values is the minimum number of scene images required to express each of the different characters.
10. In the step of editing the plurality of scene images, Identifying a specific edit code corresponding to the user information based on the first matching information; The content providing method according to claim 7 , wherein the plurality of scene images are edited according to editing styles that respectively match code values that constitute the specific editing code.
11. In the step of editing the plurality of scene images, The content providing method according to claim 1 , further comprising the step of inserting the user information into the plurality of scene images by editing the plurality of scene images.
12. The content providing method according to claim 1 , wherein the number of the plurality of scene images varies depending on the number of characters constituting the user information.
13. In the step of editing the plurality of scene images, Identifying an editing target area for performing editing on each of the plurality of scene images based on a preset criterion; The method for providing content according to claim 1 , wherein editing is performed so that the user information is included in the edit target area.
14. the predetermined criteria corresponds to a type of graphic object included in the plurality of scene images; In the step of editing the plurality of scene images, The content providing method according to claim 13 , wherein editing is performed on an area other than an area including an important object according to the preset criterion in each of the plurality of scene images.
15. In the step of editing the plurality of scene images, The content providing method according to claim 13 , wherein the region to be edited is specified based on pixel energy of a plurality of pixels constituting each of the plurality of scene images.
16. A communication unit that receives a request to view content from a user terminal; a control unit for confirming user information related to a user account logged into the user terminal; The control unit is Editing a plurality of scene images constituting the content based on the user information; A content providing system, comprising: a content providing unit that provides the content including the edited scene images to the user terminal.
17. A program executed by one or more processors in an electronic device and stored in a computer-readable recording medium, The program is: receiving a request for viewing content from a user terminal; confirming user information related to a user account logged into the user terminal; editing a plurality of scene images constituting the content based on the user information; and providing the content including the edited scene images to the user terminal.
Citation Information
Patent Citations
Copyright protection system
JP2005051735A
Video data transmission server and video data transmission system
JP2010074330A
Watermarking two or more variables of a video fragment
JP2022542878A
Method for display an watermark and image display device thereof
KR1020110139418A
Air extractor grille duct
KR1020250032326A