Method for raw content authentication

Abstract

A method for authenticating content is provided. The method includes: receiving original content from a user device; determining whether the original content has been changed by performing an authentication process on the original content; storing the original content and authentication information of the original content in an original content database through authentication processing based on the original content; and providing a content authentication service based on the authentication information.

Description

[0001] This application claims the benefit of Korean Patent Application No. 10-2024-0003582, filed with the Korean Intellectual Property Office on January 9, 2024, the entire disclosure of which is hereby incorporated by reference for all purposes. Technical Field

[0002] The following description relates to a method for authenticating original content. Background Art

[0003] A deepfake is content (e.g., an image, a video, an audio, etc.) generated using artificial intelligence (e.g., a neural network, deep learning, machine learning, etc.). In some examples, a deepfake generator may combine original content with source content to generate a deepfake. With the advancement of artificial intelligence, deepfake media has become more and more practical and can be used to generate false information (such as forged news). AI-generated content and real content have become difficult to distinguish. Currently, the main technologies for detecting generated forged information involve using watermarks to check for image changes or managing editing history through blockchain or the like. Summary of the Invention

[0004] This Summary of the Invention is provided to introduce a selection of concepts that will be further described below in the Detailed Description. This Summary of the Invention is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to help determine the scope of the claimed subject matter.

[0005] In one general aspect, a method performed by an authentication server includes: receiving original content from a user device; determining whether the original content has been changed by performing an authentication process on the original content; storing the original content and authentication information of the original content in an original content database based on the original content passing the authentication process; and providing a content authentication service based on the authentication information.

[0006] The original content may be sensor data in a secure state, and the sensor data is generated by a sensor of the user device.

[0007] The secure state of the sensor data may be achieved by encrypting the sensor data, storing the sensor data in a secure storage device of the user device, sending the sensor data using a secure protocol, or a combination thereof.

[0008] The sensor may include an image sensor.

[0009] The steps of receiving the original content may include: receiving image sensor data from a user device in a state where a part of the image signal processing (ISP) pipeline of the user device has not been applied to the image sensor data, and the method may further include: applying an alternative ISP pipeline corresponding to the unapplied part of the ISP pipeline of the user device to the image sensor data through an authentication service to generate enhanced original content.

[0010] The method may further include: receiving additional information associated with receiving the original content from the user device, the additional information including information about the part of the ISP pipeline of the user device, wherein enhanced original content is generated by applying the alternative ISP pipeline to the image sensor data based on the information about the part of the ISP pipeline of the user device.

[0011] The steps of providing a content authentication service may include: receiving an instance of the authentication information from another device; extracting original content from an original content database based on the instance of the authentication information; and sending the original content to the another device.

[0012] The steps of providing a content authentication service may include: receiving input content and an instance of the authentication information from a social network service (SNS) server; comparing the original content in the original content database with the input content based on the instance of the authentication information; and sending the result of the comparison to the SNS server.

[0013] The method may further include: receiving additional information including information about the type of the original content, the attributes of the original content, or a combination thereof, wherein the step of checking whether the original content has been changed includes checking whether the original content has been changed based on the additional information.

[0014] The authentication process may include applying a liveness detection algorithm to the original content.

[0015] In another general aspect, a method performed by a user device includes: storing sensor data in a secure state on the user device when the sensor data is generated by a sensor; sending the sensor data in the secure state as original content to an authentication server; receiving authentication information of the original content from the authentication server, the authentication information being generated by the authentication server based on the original content; and sending a request for a content authentication service to the authentication server based on the authentication information.

[0016] The secure state of the sensor data may be achieved by encrypting the sensor data, storing the sensor data in a secure storage device, sending the sensor data using a secure protocol, or a combination thereof.

[0017] Sensor data from a sensor can be stored in a secure storage device of a user device by a secure processor of the user device and sent to an authentication server based on a security protocol.

[0018] The method may further include: receiving, from the authentication server, sensor data corresponding to the authentication information based on a content authentication service.

[0019] The step of storing the sensor data may include: selecting, based on whether an original content retention mode is activated, between: storing the sensor data in a secure state; and storing the sensor data in a normal state with a security lower than the secure state.

[0020] In another general aspect, a method performed by a social network service (SNS) server includes: receiving, from a first user device, a request to publish original content based on authentication information of the original content; sending the authentication information to an authentication server and, in response, receiving the original content from the authentication server; and posting the received original content as a post on an account of the first user device.

[0021] The method may further include: receiving an instance of authentication information of the original content and input content from a second user device and, based thereon, sending the instance of authentication information of the original content and the input content to the authentication server; and receiving a comparison result corresponding to a comparison between the original content and the input content from the authentication server.

[0022] The method may further include: posting the input content and the comparison result as a post of the second user device.

[0023] The comparison result may include a score of the similarity between the original content and the input content.

[0024] The comparison result may include information on a difference region where the similarity between the original content and the input content is less than a threshold.

[0025] Other features and aspects will be apparent from the following detailed description, drawings, and claims. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Figure 1 Illustrates example operations of a user device, an authentication server, and a social network service (SNS) server according to one or more embodiments.

[0027] Figure 2 Illustrates an example configuration of a user device according to one or more embodiments.

[0028] Figure 3 Illustrates an example of an original content registration process according to one or more embodiments.

[0029] Figure 4 Shows an example of a content authentication service using authentication information according to one or more embodiments.

[0030] Figure 5 Shows an example of a content authentication service using authentication information and input content according to one or more embodiments.

[0031] Figure 6 Shows an example of an interface of an authentication-based publishing service according to one or more embodiments.

[0032] Figure 7 Shows an example process of generating an original content dataset according to one or more embodiments.

[0033] Figure 8 Shows an example of an authentication-based publishing process using authentication information according to one or more embodiments.

[0034] Figure 9 Shows an example of an authentication-based publishing process using authentication information and input content according to one or more embodiments.

[0035] Figure 10 Shows an example method executed by an authentication server according to one or more embodiments.

[0036] Figure 11 Shows an example method executed by a user device according to one or more embodiments.

[0037] Figure 12 Shows an example method executed by an SNS server according to one or more embodiments.

[0038] Figure 13 Shows an example configuration of an electronic device according to one or more embodiments.

[0039] Throughout the drawings and the detailed description, unless otherwise described or provided, it is understood that like or similar reference numerals represent like or similar elements, features, and structures. The drawings may not be drawn to scale, and for clarity, illustration, and convenience, the relative sizes, proportions, and depictions of the elements in the drawings may be exaggerated. Detailed Description

[0040] The following detailed description is provided to assist the reader in obtaining a comprehensive understanding of the methods, devices, and / or systems described herein. However, various changes, modifications, and equivalents of the methods, devices, and / or systems described herein will be apparent after understanding the disclosure of this application. For example, the order of operations described herein is merely exemplary and is not limited to those set forth herein. Rather, the order of operations may be changed as will be apparent after understanding the disclosure of this application, except for operations that must occur in a particular order. Additionally, descriptions of features known after understanding the disclosure of this application may be omitted for greater clarity and conciseness.

[0041] The features described herein may be implemented in different forms and should not be construed as limited to the examples described herein. Instead, the examples described herein are provided only to illustrate some of the many possible ways of implementing the methods, devices, and / or systems described herein that will be apparent after understanding the disclosure of this application.

[0042] The terms used herein are for describing various examples only and are not intended to limit the disclosure. Unless the context clearly dictates otherwise, the singular forms are also intended to include the plural forms. As used herein, the term "and / or" includes any one of the associated listed items and any combination of any two or more of them. By way of non-limiting example, the terms "comprises," "comprising," and "having" indicate the presence of the stated features, quantities, operations, components, elements, and / or combinations thereof, but do not preclude the presence or addition of one or more other features, quantities, operations, components, elements, and / or combinations thereof.

[0043] Throughout the specification, when a component or element is described as "connected to," "coupled to," or "joined to" another component or element, the component or element may be directly "connected to," "coupled to," or directly "joined to" the other component or element, or one or more intermediate components or elements may reasonably exist therebetween. When a component or element is described as "directly connected to," "directly coupled to," or "directly joined to" another component or element, no other elements may exist therebetween. Similarly, expressions such as "between" and "immediately between" and "adjacent to" and "immediately adjacent to" may be interpreted as described above.

[0044] Although terms such as "first", "second", and "third" or A, B, (a), (b), etc. may be used herein to describe various components, elements, regions, layers, or parts, these components, elements, regions, layers, or parts are not limited by these terms. Each of these terms is not used to define, for example, the nature, order, or sequence of the corresponding component, element, region, layer, or part, but is only used to distinguish the corresponding component, element, region, layer, or part from other components, elements, regions, layers, or parts. Thus, without departing from the teachings of the examples, the first component, first element, first region, first layer, or first part referred to in the examples described herein may also be referred to as the second component, second element, second region, second layer, or second part.

[0045] Unless otherwise defined, all terms used herein (including technical and scientific terms) have the same meaning as commonly understood by one of ordinary skill in the art to which this disclosure pertains, based on an understanding of the disclosure of this application and ordinary understanding. Unless explicitly defined as such herein, terms (such as those defined in a general dictionary) should be interpreted as having a meaning consistent with their meaning in the context of the relevant art and the disclosure of this application, and should not be interpreted in an idealized or overly formal sense. The use of the term "may" herein with respect to an example or embodiment (e.g., with respect to what an example or embodiment may include or may achieve) means that there is at least one example or embodiment that includes or achieves such a feature, while all examples are not limited thereto.

[0046] Figure 1 An example of operations of a user device, an authentication server, and a social network service (SNS) server according to one or more embodiments is shown. Referring to Figure 1 , the user device 110 may register original content in the original content database 121 of the authentication server 120 through the original content registration process 101.

[0047] The user device 110 may include sensors. The sensors may generate original content. For example, the original content may include image content, audio content, etc. However, the examples are not limited thereto. For example, the sensors may be image sensors, audio sensors, depth sensors, etc. However, the examples are not limited thereto. Hereinafter, examples of image content of an image sensor may be described. However, the examples are not limited thereto, and the description can be easily applied to other types of content.

[0048] The original content can be, for example, the original sensor data in a secure state generated by the sensors of the user device 110. For authentication purposes, the original content may not need to be complete (i.e., the original content can be a part or a block of the data sensed by the sensors). However, the original content may include sufficient information for checking whether a putative copy of the original content has been changed (different from the original content). The original content can be formed using low-complexity downsampling signal processing. The sensor output can be the data corresponding to the signal output by the sensor or the data obtained by performing pre-approved (discussed below) processing on the data. For example, the sensor output can be the original data generated by the sensor. However, the examples are not limited thereto. For example, when the sensor is an image sensor, the sensor data can be image sensor data. The image sensor data can be the image sensor output. As a non-limiting example, the image sensor output can be the original image data.

[0049] When generating the original content, the user device 110 can generate additional information for the original content. The additional information can include information for authenticating the originality of the original content. Authenticating the originality of the content can indicate that the content has not been changed. The user device 110 can generate an original content data set including the original content and / or the additional information for the original content.

[0050] The secure state of the original content data set (e.g., sensor data) can be a state in which it is guaranteed that only pre-approved processing has been performed on the original content data set. For example, pre-approved processing (e.g., predetermined processing) can be performed on the original content data set. For example, the pre-approved processing can involve using an image signal processing (ISP) pipeline. The pre-approved processing of the sensor data can be hardware-based. The pre-approved processing can exclude processing by software applications capable of performing image changes (e.g., software applications using artificial intelligence (e.g., neural networks, deep learning, machine learning, etc.) such as deepfake technology). That is, the user device 110 can be configured to ensure that the pre-approved processing cannot change the original content. The pre-approved processing can be provided by the manufacturer of the user device 110. In some embodiments, only the processing provided by the manufacturer of the user device 110 can be the pre-approved processing.

[0051] For example, the security state of the original content dataset (e.g., sensor data) can be achieved by encrypting the original content dataset, storing the original content dataset in a local secure storage device, sending the original content dataset using a secure protocol, or a combination thereof. The secure storage device can be a storage device that provides security functions, and the secure protocol can be a protocol that provides security functions (e.g., a communication protocol). Such security functions can be provided by a hardware-based security platform or a secure environment (e.g., a Trusted Platform Module, Knox Vault (TM), etc.). Encrypting the original content dataset, storing the original content dataset in a local secure storage device, sending the original content dataset using a secure protocol, or using a combination thereof can prevent any software application from changing the original content dataset, thereby maintaining the security state of the original content dataset.

[0052] The authentication server 120 can receive the original content dataset (e.g., original content) from the user device 110. When the original content dataset is still in a secure state, the original content dataset can be received by the authentication server 120. The authentication server 120 can check whether the original content dataset has been changed by performing an authentication process on the original content dataset. That is, the authentication process can be used to check whether the content received from the user device 110 is the original content.

[0053] For example, the user device 110 may attempt to call the original content registration process 101 with forged original content (instead of the original content). The forged original content may contain false information presented as if it were real. For example, content generated using deepfake technology can be forged original content. For example, the image sensor of the user device 110 may capture a screen showing "the result obtained by changing the real original content", thereby generating forged original content. The forged original content can be used to call / attempt the original content registration process 101. The authentication server 120 can detect the forged original content through the authentication process. For example, the forged original content can be detected through liveness detection using depth information, etc. The authentication process performed on the original content is described in detail below.

[0054] When the original content dataset (e.g., original content) passes the authentication process, the authentication server 120 can store the original content and the authentication information of the original content in the original content database 121. For example, the authentication information can be in various forms (such as numbers or codes, text, and images (e.g., barcodes, Quick Response (QR) codes, etc.)). The original content and the authentication information of the original content can be stored and managed in pairs. Figure 1In the figure, the original content database 121 is shown to be outside the authentication server 120. However, the original content database 121 can be within the authentication server 120. The security state of the original content received through the authentication server 120 can be maintained through the original content registration process 101. The security state of the original content can be maintained in the original content database 121 by the authentication server 120.

[0055] The authentication server 120 can also provide a content authentication service 102 based on authentication information. The content authentication service 102 can be a service for ensuring the originality of content (e.g., web service, cloud service, etc.). For example, the content authentication service 102 can include an original content providing service that provides the original content corresponding to the authentication information, an originality checking service that checks whether the input content is the original content, etc. The input content can be the content provided to the authentication server 120 for originality checking. An example of the input content is the content requested to be posted (e.g., as a send request) by a user of the SNS through the SNS function of the SNS server 130. The input content can be referred to as query content. Figure 1 The content authentication service 102 between the authentication server 120 and the SNS server 130 is shown. However, the content authentication service 102 can be provided to the user device 110 and / or another user device different from the user device 110. Detailed examples of the content authentication service 102 are described below.

[0056] As described above, the SNS server 130 can provide an SNS function. Users can use the SNS function to share various types of content with other users. Users can use the SNS function to post various types of content, and other users can view posts about various types of content. The SNS server 130 can provide an authentication-based posting service 103. The authentication-based posting service 103 can be configured to use the content authentication service 102 as part of its sending / posting process to send / post content. For example, the original content or content with a similarity to the original content exceeding a threshold can be posted in a limited manner through the authentication-based posting service 103. For example, when a request to post input content is made, a score of the similarity between the original content and the input content can be provided through the authentication-based posting service 103. The score can include the similarity level between the original content and the input content and / or the difference level of the similarity / difference.

[0057] For example, users of the SNS can share the original content or content similar to the original content through the original content registration process 101, the content authentication service 102, the authentication-based posting service 103, or a combination thereof, thereby preventing the spread of forged content disguised as the original content.

[0058] Figure 2An example of the configuration of a user device according to one or more embodiments is shown. Referring to Figure 2 , the user device 210 may include a sensor 211, a general-purpose processor 212, a general-purpose storage device 213, a security processor 214, and a security storage device 215. The general-purpose processor 212 and the security processor 214 may be implemented on the same chip (e.g., an application processor (AP)). However, the example is not limited thereto. The general-purpose processor 212 and the security processor 214 may also be implemented on separate chips. The general-purpose storage device 213 and the security storage device 215 may be implemented as separate memory devices (e.g., volatile memory, non-volatile memory, and a disk). However, the example is not limited thereto. The general-purpose storage device 213 and the security storage device 215 may also be implemented as the same device.

[0059] The security processor 214 may be a processor that provides security functions. The security processor 214 may provide more stringent security than the general-purpose processor 212. The security processor 214 may include hardware for performing encryption / decryption of input data, computing a digest / fingerprint, etc. In some examples, the security processor 214 may be part of a sealed or isolated computing environment. For example, the security processor 214 may be ensured by a boot check that verifies the integrity of various components. Examples of the security processor are Knox Vault Processor (TM), Trusted Platform Module (TPM), etc. For example, the general-purpose processor 212 may be a processor (such as a central processing unit (CPU), a graphics processing unit (GPU), and / or a neural processing unit (NPU)) that mainly provides control functions and / or operation functions of the user device 210 (e.g., executing an operating system, an application, managing hardware such as the sensor 211, etc.), and the security processor 214 may be a dedicated processor that provides stringent security.

[0060] The general-purpose storage device 213 may be accessed by the general-purpose processor 212, and the security storage device 215 may be accessed by the security processor 214 but not by the general-purpose processor 212. Access of the general-purpose processor 212 to the security storage device 215 may be restricted. The security processor 214 and / or the security storage device 215 may be controlled by software authorized by an operating system (OS) (e.g., authorized by a secure boot process). Control or access of the security processor 214 and / or the security storage device 215 by software not authorized by the OS may be restricted.

[0061] When the original content (e.g., sensor data) is generated by the sensor 211, an original content data set including the original content and / or additional information of the original content can be stored in the normal storage device 213 and / or the secure storage device 215. For example, when the original content retention mode is not activated, the original content can be stored in the normal storage device 213 in a normal state. The normal state may have low security. In this case, no additional information may be generated. When the original content retention mode is activated, the original content data set can be stored in the normal storage device 213 and / or the secure storage device 215 in a secure state. The secure state may have more stringent security than the normal state. The original content retention mode may be an operation mode of the user device 110 for preventing the original content from being changed or detecting changes in the original content. The original content retention mode can be activated automatically or manually. For example, when the original content (e.g., for a specific type of content, for content taken at a specific location, etc.) determined to be important for maintaining its originality is generated by the user device 210, the user device 210 can automatically activate the original content retention mode. When the original content considered by the user to be important for maintaining its originality is generated, the user can manually activate the original content retention mode.

[0062] When the original content is generated, the additional information of the original content can be generated by the normal processor 212 and / or the secure processor 214. The additional information may include information for authenticating the originality of the original content. For example, the additional information may include the content generation history of the original content (e.g., Exchangeable Image File Format (EXIF)), the signal processing process of the original content, the type of the original content (e.g., image, video, audio, etc.), the attributes of the original content (e.g., size), the image depth information, the image metadata, the digital signature of the original content, etc.

[0063] When the original content is image sensor data, the image sensor data may be sent to the authentication server 220 in a state where part (or all) of the ISP pipeline of the user device 210 is not applied to the image sensor data. For example, the ISP pipeline may include detailed operations such as demosaicing, denoising, automatic white balance (AWB), color correction matrix (CCM), etc. Some of these detailed operations may not be used by the user device 210 to generate the original content (sensor data). Part of the additional information may include ISP adjustment information of the image sensor data associated with the part (or all) of the ISP pipeline that is not applied to the image sensor data. The ISP adjustment information may include an indication of the ISP pipeline state and parameters of the detailed operations for setting the ISP pipeline state. Using this technology, the authentication server 220 can generate enhanced original content (e.g., enhanced original image content) by applying an alternative ISP pipeline corresponding to part (or all) of the ISP pipeline to the image sensor data. The ISP adjustment information included in the additional information may grant permission to apply the alternative ISP pipeline of the authentication server 220 (or used by the authentication server 220) to the image sensor data to replace the unapplied part (or all) of the ISP pipeline of the user device 210. Additionally, the alternative ISP pipeline can be configured according to the ISP adjustment information (e.g., states that can be selected and configured, etc.).

[0064] Both the user device 210 and the authentication server 220 may include corresponding image signal processors capable of executing the ISP pipeline, and the image signal processor of the authentication server 220 may execute the alternative ISP pipeline. In summary, the ISP pipeline model can be common to the user device 210 and the server side, and the ISP pipeline processing or the original content can be split between them in various ways, and this split can be communicated as part of the additional information.

[0065] Regarding the user device 210 that generates an original content dataset including the original content and additional information of the original content, for example, the general-purpose processor 212 and / or the security processor 214 may generate the original content dataset and store the original content dataset in the general-purpose storage device 213 and / or the security storage device 215. When the original content dataset is stored in the general-purpose storage device 213, the original content dataset may be in an encrypted state while it resides in the general-purpose storage device 213.

[0066] When sensor data is generated by sensor 211, user device 210 (e.g., general processor 212 and / or security processor 214) may store the sensor data in a secure state. The secure state of the original content data set (e.g., original content and sensor data) may be achieved and maintained by encrypting the original content data set, storing the original content data set in secure storage device 215, sending the original content and / or the original content data set using a secure protocol, or a combination thereof. For example, when the original content data set is stored in general storage device 213 in encrypted form, the secure state of the original content data set may be maintained. As another example, when the original content data set is stored in secure storage device 215 in unencrypted form (e.g., block-level encryption may be applied to blocks of the original content data set through the storage stack of secure storage device 215), the secure state of the original content data set may be maintained. For example, when a secure protocol is applied to the communication between devices (e.g., sensor 211, general processor 212, general storage device 213, security processor 214, secure storage device 215, authentication server 220, and original content database 221), the secure state of the original content data set may be maintained.

[0067] For example, when original content and additional information are generated while the original content retention mode is valid, security processor 214 may store the original content data set (which includes the original content and the additional information) in secure storage device 215. User device 210 may send the original content data set in a secure state to authentication server 220, and the sending may be based on a secure protocol. The original content (of the original content data set stored in secure storage device 215) may be stored in original content database 221 of authentication server 220 through an original content registration process. The original content data set may be sent to authentication server 220 in an encrypted state. The original content data set may be encrypted by security processor 214 before being stored in secure storage device 215 and / or before being sent to authentication server 220. In this way, the originality of the original content may be maintained from the generation of the original content by sensor 211 to the storage of the original content in original content database 221.

[0068] User device 210 may receive authentication information of the original content from authentication server 220, and send a request for a content authentication service to authentication server 220 based on the authentication information. User device 210 may receive the original content (e.g., sensor data) corresponding to the authentication information from authentication server 220 based on the content authentication service. User device 210 may send the authentication information of the original content to authentication server 220. Authentication server 220 may send the original content corresponding to the authentication information to user device 210 based on the content authentication service.

[0069] Figure 3 Shows an example of the original content registration process according to one or more embodiments. Refer to Figure 3 , the original content registration process 300 can be executed by an authentication server. The original content 311 and the additional information 312 can be extracted from the original content data set 301 (for example, the original content data set 301 received from a user device for registration). When the original content data set 301 is received in an encrypted state, decryption 310 can be performed on the original content data set 301; in any case, it can be assumed that the original content 311 and the additional information 312 are in plain text form (not encrypted) (for example, for the authentication process 320).

[0070] Through the authentication process 320, it can be checked whether the original content 311 has been changed (i.e., not "original"). Specifically, it can be checked whether the original content 311 and the additional information 312 match each other. For example, the additional information 312 can include the content generation history of the original content 311 (for example, EXIF), the signal processing process of the original content 311, the type of the original content 311 (for example, image, video, audio, etc.), the attributes of the original content 311 (for example, size), image depth information, digital signature or fingerprint, hash, etc. For example, the authentication process 320 can include form authentication for the original content data set 301 and / or the original content 311. For example, in the authentication process 320, the authentication process 320 can check whether the type and / or attributes of the original content 311 match the type and / or attributes of the additional information 312. For example, in the authentication process 320, live detection can be performed on the original content 311 based on the image depth information of the additional information 312 (any known live detection algorithm service can be used). Failure of the authentication process 320 can prevent the registration of the original content 311.

[0071] In the alternative content processing 330, the content processing skipped on the user device can be optionally executed. For example, when the original content 311 is image sensor data, the alternative content processing 330 can be an alternative (server - side) ISP pipeline. The image sensor data can be received by the authentication server in a state where a part of the ISP pipeline of the user device has not been applied to the image sensor data. The authentication server can generate enhanced / revised original content by applying the part of the alternative ISP pipeline corresponding to "the part of the ISP pipeline of the user device that has not been applied" to the image sensor data. As described above, the additional information 312 can include ISP adjustment information (of the image sensor data) about the part of the ISP pipeline of the user device that has not been applied. Based on this, the authentication server can generate enhanced original content by applying the alternative ISP pipeline to the image sensor data.

[0072] When the original content 311 passes through the authentication process 320, the original content 311 can be stored in the original content database (DB) 340. The authentication server can generate authentication information 331 for the original content 311. The original content 311 and the authentication information 331 of the original content 311 can be stored in the original content database 340. When the alternative content process 330 is executed, the result of the alternative content process 330 (e.g., enhanced original content) can be additionally or optionally stored in the original content database 340 as the original content 311.

[0073] Figure 4 Shows an example of a content authentication service using authentication information according to one or more embodiments. Refer to Figure 4 , the original content authentication service 400 can be executed by an authentication server. The authentication server can receive authentication information 401 from a requesting device (e.g., a user device that generates the original content 432, another user device, or an SNS server). The authentication server can extract the original content 432 corresponding to the authentication information 401 from the original content database 430 based on the authentication information 401, and can send the original content 432 to the requesting device. Accordingly, the requesting device can use the authentication information 401 to ensure that the original content 432 has not been changed, thereby protecting the original content 432. The authentication server can also or optionally respond to the authentication information 401 by providing the authentication history of the original content 432 to the requesting device. The authentication history can include a registration record of the original content 432 and an authentication record of the original content 432 (e.g., an audit trail / log).

[0074] Figure 5 Shows an example of a content authentication service using authentication information and input content according to one or more embodiments. Refer to Figure 5 , the original content authentication service 500 can be executed by an authentication server. The authentication server can receive input content 502 and authentication information 501 from a requesting device (e.g., a user device that generates the original content 531, another user device, or an SNS server). The authentication server can extract the original content 531 corresponding to the authentication information 501 from the original content database 530 based on the authentication information 501. The authentication server can perform a content comparison 540 between the extracted original content 531 and the input content 502, and send the comparison result 541 to the requesting device according to the content comparison 540.

[0075] The comparison result 541 may include a score of the similarity between the original content 531 and the input content 502. This score may include / indicate the similarity and / or the level of difference between the original content 531 and the input content 502. The comparison result 541 may include, for example, information about a difference region indicating that the similarity between the original content 531 and the input content 502 is less than a threshold. The user may identify the change status based on the difference region. For example, the user may check whether the difference region is an important region (e.g., the face region) or an unimportant region (e.g., the background region) of the original content 531.

[0076] For example, when the input content 502 is generated by adding text to the background region of an instance of the original content 531, the similarity level between the original content 531 and the input content 502 may be very low. In this case, the background region including the text may be determined as the difference region. The user may identify the change status of the input content 502 through the difference region (e.g., by highlighting the difference region to display the input content 502). Therefore, although the similarity level between the original content 531 and the input content 502 may be very low, the user may be able to identify that the subjectively more important content (e.g., a person) of the input content 502 is similar to the original content 531.

[0077] In addition to the comparison result 541, the authentication server may also provide the authentication history of the original content 531 to the requesting device. The authentication history may include the registration record of the original content 531 and the authentication record of the original content 531.

[0078] Figure 6 An example of an interface of an authentication-based publishing service according to one or more embodiments is shown. Referring to Figure 6 , for example, an interface of an authentication-based publishing service of an SNS server (e.g., a content publishing interface 610 and a content viewing interface 620) may be provided. The content publishing interface 610 may be used by a user (e.g., of an SNS service / server) to request to publish content through the SNS server. The content publishing interface 610 may include an authentication information input window 611 and a content input window 612. The authentication information may be input through the authentication information input window 611. The input content may optionally be input through the content input window 612.

[0079] For example, the content publishing interface 610 may be provided in a user application for docking with an SNS (e.g., sending, accessing). As described above, the SNS is only an example of how content may be disseminated, and any type of service or application may provide a user interface similar to the content publishing interface 610. Similarly, the content viewing interface 620 may be provided in any type of service or application.

[0080] Authentication-based publishing may be performed based on authentication information and / or input content. Authentication-based publishing may be performed through the content viewing interface 620. The content viewing interface 620 may be used by a user to view content. The content viewing interface 620 may include a content display window 621, an authentication information display window 622, and a comparison result display window 623. The input content or the original content may be displayed in the content display window 621. The authentication information of the original content may be displayed in the authentication information display window 622. The comparison result between the original content and the input content may be displayed in the comparison result display window 623. The comparison result may be used to easily verify whether the input content has been changed and how it has been changed.

[0081] For example, the SNS server may receive a request to publish the original content based on the authentication information of the original content from the first user device. The request to publish the original content may be performed by inputting the authentication information of the original content (e.g., received from the first user device) into the authentication information input window 611. The SNS server may send the authentication information to the authentication server and, assuming successful authentication, receive the original content corresponding to the authentication information from the authentication server. The SNS server may publish the original content as a post to be displayed on the first user device. The SNS server may cause the original content to be displayed in the content display window 621. In this case, since there is no input content and comparison result, the comparison result display window 623 may not be displayed, or the maximum similarity level value may be displayed in the comparison result display window 623.

[0082] For example, the SNS server may receive "the authentication information of the original content" and the input content from the second user device. The authentication information may be received through an instance of the authentication information input window 611, and the input content may be received through an instance of the content input window 612. The second user device may be the same as or different from the first user device. The SNS server may send the authentication information and the input content to the authentication server. The authentication server may perform a content comparison between the original content and the input content and generate a comparison result. The SNS server may receive the comparison result between the original content and the input content from the authentication server. The SNS server may publish the input content and the comparison result as a post to be displayed by the second user device (e.g., in instances of the content display window 621 and the comparison result display window 623).

[0083] As described above, the comparison result may include a score / level of similarity and / or difference between the original content and the input content (as used herein, with respect to comparing the original content with some other content, since the two metrics are actually the same, "similarity" also means "difference"). The comparison result may additionally or optionally include an indication of a region of difference where the similarity between the original content and the input content is less than a threshold. The user may identify the change status based on the region of difference. For example, the user may check whether the region of difference is an important region of the original content (e.g., the face region) or an unimportant region of the original content (e.g., the background region).

[0084] Figure 7 An example process of generating a dataset of original content according to one or more embodiments is shown. Referring to Figure 7 , the sensor 710 of the user device 700 may generate the original content 711. The original content 711 may be the sensor data of the sensor 710. When the original content 711 is generated, the general-purpose processor 720 may generate additional information 721 of the original content 711. The security processor 731 may store the dataset of original content in a secure state in the secure storage device 732. The dataset of original content may include the original content 711 and the additional information 721.

[0085] For example, before storing the dataset of original content in the secure storage device 732 or before sending the dataset of original content to the authentication server, the security processor 731 may generate an encrypted dataset of original content 733 by encrypting the dataset of original content. The secure state of the dataset of original content may be maintained in the secure area 703 (e.g., a secure partition). Although Figure 7 an example where the additional information 721 is generated by the general-purpose processor 720 is shown, the additional information 721 may also be generated by the security processor 731.

[0086] Figure 8 An example of an authentication-based publishing process using authentication information according to one or more embodiments is shown. Referring to Figure 8 , the SNS server 810 may receive the authentication information 801 from the user device through the content publishing interface 811 and send the authentication information 801 to the authentication server 820. The authentication server 820 may extract the original content 802 corresponding to the authentication information 801 from the original content database 821 and send the original content 802 to the SNS server 810. The SNS server 810 may publish the original content 802 through the content viewing interface 812.

[0087] Figure 9 An example of an authentication-based publishing process using authentication information and input content according to one or more embodiments is shown. Referring to Figure 9, the SNS server 910 can receive the authentication information 901 and the input content 902 of the original content 922 from the user device through the content publishing interface 911, and send the authentication information 901 and the input content 902 to the authentication server 920. The authentication server 920 can extract the original content 922 corresponding to the authentication information 901 from the original content database 921, and perform a content comparison 923 between the original content 922 and the input content 902. The authentication server 920 can send the comparison result 924 to the SNS server 910. The SNS server 910 can provide the comparison result 924 through the content viewing interface 912. The content viewing interface 912 can display the input content 902, the authentication information 901, the comparison result 924, or a combination thereof.

[0088] Figure 10 Illustrates an example method performed by an authentication server according to one or more embodiments. Refer to Figure 10 , in operation 1010, the authentication server can receive the original content from the user device, and in operation 1020, check whether the original content has been changed by performing an authentication process on the original content. In operation 1030, when the original content passes the authentication process, the authentication server can store the original content and the authentication information of the original content in the original content database, and in operation 1040, provide a content authentication service based on the authentication information.

[0089] The original content can be sensor data in a secure state generated by a sensor of the user device.

[0090] The secure state of the sensor data can be achieved by encrypting the sensor data, storing the sensor data in a secure storage device, sending the sensor data using a secure protocol, or a combination thereof.

[0091] The original content can include image sensor data in a secure state generated by an image sensor of the user device.

[0092] Operation 1010 can include receiving the image sensor data from the user device in a state where at least part of the ISP pipeline of the user device has not been applied to the image sensor data. The authentication server can generate enhanced original content by applying an alternative ISP pipeline corresponding to at least part of the ISP pipeline to the image sensor data.

[0093] The authentication server can receive additional information including ISP adjustment information about at least part of the ISP pipeline of the image sensor data. The authentication server can generate enhanced original content by applying an alternative ISP pipeline to the image sensor data based on the ISP adjustment information.

[0094] Operation 1040 may include the following operations: receiving authentication information from another device, extracting original content from an original content database based on the authentication information, and sending the original content to another device.

[0095] Operation 1040 may include the following operations: receiving input content and authentication information from an SNS server, extracting original content from an original content database based on the authentication information, comparing the original content with the input content, and sending the comparison result to the SNS server.

[0096] The authentication server may receive additional information from the user device, where the additional information includes information about the type of the original content, the attributes of the original content, or a combination thereof. The authentication server may check whether the original content has been changed based on the additional information.

[0097] Figure 11 An example of a method performed by a user device according to one or more embodiments is shown. Refer to Figure 11 In operation 1110, when sensor data is generated by a sensor, the user device may store the sensor data in a secure state; in operation 1120, the user device may send the sensor data in the secure state as original content to an authentication server; in operation 1130, the user device may receive authentication information of the original content from the authentication server; and in operation 1140, the user device may send a request for a content authentication service to the authentication server based on the authentication information.

[0098] The secure state of the sensor data may be achieved by encrypting the sensor data, storing the sensor data in a secure storage device, sending the sensor data using a secure protocol, or a combination thereof.

[0099] Sensor data from the sensor may be stored in a secure storage device by a secure processor and sent to the authentication server based on a secure protocol.

[0100] The user device may receive sensor data corresponding to the authentication information from the authentication server based on a content authentication service.

[0101] Operation 1110 may include an operation of storing the sensor data in a secure state based on the original content retention mode of the user device being in an active state. When the original content retention mode is not activated, the sensor data may be stored in a normal state with a security level lower than the secure state.

[0102] Figure 12 An example of a method performed by an SNS server according to one or more embodiments is shown. Refer to Figure 12, in operation 1210, the SNS server may receive a request to publish the original content along with the authentication information based on the original content from the first user device; in operation 1220, the SNS server sends the authentication information to the authentication server; in operation 1230, the SNS server receives the original content from the authentication server; and in operation 1240, the SNS server publishes the original content as a post on the account of the first user device.

[0103] The SNS server may receive the authentication information of the original content and the input content from the second user device, send the authentication information of the original content and the input content to the authentication server, and receive the comparison result between the original content and the input content from the authentication server.

[0104] The SNS server may publish the input content and the comparison result as a post on the second user device.

[0105] The comparison result may include a score of the similarity between the original content and the input content.

[0106] The comparison result may include information about the difference region indicating that the similarity between the original content and the input content is less than the threshold.

[0107] Figure 13 Shows an example of the configuration of an electronic device according to one or more embodiments. Refer to Figure 13 , the electronic device 1300 may include one or more processors 1310, a memory 1320, sensors 1330, a storage device 1340, an input device 1350, an output device 1360, and a network interface 1370. These components may communicate with each other via a communication bus 1380. For example, the electronic device 1300 may be implemented as at least part of a mobile device (such as a mobile phone, a smart phone, a personal digital assistant (PDA), a netbook, a tablet computer, or a laptop computer), a wearable device (such as a smart watch, a smart bracelet, or smart glasses), a computing device (such as a desktop computer or a server), a household appliance (such as a television, a smart TV, or a refrigerator), a security device (such as a door lock), or a vehicle (such as an autonomous driving vehicle or a smart vehicle). The electronic device 1300 may structurally and / or functionally include a user device, an authentication server, or an SNS server.

[0108] One or more processors 1310 may execute instructions or functions to be performed in the electronic device 1300. For example, one or more processors 1310 may process instructions stored in the memory 1320 or the storage device 1340. One or more processors 1310 may execute the above-referred-to Figures 1 to 12The operations described. When the electronic device 1300 structurally and / or functionally includes a user device, one or more processors 1310 may include a general processor and / or a security processor.

[0109] The memory 1320 may include a computer-readable storage medium or a computer-readable storage device. The memory 1320 may store instructions to be executed by one or more processors 1310 and may store relevant information when software and / or an application is being executed by the electronic device 1300. When the electronic device 1300 structurally and / or functionally includes a user device, the memory 1320 and / or the storage device 1340 may include a general storage device and / or a security storage device.

[0110] The sensor 1330 may generate sensor data. The storage device 1340 may include a computer-readable storage medium or a computer-readable storage device. The storage device 1340 may store a larger amount of information for a longer time than the memory 1320. For example, the storage device 1340 may include a magnetic hard disk, an optical disc, a flash memory, a floppy disk, or other types of non-volatile memory known in the art.

[0111] The input device 1350 may receive input from a user through traditional input means (such as a keyboard and a mouse) and through new input means (such as touch, voice, and image). For example, the input device 1350 may include a keyboard, a mouse, a touch screen, a microphone, or any other device that detects input from a user and sends the detected input to the electronic device 1300. The output device 1360 may provide the output of the electronic device 1300 to the user through visual, auditory, or tactile channels. The output device 1360 may include, for example, a display, a touch screen, a speaker, a vibration generator, or any other device that provides the output to the user. The network interface 1370 may communicate with external devices through a wired network or a wireless network.

[0112] Herein, with respect to Figures 1 to 13The described computing devices, servers, electronic devices, processors, memories, image sensors, displays, information output systems and hardware, storage devices, and other devices, apparatuses, units, modules, and components are implemented by or represent hardware components. Examples of hardware components that can be used to perform the operations described in this application include, where appropriate: controllers, sensors, generators, drivers, memories, comparators, arithmetic logic units, adders, subtractors, multipliers, dividers, integrators, and any other electronic components configured to perform the operations described in this application. In other examples, one or more of the hardware components that perform the operations described in this application are implemented by computing hardware (e.g., by one or more processors or computers). A processor or computer can be implemented by one or more processing elements such as logic gate arrays, controllers, and arithmetic logic units, digital signal processors, microcomputers, programmable logic controllers, field programmable gate arrays, programmable logic arrays, microprocessors, or any other device or combination of devices configured to respond and execute instructions in a defined manner to achieve a desired result. In one example, a processor or computer includes or is connected to one or more memories that store instructions or software executed by the processor or computer. The hardware components implemented by the processor or computer can execute instructions or software (such as an operating system (OS) and one or more software applications running on the OS) for performing the operations described in this application. The hardware components can also access, manipulate, process, create, and store data in response to the execution of the instructions or software. For the sake of brevity, the singular terms "processor" or "computer" can be used in the description of the examples described in this application, but in other examples, multiple processors or computers can be used, or a processor or computer can include multiple processing elements or multiple types of processing elements or both. For example, a single hardware component or two or more hardware components can be implemented by a single processor, or two or more processors, or a processor and a controller. One or more hardware components can be implemented by one or more processors, or a processor and a controller, and one or more other hardware components can be implemented by one or more other processors, or additional processors and additional controllers. One or more processors, or a processor and a controller, can implement a single hardware component or two or more hardware components. The hardware components can have any one or more of different processing configurations, where examples of different processing configurations include: single processor, independent processor, parallel processor, single instruction single data (SISD) multiprocessing, single instruction multiple data (SIMD) multiprocessing, multiple instruction single data (MISD) multiprocessing, and multiple instruction multiple data (MIMD) multiprocessing.

[0113] Figures 1 to 13The method of performing the operations described in this application, as shown, is performed by computing hardware (e.g., by one or more processors or computers), which is implemented to execute instructions or software for performing the operations performed by the method described in this application. For example, a single operation or two or more operations can be performed by a single processor, or two or more processors, or a processor and a controller. One or more operations can be performed by one or more processors, or a processor and a controller, and one or more other operations can be performed by one or more other processors, or additional processors and additional controllers. One or more processors, or a processor and a controller, can perform a single operation or two or more operations.

[0114] Instructions or software for controlling computing hardware (e.g., one or more processors or computers) to implement the hardware components and perform the method as described above can be written as a computer program, code segment, instruction, or any combination thereof to individually or jointly direct or configure one or more processors or computers to operate as a machine or special-purpose computer to perform the operations performed by the hardware components and method as described above. In one example, the instructions or software include machine code (such as machine code generated by a compiler) that is directly executed by one or more processors or computers. In another example, the instructions or software include higher-level code that is executed by one or more processors or computers using an interpreter. The instructions or software can be written in any programming language based on the block diagrams and flowcharts shown in the figures and the corresponding descriptions herein, which disclose algorithms for performing the operations performed by the hardware components and method as described above.

[0115] Instructions or software for controlling computing hardware (e.g., one or more processors or computers) to implement the hardware components and execute the methods as described above, and any associated data, data files, and data structures can be recorded, stored, or fixed in one or more non-transitory computer-readable storage media, or recorded, stored, or fixed on one or more non-transitory computer-readable storage media. Examples of non-transitory computer-readable storage media include: read-only memory (ROM), random access programmable read-only memory (PROM), electrically erasable programmable read-only memory (EEPROM), random access memory (RAM), dynamic random access memory (DRAM), static random access memory (SRAM), flash memory, non-volatile memory, CD-ROM, CD-R, CD+R, CD-RW, CD+RW, DVD-ROM, DVD-R, DVD+R, DVD-RW, DVD+RW, DVD-RAM, BD-ROM, BD-R, BD-R LTH, BD-RE, Blu-ray or optical disc memory, hard disk drive (HDD), solid state drive (SSD), flash memory, card memory (such as, micro multimedia card or card (e.g., Secure Digital (SD) or Extreme Digital (XD))), magnetic tape, floppy disk, magneto-optical data storage device, optical data storage device, hard disk, solid state disk, and any other device that is configured to store instructions or software and any associated data, data files, and data structures in a non-transitory manner and provide the instructions or software and any associated data, data files, and data structures to one or more processors or computers such that the one or more processors or computers can execute the instructions. In one example, the instructions or software and any associated data, data files, and data structures are distributed across a networked computer system such that the instructions and software and any associated data, data files, and data structures are stored, accessed, and executed by one or more processors or computers in a distributed manner.

[0116] Although this disclosure includes specific examples, it will be apparent after understanding the disclosure of this application that various changes in form and detail can be made in these examples without departing from the spirit and scope of the claims and their equivalents. The examples described herein are considered to be illustrative only and not for purposes of limitation. The description of a feature or aspect in each example is considered to be applicable to similar features or aspects in other examples. Appropriate results can be achieved if the described techniques are performed in a different order, and / or if the components in the described systems, architectures, devices, or circuits are combined in a different manner, and / or replaced or supplemented by other components or their equivalents.

[0117] Accordingly, in addition to the foregoing disclosure, the scope of the disclosure may also be defined by the claims and their equivalents, and all changes within the scope of the claims and their equivalents should be construed as being included in the disclosure.

Claims

1. A method performed by an authentication server, the method comprising: Receiving original content from a user device; Determining whether the original content has been changed by performing an authentication process on the original content; Based on the original content passing the authentication process, storing the original content and the authentication information of the original content in an original content database; And Providing a content authentication service based on the authentication information.

2. The method according to claim 1, wherein, The original content is sensor data in a secure state, and the sensor data is generated by a sensor of the user device.

3. The method according to claim 2, wherein, The secure state of the sensor data is achieved by encrypting the sensor data, storing the sensor data in a secure storage device of the user device, sending the sensor data using a secure protocol, or a combination thereof.

4. The method according to claim 2, wherein The sensor includes an image sensor.

5. The method according to claim 4, wherein The step of receiving the original content includes: receiving image sensor data from the user device in a state where a part of the image signal processing pipeline of the user device has not been applied to the image sensor data, and The method further includes: applying, by the authentication server, an alternative image signal processing pipeline corresponding to the unapplied part of the image signal processing pipeline of the user device to the image sensor data to generate enhanced original content.

6. The method according to claim 5, the method further comprising: Receiving additional information from the user device in association with receiving the original content, the additional information including information about the part of the image signal processing pipeline of the user device, Wherein, enhanced original content is generated by applying the alternative image signal processing pipeline to the image sensor data based on the information about the part of the image signal processing pipeline of the user device.

7. The method according to claim 1, wherein, The step of providing the content authentication service includes: Receiving the authentication information from another device; Extracting the original content from the original content database based on the authentication information; and Sending the original content to the another device.

8. The method according to claim 1, wherein The step of providing the content authentication service includes: Receiving input content and the authentication information from a social network service server; Based on the authentication information, comparing the original content in the original content database with the input content; and Sending the result of the comparison to the social network service server.

9. The method according to claim 1, the method further comprising: Receiving additional information including information about the type of the original content, the attributes of the original content, or a combination thereof, Wherein, the step of determining whether the original content has been changed includes checking whether the original content has been changed based on the additional information.

10. The method according to any one of claims 1 to 9, wherein, The authentication process includes applying a liveness detection algorithm to the original content.

11. A method performed by a user device, the method comprising: When sensor data is generated by a sensor, storing the sensor data in a secure state on the user device; Sending the sensor data in a secure state as original content to an authentication server; Receiving the authentication information of the original content from the authentication server, the authentication information being generated by the authentication server based on the original content; And Sending a request for the content authentication service to the authentication server based on the authentication information.

12. The method according to claim 11, wherein, The secure state of sensor data is achieved by encrypting the sensor data, storing the sensor data in a secure storage device, sending the sensor data using a secure protocol, or a combination thereof.

13. The method according to claim 11, wherein, Sensor data from the sensor is stored in a secure storage device of the user device by a secure processor of the user device and is sent to an authentication server based on a secure protocol.

14. The method according to claim 11, the method further comprising: Receiving, from the authentication server, sensor data corresponding to the authentication information based on a content authentication service.

15. The method according to claim 11, wherein, The step of storing the sensor data includes: Selecting between the following based on whether the original content retention mode is activated: Storing the sensor data in a secure state; and Storing the sensor data in a normal state with a security level lower than the secure state.

16. A method performed by a social network service server, the method comprising: Receiving, from a first user device, a request to publish original content based on authentication information of the original content; Sending the authentication information to an authentication server and, in response, receiving, from the authentication server, the original content corresponding to the authentication information; And Posting the received original content as a post on an account of the first user device.

17. The method according to claim 16, the method further comprising: Receiving, from a second user device, authentication information of the original content and input content and sending the authentication information of the original content and the input content to the authentication server; And Receiving, from the authentication server, a comparison result corresponding to a comparison between the original content and the input content.

18. The method according to claim 17, the method further comprising: Posting the input content and the comparison result as a post of the second user device.

19. The method according to claim 17, wherein, The comparison result includes a score of the similarity between the original content and the input content.

20. The method according to claim 17, wherein The comparison result includes information about a difference region indicating that the similarity between the original content and the input content is less than a threshold.

Images