Electronic device, method, and non-transitory computer-readable storage medium for generating or displaying electronic document including watermark
The electronic device embeds a watermark inseparably with translated text in a PDF file to protect the document's integrity and authenticity, addressing the lack of effective protection in existing systems.
Patent Information
- Application Number
- PCT/KR2025/006748
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-09-03
- Filing Date
- 2025-05-19
- Publication Date
- 2026-01-08
AI Technical Summary
Existing electronic document systems lack effective mechanisms to protect the integrity and authenticity of translated text by embedding a watermark that ensures the origin and prevents unauthorized alteration.
An electronic device generates an inseparable relationship between a watermark and translated text within a PDF file, using a software application to embed the watermark, ensuring the text's origin and preventing unauthorized alteration.
The solution effectively protects the integrity and authenticity of translated text by maintaining an inseparable relationship with the watermark, preventing unauthorized removal or alteration, thus safeguarding the document's origin and security.
Smart Images

Figure KR2025006748_08012026_PF_FP_ABST
Abstract
Description
Electronic device, method, and non-transitory computer-readable storage medium for generating or displaying an electronic document including a watermark
[0001] The present disclosure relates to an electronic device, a method, and a non-transitory computer-readable storage medium for generating or displaying an electronic document (e.g., an electronic document based on portable document format (PDF) and / or a file including the electronic document) including a watermark.
[0002] An electronic document is described as a document in electronic form (e.g., a file and / or a bitstream transmitted over a network). For example, an electronic document based on text, graphics, images, fonts, or a combination thereof may be stored within a file based on a standard related to the portable document format (PDF) (e.g., the International Standard Organization (ISO) 32000). An electronic device running a software application for electronic documents (e.g., an electronic document viewer) can identify text, graphics, and / or images, each occupying a portion of the electronic document, from the file. The electronic device can display the text, graphics, and / or images on a display having a layout represented by the electronic document.
[0003] The above information may be provided as background information to aid in understanding the present disclosure. None of the above is claimed to be prior art related to the present disclosure or can be used in making decisions related to prior art.
[0004] According to an embodiment, an electronic device may include a display, a memory including one or more storage media and storing instructions, and at least one processor including a processing circuit. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display a first text in a first language on the display. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to receive a first input for a translation of the first text. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to obtain a second text in a second language, translated from the first text in the first language, based on the first input. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to encode the second text in the second language based on a second input for storing the second text in the second language, thereby generating encoded data. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to generate an image including a watermark and the second text, and a file including the encoded data.
[0005] In one embodiment, a method of an electronic device including a display may be provided. The method may include an operation of displaying a first text in a first language on the display. The method may include an operation of receiving a first input for translating the first text. The method may include an operation of obtaining a second text in a second language, translated from the first text in the first language, based on the first input. The method may include an operation of encoding the second text in the second language to generate encoded data, based on a second input for storing the second text in the second language. The method may include an operation of generating an image including a watermark and the second text, and a file including the encoded data.
[0006] In one embodiment, an electronic device may include a display, one or more storage media, a memory storing instructions, and at least one processor including a processing circuit. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to receive an input for executing a file including an electronic document. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to obtain encoded data from an object within the file based on the input for executing the file using a first software application. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to decode the encoded data to obtain text. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display, on the display, a UI of the first software application including at least a portion of the electronic document including the text. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to obtain an image representing a combined watermark and the text from the object within the file based on the input for executing the file using a second software application. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display, on the display, a UI of the second software application that includes at least a portion of the electronic document including the image.
[0007] In one embodiment, a non-transitory computer-readable storage medium storing instructions may be provided. The instructions, when executed by an electronic device including a display and a memory, may cause the electronic device to receive an input for executing a file including an electronic document. The instructions, when executed by the electronic device, may cause the electronic device to obtain encoded data from an object within the file based on the input for executing the file using a first software application. The instructions, when executed by the electronic device, may cause the electronic device to decode the encoded data to obtain text. The instructions, when executed by the electronic device, may cause the electronic device to display a user interface (UI) of the first software application including at least a portion of the electronic document including the text on the display. The instructions, when executed by the electronic device, may cause the electronic device to obtain an image representing a combined watermark and the text from the object within the file based on the input for executing the file using a second software application. The instructions, when executed by the electronic device, may cause the electronic device to display, on the display, a UI of the second software application that includes at least a portion of the electronic document including the image.
[0008] FIG. 1 illustrates one embodiment of an electronic device for displaying, processing, and / or generating electronic documents.
[0009] FIG. 2 illustrates a schematic block diagram of an electronic device according to one embodiment.
[0010] FIG. 3 illustrates a flowchart of an exemplary operation of an electronic device for generating an electronic document including a watermark.
[0011] FIG. 4 illustrates a flowchart of the operation of an electronic device that generates an electronic document containing exemplary content generated by executing an artificial intelligence model.
[0012] FIGS. 5A, 5B, 5C, 5D, and 5E illustrate the operation of an electronic device receiving an input for at least partially editing an electronic document including a watermark.
[0013] Figure 6 illustrates the operation of an electronic device for generating an electronic document including encoded data together with a watermark.
[0014] FIG. 7 illustrates a schematic diagram of a file representing an electronic document generated by an electronic device, according to one embodiment.
[0015] Figure 8 illustrates a flowchart of exemplary operations of an electronic device for rendering an electronic document from a file.
[0016] FIG. 9 illustrates a flowchart of an exemplary operation of an electronic device for checking multiple objects constituting the content of an electronic document.
[0017] Figures 10a, 10b, and 10c illustrate exemplary states of an electronic device performing translation on an electronic document.
[0018] Figure 11 is a schematic diagram of an exemplary AI system.
[0019] FIG. 12 is a block diagram of an electronic device within a network environment according to various embodiments.
[0020] Hereinafter, various embodiments of this document are described with reference to the attached drawings.
[0021] The various embodiments of this document and the terminology used therein are not intended to limit the technology described in this document to a specific embodiment, but should be understood to include various modifications, equivalents, and / or substitutes of the embodiment. In connection with the description of the drawings, similar reference numerals may be used for similar components. The singular expression may include plural expressions unless the context clearly indicates otherwise. In this document, expressions such as "A or B", "at least one of A and / or B", "A, B, or C", or "at least one of A, B, and / or C" may include all possible combinations of the items listed together. Expressions such as "first", "second", "first", or "second" may modify the corresponding components regardless of order or importance, and are only used to distinguish one component from another, but do not limit the corresponding components. When it is said that a component (e.g., a first component) is “(functionally or communicatively) connected” or “connected” to another component (e.g., a second component), said component may be directly connected to said other component, or may be connected via another component (e.g., a third component).
[0022] FIG. 1 illustrates an embodiment of an electronic device (101) for displaying, processing, and / or generating an electronic document. The electronic device (101) can control a display (110) to display at least a portion of the electronic document. An exemplary hardware configuration included in the electronic device (101) is described with reference to FIG. 2.
[0023] Referring to FIG. 1, exemplary states (191, 192) of an electronic device (101) displaying an electronic document are illustrated. In state (191), the electronic device (101) may display at least a portion of the electronic document on the display (110). The electronic device (101) may execute a software application for displaying an electronic document (hereinafter, an electronic document viewer and / or a viewer application) to display at least a portion of the electronic document. For example, the electronic document may be stored as a file in the memory of the electronic device (101). For example, the electronic document may be stored in an external electronic device (e.g., a server) connected to the electronic device (101) via a network. The electronic device (101) may obtain a bitstream representing at least a portion of the electronic document from the external electronic device. For example, an electronic document may be in the form of a file stored in an electronic device (101) and / or a bitstream transmitted to the electronic device (101) via a network.
[0024] In an exemplary state (191) of FIG. 1, the electronic device (101) may display a user interface (UI) based on a viewer application on the display (110). Referring to state (191), the electronic device (101) may display a title bar and / or a status bar in a portion (121) of a display area including the top of the display (110). The title bar may display a name of an electronic document (e.g., “A_doc”). The status bar may display icons indicating a status of the electronic device (101), such as a battery state of charge (SOC), the current time, and / or a WiFi connection.
[0025] Referring to FIG. 1, the electronic device (101) can display at least a portion of an electronic document on a portion (122) on a display (110). Although the portion (122) is illustrated as being positioned below the portion (121), the positional relationship between the portions (121, 122) is not limited to the embodiment. The portion (122) can be referred to as a browser portion of a viewer application. Through the portion (122), the electronic device (101) can display first text (131) and an image (132) included in the electronic document.
[0026] Referring to FIG. 1, the electronic device (101) can display executable objects, each corresponding to a function for editing an electronic document, on a portion (123) on the display (110). Although portion (123) is illustrated as being positioned below portion (122), the positional relationship between portions (122, 123) is not limited to the embodiment. For example, portion (123) can be overlapped on portion (122) in the form of a pop-up window. For example, portion (123) can be conditionally displayed based on user input.
[0027] For example, the executable objects displayed through the portion (123) may each correspond to a function for adding text entered via a software keyboard (or virtual keyboard) or a physical keyboard paired with the electronic device (101) to an electronic document, a function for adding at least one stroke having a shape similar to a pen drawing of a ballpoint pen to the electronic document, a function for adding at least one stroke having a shape similar to a pen drawing of a liner to the electronic document, a function for removing one or more strokes added to the electronic document (e.g., strokes representing hand-writing and / or hand-drawing), a function for selecting strokes added to the electronic document (e.g., a lasso function), a function for identifying texts having a particular font from a plurality of strokes, and / or a function for at least partially undoing editing actions applied to the electronic document.
[0028] Referring to FIG. 1, the electronic device (101) may display executable objects for changing or replacing a screen (e.g., a screen including parts (121, 122, 123) and based on the execution of a viewer application) being displayed through the display (110) on a portion (124) on the display (110) with another screen. The executable objects displayed through the portion (124) may each correspond to a function for displaying another screen that was displayed before the screen being displayed through the display (110) within a state (191) (e.g., a back function), a function for displaying a designated screen referred to as a launcher screen (or home screen) (e.g., a home function), and / or a function for displaying a list of one or more screens that were displayed on the display (110) (or executed by the electronic device (101).
[0029] Referring to FIG. 1, an exemplary state (191) of an electronic device (101) displaying a first text (131) in a first language (e.g., English) is illustrated. Within the state (191), the electronic device (101) may receive a first input for translating the first text (131). For example, within the state (191), the electronic device (101) may receive an input for selecting the first text (131).
[0030] For example, the input may be detected based on a drag gesture performed over a portion of the display (110) on which the first text (131) is displayed. The drag gesture may be detected based on a path or trajectory of a finger on the display (110) that wraps around the first text (131) and / or is dragged along a direction (e.g., horizontal direction) in which the first text (131) is displayed. The input may be detected based on a tap gesture (or a long-touch gesture, detected based on a finger remaining in contact with the display (110) for more than a specified period of time, such as 1.5 seconds) performed over a portion of the display (110) on which the first text (131) is displayed. The input may include an input indicating a selection of an executable object displayed on the display (110), such as a visual object corresponding to a translation function for the entire electronic document and / or a portion of the electronic document. The above input can be detected based on an audio signal including an utterance indicating a translation of the first text (131) (e.g., "Translate the text displayed on the screen"). The audio signal may further include, along with the utterance, a reserved word (or spot keyword) for voice processing of the electronic device (101) (e.g., "Hey Bixby").
[0031] Referring to FIG. 1, an electronic device (101) that receives an input for translating a first text (131) may display a pop-up menu (140) for receiving setting values related to the translation. The pop-up menu (140) may be displayed on a point on the display (110) that received the input (e.g., a point corresponding to a position of a finger that was in contact with the display (110) to perform a tap gesture) and / or on another point on the display (110) adjacent to the point. The shape, size, and / or location at which the pop-up menu (140) is displayed are not limited to the above-described locations.
[0032] Referring to FIG. 1, the electronic device (101) may obtain or display, through a pop-up menu (140), information required to translate a first text (131) (or all texts included in an electronic document). The information may include a first language (or source language) of the first text (131) to be translated by a translation service provided by the electronic device (101), and a language (e.g., a target language) of another text to be provided as a result of the translation service. In one embodiment, the electronic device (101) may (automatically) detect or determine the first language (e.g., English) of the first text (131). The electronic device (101) may receive, through the pop-up menu (140), an input for changing the source language and / or the target language.
[0033] Referring to FIG. 1, an exemplary operation of an electronic device (101) performing translation from English to Korean is illustrated. The electronic device (101) may display text (e.g., "English → Korean") indicating that translation from English to Korean is performed within a pop-up menu (140). The electronic device (101) may display an icon (e.g., an icon including a shape in the shape of an "x") for stopping the display of the pop-up menu (140) along with the text within the pop-up menu (140). Based on an input selecting the icon, the electronic device (101) may at least temporarily stop displaying the pop-up menu (140). In one embodiment, the electronic device (101) may stop translating the first text (131) based on the input. If the above input is received after the completion of the translation of the first text (131), the electronic device (101) can hide the pop-up menu (140) from the display (110) and stop displaying the translation result of the first text (131) on the display (110).
[0034] Referring to FIG. 1, based on an input for translating a first text (131) in a first language, the electronic device (101) may obtain a second text (150) in a second language, translated from the first text (131) in the first language. The operation of translating the first text (131) (or the translation function for the first text (131)) may include an operation of generating and / or obtaining a second text (150) that includes characters, words, and / or sentences defined by a second language different from the first language of the first text (131), while maintaining the content of the first text (131) (e.g., context, contextual meaning, intent, and / or semantic representation). For example, the second text (150) in the second language may have the contextual meaning of the first text (131) in the first language.
[0035] Referring to FIG. 1, an exemplary state (192) is illustrated in which an electronic device (101) that has acquired a second text (150) displays the second text (150) on a display (110). Referring to states (191, 192), the electronic device (101) may display the second text (150) on a location in an electronic document (or a location within a portion (122) of the display (110)) where the first text (131) of the first language was displayed. For example, the electronic device (101) that displayed the first text (131) on an image (132) within the electronic document may display the second text (150) on the image (132). For example, the electronic device (101) may, when displaying the second text (150), at least temporarily stop displaying the first text (131). For example, the electronic device (101) can hide the first text (131) on the display (110) and / or from the electronic document. For example, the electronic device (101) can replace or change the first text (131) with the second text (150).
[0036] Referring to FIG. 1, an electronic device (101) that executes a translation function for a first text (131) may, when displaying a translation result (e.g., a second text (150)) of the first text (131), display a visual object indicating that the translation result was generated using the translation function. Furthermore, the electronic device (101) may inject (or embed) the visual object into an electronic document. In the present disclosure, a visual object that is displayed together with the translation result or inserted together with the translation result into an electronic document may be referred to as a watermark.
[0037] Referring to FIG. 1, an exemplary watermark (151) is illustrated that is displayed together with a second text (150) in a second language. The watermark (151) is illustrated as including designated text such as “AI (artificial intelligence) translated,” but the embodiment is not limited thereto. For example, the watermark (151) may include at least one of the name of a software application associated with the translation function (e.g., a package name), the name of the translation function and / or the name of the translation service. For example, the watermark (151) may include at least one of an identifier of a user logged into the software application that executed the translation function (e.g., the user’s organization name, name, nickname, and / or ID), the time the translation function was executed (e.g., a timestamp), and / or an icon representing the translation function. For example, the watermark (151) may be a combination of the above-exemplified elements.
[0038] Referring to FIG. 1, a watermark (151) may be overlapped with other content (e.g., second text (150) and / or image (132)) within an electronic document. The watermark (151) may be positioned beneath other content of the electronic document within a virtual page (or pages) expressed by the electronic document. The virtual page may be set within the electronic document to visualize the form of the electronic document within an actual page when the electronic document is printed. For example, the virtual page may be set to correspond to the size of an actual page (e.g., an A4 sheet and / or a US letter sheet). For example, the watermark (151) may be displayed as a background of the virtual page. Referring to FIG. 1, a watermark (151) is illustrated as being overlapped with (or positioned beneath) second text (150) translated from first text (131), but the position of the watermark (151) is not limited thereto.
[0039] Referring to FIG. 1, in state (192), the electronic device (101) may receive an input for saving an electronic document displayed through the display (110). The electronic device (101) receiving the input may generate or store a file (160) representing the electronic document. The file (160) may be transmitted not only to the electronic device (101) but also to an external electronic device different from the electronic device (101) (e.g., distribution via the Internet). In one embodiment, the electronic device (101) may prevent forgery and / or alteration of the file (160), particularly, alteration of the result of executing a translation function (e.g., second text (150)) and / or alteration of the watermark (151).
[0040] For example, when the second text (150) of the file (160) is altered (independently of the watermark (151)), the source of the file (160) indicated by the watermark (151) (e.g., the user who created the file (160), and / or the translation service and / or viewer application used to create the second text (150)) will be mistaken as having created the altered second text (150). For example, when only the watermark (151) is removed from the file (160), the second text (150) of the file (160) will be mistaken as the original content of the electronic document. Alternatively, if only the watermark (151) is removed from the file (160) (independently of the second text (150)), the second text (150) and / or the file (160) will be mistaken as having been generated from a different source than the translation service indicated by the watermark (151) as a new watermark is inserted into the file (160).
[0041] According to one embodiment, the electronic device (101) can create an indivisible (or inseparable) relationship between a watermark (151) and content of an electronic document (e.g., the second text (150) and / or the image (132)) within a file (160) containing the second text (150), which is a translation result. Based on the inseparable relationship, an action that removes only the watermark (151) from the file (160) can be blocked. Based on the inseparable relationship, an action that modifies the second text (150) independently of the watermark (151) can be prevented.
[0042] According to one embodiment, the electronic device (101) can create the inseparable relationship within a file (160) that follows a standard (e.g., a standard for storing electronic documents) referred to as a portable document format (PDF). For example, the electronic device (101) can create or store an electronic document (or a file (160) including the electronic document) that is readable by any viewer application that supports PDF. For example, the electronic device (101) can create or store a file (160) that is compatible between viewer applications.
[0043] Referring to FIG. 1, a schematic block diagram for explaining the structure of a file (160) generated by an electronic device (101) is illustrated. The structure of the file (160) illustrated in FIG. 1 may be related to PDF. The file (160) may include a header (161) (or header area), a body (162) (or body area), a cross-reference table (163) (or cross-reference table area and / or reference area), and / or a trailer (164) (or trailer area). Within the file (160), each of the header (161), the body (162), the cross-reference table (163), and the trailer (164) may be surrounded by a designated code and / or a designated identifier.
[0044] In one embodiment, areas of a file (160) may be configured to store information defining an electronic document. For example, within a header (161) of a file (160), a PDF version (or PDF standard) used to generate the file (160) and / or the electronic document represented by the file (160) may be stored. For example, within a body (162) of a file (160), information representing one or more objects constituting the content of the electronic document (e.g., object information and / or content objects) may be stored. A PDF may be defined to store the content of an electronic document as a set of information referred to as "objects." For example, objects (162-1, 162-2) located within the body (162) of a file (160) may represent second text (150) and an image (132), respectively, included in the electronic document. An object may be referred to as a document object and / or a document element.
[0045] For example, information indicating the locations of a plurality of objects included in a body (162) may be stored within a cross-reference table (163) of a file (160). For example, information indicating the location (or size) of a cross-reference table (163) within the file (160) and / or the top-level object among a plurality of objects included in the body (162) may be stored within a trailer (164) of the file (160).
[0046] Table 1 illustrates exemplary codes included in a file (160) following the PDF. Objects (162-1, 162-2) of FIG. 1 may correspond to any one of the first to fourth objects illustrated in Table 1. The file (160) may include binary data representing (or encoded from) the codes described in Table 1.
[0047]
[0048] Referring to Table 1, objects stored in the body (162) may be surrounded by reserved words including numbers (e.g., 10, 20, 30, 40) uniquely assigned to each of the objects. Referring to Table 1, the cross-reference table (163) may be distinguished from other areas by a reserved word ("xref") indicating the start of the cross-reference table (163) within the file (160). Referring to Table 1, the trailer (164) may be set from a reserved word ("trailer") specified within the file (160) to a reserved word ("%%EOF") indicating the end of the file (160). For example, information indicating a first object within the file (160) may be located between a reserved word ("10obj") including the number 10 assigned to the first object and a reserved word ("endobj") indicating the end of the definition of the object. A watermark of an electronic document (e.g., watermark (151)) may be defined by a third object representing the appearance of the watermark and a fourth object representing the content of the watermark.
[0049] According to one embodiment, the electronic device (101) can store a watermark (151) and content of an electronic document (e.g., second text (150) and / or image (132)) in a single object. For example, an inseparable relationship between the watermark (151) and the content can be formed by a single object. An operation of the electronic device (101) to generate an object having an inseparable relationship and a file (160) including the object is described with reference to FIGS. 3, 4, and / or 6. The inseparable relationship formed by the single object is described with reference to FIGS. 5A to 5E. An object generated by the electronic device (101) to form the inseparable relationship is described with reference to FIG. 7.
[0050] According to one embodiment, the electronic device (101) may selectively remove the watermark (151) when identifying an electronic document from a file (160) based on an inseparable relationship between the watermark (151) and the content of the electronic document. Referring to state (192) of FIG. 1 , since the watermark (151) overlaps the second text (150), the readability (or visibility) of the second text (150) may be at least partially impaired. To prevent a reduction in the readability of other content of the electronic document caused by the watermark (151), the electronic device (101) may at least temporarily release the inseparable relationship.
[0051] For example, the electronic device (101) can reduce the reduction in readability caused by the watermark (151) while maintaining the compatibility of the file (160). For example, the electronic device (101) can create an object representing the inseparable relationship at the time of creating the file (160), and can further store data for bypassing the inseparable relationship (e.g., information for selectively displaying the second text (150) among the second text (150) and the watermark (151)) within the object. The data can be used based on a specific condition. The specific condition can be set based on a user who can view the file (160) without the watermark (151) and / or a password associated with the file (160). An operation of conditionally removing the watermark (151) when the electronic device (101) displays an electronic document represented by the file (160) is described with reference to FIGS. 8 and 9.
[0052] As described above, according to one embodiment, the electronic device (101) can generate a file (160) readable by any viewer application that supports PDF. The electronic device (101) can generate a file (160) representing an electronic document including a watermark (151). The electronic device (101) can block or prevent an action (e.g., a tampering attack) that removes only the watermark (151) by creating an inseparable relationship between the watermark (151) and the content of the electronic document within the file (160). By blocking the action, the electronic device (101) can protect the copyright of the electronic document included in the file (160) and enhance security. The electronic device (101) can resolve the reduction in readability caused by the inseparable relationship by displaying the contents of the electronic document without a watermark (151) when opening (or browsing) a file (160) based on an authenticated viewer application.
[0053] FIG. 2 illustrates a schematic block diagram of an electronic device (101) according to one embodiment. The electronic device (101) of FIG. 2 may include the electronic device (101) of FIG. 1. Referring to FIG. 2, the electronic device (101) may be one of various forms of electronic devices, such as a laptop PC (personal computer) (290), smartphones (291) having various form factors (e.g., a bar-type smartphone (291-1), a foldable smartphone (291-2) having the shape of the electronic device (101) of FIG. 1, or a sliderable (or rollable) type smartphone (291-3)), a tablet PC (292), a head-mounted display (HMD) device (293), a watch (294), and other similar computing devices (not shown).
[0054] In one embodiment, the electronic device (101) may be referred to as a mobile device, a user equipment (UE) (or user terminal), a multi-function device, a portable communication device, a portable device, or a server. The form factor of the electronic device (101) is not limited to the exemplary form factors illustrated in FIG. 2. For example, the electronic device (101) may be included as an electronic control unit (ECU) in a vehicle (e.g., an electric vehicle (EV)). For example, the electronic device (101) may include a projector for projecting light to the outside. For example, the electronic device (101) may have any suitable form for outputting an electronic document. For example, the electronic device (101) may include a printer that outputs ink (or toner) so that the electronic document can be drawn on the surface of an object such as paper. In the present disclosure, the operation of an electronic device (101) displaying an electronic document may include an operation of visualizing the electronic document through a display (110), as well as an operation of outputting at least a portion of the electronic document on a surface of an external object.
[0055] Referring to FIG. 2, according to one embodiment, an electronic device (101) may include a processor (210) and / or a memory (220). The electronic device (101) may further include a display (110). The processor (210) may be electrically and / or operatively coupled with the memory (220) and / or the display (110). Electrical coupling of the electronic components may include a state in which a wired signal path (or a connection for wireless communication) for transmitting signals is established between the electronic components. Operationally coupling of the electronic components may include a state in which the electronic components are directly coupled (or a state in which the electronic components are indirectly coupled) such that one of the electronic components controls another electronic component. Referring to FIG. 2, an electrical connection between the processor (210), the memory (220), and the display (110) based on electronic components, referred to as a communication bus (202), is schematically illustrated. Through a communication bus (202), the processor (210), memory (220), and display (110) can be communicatively coupled.
[0056] Referring to FIG. 2, a processor (210) of an electronic device (101) may include circuits (e.g., processing circuits and / or cores) for performing operations (e.g., arithmetic operations and / or logical operations) on data. Binary codes (e.g., instructions) representing the operations may be input to the processor (210). The processor (210) may include a central processing unit (CPU), a graphic processing unit (GPU), and / or a neural processing unit (NPU). The processor (210) may be referred to as an application processor (AP) and / or a system on a chip (SoC). The processor (210) may have a structure (e.g., a multi-core structure based on a combination of multiple core circuits such as a dual core, a quad core, a hexa core, or an octa core) for loading (or fetching) and / or executing multiple instructions simultaneously. Within an electronic device (101) comprising at least one processor, including a processor (210), the at least one processor may individually or collectively perform the operations of the present disclosure. For example, the at least one processor may individually and / or collectively perform the operations of FIGS. 3 to 4, FIG. 6, FIG. 8, and / or FIG. 9 by executing instructions stored in the memory (220).
[0057] The memory (220) of FIG. 2 may include a circuit for storing data (or instructions) input to or output from the processor (210). The memory (220) may include volatile memory, such as random-access memory (RAM), and / or non-volatile memory, such as read-only memory (ROM). The non-volatile memory may be referred to as storage. The volatile memory may include, for example, at least one of dynamic RAM (DRAM), static RAM (SRAM), cache RAM, and pseudo SRAM (PSRAM). The non-volatile memory may include, for example, at least one of programmable ROM (PROM), erasable PROM (EPROM), electrically erasable PROM (EEPROM), flash memory, hard disk, compact disc, solid state drive (SSD), and embedded multimedia card (eMMC). The memory (220) may include one or more storage media (e.g., the volatile memory and / or non-volatile memory described above) located in a distributed manner in the electronic device (101). The processor (210) of the electronic device (101) may execute instructions of the memory (220) within the electronic device (101) to perform functions and / or operations indicated by the instructions (e.g., the operations of FIGS. 3 to 4, FIG. 6, FIG. 8, and / or FIG. 9).
[0058] The display (110) of the electronic device (101) may include a circuit for visualizing information provided from the processor (210). The display (110) may include a liquid crystal display (LCD), a plasma display panel (PDP), and / or light emitting diodes (LEDs). The LEDs may include organic LEDs (OLEDs). The embodiment is not limited thereto, and the display (110) may include electronic paper. The display area (or active area) of the display (110) may include an area where light is emitted, formed by pixels (e.g., activated pixels) of the display (110). The display (110) may include a sensor (e.g., a touch sensor) for detecting an external object (e.g., a user's finger) on the display (110). The sensor may be included in the display (110) in the form of a panel (e.g., a touch sensor panel (TSP)).
[0059] Referring to FIG. 2, programs (e.g., a viewer application (260) and / or an electronic document library (250)) are illustrated that are executed by a processor (210) to create or read a file (160) representing an electronic document. The programs may be independently installed in memory (220) (e.g., a collection of instructions and resources, referred to as a package) or may be stored in memory (220) as sub-routines of a single program (or an applet or a dynamic link library (DLL)).
[0060] For example, a processor (210) executing a viewer application (260) may display a UI (e.g., the UI illustrated in FIG. 1) of the viewer application (260), including at least a portion of an electronic document represented by a file (160), on the display (110). The processor (210) may execute the viewer application (260) in response to an input for opening and / or browsing the file (160). The processor (210) executing the viewer application (260) may execute a rendering engine (251) included in the electronic document library (250) so that at least a portion of the electronic document (e.g., a portion corresponding to the shape and / or size of the display (110) and / or browser portion) is displayed. The processor (210) executing the rendering engine (251) may store an image (e.g., raster graphics) representing at least a portion of the electronic document in the electronic document view (252) for storing the rendering result of the electronic document. The processor (210) may execute the electronic document manager (253) to control the creation, display, and / or storage of the electronic document.
[0061] The processor (210) that identifies the electronic document represented by the file (160) may support a function (e.g., a summary function and / or a translation function) for generating content related to the electronic document. For example, the processor (210) may execute a summary service (261) of the viewer application (260) to obtain a text in which the content of the electronic document is summarized. The operation of summarizing the electronic document may include an operation of generating at least one natural language sentence describing the content. The at least one natural language sentence generated by the operation of summarizing the electronic document may have a length and / or size less than the length and / or size of the content of the electronic document. For example, the processor (210) may execute a translation service (262) of the viewer application (260) to execute a translation function for at least a portion of the content of the electronic document (e.g., the first text (131) of FIG. 1).
[0062] In order to support the summary function and translation function based on the summary service (261) and the translation service (262), respectively, the processor (210) may execute an artificial intelligence model (270). The artificial intelligence model (270) is a computational model designed to simulate human neural activities (e.g., reasoning activities, creative activities, cognitive activities), and may include a program, hardware (e.g., NPU and / or GPU), or any combination thereof for performing calculations represented by the computational model. The artificial intelligence model (270) may be executed independently by the processor (210) and / or the electronic device (101) (e.g., on-device and / or stand-alone). The embodiment is not limited thereto, and the electronic device (101) may communicate with an external electronic device (e.g., a server) configured to execute the artificial intelligence model (270) to execute functions (e.g., summary functions and / or translation functions) based on the artificial intelligence model (270). To communicate with external electronic devices, the electronic device (101) may further include communication circuitry (and / or a modem). The artificial intelligence model (270) of FIG. 2 may include the generative AI model (1130) of FIG. 11.
[0063] For example, the processor (210) may execute a translation function based on an artificial intelligence model (270) (or a translation model (272)) based on a user input. For example, the processor (210) may execute a summary function based on an artificial intelligence model (270) (or a summary model (271)) based on another user input. When executing the translation function, the processor (210) may display a translation result (e.g., the second text (150) of FIG. 1) obtained from the translation model (272) on the display (110). The processor (210) may display the translation result on the display (110) based on the execution of the rendering engine (251).
[0064] According to one embodiment, the processor (210) may execute a viewer application (260) to generate or store a file (160) representing an electronic document including the translation result. Within the file (160), a watermark (e.g., watermark (151) of FIG. 1) indicating that a translation function has been applied to the electronic document, as described above with reference to FIG. 1, may be stored together with the translation result. The watermark may be set to have an inseparable relationship with the translation result within the file (160).
[0065] Hereinafter, with reference to FIG. 3, the operation of an electronic device (101) and / or a processor (210) that executes a viewer application (260) to create a file (160) is described.
[0066] FIG. 3 illustrates a flowchart of exemplary operations of an electronic device for generating an electronic document including a watermark. The electronic device (101) of FIGS. 1 and 2 may perform the operations described with reference to FIG. 3 . For example, at least one of the operations of FIG. 3 may be performed by the electronic device (101) and / or the processor (210) of FIG. 2 . The order of the operations illustrated in FIG. 3 is exemplary, and the embodiment is not limited thereto. For example, the electronic device may perform the operations of FIG. 3 in a different order than the operations illustrated in FIG. 3 . For example, the electronic device may perform at least two of the operations of FIG. 3 substantially simultaneously.
[0067] Referring to FIG. 3, in operation (310), according to one embodiment, an electronic device may identify a file containing an electronic document (e.g., file (160) of FIG. 1 and / or FIG. 2). For example, the electronic device may perform operation (310) based on receiving a file from a network. For example, the electronic device may perform operation (310) based on receiving an input for executing a file using a software application (e.g., viewer application (260) of FIG. 2). For example, the electronic device may perform operation (310) based on receiving the input through the software application.
[0068] Referring to FIG. 3, in operation (320), according to one embodiment, an electronic device may identify a first text in a first language from a file. The first text of operation (320) may include the first text (131) of FIG. 1. The electronic device may identify the first text in the first language by parsing (or decoding) one or more objects included in the file of operation (310). Based on the identification of operation (320), the electronic device may display the identified first text on a display (e.g., display (110) of FIG. 1 and / or FIG. 2).
[0069] Referring to FIG. 3, in operation (330), according to one embodiment, an electronic device may execute a translation function for a first text in a first language. The electronic device may perform operation (330) in response to an input for executing the translation function described with reference to FIG. 1. The translation function may be performed by an on-device model (e.g., an artificial intelligence model (270) and / or a translation model (272) of FIG. 2) designed to be executed by a processor of the electronic device (e.g., a processor (210) of FIG. 2). The embodiment is not limited thereto, and the electronic device may request a translation of the first text from an external electronic device including an artificial intelligence model. The electronic device may receive a translation result for the first text from the external electronic device that received the request.
[0070] Referring to FIG. 3, in operation (340), according to one embodiment, an electronic device may determine the location, shape, and / or size of a second text in a second language (e.g., the second text (150) of FIG. 1 ) translated from a first text within an electronic document. For example, the electronic device may determine the layout and / or style of the second text. The electronic device may determine the shape of the second text within the electronic document.
[0071] Referring to FIG. 3, in operation (350), according to one embodiment, the electronic device may display an electronic document including second text. For example, based on the position, shape, and / or size determined based on operation (340), the electronic device may display the electronic document including the second text on the display. When displaying the electronic document based on a viewer application (e.g., the viewer application (260) of FIG. 2), the electronic device may display at least a portion of the electronic document on at least a portion of the UI of the viewer application (e.g., portion (122) of FIG. 1).
[0072] Referring to FIG. 3, in operation (360), according to one embodiment, an electronic device may receive an input for storing an electronic document. The input may be received through a UI of a viewer application. For example, the electronic device may display a visual object in the form of a button for receiving the input. In the example, the input of operation (360) may include an input indicating selection of the visual object (e.g., a tap gesture and / or a mouse click). The electronic device, upon receiving the input of operation (360), may perform operations (370, 380).
[0073] Referring to FIG. 3, in operation (370), according to an embodiment, an electronic device may obtain data by encoding a second text based on a password. Based on receiving an input of operation (360), the electronic device may display a UI (e.g., a pop-up window (371)) on the display for obtaining a password to be used for encrypting the second text. The password received through the operation UI may be, for example, an owner password among an owner password or a user password of a PDF, but is not limited thereto. Through the UI, the electronic device may receive another input for inputting the password. Based on the other input received through the UI, the electronic device may encrypt the second text with the password to generate data (e.g., encoded data and / or encrypted data) of operation (370).
[0074] Referring to FIG. 3, a pop-up window (371), which is an example of the UI, is illustrated. The pop-up window (371) may include text boxes (372, 373) for receiving a password. If the passwords received through each of the text boxes (372, 373) match, the electronic device may obtain a password to be used for encoding the second text. For example, if the passwords received through each of the text boxes (372, 373) are different, the electronic device may request the user to re-enter the password.
[0075] Referring to FIG. 3, the pop-up window (371) may include a visual object (374) (e.g., a button containing designated text such as "Done") for initiating encoding based on a password entered through text boxes (372, 373). The pop-up window (371) may include a visual object (375) (e.g., a button containing designated text such as "Cancel") for stopping displaying the pop-up window (371). For example, upon receiving an input for selecting the visual object (375), the electronic device may not store the electronic document of the operation (360). For example, the electronic device may stop displaying the pop-up window (371). Upon receiving an input for selecting the visual object (375), the electronic device may re-display a screen that was displayed before displaying the pop-up window (371) (e.g., a screen that was displayed at the time of performing the operation (350)). An electronic device that receives an input indicating selection of a visual object (374) while the passwords received through each of the text boxes (372, 373) match each other can perform encoding of a second text using the passwords received through the text boxes (372, 373).
[0076] Based on the input of operation (360) (e.g., input for storing a second text in a second language), the electronic device may encode the second text in the second language to generate encoded data. In terms of including the second text encrypted using a password, the data of operation (370) may be referred to as encrypted data. The encrypted data may include the second text, which is readable based on decryption based on the password.
[0077] Referring to FIG. 3, in operation (380), according to one embodiment, an electronic device may generate and / or store a file (e.g., file (160) of FIGS. 1 and / or 2) including an image including a second text and a watermark (e.g., watermark (151) of FIG. 1), and data of operation (370) (e.g., encoded data and / or encrypted data). The watermark may be located on a specific page within an electronic document where the second text is located. The image and the data may have an inseparable relationship within the file, as described above with reference to FIG. 1. For example, the image and the data may be included within a single object (e.g., objects (162-1, 162-2) of FIG. 1) within the file. When displaying the image, the electronic device may display both the watermark and the second text. When decrypting the data, the electronic device may display only the second text represented by the decrypted data, without the watermark.
[0078] As described above with reference to FIG. 3, the electronic device may align the second text obtained by executing a translation function (e.g., translation based on an artificial intelligence model) within an electronic document. While displaying the electronic document including the second text, the electronic device may further receive user input for editing the electronic document. Upon receiving the user input, the electronic device may at least partially modify the electronic document based on the user input. Upon receiving the input of operation (360), the electronic device may generate a file for re-displaying the electronic document at the time the input was received.
[0079] Below, with reference to FIG. 4, the operation of the electronic device performing operation (380) is described in more detail.
[0080] FIG. 4 illustrates a flowchart of operations of an electronic device that generates an electronic document including exemplary content generated by executing an artificial intelligence model (e.g., artificial intelligence model (270) of FIG. 2). The electronic device (101) of FIGS. 1 and 2 may perform the operations described with reference to FIG. 4. For example, at least one of the operations of FIG. 4 may be performed by the electronic device (101) and / or the processor (210) of FIG. 2. The operations illustrated in FIG. 4 may be related to or included in at least one of the operations of FIG. 3 (e.g., operation (380)). The order of the operations illustrated in FIG. 4 is exemplary, and the embodiment is not limited thereto. For example, the electronic device may perform the operations of FIG. 4 in a different order than the operations illustrated in FIG. 4. For example, the electronic device may perform at least two of the operations of FIG. 4 substantially simultaneously.
[0081] Referring to FIG. 4, in operation (410), according to an embodiment, an electronic device may identify text (e.g., second text (150) of FIG. 1) generated from content of an electronic document using an artificial intelligence model (e.g., translation model (272) of FIG. 2). When the electronic device acquires text by executing a translation function, the electronic device may insert a flag (or a flag indicating a combination of a watermark (e.g., watermark (151) of FIG. 1)) indicating that the text was generated based on the artificial intelligence model into an object corresponding to the text. The electronic device, which has identified the text of operation (410), may perform operation (420).
[0082] Referring to FIG. 4, in operation (420), according to one embodiment, an electronic device may combine identified text and a watermark to generate an image including the identified text and the watermark. If the electronic document has multiple pages, the electronic device may insert or add a watermark to a specific page including the text of operation (410). The electronic device may generate an image representing the combination of the text and the watermark of operation (410). Within the image, the text may be superimposed on the watermark. The order and / or positions of the text and the watermark within the image may vary depending on the embodiment.
[0083] Referring to FIG. 4, in operation (430), according to an embodiment, an electronic device may add an object including a generated image (e.g., objects 162-1 and 162-2 of FIG. 1) to an electronic document in order to generate an electronic document with an inserted watermark. The object may be included in a file representing the electronic document such that the image representing the combined appearance of the watermark and the text is included in the electronic document. In an embodiment, when the electronic document includes a plurality of (virtual) pages, the electronic device may add the object of operation (430) to at least one page among the plurality of pages where text generated using a translation function is to be located. For example, a watermark may be placed on at least one page among the plurality of pages where text identified based on the translation function of operation (410) is located. For example, an object representing the combined appearance of the watermark and the text may be placed on the at least one page.
[0084] For example, editing content within an electronic document may be performed in units of multiple objects included in the electronic document. For example, when the object is removed, all text and watermarks expressed by the image may be removed from the electronic document. For example, the electronic device may add an object of operation (430) representing the inseparable relationship between text and watermark to the electronic document. The object of operation (430) may have a format similar to the first to fourth objects of Table 1.
[0085] As described above, the electronic device can generate or store an electronic document that includes a watermark that is linked to other content within the electronic document (e.g., the text of operation (410)) so that only the watermark is removed from the electronic document. Since removing the watermark causes the deletion of other content within the electronic document (i.e., damage to the electronic document), the difficulty of forgery of the electronic document based on the removal of the watermark can increase.
[0086] Hereinafter, with reference to FIGS. 5A to 5E, exemplary operations of an electronic device that receives an input for editing an electronic document including an object of operation (430) are described.
[0087] FIGS. 5A, 5B, 5C, 5D, and 5E illustrate the operation of an electronic device (101) that receives an input for at least partially editing an electronic document including a watermark (151). The electronic device (101) of FIGS. 1 and 2 can perform the operations described with reference to FIGS. 5A to 5E.
[0088] Referring to FIG. 5A, an exemplary state (501) of an electronic device (101) displaying an electronic document of operation (430) of FIG. 4 is illustrated. Within the state (501), the electronic device (101) may display at least a portion of the electronic document, including a second text (150) indicating a translation result, a watermark (151) indicating that the second text (150) was obtained by executing a translation function, an image (132), and a table (510). The electronic device (101) may display the watermark (151) overlapping the second text (150) indicating the translation result. For example, the watermark (151) may be displayed as being positioned below the second text (150). The embodiment is not limited thereto, and the watermark (151) may be displayed or positioned on the second text (150). When displaying an electronic document by executing a viewer application (e.g., the viewer application (260) of FIG. 2), the electronic device (101) may display at least a portion of the electronic document through a portion (122), which is a browser portion. For example, based on a swipe gesture performed on the portion (122) (e.g., a drag gesture based on two fingers contacting the portion (122), the electronic device (101) may change a portion of the electronic document displayed on the portion (122) (e.g., a scroll). In response to another gesture performed on the portion (122) (e.g., a pinch-to-zoom gesture based on two fingers contacting each other), the electronic device (101) may zoom in or out of the electronic document displayed through the portion (122).
[0089] The watermark (151) of FIG. 5A may be included in the image of the operation (380) of FIG. 3 and / or the operation (420) of FIG. 4. When the electronic device (101) receives an input for deleting the watermark (151), it may delete the image including the watermark (151). As described above with reference to FIGS. 1 to 4, since the image includes the watermark (151) and other content within the electronic document, deleting the image may result in the deletion of not only the watermark (151) but also the other content.
[0090] For example, an electronic device (101) displaying an image including a watermark (151) and a second text (150) may switch to a state (502) in response to an input for deleting the watermark (151). Within the state (502), the electronic device (101) may display an electronic document in which not only the watermark (151) but also the second text (150) has been deleted. For example, an image including a watermark (151) and a second text (150) may represent the appearance of the watermark (151) combined with the second text (150). The electronic device (101) that receives an input for deleting the watermark (151) may delete the image, i.e., the appearance of the watermark (151) combined with the second text (150).
[0091] While one embodiment of combining a watermark (151) with a translation result (e.g., second text (150)) has been described, the embodiment is not limited thereto. For example, the electronic device (101) may combine a watermark (151) and an image (132). In the above example, the electronic device (101) that receives an input indicating deletion of a watermark (151) may display at least a portion of the electronic document from which the watermark (151) and the image (132) have been entirely deleted, as in state (503).
[0092] As another example, the electronic device (101) may generate an image including the entire watermark (151) and the table (510). While displaying the image, the electronic device (101) that receives an input for deleting the watermark (151) may transition to a state (504). Within the state (504), the electronic device (101) may display at least a portion of the electronic document from which the entire watermark (151) and the table (510) have been deleted.
[0093] As another example, the electronic device (101) may generate an image of an entire specific page of an electronic document including a watermark (151). While displaying the image, the electronic device (101) that identifies a request to delete the watermark (151) may display the electronic document with the content of the entire specific page removed, as in state (505). For example, the specific page may be changed to a blank page in response to the request.
[0094] As described above, according to one embodiment, the electronic device (101) can associate or link the watermark (151) with various objects (e.g., text, images, tables, forms, paths, and / or shading objects) within a page. For example, the electronic device (101) can generate or store a watermark (151) that is at least partially fused with content included in an electronic document. The watermark (151) can be deleted and / or moved together with at least a portion of the content fused with the watermark (151). For example, deleting the watermark (151) can cause loss of the electronic document, thereby weakening the motivation of an attacker to falsify the electronic document. Accordingly, the electronic device (101) can generate or store an electronic document that is robust to falsification. In other words, the electronic device (101) can enhance the security of electronic documents.
[0095] Hereinafter, with reference to FIG. 6, an exemplary operation of an electronic device (101) that merges the content of an electronic document and a watermark (151) is described.
[0096] FIG. 6 illustrates the operation of an electronic device that generates an electronic document including encoded data together with a watermark (e.g., the watermark (151) of FIG. 1). The electronic device (101) of FIGS. 1 and 2 may perform the operations described with reference to FIG. 6. For example, at least one of the operations of FIG. 6 may be performed by the electronic device (101) and / or the processor (210) of FIG. 2. The operations illustrated in FIG. 6 may be related to or included in the operations of FIGS. 3 and / or 4. The order of the operations of FIG. 6 is exemplary, and the embodiment is not limited thereto. For example, the electronic device may perform the operations of FIG. 6 in a different order than the operations illustrated in FIG. 6. For example, the electronic device may perform at least two of the operations of FIG. 6 substantially simultaneously.
[0097] Referring to FIG. 6, in operation (610), according to an embodiment, an electronic device may identify n objects representing an electronic document. The objects may include objects (162-1, 162-2) of FIG. 1. n of operation (610) may be the number of objects included in a file representing the electronic document (e.g., included in body (162) of FIG. 1). For example, if the electronic device identifies a code of Table 1, the electronic device may identify four objects (e.g., the first to fourth objects of Table 1). Having identified the n objects, the electronic device may scan (e.g., sequentially check) the n objects to determine whether to change each of the n objects into an object combined with a watermark, as described below with reference to operations (620, 630, 640, and 650).
[0098] Referring to FIG. 6, in operation (620), according to one embodiment, the electronic device may check whether the k-th object includes text based on an artificial intelligence model (e.g., the translation model (272) of FIG. 2). If the electronic device identifies n objects, the electronic device may perform operation (620) starting from the first object. For example, the electronic device may check a flag indicating whether the k-th object includes text based on the artificial intelligence model. For example, the electronic device may manage a list of one or more objects generated based on the artificial intelligence model and perform operation (620) using the list. If the k-th object includes text based on the artificial intelligence model (620 - Yes), the processor may perform operation (630). If the k-th object does not include text based on the artificial intelligence model (620 - No), the processor may perform operation (640).
[0099] Referring to FIG. 6, in operation (630), according to one embodiment, the electronic device may change the k-th object into an image including text and a watermark (e.g., watermark (151) of FIG. 1), and another object including data obtained by encrypting the text. The image may include a watermark and text. The image may express the appearance and / or appearance of text superimposed on the watermark. The image may correspond to a portion of the electronic document where the text and the watermark are located. The data of operation (630) may correspond to the data of operation (370) of FIG. 3. The other object of operation (630), from the perspective of including a watermark, may be referred to as a watermark object.
[0100] Referring to FIG. 6, in operation (640), according to an embodiment, the electronic device may determine whether all n objects of operation (620) have been checked. For example, when using a variable k starting from 1 to check whether each of the n objects includes text based on an artificial intelligence model, the electronic device may determine whether the variable k is less than n. If the variable k is less than n (640—Yes), or if not all n objects have been checked, the electronic device may perform operation (650). If the variable k is greater than or equal to n, or if all n objects have been checked (640—No), the electronic device may perform operation (660).
[0101] Referring to FIG. 6, in operation (650), according to one embodiment, the electronic device may increase the variable k by 1. Using the variable k starting from 1, when checking whether each of the n objects includes text based on the artificial intelligence model, the electronic device may increase the variable k by 1 to perform operation (620) for the k+1th object. Having performed operation (650), the electronic device may perform operation (620) again. Based on operations (620, 630, 640, 650), among the n objects, one or more objects including text based on the artificial intelligence model may be changed based on operation (630).
[0102] Referring to FIG. 6, in operation (660), according to one embodiment, an electronic device may generate and / or store a file (e.g., file (160) of FIG. 1) containing n objects. For example, the electronic device may generate a file representing an electronic document expressed by the n objects. After checking all of the n objects based on operations (620, 630, 640, 650), the electronic device may perform operation (660). The file stored based on operation (660) may include the code illustrated in Table 1. Within the file stored based on operation (660), a watermark may be fused with the content of the electronic document (e.g., the text of operation (620)).
[0103] As described above, according to one embodiment, the electronic device can link or merge text, which is a translation result (or a result of executing an artificial intelligence model), with a watermark within a file. By storing an image representing a watermark merged with the text within the file, the electronic device can generate an electronic document in which even the text is deleted by an attack that deletes the watermark. For example, the electronic device can generate a file including an image and an object combined with the data, in order to display either the image of the operation (630) or the text of the operation (620), based on decryption of the data (e.g., encoded data and / or encrypted data) of the operation (630) according to the execution of a software application (e.g., the viewer application (260) of FIG. 2).
[0104] Below, with reference to FIG. 7, an exemplary structure of another object generated based on the operation (630) is described.
[0105] FIG. 7 illustrates a schematic diagram of a file (160) representing an electronic document generated by an electronic device according to one embodiment. The electronic device (101) of FIGS. 1 and 2 may perform the operations of the electronic device described with reference to FIG. 7. For example, the operations of the electronic device described with reference to FIG. 7 may be performed by the electronic device (101) and / or the processor (210) of FIG. 2. The operations of the electronic device described with reference to FIG. 7 may be related to the operations of FIGS. 3, 4, and / or 6.
[0106] Referring to FIG. 7, a block diagram of a file (160) representing an electronic document fused with a watermark is illustrated. For example, an electronic device may generate an object (162-1) including text representing a translation result (e.g., the second text (150) of FIG. 1), an image including a watermark, and data encoded with the text. The electronic device may generate a file (160) including the generated object (162-1), or store it (in the memory (220) of FIG. 2). In one embodiment, the electronic device may insert or add information (e.g., tags, codes, and / or objects corresponding to the content) for separating and / or extracting content (e.g., the text) of the electronic document fused with the watermark (together with the image) into the object (162-1).
[0107] Referring to FIG. 7, the structure of an object (162-1) is illustrated. The object (162-1) may include an image area (710) where an image representing the content of an electronic document and a combination of a watermark are stored, and a reserved area (720). Within the reserved area (720), the electronic device may store data regarding the content of the electronic document combined with the watermark. The data stored in the reserved area (720) may be decrypted or encrypted based on a password.
[0108] For example, the electronic device may generate a file (160) containing an image in the image area (710) to display the appearance of content overlapping a watermark when data in the reserved area (720) is not decrypted. The image area (710) may include pixel data representing colors of pixels of the image, a color table representing a mapping between binary codes of the colors and pixel data, a bitmap information header including metadata related to the image, and / or a bitmap file header.
[0109] In one embodiment, if the electronic device cannot decode the reserved area (720) or does not have information for decoding the reserved area (720) (e.g., the password of operation (370) of FIG. 3), the electronic device may obtain an image representing a combination of a watermark and content of the electronic document (e.g., the second text (150) of FIG. 1) from an object (162-1) in the file (160). For example, the electronic device may obtain the image from the image area (710) of the object (162-1) when executing the file (160) using a software application that cannot decode the reserved area (720). The electronic device that has obtained the image may display a UI of the software application, which includes at least a portion of the electronic document including the image, on a display (e.g., the display (110) of FIG. 1). A software application that cannot decode the reserved area (720) may include an unauthenticated software application. For example, an electronic device may generate the image to prevent unauthorized software applications from displaying an electronic document without a watermark.
[0110] In one embodiment, if the electronic device can decode the reserved area (720) or has information for decoding the reserved area (720) (e.g., the password of operation (370) of FIG. 3), the electronic device can decode data included in the reserved area (720) of the object (162-1) within the file (160). The software application capable of decoding the reserved area may include an authenticated software application. The electronic device can decode the encoded data of the reserved area (720) to obtain at least one object included in the electronic document (e.g., the second text (150) of FIG. 1). For example, the information obtained by decrypting the encrypted data of the reserved area (720) may include at least one object representing the content of the electronic document. The at least one object, similar to other objects, may be used for rendering the electronic document.
[0111] Referring to FIG. 7, one or more objects that can be encoded in the reserved area (720) are exemplarily illustrated. For example, as described above with reference to state (503) of FIG. 5c, the electronic device can encode an object (e.g., an image object) representing an image included in an electronic document (e.g., an image (132) of FIG. 5a) within the reserved area (720). For example, as described above with reference to state (502) of FIG. 5b, the electronic device can encrypt a code representing an object (e.g., a text object) comprising text within the electronic document (e.g., the second text (150) of FIG. 5a) within the reserved area (720). For example, as described above with reference to state (504) of FIG. 5d, the electronic device can encrypt a code of an object (e.g., a table object) corresponding to a table within the electronic document (e.g., a table (510) of FIG. 5a) within the reserved area (720). The embodiment is not limited thereto, and the electronic device may encrypt the code of an object representing a form (e.g., a form object), an object representing a path (e.g., a path object), and / or an object representing shading (e.g., a shading object) within the reserved area (720).
[0112] The number of objects encoded in the reserved area (720) may vary depending on the embodiment. For example, the electronic device may encode only specific text (e.g., text indicating a translation result) in the reserved area (720). As described above with reference to state (505) of FIG. 5e, the electronic device may encrypt all objects of a specific page of an electronic document in the reserved area (720).
[0113] In one embodiment, an electronic device that obtains content (e.g., text) of an electronic document by decoding data in the reserved area (720) may display a UI of a software application that includes at least a portion of the electronic document including the content on the display. Within the reserved area (720), data for displaying content fused with a watermark without the watermark may be binarized and / or encrypted. An electronic device capable of performing decoding on the reserved area (720) may access the reserved area (720) among the reserved area (720) and the image area (710) to identify an object to be included in the electronic document. An electronic device that does not have information for decoding the reserved area (720) may access the image area (710) among the reserved area (720) and the image area (710) to identify an object representing content including a watermark.
[0114] Below, with reference to FIG. 8, an exemplary operation of an electronic device for rendering an electronic document based on the file (160) of FIG. 7 is described.
[0115] FIG. 8 illustrates a flowchart of exemplary operations of an electronic device for rendering an electronic document from a file (e.g., file (160) of FIG. 1). The electronic device (101) of FIGS. 1 and 2 may perform the operations described with reference to FIG. 8. For example, at least one of the operations of FIG. 8 may be performed by the electronic device (101) of FIG. 2 and / or the processor (210). The operations illustrated in FIG. 8 may be related to the operations of FIGS. 3, 4, and / or 6. The order of the operations of FIG. 8 is exemplary and the embodiment is not limited thereto. For example, the electronic device may perform the operations of FIG. 8 in a different order than the operations illustrated in FIG. 8. For example, the electronic device may perform at least two of the operations of FIG. 8 substantially simultaneously. The operation of FIG. 8 can be performed by an electronic device running a viewer application (e.g., the viewer application (260) of FIG. 2).
[0116] Referring to FIG. 8, in operation (810), according to one embodiment, the electronic device may identify logged-in account information. For example, the electronic device may identify account information associated with (or logged into) a viewer application running on the electronic device. If the account information is identified (810—Yes), the electronic device may perform operation (815). If the account information is not identified (810—No), the electronic device may perform operation (860).
[0117] Referring to FIG. 8, in operation (815), according to one embodiment, an electronic device may identify a file to be displayed on a display (e.g., file (160) of FIG. 1). When a viewer application is executed, the electronic device may display a screen for selecting a file. The screen may include visual objects for navigating the memory of the electronic device based on a directory. Through the screen, the electronic device may receive an input for selecting and / or viewing a file. The electronic device, having identified the file based on the input, may perform operation (820).
[0118] Referring to FIG. 8, in operation (820), according to one embodiment, the electronic device may check whether a password corresponding to the identified file is stored in the account information. For example, the electronic device may, in response to an input for executing a file, search for a password stored in memory and associated with the file. For example, the electronic device may search a database (or list) associated with the account information using the file name of the file identified based on operation (815). Within the database, the electronic device may identify a pair of a file name and a password. The password may be an owner password of the PDF. If the password is stored in the memory and / or the account information (820—Yes), the electronic device may perform operation (845). If the password is not stored in the memory and the account information (820—No), the electronic device may perform operation (825).
[0119] Referring to FIG. 8, in operation (825), according to one embodiment, the electronic device can check whether the electronic document represented by the file includes text generated based on an artificial intelligence model (e.g., the artificial intelligence model (270) of FIG. 2). As described above with reference to FIGS. 1 to 7, the text generated based on the artificial intelligence model can have an inseparable relationship with a watermark (e.g., the watermark (151) of FIG. 1) within the file. If the electronic document does not include the text of operation (825) (825-No) (e.g., the watermark is not included in the electronic document), the electronic device can perform operation (855). If the text generated based on the artificial intelligence model and / or an object representing the text is confirmed from the electronic document (825-Yes), the electronic device can perform operation (830).
[0120] Referring to FIG. 8, in operation (830), according to one embodiment, an electronic device may obtain a password. For example, the electronic device may display a pop-up window including a visual object for receiving a password. If the password is obtained through the pop-up window (830 - Yes), the electronic device may perform operation (835). If the password is not obtained through the pop-up window (830 - No), the electronic device may perform operation (855). If the password of operation (830) is an owner password, the electronic device may perform operation (835). If another password (e.g., a user password of a PDF) is set for the electronic document, the electronic device may further perform authentication based on the other password.
[0121] Referring to FIG. 8, in operation (835), according to one embodiment, the electronic device can check whether the acquired password matches the password included in the file. The electronic device can perform an operation of authenticating the owner password of the PDF to check whether the password of operation (830) matches the password included in the file. If the password of operation (830) matches the password included in the file (835 - Yes), the electronic device can perform operation (840). If the password of operation (830) does not match the password included in the file (835 - No), the electronic device can perform operation (855).
[0122] Referring to FIG. 8, in operation (840), according to one embodiment, the electronic device may store the acquired password in account information. For example, the electronic device may store a pair (or combination) of the file name of operation (815) and the password of operation (830) in a database and / or list linked to the account information. The pair may be stored to omit acquiring the password of operation (830) based on operation (820) when the file is re-executed (or re-opened).
[0123] Referring to FIG. 8, in operation (845), according to one embodiment, an electronic device may identify an object from a file, which is a combination of a watermark and content of an electronic document. The object may be stored in the file based on the operations described with reference to FIGS. 3 to 4 and / or FIG. 6. The object may include object (162-1) of FIG. 7.
[0124] Referring to FIG. 8, in operation (850), according to an embodiment, the electronic device can identify content from which a watermark has been excluded from an object identified based on operation (845). If a password for the file has been retrieved (820 - Yes) or a password has been obtained from the user (830 - Yes), the electronic device can decrypt or decode encoded data within the object (e.g., data stored in the reserved area (720) of FIG. 7) using the password. Based on the decryption, the electronic device can obtain the content of operation (845) (e.g., text representing a translation result).
[0125] Referring to FIG. 8, in operation (855), according to one embodiment, an electronic device may render an electronic document including identified content. Based on the rendering, the electronic device may display at least a portion of the electronic document on a display. If content without a watermark is identified based on operation (850), the electronic device may display the identified content without a watermark on a display (e.g., display (110) of FIG. 1). If there is no logged-in account information (810 - No), the electronic document does not include text generated based on an artificial intelligence model (825 - No), the password was not obtained from the user (830 - No), or the password obtained from the user does not match the password of the file (835 - No), the electronic device may bypass operations (845, 850).
[0126] Referring to FIG. 8, in operation (860), according to one embodiment, an electronic device may identify a file to be displayed on a display. The electronic device, having identified the file of operation (860), may render an electronic document represented by the file of operation (860) based on operation (855).
[0127] Referring to FIG. 8, if the text is identified based on the artificial intelligence model but a password corresponding to the password of the file is not obtained (830-No, and / or 835-No), the electronic device may display an image including the text and a watermark. For example, if the password associated with the file is not stored in memory, the electronic device may display a UI of a software application including at least a portion of an electronic document including the image on the display.
[0128] As described above, an electronic device executing a software application capable of decoding encoded data included in an object may further receive a password and display only the watermark of operation (845) and the content of operation (845). An electronic device executing a software application incapable of decoding the encoded data may display an image including the watermark overlapping the text as at least a portion of an electronic document.
[0129] Below, with reference to FIG. 9, an exemplary operation of an electronic device for determining whether an electronic document includes text generated based on an artificial intelligence model is described.
[0130] FIG. 9 illustrates a flowchart of exemplary operations of an electronic device for checking a plurality of objects constituting the content of an electronic document. The electronic device (101) of FIGS. 1 and 2 may perform the operations described with reference to FIG. 9. For example, at least one of the operations of FIG. 9 may be performed by the electronic device (101) and / or the processor (210) of FIG. 2. The operations illustrated in FIG. 9 may be related to or included in at least one of the operations of FIG. 8 (e.g., operation (825)). The order of the operations of FIG. 9 is exemplary, and the embodiment is not limited thereto. For example, the electronic device may perform the operations of FIG. 9 in a different order than the operations illustrated in FIG. 9. For example, the electronic device may perform at least two of the operations of FIG. 9 substantially simultaneously. The operation of FIG. 9 can be performed by an electronic device running a viewer application (e.g., the viewer application (260) of FIG. 2).
[0131] Referring to FIG. 9, in operation (910), according to an embodiment, an electronic device may identify n objects representing an electronic document. For example, the electronic device may identify n objects from a file representing the electronic document (e.g., file (160) of FIG. 1). The electronic device may identify n objects from a portion of the file (e.g., body (162) of FIG. 1) configured to store objects representing the electronic document. n of operation (910) may represent the number of objects included in the file. Having identified n objects, the electronic device may perform operations (920, 940, 950) to determine whether the electronic document includes content generated based on an artificial intelligence model (e.g., second text (150) of FIG. 1 obtained using a translation model).
[0132] Referring to FIG. 9, in operation (920), according to an embodiment, the electronic device may determine whether the k-th object includes a reserved area (e.g., the reserved area (720) of FIG. 7) in which encrypted data is stored. If the electronic device identifies n objects, the electronic device may perform operation (920) starting from the first object among the n objects. For example, the electronic device may perform operation (920) using a variable k that is initialized to store the natural number 1. If the k-th object includes an image area (710) and a reserved area (720), such as object (162-1) of FIG. 7, the electronic device may determine that the k-th object includes encrypted data. The electronic device that detects the k-th object including encrypted data may perform operation (930). If the k-th object does not include encrypted data (920-No), the electronic device may perform operation (940).
[0133] Referring to FIG. 9, in operation (940), according to one embodiment, the electronic device may determine whether all n objects have been checked. For example, if operation (930) is performed using a variable k initialized to store a natural number 1, the electronic device may determine whether the variable k is less than n. If the variable k is less than n, or not all n objects have been checked (940 - Yes), the electronic device may perform operation (950). If the variable k is greater than or equal to n, or all n objects have been checked (940 - No), the electronic device may perform operation (960).
[0134] Referring to FIG. 9, in operation (950), according to one embodiment, the electronic device may increase the variable k by 1. When checking whether each of the n objects contains encrypted data using the variable k initialized to store the natural number 1, the electronic device may increase the variable k by 1 to perform operation (920) for the k+1th object. Having performed operation (950), the electronic device may perform operation (920) again. By repeatedly performing operations (920, 940, 950), the electronic device may identify at least one object among the n objects that contains encrypted data. As soon as the object containing encrypted data is identified, the electronic device may perform operation (930).
[0135] Referring to FIG. 9, in operation (960), according to one embodiment, the electronic device may determine that the electronic document does not contain content generated based on an artificial intelligence model. For example, if none of the n objects contain encrypted data, the electronic device may perform operation (960).
[0136] Referring to FIG. 9, in operation (930), according to one embodiment, an electronic device may determine that an electronic document includes content generated based on an artificial intelligence model. The electronic device, which has identified an electronic document including content generated based on an artificial intelligence model, may decrypt the encrypted data using a password retrieved from memory. The embodiment is not limited thereto, and if the electronic device has identified content generated based on an artificial intelligence model based on operation (930), it may retrieve a password corresponding to the electronic document of operation (910) (or a file in which the electronic document is stored) from memory. For example, among n objects representing an electronic document, an electronic device that has identified an object that combines encrypted data (or encoded data) and an image may begin decoding the encrypted data.
[0137] As described above, according to one embodiment, an electronic device can at least partially modify the content of an electronic document using an artificial intelligence model. When storing the modified electronic document, the electronic device can insert a watermark indicating a change in the content based on the artificial intelligence model into the electronic document. The watermark can be combined with the content of the electronic document. Based on the format of the PDF object, the electronic device can store an image including the content combined with the watermark, and data for displaying the content without the watermark. The data can be encoded or encrypted based on a password (e.g., an owner password of the PDF). The electronic device can decode the data conditionally upon identifying the password. If the data is decoded, the electronic device can display the content represented by the decoded data instead of displaying the image. If the data is not decoded, the electronic device can display the image. When displaying an image containing content combined with a watermark, an electronic device that receives an input for deleting the watermark can delete not only the watermark but also the content, thereby blocking an action to tamper with the electronic document by deleting the watermark.
[0138] FIGS. 10A, 10B, and 10C illustrate exemplary states of an electronic device (101) performing translation on an electronic document. The electronic device (101) of FIGS. 10A to 10C can perform the operations described with reference to FIGS. 1 to 9.
[0139] Referring to FIG. 10A, a state (1001) is illustrated in which at least a portion of an electronic document is displayed on a display (110). Within the state (1001), the electronic device (101) may display a title of the electronic document (e.g., “guideBook”) on a portion (121) of the display (110). An exemplary state (1001) of the electronic device (101) is illustrated, but the embodiment is not limited thereto, of displaying an electronic document including a first text (1011), a second text (1012), a third text (1013), a fourth text (1014), a fifth text (1015), and a sixth text (1016) in a first language (e.g., English).
[0140] Within state (1001) of FIG. 10A, the electronic device (101) may receive an input for executing a translation function for an electronic document. The input may include an input indicating a selection of an executable visual object (1019) displayed via a portion (121). In response to the input, the electronic device (101) may display a menu (1021) on the display (110), as in state (1002). The menu (1021) may be referred to as a drop-down menu and / or a pop-up menu (or pop-up window). The menu (1021) may include a first item for executing a summary function based on an artificial intelligence model (e.g., the artificial intelligence model (270) and / or the summary model (271) of FIG. 2) and / or a second item for executing a translation function based on an artificial intelligence model (e.g., the artificial intelligence model (270) and / or the translation model (272) of FIG. 2). The items included in the menu (1021) are not limited to the first item and the second item.
[0141] Referring to FIG. 10A, within a state (1002), the electronic device (101) may receive an input for selecting a second item of a menu (1021) (e.g., a touch input at a point (1022) on text representing the second item). Based on receiving the input, the electronic device (101) may execute a translation function for the electronic document. The translation function may be executed based on the operations described with reference to FIGS. 1 to 9. Referring to FIG. 10B, an exemplary state (1003) of the electronic device (101) is illustrated, which displays a result of translating at least a portion of the electronic document (e.g., at least one (virtual) page of the electronic document being displayed within the state (1002)) based on the input.
[0142] Within state (1003) of FIG. 10b, the electronic device (101) may display an electronic document including texts (e.g., first text (1031) to sixth text (1036)) in a second language (e.g., Korean) that are the result of translating texts (e.g., first text (1011) to sixth text (1016)) in a first language (e.g., English). The electronic device (101) may (prioritically) translate texts included in a page displayed on the display (110) among the pages of the electronic document (additionally, N pages before and / or after the page). Within state (1003), the electronic device (101) may display a visual object (1038) representing the first language and a visual object (1039-1) representing the second language within a portion (121) including a title bar. The second language indicated by the visual object (1039-1) may be a language predetermined according to the setting value of the electronic device (101). The embodiment is not limited thereto, and the second language may be determined by a software application executed by the electronic device (101) to display the electronic document and / or information (e.g., context information) of the software application. The visual object (1038) may indicate the result of (automatically) recognizing the language of texts included in the electronic document (e.g., the first text (1011) to the sixth text (1016) of FIG. 10A). The visual object (1039-2) may be displayed on the display (110) to receive a user input for changing the second language. For example, in response to an input indicating selection of the visual object (1039-2), the electronic device (101) may display a drop-down menu (e.g., a list including texts representing multiple languages) for changing the second language on the display (110).
[0143] Referring to FIG. 10c, in state (1003), the electronic device (101) that receives a user input for selecting at least a portion of an electronic document displayed on the display (110) may switch to state (1004). In state (1004), the electronic device (101) may display a menu on the display (110) that includes a designated text, such as “Add to Note.” The menu may be displayed as a submenu of an icon (1041) included in a portion (121). The electronic device (101) that receives a user input for selecting the menu (e.g., an input for selecting a point (1042) on the display (110)) may execute a function for adding or storing the electronic document including the translation result (e.g., the first text (1031) to the sixth text (1036)) to a software application, such as a note application. The electronic device (101) that receives the above user input can switch from state (1004) to state (1005) of FIG. 10c.
[0144] Within state (1005) of FIG. 10c, the electronic device (101) may execute a translation function for the remaining pages of the electronic document that are not displayed on the display (110). While executing the translation function for the remaining pages, the electronic device (101) may display a pop-up window (1050) on the display (110). The pop-up window (1050) may include a visual object (e.g., text including a numeric value such as “9%”) and / or a progress bar) indicating the status of executing the translation function for the electronic document. Upon completing the translation of all pages included in the electronic document based on the translation function, the electronic device (101) may add or save the electronic document translated from the first language to the second language to a software application, such as a note application. Upon completing the translation, the electronic device (101) may switch from state (1005) of FIG. 10c to state (1006).
[0145] Within state (1006) of FIG. 10c, the electronic device (101) can add a translation result (e.g., an electronic document translated from a first language to a second language) to the note application and display the added translation result, the electronic document. For example, the electronic device (101) can display an electronic document including the first text (1031) to the sixth text (1036) on the display (110). As described above with reference to FIGS. 1 to 9 , the electronic device (101) can display an electronic document including a watermark (1062) along with the first text (1031) to the sixth text (1036), which are the translation results. Within the state (1006) of displaying an electronic document including a watermark (1062), the electronic device (101) may display text (1064) (e.g., “Content translated by AI”) within a title bar displayed in a portion (121) indicating that the electronic document displayed on the display (110) is an AI-based translation. The text (1064) may also be referred to as a watermark or may be included in a watermark provided with the electronic document. Referring to FIG. 10C, an embodiment is illustrated in which the watermark (1062) is positioned in a designated area, such as the lower left area of the page, but the location of the watermark (1062) within the page is not limited thereto.
[0146] Figure 11 is a schematic diagram of an exemplary AI system. Referring to Figure 11, the AI system (1100) may include an input / output interface (1110), an AI framework (1120), a generative AI model (1130), and / or a knowledge repository (1190).
[0147] The input / output interface (1110) can receive input. The input can include user input and / or data obtained or generated by an electronic device (e.g., the electronic device (101) of FIGS. 1 to 9, FIGS. 10A, 10B, and / or 10C, and / or the electronic device (1201) of FIG. 12). The data may include images, videos, and / or sensor data (e.g., illumination data around the electronic device obtained from a sensor or sensor hub (e.g., a secondary processor (1223) of FIG. 12), posture data (or orientation data) of the electronic device, temperature inside the electronic device (e.g., temperature of the display (110) of FIG. 2) or temperature of the processor (210)), size information of a display area of a display (e.g., display (110) of FIG. 2), and / or images obtained through an image sensor of the electronic device (e.g., included in a camera module (1280) of FIG. 12)). The user input may include natural language, touch data obtained via touch circuitry included within the display (panel) (e.g., used to identify input from a finger and / or a stylus), images displayed (and / or to be displayed) on the display, and / or video. As a non-limiting example, the user input may be received by the input / output interface (1110) together with context information. The context information may be described as additional information obtained in relation to the user input. The context information may relate to a state when the user input is received (e.g., including a state of the electronic device and / or a state surrounding the electronic device (e.g., a user state)). For example, the context information may include information about one or more software applications running within the electronic device when the user input is received.For example, the contextual information may include information about the location of the electronic device (or the location of the user of the electronic device) at the time the user input is received. For example, the user input may be integrated with the contextual information. For example, the user input integrated with the contextual information may be received by the input / output interface (1110).
[0148] The input / output interface (1110) can transmit (or provide) output. The output may include a result (or result information) generated or acquired by the AI system (1100) based at least in part on the input. The format of the output may vary. For example, the output may include natural language. For example, the output may include content (e.g., including media content and / or multimedia content). For example, the output may include an action related to a user of the electronic device. For example, the output may have a format according to a user setting of the electronic device.
[0149] The input / output interface (1110) can be described as a user inquiry / response interface (1110).
[0150] The AI framework (1120) can be used to obtain information (or data) about the input from the input / output interface (1110) and control one or more components related to the AI system (1100) using the obtained information.
[0151] For example, the prompt design component (1121) within the AI framework (1120) can use the acquired information to generate or obtain a prompt for a generative AI model (1130) (e.g., including a large language model (LLM) or a large multimodal model (LMM)). For example, the prompt design component (1121) can be described as an AI component that uses a learning algorithm and / or a neural network to provide enhanced prompts over time. For example, the prompt design component (1121) can use the acquired information to access a knowledge component (e.g., a knowledge repository (1190)) that includes user preference data, a prompt library, and / or prompt examples to generate or obtain a prompt. The generated prompt can be provided to the generative AI model (1130) (e.g., including an LLM or LMM).
[0152] For example, an application programming interface (API) / plugin management component (1122) within the AI framework (1120) may be utilized to support communication for additional information requested (or induced) in connection with the prompt provided (or to be provided) to the generative AI model (1130). For example, the API / plugin management component (1122) may be utilized to create or establish channels for communication with various data sources (e.g., knowledge repositories (1190)). For example, the API / plugin management component (1122) may support access to at least some of the data sources. For example, the API / plugin management component (1122) may be utilized to request another component (e.g., an application / service component (1180)) to perform feedback (or response) according to the prompt. As a non-limiting example, information obtained (or generated) through the API / plugin management component (1122) may be provided to the prompt design component (1121) for the purpose of generating a prompt. As a non-limiting example, information obtained (or generated) through the API / plugin management component (1122) may be provided to the generative AI model (1130).
[0153] For example, the improvement component (1123) within the AI framework (1120) can at least partially tune (or adjust) (or change) the result (e.g., content) obtained (or output) from the generative AI model (1130). For example, the improvement component (1123) can determine or verify whether the content obtained from the generative AI model (1130) is related to the input. For example, the improvement component (1123) can determine or verify whether the content obtained from the generative AI model (1130) contains biased content. For example, the improvement component (1123) can determine or verify whether the content obtained from the generative AI model (1130) contains harmful content. For example, the improvement component (1123) can support or assist in performing additional processing to improve the content obtained from the generative AI model (1130). For example, the improvement component (1123) may support providing hints to the user to improve the content.
[0154] A generative AI model (1130) can be described as an artificial intelligence neural network that generates feedback in response to a prompt. For example, the feedback may include additional data and / or information related to the prompt, but relative to the prompt. For example, the feedback may include new content related to the prompt. For example, the generative AI model (1130) may include a model that generates images and / or a model that generates language. For example, the model that generates images may include a generative adversarial network (GAN) and / or a variational autoencoder (VAE). For example, the model that generates images may include a diffusion-based generative model (e.g., a transformer VAE). For example, the model that generates language may include CHAT-GPT 3 and / or CHAT-GPT 4. For example, a generative AI model (1130) may include an LMM that generates the feedback by recognizing text, images, and / or speech.
[0155] As a non-limiting example, the AI framework (1120) and / or the generative AI model (1130) may be included within an AI module (e.g., including a processing circuit) within the electronic device. For example, the AI module may be operatively coupled with at least one processor of the electronic device (e.g., the processor 210 of FIG. 2 or the processor 1210 of FIG. 12). For example, the AI module may be operatively coupled with a display driving circuit of the electronic device. For example, the AI module may be operatively coupled with a sensor hub of the electronic device for one or more sensors within the electronic device. In one embodiment, the artificial intelligence model (270) of FIG. 2 may correspond to the AI system (1100) and / or the generative AI model (1130) of FIG. 11.
[0156] Hereinafter, with reference to FIG. 12, one embodiment of the electronic device (101) of FIGS. 1 and 2 is described.
[0157] FIG. 12 is a block diagram of an electronic device (1001) within a network environment (1200) according to various embodiments. Referring to FIG. 12 , in the network environment (1200), the electronic device (1201) may communicate with the electronic device (1202) via a first network (1298) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (1204) or the server (1208) via a second network (1299) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (1201) may communicate with the electronic device (1204) via the server (1208). According to one embodiment, the electronic device (1201) may include a processor (1220), a memory (1230), an input module (1250), an audio output module (1255), a display module (1260), an audio module (1270), a sensor module (1276), an interface (1277), a connection terminal (1278), a haptic module (1279), a camera module (1280), a power management module (1288), a battery (1289), a communication module (1290), a subscriber identification module (1296), or an antenna module (1297). In some embodiments, the electronic device (1201) may omit at least one of these components (e.g., the connection terminal (1278)), or may have one or more other components added. In some embodiments, some of these components (e.g., sensor module (1276), camera module (1280), or antenna module (1297)) may be integrated into a single component (e.g., display module (1260)).
[0158] The processor (1220) may control at least one other component (e.g., hardware or software component) of the electronic device (1201) connected to the processor (1220) by executing, for example, software (e.g., program (1240)), and may perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (1220) may store commands or data received from other components (e.g., sensor module (1276) or communication module (1290)) in volatile memory (1232), process the commands or data stored in volatile memory (1232), and store result data in non-volatile memory (1234). According to one embodiment, the processor (1220) may include a main processor (1221) (e.g., a central processing unit or an application processor) or an auxiliary processor (1223) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (1221). For example, when the electronic device (1201) includes the main processor (1221) and the auxiliary processor (1223), the auxiliary processor (1223) may be configured to use less power than the main processor (1221) or to be specialized for a given function. The auxiliary processor (1223) may be implemented separately from the main processor (1221) or as a part thereof.
[0159] The auxiliary processor (1223) may control at least a portion of functions or states associated with at least one component (e.g., a display module (1260), a sensor module (1276), or a communication module (1290)) of the electronic device (1201), for example, on behalf of the main processor (1221) while the main processor (1221) is in an inactive (e.g., sleep) state, or together with the main processor (1221) while the main processor (1221) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (1223) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (1280) or a communication module (1290)). In one embodiment, the auxiliary processor (1223) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (1201) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (1208)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.
[0160] The memory (1230) can store various data used by at least one component (e.g., the processor (1220) or the sensor module (1276)) of the electronic device (1201). The data can include, for example, software (e.g., the program (1240)) and input data or output data for commands related thereto. The memory (1230) can include a volatile memory (1232) or a non-volatile memory (1234).
[0161] The program (1240) may be stored as software in memory (1230) and may include, for example, an operating system (1242), middleware (1244), or an application (1246).
[0162] The input module (1250) can receive commands or data to be used in a component of the electronic device (1201) (e.g., a processor (1220)) from an external source (e.g., a user) of the electronic device (1201). The input module (1250) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
[0163] The audio output module (1255) can output audio signals to the outside of the electronic device (1201). The audio output module (1255) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.
[0164] The display module (1260) can visually provide information to an external party (e.g., a user) of the electronic device (1201). The display module (1260) may include, for example, a display, a holographic device, or a projector, and a control circuit for controlling the device. In one embodiment, the display module (1260) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.
[0165] The audio module (1270) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (1270) can acquire sound through the input module (1250), output sound through the sound output module (1255), or an external electronic device (e.g., electronic device (1202)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (1201).
[0166] The sensor module (1276) can detect the operating status (e.g., power or temperature) of the electronic device (1201) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (1276) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
[0167] The interface (1277) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (1201) with an external electronic device (e.g., the electronic device (1202)). In one embodiment, the interface (1277) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
[0168] The connection terminal (1278) may include a connector through which the electronic device (1201) may be physically connected to an external electronic device (e.g., the electronic device (1202)). In one embodiment, the connection terminal (1278) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0169] The haptic module (1279) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. In one embodiment, the haptic module (1279) may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.
[0170] The camera module (1280) can capture still images and videos. According to one embodiment, the camera module (1280) may include one or more lenses, image sensors, image signal processors, or flashes.
[0171] The power management module (1288) can manage the power supplied to the electronic device (1201). According to one embodiment, the power management module (1288) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).
[0172] A battery (1289) may power at least one component of the electronic device (1201). In one embodiment, the battery (1289) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0173] The communication module (1290) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (1201) and an external electronic device (e.g., electronic device (1202), electronic device (1204), or server (1208)), and the performance of communication through the established communication channel. The communication module (1290) may operate independently from the processor (1220) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (1290) may include a wireless communication module (1292) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (1294) (e.g., a local area network (LAN) communication module, or a power line communication module). Any of these communication modules may communicate with an external electronic device (1204) via a first network (1298) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (1299) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (1292) may use subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (1296) to verify or authenticate the electronic device (1201) within a communication network such as the first network (1298) or the second network (1299).
[0174] The wireless communication module (1292) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (1292) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (1292) may support various technologies for securing performance in high-frequency bands, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (1292) may support various requirements specified in the electronic device (1201), an external electronic device (e.g., the electronic device (1204)), or a network system (e.g., the second network (1299)). According to one embodiment, the wireless communication module (1292) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.
[0175] The antenna module (1297) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (1297) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (1297) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (1298) or the second network (1299), may be selected from the plurality of antennas, for example, by the communication module (1290). A signal or power may be transmitted or received between the communication module (1290) and an external electronic device via the selected at least one antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (1297).
[0176] According to various embodiments, the antenna module (1297) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band.
[0177] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).
[0178] According to one embodiment, commands or data may be transmitted or received between the electronic device (1201) and an external electronic device (1204) via a server (1208) connected to a second network (1299). Each of the external electronic devices (1202, or 704) may be the same or a different type of device as the electronic device (1201). According to one embodiment, all or part of the operations executed in the electronic device (1201) may be executed in one or more of the external electronic devices (1202, 1204, or 708). For example, when the electronic device (1201) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (1201) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (1201). The electronic device (1201) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (1201) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In one embodiment, the external electronic device (1204) may include an Internet of Things (IoT) device. The server (1208) may be an intelligent server utilizing machine learning and / or a neural network.According to one embodiment, an external electronic device (1204) or server (1208) may be included within the second network (1299). The electronic device (1201) may be applied to intelligent services (e.g., smart homes, smart cities, smart cars, or healthcare) based on 5G communication technology and IoT-related technology.
[0179] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.
[0180] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.
[0181] The term "module" used in various embodiments of this document may include a unit implemented in hardware, and may be used interchangeably with terms such as logic, block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0182] Various embodiments of the present document may be implemented as software (e.g., a program (1240)) including one or more instructions stored in a storage medium (e.g., an internal memory (1236) or an external memory (1238)) readable by a machine (e.g., an electronic device (1201)). For example, a processor (e.g., a processor (1220)) of the machine (e.g., an electronic device (1201)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.
[0183] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smart phones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.
[0184] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separately arranged in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added. The electronic device (1201) of FIG. 12 may be an example of the electronic device (101) of FIGS. 1 and 2.
[0185] In one embodiment, a method may be required to generate an electronic document including a watermark and / or a file in which the electronic document is stored. In one embodiment, a method may be required to selectively (or conditionally) remove a watermark included in an electronic document (e.g., removal based on a password). In one embodiment, a method may be required to block an action that only deletes a watermark without authentication. According to one embodiment, an electronic device as described above may include a display, a memory including one or more storage media, storing instructions, and at least one processor including a processing circuit. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display a first text in a first language on the display. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to receive a first input for translating the first text. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to obtain, based on the first input, a second text in a second language, translated from the first text in the first language. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to encode the second text in the second language, based on a second input for storing the second text in the second language, to generate encoded data.The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to generate an image including a watermark and the second text, and a file including the encoding data. In one embodiment, the electronic device may generate an electronic document including a watermark and / or a file in which the electronic document is stored. In one embodiment, the electronic device may selectively (or conditionally) remove a watermark included in an electronic document. In one embodiment, the electronic device may block an action of deleting only the watermark without authentication by deleting other content of the electronic document together with the watermark when receiving an input for deleting only the watermark without authentication.
[0186] For example, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to generate the file including an object combining the image and the encoded data, for displaying either the image or the second text, based on decryption of the encoded data according to execution of a software application.
[0187] For example, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to generate the file representing an electronic document represented by a plurality of objects including the object.
[0188] For example, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to encrypt the second text to allow an authenticated software application to display the second text without the watermark. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to generate the image to prevent an unauthenticated software application from displaying the second text without the watermark.
[0189] For example, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display the second text among the second text and the watermark based on a third input received via a software application capable of decoding the encoded data. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display the image including the watermark overlapping the second text based on a fourth input received via a software application that is not capable of decoding the encoded data.
[0190] For example, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display on the display a user interface (UI) for obtaining a password to be used for encrypting the second text based on receiving the second input. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to encrypt the second text with the password based on a third input for inputting the password, received through the UI, to generate the encoded data.
[0191] For example, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to generate the file including the image to display the appearance of the second text overlaid with the watermark when the encoded data is not decrypted.
[0192] For example, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to generate the file including the image representing the combined appearance of the watermark and the second text, such that the second text is deleted together with the watermark, based on a third input for deleting the watermark, when a software application for displaying the file is executed.
[0193] According to one embodiment, a method of an electronic device including a display as described above may be provided. The method may include an operation of displaying a first text in a first language on the display. The method may include an operation of receiving a first input for translating the first text. The method may include an operation of obtaining a second text in a second language, translated from the first text in the first language, based on the first input. The method may include an operation of encoding the second text in the second language to generate encoded data, based on a second input for storing the second text in the second language. The method may include an operation of generating an image including a watermark and the second text, and a file including the encoded data.
[0194] For example, the generating operation may include generating the file including an object in which the image and the encoding data are combined, for displaying either the image or the second text, based on decryption of the encoding data upon execution of a software application.
[0195] For example, the generating operation may include an operation of generating the file, which represents an electronic document represented by a plurality of objects including the object.
[0196] For example, the generating operation may include encrypting the second text to allow display of the second text without the watermark using an authenticated software application. The method may include generating the image to prevent display of the second text without the watermark using an unauthenticated software application.
[0197] For example, the method may include an action of displaying the second text among the second text and the watermark based on a third input received via a software application capable of decoding the encoded data. The method may include an action of displaying the image including the watermark overlapping the second text based on a fourth input received via a software application that is not capable of decoding the encoded data.
[0198] For example, the generating operation may include an operation of displaying on the display a UI for obtaining a password to be used for encrypting the second text based on receiving the second input. The generating operation may include an operation of encrypting the second text with the password based on a third input for inputting the password received through the UI, thereby generating the encoded data.
[0199] For example, the generating operation may include generating the file including the image to display the appearance of the second text overlapping the watermark when the encoding data is not decrypted.
[0200] For example, the generating operation may include generating the file including the image showing the watermark and the second text combined, such that the second text is deleted together with the watermark based on a third input for deleting the watermark when the software application for displaying the file is executed.
[0201] According to one embodiment, an electronic device as described above may include a display, one or more storage media, a memory for storing instructions, and at least one processor including a processing circuit. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to receive an input for executing a file including an electronic document. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to obtain encoded data from an object within the file based on the input for executing the file using a first software application. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to decode the encoded data to obtain text. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display, on the display, a UI of the first software application that includes at least a portion of the electronic document including the text. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to obtain, based on the input for executing the file using a second software application, an image representing a combined appearance of a watermark and the text from the object within the file.The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display, on the display, a UI of the second software application that includes at least a portion of the electronic document including the image.
[0202] For example, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to retrieve a password stored in the memory and associated with the file based on the input for executing the file using the first software application. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to decrypt the encoded data with the password based on retrieving the password from the memory to obtain the text. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display, on the display, the text from among the obtained text and the image based on obtaining the text.
[0203] For example, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display, on the display, the UI of the first software application, including at least a portion of the electronic document including the image, based on identifying that the password associated with the file is not stored in the memory.
[0204] For example, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to retrieve the password from the memory based on identifying, among a plurality of objects representing the electronic document, the object comprising the encoded data and the image combined.
[0205] In one embodiment, as described above, a non-transitory computer-readable storage medium storing instructions may be provided. The instructions, when executed by an electronic device including a display and a memory, may cause the electronic device to receive an input for executing a file including an electronic document. The instructions, when executed by the electronic device, may cause the electronic device to obtain encoded data from an object within the file based on the input for executing the file using a first software application. The instructions, when executed by the electronic device, may cause the electronic device to decode the encoded data to obtain text. The instructions, when executed by the electronic device, may cause the electronic device to display, on the display, a UI of the first software application including at least a portion of the electronic document including the text. The instructions, when executed by the electronic device, may cause the electronic device to obtain an image representing a combined watermark and the text from the object within the file based on the input for executing the file using a second software application. The instructions, when executed by the electronic device, may cause the electronic device to display, on the display, a UI of the second software application that includes at least a portion of the electronic document including the image.
[0206] For example, the instructions, when executed by the electronic device, may cause the electronic device to retrieve a password stored in the memory and associated with the file based on the input for executing the file using the first software application. The instructions, when executed by the electronic device, may cause the electronic device to decrypt the encoded data using the password, based on retrieving the password from the memory, to obtain the text. The instructions, when executed by the electronic device, may cause the electronic device to display, on the display, the text from among the obtained text and the image, based on obtaining the text.
[0207] For example, the instructions, when executed by the electronic device, may cause the electronic device to display, on the display, the UI of the first software application, including at least a portion of the electronic document including the image, based on identifying that the password associated with the file is not stored in the memory.
[0208] For example, the instructions, when executed by the electronic device, may cause the electronic device to retrieve the password from the memory based on identifying, among a plurality of objects representing the electronic document, the object comprising the encoded data and the image.
[0209] As used herein, the term "if" will be understood to mean "when, upon," "in response to determining," or "in response to detecting," depending on the context. Similarly, "if it is determined to," or "if [the stated condition or event] is detected," will optionally be understood to mean "upon determining," or "in response to determining," "upon detecting [the stated condition or event]," or "in response to detecting [the stated condition or event]."
[0210] The devices described above may be implemented as hardware components, software components, and / or a combination of hardware components and software components. For example, the devices and components described in the embodiments may be implemented using one or more general-purpose computers or special-purpose computers, such as a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing instructions and responding to them. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to the execution of the software. For ease of understanding, the processing device is sometimes described as being used alone; however, one of ordinary skill in the art will recognize that the processing device may include multiple processing elements and / or multiple types of processing elements. For example, a processing unit may include multiple processors, or a processor and a controller. Other processing configurations, such as parallel processors, are also possible.
[0211] Software may include a computer program, code, instructions, or a combination of one or more of these, which may configure a processing device to perform a desired operation or may independently or collectively command the processing device. The software and / or data may be embodied in any type of machine, component, physical device, computer storage medium, or device for interpretation by the processing device or for providing instructions or data to the processing device. The software may also be distributed over networked computer systems and stored or executed in a distributed manner. The software and data may be stored on one or more computer-readable recording media.
[0212] The method according to the embodiment may be implemented in the form of program commands that can be executed through various computer means and recorded on a computer-readable medium. In this case, the medium may be one that continuously stores a computer-executable program or one that temporarily stores it for execution or download. In addition, the medium may be various recording means or storage means in the form of a single or multiple hardware combinations, and is not limited to a medium directly connected to a computer system, but may also be distributed over a network. Examples of the medium may include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and those configured to store program commands, including ROM, RAM, and flash memory. In addition, examples of other media may include recording media or storage media managed by app stores that distribute applications, sites that supply or distribute various software, servers, etc.
[0213] Although the embodiments described above have been described by way of limited examples and drawings, those skilled in the art will appreciate that various modifications and variations can be made based on the above description. For example, appropriate results can still be achieved even if the described techniques are performed in a different order than described, and / or components of the described systems, structures, devices, circuits, etc. are combined or combined in a different manner than described, or are replaced or substituted with other components or equivalents.
[0214] Therefore, other implementations, other embodiments, and equivalents to the claims also fall within the scope of the claims described below.
Claims
In electronic devices, display; A memory including one or more storage media and storing instructions; and comprising at least one processor, comprising a processing circuit; The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: On the above display, display a first text in a first language; Receiving a first input for translation of the first text; Based on the first input, obtaining a second text in a second language, translated from the first text in the first language; Encoding the second text in the second language based on the second input for storing the second text in the second language to generate encoded data; and Causing to generate an image including a watermark and the second text, and a file including the encoding data, Electronic devices. In claim 1, the instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Based on the decryption of the encoding data according to the execution of the software application, causing the file to be generated, which includes an object in which the image and the encoding data are combined, to display either the image or the second text. Electronic devices. In claim 2, the instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Causing to generate the file representing an electronic document represented by a plurality of objects including the object, Electronic devices. In claim 1, the instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Encrypting said second text to allow display of said second text without said watermark using an authenticated software application; and To prevent displaying said second text without said watermark using unauthorized software applications, causing said image to be generated, Electronic devices. In claim 1, the instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Displaying the second text among the second text and the watermark based on a third input received through a software application capable of decoding the encoding data; and Causing to display the image including the watermark superimposed on the second text, based on a fourth input received through a software application that is unable to decode the encoding data. Electronic devices. In claim 1, the instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Based on receiving the second input, displaying a UI (user interface) for obtaining a password to be used for encrypting the second text on the display; and Causing to generate the encoded data by encrypting the second text with the password based on the third input for inputting the password received through the UI. Electronic devices. In claim 6, the instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: When the encoding data is not decrypted, causing the file including the image to be generated to display the appearance of the second text overlapping the watermark, Electronic devices. In claim 1, the instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: When the software application for displaying the file is executed, the file is generated including the image showing the combined appearance of the watermark and the second text, based on a third input for deleting the watermark, so that the second text is deleted together with the watermark. Electronic devices. In a method of an electronic device including a display, An action of displaying a first text in a first language on the above display; An operation of receiving a first input for translation of the first text; An operation of obtaining a second text in a second language, translated from the first text in the first language, based on the first input; An operation of encoding the second text of the second language based on a second input for storing the second text of the second language, thereby generating encoded data; and An operation comprising generating an image including a watermark and the second text, and a file including the encoding data. method. In claim 9, the generating operation comprises: An operation of generating a file including an object in which the image and the encoding data are combined, based on decryption of the encoding data according to execution of a software application, to display either the image or the second text. method. In claim 10, the generating operation comprises: An operation of generating a file, comprising: generating an electronic document represented by a plurality of objects including the object; method. In claim 9, the generating operation comprises: An operation of encrypting said second text to allow display of said second text without said watermark using an authenticated software application; and In order to prevent displaying the second text without the watermark using an unauthenticated software application, the operation of generating the image is included. method. In claim 9, An operation of displaying the second text among the second text and the watermark based on a third input received through a software application capable of decoding the encoded data; and An operation of displaying the image including the watermark superimposed on the second text, based on a fourth input received through a software application that is unable to decode the encoding data. method. In claim 9, the generating operation comprises: An operation of displaying a UI for obtaining a password to be used for encrypting the second text on the display based on receiving the second input; and An operation of generating the encoded data by encrypting the second text with the password based on a third input for inputting the password received through the UI, method. In claim 14, the generating operation comprises: Including an action of generating the file including the image to display the appearance of the second text overlapping the watermark when the encoding data is not decrypted. method.
Citation Information
Patent Citations
Translation apparatus, translation method and program
JP2006279098A
Electric comic book delivering server and apparatus for creating translated electric comic book
JP2008084286A
Integrated native language translation
KR1020080014797A
Mobile television using lidar sensor and artificial intelligence
KR1020250133067A
System and method for device filtered translation
US20170371864A1