Electronic device and method for providing visual effect for hiding part of content

Abstract

An electronic device according to an embodiment may comprise: a processor; a sensor for obtaining biometric information of a user; and a display configured to display content. The processor is configured to: identify, through the sensor, a first text focused by a user in a first portion of content, while the first portion of the content is displayed on the display; identify, on the basis of identifying the first text, a second text related to the first text in the content; and apply a visual effect for hiding the second text, when a second portion that is different from the first portion is displayed on the display.

Description

Electronic device and method for providing a visual effect to obscure a portion of content

[0001] Various embodiments disclosed in this document relate to electronic devices and methods for providing a visual effect for obscuring a portion of content.

[0002] An electronic device can provide content containing text via a display. For example, the content can include novels, comics, etc. The user can read the text displayed on the display.

[0003] Electronic devices can apply visual effects to content displayed on a display. For example, a processor can apply a blur effect by controlling the display driver circuit. As the blur effect is applied, portions of the content displayed on the display may be obscured.

[0004] When an electronic device presents content on a display, the user may first access the main portion of the content, regardless of the order in which the content is presented. For example, if the timing of the presentation of the main portion of the content is a factor that stimulates the user's interest, accessing the main portion first may diminish the user's interest. A method is needed to obscure the main portion of the content when it is displayed on a display to prevent the user from reading it first.

[0005] An electronic device according to one embodiment may include a processor, a sensor for acquiring biometric information of a user, and a display configured to display content. The processor may be configured to, while displaying a first portion of the content on the display, identify, through the sensor, a first text within the first portion focused by a user, identify, based on the identified first text, a second text within the content, related to the first text, and apply a visual effect to cover the second text when displaying a second portion different from the first portion on the display.

[0006] A method of an electronic device according to one embodiment may include an operation of identifying, through a sensor for obtaining biometric information of a user while displaying a first portion of content on a display of the electronic device, a first text within the first portion focused by a user, an operation of identifying, based on the identified first text, a second text within the content, related to the first text, and an operation of applying a visual effect for covering the second text when displaying a second portion different from the first portion on the display.

[0007] In one embodiment, a non-transitory computer-readable storage medium may be configured to, when executed by a processor of an electronic device, identify, through a sensor for eye tracking, a first text within the first portion of content focused by a user while displaying the first portion of the content on a display of the electronic device, identify, based on the identification of the first text, a second text within the content, related to the first text, and apply a visual effect to cover the second text when displaying a second portion different from the first portion on the display.

[0008] FIG. 1A is a block diagram of electronic devices according to various embodiments.

[0009] Figure 1b illustrates a usage state of an electronic device according to one embodiment.

[0010] FIG. 2A illustrates an example of a sensor of an electronic device according to one embodiment.

[0011] FIG. 2b illustrates an electronic device according to one embodiment.

[0012] FIG. 3A is a flow chart illustrating an operation of an electronic device applying a visual effect according to one embodiment.

[0013] FIG. 3b schematically illustrates an electronic device and content according to one embodiment.

[0014] FIGS. 3c and 3d illustrate an electronic device according to one embodiment to which visual effects are applied.

[0015] FIG. 4A is a flowchart illustrating an operation of an electronic device according to one embodiment to release a visual effect.

[0016] Figure 4b schematically illustrates the process of releasing visual effects.

[0017] FIG. 5 is a flowchart illustrating an operation of an electronic device according to one embodiment to identify a first text based on a gaze fixation time.

[0018] FIG. 6 is a flowchart illustrating an operation of an electronic device according to one embodiment to identify a first text based on a user's biometric information.

[0019] FIG. 7 is a simplified block diagram of electronic devices according to various embodiments.

[0020] Specific structural or functional descriptions of embodiments according to the concept of the present invention disclosed in this specification are merely illustrative for the purpose of explaining embodiments according to the concept of the present invention, and embodiments according to the concept of the present invention may be implemented in various forms and are not limited to the embodiments described in this specification.

[0021] Embodiments according to the concept of the present invention may have various modifications and take various forms, and thus, embodiments are illustrated in the drawings and described in detail in this specification. However, this is not intended to limit embodiments according to the concept of the present invention to specific disclosed forms, but rather includes modifications, equivalents, or alternatives that fall within the spirit and technical scope of the present invention.

[0022] While terms such as "first" or "second" may be used to describe various components, these components should not be limited by these terms. These terms are intended solely to distinguish one component from another. For example, a first component may be referred to as a "second component," and similarly, a second component may also be referred to as a "first component," without departing from the scope of the invention.

[0023] When a component is referred to as being "connected" or "connected" to another component, it should be understood that it may be directly connected or connected to that other component, but that there may be other components in between. Conversely, when a component is referred to as being "directly connected" or "directly connected" to another component, it should be understood that there are no other components in between. Expressions that describe relationships between components, such as "between," "immediately between," or "directly adjacent to," should be interpreted similarly.

[0024] The terminology used herein is for the purpose of describing specific embodiments only and is not intended to limit the present invention. The singular expressions include plural expressions unless the context clearly indicates otherwise. In this specification, it should be understood that the terms "comprises" or "has" are intended to specify the presence of a described feature, number, step, operation, component, part, or combination thereof, but do not preclude the possibility of the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0025] Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention pertains. Terms defined in commonly used dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant technology, and will not be interpreted in an idealized or overly formal sense unless explicitly defined herein.

[0026] Hereinafter, embodiments will be described in detail with reference to the attached drawings. However, the scope of the patent application is not limited or restricted by these embodiments. The same reference numerals in each drawing represent the same components.

[0027] FIG. 1A is a block diagram of electronic devices according to various embodiments. FIG. 1B illustrates a state of use of an electronic device according to one embodiment.

[0028] Referring to FIG. 1A, an electronic device (101) according to one embodiment may include at least one of a processor (110), a memory (120), a display (130), and a communication circuit (140). The processor (110), the memory (120), the display (130), and the communication circuit (140) may be electrically and / or operably coupled with each other by an electronic component such as a communication bus. The type and / or number of hardware components included in the electronic device (101) are not limited to those illustrated in FIG. 1A. For example, the electronic device (101) may include only some of the hardware components illustrated in FIG. 1A.

[0029] A processor (110) of an electronic device (101) according to one embodiment may include hardware components for processing data based on one or more instructions. The hardware components for processing data may include, for example, an Arithmetic and Logic Unit (ALU), a Field Programmable Gate Array (FPGA), and / or a Central Processing Unit (CPU). The number of processors (110) may be one or more. For example, the processor (110) may have a multi-core processor structure such as a dual core, a quad core, or a hexa core.

[0030] The memory (120) of the electronic device (101) according to one embodiment may include a hardware component for storing data and / or instructions input and / or output to the processor (110). The memory (120) may include, for example, a volatile memory such as a random-access memory (RAM) and / or a non-volatile memory such as a read-only memory (ROM). The volatile memory may include, for example, at least one of a dynamic RAM (DRAM), a static RAM (SRAM), a cache RAM, and a pseudo-SRAM (PSRAM). The non-volatile memory may include, for example, at least one of a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable PROM (EEPROM), a flash memory, a hard disk, a compact disc, and an embedded multi media card (eMMC).

[0031] In one embodiment, one or more instructions indicating an operation to be performed on data by the processor (110) may be stored in the memory (120) of the electronic device (101). A set of instructions may be referred to as firmware, an operating system, a process, a routine, a sub-routine, and / or an application. For example, the electronic device (101) and / or the processor (110) of the electronic device (101) may execute a set of a plurality of instructions distributed in the form of an application, thereby performing at least one of the operations of FIG. 3A, FIG. 4A, FIG. 5, and / or FIG. 6.

[0032] In one embodiment, a set of parameters related to a neural network (125) may be stored in the memory (120) of an electronic device (101). The neural network (125) is a recognition model implemented in software or hardware that mimics the computational capabilities of a biological system by using a large number of artificial neurons (or nodes). The neural network (125) may perform human cognitive functions or learning processes through the artificial neurons. The parameters related to the neural network (125) may represent, for example, weights assigned to a plurality of nodes included in the neural network (125) and / or connections between the plurality of nodes. The number of neural networks (125) stored in the memory (120) is not limited to that illustrated in FIG. 1A, and sets of parameters corresponding to each of the plurality of neural networks may be stored in the memory (120).

[0033] A communication circuit (140) of an electronic device (101) according to one embodiment may include hardware components for supporting transmission and / or reception of electrical signals between the electronic device (101) and an external electronic device. The communication circuit (140) may include, for example, at least one of a modem (MODEM), an antenna, and an optical / electronic (O / E) converter. The communication circuit (140) may support transmission and / or reception of electrical signals based on various types of protocols, such as Ethernet, a local area network (LAN), a wide area network (WAN), wireless fidelity (WiFi), Bluetooth, Bluetooth low energy (BLE), ZigBee, long term evolution (LTE), and 5G new radio (NR).

[0034] An electronic device (101) according to one embodiment can identify an object from an image or video using a neural network (125). The neural network (125) may be a convolution neural network (CNN), a long-short term memory (LSTM), and / or a recurrent neural network (RNN).

[0035] According to one embodiment, a display (130) of an electronic device (101) can output visualized information to a user. For example, the display (130) can be controlled by a controller, such as a processor (110), to output visualized information to the user. The display (130) may include a Flat Panel Display (FPD) and / or electronic paper. The FPD may include a Liquid Crystal Display (LCD), a Plasma Display Panel (PDP), and / or one or more Light Emitting Diodes (LEDs). The LEDs may include Organic LEDs (OLEDs).

[0036] Referring to FIG. 1A, an electronic device (101) according to one embodiment may further include a sensor (150). According to one embodiment, the sensor (150) may be used to obtain biometric information of a user using the electronic device (101), such as a gaze (e.g., a direction of gaze (160)), pupil, iris, face, facial expression, heart rate, voice, temperature, skin electrical resistance, autonomic nervous system balance, fatigue, and physical activity.

[0037] Referring to FIG. 1B, the electronic device (101) may be configured to display content (160) through the display (130). For example, the content (160) may be content (160) provided from a server (105). For example, a processor (e.g., processor (110) of FIG. 1A) may be configured to display content (160) contained in the server (105) through the display (130). For example, the processor (110) may be configured to display content (160), such as a novel, a comic, or a news article contained in the server (105), through the display (130). However, the present invention is not limited thereto. For example, the processor (110) may be configured to download data including content (160) contained in the server (105) into a memory (e.g., memory (120) of FIG. 1A) and display the content (160) through a display (130) based on the downloaded data.

[0038] According to one embodiment, the content (160) displayed on the display (130) may include texts. For example, the content (160) may include, but is not limited to, creative works such as poetry, novels (e.g., web novels), comics (e.g., webtoons), news articles, scripts, essays, scenarios, reviews, images, and videos. The user may read the texts included in the content (160) displayed on the display (130). In terms of the user of the electronic device (101) reading texts, the user may also be referred to as a reader.

[0039] A user can view content (160) displayed on a display (130). The processor (110) can obtain biometric information of the user viewing the content (160) through a sensor (e.g., sensor (150) of FIG. 1A). According to one embodiment, the processor (110) can be configured to identify the gaze of the user viewing the content (160) displayed on the display (130) through the sensor (150). For example, the sensor (150) can be used to track the gaze of the user. For example, the sensor (150) can be configured to emit infrared light (e.g., infrared light (203) of FIG. 2A) toward the user's eye (including the pupil) and identify reflected light (e.g., reflected light (204) of FIG. 2A) due to corneal reflection formed on the user's cornea by the infrared light (203). The sensor (150) may be configured to generate data indicating a direction of gaze (170) based on the corneal reflection. The processor (110) may be configured to obtain the data from the sensor (150) and identify the direction of gaze (170) of the user based on the data.

[0040] The aforementioned operation of tracking the user's gaze is exemplary and not limited thereto. For example, the sensor (150) may include a camera for acquiring images and / or videos. Within the images and / or videos acquired from the camera, the processor (110) of the electronic device (101) may detect portions of the images and / or videos corresponding to the two eyes. The detection of the portions may be performed based on the operation of a neural network trained for feature point analysis and / or pupil tracking. The processor (110) that has detected the portions corresponding to the two eyes may acquire or generate data indicating the direction of the gaze (170) by utilizing the shapes of the two eyes (e.g., the shape and position of the iris and / or pupil) within the portions.

[0041] For example, a user can read content (160), such as a novel, displayed on a display (130). The content (160) can be displayed on a display area (131) of the display (130), and the user can view the content (160) displayed on the display area (131). Since the size of the display area (131) is limited, the entire content (160) may not be displayed on the display (130), and a portion (e.g., a first portion (161)) of the content (160) may be displayed on the display (130). The user can view the first portion (161) of the content (160) displayed on the display area (131). A second portion (162) following the first portion (161) is not displayed on the display area (131), but may be displayed on the display area (131) based on a user input (e.g., a user input for scrolling) to display at least a portion of the second portion (162).

[0042] When a user acquires content (160), he or she may unintentionally acquire a portion of the story that arouses interest. For example, a novel may have a sequence of events arranged to arouse the reader's interest. A climax, where multiple events resolve, or a falling action, where multiple events reverse, may arouse the reader's interest. If the user unintentionally reads the climax or falling action when the novel is displayed on the display (130), the user may not be interested in the narrative for the portion that arouses interest. For example, the content (160) may be configured to arouse the reader's interest in a specific character.

[0043] For example, if the secret held by the protagonist in a novel is a compelling part of the novel, the user may experience catharsis when the secret is revealed. However, if the user unintentionally reads the part where the secret is revealed first, without first reading the preceding part intended to arouse interest in the secret, while the part where the secret is revealed is displayed in the display area (131) of the display (130), the user may not experience the catharsis intended by the author.

[0044] An electronic device (101) according to one embodiment may be configured to track a direction (170) of a user's gaze with respect to content (160) displayed on a display (130) using a sensor (150), and identify a first text (310) within a first portion (161) focused on by the user based on the direction (170) of the gaze. An electronic device (101) according to one embodiment may be configured to identify a second text (320) (e.g., a sentence and / or word related to the character identified by the name) related to the first text (310) (e.g., a name of a character) using a neural network (125), and apply a visual effect to cover the second text (320) when the second text (320) is displayed on the display (130). An electronic device (101) according to one embodiment can provide a user with an experience intended by the creator of the content (160) by preventing a situation in which the user unintentionally acquires second text (320). Through the above operations, the user experience can be enhanced.

[0045] Hereinafter, an electronic device (101) according to one embodiment is described.

[0046] FIG. 2A illustrates an example of a sensor of an electronic device according to one embodiment. FIG. 2B illustrates an electronic device according to one embodiment.

[0047] Referring to FIG. 2A, an electronic device (101) according to one embodiment may include a sensor (150) for obtaining biometric information of a user. For example, the sensor (150) may include, but is not limited to, a sensor for tracking the direction of a user's gaze. The electronic device (101) according to one embodiment may be configured to identify a first text (e.g., the first text (310) of FIG. 3A) focused by a user within content (e.g., the content (160) of FIG. 1B) using the sensor (150) for tracking the direction of the gaze. An example of the sensor (150) described below is described as a sensor for obtaining information related to the user's gaze (e.g., the direction of the gaze) among the user's biometric information, but is not limited thereto. For example, the sensor (150) may be used to obtain biometric information of the user, including at least one of the size of the user's pupil and / or iris, face, facial expression, heart rate, voice, temperature, skin galvanic resistance, autonomic nervous system balance, fatigue, and / or physical activity, in addition to the direction of gaze.

[0048] In one embodiment, the sensor (150) may enable gaze tracking by measuring the user's eye movements. For example, the sensor (150) may include a light emitter (151) and a light detector (152).

[0049] For example, the light emitter (151) may be referred to as, but is not limited to, an infrared light emitter (151) that emits infrared light (203). The light emitter (151) may be configured to emit infrared light (203) toward the user's eye (201). The light emitted from the light emitter (151) may be reflected by the user's eye (201), thereby causing reflected light (204). For example, a light detector (152) may be used to acquire the reflected light (204) reflected by the user's eye (201). For example, the light detector (152) may include an infrared camera. For example, since the brightness, phase, and / or luminance of the reflected light (204) is determined by the user's eye (201) (e.g., pupil (202)), the reflected light (204) acquired by the light detector (152) may include information related to the direction of the user's gaze. The sensor (150) may provide data corresponding to the reflected light (204) acquired by the light detector (152) to the processor (110). Since the data is data based on the reflected light (204), the data may include information related to the direction of the gaze.

[0050] According to one embodiment, the processor (110) may obtain information related to the direction of the gaze based on data corresponding to the reflected light (204), which includes information related to the direction of the gaze. For example, a memory (e.g., memory (120) of FIG. 1A) may store data and / or instructions that, when executed by the processor (110), enable the processor (110) to obtain information related to the direction of the gaze based on the data corresponding to the reflected light (204). The processor (110) may obtain information related to the direction of the gaze by executing the data and / or instructions stored in the memory (120). The processor (110) may be configured to track the direction of the user's gaze based on the information related to the direction of the gaze. However, the present invention is not limited thereto. For example, the sensor (150) may include a visible light camera. The sensor (150) may provide an image and / or video of the user's face to the processor (110). The processor (110) can obtain information related to the direction of gaze from a portion of the image and / or video corresponding to the user's two eyes within the image and / or video.

[0051] For example, the sensor (150) may be used to identify the size of the user's pupil (202). For example, the reflected light (204) acquired by the light detector (152) may include information related to the size of the user's pupil (202). The sensor (150) may provide data corresponding to the reflected light (204) acquired by the light detector (152) to the processor (110). The processor (110) may acquire information related to the size of the user's pupil (202) based on the data corresponding to the reflected light (204). The size of the pupil (202) may be enlarged by an emotional response based on a stimulus. For example, positive emotions such as joy and excitement may cause the secretion of neurotransmitters such as dopamine and norepinephrine in the brain, thereby causing the size of the pupil (202) to be enlarged. The change in the size of the user's pupil (202) can be used to identify a portion of the content (160) that attracts the user's interest based on eye movement. However, the present invention is not limited thereto. For example, the sensor (150) can provide an image and / or video including the user's face to the processor (110) via a visible light camera. The processor (110) can detect a portion of the image and / or video corresponding to the user's two eyes within the image and / or video provided from the sensor (150). The processor (110) can identify the size of the user's pupil based on the portion of the image and / or video corresponding to the detected two eyes.

[0052] 200a of FIG. 2b illustrates the front of the electronic device (101). 200b of FIG. 2b illustrates a cross-section of the electronic device (101) taken along line A-A' of 200a.

[0053] Referring to FIG. 2B, the display (130) may form at least a portion of the front surface (e.g., the surface facing the +z direction) of the electronic device (101). For example, the electronic device (101) may be positioned to face the +z direction.

[0054] For example, the display (130) may include a display area (131) including a plurality of pixels for displaying visual information. The plurality of pixels may be referred to as the minimum unit for forming visual information. The display (130) may output images and / or text using the plurality of pixels. A user of the electronic device (101) may view the images and / or text displayed on the display (130) with his / her eyes (201). In the present disclosure, the expression 'content (160) and / or text are displayed on the display (130)' may be interpreted to mean substantially the same as that content (160) and / or text are displayed on the display area (131) of the display (130).

[0055] In one embodiment, the sensor (150) may be positioned below the display (130) (e.g., in the -z direction) to track the direction of the user's gaze while viewing images and / or text displayed on the display (130). For example, referring to FIG. 2B, the display (130) may include an aperture (210) that overlaps the sensor (150) positioned below the display (130). Infrared light (203) emitted from the light emitter (151) may be provided to the user's eye (201) through the aperture (210). Reflected light (204) reflected by the user's eye (201) may be provided to the light detector (152) through the aperture (210). In one embodiment, the sensor (150) may be positioned below the aperture (210) (e.g., in the -z direction). For example, when viewing the electronic device (101) from the front, the sensor (150) may at least partially overlap the opening (210).

[0056] According to one embodiment, the sensor (150) may be positioned in a direction in which the display area (131) of the display (130) faces to emit infrared light (203) toward the eyes (201) of a user viewing an image and / or text displayed on the display (130) and receive reflected light reflected by the eyes (201) of the user. For example, if the display area (131) of the display (130) faces the +z direction, the sensor (150) may be positioned to face the +z direction.

[0057] The components and arrangement structure of the sensor (150) described above are merely exemplary and are not limited thereto. For example, the electronic device (101) may utilize various sensors (150) (e.g., a camera) to track the direction of gaze. Below, an operation of the electronic device (101) using the sensor (150) according to one embodiment to obscure a portion of text is described.

[0058] Figure 3a is a flowchart illustrating an operation of an electronic device applying a visual effect according to one embodiment. Figure 3b schematically illustrates an electronic device and content according to one embodiment. Figures 3c and 3d illustrate an electronic device according to one embodiment with a visual effect applied.

[0059] The operations illustrated in FIG. 3a may be performed when the processor (110) of FIG. 1a executes instructions stored in the memory (120).

[0060] Referring to FIG. 3A, in operation 301, the processor (110) may display a first portion (e.g., the first portion (161) of FIG. 3B) on a display (e.g., the display (130) of FIG. 1A).

[0061] For example, the processor (110) may be configured to display content (e.g., content (160) of FIG. 1B) on the display (130). As described above, the content (160) may include a creative work including text, such as a novel. The electronic device (101) may be configured to display text included in the content (160) on the display (130).

[0062] For example, since the size of the display area (131) of the display (130) is limited, the entire content (160) may not be displayed on the display area (131), but may be configured to display only a first portion (161) of the content (160) depending on the size and display method of the display area (131) (e.g., the size of text within the display area (131). For example, the first portion (161) may be a part of the content (160).

[0063] In operation 302, the processor (110) can identify a first text (310) within a first portion (161) via a sensor (e.g., sensor (150) of FIG. 1A).

[0064] According to one embodiment, the sensor (150) may be configured to acquire data including information related to a direction of a user's gaze while a first portion (161) of content (160) is displayed on the display (130). For example, the sensor (150) may be configured to emit infrared light (e.g., infrared light (203) of FIG. 2A) through the aperture (210) while the content (160) is displayed on the display (130) and acquire reflected light (204) that is the infrared light reflected to the user's eye through the aperture (e.g., aperture (210) of FIG. 2B). For example, the sensor (150) may be configured to provide data including information related to a direction of a gaze to the processor (110) based on the acquired reflected light (e.g., reflected light (204) of FIG. 2A). The embodiment is not limited thereto, and the processor (110) may use the sensor (150) to recognize the user's two eyes using images and / or videos based on visible light. From the portions of the images and / or videos corresponding to the two eyes, the processor (110) may obtain information related to the direction of the gaze.

[0065] According to one embodiment, the processor (110) may be configured to identify, via the sensor (150), a first text (310) within a first portion (161) focused by the user. The first text (310) may be referred to as text focused by the user and thus a text that attracts the user's interest.

[0066] For example, the processor (110) may be configured to acquire information related to the direction of the gaze included in the data acquired from the sensor (150). Based on the information, the processor (110) may identify the first text (310) located within an area where the user's gaze focuses. For example, if the user's gaze remains within an area for a time exceeding a reference time, the processor (110) may be configured to identify the text located within the area as the first text (310). For example, if the size of the user's pupil within an area exceeds a reference size, the processor (110) may be configured to identify the text located within the area as the first text (310). However, the present invention is not limited thereto. For example, the processor (110) may obtain information related to the user's heart rate through the sensor (150), and when the user's heart rate exceeds a reference size within an area, the processor (110) may be configured to identify text located within the area as the first text (310). For example, the processor (110) may obtain information related to the volume of the user's voice through the sensor (150), and when the volume of the user's voice exceeds a reference size within an area, the processor (110) may be configured to identify text located within the area as the first text (310). For example, the processor (110) may obtain information related to the user's body temperature through the sensor (150), and when the volume of the user's body temperature exceeds a reference size within an area, the processor (110) may be configured to identify text located within the area as the first text (310).

[0067] Meanwhile, according to one embodiment, the processor (110) may be configured to identify the first text (310) using the data acquired from the sensor (150) using the neural network (125). Since the first text (310) may vary depending on the subjective feelings of the user, the processor (110) may identify the first text (310) using the neural network (125). For example, the neural network (125) may include a machine learning model that understands the meaning of a plurality of texts included in the first part and can identify the first text (310) based on the meaning of the texts. For example, the neural network (125) may be trained to output information indicating the relationship between texts of the content (160) and / or words (or morphemes) of the texts based on tokenization of natural language.

[0068] The electronic device (101) illustrated in FIG. 3B represents an electronic device (101) displaying a first portion (161) on a display (130). For example, the first portion (161) may be referred to as a portion displayed on the display (130) as part of the content (160). For example, if the content (160) is a novel, text included in the first portion (161) may be displayed on the display (130). A user can read the first portion (161) displayed on the display (130) with their eyes.

[0069] In one embodiment, the sensor (150) may be used to track the direction of the user's gaze (170) while reading the first portion (161). For example, the sensor (150) may be configured to continuously track the user's gaze while providing data including information related to the direction of the user's gaze (170) to the processor (110).

[0070] For example, if the user's gaze stays within an area within the first part (161) for a reference time or longer, the processor (110) can identify the first text (310) located within the area based on the data acquired from the sensor (150). For example, the area may be plural, and if there are plural areas, the first text (310) may be plural. As illustrated in FIG. 3b, if 'female prosecutor' and 'helmet and armor' are located within an area where the user's gaze stays, the processor (110) can identify 'female prosecutor' and 'helmet and armor' located within the area as the first text (310).

[0071] Referring again to FIG. 3A, at operation 303, the processor (110) may identify a second text (320) related to the first text (310) based on identifying the first text (310).

[0072] According to one embodiment, the processor (110) may be configured to identify, among texts in the content (160), a second text (320) related to the first text (310) using a neural network (125). Since the second text (320) may vary depending on the subjective feelings of the user, the processor (110) may identify the second text (320) using the neural network (125). For example, the neural network (125) may include a machine learning model that understands the meaning of the first text (310) and extracts the second text (320) based on the meaning of the first text (310). For example, the neural network (125) may be trained to output information indicating relationships between texts of the content (160) and / or words (or morphemes) of the texts based on tokenization of natural language. For example, the processor (110) may extract a second text (320) that is highly related to the identified first text (310) using the neural network (125). For example, from the neural network (125), the processor (110) may extract a second text (320) that has a high correlation and / or similarity with the first text (310) based on the dictionary meaning of the first text (310). For example, the neural network (125) may be trained to extract second text (320) based on the implicit meaning (e.g., foreshadowing) of the first text (310) within the entire content (160). However, the present invention is not limited thereto. The processor (110) may identify the second text (320) extracted by the neural network (125).

[0073] For example, within content (160), a first text (310) may be provided for the interest provided by a second text (320). As illustrated in FIG. 3B , if the processor (110) identifies the first text (310) as 'female prosecutor' and 'helmet and armor,' the processor (110) may use the neural network (125) to identify the second text (320) as 'the prosecutor was A.' For example, 'female prosecutor' and 'helmet and armor' may be foreshadowing of the fact that A is a prosecutor, which is revealed in the second portion (162) following the first portion (161).

[0074] In operation 304, the processor (110) may apply an effect to cover the second text (320) when displaying a second portion (162) different from the first portion (161) on the display (130).

[0075] Referring to FIG. 3B, the content (160) may include a first portion (161) and a second portion (162). For example, the second portion (162) may be positioned after the first portion (161) within the content (160). A user may first read the content (160) displayed within the first portion (161) and then read the content (160) displayed within the second portion (162).

[0076] For example, the second portion (162) may be located within a scrollable area from the first portion (161). For example, while the first portion (161) is displayed on the display (130), the processor (110) may change the content displayed on the display (130) from the first portion (161) to the second portion (162) based on identifying a user input for scrolling. As the second portion (162) is displayed on the display (130) by the user input for scrolling, the content (160) included in the second portion (162) may be displayed on the display (130). In this case, a situation may occur in which the user unintentionally reads the second text (320) related to the first text (310). If a user unintentionally reads the second text (320) first within the second part (162), the interest that may be provided by the order of the content (160) may be reduced.

[0077] For example, a user may provide a user input for scrolling to view a second portion (162) after reading a first portion (161) displayed on a display (130). In response to the user input, the processor (110) may display the second portion (162) on the display (130). When the second portion (162) of the content (160) is displayed on the display (130), if the user first reads the part 'the test was A' within the second portion (162), the user's interest may be reduced.

[0078] Referring to FIG. 3C, the processor (110) may be configured to apply a visual effect for covering at least a portion of the second text (320) when displaying a second portion (162) different from the first portion (161) on the display (130). For example, the visual effect for covering at least a portion of the second text (320) may include a blur effect (331) for at least a portion of the second text (320).

[0079] In one embodiment, when a blur effect (331) is applied, a user may not be able to read at least a portion of the second text (320). The blur effect (331) may be referred to as an effect that reduces the readability of text by blurring the border of the text. When the blur effect (331) is applied to at least a portion of the second text (320), the readability of the second text (320) is reduced, and the user may not be able to read at least a portion of the blurred second text (320).

[0080] For example, when displaying the second portion (162), the processor (110) may apply a blur effect (331) to cover the second text (320). When the second portion (162) is displayed on the display (130), the user may not be able to read the second text (320) and may first read the portion of the content (160) positioned before the second text (320). Since a situation in which the user unintentionally reads the second text (320) first can be prevented, the interest that can be provided through the content (160) can be improved. According to one embodiment, a spoiler that occurs when the user unintentionally reads a portion of the content (160) that may arouse interest can be prevented.

[0081] The visual effect illustrated in FIG. 3c is described as a blur effect (331), but is not limited thereto. Referring to FIG. 3d, the processor (110) may be configured to display a visual object (332) that is superimposed on the second portion (162) in order to apply a visual effect for obscuring the second text (320).

[0082] According to one embodiment, the visual object (332) may include an image that is superimposed on the second text (320) to cover the second text (320). For example, the image may include, but is not limited to, a masking tape image for covering the second text (320). In a state where the visual object (332) is superimposed on the second text (320), the second text (320) may not be recognized by the user because it is covered by the visual object (332). As the second text (320) is covered by the visual object (332), a situation in which the user unintentionally reads the second text (320) first within the second portion (162) may be prevented.

[0083] In one embodiment, the visual object (332) may include an advertising image that covers the second text (320). As the second text (320) is covered by the visual object (332), the advertising effect due to the advertising image covering the second text (320), which is the part where the user's immersion can be the highest, may be enhanced.

[0084] According to one embodiment, the blur effect (331) and / or the visual object (332) may vary depending on the size and magnification of the second portion (162) displayed on the display (130). For example, when a user enlarges the second portion (162) displayed on the display (130), the processor (110) may adjust the relative size of the blur effect (331) and / or the visual object (332) to cover the second text (320). For example, when the relative position of the area where the content (160) is displayed on the display (130) is adjusted, the processor (110) may adjust the relative position of the blur effect (331) and / or the visual object (332) to cover the second text (320).

[0085] An electronic device (101) according to one embodiment can prevent a user from unintentionally reading the second text (320) first by applying a visual effect when displaying the second portion (162). For example, the processor (110) can prevent a situation in which a user unintentionally reads the second text (320) first by identifying the first text (310) and applying a visual effect to obscure the second text (320) related to the first text (310). An electronic device (101) according to one embodiment can provide a user experience that can be provided by content (160).

[0086] When a visual effect is applied, the user may need to disable the visual effect in order to read the second text (320). After disabling the visual effect, the user can read the second text (320).

[0087] Meanwhile, according to another embodiment, the processor (110) may be configured to apply a visual effect to cover at least a portion of the first text (310) when displaying the first portion (161) on a display device of another user based on the identified first text (310) information. For example, when displaying the first text (310) on a display device of another user B based on the first text (310) information identified through the display (310) sensor of user A, a blur effect (331) for the first text (310) may be included.

[0088] Below, an operation of an electronic device (101) according to one embodiment to release a visual effect is described.

[0089] FIG. 4a is a flowchart illustrating an operation of an electronic device according to one embodiment to disable a visual effect. FIG. 4b schematically illustrates a process for disabling a visual effect.

[0090] The operations illustrated in FIG. 4a may be performed when the processor (110) of FIG. 1a executes instructions stored in the memory (120).

[0091] Referring to FIG. 4A, in operation 401, when displaying a second portion (e.g., a second portion (162) of FIG. 4B) that is different from a first portion (e.g., a first portion (161) of FIG. 3B) on a display (e.g., a display (130) of FIG. 1A), the processor (110) may apply a visual effect (e.g., a visual effect (330) of FIGS. 3C and 3D) to cover a second text (e.g., a second text (320) of FIG. 4B).

[0092] For example, operation 401 may correspond to operation 304 of FIG. 3. For example, in operation 401, the second text (320) may be obscured by applying a visual effect.

[0093] At operation 402, the processor (110) may identify a user input (e.g., user input (410) of FIG. 4B) to disable the visual effect (330).

[0094] For example, after the user has read all of the portion of content (160) provided before the second text (320) within the second portion (162), the user may provide a designated user input (410) to read the second text (320). The designated user input (410) may include a touch or click input for a visual effect (330) displayed on the display (130).

[0095] An electronic device (101) according to one embodiment may include a touch sensor (not shown) for receiving a user input (410). For example, the touch sensor may provide data indicating an impedance change that occurs when the touch sensor comes into contact with a user's body to the processor (110). The processor (110) may be configured to identify a user's touch input based on the data. For example, the touch sensor may include, but is not limited to, a touch panel disposed within the display (130). For example, the processor (110) may use the touch sensor to identify a user input (410) for releasing a visual effect (330).

[0096] In operation 403, the processor (110) may disable the visual effect (330) based on identifying a user input (e.g., user input (410) of FIG. 4B).

[0097] For example, the specified user input (410) may include a touch input for a visual effect (330) displayed on the display (130). Referring to FIG. 4B, a state (400a) of FIG. 4B illustrates an electronic device (101) to which a blur effect (331) is applied to obscure a second text (320). A state (400b) of FIG. 4B illustrates an electronic device (101) to which a visual object (332) is displayed to obscure the second text (320). A state (400c) of FIG. 4B illustrates an electronic device (101) to which the visual effect (330) is released.

[0098] For example, within a state (400a), a first touch input (411) may be provided to an area of ​​the display (130) to which a blur effect (331) is applied in order to release the visual effect (330). The processor (110) may release the blur effect (331) based on identifying the first touch input (411) to the area of ​​the display (130) to which the blur effect (331) is applied. As the blur effect (331) is released, the state (400a) may change to a state (400c). Within the state (400c), the readability of the second text (320) may be enhanced as the second text (320) is clearly recognized. The user may read the second text (320) with the blur effect (331) released.

[0099] For example, within a state (400b), a second touch input (412) may be provided to an area of ​​the display (130) where a visual object (332) is displayed to release the visual effect (330). The processor (110) may stop displaying the visual object (332) based on identifying the second touch input (412) to an area of ​​the display (130) where the visual object (332) is displayed. As the display of the visual object (332) is stopped, the state (400b) may change to a state (400c). Within the state (400c), the display of the visual object (332) that was displayed overlapping the second text (320) to cover the second text (320) is stopped, so that the second text (320) may be displayed on the display (130). The user may read the second text (320) displayed on the display (130).

[0100] According to one embodiment, a user input (410) for covering up the second text (320) may be intentionally provided by the user. The processor (110) may be configured to disable the visual effect (330) based on the user input (410) for disabling the visual effect (330). Unlike a situation where the user unintentionally reads the second text (320), the user may be provided with the second text (320) through an intentional user input (410). The electronic device (101) according to one embodiment may provide an improved user experience by preventing a situation where an interesting portion of the content (160) is unintentionally provided.

[0101] FIG. 5 is a flowchart illustrating an operation of an electronic device according to one embodiment to identify a first text based on a gaze fixation time.

[0102] The operations illustrated in FIG. 5 may be performed when the processor (110) of FIG. 1A executes instructions stored in the memory (120).

[0103] The first text (e.g., the first text (310) of FIG. 3B) may be text focused on by the user. The second text (e.g., the second text (320) of FIG. 4B) may be text related to the first text (310) focused on by the user. According to one embodiment, gaze tracking may be performed based on gaze fixation on an area of ​​interest. For example, the user's gaze may be focused on text that arouses the user's interest. According to one embodiment, an electronic device (e.g., the electronic device (101) of FIG. 1A) may be configured to identify the first text (310) focused on by the user based on the time the user's gaze remains on the text.

[0104] Referring to FIG. 5, in operation 501, the processor (110) may identify a first timing at which the user's gaze begins to an area within the first area (161) through a sensor (e.g., sensor (150) of FIG. 1A) while displaying a first portion (e.g., the first portion (161) of FIG. 3B) on a display (e.g., display (130) of FIG. 1A). The area of ​​the first area (161) may be distinguished by, or correspond to, words included in text displayed through the first area (161).

[0105] As described above, the sensor (150) may be configured to provide data including information related to the direction of the user's gaze to the processor (110). For example, the information related to the direction of the gaze may include information regarding the timing (e.g., the first timing) at which the user's gaze begins on a region of the display (130). For example, the processor (110) may be configured to identify the first timing at which the user's gaze begins on a region based on the data provided from the sensor (150).

[0106] For example, if the sensor (150) includes an infrared camera, the processor (110) may identify the first timing based on reflected light (e.g., reflected light (204) of FIG. 2A) resulting from reflection of infrared light (e.g., infrared light (203) of FIG. 2A) emitted toward the user's eyes. However, the present invention is not limited thereto. For example, if the sensor (150) includes a visible light camera, the sensor (150) may provide the processor (110) with an image and / or video of the user's face. The processor (110) may detect, within the image and / or video provided from the sensor (150), a portion of the image and / or video corresponding to the user's two eyes. The processor (110) may be configured to identify a timing at which the user's gaze toward an area begins based on the portion of the image and / or video corresponding to the detected two eyes.

[0107] In operation 502, the processor (110) can identify a second timing at which the user's gaze ends on an area within the first portion (161) while displaying the first portion (161) on the display (130), through the sensor (150).

[0108] For example, when a user's gaze moves from one area to another area, the sensor (150) may provide data including information regarding the timing at which the user's gaze toward the other area begins to the processor (110). The timing at which the gaze moves from one area to the other area may be referred to as the timing at which the user's gaze toward the one area ends (e.g., the second timing). For example, the processor (110) may be configured to identify the second timing at which the user's gaze toward the one area ends based on the data provided from the sensor (150).

[0109] In operation 503, the processor (110) can identify a fixation time during which the gaze is fixed within an area based on the first timing and the second timing.

[0110] For example, fixation time can be referred to as the time during which a user's gaze remains fixed on an area. Generally, since a person's gaze can move continuously, gaze fixation can be a factor that determines whether or not the user is focused. For example, a user may move their eyes toward a stimulus that arouses their interest (e.g., text) and focus on that stimulus. According to one embodiment, the processor (110) can calculate the fixation time during which the user's gaze remains fixed on an area. For example, the time can be calculated as the time interval between a first timing and a second timing.

[0111] At operation 504, the processor (110) may identify a first text (310) based on the text displayed within the fixed time and day area.

[0112] For example, the processor (110) may compare a reference time with a fixation time. The reference time may be referred to as the time at which a user can be determined to have intentionally fixed their gaze, compared to the time it typically takes for a person to fixate their gaze. For example, saccades, which represent gaze movement, may take less than about 100 ms, and fixation may last for about 200 ms to 300 ms. For example, the reference time may be longer than about 100 ms and shorter than about 300 ms, but is not limited thereto.

[0113] According to one embodiment, the processor (110) may be configured to identify text displayed within an area as first text (310) based on identifying a fixation time exceeding a reference time. If the text displayed within an area that caused the gaze fixation is focused by the user, the fixation time for the area may be longer than the reference time. For example, in the example illustrated in FIG. 3B , if the fixation time for an area of ​​the display (130) where 'Female Prosecutor' is displayed and / or an area of ​​the display (130) where 'Helm and Armor' is displayed is longer than the reference time, the processor (110) may identify 'Female Prosecutor' and 'Helm and Armor' displayed within the area as first text (310). When the gaze fixation time for an area is longer than the reference time, it means that the user has gazed at the area for a relatively long time, and therefore, the text within the area may be identified as first text (310).

[0114] An electronic device (101) according to one embodiment can apply a visual effect (330) to cover a second text (320) related to the first text (310) by identifying the first text (310) based on the time the user's gaze is fixed on it. The electronic device (101) according to one embodiment can prevent a deterioration of the user experience provided by the content (160) by unintentionally acquiring the second text (320).

[0115] FIG. 6 is a flowchart illustrating an operation of an electronic device according to one embodiment to identify a first text based on a user's biometric information.

[0116] The operations illustrated in FIG. 6 may be performed when the processor (110) of FIG. 1A executes instructions stored in the memory (120).

[0117] In one embodiment, gaze tracking may be performed based on the user's biometric information when the user gazes at an area of ​​interest. For example, when the user reads a portion of interest within content (e.g., content (160) of FIG. 3B ), the user's emotional response may include dilated pupils, increased heart rate, increased breathing, increased stress level, or vocalization. At the timing when the user's pupils dilate, heart rate increases, breathing becomes faster, stress level increases, facial expression changes, or vocalization occurs, the portion of the content (160) that the user is viewing may be a portion focused on by the user. The electronic device (101) according to one embodiment may be configured to identify a first text focused on by the user (e.g., first text (310) of FIG. 3B ) based on the user's biometric information.

[0118] Referring to FIG. 6, in operation 601, the processor (110) can identify the user's biometric information through a sensor (e.g., sensor (150) of FIG. 1A) while displaying a first portion (e.g., first portion (161) of FIG. 3B) on a display (e.g., display (130) of FIG. 1A).

[0119] In one embodiment, the sensor (150) may be used to identify biometric information of a user. For example, the biometric information of the user may include the size of the user's pupil. For example, the photodetector of the sensor (150) (e.g., the photodetector (152) of FIG. 2A) may include an infrared camera (or a visible light camera) for identifying the size of the pupil. For example, the photodetector (152) may capture a photograph of the user's face and provide data representing the size of the user's pupil within the captured photograph to the processor (110). The processor (110) may identify the size of the pupil of the user viewing the display (130) based on the data obtained from the sensor (150). For example, the size of the pupil may be referred to as the area of ​​the pupil.

[0120] For example, if the sensor (150) includes an infrared camera, the processor (110) can identify the size of the user's pupil based on the reflected light (e.g., the reflected light (204) of FIG. 2A) resulting from the reflection of infrared light (e.g., the infrared light (203) of FIG. 2A) emitted toward the user's eyes. However, the present invention is not limited thereto. For example, if the sensor (150) includes a visible light camera, the sensor (150) can provide the processor (110) with an image and / or video of the user's face. The processor (110) can detect, within the image and / or video provided from the sensor (150), a portion of the image and / or video corresponding to the user's two eyes. The processor (110) can detect the user's pupil included within the portion of the image and / or video corresponding to the user's two eyes, and identify the size of the pupil.

[0121] In operation 602, the processor (110) can identify the first text (310) based on the biometric information of the user identified through the sensor (150).

[0122] For example, the processor (110) may compare identified biometric information (e.g., pupil size) with a reference size. The reference size may be referenced as biometric information of a typical person (e.g., pupil size). Within the content (160), the user's biometric information may change (e.g., pupil dilation) by causing an emotional response from the user to a portion that arouses the user's interest. Biometric information (e.g., pupil size) exceeding the reference size may be a factor in determining whether the user's emotional response occurs. For example, the user's pupil size may become larger than the reference size due to the user's emotional response.

[0123] According to one embodiment, the processor (110) may identify a region of the display (130) corresponding to the user's gaze at a timing when the user identifies the biometric information exceeding the reference size based on identifying a change in the biometric information exceeding the reference size. For example, the size of the user's pupil may be maintained below the reference size, and when the user looks at an area of ​​the display (130), the size of the user's pupil may expand to a size exceeding the reference size. The processor (110) may identify an area of ​​the display (130) corresponding to the user's gaze at a timing when the size of the pupil exceeding the reference size is identified through the sensor (150). According to one embodiment, the processor (110) may be configured to identify text displayed within the area as first text (310). For example, in the example illustrated in FIG. 3B, when the user's gaze remains on an area of ​​the display (130) where 'Female Inspector' is displayed and / or an area of ​​the display (130) where 'Helmet and Armor' is displayed, the size of the user's pupil may exceed a reference size. The processor (110) may identify 'Female Inspector' and 'Helmet and Armor' displayed within the area as first text (310). When the user gazes at the area, since the user's pupil exceeds the reference size, the text within the area may be identified as the first text (310). In the above-described example, the user's biometric information has been described as an example of the user's pupil size, but is not limited thereto. For example, the biometric information may be the user's heart rate. The processor (110) may identify an area of ​​the display (130) corresponding to the user's gaze at a timing when the user's heart rate exceeds the reference size through the sensor (150). For example, the biometric information may be the user's body temperature.The processor (110) can identify an area of ​​the display (130) corresponding to the user's gaze at a timing when the user's body temperature exceeds a reference size through the sensor (150). In addition to this, various other examples may be possible.

[0124] An electronic device (101) according to one embodiment can identify a first text (310) based on a change in a user's biometric information exceeding a reference size, thereby applying a visual effect (330) to cover a second text (320) related to the first text (310). The electronic device (101) according to one embodiment can prevent a deterioration of the user experience provided by the content (160) in advance by unintentionally acquiring the second text (320).

[0125] Fig. 7 is a simplified block diagram of electronic devices according to various embodiments. The electronic devices (101, 102, 103, 104, and 105) of Fig. 7 may correspond to the electronic device (101) of Fig. 1.

[0126] Referring to FIG. 7, the electronic device (700) may be an example of the electronic device (101), the electronic device (102), the electronic device (103), the electronic device (104), or the electronic device (105). The electronic device (700) may include a processor (702), a memory (704), a storage device (706), a high-speed controller (708) (e.g., a northbridge, a Main Controller Hub (MCH)), and a low-speed controller (712) (e.g., a southbridge, an I / O controller hub (ICH)). Within the electronic device (700), each of the processor (702), the memory (704), the storage device (706), the high-speed controller (708), and the low-speed controller (712) may be interconnected using various buses.

[0127] For example, the processor (702) may process instructions for execution within the electronic device (700) to display graphical information for a graphical user interface (GUI) on an external input / output device, such as a display (716) connected to a high-speed controller (708). The instructions may be contained within the memory (704) or the storage device (706). The instructions, when executed by the processor (702), may cause the electronic device (700) to perform one or more of the operations described above. According to embodiments, the processor (702) may be configured with a plurality of processors, including a communication processor and a graphical processing unit (GPU).

[0128] For example, the memory (704) may store information within the electronic device (700). For example, the memory (704) may be a volatile memory unit or units. For another example, the memory (704) may be a non-volatile memory unit or units. For another example, the memory (704) may be another form of computer-readable media, such as a magnetic or optical disk.

[0129] For example, the storage device (706) may provide mass storage space to the electronic device (700). For example, the storage device (706) may be a computer-readable medium, such as a hard disk device, an optical disk device, flash memory, a solid-state memory device, or an array of devices within a storage area network (SAN).

[0130] For example, the high-speed controller (708) may manage bandwidth-intensive operations for the electronic device (700), while the low-speed controller (712) may manage low-bandwidth intensive operations for the electronic device (700). For example, the high-speed controller (708) may be coupled to memory (704) and to a display (716) via a GPU or accelerator, while the low-speed controller (712) may be coupled to storage (706) and various communication ports (e.g., universal serial bus (USB), Bluetooth, Ethernet, wireless Ethernet) for communicating with external electronic devices (e.g., a keyboard, a transducer, a scanner, or a network device (e.g., a switch or router)).

[0131] The electronic device (750) may be an example of the electronic device (101) or the electronic device (105). The electronic device (750) may include a processor (752), a memory (764), an input / output device such as a display (754) (e.g., an organic light emitting diode (OLED) display or other suitable display), a communication interface (766), and a transceiver (768). Each of the processor (752), the memory (764), the input / output device, the communication interface (766), and the transceiver (768) may be interconnected using various buses.

[0132] For example, the processor (752) may process instructions contained in the memory (764) to display graphical information for a GUI on the input / output device. The instructions, when executed by the processor (752), may cause the electronic device (750) to perform one or more of the operations described above. For example, the processor (752) may interact with a user through a display interface (756) coupled with a display (754) and a control interface (758). For example, the display interface (756) may include circuitry for driving the display (754) to provide visual information to the user, and the control interface (758) may include circuitry for receiving commands received from the user and converting the commands for providing them to the processor (752). According to embodiments, the processor (752) may be implemented as a chipset of chips including analog and digital processors.

[0133] For example, memory (764) may store information within the electronic device (750). For example, memory (764) may include at least one of one or more volatile memory units, one or more non-volatile memory units, or a computer-readable medium.

[0134] For example, the communication interface (766) may perform wireless communication between the electronic device (750) and an external electronic device through various communication techniques, such as a cellular communication technique, a Wi-Fi communication technique, an NFC technique, or a Bluetooth communication technique, based on interworking with the processor (752). For example, the communication interface (766) may be coupled with a transceiver (768) to perform the wireless communication. For example, the communication interface (766) may be further coupled with a global navigation satellite system (GNSS) receiving module (770) to obtain location information of the electronic device (750).

[0135] An electronic device according to one embodiment may include a processor, a sensor for acquiring biometric information of a user, and a display configured to display content. The processor may be configured to, while displaying a first portion of the content on the display, identify, through the sensor, a first text within the first portion focused by a user, identify, based on the identified first text, a second text within the content, related to the first text, and apply a visual effect to cover the second text when displaying a second portion different from the first portion on the display.

[0136] In one embodiment, the visual effect may include a blur effect for the second text within the second portion.

[0137] In one embodiment, the processor may be configured to display a visual object superimposed on the second portion to apply the visual effect.

[0138] In one embodiment, the processor may be configured to identify the second text related to the first text using a neural network.

[0139] In one embodiment, the second portion may be positioned within the content after the first portion.

[0140] According to one embodiment, the second portion may be positioned within a scrollable area from the first portion.

[0141] In one embodiment, the processor may be configured to disable the visual effect based on identifying a user input to disable the visual effect.

[0142] In one embodiment, the user input may include a touch input for the visual effect displayed on the display.

[0143] In one embodiment, the sensor may include a sensor for tracking the direction of the user's gaze. The processor may be configured to identify, through the sensor, a fixation time during which the user's gaze is continuously fixed on a region of the display while the first portion is displayed on the display, and identify the first text based on the fixation time and the text displayed within the region.

[0144] According to one embodiment, the processor may be configured to identify text displayed within the one area as the first text based on the time exceeding the reference time.

[0145] According to one embodiment, the processor may be configured to identify biometric information of the user through the sensor while displaying the first portion on the display, and identify the first text within the content based on the biometric information.

[0146] According to one embodiment, the biometric information may include pupil size information. The processor may be configured to identify an area of ​​the display corresponding to the user's gaze at a timing when the pupil size exceeds a reference size, and to identify text displayed within the area as the first text.

[0147] In one embodiment, the sensor may be configured to provide data to the processor, the data including information related to the direction of the user's gaze while the content is displayed on the display.

[0148] According to one embodiment, the sensor may be positioned in a direction toward which the display area of ​​the display faces.

[0149] In one embodiment, the display may include an opening that at least partially overlaps the sensor.

[0150] A method of an electronic device according to one embodiment may include an operation of identifying, through a sensor for obtaining biometric information of a user while displaying a first portion of content on a display of the electronic device, a first text within the first portion focused by a user, an operation of identifying, based on the identified first text, a second text within the content, related to the first text, and an operation of applying a visual effect for covering the second text when displaying a second portion different from the first portion on the display.

[0151] In one embodiment, the visual effect may include a blur effect for the second text within the second portion.

[0152] According to one embodiment, the method may further include an action of displaying a visual object superimposed on the second portion to apply the visual effect.

[0153] According to one embodiment, the operation of identifying the second text may identify the second text related to the first text using a neural network.

[0154] According to one embodiment, the method may further include an action of disabling the visual effect based on identifying a user input for disabling the visual effect.

[0155] According to one embodiment, the method may further include an operation of identifying, through the sensor, a fixation time during which the user's gaze is continuously fixed on an area of ​​the display while the first portion is displayed on the display, and an operation of identifying the first text based on the fixation time and text displayed within the area.

[0156] According to one embodiment, the method may further include an operation of identifying biometric information of the user through the sensor while displaying the first portion on the display, and an operation of identifying the first text within the content based on the biometric information.

[0157] In one embodiment, a non-transitory computer-readable storage medium may be configured to, when executed by a processor of an electronic device, identify, through a sensor for eye tracking, a first text within the first portion of content focused by a user while displaying the first portion of the content on a display of the electronic device, identify, based on the identification of the first text, a second text within the content, related to the first text, and apply a visual effect to cover the second text when displaying a second portion different from the first portion on the display.

[0158] The devices described above may be implemented as hardware components, software components, and / or a combination of hardware components and software components. For example, the devices and components described in the embodiments may be implemented using one or more general-purpose computers or special-purpose computers, such as, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing instructions and responding to them. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to the execution of the software. For ease of understanding, the processing device is sometimes described as being used alone; however, one of ordinary skill in the art will recognize that the processing device may include multiple processing elements and / or multiple types of processing elements. For example, a processing unit may include multiple processors, or a processor and a controller. Other processing configurations, such as parallel processors, are also possible.

[0159] Software may include a computer program, code, instructions, or a combination of one or more of these, which may configure a processing device to perform a desired operation or may, independently or collectively, command the processing device. The software and / or data may be permanently or temporarily embodied in any type of machine, component, physical device, virtual equipment, computer storage medium or device, or transmitted signal wave, for interpretation by the processing device or for providing instructions or data to the processing device. The software may also be distributed over networked computer systems and stored or executed in a distributed manner. The software and data may be stored on one or more computer-readable recording media.

[0160] The method according to the embodiment may be implemented in the form of program commands that can be executed through various computer means and recorded on a computer-readable medium. The computer-readable medium may include program commands, data files, data structures, etc., alone or in combination. The program commands recorded on the medium may be those specially designed and configured for the embodiment or may be those known and available to those skilled in the art of computer software. Examples of the computer-readable recording medium include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and hardware devices specially configured to store and execute program commands, such as ROMs, RAMs, and flash memories. Examples of the program commands include not only machine language codes generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter, etc. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiment, and vice versa.

[0161] Although the embodiments described above have been described by way of limited examples and drawings, those skilled in the art will appreciate that various modifications and variations can be made based on the above teachings. For example, appropriate results can still be achieved even if the described techniques are performed in a different order than described, and / or components of the described systems, structures, devices, circuits, etc. are combined or combined in a different manner than described, or are replaced or substituted with other components or equivalents.

[0162] Therefore, other implementations, other embodiments, and equivalents to the claims also fall within the scope of the claims described below.

Claims

1. In an electronic device, a processor; a sensor for acquiring biometric information of a user; and a display configured to display content, wherein the processor identifies first text within a first portion of the content focused by a user through the sensor while displaying a first portion of the content on the display; identifies second text related to the first text within the content based on the identified first text; and is configured to apply a visual effect for covering the second text when displaying a second portion different from the first portion on the display, the electronic device.

2. According to claim 1, the visual effect includes a blur effect on the second text within the second portion, the electronic device.

3. According to claim 1, the processor is configured to display a visual object that is superposed on the second portion to apply the visual effect, the electronic device.

4. According to claim 1, the processor is configured to identify the second text related to the first text using a neural network, the electronic device.

5. According to claim 1, the second portion is located after the first portion within the content, the electronic device.

6. According to claim 1, the processor is configured to cancel the visual effect based on identifying a user input for canceling the visual effect, the electronic device.

7. According to claim 1, the sensor includes a sensor for tracking a direction of a user's line of sight, wherein the processor identifies a fixation time during which the user's line of sight continuously remains fixed on an area of the display through the sensor while displaying the first portion on the display; and is configured to identify the first text based on the fixation time and text displayed within the area, the electronic device.

8. According to claim 7, the processor Based on the time exceeding the reference time, the text displayed within the said work area is configured to be identified as the first text. Electronic devices.

9. In paragraph 1, The above processor, While displaying the first portion on the display, identifying the user's biometric information through the sensor; and Based on the size of the biometric information, configured to identify the first text within the content, Electronic devices.

10. In paragraph 9, The above biometric information includes pupil size information, The above processor, Identifying an area of ​​the display corresponding to the user's gaze at a timing for identifying the size of the pupil exceeding a reference size; and configured to identify the text displayed within the above work area as the first text; Electronic devices.

11. In paragraph 1, The above sensor, configured to provide data including information related to the direction of the user's gaze to the processor while the content is displayed on the display; Electronic devices.

12. In paragraph 1, The above sensor, Positioned in the direction in which the display area of ​​the above display faces, Electronic devices.

13. In the method of an electronic device, An action of identifying a first text within the first portion focused by a user through a sensor for obtaining biometric information of the user while displaying a first portion of content on a display of an electronic device; An operation of identifying a second text, related to the first text, within the content based on the identified first text; and When displaying a second portion different from the first portion on the display, the operation of applying a visual effect to cover the second text is included. method.

14. In paragraph 13, The above visual effects are, Including a blur effect for the second text within the second portion; method.

15. In paragraph 13, In order to apply the above visual effect, the method further includes an action of displaying a visual object that is displayed in an overlapping manner on the second portion. method.

16. In paragraph 13, The action of identifying the second text is: Using a neural network, identifying the second text related to the first text, method.

17. In paragraph 13, Further comprising an action of disabling the visual effect, based on identifying a user input for disabling the visual effect. method.

18. In paragraph 13, An operation of identifying a fixation time during which the user's gaze is continuously fixed on an area of ​​the display through the sensor while displaying the first portion on the display; and Further comprising an action of identifying the first text based on the fixed time and the text displayed within the work area. method.

19. In paragraph 13, An operation of identifying the user's biometric information through the sensor while displaying the first portion on the display; and Further comprising an action of identifying the first text within the content based on the biometric information. method.

20. In a non-transitory computer-readable storage medium, The above non-transitory computer-readable storage medium, when executed by a processor of an electronic device, While displaying a first portion of content on a display of an electronic device, a first text within said first portion focused by a user is identified through a sensor for eye tracking; Based on the identified first text, identifying a second text within the content, which is related to the first text; and When displaying a second part different from the first part on the above display, a visual effect is applied to cover the second text, A non-transitory computer-readable storage medium.

Images