Method, electronic device, program, and storage medium for optimizing display setting

Abstract

According to one embodiment, a method for optimizing a display setting may be provided. The method may be performed in an electronic device comprising a display and an eye tracker. The method may comprise an operation of displaying first text having a first text format through the display. The method may comprise an operation of detecting, through the eye tracker, a first gaze movement of a user corresponding to reading the displayed first text. The method may comprise an operation of measuring a first reading speed of the user for the first text on the basis of the first gaze movement. The method may comprise an operation of displaying second text having a second text format different from the first text format through the display. The method may comprise an operation of detecting, through the eye tracker, a second gaze movement of the user corresponding to reading the displayed second text. The method may comprise an operation of measuring a second reading speed of the user for the second text on the basis of the second gaze movement. The method may comprise an operation of determining, on the basis of the first reading speed and the second reading speed, the text format to be used in the electronic device. The method may comprise an operation of controlling a display setting in the electronic device on the basis of the determined text format.

Description

How to optimize display settings, electronic devices, programs, and storage media

[0001] The present disclosure relates to a method for optimizing display settings, an electronic device, a program, and a storage medium, and more specifically, to optimizing display settings by measuring the reading speed of displayed text.

[0002] Recently, wearable electronic devices that provide extended reality (XR) services, including augmented reality (AR), virtual reality (VR), or mixed reality (MR), are being developed. For example, users can enjoy various XR services such as cameras, games, video streaming, or navigation while wearing a head-mounted display (HMD) type wearable electronic device on their head or XR glasses on their face.

[0003] Display technology is continuously evolving to provide users with diverse visual environments. In electronic devices such as smartphones, tablets, or computers, as well as in HMD-type or glasses-type wearable electronic devices, features are provided to adjust visual elements—such as screen brightness, font size, font weight, text outline, color theme, color contrast, high contrast, and color filters—to maximize user experience (UX). These display settings play a crucial role not only for general users but also for users with visual impairments or those experiencing readability issues in specific environments.

[0004] Recently, artificial intelligence systems capable of achieving human-level intelligence are being utilized in various fields. Unlike conventional rule-based smart systems, artificial intelligence systems are systems in which machines learn, make judgments, and become smarter on their own. As artificial intelligence systems improve in recognition accuracy and gain a more accurate understanding of user preferences with continued use, existing rule-based smart systems are gradually being replaced by deep learning-based artificial intelligence systems.

[0005] The information described above may be provided as related art for the purpose of aiding understanding of the present disclosure. No claim or determination is made as to whether any of the foregoing may be applied as prior art in relation to the present disclosure.

[0006] According to one embodiment, a method for optimizing display settings may be provided. The method may be performed in an electronic device comprising a display and an eye tracker. The method may include an operation of displaying a first text having a first text format through the display. The method may include an operation of detecting a first eye movement of a user corresponding to reading the displayed first text through the eye tracker. The method may include an operation of measuring a first reading speed of the user for the first text based on the first eye movement. The method may include an operation of displaying a second text having a second text format different from the first text format through the display. The method may include an operation of detecting a second eye movement of the user corresponding to reading the displayed second text through the eye tracker. The method may include an operation of measuring a second reading speed of the user for the second text based on the second eye movement. The method may include an operation of determining a text format to be used in the electronic device based on the first reading speed and the second reading speed. The method may include an operation of controlling display settings in the electronic device based on the determined text format.

[0007] According to one embodiment, an electronic device may be provided comprising one or more processors including a display, an eye tracker, a memory for storing instructions, and processing circuitry. When the instructions are executed individually or jointly by the one or more processors, the electronic device may cause a first text having a first text format to be displayed through the display. When the instructions are executed individually or jointly by the one or more processors, the electronic device may cause a first eye movement of a user corresponding to reading the displayed first text to be detected through the eye tracker. When the instructions are executed individually or jointly by the one or more processors, the electronic device may cause a first reading speed of the user for the first text to be measured based on the first eye movement. When the instructions are executed individually or jointly by the one or more processors, the electronic device may cause a second text having a second text format different from the first text format to be displayed through the display. When the above instructions are executed individually or jointly by the one or more processors, the electronic device may detect, through the eye tracker, a second eye movement of the user corresponding to reading the displayed second text. When the above instructions are executed individually or jointly by the one or more processors, the electronic device may measure the user's second reading speed for the second text based on the second eye movement.When the above instructions are executed individually or jointly by the one or more processors, the electronic device may determine a text format to be used in the electronic device based on the first read speed and the second read speed. When the above instructions are executed individually or jointly by the one or more processors, the electronic device may control a display setting in the electronic device based on the determined text format.

[0008] A computer-readable non-transitory recording medium according to one embodiment of the present invention may store at least one instruction and / or instruction that causes an electronic device to perform the method or operation of the electronic device described above when executed.

[0009] In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components.

[0010] FIG. 1 is a flowchart of a method for optimizing display settings in an electronic device according to one embodiment.

[0011] FIGS. 2a and 2b are drawings illustrating exemplary graphic user interfaces (GUIs) for optimizing display settings according to one embodiment.

[0012] FIG. 3a is a diagram illustrating the operation of a display setting engine according to one embodiment.

[0013] FIG. 3b is a diagram illustrating the operation of a format combination module for dynamically generating a combination of a plurality of text formats according to one embodiment.

[0014] FIG. 4 is a flowchart of a method for proposing an optimized display setting in an electronic device according to one embodiment.

[0015] FIGS. 5a and 5b are drawings illustrating exemplary GUIs for optimizing display settings according to one embodiment.

[0016] FIG. 6a is a drawing showing an exemplary GUI for initial setup of an electronic device according to one embodiment.

[0017] FIG. 6b is a drawing showing an exemplary GUI for display settings of an electronic device according to one embodiment.

[0018] FIG. 7 is a drawing showing an exemplary GUI for applying an optimized display setting according to one embodiment.

[0019] FIG. 8 is a block diagram of a wearable electronic device according to one embodiment.

[0020] FIG. 9 is a block diagram of an electronic device in a network environment according to one embodiment.

[0021] Embodiments of the present disclosure are described below in detail with reference to the attached drawings so that those skilled in the art can easily implement them. However, the present disclosure may be embodied in various different forms and is not limited to the embodiments described herein. Furthermore, in order to clearly explain the present disclosure in the drawings, parts unrelated to the explanation have been omitted, and similar parts throughout the specification are denoted by similar reference numerals.

[0022] The terms used in this disclosure are described in their current, general form considering the functions mentioned herein; however, they may refer to various other terms depending on the intent of those skilled in the art, case law, or the emergence of new technologies. Accordingly, the terms used in this disclosure should not be interpreted solely by their names, but should be interpreted based on the meaning of the terms and the overall content of this disclosure.

[0023] Additionally, terms such as the first, second, third, ..., Nth may be used to describe various components, but the components should not be limited by these terms. These terms are used for the purpose of distinguishing one component from another.

[0024] Throughout the specification, when a part is described as being "connected" to another part, this includes not only cases where they are "directly connected," but also cases where they are "electrically connected" with other components interposed between them. Furthermore, when a part is described as "including" a certain component, this means that, unless specifically stated otherwise, it does not exclude other components but may include additional components.

[0025] Phrases such as "in one embodiment" appearing in various places in this disclosure do not necessarily refer to the same embodiment.

[0026] One embodiment of the present disclosure may be represented by functional block configurations and various processing steps. Some or all of these functional blocks may be implemented by various numbers of hardware and / or software configurations that execute specific functions. For example, the functional blocks of the present disclosure may be implemented by one or more microprocessors or by circuit configurations for a specific function. Additionally, for example, the functional blocks of the present disclosure may be implemented in various programming or scripting languages. The functional blocks may be implemented as algorithms executed on one or more processors. Furthermore, the present disclosure may employ prior art for electronic configuration, signal processing, and / or data processing. Terms such as "mechanism," "element," "means," and "configuration" may be used broadly and are not limited to mechanical and physical configurations.

[0027] Furthermore, the connecting lines or connecting members between the components depicted in the drawings are merely illustrative of functional connections and / or physical or circuit connections. In the actual device, connections between components may be represented by various alternative or added functional connections, physical connections, or circuit connections.

[0028] In electronic devices, visual elements such as screen brightness, font size, font weight, text outline, color theme, color contrast, high contrast, and color filters can be adjusted through display settings. However, these features must be adjusted manually by the user, and the user must attempt multiple times to find the optimized display settings. Furthermore, it is difficult to guarantee that the display settings found by the user are actually optimal for the user.

[0029] In addition, as society ages, the importance of display settings to improve readability is emphasized; however, it is difficult to provide display settings optimized for users due to differences in users' reading environments. Nevertheless, according to one embodiment of the present disclosure, display settings optimized according to the user's visual acuity or color vision deficiency can be provided.

[0030] According to one embodiment, artificial intelligence technology may be used to provide optimized display settings.

[0031] Artificial intelligence technology consists of machine learning (e.g., deep learning) and component technologies utilizing machine learning. Machine learning is an algorithmic technology that classifies and learns the characteristics of input data on its own, and component technologies are technologies that mimic functions such as cognition and judgment of the human brain by utilizing deep learning machine learning algorithms, and consist of technology fields such as linguistic understanding, visual understanding, reasoning / prediction, knowledge representation, and motion control.

[0032] The various fields where artificial intelligence technology is applied are as follows. Linguistic understanding is a technology that recognizes, applies, and processes human language and text, and includes natural language processing, machine translation, dialogue systems, question answering, and speech recognition / synthesis. Visual understanding is a technology that perceives and processes objects like human vision, and includes object recognition, object tracking, image search, person recognition, scene understanding, spatial understanding, and image enhancement. Inference and prediction is a technology that judges information to logically infer and predict, and includes knowledge / probability-based inference, optimization prediction, preference-based planning, and recommendation. Knowledge representation is a technology that automatically processes human experiential information into knowledge data, and includes knowledge construction (data generation / classification) and knowledge management (data utilization). Motion control is a technology that controls the autonomous driving of vehicles and the movement of robots, and includes motion control (navigation, collision, driving) and manipulation control (behavior control).

[0033] Functions related to artificial intelligence according to the present disclosure are operated through a processor and memory. The processor may be composed of one or more processors. In this case, the one or more processors may be general-purpose processors such as CPUs, APs, and DSPs (Digital Signal Processors), graphics-dedicated processors such as GPUs and VPUs (Vision Processing Units), or artificial intelligence-dedicated processors such as NPUs. The one or more processors control the processing of input data according to predefined operation rules or artificial intelligence models stored in memory. Alternatively, if the one or more processors are artificial intelligence-dedicated processors, the artificial intelligence-dedicated processors may be designed with a hardware structure specialized for processing a specific artificial intelligence model.

[0034] The predefined rules of operation or artificial intelligence models are characterized by being created through learning. Here, being created through learning means that a predefined rules of operation or artificial intelligence models configured to perform desired characteristics (or objectives) are created by a basic artificial intelligence model being trained using multiple learning data by a learning algorithm. Such learning may be performed on the device itself where the artificial intelligence according to the present disclosure is executed, or it may be performed through a separate server and / or system. Examples of learning algorithms include supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but are not limited to the examples described above.

[0035] An artificial intelligence model may be composed of multiple neural network layers. Each of the multiple neural network layers has multiple weight values ​​and performs neural network operations through operations between the results of previous layers and the multiple weights. The multiple weights possessed by the multiple neural network layers can be optimized based on the learning results of the artificial intelligence model. For example, the multiple weights may be updated so that the loss value or cost value obtained from the artificial intelligence model during the learning process is reduced or minimized. Artificial neural networks may include deep neural networks (DNNs), such as Convolutional Neural Networks (CNNs), Deep Neural Networks (DNNs), Recurrent Neural Networks (RNNs), Restricted Boltzmann Machines (RBMs), Deep Belief Networks (DBNs), Bidirectional Recurrent Deep Neural Networks (BRDNNs), or Deep Q-Networks, but are not limited to the examples mentioned above.

[0036] According to one embodiment, an optimized display setting may be proposed or provided in an HMD-type or glasses-type wearable electronic device that provides XR services. The HMD-type or glasses-type wearable electronic device may display an XR space. The XR space may be implemented by displaying a virtual image containing a virtual object, but is not limited thereto. For example, the XR space may be implemented by displaying a combination of a virtual image and a real-world image in which a real-world scene containing a real-world object is captured. For example, the XR space may be implemented by overlaying a virtual image onto a physical environment space of the real world that is visible through the lens of the electronic device.

[0037] In the present disclosure, text may consist of a series of words. The series of words may be arranged grammatically or grammatically to form one or more sentences. Text may include one or more sentences, and context may or may not be present in the sentences.

[0038] In the present disclosure, a text format refers to a visual effect applied to text being displayed, or an attribute of the text corresponding to such visual effect, and the text format may include, for example, a font size, font weight, font color, bold text, emphasis of the outline of the text, the color of the outline of the text, the color of the background of the text, high contrast, and color vision filters (e.g., red angle filter, green angle filter, and blue angle filter).

[0039] In the present disclosure, display settings may include display settings of an operating system of an electronic device and / or display settings of an application running on the operating system of an electronic device. Display settings may include, but are not limited to, default font sizes of text used in the operating system or application. For example, display settings may include whether various visual effects are applied to text used in the operating system or application.

[0040] The present disclosure will be described in detail below with reference to the attached drawings.

[0041] FIG. 1 is a flowchart of a method for controlling display settings in an electronic device according to one embodiment.

[0042] According to one embodiment, the electronic device may be a wearable electronic device, and the wearable electronic device may be, for example, a head-mounted display (HMD) worn on the head or XR glasses worn on the face, but is not limited thereto. The electronic device may be a smartphone, a tablet, or a computing device. The electronic device may include a display and an eye tracker, or communicate with the display and the eye tracker to perform the following operations. According to one embodiment, the electronic device may be an electronic device including a plurality of displays, for example, a foldable or multi-foldable device, and the plurality of displays may have different aspect ratios or resolutions. Optimization of display settings according to one embodiment may be performed for each of the plurality of displays having different aspect ratios or resolutions, but is not limited thereto. For example, optimization of display settings may be performed for one display, and the optimized setting value may be applied to another display as is, or the setting value applied to another display may be adjusted based on the difference between the two displays.

[0043] For convenience of explanation, further reference is made to FIGS. 2a and FIGS. 2b.

[0044] FIGS. 2a and 2b are drawings illustrating exemplary GUIs for optimizing display settings according to one embodiment.

[0045] Referring to FIGS. 2a and 2b, the electronic device may be a wearable electronic device of the HMD type or glasses type, and the electronic device may display an XR space (200). The user may perform various tasks in the displayed XR space (200). A GUI (202) for optimizing display settings in the XR space (200) may be displayed.

[0046] According to one embodiment, the electronic device may display a desktop, a space, or a home screen, and the user may access a GUI (202) for optimizing display settings through the displayed desktop, space, or home screen. According to one embodiment, the GUI (202) for optimizing display settings may be displayed during the initial setup phase of the electronic device, and optimizing display settings during the initial setup phase will be described later with reference to FIG. 6a. According to one embodiment, the GUI (202) for optimizing display settings may be displayed in the display setup mode of the electronic device, and optimizing display settings in the display setup mode will be described later with reference to FIG. 6b.

[0047] In the following embodiments, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, and at least two operations may be performed in parallel.

[0048] According to one embodiment, the following operations 110, 112, 120, 122, and 130 may be understood to be performed by a processor (e.g., processor (820) of FIG. 8 or processor (920) of FIG. 9) of an electronic device (e.g., wearable electronic device (801) of FIG. 8 or electronic device (901) of FIG. 9).

[0049] According to one embodiment, in operation 110, the electronic device may display a first text (210). The electronic device may display a GUI (202) for optimizing display settings in an XR environment, and the first text (210) may be displayed through the GUI (202). The GUI (202) may include a guidance message (204) requesting the text to be read in order to optimize display settings.

[0050] As illustrated in FIG. 2a, the first text (210) may be a single sentence composed of a series of words arranged according to grammar and having context, but is not limited thereto. For example, the first text (210) may be composed of a series of words that do not follow grammar, or a sentence arranged according to grammar but without context. The first text (210) may also include multiple sentences.

[0051] According to one embodiment, the first text (210) may have a text format, and the text format of the first text (210) may be referred to as the first text format. The text format refers to a visual effect applied to the text being displayed, or an attribute of the text corresponding to such visual effect, and the text format may include, for example, a font size, font weight, font color, bold text, emphasis of the outline of the text, color of the outline of the text, color of the background of the text, high contrast, and a color vision filter (e.g., a red angle filter, a green angle filter, and a blue angle filter).

[0052] Referring to FIG. 2a, the first text (210) may have a first character size, and the user may read the first text (210) of the first character size according to the guidance message (204). According to one embodiment, the text format of the text may be composed of a combination of a plurality of text formats, which will be described later with reference to FIG. 3a, FIG. 3b and FIG. 4.

[0053] According to one embodiment, in operation 112, the electronic device can measure the user's first reading speed for the first text (210) displayed in operation 110. The electronic device can measure the user's reading speed for reading the displayed text by tracking the user's eye movement through an eye tracker, and the user's reading speed for the first text (210) may be referred to as the first reading speed.

[0054] To measure a user's reading speed for displayed text, an electronic device may detect the user's gaze toward the starting position of the displayed text, detect the user's gaze movement along the displayed text, and detect the user's gaze toward the ending position of the displayed text. The user's reading speed for the displayed text may be measured based on the time taken to reach the ending position from the starting position of the displayed text. Since the range of perception and reading methods differ from person to person, the starting position and ending position of the text may refer to arbitrary locations within a predetermined range from the first and last letters of the text, respectively. The user's reading speed may be measured using an eye-tracking function used in HMD-type or glasses-type wearable electronic devices.

[0055] Reading speed may refer to the time taken to read all of the displayed text, but is not limited thereto. For example, reading speed may be measured in words per second, and the first reading speed may be calculated based on the number of words constituting the first text (210) and the time taken to read all of the first text (210).

[0056] According to one embodiment, the reading speed may be measured based on the speed at which a user actually reads aloud the displayed text, and this may be calculated based on the time taken from the time the first character of the displayed text is read to the time the last character is read.

[0057] According to one embodiment, in operation 120, the electronic device may display a second text (220). The electronic device may display a GUI (202) for optimizing display settings in an XR environment, and the second text (220) may be displayed through the GUI (202). The GUI (202) may include a guidance message (204) that requires reading the text to optimize the display settings. The guidance message (204) may include a specific method of reading the text, such as, for example, "Read the text without skipping words" or "Read the text aloud."

[0058] According to one embodiment, the GUI (202) may include a button (206) for skipping text when the user has difficulty reading the displayed text, for example, when the font size of the text is too small for a user with low vision to read. When the button (206) is selected by the user, the electronic device may measure the user's reading speed by displaying text with a larger font size.

[0059] As illustrated in FIG. 2b, the second text (220) may be a single sentence composed of a series of words arranged according to grammar like the first text (210) and having context, but is not limited thereto. For example, the first text (210) and the second text (220) may be composed of a series of words that do not follow grammar, a sentence arranged according to grammar but without context, or may include multiple sentences.

[0060] According to one embodiment, the second text (220) may have a text format, and the text format of the second text (220) may be referred to as the second text format. Referring to FIG. 2b, the second text (220) may have a second text size different from the first text size, and the user may read the second text (220) of the second text size according to the guidance message (204).

[0061] According to one embodiment, in operation 122, the electronic device can measure the user's second reading speed for the second text (220) displayed in operation 120. The electronic device can measure the user's reading speed for reading the displayed text by tracking the user's eye movement through an eye tracker, and the user's reading speed for the second text (220) may be referred to as the second reading speed.

[0062] According to one embodiment, the second text (220) may be displayed based on the user having read all of the first text (210), but is not limited thereto. For example, the second text (220) and the first text (210) may be displayed together. The electronic device may measure a first reading speed of a user reading the first text (210) among the first text (210) and the second text (220) displayed together, and measure a second reading speed of a user reading the second text (220).

[0063] According to one embodiment, in operation 130, the electronic device can control the display settings. The electronic device can control the display settings based on the first reading speed and the second reading speed measured in operation 112 and operation 122. Based on the first reading speed and the second reading speed measured in operation 112 and operation 122, the electronic device determines a text format to be used in the electronic device and can control the display settings in the electronic device based on the determined text format.

[0064] If the first reading speed is faster than the second reading speed, or if the time taken to read all of the first text (210) is shorter than the time taken to read all of the second text (220), the first text format (e.g., first character size) of the first text (210) may be determined as the text format to be used in the electronic device. Accordingly, the text displayed in the electronic device may be set to have the first character size by default, or may be set after user confirmation.

[0065] According to one embodiment, since the text format to be used in the electronic device is determined based on the user's first reading speed and second reading speed for the first text (210) and the second text (220), a more efficient text format can be suggested to the user than when the user directly determines the format, thereby saving the user time spent deliberating. In addition, since an optimized display setting can be suggested to the user simply by reading the text, the user experience of the user of the electronic device can be improved.

[0066] According to one embodiment, the display settings may be optimized by displaying three or more texts, not just the first text (210) and the second text (220), i.e., two texts, and measuring the reading speed thereof. In this case, the text format of the text with the fastest measured reading speed among the multiple texts may be determined as the text format to be used in the electronic device.

[0067] According to one embodiment, if it is identified that a user reads the text with a smaller font size between the first text (210) and the second text (220) more slowly, the electronic device may display a third text having a larger font size than the first text (210) and the second text (220), and measure the reading speed of the displayed third text to determine the text format to be used in the electronic device. If it is identified that a user reads the text with a larger font size between the first text (210) and the second text (220) more slowly, the electronic device may display a third text having a smaller font size than the first text (210) and the second text (220), and measure the reading speed of the displayed third text to determine the text format to be used in the electronic device. Thus, the electronic device can suggest an optimized display setting to the user with relatively high accuracy using only three texts.

[0068] According to one embodiment, a method for optimizing display settings may be provided. The method may be performed in an electronic device (801, 901) comprising a display (306, 860, 960) and an eye tracker (304, 880, 980). The method may include an operation of displaying a first text (210, 510) having a first text format through the display (306, 860, 960). The method may include an operation of detecting a first eye movement of a user corresponding to reading the displayed first text (210, 510) through the eye tracker (304, 880, 980). The method may include an operation of measuring a first reading speed of the user for the first text (210, 510) based on the first eye movement. The above method may include an operation of displaying a second text (220, 520) having a second text format different from the first text format through the display (306, 860, 960). The above method may include an operation of detecting a second eye movement of the user corresponding to reading the displayed second text (220, 520) through the eye tracker (304, 880, 980). The above method may include an operation of measuring a second reading speed of the user for the second text (220, 520) based on the second eye movement. The above method may include an operation of determining a text format to be used in the electronic device (801, 901) based on the first reading speed and the second reading speed. The above method may include an operation of controlling display settings in the electronic device (801, 901) based on the determined text format.

[0069] According to one embodiment, the first text format includes a first character size, and the second text format may include a second character size different from the first text (210, 510).

[0070] According to one embodiment, the first text format may include a first combination of a first plurality of text formats, and the second text format may include a second combination of a second plurality of text formats.

[0071] According to one embodiment, the first combination of the first plurality of text formats includes a first character color and a first background color, and the second combination of the second plurality of text formats may include a second character color and a second background color.

[0072] According to one embodiment, the first combination of the first plurality of text formats and the second combination of the second plurality of text formats can be selected from a plurality of presets.

[0073] According to one embodiment, the method may include an operation of generating the second combination of the second plurality of text formats based on the first combination of the first plurality of text formats and the first reading speed.

[0074] According to one embodiment, the operation of generating the second combination of the second plurality of text formats may include applying the first combination of the first plurality of text formats and the first reading speed to an artificial intelligence model to generate the second combination of the second plurality of text formats. The artificial intelligence model may be pre-trained to generate a combination of the plurality of text formats to achieve a reading speed higher than the input reading speed.

[0075] According to one embodiment, the first text format includes a first character size, and the second text format includes a second character size different from the first character size, and the method may include an operation of displaying a third text having a third character size different from the first character size and the second character size through the display (306, 860, 960). The method may include an operation of detecting a third eye movement of the user corresponding to reading the displayed third text through the eye tracker (304, 880, 980). The method may include an operation of measuring a third reading speed of the user for the third text based on the third eye movement. An operation of determining the text format to be used in the electronic device (801, 901) may include an operation of determining the text format to be used in the electronic device (801, 901) based on the first reading speed, the second reading speed, and the third reading speed.

[0076] According to one embodiment, if the second character size is smaller than the first character size and the second reading speed is slower than the first reading speed, the third character size is larger than the first character size; if the second character size is smaller than the first character size and the second reading speed is faster than the first reading speed, the third character size is smaller than the second character size; if the second character size is larger than the first character size and the second reading speed is slower than the first reading speed, the third character size is smaller than the first character size; and if the second character size is larger than the first character size and the second reading speed is faster than the first reading speed, the third character size may be larger than the second character size.

[0077] According to one embodiment, the text format to be used in the electronic device (801, 901) includes the character size of the text in which the fastest reading speed among the first reading speed, the second reading speed, and the third reading speed is measured, and the character size may be one of the first character size, the second character size, and the third character size.

[0078] FIG. 3a is a diagram illustrating the operation of a display setting engine according to one embodiment.

[0079] According to one embodiment, optimization of display settings in an electronic device may be performed by a display setting engine (302) running in the electronic device. The display setting engine (302) may include, but is not limited to, a reading speed measurement module (3020), a format combination module (3022), a text generation module (3024), and a sentence preset (3026).

[0080] The display setting engine (302) can generate text and cause the display (306) of the electronic device to display the generated text. The movement of a user's gaze while reading the text displayed on the display (306) is detected through the eye tracker (304) of the electronic device, and information regarding the gaze movement can be transmitted to the reading speed measurement module (3020) of the display setting engine (302).

[0081] According to one embodiment, the reading speed measurement module (3020) can measure or calculate the reading speed of a user's text based on information regarding eye movement. The information regarding eye movement may include the user's gaze directed toward the start position of the displayed text and the time (T1) when the gaze is detected, the user's gaze directed toward the end position of the displayed text and the time (T2) when the gaze is detected, and information regarding eye movement along the text during the time between the two times (T1 and T2). The start position and end position of the text may each refer to any position within a predetermined range from the first and last letter of the text. Information regarding the reading speed measured for the displayed text may be transmitted from the reading speed measurement module (3020) to the format combination module (3022).

[0082] According to one embodiment, the format combination module (3022) can determine the text format of the text to be displayed next based on information regarding reading speed. If it is identified that the user reads the text with the smaller font size between the first text and the second text more slowly, the format combination module (3022) can determine the font size of the third text to be displayed next to be larger than the first text and the second text. If it is identified that the user reads the text with the larger font size between the first text and the second text more slowly, the format combination module (3022) can determine the font size of the third text to be displayed next to be smaller than the first text and the second text.

[0083] The text format of the text being displayed may be composed of a combination of multiple text formats. The text format may be composed of, for example, a combination of font size, font weight, font color, bold text, emphasis of the text outline, color of the text outline, color of the text background, high contrast, and / or color vision filters (e.g., red angle filter, green angle filter, and blue angle filter).

[0084] According to one embodiment, the format combination module (3022) can store various combinations of multiple text formats as presets as shown in Table 1. Combinations can be created and stored in advance to suggest display setting values ​​optimized for the user with minimal testing through experimentation. Table 1 shows examples of four combinations, but a larger number of combinations can be stored in advance as presets. Table 1 shows examples of eight text formats, but fewer or more text formats may be included in the combinations. Since most users experience differences in reading speed depending on the font size, the font sizes of the four combinations are all different. Changes in reading speed according to different font sizes can be measured through testing of the four combinations. Both the first combination and the second combination have a white background color and a black text color, and differ in font size and whether high contrast is applied. Through testing of the text of the first and second combinations, it can be tested whether there is a difference in reading speed depending on the font size and whether high contrast is applied. To measure the user's reading speed in night mode, texts with a black background and white text can also be tested. In the third combination, the green angle filter is activated, the background color is set to green and the text color to orange, and the outline is highlighted, allowing for the measurement of changes in reading speed resulting from outline highlighting and / or the activation of the green angle filter. In the fourth combination, the red angle filter is activated, the background color is set to green and the text color to yellow, allowing for the measurement of changes in reading speed resulting from the activation of the red angle filter.

[0085] According to one embodiment, an artificial neural network may be utilized that receives as input each combination and the reading speed for the text displayed with each combination, and provides as output a combination of multiple optimized text formats. Such an artificial neural network may be pre-trained through a supervised learning method, but is not limited thereto. The artificial neural network may be stored in an electronic device or in another electronic device (e.g., a server) that communicates with the electronic device and utilized therein. A combination of text formats of the text to be displayed may be determined or generated by a format combination module (3022) and transmitted from the format combination module (3022) to a text generation module (3024).

[0086] According to one embodiment, an artificial neural network may be utilized that receives as input each combination and the reading speed for the text displayed with each combination, and provides as output a combination of multiple optimized text formats. Such an artificial neural network may be pre-trained through a supervised learning method, but is not limited thereto. The artificial neural network may be stored in an electronic device or in another electronic device (e.g., a server) that communicates with the electronic device and utilized therein. A combination of text formats of the text to be displayed may be determined or generated by a format combination module (3022) and transmitted from the format combination module (3022) to a text generation module (3024).

[0087] Combination #Font Size Outline Emphasize High Contrast Text Background Color Text Color Green Angle Filter Red Angle Filter Blue Angle Filter 110 Off Off White Black Off Off Off 215 Off On White Black Off Off Off 324 On Off Green Orange On Off Off 48 Off Off Green Yellow Off On Off

[0088] According to one embodiment, a text generation module (3024) may obtain text to be displayed from a sentence preset (3026). The sentence preset (3026) refers to various sentences stored in advance and may include, but is not limited to, standardized sentences used in reading charts used in visual acuity measurement (e.g., Radner reading chart or Jaeger reading chart). The sentence preset (3026) may include any sentences that have context and any sentences that do not have context, arranged according to grammar. The text format to be used in the electronic device may be determined based on the results of comparing reading speeds for sentences that have context or based on the results of comparing reading speeds for sentences that do not have context.

[0089] According to one embodiment, the text generation module (3024) can generate text to be displayed on the display (306) by applying a combination of text formats obtained from the format combination module (3022) to a sentence obtained from the sentence preset (3026). The generated text is displayed on the display (306), the user's gaze movement toward the displayed text is detected by the eye tracker (304), and information regarding the gaze movement can be transmitted to the reading speed measurement module (3020) of the display setting engine (302).

[0090] The display setting engine (302) can determine the text format to be used in the electronic device based on the reading speeds of the texts and apply the determined text format to the display setting.

[0091] According to one embodiment, the format combination module (3022) can dynamically generate a combination of multiple text formats, which is explained with further reference to FIG. 3b.

[0092] FIG. 3b is a diagram illustrating the operation of a format combination module (3022) for dynamically generating a combination of a plurality of text formats according to one embodiment.

[0093] Referring to FIG. 3b, the format combination module (3022) can identify text formats to be applied to the next text from various text formats included in the format pool (30220).

[0094] According to one embodiment, the format combination module (3022) may receive information regarding the combination of text formats of the previous text and the reading speed of the previous text as an input (30222). The format combination module (3022) may analyze the input (30222) and generate a combination of next text formats as an output (30224), and an artificial intelligence model may be utilized for this purpose. The artificial intelligence model may observe the combination of text formats of the previous text or said combination and the reading speed of the previous text as a state, and may be trained through reinforcement learning in which a combination of text formats of the next text is given as input and the reading speed of the next text is given as a result, but is not limited thereto. According to one embodiment, by utilizing an artificial intelligence model, a combination of text formats optimized for the user can be identified more quickly. The artificial intelligence model may be stored in an electronic device or in another electronic device (e.g., a server) that communicates with the electronic device and utilized therein.

[0095] FIG. 4 is a flowchart of a method for proposing an optimized display setting in an electronic device according to one embodiment.

[0096] In the following embodiments, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, and at least two operations may be performed in parallel.

[0097] According to one embodiment, the following operations 410, 412, 414, 416, 430, 432, and 434 may be understood to be performed by a processor (e.g., processor (820) of FIG. 8 or processor (920) of FIG. 9) of an electronic device (e.g., wearable electronic device (801) of FIG. 8 or electronic device (901) of FIG. 9).

[0098] According to one embodiment, a combination of text formats may be determined in operation 410. The combination of text formats may be determined or generated by the format combination module (3022) of the display setting engine (302) described in FIGS. 3a and 3b, and redundant descriptions are omitted as described in FIGS. 3a and 3b.

[0099] According to one embodiment, text may be displayed in operation 412. Since the display of text is substantially the same as operations 110 and 120 of FIG. 1, a redundant description is omitted.

[0100] According to one embodiment, the reading speed of the text displayed in operation 414 can be measured. Since the measurement of the reading speed is substantially the same as operations 112 and 122 of FIG. 1, a redundant description is omitted.

[0101] According to one embodiment, in operation 416, whether a condition is satisfied is determined, and if it is determined that the condition is satisfied, an optimized display setting may be proposed to the user in operation 430. For example, the electronic device may determine that the condition is satisfied when the number of tests reaches a threshold, or when an optimized display setting is found to the user before the number of tests reaches a threshold. For example, when the threshold for the number of tests is 3, three texts—namely, a first text, a second text, and a third text having different text formats—are displayed, and a first reading speed, a second reading speed, and a third reading speed are measured, thereby an optimized display setting may be proposed to the user based on the results of three tests.

[0102] According to one embodiment, if the reading speed exceeds the threshold speed before the number of tests reaches a threshold speed, for example, if the user's reading speed for text having the same character size as the default character size of the text used in the electronic device exceeds the threshold speed, the default character size may be proposed as an optimized display setting.

[0103] According to one embodiment, in operation 432, whether the user accepts the optimized display settings may be determined, and if the user accepts the optimized display settings, in operation 434, the display settings may be applied to an electronic device or an application running on the electronic device. A GUI that proposes the optimized display settings to the user will be described later with reference to FIG. 7.

[0104] FIGS. 5a and 5b are drawings illustrating exemplary GUIs for optimizing display settings according to one embodiment.

[0105] Referring to FIGS. 5a and 5b, the electronic device may be a wearable electronic device of the HMD type or glasses type, and the electronic device may display an XR space (500). The user may perform various tasks in the displayed XR space (500). A GUI (502) for optimizing display settings in the XR space (500) may be displayed.

[0106] According to one embodiment, the electronic device may display a desktop, a space, or a home screen, and the user may access a GUI (502) for optimizing display settings through the displayed desktop, space, or home screen. According to one embodiment, the GUI (502) for optimizing display settings may be displayed during the initial setup phase of the electronic device, and optimizing display settings during the initial setup phase will be described later with reference to FIG. 6a. According to one embodiment, the GUI (502) for optimizing display settings may be displayed in the display setup mode of the electronic device, and optimizing display settings in the display setup mode will be described later with reference to FIG. 6b.

[0107] According to one embodiment, an electronic device may display a first text (510). The electronic device may display a GUI (502) for optimizing display settings in an XR environment, and the first text (510) may be displayed through the GUI (502). The GUI (502) may include a guidance message (504) requesting the text to be read in order to optimize display settings.

[0108] Referring to FIGS. 5a and 5b, if a user has difficulty reading the displayed text (510), for example, if the font size of the text (510) is too small for a user with low vision to read, or if the text color (512) and background color (514) are difficult for a user with color vision deficiency to read, a button (506) for skipping the text (510) may be displayed in the GUI (502). When the button (506) is selected by the user, the electronic device may measure the user's reading speed by displaying text (520) with a larger font size or text (520) with a text color (522) and background color (524) that can be read by the user with color vision deficiency.

[0109] According to one embodiment, if it is determined that the difference between reading speeds of texts displayed by changing the text color and background color is within a threshold range, the color vision filter or high contrast may be disabled in the display settings optimized for the user because the user has no color vision deficiency.

[0110] According to one embodiment, if it is determined that the difference between reading speeds of texts displayed by changing the text color and background color exceeds a threshold range, a color vision filter or high contrast may be activated in the display settings optimized for the user, as the user has a color vision deficiency.

[0111] According to one embodiment, in order to suggest display settings optimized for a user with color vision deficiency, the outline of text may be emphasized or the color of the outline may be changed, and the user's reading speed may be measured. For example, if it is determined that the difference between reading speeds for texts displayed with the text color and background color changed exceeds a threshold range, the text used in the next test may be tested for suitability by emphasizing the outline or setting the outline color, as the user has color vision deficiency.

[0112] FIG. 6a is a drawing showing an exemplary GUI for initial setup of an electronic device according to one embodiment.

[0113] According to one embodiment, an initial setup GUI (610) may be displayed in an XR space (600) during the initial setup phase of an electronic device. The initial setup GUI (610) may include a button (612) for starting with a default display setting, an accessibility setting button (614) for users with accessibility difficulties such as color vision deficiency, and a button (616) for optimizing display settings. By selecting the button (616) for optimizing display settings during the initial setup phase of the electronic device and simply reading the text displayed in the GUI (202, 502) for optimizing display settings exemplified in FIGS. 2a, 2b, 5a, and 5b, the user can receive suggestions for display settings optimized for them without the hassle of manually manipulating display settings one by one.

[0114] According to one embodiment, even without displaying a GUI (202, 502) for optimizing the display settings exemplified in FIGS. 2a, 2b, 5a, and 5b, different text formats are applied to the texts included in the various GUIs displayed during the initial setup phase of the electronic device, and the texts are displayed, and the user's reading speeds for the displayed texts are measured, thereby suggesting an optimized display setting to the user. Thus, an optimized display setting can be suggested to the user without the user performing any conscious action to optimize the display themselves.

[0115] FIG. 6b is a drawing showing an exemplary GUI for display settings of an electronic device according to one embodiment.

[0116] According to one embodiment, a display setting GUI (620) may be displayed in an XR space (600) in a display setting mode of an electronic device. The display setting GUI (620) may include a window (621) for previewing the applied state of the settings, a button (622) for adjusting the font size, a button (623) for adjusting whether to emphasize the outline or the color of the outline, a button (624) for adjusting the text color and background color, and a button (626) for optimizing the display settings. A user can open the display setting GUI (620) at any time, select the button (616) for optimizing the display settings, and simply read the text displayed in the GUI (202, 502) for optimizing the display settings exemplified in FIGS. 2a, 2b, 5a, and 5b, and receive suggestions for display settings optimized for them without the hassle of manually manipulating the display settings one by one.

[0117] FIG. 7 is a drawing showing an exemplary GUI for applying an optimized display setting according to one embodiment.

[0118] According to one embodiment, an optimized display setting (734) determined through a GUI (202, 502) for optimizing the display settings exemplified in FIG. 2a, 2b, 5a and 5b can be displayed in the XR space (700) through a display setting suggestion GUI (730).

[0119] The optimized display setting (734) can be expressed through a pangram sentence that includes all characters evenly, thereby allowing the user to effectively recognize the result with the applied text format.

[0120] The display setting suggestion GUI (730) can display the previous display settings (732), thereby allowing the user to easily compare the before and after of optimization.

[0121] The display setting suggestion GUI (730) may include a button (736) for the user to accept the optimized display setting (734) and a button (738) for rejecting it.

[0122] According to one embodiment, the display setting suggestion GUI (730) may further include a button for sharing the optimized display settings (734) with another electronic device, for example, another electronic device logged in with the same user account, or a button for applying the optimized display settings (734) to another electronic device through synchronization. According to one embodiment, the optimized display settings (734) may be applied in the same way to another electronic device, but are not limited thereto. For example, if the display on which the XR space (700) is displayed and the display of another electronic device have different aspect ratios or different resolutions, the optimized display settings (734) may be adjusted based on the difference between the two displays and applied to the other electronic device.

[0123] FIG. 8 is a block diagram of a wearable electronic device according to one embodiment.

[0124] An electronic device according to one embodiment may be the wearable electronic device (801) of FIG. 8. Referring to FIG. 8, the wearable electronic device (801) may include a processor (820), memory (830), a display module (860), a camera module (880), and a communication module (890). The wearable electronic device (801) may include additional components in addition to the components shown in FIG. 8. Some of the components of the wearable electronic device (801) shown in FIG. 8 may be omitted, replaced, or integrated with one another. The wearable electronic device (801) may correspond to the electronic device (901) of FIG. 9.

[0125] According to one embodiment, the components of the wearable electronic device (801) shown in FIG. 8 may correspond to the components of the electronic device (901) shown in FIG. 9. For example, the processor (820), memory (830), display module (860), camera module (880), and communication module (890) may correspond to the processor (920), memory (930), display module (960), camera module (980), and communication module (990) of FIG. 9, respectively.

[0126] According to one embodiment, components included in a wearable electronic device (801) may be electrically and / or operatively connected to each other to exchange signals (e.g., commands or data) with one another. For example, instructions stored in memory (830) may be executed by a processor (820). For example, the processor (820) may execute instructions stored in memory (830) to perform a specified function (or logic) or control other components of the wearable electronic device (801).

[0127] In one embodiment, the camera module (880) may capture an image by photographing a subject or the surroundings of the wearable electronic device (801). The camera module (880) may transmit the acquired image to the processor (820). The camera module (880) may include an infrared (IR) camera, a near-infrared (NIR) camera, and / or a visible light camera, and at least one camera may function as an eye tracker that photographs the user's eyes to track their gaze.

[0128] In one embodiment, the wearable electronic device (801) may further include an illuminator. The illuminator projects light, for example, infrared light, onto the user's eyes, and by capturing the projected light through an IR camera or NIR camera, the user's gaze can be tracked based on the captured images.

[0129] In one embodiment, the communication module (890) can be used for the wearable electronic device (801) to communicate with another electronic device or server.

[0130] In one embodiment, the wearable electronic device (801) may include a sensor module. For example, the sensor module may include a depth sensor, and depth information may be obtained through the depth sensor. The depth sensor may be an infrared sensor, a Time-of-Flight (ToF) sensor, an ultrasonic sensor, a light detection and ranging (LiDAR) sensor, or a stereo camera, and the depth sensor may be used for eye tracking. The depth information may be generated by the depth sensor and transmitted to the processor (820).

[0131] According to one embodiment, an electronic device (801, 901) may be provided, comprising a display (306, 860, 960), an eye tracker (304, 880, 980), a memory (830, 930) for storing instructions, and one or more processors (820, 920) including processing circuitry. When the instructions are executed individually or jointly by the one or more processors (820, 920), the electronic device (801, 901) may cause a first text (210, 510) having a first text format to be displayed through the display (306, 860, 960). When the above commands are executed individually or jointly by the one or more processors (820, 920), the electronic device (801, 901) may detect a first eye movement of a user corresponding to reading the displayed first text (210, 510) through the eye tracker (304, 880, 980). When the above commands are executed individually or jointly by the one or more processors (820, 920), the electronic device (801, 901) may measure a first reading speed of the user for the first text (210, 510) based on the first eye movement. When the above instructions are executed individually or jointly by one or more processors (820, 920), the electronic device (801, 901) may cause a second text (220, 520) having a second text format different from the first text format to be displayed through the display (306, 860, 960).When the above commands are executed individually or jointly by the one or more processors (820, 920), the electronic device (801, 901) may detect the user's second eye movement corresponding to reading the displayed second text (220, 520) through the eye tracker (304, 880, 980). When the above commands are executed individually or jointly by the one or more processors (820, 920), the electronic device (801, 901) may measure the user's second reading speed for the second text (220, 520) based on the second eye movement. When the above instructions are executed individually or jointly by the one or more processors (820, 920), the electronic device (801, 901) may determine a text format to be used in the electronic device (801, 901) based on the first reading speed and the second reading speed. When the above instructions are executed individually or jointly by the one or more processors (820, 920), the electronic device (801, 901) may control a display setting in the electronic device (801, 901) based on the determined text format.

[0132] According to one embodiment, the first text format includes a first character size, and the second text format may include a second character size different from the first text (210, 510).

[0133] According to one embodiment, the first text format may include a first combination of a first plurality of text formats, and the second text format may include a second combination of a second plurality of text formats.

[0134] According to one embodiment, the first combination of the first plurality of text formats includes a first character color and a first background color, and the second combination of the second plurality of text formats may include a second character color and a second background color.

[0135] According to one embodiment, the first combination of the first plurality of text formats and the second combination of the second plurality of text formats can be selected from a plurality of presets.

[0136] According to one embodiment, when the instructions are executed individually or jointly by one or more processors (820, 920), the electronic device (801, 901) may be made to generate the second combination of the second plurality of text formats based on the first combination of the first plurality of text formats and the first reading speed.

[0137] According to one embodiment, when the instructions are executed individually or jointly by one or more processors (820, 920), the electronic device (801, 901) may be configured to apply the first combination of the first plurality of text formats and the first reading speed to an artificial intelligence model to generate the second combination of the second plurality of text formats. The artificial intelligence model may be pre-trained to generate a combination of the plurality of text formats to achieve a reading speed higher than the input reading speed.

[0138] According to one embodiment, the first text format may include a first character size, and the second text format may include a second character size different from the first character size. When the instructions are executed individually or jointly by the one or more processors (820, 920), the electronic device (801, 901) may cause the display (306, 860, 960) to display a third text having a third character size different from the first character size and the second character size. When the instructions are executed individually or jointly by the one or more processors (820, 920), the electronic device (801, 901) may cause the displayer (304, 880, 980) to detect a third eye movement of the user corresponding to reading the displayed third text. When the above instructions are executed individually or jointly by the one or more processors (820, 920), the electronic device (801, 901) may be configured to measure the user's third reading speed for the third text based on the third eye movement. When the above instructions are executed individually or jointly by the one or more processors (820, 920), the electronic device (801, 901) may be configured to determine the text format to be used in the electronic device (801, 901) based on the first reading speed, the second reading speed, and the third reading speed.

[0139] According to one embodiment, if the second character size is smaller than the first character size and the second reading speed is slower than the first reading speed, the third character size is larger than the first character size; if the second character size is smaller than the first character size and the second reading speed is faster than the first reading speed, the third character size is smaller than the second character size; if the second character size is larger than the first character size and the second reading speed is slower than the first reading speed, the third character size is smaller than the first character size; and if the second character size is larger than the first character size and the second reading speed is faster than the first reading speed, the third character size may be larger than the second character size.

[0140] According to one embodiment, the text format to be used in the electronic device (801, 901) includes the character size of the text in which the fastest reading speed among the first reading speed, the second reading speed, and the third reading speed is measured, and the character size may be one of the first character size, the second character size, and the third character size.

[0141] FIG. 9 is a block diagram of an electronic device (901) in a network environment (900) according to various embodiments.

[0142] Referring to FIG. 9, in a network environment (900), an electronic device (901) may communicate with an electronic device (902) through a first network (998) (e.g., a short-range wireless communication network) or with an electronic device (904) or a server (908) through a second network (999) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (901) may communicate with the electronic device (904) through a server (908). According to one embodiment, the electronic device (901) may include a processor (920), memory (930), input module (950), sound output module (955), display module (960), audio module (970), sensor module (976), interface (977), connection terminal (978), haptic module (979), camera module (980), power management module (988), battery (989), communication module (990), subscriber identification module (996), or antenna module (997). In some embodiments, at least one of these components (e.g., connection terminal (978)) may be omitted from the electronic device (901), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (976), camera module (980), or antenna module (997)) may be integrated into a single component (e.g., display module (960)).

[0143] The processor (920) can control at least one other component (e.g., a hardware or software component) of the electronic device (901) connected to the processor (920) by executing software (e.g., a program (940)), for example, and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (920) can store commands or data received from other components (e.g., a sensor module (976) or a communication module (990)) in volatile memory (932), process the commands or data stored in volatile memory (932), and store the resulting data in non-volatile memory (934). According to one embodiment, the processor (920) may include a main processor (921) (e.g., a central processing unit or an application processor) or an auxiliary processor (923) that can operate independently or together with it (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device (901) includes a main processor (921) and an auxiliary processor (923), the auxiliary processor (923) may be configured to use lower power than the main processor (921) or to be specialized for a designated function. The auxiliary processor (923) may be implemented separately from the main processor (921) or as part thereof.

[0144] The auxiliary processor (923) may control at least some of the functions or states associated with at least one component of the electronic device (901) (e.g., display module (960), sensor module (976), or communication module (990)) on behalf of the main processor (921) while the main processor (921) is in an inactive (e.g., sleep) state, or together with the main processor (921) while the main processor (921) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (923) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (980) or communication module (990)). According to one embodiment, the auxiliary processor (923) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (901) itself where the artificial intelligence is performed, or through a separate server (e.g., server (908)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.

[0145] The number of processors (920) may be one or more. For example, the processor (920) may have the structure of a multi-core processor such as a dual core, quad core, or hexa core.

[0146] The processor (920) can control the operations of the electronic device (901) by executing instructions stored in memory (930). For example, the processor (920) may correspond to a plurality of processors that divide and collectively perform a plurality of operations among the processors.

[0147] The memory (930) can store various data used by at least one component of the electronic device (901) (e.g., processor (920) or sensor module (976)). The data may include, for example, software (e.g., program (940)) and input or output data for related commands. The memory (930) may include volatile memory (932) or non-volatile memory (934).

[0148] The program (940) may be stored as software in memory (930) and may include, for example, an operating system (942), middleware (944), or an application (946).

[0149] The input module (950) can receive commands or data to be used for a component of the electronic device (901) (e.g., processor (920)) from outside the electronic device (901) (e.g., user). The input module (950) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0150] The sound output module (955) can output a sound signal to the outside of the electronic device (901). The sound output module (955) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.

[0151] The display module (960) can visually provide information to an external (e.g., user) of the electronic device (901). The display module (960) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (960) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.

[0152] The audio module (970) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (970) can acquire sound through the input module (950) or output sound through the sound output module (955) or an external electronic device (e.g., electronic device (902)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (901).

[0153] The sensor module (976) can detect the operating state of the electronic device (901) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (976) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0154] The interface (977) may support one or more specified protocols that can be used for the electronic device (901) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (902)). According to one embodiment, the interface (977) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0155] The connection terminal (978) may include a connector through which the electronic device (901) can be physically connected to an external electronic device (e.g., electronic device (902)). According to one embodiment, the connection terminal (978) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0156] The haptic module (979) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module (979) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.

[0157] The camera module (980) can capture still images and video. According to one embodiment, the camera module (980) may include one or more lenses, image sensors, image signal processors, or flashes.

[0158] The power management module (988) can manage the power supplied to the electronic device (901). According to one embodiment, the power management module (988) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).

[0159] The battery (989) can supply power to at least one component of the electronic device (901). According to one embodiment, the battery (989) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0160] The communication module (990) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (901) and an external electronic device (e.g., electronic device (902), electronic device (904), or server (908)), and the performance of communication through the established communication channel. The communication module (990) may include one or more communication processors that operate independently of the processor (920) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (990) may include a wireless communication module (992) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (994) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (904) through a first network (998) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (999) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (992) can identify or authenticate the electronic device (901) within a communication network such as the first network (998) or the second network (999) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (996).

[0161] The wireless communication module (992) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (992) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (992) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (992) can support various requirements specified in the electronic device (901), external electronic device (e.g., electronic device (904)), or network system (e.g., second network (999)). According to one embodiment, the wireless communication module (992) can support a Peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 164 dB or less) for realizing mMTC, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for realizing URLLC.

[0162] An antenna module (997) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (997) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (997) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (998) or a second network (999), may be selected from the plurality of antennas, for example, by a communication module (990). A signal or power may be transmitted or received between the communication module (990) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (997).

[0163] According to various embodiments, the antenna module (997) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.

[0164] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.

[0165] According to one embodiment, commands or data may be transmitted or received between the electronic device (901) and an external electronic device (904) through a server (908) connected to a second network (999). Each of the external electronic devices (902, or 904) may be the same or a different type of device as the electronic device (901). According to one embodiment, all or part of the operations performed on the electronic device (901) may be performed on one or more of the external electronic devices (902, 904, or 908). For example, if the electronic device (901) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (901) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (901). The electronic device (901) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (901) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (904) may include an Internet of Things (IoT) device. The server (908) may be an intelligent server using machine learning and / or neural networks. According to one embodiment, the external electronic device (904) or the server (908) may be included within a second network (999).The electronic device (901) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0166] An electronic device (901) according to one embodiment may correspond to an electronic device of FIGS. 1 to 8 (e.g., an electronic device (801) of FIG. 8), and the electronic device (901) may perform the operations of an electronic device of FIGS. 1 to 8 (e.g., an electronic device (801) of FIG. 8).

[0167] The technical problems to be solved in this disclosure are not limited to those mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art to which this disclosure pertains.

[0168] The effects obtainable from the present disclosure are not limited to those mentioned above, and other unmentioned effects will be clearly understood by those skilled in the art to which the present disclosure belongs.

[0169] The electronic device according to the various embodiments disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this document is not limited to the devices described above.

[0170] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as “coupled” or “connected” to another (e.g., 2nd) component, with or without the terms “functionally” or “communicationly,” it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.

[0171] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0172] Various embodiments of the present document may be implemented as software (e.g., program (940)) comprising one or more instructions stored in a storage medium (e.g., internal memory (936) or external memory (938)) readable by a machine (e.g., electronic device (901)). For example, a processor (e.g., processor (920)) of the machine (e.g., electronic device (901)) may call at least one of the one or more instructions stored in the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.

[0173] According to one embodiment, the method according to the various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or an application store (e.g., Play Store). TM It can be distributed online (e.g., downloaded or uploaded) through ) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0174] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In electronic devices: display; Eye tracker; Memory for storing instructions; and It includes one or more processors including processing circuitry, and When the above instructions are executed individually or collectively by the one or more processors, the electronic device: Displaying a first text having a first text format through the display; Detecting the user's first eye movement corresponding to reading the first text displayed above through the eye tracker; Based on the first eye movement above, measure the user's first reading speed for the first text; Displaying a second text having a second text format different from the first text format through the display; Detecting the user's second eye movement corresponding to reading the displayed second text through the eye tracker; Based on the second eye movement above, measure the user's second reading speed for the second text; Based on the first reading speed and the second reading speed, determine the text format to be used in the electronic device; and An electronic device that controls display settings in the electronic device based on the above-determined text format.

2. In Paragraph 1, The above first text format includes a first character size, and An electronic device in which the second text format includes a second character size different from the first text.

3. In Paragraph 1, The first text format above includes a first combination of a first plurality of text formats, and The electronic device wherein the second text format comprises a second combination of a second plurality of text formats.

4. In Paragraph 3, The first combination of the first plurality of text formats includes a first character color and a first background color, and An electronic device in which the second combination of the second plurality of text formats includes a second character color and a second background color.

5. In Paragraph 3, An electronic device in which the first combination of the first plurality of text formats and the second combination of the second plurality of text formats are selected from a plurality of presets.

6. In Paragraph 3, When the above instructions are executed individually or jointly by the one or more processors, the electronic device: An electronic device that generates the second combination of the second plurality of text formats based on the first combination of the first plurality of text formats and the first reading speed.

7. In Paragraph 6, When the above instructions are executed individually or jointly by the one or more processors, the electronic device: The first combination of the first plurality of text formats and the first reading speed are applied to an artificial intelligence model to generate the second combination of the second plurality of text formats, and The above artificial intelligence model is an electronic device that is pre-trained to generate a combination of multiple text formats to achieve a reading speed higher than the input reading speed.

8. In Paragraph 1, The above first text format includes a first character size, and The second text format above includes a second character size different from the first character size, and When the above instructions are executed individually or jointly by the one or more processors, the electronic device: Displaying a third text having a third character size different from the first character size and the second character size through the display; Detecting the user's third eye movement corresponding to reading the displayed third text through the eye tracker; Based on the third eye movement above, measure the user's third reading speed for the third text; and An electronic device that determines the text format to be used in the electronic device based on the first reading speed, the second reading speed, and the third reading speed.

9. In Paragraph 8, If the second character size is smaller than the first character size and the second reading speed is slower than the first reading speed, the third character size is larger than the first character size, and If the second character size is smaller than the first character size and the second reading speed is faster than the first reading speed, the third character size is smaller than the second character size, and If the second character size is larger than the first character size and the second reading speed is slower than the first reading speed, the third character size is smaller than the first character size, and An electronic device in which, when the second character size is larger than the first character size and the second reading speed is faster than the first reading speed, the third character size is larger than the second character size.

10. In Paragraph 8, The text format to be used in the electronic device includes the character size of the text in which the fastest reading speed among the first reading speed, the second reading speed, and the third reading speed is measured, and An electronic device in which the above-mentioned character size is one of the above-mentioned first character size, the above-mentioned second character size, and the above-mentioned third character size.

11. A method performed in an electronic device including a display and an eye tracker: The operation of displaying a first text having a first text format through the display; An operation of detecting a user's first eye movement corresponding to reading the first text displayed above through the eye tracker; An operation to measure the user's first reading speed for the first text based on the first eye movement; The operation of displaying a second text having a second text format different from the first text format through the display; An operation of detecting the user's second eye movement corresponding to reading the second text displayed above through the eye tracker; An operation to measure the user's second reading speed for the second text based on the second eye movement; An operation to determine a text format to be used in the electronic device based on the first reading speed and the second reading speed; and A method comprising controlling a display setting in the electronic device based on the above-determined text format.

12. In Paragraph 11, The above first text format includes a first character size, and A method in which the second text format includes a second character size different from the first text.

13. In Paragraph 11, The first text format above includes a first combination of a first plurality of text formats, and A method in which the second text format comprises a second combination of a second plurality of text formats.

14. In Paragraph 11, The above first text format includes a first character size, and The second text format above includes a second character size different from the first character size, and The above method is: The operation of displaying a third text having a third character size different from the first character size and the second character size through the display; The operation of detecting the user's third eye movement corresponding to reading the third text displayed above through the eye tracker; and The method further includes an operation to measure the user's third reading speed for the third text based on the third eye movement. The operation of determining the text format to be used in the above electronic device is: A method comprising determining the text format to be used in the electronic device based on the first reading speed, the second reading speed, and the third reading speed.

15. A computer-readable, non-transient recording medium storing a computer program comprising instructions, wherein the instructions, when executed by an electronic device, cause the electronic device: The operation of displaying a first text having a first text format through a display; An operation of detecting a user's first eye movement corresponding to reading the first text displayed above through an eye tracker; An operation to measure the user's first reading speed for the first text based on the first eye movement; The operation of displaying a second text having a second text format different from the first text format through the display; An operation of detecting the user's second eye movement corresponding to reading the second text displayed above through the eye tracker; An operation to measure the user's second reading speed for the second text based on the second eye movement; An operation to determine a text format to be used in the electronic device based on the first reading speed and the second reading speed; and A recording medium that enables a method including controlling a display setting in the electronic device based on the above-determined text format.

Images