Method of changing settings of a display and electronic device

CN116057451BActive Publication Date: 2026-08-21SAMSUNG ELECTRONICS CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202180054559.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2020-09-03
Filing Date
2021-08-27
Publication Date
2026-08-21
Estimated Expiration
2041-08-27

AI Technical Summary

Benefits of technology

[0011] Some embodiments of this disclosure can identify the dominant eye and/or non-dominant eye from the user's eye and change at least some settings of the display panel corresponding to the non-dominant eye, which can reduce the current consumption of the electronic device.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116057451B_ABST
    Figure CN116057451B_ABST
Patent Text Reader

Abstract

An electronic device according to various embodiments can include a first camera to capture an external environment in front of the electronic device, a second camera to capture a direction opposite to a capturing direction of the first camera so as to identify a gaze direction of left and right eyes of a user, a first display panel corresponding to the left eye, a second display panel corresponding to the right eye, a memory, and a processor operatively connected with the first camera, the second camera, the first display panel, the second display panel, and the memory. The processor can identify a dominant eye and a non-dominant eye among the left and right eyes, identify a main display panel corresponding to the dominant eye among the first display panel and the second display panel, and identify an auxiliary display panel corresponding to the non-dominant eye among the first display panel and the second display panel, and change at least some settings of the main display panel. Other various embodiments are possible.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] Some embodiments of this disclosure relate to methods and electronic devices for changing the settings of virtual reality and augmented reality displays. Background Technology

[0002] With the development of digital technology, various types of electronic devices, such as mobile communication terminals, personal digital assistants (PDAs), electronic notebooks, smartphones, tablet PCs (PCs), and wearable devices, have been widely used. Development continues to support and enhance these functions of electronic devices, thereby improving hardware and / or software.

[0003] For example, electronic devices can facilitate virtual reality (VR) services, allowing users to have a realistic experience in a computer-generated virtual world. Furthermore, electronic devices can provide augmented reality (AR) services where virtual information (or objects) are added to a view of the real world. Additionally, some devices offer mixed reality (MR) services that blend VR and AR into a single experience. Electronic devices can include heads-up displays (HUDs) that provide such VR and AR services. Summary of the Invention

[0004] Technical issues

[0005] Electronic devices such as HUDs can be worn on a user's head and include a first panel corresponding to the left eye and a second panel corresponding to the right eye. A display module can be included within the device frame (e.g., a housing). The display module may include the first and second panels. The electronic device can display an image with certain matching elements (e.g., providing a stereoscopic effect) through the first and second panels. When the electronic device outputs an image through the first and second panels, it consumes a significant amount of power, thus potentially reducing the device's usability and causing its temperature to rise due to the resulting heat.

[0006] Some embodiments of this disclosure may provide devices and methods to distinguish between a user's dominant eye and non-dominant eye, and to change the settings of the display panel corresponding to the non-dominant eye, thereby reducing power consumption.

[0007] Solution

[0008] An electronic device according to certain embodiments may include: a first camera configured to capture the external environment in front of the electronic device; a second camera oriented opposite to the first camera and configured to capture the gaze directions of a user's left and right eyes; a first display panel corresponding to the left eye; a second display panel corresponding to the right eye; a memory; and a processor operatively connected to the first camera, the second camera, the first display panel, the second display panel, and the memory, wherein the processor is configured to: identify a dominant eye and a non-dominant eye in the left and right eyes using the second camera; identify a dominant display panel corresponding to the dominant eye from the first and second display panels, and identify a non-dominant display panel corresponding to the non-dominant eye from the first and second display panels; and change the settings of the dominant display panel to be different from the settings of the non-dominant display panel.

[0009] The method according to some embodiments may include using one or more of a first camera configured to capture the external environment in front of the electronic device or a second camera oriented opposite to the first camera and configured to capture the gaze directions of the user's left and right eyes; identifying a dominant eye and a non-dominant eye in the user's left and right eyes using at least one processor; identifying a dominant display panel corresponding to the dominant eye from a first display panel and a second display panel, and identifying a non-dominant display panel corresponding to the non-dominant eye from the first display panel and the second display panel; and changing the settings of the dominant display panel to be different from the settings of the non-dominant display panel.

[0010] Technical effects of the present invention

[0011] Some embodiments of this disclosure can identify the dominant eye and / or non-dominant eye from the user's eye and change at least some settings of the display panel corresponding to the non-dominant eye, which can reduce the current consumption of the electronic device.

[0012] According to some embodiments, the electronic device can determine a user's dominant eye and non-dominant eye, and change the settings of the display panel corresponding to the non-dominant eye, making them at least partially different from the settings of the display panel corresponding to the dominant eye. The electronic device can change at least some settings of the display panel corresponding to the non-dominant eye to reduce the display quality of the display panel.

[0013] According to certain embodiments of this disclosure, by changing the display panel settings, the current consumption of the electronic device can be reduced, the potential usage time of the device can be increased, and heat generation can be reduced.

[0014] In addition, various effects that can be determined directly or indirectly through this article can be provided. Attached Figure Description

[0015] The above and other aspects, features and advantages of this disclosure will become clearer from the following description taken in conjunction with the accompanying drawings, wherein:

[0016] Figure 1 This describes an electronic device in a network environment according to the present disclosure.

[0017] Figure 2a This is a view illustrating the overall configuration of an electronic device including multiple cameras according to certain embodiments of the present disclosure.

[0018] Figure 2b This is a front view of an electronic device according to certain embodiments of the present disclosure.

[0019] Figure 2c This is a rear view of an electronic device according to certain embodiments of the present disclosure.

[0020] Figure 3 This is a block diagram of an electronic device for changing the settings of a display panel according to certain embodiments of the present disclosure.

[0021] Figure 4 This is a flowchart illustrating a method for changing the settings of a display panel corresponding to a non-dominant eye, according to certain embodiments of the present disclosure.

[0022] Figure 5 This describes a method for adjusting the resolution of a display panel corresponding to the non-dominant eye, according to certain embodiments of the present disclosure.

[0023] Figure 6 This is a table describing methods for adjusting the resolution of a display panel corresponding to the non-dominant eye according to certain embodiments of this disclosure.

[0024] Figure 7 This is a flowchart illustrating a method for adjusting the frame rate of a display panel corresponding to a non-dominant eye, according to certain embodiments of the present disclosure.

[0025] Figure 8 This is a table describing a method for adjusting the frame rate of a display panel corresponding to a non-dominant eye, according to certain embodiments of this disclosure.

[0026] Figure 9 This is a flowchart illustrating a method for adjusting the display area of ​​a display panel corresponding to a non-dominant eye, according to certain embodiments of the present disclosure.

[0027] Figure 10aThis is a first explanatory diagram illustrating a method for adjusting the display area of ​​a display panel corresponding to a non-dominant eye, according to certain embodiments of the present disclosure.

[0028] Figure 10b This is a second explanatory diagram illustrating a method for adjusting the display area of ​​a display panel corresponding to the non-dominant eye, according to certain embodiments of the present disclosure.

[0029] Figure 11 This is a flowchart illustrating a method for detecting changes in the non-dominant eye and changing the settings of a display panel corresponding to the changed non-dominant eye, according to certain embodiments of this disclosure.

[0030] Figure 12 This is an explanatory diagram illustrating a method for detecting changes in the non-dominant eye and changing the settings of a display panel corresponding to the changed non-dominant eye, according to certain embodiments of the present disclosure.

[0031] Figure 13a This is a first illustrative diagram depicting a method for detecting a dominant eye and a non-dominant eye according to certain embodiments of the present disclosure.

[0032] Figure 13b This is a second illustrative diagram depicting a method for detecting the dominant eye and non-dominant eye according to certain embodiments of the present disclosure.

[0033] Figure 14 This is an illustrative diagram depicting a method for detecting the dominant eye and non-dominant eye based on a field of view region according to certain embodiments of the present disclosure. Detailed Implementation

[0034] The following is a detailed description of certain embodiments with reference to the accompanying drawings. It should be understood that these embodiments and the terminology used therein are not intended to limit the technology described herein to the specific embodiments, but rather to include various modifications, equivalents, and / or substitutions thereof. In the description of the drawings, similar reference numerals may be used for similar components. Unless the context clearly indicates otherwise, the singular form also includes the plural form.

[0035] Figure 1 This is a block diagram illustrating an electronic device 101 in a network environment 100 according to various embodiments. (Refer to...) Figure 1In network environment 100, electronic device 101 can communicate with electronic device 102 via a first network 198 (e.g., a short-range wireless communication network), or with electronic device 104 or server 108 via a second network 199 (e.g., a long-range wireless communication network). According to an embodiment, electronic device 101 can communicate with electronic device 104 via server 108. According to an embodiment, electronic device 101 may include a processor 120, memory 130, input device 150, sound output device 155, display device 160, audio module 170, sensor module 176, interface 177, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, user identification module (SIM) 196, or antenna module 197. In some embodiments, at least one of these components (e.g., display device 160 or camera module 180) may be omitted from electronic device 101, or one or more other components may be added to electronic device 101. In some embodiments, some of the components may be implemented as a single integrated circuit. For example, the sensor module 176 (e.g., a fingerprint sensor, an iris sensor, or an illuminance sensor) may be implemented as embedded in the display device 160 (e.g., a display).

[0036] Processor 120 may run software (e.g., program 140) to control at least one other component (e.g., hardware or software component) of electronic device 101 connected to processor 120, and may perform various data processing or calculations. According to one embodiment, as at least part of the data processing or calculation, processor 120 may load commands or data received from another component (e.g., sensor module 176 or communication module 190) into volatile memory 132, process the commands or data stored in volatile memory 132, and store the resulting data in non-volatile memory 134. According to an embodiment, processor 120 may include a main processor 121 (e.g., central processing unit (CPU) or application processor (AP)) and an auxiliary processor 123 (e.g., graphics processing unit (GPU), image signal processor (ISP), sensor hub processor, or communication processor (CP)) that is operationally independent of or combined with the main processor 121. Additionally or alternatively, auxiliary processor 123 may be adapted to consume less power than main processor 121, or adapted for a specific function. The auxiliary processor 123 can be implemented separately from the main processor 121, or it can be implemented as part of the main processor 121.

[0037] When the main processor 121 is inactive (e.g., in sleep mode), the auxiliary processor 123 may control at least some of the functions or states associated with at least one component of the electronic device 101 (other than the main processor 121) (e.g., display device 160, sensor module 176, or communication module 190), or when the main processor 121 is active (e.g., running an application), the auxiliary processor 123 may work with the main processor 121 to control at least some of the functions or states associated with at least one component of the electronic device 101 (e.g., display device 160, sensor module 176, or communication module 190). According to embodiments, the auxiliary processor 123 (e.g., an image signal processor or a communication processor) may be implemented as part of another component (e.g., camera module 180 or communication module 190) functionally associated with the auxiliary processor 123.

[0038] Memory 130 may store various data used by at least one component of electronic device 101 (e.g., processor 120 or sensor module 176). The various data may include, for example, software (e.g., program 140) and input or output data for commands associated with it. Memory 130 may include volatile memory 132 or non-volatile memory 134.

[0039] The program 140 may be stored as software in the memory 130, and the program 140 may include, for example, an operating system (OS) 142, middleware 144, or application 146.

[0040] Input device 150 can receive commands or data from outside electronic device 101 (e.g., a user) that will be used by other components of electronic device 101 (e.g., processor 120). Input device 150 may include, for example, a microphone, mouse, keyboard, keys (e.g., buttons), or digital pen (e.g., stylus).

[0041] The sound output device 155 can output sound signals to the outside of the electronic device 101. The sound output device 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as playing multimedia or playing records, and the receiver can be used for incoming calls. According to an embodiment, the receiver may be implemented separately from the speaker or as part of the speaker.

[0042] Display device 160 can visually provide information to the outside of electronic device 101 (e.g., to a user). Display device 160 may include, for example, a display, a holographic device, or a projector, and control circuitry for controlling a respective one of the display, holographic device, and projector. According to an embodiment, display device 160 may include touch circuitry adapted to detect touch or sensor circuitry (e.g., a pressure sensor) adapted to measure the intensity of the force caused by touch.

[0043] The audio module 170 can convert sound into electrical signals and vice versa. According to an embodiment, the audio module 170 can obtain sound via the input device 150, or output sound via the sound output device 155 or headphones of an external electronic device (e.g., electronic device 102) that is directly (e.g., wired) or wirelessly connected to the electronic device 101.

[0044] Sensor module 176 can detect the operating state of electronic device 101 (e.g., power or temperature) or the environmental state outside electronic device 101 (e.g., user state), and then generate an electrical signal or data value corresponding to the detected state. According to embodiments, sensor module 176 may include, for example, a gesture sensor, gyroscope sensor, atmospheric pressure sensor, magnetic sensor, accelerometer, grip sensor, proximity sensor, color sensor, infrared (IR) sensor, biometric sensor, temperature sensor, humidity sensor, or illuminance sensor.

[0045] Interface 177 may support one or more specific protocols used to enable electronic device 101 to connect directly (e.g., wired) or wirelessly to external electronic devices (e.g., electronic device 102). According to embodiments, interface 177 may include, for example, a High Definition Multimedia Interface (HDMI), a Universal Serial Bus (USB) interface, a Secure Digital Card (SD) interface, or an audio interface.

[0046] Connection end 178 may include a connector, through which electronic device 101 can be physically connected to an external electronic device (e.g., electronic device 102). According to embodiments, connection end 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0047] The tactile module 179 can convert electrical signals into mechanical stimuli (e.g., vibration or motion) or electrical stimuli that can be recognized by a user through his touch or kinesthesia. According to embodiments, the tactile module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulator.

[0048] Camera module 180 can capture still or moving images. According to an embodiment, camera module 180 may include one or more lenses, an image sensor, an image signal processor, or a flash. According to an embodiment, camera module 180 may include a front-facing camera disposed on the front surface of electronic device 101 and a rear-facing camera disposed on the rear surface of electronic device 101.

[0049] The power management module 188 manages the power supply to the electronic device 101. According to an embodiment, the power management module 188 may be implemented as at least part of, for example, a power management integrated circuit (PMIC).

[0050] Battery 189 can power at least one component of electronic device 101. According to an embodiment, battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable rechargeable battery, or a fuel cell.

[0051] Communication module 190 can support the establishment of a direct (e.g., wired) or wireless communication channel between electronic device 101 and external electronic devices (e.g., electronic device 102, electronic device 104, or server 108), and perform communication via the established communication channel. Communication module 190 may include one or more communication processors capable of operating independently of processor 120 (e.g., application processor (AP)) and support direct (e.g., wired) or wireless communication. According to embodiments, communication module 190 may include wireless communication module 192 (e.g., cellular communication module, short-range wireless communication module, or Global Navigation Satellite System (GNSS) communication module) or wired communication module 194 (e.g., local area network (LAN) communication module or power line communication (PLC) module). One of these communication modules can communicate with an external electronic device via a first network 198 (e.g., a short-range communication network such as Bluetooth, Wi-Fi Direct, or Infrared Data Association (IrDA)) or a second network 199 (e.g., a long-range communication network such as a cellular network, the Internet, or a computer network (e.g., a LAN or a wide area network (WAN))). These various types of communication modules can be implemented as a single component (e.g., a single chip) or as multiple components (e.g., multiple chips) that are separate from each other. The wireless communication module 192 can identify and verify the electronic device 101 in the communication network (such as the first network 198 or the second network 199) using user information (e.g., the International Mobile Subscriber Identity (IMSI)) stored in the user identification module 196.

[0052] Wireless communication module 192 can support 5G networks and next-generation communication technologies beyond 4G networks, such as New Radio (NR) access technologies. NR access technologies can support enhanced mobile broadband (eMBB), massive machine-type communications (mMTC), or ultra-reliable and low-latency communications (URLLC). Wireless communication module 192 can support high-frequency bands (e.g., millimeter-wave bands) to achieve, for example, high data transmission rates. Wireless communication module 192 can support various technologies to ensure performance at high frequencies, such as beamforming, massive MIMO, full-dimensional MIMO (FD-MIMO), array antennas, analog beamforming, or massive antennas. Wireless communication module 192 can support various requirements specified in electronic device 101, external electronic devices (e.g., electronic device 104), or network systems (e.g., second network 199). According to an embodiment, the wireless communication module 192 may support peak data rates (e.g., 20 Gbps or higher) for implementing eMBB, loss coverage (e.g., 164 dB or lower) for implementing mMTC, or U-plane latency (e.g., 0.5 ms or less, or 1 ms or less round trip in each of the downlink (DL) and uplink (UL)) for implementing URLLC.

[0053] Antenna module 197 can transmit or receive signals or power to or from the outside of electronic device 101 (e.g., external electronic device). According to embodiments, antenna module 197 may include one or more antennas, and therefore, at least one antenna suitable for a communication scheme used in a communication network (such as a first network 198 or a second network 199) can be selected by, for example, communication module 190 (e.g., wireless communication module 192). Signals or power can then be transmitted or received between communication module 190 and external electronic device via the selected at least one antenna.

[0054] According to some embodiments, antenna module 197 can form a millimeter-wave antenna module. According to embodiments, the millimeter-wave antenna module may include a printed circuit board, an RFIC disposed on a first surface (e.g., the bottom surface) of the printed circuit board or an RFIC adjacent to the first surface that is capable of supporting a specified high-frequency band (e.g., millimeter-wave band), and a plurality of antennas (e.g., array antennas) disposed on a second surface (e.g., the top or side surface) of the printed circuit board or adjacent to the second surface that are capable of transmitting or receiving signals of the specified high-frequency band.

[0055] At least some of the aforementioned components can be interconnected and communicate signals (e.g., commands or data) between them via an inter-peripheral communication scheme (e.g., bus, general purpose input / output (GPIO), serial peripheral interface (SPI), or mobile industrial processor interface (MIPI)).

[0056] According to an embodiment, commands or data can be sent or received between electronic device 101 and external electronic device 104 via server 108 connected to a second network 199. Each of electronic device 102 and electronic device 104 can be a device of the same type as electronic device 101, or a device of a different type. According to an embodiment, all or some operations that would be performed on electronic device 101 can be performed on one or more of external electronic devices 102, external electronic devices 104, or server 108. For example, if electronic device 101 is required to automatically perform a function or service, or is required to perform a function or service in response to a request from a user or another device, electronic device 101 may request the one or more external electronic devices to perform at least a portion of the function or service, instead of running the function or service, or electronic device 101 may request the one or more external electronic devices to perform at least a portion of the function or service in addition to running the function or service. Upon receiving the request, the one or more external electronic devices may perform at least a portion of the requested function or service, or perform additional functions or services related to the request, and transmit the result of the execution to electronic device 101. Electronic device 101 may provide the result as at least a partial response to the request, either with further processing or without further processing. For this purpose, technologies such as cloud computing, distributed computing, or client-server computing may be used.

[0057] Figure 2a This describes an electronic device including multiple cameras according to certain embodiments of the present disclosure (e.g., Figure 1 The overall configuration of the electronic device 101 in the middle. Figure 2b A front view of an electronic device according to certain embodiments of the present disclosure is shown. Figure 2c A rear view of an electronic device according to certain embodiments of the present disclosure is shown. Figure 2b This is the first explanatory diagram illustrating the front of the electronic device 101. Figure 2c This is a second explanatory diagram illustrating the rear of the electronic device 101, whose internal configuration can be compared with... Figure 2a The configuration shown is the same.

[0058] In some embodiments, the electronic device 101 may be worn on a user's head and provide the user with images related to augmented reality services. According to embodiments, the electronic device 101 may provide augmented reality services, the service output of which is viewed as overlaid on at least one virtual object within an area defined as the user's field of view (FoV). For example, the area defined as the user's field of view is defined as an area that can be recognized by a user wearing the electronic device 101 through the electronic device 101, and may be a display module including the electronic device 101 (e.g., Figure 1 The display module 160 in the display module (or at least a portion thereof) may be located in the entirety or at least a portion thereof. According to an embodiment, the electronic device 101 may include multiple glasses (e.g., first glasses 220 and / or second glasses 230) corresponding to the user's two eyes (e.g., left eye and / or right eye). These multiple glasses may include at least a portion of the display module (e.g., ...). Figure 3 The device 101 may include a first display module 351 and / or a second display module 353. For example, the first glasses 220 corresponding to the user's left eye may include the first display module 351, and the second glasses 230 corresponding to the user's right eye may include the second display module 353. For example, the electronic device 101 may be configured as at least one of glasses, goggles, a helmet, or a hat, but is not limited thereto.

[0059] Reference Figure 2a The electronic device 101 according to the embodiment may include a display module 214 (e.g., Figure 1 The display module 160 and the camera module (e.g., Figure 1 The camera module 180 and the audio module (e.g., Figure 1 The audio module 170, the first support portion 221, and / or the second support portion 222 are included. According to an embodiment, the display module 160 may include a first display (e.g., an audio module 170), a first support portion 221, and / or a second support portion 222. Figure 3 The first glasses 220, the first display module 351) and / or the second display (e.g., Figure 3The second glasses 230 and the second display module 353 are included. According to an embodiment, at least one camera may include a capturing camera 213 for capturing images corresponding to the user's field of view (FoV) and / or measuring distances to environmental objects, an eye-tracking camera 212 for identifying the user's gaze direction, and / or a recognition camera (e.g., a gesture capture camera) 211-1 or 211-2 for identifying a specific space. For example, the capturing camera 213 may capture images from the front of the electronic device 101, and the eye-tracking camera 212 may capture images from the opposite direction to the capturing camera 213. For example, the eye-tracking camera 212 may at least partially capture images of the user's eyes. According to an embodiment, the first support portion 221 and / or the second support portion 222 may include printed circuit boards (PCBs) 231-1 and 231-2, speakers 232-1 and 232-2, and / or batteries 233-1 and 233-2.

[0060] According to an embodiment, the display module 160 (e.g., Figure 2a The display module 214 in the electronic device 101 can be disposed in the main body of the electronic device 101 (e.g., Figure 2b The main body portion 223 of the display module 160 may include a focusing lens (not shown) and / or a transparent waveguide (not shown) on eyeglasses (e.g., first eyeglasses 220 and second eyeglasses 230). For example, the transparent waveguide may be at least partially disposed in a portion of the eyeglasses. According to an embodiment, light emitted from the display module 160 can be incident on one end of the eyeglasses through the first eyeglasses 220 and the second eyeglasses 230, and the incident light can be transmitted to the user through the waveguide formed in the eyeglasses. The waveguide may be made of glass, plastic, or polymer, and may include nanopatterns, such as polygonal or arcuate grating structures formed on one surface, either internally or externally. According to an embodiment, the incident light can be provided to the user by propagation or reflection within the waveguide through the nanopatterns. According to an embodiment, the waveguide may include at least one of at least one diffractive element (e.g., a diffractive optical element (DOE), a holographic optical element (HOE)) or at least one reflective element (e.g., a mirror). According to an embodiment, the waveguide can guide display light emitted from the light source to the user's eyes by using at least one diffractive element or reflective element.

[0061] Reference Figure 2aThe first support portion 221 and / or the second support portion 222 may include printed circuit boards 231-1 and 231-2 for transmitting electrical signals to various components of the electronic device 101, speakers 232-1 and 232-2 for outputting audio signals, batteries 233-1 and 233-2, and / or hinges 240-1 and 240-2 for at least partially connecting to the main body portion 223 of the electronic device 101. According to an embodiment, speakers 232-1 and 232-2 may include a first speaker 232-1 for transmitting audio signals to the user's left ear and a second speaker 232-2 for transmitting audio signals to the user's right ear. Speakers 232-1 and 232-2 may be included in... Figure 1 In the audio module 170. According to an embodiment, the electronic device 101 may be equipped with multiple batteries 233-1 and 233-2, and can be connected via a power management module (e.g., Figure 1 The power management module 188 in the middle supplies power to printed circuit boards 231-1 and 231-2.

[0062] Reference Figure 2a The electronic device 101 may include a microphone 241 for receiving the user's voice and ambient sounds. For example, the microphone 241 may be included in... Figure 1 The audio module 170 is included. Electronic device 101 may include at least one illumination device (illumination LED) 242 to improve the accuracy of at least one camera (e.g., capturing camera 213, eye-tracking camera 212, and / or recognition camera 211-1 or 211-2). For example, illumination device 242 may serve as an auxiliary device to improve the accuracy of capturing a user's pupil with eye-tracking camera 212, and illumination device 242 may use an infrared LED with an infrared wavelength instead of a visible light wavelength. As another example, illumination device 242 may serve as an auxiliary device for capturing a user's gestures using recognition cameras 211-1 and 211-2 when the object to be captured is difficult to detect in a dark environment or due to the mixing of multiple light sources and reflected light.

[0063] Reference Figure 2b and Figure 2c The electronic device 101 according to an embodiment may include a main body portion 223 and a support portion (e.g., a first support portion 221 and / or a second support portion 222), and the main body portion 223 and the support portions 221 and 222 may be in an operably connected state. For example, the main body portion 223 and the support portions 221 and 222 may be operably connected via hinges 240-1 and 240-2. The main body portion 223 may be at least partially mounted on the user's nose and may include a display module 160 and a camera module (e.g., ...). Figure 1(Camera module 180 in the image). Support portions 221 and 222 may include support portions placed on the user's ears, and may include a first support portion 221 placed on the left ear and / or a second support portion 222 placed on the right ear. According to an embodiment, the first support portion 221 or the second support portion 222 may at least partially include a printed circuit board 231-1 or 231-2, a speaker 232-1 or 232-2 and / or a battery 233-1 or 233-2 (e.g., ...). Figure 1 Battery 189 in Figure 3 The first battery 333 and / or the second battery 334 in the battery. The battery can be connected to a power management module (e.g., Figure 1 The power management module 188 in the middle is electrically connected.

[0064] According to an embodiment, the display module 160 may include a first pair of glasses 220 and / or a second pair of glasses 230, and can provide visual information to a user through the first pair of glasses 220 and the second pair of glasses 230. The electronic device 101 may include a first pair of glasses 220 corresponding to the left eye and / or a second pair of glasses 230 corresponding to the right eye. According to an embodiment, the display module 160 may include a display panel and / or lenses (e.g., glass). For example, the display panel may include a transparent material, such as glass or plastic.

[0065] According to an embodiment, the display module 160 may include a transparent element, through which a user can perceive the real space behind the display module 160. The display module 160 may display virtual objects on at least a portion of the transparent element, thereby allowing the user to perceive the virtual objects as being added to at least some real space. The first glasses 220 and / or the second glasses 230 included in the display module 160 may include multiple display panels corresponding to the user's two eyes (e.g., the left eye and / or the right eye), respectively.

[0066] According to an embodiment, electronic device 101 may include a virtual reality (VR) device (e.g., a virtual reality device). When electronic device 101 is a VR device, the first glasses 220 may be a first display module 351, and the second glasses 230 may be a second display module 353.

[0067] According to embodiments, the virtual objects output by display module 160 may include information related to an application running on electronic device 101 and / or information related to external objects located in real space corresponding to the area determined as the user's field of view (FoV). For example, in image information related to real space obtained by a camera (e.g., capturing camera 213) of electronic device 101, electronic device 101 may identify external objects included in at least a portion corresponding to the area determined as the user's field of view (FoV). Electronic device 101 may output (or display) virtual objects related to the external objects identified in at least a portion of the area determined as the user's field of view in the display area of ​​electronic device 101. External objects may include things existing in real space. According to some embodiments, the display area of ​​electronic device 101 displaying virtual objects may include a portion (e.g., at least a portion of a display panel) of a display module (e.g., a first display module 351 or a second display module 353). According to embodiments, the display area may be an area corresponding to at least a portion of the first glasses 220 and / or the second glasses 230.

[0068] According to an embodiment, the electronic device 101 may include a capturing camera 213 (e.g., an RGB camera) for capturing images corresponding to the user's field of view (FoV) and / or measuring distances to objects, an eye-tracking camera 212 for identifying the user's gaze direction, and / or recognition cameras 211-1 and 211-2 (e.g., gesture cameras) for identifying specific spaces. According to an embodiment, the electronic device 101 may utilize the capturing camera 213 to measure distances to objects located in front of the electronic device 101. According to an embodiment, in the electronic device 101, a plurality of eye-tracking cameras 212 may be arranged corresponding to the user's eyes. For example, the eye-tracking camera 212 may capture images in the opposite direction to the capturing direction of the capturing camera 213. The eye-tracking camera 212 may detect the user's gaze direction (e.g., eye movement). For example, the eye-tracking camera 212 may include a first eye-tracking camera 212-1 for tracking the gaze direction of the user's left eye and a second eye-tracking camera 212-2 for tracking the gaze direction of the user's right eye. According to an embodiment, electronic device 101 can utilize recognition cameras 211-1 and 211-2 to detect user gestures within a preset distance (e.g., a specific space). For example, recognition cameras 211-1 and 211-2 can be configured in multiples and can be positioned on both sides of electronic device 101. Electronic device 101 can utilize at least one camera to detect the eye corresponding to the dominant eye and / or non-dominant eye from the left and / or right eye. For example, electronic device 101 can detect the eye corresponding to the dominant eye and / or non-dominant eye based on the user's gaze direction towards an external or virtual object.

[0069] According to embodiments, the capturing camera 213 may include a high-quality camera, such as a high-resolution (HR) camera and / or a photo-video (PV) camera. According to embodiments, the eye-tracking camera 212 may track the user's gaze direction by detecting the user's pupils and may be used to move the center of a virtual image in response to the gaze direction. For example, the eye-tracking camera 212 may be divided into a first eye-tracking camera 212-1 corresponding to the left eye and a second eye-tracking camera 212-2 corresponding to the right eye, and these cameras may be substantially identical in performance and / or specifications. According to embodiments, the recognition cameras 211-1 and 211-2 may be used to detect the user's hands (gestures) and / or spatial recognition, and may include a global shutter (GS) camera. For example, the recognition cameras 211-1 and 211-2 may include a GS camera with low image latency, such as a rolling shutter (RS) camera, to detect and track rapid gestures and / or minute finger movements.

[0070] According to an embodiment, the electronic device 101 may be based on a camera (e.g., via the electronic device 101) Figure 1 The electronic device 101 uses image information related to real space obtained by the camera module 180 to display virtual objects and augmented reality services. According to an embodiment, the electronic device 101 can display virtual objects based on display modules configured to correspond to the user's two eyes (e.g., a first display module 351 corresponding to the left eye and / or a second display module 353 corresponding to the right eye). According to an embodiment, the electronic device 101 can display virtual objects based on pre-configured settings information (e.g., resolution, frame rate, brightness, and / or display area).

[0071] According to an embodiment, the electronic device 101 can operate as independent components, including a first display panel in the first glasses 220 and a second display panel in the second glasses 230. For example, the electronic device 101 can determine the display performance of the first display panel based on first setting information, and can determine the display performance of the second display panel based on second setting information.

[0072] Included Figure 2a , Figure 2b and / or Figure 2c The number and location of one or more cameras (e.g., capturing camera 213, eye-tracking camera 212, and / or recognition cameras 211-1 and 211-2) in the electronic device 101 shown may not be fixed. For example, the number and location of one or more cameras (e.g., capturing camera 213, eye-tracking camera 212, and / or recognition cameras 211-1 and 211-2) may vary depending on the form (e.g., shape or size) of the electronic device 101.

[0073] Figure 3An electronic device 101 for changing settings of a display panel according to certain embodiments of this disclosure (e.g., Figure 1 Block diagram of electronic device 101 in the middle.

[0074] Reference Figure 3 Electronic device 101 may include processor 120 (e.g., Figure 1 The processor 120 and memory 130 (e.g., Figure 1 The memory 130 and the display module 160 (e.g., in the memory 130) are shown in the display module 160. Figure 1 The display module 160 and audio module 170 (e.g., Figure 1 The audio module 170 and sensor module 176 (e.g., Figure 1 Sensor module 176 and camera module 180 (e.g., Figure 1 The camera module 180 and power management module 188 (e.g., Figure 1 The power management module 188 and battery 189 (e.g., Figure 1 The battery 189) and / or communication module (e.g., Figure 1 The communication module 190 in the middle). According to an embodiment, the electronic device 101 can be connected to an external electronic device (not shown) via a connection terminal 330 (e.g., USB Type-C). For example, the power management module 188 of the electronic device 101 can receive power from the external electronic device via the connection terminal 330 to charge the battery 189. As another example, the processor 120 of the electronic device 101 can perform power line communication with the external electronic device via the connection terminal 330. According to an embodiment, the electronic device 101 may include a main body portion (e.g., Figure 2b The main body 223) and the supporting parts (e.g., Figure 2b (The first support portion 221 and / or the second support portion 222). According to an embodiment, components of the electronic device 101 may be disposed on the main body portion 223 or the support portions 221 and 222.

[0075] According to an embodiment, processor 120 can execute a program stored in memory 130 (e.g., Figure 1 The processor 120 (program 140) controls at least one other component (e.g., a hardware or software component) and performs various data processing or operations. According to an embodiment, the processor 120 can provide augmented reality services to a user. The processor 120 can output at least one virtual object via the display module 160, such that the at least one virtual object is perceived as being added to the real space corresponding to the user's field of view wearing the electronic device 101.

[0076] According to an embodiment, the display module 160 of the electronic device 101 may include at least one pair of glasses (e.g., a first pair of glasses). Figure 2a The first pair of glasses 220) and / or the second pair of glasses (e.g., Figure 2a (Second glasses in the device 101). According to an embodiment, the first glasses 220 may include at least a portion of the first display module 351, and the second glasses 230 may include at least a portion of the second display module 353. For example, both the first display module 351 and / or the second display module 353 may include display panels. The display panels may be made of transparent elements so that the user can perceive real space through the display module 160. The display module 160 may display at least one virtual object on at least a portion of the display panel so that the user of the wearable electronic device 101 perceives the virtual object as added to real space. For example, the user's field of view may include the angle and / or range at which the user can perceive objects. According to an embodiment, the display module 160 may include the first display module 351 corresponding to the left eye of the user's eyes and / or the second display module 353 corresponding to the right eye. According to an embodiment, the processor 120 may load setting information (e.g., resolution, frame rate, size of the display area, and / or sharpness) related to the performance of the display module 160 from the memory 130, and may adjust the performance of the display module 160 based on the setting information. According to an embodiment, setting information may be determined separately for each display panel included in the display module 160. For example, a first display panel corresponding to the left eye can be configured based on first setting information, and a second display panel corresponding to the right eye can be configured based on second setting information. According to another embodiment, the setting information can differently configure at least a portion of a display panel included in the display module 160. For example, the electronic device 101 can differently configure the display module 160 in at least one aspect of resolution, frame rate, and / or sharpness. According to an embodiment, the electronic device 101 can reduce power consumption by at least partially changing the settings of the display module 160.

[0077] According to an embodiment, under the control of the processor 120, the audio module 170 can convert sound into electrical signals, or vice versa. For example, the audio module 170 may include... Figure 2a The speakers 232-1 and 232-2 and / or Figure 2a Microphone 241 in the middle.

[0078] According to an embodiment, the sensor module 176 of the electronic device 101 may include a proximity sensor 321, an illuminance sensor 322, and / or a gyroscope sensor 323. According to an embodiment, the proximity sensor 321 can detect objects approaching the electronic device 101. The illuminance sensor 322 can measure the brightness level around the electronic device 101. According to an embodiment, the processor 120 can use the illuminance sensor 322 to check the brightness level around the electronic device 101 and change the brightness-related settings of the display module 160 based on the brightness level. For example, if the ambient brightness is higher than a preset brightness, the processor 120 can set the brightness level of the display module 160 to be higher to increase the user's visibility. According to an embodiment, the gyroscope sensor 323 can detect the attitude and position of the electronic device 101. For example, the gyroscope sensor 323 can detect whether the electronic device 101 is correctly worn on the user's head. As another example, the gyroscope sensor 323 can detect the movement of the electronic device 101 or the user wearing the electronic device 101.

[0079] According to an embodiment, electronic device 101 can communicate with another electronic device (e.g., wireless communication circuit) via communication module 190 (e.g., wireless communication circuit). Figure 1 The electronic device 101 (or 104) communicates wirelessly with other electronic devices. For example, the electronic device 101 can communicate wirelessly with a portable electronic device (e.g., a smartphone) and exchange commands and / or data with it. According to an embodiment, the electronic device 101 can be at least partially controlled by another external electronic device (e.g., a portable electronic device). For example, the electronic device 101 can perform at least one function under the control of another external electronic device.

[0080] According to some embodiments, electronic device 101 may be based on different electronic devices connected wirelessly and / or wiredly (e.g., Figure 1 The electronic device 101 can be controlled by electronic device 102 or 104 to change at least some settings of the display panel. According to an embodiment, the electronic device 101 can control the camera (e.g., [missing information]) of the electronic device 101. Figure 1Dominant / non-dominant eye related information (e.g., distance information to objects in real space, user eye-tracking information, user gesture information) obtained by the camera module 180 in the system is sent to different electronic devices. Based on the dominant / non-dominant eye related information received from the electronic device 101, the different electronic devices can send the setting information of the display panel corresponding to the detected dominant or non-dominant eye, included in the glasses (e.g., first glasses 220 and / or second glasses 230), to the electronic device 101. The electronic device 101 can change at least some settings of the display panel based on the display panel setting information received from the different electronic devices. For example, the display panel settings can be changed to reduce the quality of the display panel, and at least some settings can be changed so as not to be perceived by the user. According to an embodiment, the electronic device 101 can reduce the resolution of the display panel, reduce the frame rate, or adjust the size and position of the display area of ​​the display panel.

[0081] According to an embodiment, the camera module 180 of the electronic device 101 may include a gesture camera 311, an eye-tracking camera 313, a distance measurement camera (depth camera) 315, and / or an RGB camera 317. According to an embodiment, the gesture camera 311 can detect the user's movement. Figure 2a The recognition cameras 211-1 and 211-2 in the device may include a gesture camera 311. For example, at least one gesture camera 311 may be mounted on the electronic device 101 and may detect hand movements of a user within a preset distance. The gesture camera 311 may include a simultaneous localization and mapping (SLAM) camera for recognizing information about the surrounding space of the electronic device 101 (e.g., position and / or orientation). The gesture recognition area of ​​the gesture camera 311 may be set based on the shooting range of the gesture camera 311. According to an embodiment, an eye-tracking camera 313 (e.g., Figure 2a The eye-tracking camera 212 can track the movement of the user's left and right eyes. According to an embodiment, the processor 120 can utilize the eye-tracking camera 313 to identify the gaze direction of the left and right eyes. For example, the eye-tracking camera 313 may include a first eye-tracking camera 212-1 for identifying the gaze direction of the left eye and a second eye-tracking camera 212-2 for identifying the gaze direction of the right eye. According to an embodiment, the processor 120 can determine the dominant and non-dominant eyes based on the gaze direction of the left and right eyes. According to an embodiment, the distance measuring camera 315 can measure the distance to objects located in front of the electronic device 101. Figure 2aThe capturing camera 213 may include a distance measuring camera 315. The distance measuring camera 315 may include a time-of-flight (TOF) camera and / or a depth camera. According to an embodiment, the distance measuring camera 315 may capture images from the front of the electronic device 101, and the eye-tracking camera 313 may capture images from the opposite direction of the distance measuring camera 315. According to another embodiment, the electronic device 101 may use the distance measuring camera 315 to measure the distance to an object and may change the settings of the display panel when the distance is greater than or equal to a threshold. For example, when the distance to an object is close to being less than or equal to the threshold, the electronic device 101 may maintain the display performance of the display panel. According to an embodiment, the electronic device 101 may use the eye-tracking camera 313 to identify one of the objects located in the user's gaze direction (e.g., FOV) and may calculate the distance to the corresponding object from depth information obtained by a depth camera or measure the distance to the corresponding object using a TOF camera. According to an embodiment, the red-green-blue (RGB) camera 317 may detect information about the color of the object and information about the distance to the object. According to an embodiment, electronic device 101 may include a camera obtained by combining a distance measuring camera 315 and an RGB camera 317. For example, Figure 2a The capturing camera 213 may include a distance measuring camera 315 and / or an RGB camera 317. According to embodiments, the gesture camera 311, eye-tracking camera 313, distance measuring camera 315, and / or RGB camera 317 included in the camera module 180 may each be individually included in the electronic device 101, or some of them may be implemented as an integrated camera. For example, the distance measuring camera 315 and the RGB camera 317 may be implemented as a single integrated camera.

[0082] According to an embodiment, the power management module 188 can manage the power supplied to the electronic device 101. The power management module 188 may include multiple power management modules (e.g., a first power management module 331, a second power management module 332). At least one of the first power management module 331 or the second power management module 332 can be directly connected to the processor 120 to supply power. At least one of the first power management module 331 or the second power management module 332 can receive power from an external electronic device via a connection terminal 330 (e.g., Type-C) to charge the battery 189 or power other components of the electronic device 101. According to an embodiment, the electronic device 101 can receive power from an external electronic device to charge the battery 189 via a wireless charging method. According to an embodiment, the power management module 188 can be electrically connected to components of the electronic device 101 (e.g., memory 130, display module 160, audio module 170, sensor module 176, camera module 180, and / or communication module 190). For example, power management module 188 can provide power from battery 189 to components of electronic device 101 based on the control of processor 120. According to an embodiment, electronic device 101 can receive power from first battery 333 via first power management module 331 and from second battery 334 via second power management module 332. According to an embodiment, processor 120 can manage power consumption by at least partially changing the settings of display module 160 based on information obtained using at least one of cameras 311, 313, 315, and 317 included in camera module 180.

[0083] According to an embodiment, under the control of the power management module 188, the battery 189 can be charged by receiving power or discharged by providing power. According to an embodiment, the battery 189 may include multiple batteries (e.g., a first battery 333 and a second battery 334). For example, the multiple batteries (e.g., the first battery 333 and the second battery 334) may be disposed on the main body portion 223 and the support portion (e.g., the first support portion 221 and / or the second support portion 222). According to an embodiment, the first battery 333 may be disposed on the first support portion 221, and the second battery 334 may be disposed on the second support portion 222.

[0084] According to some embodiments, electronic device 101 may include: a first camera (e.g., Figure 3 The distance measuring camera 315 is configured to capture the external environment in front of the electronic device 101; the second camera (e.g., Figure 3The eye-tracking camera 313 is oriented opposite to the first camera and configured to capture the gaze directions of the user's left and right eyes; a first display panel (e.g., first display module 351) corresponds to the left eye; and a second display panel (e.g., [missing information]) corresponds to the right eye. Figure 3 The system includes a second display module 353; a memory 130; and a processor 120 operatively connected to the first camera 315, the second camera 313, the first display panel, the second display panel, and the memory 130. The processor 120 can be configured to identify a dominant eye and / or a non-dominant eye in the left and right eyes, identify a dominant display panel corresponding to the dominant eye from the first and second display panels, identify a non-dominant display panel corresponding to the non-dominant eye from the first and second display panels, and change the settings of the dominant display panel to be different from the settings of the non-dominant display panel.

[0085] According to an embodiment, the processor 120 may be configured to use at least one of the first camera 315 or the second camera 313 to identify the gaze direction of the user's left eye and the user's right eye, and to identify the dominant eye and non-dominant eye in the left eye and right eye based on the captured gaze direction.

[0086] According to an embodiment, the processor 120 may be configured to use a first camera 315 to measure the distance to an object, use a second camera 313 to identify the gaze direction of the user's left and right eyes based on the detection that the measured distance exceeds a threshold, and change some settings of the non-dominant display panel corresponding to the non-dominant eye based on the determination that the measured distance exceeds the threshold.

[0087] According to an embodiment, the electronic device 101 may further include an illuminance sensor for detecting ambient brightness (e.g., Figure 3 The illuminance sensor 322 is configured to identify whether the luminance value measured by the illuminance sensor 322 is less than or equal to a threshold, and reduce the display resolution of the non-dominant display panel corresponding to the non-dominant eye based on the determination that the luminance value is less than or equal to the threshold.

[0088] According to an embodiment, the processor 120 can be configured to identify the movement of an object that the user is looking at based on the user's gaze direction, identify whether the movement of the object exceeds a preset reference value, and reduce the frame rate of the non-dominant display panel corresponding to the non-dominant eye based on the determination that the movement exceeds the reference value.

[0089] According to an embodiment, the processor 120 may be configured to reduce one or more of the resolution and frame rate of the non-dominant display panel corresponding to the non-dominant eye based on a preset time interval.

[0090] According to an embodiment, the processor 120 can be configured to detect the movement of the left and right eyes, determine whether the detected gaze movement exceeds a preset reference value, and reduce the display area of ​​the non-dominant display panel corresponding to the non-dominant eye based on the determination that the gaze movement exceeds the reference value.

[0091] According to an embodiment, the processor 120 can be configured to display virtual objects on a first display panel and a second display panel, and when a user looks at the displayed virtual object, the second camera is used to identify the gaze direction of the left eye and the gaze direction of the right eye, wherein the non-dominant eye is identified from the left eye and the right eye based on the identified gaze directions of the left eye and the right eye.

[0092] According to an embodiment, the electronic device 101 may also include a third camera (e.g., Figure 3 The gesture camera 311 in the middle is used to detect the user's gestures, so that the processor 120 can be configured to: use a third camera to detect the position of the user's hand when the user's hand forms a circle, and use a second camera to identify the gaze direction of the left eye and the gaze direction of the right eye when the user looks at an object through the circle, and wherein the non-dominant eye is identified from the left eye and the right eye based on the identified gaze directions of the left eye and the right eye.

[0093] According to an embodiment, the processor 120 can be configured to determine whether the dominant eye has changed based on the detection of the gaze direction of the left eye and the gaze direction of the right eye, and based on the determination that the dominant eye has changed from the right eye to the left eye, to change at least some settings of the display panel corresponding to the right eye, or to restore the settings of the display panel corresponding to the left eye to the initial settings.

[0094] Figure 4 This is a flowchart illustrating an example method for changing settings of a non-dominant display panel corresponding to a non-dominant eye, according to certain embodiments of this disclosure. The operations in the following embodiments may be performed sequentially, but not necessarily sequentially. For example, the order of operations may be changed, and at least two operations may be performed in parallel. According to embodiments, Figure 4 The electronic devices in the document may include Figure 1 The electronic device 101 in Figure 2 or the electronic device 101 in Figure 2.

[0095] According to an embodiment, this example electronic device (e.g., Figure 1 The electronic device 101 may include at least two display panels, each corresponding to one of the user's eyes, and may be mounted / worn on the user's head (e.g., to create a stereoscopic effect). The electronic device 101 may include a display module (e.g., Figure 1The display module 160 may include at least one display panel. For example, the display module 160 may include a first display module corresponding to the user's left eye (e.g., ...). Figure 3 The first display module 351 in the middle) and the second display module corresponding to the user's right eye (e.g., Figure 3 The second display module 353 in the first display module 351 may include a first display panel, and the second display module 353 may include a second display panel. According to an embodiment, the display module 160 of the electronic device 101 may include at least one display driver integrated circuit (DDI). For example, it may include a first DDI corresponding to the first display panel and a second DDI corresponding to the second display panel, or the first and second display panels may be driven by a single DDI. The display panel may be made of transparent elements so that the user can perceive the real space through the display panel.

[0096] According to an embodiment, the processor (e.g., Figure 1 The processor 120 in the display panel can display at least one virtual object so that the virtual object is perceived as being added to real space. The electronic device 101 may include an AR glasses device, and the display panel may be a component corresponding to a lens of the AR glasses device. According to an embodiment, the lens of the AR glasses device may include a waveguide for providing the user with the virtual object displayed by the display module 160. For example, the lens of the AR glasses device may include a first waveguide for transmitting an image displayed on a first display panel to the user's left eye and a second waveguide for transmitting an image displayed on a second display panel to the user's right eye. According to an embodiment, the waveguides (e.g., the first waveguide and / or the second waveguide) may be made of transparent elements so that the user can perceive real space through the waveguides.

[0097] According to an embodiment, electronic device 101 may include an eye-tracking camera for tracking the user's gaze direction (e.g., Figure 3 The eye-tracking camera 313) and the distance measuring camera (e.g., for measuring distance to an object) are used to measure distance to an object. Figure 3The distance measurement camera 315 in the image can be used. Multiple eye-tracking cameras 313 may be provided, each corresponding to one of the user's eyes. For example, the eye-tracking cameras 313 may include a first eye-tracking camera corresponding to the user's left eye and a second eye-tracking camera corresponding to the user's right eye. According to an embodiment, the eye-tracking cameras 313 can sense reflected light from the user's eyes based on the control of the processor 120. The eye-tracking cameras 313 can convert the sensed reflected light into electrical signals. The processor 120 can obtain an image of the user's eye using the converted electrical signals. The processor 120 can use the obtained image of the user's eye to track the user's gaze. For example, the processor 120 can track the user's gaze based on the position and movement of the reflected light sensed by the eye-tracking cameras 313.

[0098] The first eye-tracking camera can track the gaze direction of the left eye, and the second eye-tracking camera can track the gaze direction of the right eye. Generally, when a user gazes at an object, the eye that is accurately gazing at that object can be called the dominant eye, and the other eye can be called the non-dominant eye. According to an embodiment, the electronic device 101 can use the eye-tracking camera 313 to identify the gaze directions of the left and right eyes, and can distinguish the dominant eye and non-dominant eye in the user's eyes based on the identified gaze directions.

[0099] In operation 401, the processor of electronic device 101 (e.g., Figure 1 The processor 120 in the middle can utilize at least one camera (e.g., Figure 3 The processor 120 uses a camera module 180 to identify the gaze direction of the user's left and right eyes. For example, the processor 120 can utilize an eye-tracking camera 313 included in the camera module 180 to detect the gaze direction of the left and right eyes. According to an embodiment, the processor 120 can utilize at least one distance measurement camera to calculate the distance to objects in the external environment and can utilize at least one eye-tracking camera to detect the user's gaze direction. When the user gazes at an object located in front of the device, the processor 120 can determine which eye is dominant in the gaze from the user's left and right eyes.

[0100] In operation 403, processor 120 can determine the dominant and / or non-dominant eye from the user's left and / or right eyes based on the identified gaze direction. For example, the dominant eye may be primarily used when the user gazes at an object, and the non-dominant eye may refer to the eye that is supplementarily used to gaze at the object. The user's dominant and non-dominant eyes can be identified by examination or testing, and the user can be informed of their dominant and non-dominant eyes. According to an embodiment, when the user perceives real space (e.g., the external environment), perception can be based on the field of view of the dominant eye.

[0101] In operation 405, processor 120 may change at least some settings of the display panel corresponding to the non-dominant eye. For example, when gazing at a particular object, gazing primarily uses the dominant eye, so the display performance of the dominant eye display panel (e.g., corresponding to the dominant eye) may affect the user's perception. On the other hand, the display performance of the non-dominant eye display panel (e.g., corresponding to the non-dominant eye) may have a relatively small impact on the user's perception. According to an embodiment, processor 120 may change at least some settings of the non-dominant display panel corresponding to the user's non-dominant eye, which in turn may reduce the power consumption of the non-dominant display panel corresponding to the user's non-dominant eye. According to an embodiment, processor 120 may change the settings of the display panel corresponding to the non-dominant eye to a degree imperceptible to the user. For example, processor 120 may reduce the resolution of the display panel corresponding to the non-dominant eye and / or reduce the frame rate displayed through the display panel. As another example, processor 120 may reduce the size of the display area of ​​the display panel corresponding to the non-dominant eye. According to an embodiment, processor 120 may change the settings of the display panel corresponding to the non-dominant eye so that they are at least partially different from the settings of the display panel corresponding to the dominant eye. According to an embodiment, the processor 120 can change the settings of the display panel based on hardware or based on software (e.g., an application).

[0102] Figure 5 This is a flowchart illustrating an example method for adjusting the resolution of a display panel corresponding to the non-dominant eye, according to certain embodiments of the present disclosure. According to embodiments, electronic devices (e.g., Figure 1 The processor of the electronic device 101 in the middle (e.g., Figure 1 The processor 120 in the middle can reduce the resolution of the display panel corresponding to the non-dominant eye in order to reduce the power consumption of the display panel corresponding to the non-dominant eye.

[0103] In operation 501, processor 120 can identify the user's dominant eye and non-dominant eye. Operation 501 may include... Figure 4 The process is essentially the same as operation 403 in the previous example. According to an embodiment, the processor 120 may be based on data stored in memory (e.g., ...). Figure 1The processor 120 can identify a user's dominant and non-dominant eyes based on information about the dominant and non-dominant eyes stored in the memory 130 or based on direct user input. For example, the processor 120 can provide a user interface through which the user can input information about the dominant and non-dominant eyes. The processor 120 can identify the user's dominant and non-dominant eyes based on the information input to the user interface. According to an embodiment, the electronic device 101 may include a sensor (e.g., a biosignal processing sensor) capable of acquiring at least one biometric information (e.g., heart rate, oxygen saturation, blood pressure, and / or blood glucose). For example, the processor 120 can obtain information about the dominant and non-dominant eyes set by the user based on at least one biometric information acquired by the sensor (e.g., the biosignal processing sensor). According to an embodiment, the processor 120 may utilize at least one camera (e.g., an eye-tracking camera) included in the electronic device 101 to identify the gaze direction corresponding to the user's eyes and identify the user's dominant and non-dominant eyes based on the identified gaze direction.

[0104] According to an embodiment, the processor 120 may utilize a sensor module (e.g., Figure 1 The processor 120 can use the sensor module 176 in the sensor module to obtain context information. In operation 503, the processor 120 can utilize the illuminance sensor (e.g., sensor module 176) to obtain context information. Figure 3 The processor 120 uses an illuminance sensor 322 to detect the ambient brightness of the electronic device 101. The processor 120 can obtain an illuminance sensing value indicating the ambient brightness level from the sensor module 176 and can determine whether the illuminance sensing value is less than or equal to a threshold. According to an embodiment, when the brightness level around the electronic device 101 becomes very high, the processor 120 can add a display device (e.g., Figure 1 The resolution of the display module 160 is adjusted to ensure user visibility. According to an embodiment, when the brightness level around the electronic device 101 decreases, the processor 120 can reduce the resolution of the display panel corresponding to the non-dominant eye. According to an embodiment, if the illuminance sensing value is less than or equal to a threshold, the processor 120 can perform operation 505; if the illuminance sensing value is greater than or equal to the threshold, the processor 120 can perform operation 501 based on a period or event occurrence (e.g., a change in at least one object displayed on the display module 160).

[0105] In operation 505, processor 120 can reduce the display resolution of the non-dominant display panel corresponding to the non-dominant eye. For example, processor 120 can reduce the resolution of the display panel to a level that is not easily perceived by the user. Processor 120 can reduce the resolution of the display panel corresponding to the user's non-dominant eye, thereby reducing power consumption based on the driving of the display panel. For example, changes (or modifications) to the display panel corresponding to the non-dominant eye can be set to a level that is imperceptible to the user.

[0106] According to an embodiment, processor 120 can obtain illuminance sensing values ​​from sensor module 176, and if the illuminance sensing value is less than or equal to a first threshold, it can simultaneously reduce the resolution of the display panel corresponding to the dominant eye and the resolution of the display panel corresponding to the non-dominant eye. Processor 120 can adjust the resolution of the display panel corresponding to the non-dominant eye to be lower than the resolution of the display panel corresponding to the dominant eye. For example, it can adjust the resolution of the display panel corresponding to the dominant eye based on the illuminance sensing value, and can adjust the resolution of the display panel corresponding to the non-dominant eye to be lower than the resolution of the display panel corresponding to the dominant eye.

[0107] According to an embodiment, the electronic device 101 can reduce the resolution of the display panel to a degree that may be imperceptible to the user, and can reduce power consumption due to the display panel. The usage time of the electronic device 101 can be increased, and the heat generated due to driving the display panel can be reduced.

[0108] Figure 6 This is a table describing a method for adjusting the resolution of a display panel corresponding to the non-dominant eye according to certain embodiments of this disclosure.

[0109] Figure 6 Tables [a] and [b] illustrate the resolution settings of the display panel when the user's left eye 601 is the dominant eye and the user's right eye 603 is the non-dominant eye. Electronic devices (e.g., Figure 1 The electronic device 101 in the middle can reduce the resolution of the display panel corresponding to the non-dominant eye (e.g., the right eye).

[0110] Referring to Tables [a] and [b], electronic device 101 can change the resolution of the display panel corresponding to the dominant eye or the display panel corresponding to the non-dominant eye based on a preset time interval (e.g., 1 second (s)). Referring to Table [a], the processor of electronic device 101 (e.g., Figure 1The processor 120 can maintain FHD image quality for the first display panel corresponding to the dominant left eye and can alternately change the image quality between FHD and HD for the second display panel corresponding to the non-dominant eye (611). For example, the processor 120 can change the resolution of the second display panel to FHD or HD based on a set time interval (e.g., 1 second (s)). According to the embodiment, the image quality change between FHD and HD can be performed to a degree less than that perceived by the user. For example, the time interval and the degree of resolution change can be set according to the user's perception (e.g., feeling). Therefore, even if the electronic device 101 changes the resolution of the second display panel corresponding to the non-dominant eye according to a preset time interval, it may be imperceptible to the user. Referring to Table [b], the processor 120 can maintain FHD image quality for the first display panel corresponding to the dominant left eye and maintain HD image quality for the second display panel corresponding to the non-dominant eye (613).

[0111] According to some embodiments, the time interval and the degree of resolution variation can be set in multiple ways. For example, processor 120 can divide the resolution of the display panel corresponding to the dominant eye and the display panel corresponding to the non-dominant eye into multiple levels and change them at multiple levels. As another example, processor 120 can set different time intervals (e.g., period (time interval), time to change from FHD to HD and / or time to change from HD to FHD) to change the resolution of the display panel corresponding to the non-dominant eye.

[0112] According to an embodiment, electronic device 101 can reduce power consumption due to the display panel by setting the resolution of the display panel corresponding to the non-dominant eye to a low level. Electronic device 101 can adjust the resolution to a low level to a degree that may be imperceptible to the user.

[0113] Figure 7 This is a flowchart illustrating a method for adjusting the frame rate of a display panel corresponding to the non-dominant eye according to certain embodiments of the present disclosure. According to embodiments, electronic devices (e.g., Figure 1 The processor of the electronic device 101 in the middle (e.g., Figure 1 The processor 120 in the display panel can reduce the frame rate of the display panel, thereby reducing the display performance of the display panel.

[0114] In operation 701, processor 120 can identify the user's dominant eye and non-dominant eye. Operation 701 may include... Figure 4 The process is essentially the same as operation 403 in the previous example. According to an embodiment, the processor 120 may be based on data stored in memory (e.g., ...). Figure 1The processor 120 can identify the dominant and non-dominant eyes by storing information about them in memory 130 or by using direct user input. According to an embodiment, the processor 120 can utilize at least one camera included in the electronic device 101 to identify the gaze direction corresponding to the user's eyes, and identify the user's dominant and non-dominant eyes based on the identified gaze direction.

[0115] In operation 703, processor 120 may utilize at least one camera to detect movement of an object the user is looking at. For example, the object the user is looking at may include an object displayed on a display module (e.g., Figure 1 The processor 120 displays virtual objects on the display module 160, which are based on real objects. For example, the processor 120 can identify the degree of object movement by comparing the object's movement with preset movement-related information. The processor 120 can determine whether the object's movement is above or below the set degree of movement. For example, if the object's movement is below a preset threshold, the movement of the area the user is looking at may be very small, and even if the display performance of the display panel corresponding to the non-dominant eye is adjusted to a lower level, it may be imperceptible to the user. According to an embodiment, the electronic device 101 can reduce the display performance of the display panel corresponding to the non-dominant eye to a degree imperceptible to the user. According to an embodiment, if the movement of the content displayed on the display is less than or equal to the threshold, the processor 120 can perform operation 705, and if the movement of the content displayed on the display is greater than or equal to the threshold, operation 701 can be performed based on a period or event occurrence (e.g., a change in at least one object displayed on the display).

[0116] In operation 705, processor 120 can adjust the frame rate of the display panel corresponding to the non-dominant eye. For example, when the movement of the object being looked at by the user in at least one object displayed on the display is below a preset threshold, processor 120 can reduce the frame rate of the display panel. The reduction in frame rate can be set to a level imperceptible to the user. Processor 120 can reduce the frame rate of the display panel corresponding to the user's non-dominant eye, thereby reducing power consumption due to driving the display panel. For example, the change in display performance of the display panel corresponding to the non-dominant eye can be set to a level imperceptible to the user.

[0117] According to one embodiment, when the movement of the object being looked at by the user in at least one object displayed on the display is less than or equal to a first threshold, the processor 120 may reduce both the frame rate of the display panel corresponding to the dominant eye and the frame rate of the display panel corresponding to the non-dominant eye. The processor 120 may adjust the frame rate of the display panel corresponding to the non-dominant eye to be lower than the frame rate of the display panel corresponding to the dominant eye. According to another embodiment, when the movement of the object being looked at by the user in at least one object displayed on the display is greater than a first threshold and less than or equal to a second threshold, the processor 120 may set the frame rate of the display panel corresponding to the non-dominant eye to be lower than the frame rate of the display panel corresponding to the dominant eye.

[0118] According to an embodiment, electronic device 101 can reduce the frame rate of at least some display panels to a degree imperceptible to the user, and reduce power consumption due to the display panels. The usage time of electronic device 101 can be increased, and the heat generated due to driving the display panels can be reduced.

[0119] Figure 8 This is a table describing a method for adjusting the frame rate of a display panel corresponding to a non-dominant eye according to certain embodiments of this disclosure.

[0120] Figure 8 Tables [a] and [b] illustrate the frame rates of the display panel when the user's left eye 801 is the dominant eye and the user's right eye 803 is the non-dominant eye. Electronic devices (e.g., Figure 1 The electronic device 101 in the middle can reduce the frame rate of the display panel corresponding to the non-dominant eye (e.g., the right eye).

[0121] Referring to Tables [a] and [b], electronic device 101 can change the frame rate of each display panel based on a preset time interval (e.g., 1 second (s)). Referring to Table [a], the processor of electronic device 101 (e.g., ...) Figure 1The processor 120 can maintain a first frame rate (e.g., about 120 Hz) for a first display panel corresponding to the dominant left eye (811), and can alternately change the frame rate between the first frame rate (e.g., about 120 Hz) and a second frame rate (e.g., about 60 Hz) for a second display panel corresponding to the non-dominant eye (811). For example, the processor 120 can change the frame rate of the second display panel from about 120 Hz to about 60 Hz based on a set time interval (e.g., 1 second (s)). According to embodiments, the frame rate change can be performed to a degree imperceptible to the user. For example, the time interval and the degree of frame rate change can be determined based on the user's level of perception (e.g., sensation). According to embodiments, even if the electronic device 101 changes the second frame rate of the second display panel corresponding to the non-dominant eye according to a preset time interval, it may still be imperceptible to the user. Referring to Table [b], the processor 120 can maintain a first frame rate (e.g., about 120 Hz) for a first display panel corresponding to the dominant left eye and a second frame rate (e.g., about 60 Hz) for a second display panel (813) corresponding to a non-dominant eye.

[0122] According to some embodiments, the time interval and frame rate variations can have multiple settings. For example, processor 120 can divide the frame rate of the display panel corresponding to the dominant eye and the display panel corresponding to the non-dominant eye into three or more levels, such as 60Hz, 120Hz, and 144Hz, and vary them at these levels. As another example, processor 120 can set different time intervals (e.g., the time to change from 60Hz to 120Hz and / or the time to change from 120Hz to 60Hz) to change the frame rate of the display panel corresponding to the non-dominant eye. According to embodiments, the frame rate of the display panel corresponding to the non-dominant eye can be changed by selecting one of a plurality of frame rate settings based on the movement speed of the object being viewed by the user in at least one object displayed on the display.

[0123] According to an embodiment, electronic device 101 can reduce power consumption due to the display panel by setting the frame rate of the display panel corresponding to the non-dominant eye to a low level. Electronic device 101 can adjust the frame rate to a low level that may be imperceptible to the user.

[0124] Figure 9 This is a flowchart illustrating a method for adjusting the display area of ​​a display panel corresponding to a non-dominant eye, according to certain embodiments of the present disclosure. According to embodiments, electronic devices (e.g., Figure 1 The processor of the electronic device 101 in the middle (e.g., Figure 1 The processor 120 in the display panel can reduce the power consumption of the display panel by reducing the size of the display area.

[0125] In operation 901, processor 120 can identify the user's dominant eye and non-dominant eye. Operation 901 may include... Figure 4 The process is essentially the same as operation 403 in the previous example. According to an embodiment, the processor 120 may be based on data stored in memory (e.g., ...). Figure 1 The processor 120 can identify a user's dominant and non-dominant eyes by storing information about the dominant and non-dominant eyes in memory 130 or by using direct user input. According to an embodiment, the processor 120 may utilize at least one camera included in the electronic device 101 (e.g., an eye-tracking camera). Figure 3 The eye-tracking camera 313) in the middle identifies the gaze direction corresponding to the user's eyes, and identifies the user's dominant eye and non-dominant eye based on the identified gaze direction.

[0126] In operation 903, processor 120 may use at least one camera (e.g., eye-tracking camera 313) to detect the movement of the user's pupils (e.g., left and right eyes). For example, processor 120 may identify the degree of eye movement by comparing pupil movement with preset pupil movement-related information. Processor 120 may determine whether the pupil movement is greater than or less than the preset movement degree. For example, when the pupil movement is below a preset threshold, the movement of the area the user is looking at may be very small, and may be imperceptible to the user even if the size of the display area of ​​the display panel corresponding to the non-dominant eye is adjusted to be smaller. According to an embodiment, electronic device 101 may reduce the size of the display area of ​​the display panel corresponding to the non-dominant eye to a degree imperceptible to the user. According to an embodiment, if the movement of a user's pupil (e.g., left eye and / or right eye) detected by at least one camera (e.g., eye-tracking camera 313) is below a specified degree or threshold, the processor 120 may perform operation 905, and if the movement of the user's pupil (e.g., left eye and / or right eye) is above or equal to the specified degree or threshold, operation 901 may be performed based on a period or event occurring (e.g., a change in at least one object displayed on the display).

[0127] In operation 905, processor 120 can reduce the size of the display area of ​​the display panel corresponding to the non-dominant eye. For example, processor 120 can reduce the display area of ​​the display panel to a degree imperceptible to the user. Therefore, processor 120 can reduce the amount of power consumed by driving the display panel by reducing the size of the display area of ​​the display panel corresponding to the user's non-dominant eye. For example, the reduction in the size of the display area of ​​the display panel corresponding to the non-dominant eye can be set to a degree imperceptible to the user. According to an embodiment, when the movement of the user's pupil detected by at least one camera (e.g., eye-tracking camera 313) is less than or equal to a first threshold, processor 120 can reduce both the display area of ​​the display panel corresponding to the dominant eye and the display area of ​​the display panel corresponding to the non-dominant eye. According to another embodiment, when the movement of the user's pupil is greater than or equal to a second threshold (which is greater than the first threshold), processor 120 can set the display area of ​​the display panel corresponding to the dominant eye to be the same as the display area of ​​the display panel corresponding to the non-dominant eye. According to another embodiment, when the movement of the user's pupil is greater than a first threshold and less than a second threshold, the processor 120 can set the display area of ​​the display panel corresponding to the non-dominant eye to be smaller than the display area of ​​the display panel corresponding to the dominant eye.

[0128] According to an embodiment, the electronic device 101 can reduce the display area of ​​the display panel to a degree imperceptible to the user and reduce power consumption caused by the display panel. The usage time of the electronic device 101 can be increased, and the heat generated due to driving the display panel can be reduced.

[0129] According to an embodiment, when a user's pupil (or gaze) deviates from the display area of ​​the display panel corresponding to the non-dominant eye (which is set to be smaller than the display area of ​​the display panel corresponding to the dominant eye), the electronic device 101 can set the display area of ​​the display panel corresponding to the non-dominant eye to be the same as the display area of ​​the display panel corresponding to the dominant eye. For example, the electronic device 101 can use at least one camera (e.g., eye-tracking camera 313) to check whether the user's pupil (or gaze) deviates from the display area of ​​the display panel corresponding to the non-dominant eye.

[0130] Figure 10a and Figure 10b This is an illustrative diagram describing a method for adjusting the display area of ​​a display panel corresponding to a non-dominant eye according to certain embodiments of the present disclosure. Figure 10a A first embodiment is described, in which the size of the display area of ​​the display panel is reduced relative to the center point. Figure 10b This describes a second embodiment where the size of the display area of ​​the display panel is reduced relative to the user's gaze direction.

[0131] Reference Figure 10a Electronic devices (e.g.) Figure 1 The processor of the electronic device 101 in the middle (e.g., Figure 1 The processor 120 in the device 101 can reduce the size of the display area of ​​the display panel corresponding to the user's non-dominant eye. For example, the processor 120 can reduce the size from a first display area 1001 to a second display area 1003. The processor 120 can reduce the display area from the first display area 1001 to the second display area 1003 relative to its center point. According to an embodiment, the first display panel corresponding to the dominant eye can display the surrounding background based on the first display area 1001, and the second display panel corresponding to the non-dominant eye can display the surrounding background based on the second display area 1003. For example, the area between the first display area 1001 and the second display area can be processed to have a lower resolution, can be blurred, or can be displayed as a black screen. According to an embodiment, the processor 120 of the electronic device 101 can reduce the size of the display area of ​​the display panel to a degree imperceptible to the user and can reduce power consumption due to the display panel. According to an embodiment, based on the movement of the user's eye, the processor 120 can also adjust the size of the display area of ​​the first display panel corresponding to the dominant eye to correspond to the size of the display area of ​​the second display panel corresponding to the non-dominant eye. The size of the display area of ​​the second display panel corresponding to the non-dominant eye can be adjusted to be smaller than the size of the display area of ​​the first display panel corresponding to the dominant eye.

[0132] Reference Figure 10b The processor 120 of the electronic device 101 can reduce the size of the display area of ​​the display panel corresponding to the user's non-dominant eye. For example, the processor 120 can reduce the size from a first display area 1011 to a second display area 1013. The processor 120 can identify the object 1020 that the user is looking at (or the direction the user is looking in) and set the identified object 1020 as the center point for reduction. The processor 120 can reduce the size of the display area from the first display area 1011 to the second display area 1013 relative to the object 1020 that is set as the center point. According to an embodiment, the first display module corresponding to the dominant eye (e.g., Figure 3 The first display module 351 can display the surrounding background based on the first display area 1011, and the second display module corresponding to the non-dominant eye (e.g., Figure 3The second display module 353 can display the surrounding background based on the second display area 1013. For example, the area 1030 between the first display area 1001 and the second display area can be processed to have a lower resolution, can be blurred, or can be displayed as a black screen. According to an embodiment, the processor 120 of the electronic device 101 can reduce the size of the display area of ​​the display panel to a degree imperceptible to the user, and can reduce the power consumption generated by the display panel.

[0133] The display areas of the first and second display panels are in Figure 10a and Figure 10b The example shows a circle, but according to some embodiments, the shape of the display area can vary depending on the shape of the display panel or the lens of the electronic device 101. For example, the display area may include a triangle, a quadrilateral, a pentagon, or a polygon.

[0134] Figure 11 This is a flowchart illustrating a method for detecting changes in the non-dominant eye and changing settings of a display panel corresponding to the changed non-dominant eye, according to certain embodiments of this disclosure. According to embodiments, electronic devices (e.g., Figure 1 The processor of the electronic device 101 in the middle (e.g., Figure 1 The processor 120 can periodically or when an event occurs (e.g., when at least one object displayed on the display panel changes), and can change the display panel whose display performance is to be adjusted when the dominant eye (or non-dominant eye) changes according to the change in the field of view. In operation 1101, the processor 120 can identify the user's dominant eye and non-dominant eye. Operation 1101 may include... Figure 4 The process is essentially the same as operation 403 in the previous example. According to an embodiment, the processor 120 may be based on data stored in memory (e.g., ...). Figure 1 The processor 120 can identify the dominant and non-dominant eyes by storing information about them in memory 130 or by using direct user input. According to an embodiment, the processor 120 may utilize at least one camera (e.g., eye-tracking camera 313) included in the electronic device 101 to identify the gaze direction corresponding to the user's eyes, and identify the user's dominant and non-dominant eyes based on the identified gaze direction.

[0135] In operation 1103, processor 120 can determine whether the user's right eye is the dominant eye. For example, processor 120 can distinguish between the user's dominant and non-dominant eyes and can adjust the performance of the display panel corresponding to the non-dominant eye. According to an embodiment, if the right eye is the dominant eye among the user's two eyes, then the left eye can be determined as the non-dominant eye. If the left eye is the dominant eye among the user's two eyes, then the right eye can be determined as the non-dominant eye.

[0136] If the right eye is determined to be the dominant eye at operation 1103, then at operation 1105, the processor 120 can change at least some settings of the display panel corresponding to the left eye (e.g., the non-dominant eye). For example, the processor 120 can change at least some settings of the display panel corresponding to the non-dominant eye to reduce the quality of the display panel. According to an embodiment, the processor 120 can change at least some settings of the display panel corresponding to the non-dominant eye when specified conditions are met. For example, if the illuminance sensing value is less than or equal to a threshold, the processor 120 can reduce the resolution of the display panel corresponding to the non-dominant eye; if the movement of the content displayed on the display panel corresponding to the non-dominant eye is small, the frame rate can be reduced; or if the user's pupil movement is small, the size of the display area of ​​the display panel corresponding to the non-dominant eye can be reduced.

[0137] In operation 1107, processor 120 can check whether the existing dominant eye (and / or non-dominant eye) has changed. For example, processor 120 can utilize at least one camera (e.g., an eye-tracking camera, such as...). Figure 3 The processor 120 detects the movement of the user's pupils (e.g., left and right eyes) using a camera (e.g., eye-tracking camera 313). When the user gazes at a specific object, the processor 120 can identify the eye that is primarily focused on that object. According to an embodiment, the processor 120 can periodically check the user's field of view using at least one camera (e.g., eye-tracking camera 313) and can determine that a change in the dominant eye has occurred when the user's field of view extends beyond a preset area. For example, a change in the dominant eye may imply a change in the non-dominant eye. If the dominant eye (or non-dominant eye) has not changed, the processor 120 can branch to operation 1105, in which the processor 120 can periodically adjust the performance of the display panel corresponding to the non-dominant eye based on specified conditions or when specified events occur (e.g., movement of the electronic device 101 or a change in the displayed virtual object). If the dominant eye (or non-dominant eye) has changed, the processor 120 can branch to operation 1109.

[0138] If the dominant eye has changed, in operation 1109, the processor 120 can adjust the performance of the display panel corresponding to the right eye (e.g., now corresponding to the non-dominant eye).

[0139] In some embodiments, the electronic device 101 detecting a change in the user's dominant and non-dominant eyes may include detecting a change in the eye primarily focused on the object when the user is looking at it. For example, when the user is looking at an object with their dominant eye, and the user is looking at the object through their non-dominant eye because the object is not within the dominant eye's field of vision, the electronic device 101 may determine that the user's dominant and non-dominant eyes have changed.

[0140] According to an embodiment, the electronic device 101 can periodically identify a user's dominant eye or non-dominant eye, and if the dominant eye (or non-dominant eye) has changed, it can change at least some settings of the display panel corresponding to the dominant eye (or non-dominant eye). The electronic device 101 can identify the display panel corresponding to the changed non-dominant eye and can change at least some settings of the corresponding display panel. According to an embodiment, the settings can be changed so that the quality of the display panel corresponding to the non-dominant eye is lower than the quality of the display panel corresponding to the dominant eye.

[0141] According to some embodiments, the settings of the display panel may include the resolution setting of the display panel, the frame rate setting of the display panel, and / or the size setting of the display area of ​​the display panel. The electronic device 101 may change at least one of the resolution setting, the frame rate setting, and / or the size setting of the display area of ​​the display panel.

[0142] According to an embodiment, electronic device 101 can alter at least some settings of the display panel corresponding to the altered non-dominant eye to a degree imperceptible to the user. Electronic device 101 can reduce the power consumption of the display panel, thereby extending the usage time and reducing the heat generated by electronic device 101.

[0143] According to some embodiments, electronic device 101 may periodically or when a specified event occurs (e.g., movement of electronic device 101 or change of displayed virtual objects) check conditions for adjusting the quality of the dominant eye and / or non-dominant eye. For example, conditions for adjusting the quality of the dominant eye and / or non-dominant eye may include changes in illuminance sensing values, changes in movement of content displayed on the display panel, changes in the user's pupil movement, or changes between the dominant and non-dominant eyes. According to some embodiments, when conditions for adjusting the quality of the dominant eye and / or non-dominant eye are identified, electronic device 101 may make changes for at least one of the following: changes in resolution, frame rate, or size of the display area of ​​the display panel for the dominant and / or non-dominant eye. For example, based on at least one of the following: illuminance sensing values ​​are less than or equal to a threshold; changes in movement of content displayed on the display panel are small; or changes in the user's pupil movement are small, electronic device 101 may perform at least one of the following: reducing the resolution of the display panel corresponding to the non-dominant eye; reducing the frame rate; or reducing the size of the display area of ​​the display panel.

[0144] Figure 12 This is an explanatory diagram illustrating a method for detecting changes in the non-dominant eye and changing the settings of a display panel corresponding to the changed non-dominant eye, according to certain embodiments of the present disclosure.

[0145] Case [a] illustrates a situation where a user is looking at a specific object 1205 located in front of the user. According to an embodiment, when the user is looking at the specific object 1205, a difference can be distinguished between the dominant eye (e.g., the right eye 1201) and the secondary non-dominant eye (e.g., the left eye 1203). Electronic device 101 (e.g., Figure 1 The electronic device 101 may include at least one camera for tracking the user's pupil (e.g., a first eye-tracking camera 1211 for tracking the gaze direction of the right eye 1201 and / or a second eye-tracking camera 1213 for tracking the gaze direction of the left eye 1203). According to an embodiment, the electronic device 101 may identify the dominant eye (e.g., the right eye 1201) and non-dominant eye (e.g., the left eye 1203) among the eyes gazing at a specific object 1205. According to an embodiment, the electronic device 101 may modify the first glasses 220 (e.g., Figure 2a The electronic device 101 can change at least some settings of the display panel corresponding to the left eye 1203 (as the non-dominant eye) in the first glasses 220.

[0146] Scenario [b] illustrates a situation where a specific object 1206 moves to one side relative to the electronic device 101 and the user gazes at the specific object 1206. Previously, the user's right eye 1201 was set as the dominant eye, and the left eye 1203 could be set as the non-dominant eye. According to an embodiment, when the specific object 1206 moves to one side and leaves the field of view of the right eye 1201, the dominant eye can change from the right eye 1201 to the left eye 1203. A change in dominant eye from right eye 1201 to left eye 1203 can also indicate a change in non-dominant eye from left eye 1203 to right eye 1201. According to an embodiment, the electronic device 101 can use a first gaze-tracking camera 1211 and a second gaze-tracking camera 1213 to confirm that the dominant and non-dominant eyes gazing at the specific object 1206 have changed. According to an embodiment, in response to a change in dominant eye, the electronic device 101 can change the second glasses 230 (e.g., Figure 2a At least some settings of the display panel in the second glasses 230) corresponding to the modified non-dominant eye. The electronic device 101 can change at least some settings to reduce the quality of the display panel corresponding to the right eye 1201 (as the non-dominant eye).

[0147] According to an embodiment, the electronic device 101 can periodically check the visual fields of the user's two eyes (e.g., the left or right eye). The electronic device 101 can detect whether the object the user is looking at is outside the visual field of the eye corresponding to the dominant eye, and if the object is outside the visual field of the dominant eye, it can be determined that the dominant eye has changed.

[0148] According to an embodiment, upon confirming a change in the dominant eye (or non-dominant eye), the electronic device 101 can alter the display performance of the display panel corresponding to the non-dominant eye. For example, when the non-dominant eye has shifted from the left eye 1203 to the right eye 1201, the electronic device 101 can reduce the display performance of the display panel corresponding to the right eye 1201. Conversely, when the dominant eye has shifted from the right eye 1201 to the left eye 1203, the electronic device 101 can restore the display performance of the display panel corresponding to the left eye 1203 to its initial setting. For example, the display performance of the display panel corresponding to the left eye 1203 may be superior to that of the display panel corresponding to the right eye 1201.

[0149] Figure 13a and Figure 13b This is an illustrative diagram depicting a method for detecting the dominant eye and non-dominant eye according to certain embodiments of the present disclosure. Figure 13a This describes a scenario in which a circular virtual object 1320 is at least partially displayed on at least one display panel, and the eye that gazes at a particular object 1305 through the virtual object 1320 is identified as the dominant eye. Figure 13b This illustrates a scenario where a circle formed by a user's fingers is identified as a temporary object (e.g., formed by gesture 1330), and the eye that gazes at a specific object 1305 through the temporary object (e.g., as part of gesture 1330) is identified as the dominant eye.

[0150] Reference Figure 13a Electronic device 101 (e.g., Figure 1 The electronic device 101 may include at least one camera for tracking the user's pupils (e.g., a first gaze-tracking camera 1311 for tracking the gaze direction of the right eye 1301 and / or a second gaze-tracking camera 1313 for tracking the gaze direction of the left eye 1303). The electronic device 101 may also include a distance-measuring camera 1315 for measuring the distance to a specific object 1305 (e.g., ...). Figure 3 (Distance measurement camera 315 in the middle). According to an embodiment, the electronic device 101 can use a first gaze-tracking camera 1311 and / or a second gaze-tracking camera 1313 to determine the gaze direction of the user's eyes (e.g., right eye 1301 and / or left eye 1303). The electronic device 101 can determine that the right eye 1301 is the dominant eye (e.g., the left eye 1303 can be determined as the non-dominant eye), which corresponds to the gaze direction of looking at a specific object 1305 while passing through a virtual object 1320 formed on at least one display panel.

[0151] According to an embodiment, electronic device 101 can utilize distance measuring camera 1315 to measure the distance to a specific object 1305. According to an embodiment, if the measured distance is greater than or equal to a threshold, electronic device 101 can utilize a first gaze-tracking camera 1311 and / or a second gaze-tracking camera 1313 to identify the gaze direction of the user's eyes (e.g., right eye 1301 and / or left eye 1303). Electronic device 101 can distinguish between a dominant eye and a non-dominant eye based on the identified gaze direction. For example, if it is confirmed that the gaze direction of the right eye 1301 is focused on a specific object 1305 while passing through the first glasses 220 (e.g., ...), Figure 2a The first pair of glasses 220) and / or the second pair of glasses 230 (e.g., Figure 2a When the orientation of the virtual object 1320 on the second pair of glasses (230) is known, the electronic device 101 can determine that the user's right eye 1301 is the dominant eye. Correspondingly, the user's left eye 1303 can be determined as the non-dominant eye. According to an embodiment, the electronic device 101 can change the settings of the display panel corresponding to the left eye 1303 (as the non-dominant eye) to reduce the quality of the display panel.

[0152] According to another embodiment, if the distance to a specific object 1305 measured by the distance measuring camera 1315 is greater than or equal to a set threshold, the electronic device 101 can display a virtual object on the display panel and identify the user's dominant eye and non-dominant eye. For example, when the distance to the specific object 1305 is less than the set threshold, the electronic device 101 can maintain the display performance of the display panel corresponding to the non-dominant eye.

[0153] According to an embodiment, when a distance measuring camera 1315 is used to gaze at a specific object 1305 at a specified distance or further away, the electronic device 101 can use a first gaze-tracking camera 1311 or a second gaze-tracking camera 1313 to identify the gaze direction of the left and right eyes, and identify at least one of the dominant or non-dominant eyes based on the identified gaze direction information. For example, when the distance to the specific object 1305 is less than a set threshold, the electronic device 101 may not change the display performance of the display panel corresponding to the non-dominant eye.

[0154] Reference Figure 13b Electronic device 101 (e.g., Figure 1 The electronic device 101 may include at least one camera for tracking the user's pupils (e.g., a first gaze-tracking camera 1311 for tracking the gaze direction of the right eye 1301 and / or a second gaze-tracking camera 1313 for tracking the gaze direction of the left eye 1303). The electronic device 101 may also include gesture cameras 1317 and 1319 for detecting user gestures within a specific distance (e.g., ...). Figure 3(Gesture camera 311 in the image). According to an embodiment, the electronic device 101 may utilize a first eye-tracking camera 1311 and / or a second eye-tracking camera 1313 to identify the gaze direction of the user's eyes (e.g., right eye 1301 and / or left eye 1303). The electronic device 101 may utilize at least one gesture camera 1317 and 1319 to detect the user's gesture 1330 (e.g., making a circle with a finger). The electronic device 101 may determine that the right eye 1301 is the dominant eye (e.g., the left eye 1303 may be determined as the non-dominant eye), corresponding to the gaze direction of looking at a specific object 1305 while passing through the circle formed by the user's gesture 1330. According to an embodiment, the electronic device 101 may reduce the display performance of the display panel corresponding to the left eye 1303 (as the non-dominant eye).

[0155] According to some embodiments, the method for detecting a user's dominant eye and / or non-dominant eye is not limited to... Figure 13a and / or Figure 13b The embodiment shown.

[0156] According to an embodiment, the electronic device 101 can display virtual objects via a first display panel corresponding to the user's right eye 1301 included in the first glasses 220 and / or a second display panel corresponding to the user's left eye 1302 included in the second glasses 230. The processor 120 of the electronic device 101 can track the user's gaze direction toward the virtual object via a first gaze-tracking camera 1311 for tracking the gaze direction of the right eye 1301 and / or a second gaze-tracking camera 1313 for tracking the gaze direction of the left eye 1303, and can detect the user's dominant eye and / or non-dominant eye based on the gaze direction.

[0157] Figure 14 This is an illustrative diagram illustrating a method for detecting the dominant eye and non-dominant eye based on a region of view according to certain embodiments of the present disclosure.

[0158] exist Figure 14 In the process, the field of view for a user to identify objects through the right eye 1401 and / or the left eye 1402 can be divided into multiple regions (e.g., the first region 1411, the second region 1412, the third region 1413 and / or the fourth region 1414).

[0159] According to an embodiment, the first region 1411 can be defined as the region where the user's right eye 1401 and left eye 1402 have substantially equal dominance. For example, when the user is looking at an object located in the first region 1411, the electronic device 101 can utilize at least one camera (e.g., Figure 3 The eye-tracking camera 313 in the middle is used to identify the user's gaze direction and determine the user's dominant eye and / or non-dominant eye.

[0160] According to an embodiment, the second region 1412 can be defined as the region dominated by the user's left eye 1401. For example, when the user views an object located in the second region 1412, the user's left eye 1402 can be identified as the dominant eye, and the user's right eye 1401 can be identified as the non-dominant eye.

[0161] According to an embodiment, the third region 1413 can be defined as the region dominated by the user's right eye 1401. For example, when the user views an object located in the third region 1413, the user's right eye 1401 can be identified as the dominant eye, and the user's left eye 1402 can be identified as the non-dominant eye.

[0162] According to an embodiment, the fourth region 1414 can be defined as a region that ignores the dominance of the user's right eye 1401 or left eye 1402. For example, when a user views an object located in the fourth region 1414, it may be difficult to determine the dominant eye and / or non-dominant eye because the object is too close to the user's face.

[0163] exist Figure 14 In this embodiment, the field of view used to identify objects is divided into four regions, but according to some embodiments, the field of view used to identify objects may be divided into four or more regions, or four or fewer regions.

[0164] According to some embodiments, the electronic device 101 can identify a dominant eye and / or a non-dominant eye based on the user's left and right eyes, and can change the settings of the display panel corresponding to the identified non-dominant eye in a first display panel corresponding to the left eye and a second display panel corresponding to the right eye, making them at least partially different from the settings of the display panel corresponding to the identified dominant eye. For example, the electronic device 101 can at least partially change the settings of the display panel corresponding to the non-dominant eye to reduce the display performance of that display panel.

[0165] The method according to some embodiments may include: utilizing an electronic device 101 configured to capture (e.g., Figure 1 The first camera (e.g., the one in front of the electronic device 101) of the external environment. Figure 3 The distance measuring camera 315 in the middle) or a second camera oriented opposite to the first camera and configured to capture the gaze directions of the user's left and right eyes (e.g., Figure 3The device includes one or more eye-tracking cameras (313) to identify a dominant eye and / or a non-dominant eye from the user's left and right eyes, wherein the first and second cameras are included in the electronic device 101; using at least one processor to identify a dominant display panel corresponding to the dominant eye from the first and second display panels, and a non-dominant display panel corresponding to the non-dominant eye from the first and second display panels; and changing the settings of the dominant display panel to be different from the settings of the non-dominant display panel.

[0166] According to an embodiment, identifying the dominant eye and the non-dominant eye may include: measuring the distance to an object using a first camera; identifying the gaze direction of the left and right eyes using a second camera 313 based on determining that the measured distance exceeds a threshold; and identifying the dominant eye and the non-dominant eye from the left and right eyes based on the captured gaze direction.

[0167] According to an embodiment, changing the settings of the dominant display panel may include: determining the use of an illuminance sensor (e.g., Figure 3 The illuminance sensor 322 in the image measures whether the luminance value is less than or equal to a threshold; and based on the determination that the luminance value is less than or equal to the threshold, the display resolution of the non-dominant display panel corresponding to the non-dominant eye is reduced.

[0168] The method according to the embodiment may further include: detecting the movement of an object being gazed at by the user based on the gaze direction; determining whether the movement of the object exceeds a preset reference value; and reducing the frame rate of the non-dominant display panel corresponding to the non-dominant eye based on the determination that the movement exceeds the reference value.

[0169] The method according to the embodiment may further include: determining whether the dominant eye has changed based on the detection of the left eye gaze direction and the right eye gaze direction; changing at least some settings of the display panel corresponding to the right eye based on the determination that the dominant eye has changed from the right eye to the left eye; and restoring the settings of the display panel corresponding to the left eye to the initial settings based on the determination that the dominant eye has changed from the right eye to the left eye.

[0170] The electronic device according to various embodiments can be one of a variety of types of electronic devices. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. According to embodiments of this disclosure, the electronic device is not limited to those described above.

[0171] It should be understood that the various embodiments of this disclosure and the terminology used therein are not intended to limit the technical features set forth herein to the specific embodiments, but rather to include various changes, equivalents, or substitutions to the respective embodiments. In the description of the drawings, similar reference numerals may be used to refer to similar or related elements. It will be understood that nouns in the singular form corresponding to terms may include one or more things unless the relevant context clearly indicates otherwise. As used herein, each of the phrases such as “A or B,” “at least one of A and B,” “at least one of A or B,” “A, B, or C,” “at least one of A, B, and C,” and “at least one of A, B, or C” may include all possible combinations of the items enumerated together with the corresponding phrase among the plurality of phrases. As used herein, terms such as “first” and “second” or “first” and “second” may be used to simply distinguish one component from another and do not limit the components in other respects (e.g., importance or order). It will be understood that, whether the terms “operably” or “communically” are used or not, if an element (e.g., a first element) is referred to as “combined with another element (e.g., a second element),” “combined to another element (e.g., a second element),” “connected to another element (e.g., a second element),” or “attached to another element (e.g., a second element)”, it means that the first element can be directly (e.g., wiredly) connected to the second element, wirelessly connected to the second element, or connected to the second element via a third element.

[0172] As used herein, the term "module" can include a unit implemented in hardware, software, or firmware, and is used interchangeably with other terms (e.g., "logic," "logic block," "part," or "circuit"). A module can be a single integrated component adapted to perform one or more functions, or the smallest unit or part of such a single integrated component. For example, according to an embodiment, a module can be implemented in the form of an application-specific integrated circuit (ASIC).

[0173] The various embodiments set forth herein can be implemented as software (e.g., program 140) containing one or more instructions readable by a machine (e.g., electronic device 101) stored in a storage medium (e.g., internal memory 136 or external memory 138). For example, under the control of a processor, the processor (e.g., processor 120) of the machine (e.g., electronic device 101) can invoke and execute at least one of the one or more instructions stored in the storage medium, with or without the use of one or more other components. This enables the machine to operate to perform at least one function according to the invoked at least one instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. Machine-readable storage media may be provided in the form of non-transitory storage media. The term "non-transitory" means only that the storage medium is a tangible device and does not include signals (e.g., electromagnetic waves), but this term does not distinguish between data being stored semi-permanently in the storage medium and data being temporarily stored in the storage medium.

[0174] According to embodiments, methods according to various embodiments of this disclosure may be included and provided in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., a compact disk read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an app store (e.g., the Play Store™), or may be distributed directly between two user devices (e.g., smartphones) (e.g., downloaded or uploaded). If distributed online, at least a portion of the computer program product may be temporarily generated, or at least a portion of the computer program product may be stored at least temporarily in a machine-readable storage medium (such as the memory of a manufacturer's server, an app store's server, or a forwarding server).

[0175] According to various embodiments, each of the above-described components (e.g., a module or program) may include a single entity or multiple entities. According to various embodiments, one or more of the above-described components may be omitted, or one or more other components may be added. Optionally or additionally, multiple components (e.g., modules or programs) may be integrated into a single component. In this case, according to various embodiments, the integrated component may still perform the one or more functions of each of the multiple components in the same or similar manner as the corresponding component of the multiple components performed one or more functions prior to integration. According to various embodiments, the operations performed by a module, program, or other component may be performed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations may be run in a different order or omitted, or one or more other operations may be added.

[0176] The embodiments and accompanying drawings of this disclosure are merely examples to facilitate the description and understanding of the contents of this disclosure, and are not intended to limit the scope of this disclosure. Therefore, this disclosure should be understood to include all modifications or alterations derived from this disclosure, in addition to the embodiments disclosed herein, and is defined by the appended claims and their equivalents.

Claims

1. An electronic device, the electronic device comprising: A first camera, configured to acquire images relating to the external environment in front of the electronic device; A second camera, which is oriented opposite to the first camera and is configured to acquire images related to the user’s left and right eyes; A first display panel, the first display panel corresponding to the user's left eye; A second display panel, the second display panel corresponding to the user's right eye; Memory; as well as A processor, operatively connected to the first camera, the second camera, the first display panel, the second display panel, and the memory. The processor is configured as follows: Based on the images obtained through the second camera, the gaze direction of the user's left eye and the user's right eye is identified. Based on the gaze direction of the user's left and right eyes, the dominant and non-dominant eyes are identified in the user's left and right eyes. Identify the dominant display panel corresponding to the dominant eye and the non-dominant display panel corresponding to the non-dominant eye from the first display panel and the second display panel. Based on the direction of the user's gaze, the movement of the object being gazed at is identified, and Based on the movement of the object, the settings of the dominant display panel are changed to be different from those of the non-dominant display panel.

2. The electronic device according to claim 1, wherein, The processor is also configured to; Based on images obtained through at least one of the first camera and the second camera, the gaze direction of the user's left eye and the user's right eye is identified.

3. The electronic device according to claim 2, wherein, The processor is also configured to: The distance to the object is measured using the first camera. Based on the determination that the measured distance exceeds a threshold, the second camera is used to identify the gaze direction of the user's left and right eyes, and Based on the determination that the measured distance exceeds a threshold, some settings of the non-dominant display panel corresponding to the non-dominant eye are changed.

4. The electronic device of claim 1, further comprising an illuminance sensor for detecting ambient brightness, wherein, The processor is also configured to: The system identifies whether the luminance value measured by the illuminance sensor is less than or equal to a threshold, and Based on the determination that the brightness value is less than or equal to the threshold, the display resolution of the non-dominant display panel corresponding to the non-dominant eye is reduced.

5. The electronic device according to claim 1, wherein, The processor is also configured to: Determine whether the movement of the object is below a preset reference value, and Based on the determination that the movement is lower than the preset reference value, the frame rate of the non-dominant display panel corresponding to the non-dominant eye is reduced.

6. The electronic device according to claim 1, wherein, The processor is also configured to: Based on a preset time interval, reduce one or more of the resolution and frame rate of the non-dominant display panel corresponding to the non-dominant eye.

7. The electronic device according to claim 1, wherein, The processor is also configured to: Detect the gaze movements of the user's left and right eyes. Determine whether the detected gaze movement exceeds a preset reference value, and Based on the determination that the gaze movement exceeds the preset reference value, the display area of ​​the non-dominant display panel corresponding to the non-dominant eye is reduced.

8. The electronic device according to claim 1, wherein, The processor is also configured to: Display virtual objects on the first display panel and the second display panel, and When a user looks at a displayed virtual object, the second camera is used to identify the left and right eye gaze directions. The non-dominant eye is identified from the user's left eye and right eye based on the recognized left and right eye gaze directions.

9. The electronic device of claim 1, further comprising a third camera configured to detect a user's gesture, and wherein the processor is further configured to: When the user's hand forms a circle, the third camera is used to detect the position of the user's hand, and When a user looks at the object while passing through the circle, the second camera is used to identify the left and right eye gaze directions. in, The non-dominant eye is identified from the user's left eye and right eye based on the recognized left and right eye gaze directions.

10. The electronic device according to claim 1, wherein, The processor is also configured to: Based on the detection of the left and right eye gaze directions, it is determined whether the dominant eye has changed, and Based on the determination that the dominant eye has changed from the user's right eye to the user's left eye, at least some settings of the second display panel corresponding to the user's right eye are changed, or the settings of the first display panel corresponding to the user's left eye are restored to the initial settings.

11. A method of operating an electronic device, the electronic device comprising a first camera configured to acquire an image relating to a frontal external environment of the electronic device, a second camera oriented opposite to the first camera and configured to acquire images relating to a user's left and right eyes, and a processor, the method comprising: Based on the images obtained through the second camera, the gaze direction of the user's left eye and the user's right eye is identified. Based on the gaze direction of the user's left eye and the user's right eye, identify the dominant eye and the non-dominant eye in the user's left eye and the user's right eye; The processor is used to identify, from the first and second display panels of the electronic device, the dominant display panel corresponding to the dominant eye and the non-dominant display panel corresponding to the non-dominant eye; Based on the direction of the user's gaze, the movement of the object being gazed at is identified; as well as Based on the movement of the object, the settings of the dominant display panel are changed to be different from those of the non-dominant display panel.

12. The method of claim 11, wherein, Identifying the dominant eye and the non-dominant eye further includes: The distance to the object is measured using the first camera; and Based on the determination that the measured distance exceeds a threshold, the second camera is used to identify the gaze direction of the user's left eye and the user's right eye.

13. The method of claim 11, wherein, Changing the settings of the dominant display panel includes: Determine whether the luminance value measured by the illuminance sensor of the electronic device is less than or equal to a threshold; and Based on determining that the brightness value is less than or equal to the threshold, the display resolution of the non-dominant display panel corresponding to the non-dominant eye is reduced.

14. The method according to claim 11, further comprising: Determine whether the movement of the object is below a preset reference value; as well as Based on the determination that the movement is lower than the preset reference value, the frame rate of the non-dominant display panel corresponding to the non-dominant eye is reduced.

15. The method according to claim 11, further comprising: Based on the detection of the left eye gaze direction and the right eye gaze direction, it is determined whether the dominant eye has changed; Based on determining that the dominant eye has changed from the user's right eye to the user's left eye, at least some settings of the second display panel corresponding to the user's right eye are changed; as well as Based on the determination that the dominant eye has changed from the user's right eye to the user's left eye, the settings of the first display panel corresponding to the user's left eye are restored to the initial settings.

Citation Information

Patent Citations

  • Electronic correction based on eye tracking

    US20140362446A1