Electronic device comprising light source and light source driving method thereof
By controlling the driving time and current of LEDs in AR devices to avoid overlapping turn-off times, the method addresses noise issues in AR devices, improving audio output quality by minimizing current changes and magnetic field-induced noise.
Patent Information
- Application Number
- PCT/KR2024/005475
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-07-17
- Filing Date
- 2024-04-23
- Publication Date
- 2024-11-21
AI Technical Summary
In augmented reality (AR) and mixed reality (MR) devices, the rapid turn-on and turn-off of LEDs in reflective displays cause sudden changes in current, leading to noise induction in power lines and audio output modules, such as speakers, due to magnetic field changes near the power line.
The implementation of a method where the driving time of specific LEDs is increased while reducing the driving current, and the sequence of turn-on and turn-off operations is controlled to ensure that the turn-off times of different LEDs do not overlap, using a controller connected to light source drivers to manage the power supply and minimize current changes.
This approach reduces noise induced into the power line and speakers by smoothing current changes during LED turn-on and turn-off operations, enhancing the reliability of audio output in AR devices.
Smart Images

Figure KR2024005475_21112024_PF_FP_ABST
Abstract
Description
Electronic device including a light source and a method for driving the light source thereof
[0001] Various embodiments relate to an electronic device including a light source and a method for driving the light source thereof.
[0002] Recently, electronic devices (hereinafter referred to as AR devices) that support augmented reality (AR) or mixed reality (MR) services that provide information by superimposing virtual images on images or backgrounds of real-world elements have been rapidly increasing.
[0003] AR devices utilize reflective displays to project images onto a transparent display (or see-through display) to provide virtual AR information. The optical system of a reflective display (e.g., liquid crystal on silicon, LCoS) may include a light source (e.g., LED or LD) to sequentially project color data to represent a virtual image onto the display.
[0004] The light source may include a three-color lamp of R (red), G (green), and B (blue), for example, a light-emitting diode (LED) light source. Each LED light source is implemented as a separate color field and can be imaged by a reflective display. For example, a reflective display can image the light emitted from each LED light source as it passes through the reflective display and then transmits image information in the form of light to a lens.
[0005] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above is applicable as prior art related to the present disclosure.
[0006] In an optical system of a display including light sources, the light sources can be operated to turn on / off sequentially. For example, in the case of LEDs, one LED is sequentially turned on and off, and then another LED is turned on and off, in the following order: Red LED turn on, Red LED turn off, Green LED turn on, Green LED turn off, Blue LED turn on, Blue LED turn off.
[0007] However, when one LED is turned off and the other LED is turned on, the power supply to the LED is cut off, which causes a sudden change in current, which can cause a change in battery current and generate noise in the power line.
[0008] For example, a wearable AR device in the form of glasses may have a structure in which a component such as a speaker is placed between an LED and a battery. If the power line transmitted to the LED is placed adjacent to an audio output module (e.g., a speaker), the current change due to the repeated operation of turning the LED on / off during speaker output may cause a change in the magnetic field near the power line, which may induce a current in the adjacent speaker coil. This may cause output noise (e.g., a phenomenon in which the sound is cut off every time the LED is turned off repeatedly) during speaker operation.
[0009] Various embodiments seek to provide a method for minimizing current changes occurring during the turn-on / turn-off process of a light source (e.g., LED).
[0010] The technical tasks to be achieved in this document are not limited to the technical tasks mentioned above, and other technical tasks not mentioned will be clearly understood by those with ordinary skill in the technical field to which this document pertains from the description below.
[0011] An electronic device including light sources according to one embodiment may include a first display and a second display. The electronic device according to one embodiment may include a first light source driver that controls driving of the first light sources included in the first display. The electronic device according to one embodiment may include a second light source driver that controls driving of the first light sources included in the second display. The electronic device according to one embodiment may include a controller operatively connected to the first light source driver and the second light source driver. The electronic device according to one embodiment may include a memory that stores instructions executable by the controller. The instructions according to one embodiment may control the electronic device to sequentially repeat one cycle of turn-on / turn-off operations for each of the first light sources through the first light source driver. The commands according to one embodiment may control the electronic device to operate the second light sources in a sequence in which the driving time of a specific light source among the second light sources is increased while the driving current is decreased based on the one cycle, and the driving times of other light sources among the second light sources are decreased while the driving current is increased.
[0012] The commands according to one embodiment may further be configured to cause the electronic device to change a sync setting or a light source driving setting of either the first light source driver or the second light source driver so that the turn-off times of the first light sources and the second light sources do not overlap but intersect.
[0013] An operation of an electronic device including light sources according to one embodiment may include an operation of controlling the driving of the first light sources through a first light source driver included in the electronic device so that one cycle is repeated in sequence for a turn-on / turn-off operation for each of the first light sources. An operation of an electronic device including light sources according to one embodiment may include an operation of controlling the driving of the second light sources through the second light source driver so that the driving time of a specific light source among the second light sources is increased based on the one cycle while the driving current is decreased, and the driving times of other light sources other than the specific light source are decreased while the driving current is increased.
[0014] A recording medium implemented in an electronic device including light sources according to one embodiment may include a recording medium having a program recorded thereon for causing the electronic device to execute an operation of controlling the driving of the first light sources through a first light source driver so that a turn-on / turn-off operation for each of the first light sources is sequentially repeated for one cycle, and an operation of controlling the driving of the second light sources through the second light source driver so that the driving time of a specific light source among the second light sources is increased based on the one cycle while the driving current is decreased, and the driving times of other light sources other than the specific light source are decreased while the driving current is increased.
[0015] Electronic devices, methods and / or recording media according to various embodiments can reduce noise induced in a power line by minimizing current changes due to LED turn-on / turn-off of a reflective display.
[0016] Devices and methods according to various embodiments can reduce current changes due to LED turning on / off in a display device including a light source, thereby reducing noise induced to a speaker through a power line.
[0017] The effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the art to which the present disclosure belongs from the description below.
[0018] Figure 1 is a block diagram of an electronic device according to one embodiment.
[0019] FIG. 2 is a block diagram of an augmented reality (AR) device according to one embodiment.
[0020] FIG. 3 is a diagram illustrating an AR device according to one embodiment.
[0021] Figure 4 is a drawing for explaining an optical system of a reflective display according to one embodiment.
[0022] Fig. 5 is a drawing showing the driving sequence and current consumption of a light source module included in an AR device according to a comparative example.
[0023] FIG. 6A illustrates a simplified block diagram of a light source module of an electronic device according to one embodiment.
[0024] FIG. 6b illustrates a circuit diagram of an LED module according to one embodiment.
[0025] FIG. 7 is a diagram showing the driving sequence and current consumption of a light source module included in an electronic device according to one embodiment.
[0026] FIG. 8 is a diagram showing the driving sequence and current consumption of a light source module included in an electronic device according to one embodiment.
[0027] FIG. 9 is a diagram showing the driving sequence and current consumption of a light source module included in an electronic device according to one embodiment.
[0028] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments.
[0029] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).
[0030] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or calculations. According to one embodiment, as at least a part of the data processing or calculations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or a secondary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor)) that can operate independently or together therewith. For example, if the electronic device (101) includes a main processor (121) and a secondary processor (123), the secondary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a specified function. The secondary processor (123) may be implemented separately from the main processor (121) or as a part thereof.
[0031] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, in the electronic device (101) itself where artificial intelligence is performed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.
[0032] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).
[0033] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).
[0034] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
[0035] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.
[0036] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. In one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.
[0037] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).
[0038] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
[0039] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HMDI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
[0040] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HMDI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0041] A haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. In one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.
[0042] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.
[0043] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least a part of a power management integrated circuit (PMIC).
[0044] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0045] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Any of these communication modules may communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). For example, the wireless communication module (192) may use subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196) to verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199).
[0046] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.
[0047] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas by, for example, the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).
[0048] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band.
[0049] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).
[0050] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In one embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.
[0051] The electronic device (101) according to various embodiments disclosed in this document may be a device of various forms. The electronic device (101) may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance device. The electronic device (101) according to the embodiments of this document is not limited to the aforementioned devices.
[0052] FIG. 2 is a block diagram of an augmented reality (AR) device according to one embodiment.
[0053] Referring to FIG. 2, according to various embodiments, an electronic device (e.g., electronic device (101) of FIG. 1) may be an AR device (201) that supports an AR service that provides an image related to augmented reality (AR) to a user.
[0054] According to one embodiment, the display module (240) (e.g., the display module (160) of FIG. 1) or the display can display at least one virtual object on at least a portion of the display module (240) so that a user wearing an electronic device (e.g., an AR device) appears to have the virtual object superimposed on a real image (or real image) related to a real space acquired through a camera.
[0055] According to one embodiment, the AR device (201) may include a communication module (210) (e.g., the communication module (190) of FIG. 1), a processor (220) (e.g., the processor (120) of FIG. 1), a memory (230) (e.g., the memory (130) of FIG. 1), a display module (240) (e.g., the display module (160) of FIG. 1), an audio module (250) (e.g., the audio module (170) of FIG. 1), a sensor module (260) (e.g., the sensor module (176) of FIG. 1), and a camera module (270) (e.g., the camera module (180) of FIG. 1). Although not shown in the drawing, the AR device (201) may further include a power management module (not shown) and a battery (not shown).
[0056] According to one embodiment, the communication module (210) (e.g., wireless communication circuit) may communicate with the electronic device (101) (e.g., the electronic device (101) of FIG. 1) via a wireless communication network (e.g., the first network (198) of FIG. 1) (e.g., a short-range wireless communication network), or may communicate wirelessly with a server device via a long-range wireless network (e.g., the second network (199) of FIG. 1). For example, the AR device (201) may communicate wirelessly with the electronic device (101) (e.g., the electronic device (101) of FIG. 1) to exchange commands and / or data with each other.
[0057] According to one embodiment, the communication module (210) can support a 5G network and next-generation communication technologies after a 4G network, such as NR access technology (new radio access technology). NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The communication module (210) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The communication module (210) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna.
[0058] According to one embodiment, the display or display module (240) (hereinafter, also referred to as a display) may display at least one virtual object on at least a portion of the display panel so that the virtual object appears to be superimposed on an image related to a real space acquired by a user wearing the AR device (201) through the camera module (270).
[0059] According to one embodiment, the display module (240) may include a first display module (241) corresponding to the left eye of the user and / or a second display module (243) corresponding to the right eye.
[0060] According to one embodiment, the display module (240) may be configured as a transparent or translucent display.
[0061] According to one embodiment, the display module (240) may include a lens. The lens may include a lens including a transparent waveguide. The lens may transmit light output from the display panel to the user's eyes. For example, light emitted from the display panel may pass through the lens and be transmitted to the user through a waveguide (e.g., a waveguide) formed within the lens. The waveguide may include at least one diffractive element (e.g., a diffractive optical element (DOE), a holographic optical element (HOE)) or a reflective element (e.g., a reflective mirror). The waveguide may guide display light emitted from a light source to the user's eyes using at least one diffractive element or reflective element. The user may perceive the actual space (or actual environment) behind the display by passing through the display module (240).
[0062] According to one embodiment, the audio module (250) may convert sound into an electrical signal or, conversely, convert an electrical signal into sound based on the control of the processor (220). For example, the audio module (250) may include a speaker and / or a microphone.
[0063] According to one embodiment, the sensor module (260) can detect the movement of the AR device (201). The sensor module (260) can detect physical quantities related to the movement of the AR device (201), for example, the speed, acceleration, angular velocity, angular acceleration, and / or geographical location of the AR device (201).
[0064] According to one embodiment, the sensor module (260) may include various sensors. For example, the sensor module (260) may include, but is not limited to, a proximity sensor (261), an illuminance sensor (262), and / or a gyro sensor (263). The proximity sensor (261) may detect an object adjacent to the AR device (201). The illuminance sensor (262) may measure the brightness level around the AR device (201). According to one embodiment, the processor (220) may use the illuminance sensor (262) to check the brightness level around the AR device (201) and change brightness-related setting information of the display module (240) based on the brightness level. The gyro sensor (263) may detect the state (or posture, direction) and position of the AR device (201). The gyro sensor (263) may detect movement of the AR device (201) or a user wearing the AR device (201).
[0065] According to one embodiment, the processor (220) may execute a program (e.g., program (140) of FIG. 1) stored in the memory (230) to control at least one other component (e.g., communication module (210), display module (240), audio module (250), sensor module (260), camera module (270)) related to the function of the AR device (201) and perform data processing or calculations required for tasks related to augmented reality services (e.g., AR tasks). For example, the processor (220) may include a computation processing unit.
[0066] According to one embodiment, the processor (220) can capture an image related to a real space corresponding to the field of view of a user wearing the AR device (201) through a camera module (270) to obtain image information. The processor (220) can recognize information corresponding to an area determined as the user's field of view (FoV) among the images related to the real space obtained through the camera module (270) of the AR device (201). The processor (220) can generate a virtual object based on virtual information based on the image information. The processor (220) can display a virtual object related to an augmented reality service together with the image information through the display module (240).
[0067] According to one embodiment, the processor (220) can measure physical quantities related to the movement of the AR device (201) through the sensor module (260) (e.g., geographical location, speed, acceleration, angular velocity and / or angular acceleration of the AR device (201), and can obtain movement information of the AR device (201) using the measured physical quantities or a combination thereof.
[0068] According to one embodiment, the processor (220) can analyze the movement information and image information of the AR device (201) in real time and control the processing of AR tasks, for example, a head tracking task, a hand tracking task, and / or an eye tracking task.
[0069] The camera module (270) can capture still images and videos. According to one embodiment, the camera module (270) can include one or more lenses, image sensors, image signal processors, and / or flashes. According to one embodiment, the camera module (270) can include a gesture camera (271), an eye tracking camera (273), a depth camera (275), and / or an RGB camera (277). According to one embodiment, the gesture camera (271) can detect a user's movement. For example, at least one gesture camera (271) can be placed on the AR device (201) and can detect a user's hand movement within a preset distance. The gesture camera (271) can include a simultaneous localization and mapping camera (SLAM camera) to recognize information (e.g., location and / or direction) related to the surrounding space of the AR device (201). The gesture recognition area of the gesture camera (271) can be set based on the shooting range of the gesture camera (271). According to one embodiment, the gaze tracking camera (273) can track the movements of the user's left and right eyes. According to one embodiment, the processor (120) can use the gaze tracking camera (273) to determine the gaze direction of the left eye and the gaze direction of the right eye. For example, the gaze tracking camera (273) can include a first gaze tracking camera for determining the gaze direction of the left eye and a second gaze tracking camera for determining the gaze direction of the right eye. According to one embodiment, the processor (120) can determine the dominant eye and the auxiliary eye based on the gaze direction of the left eye and the gaze direction of the right eye. According to one embodiment, the distance measuring camera (275) can measure the distance to an object located in front of the AR device (201).The distance measuring camera (275) may include a TOF (time of flight) camera and / or a depth camera. According to one embodiment, the distance measuring camera (275) may capture a front direction of the AR device (201), and the gaze tracking camera (273) may capture a direction opposite to the capturing direction of the distance measuring camera (275). According to one embodiment, the AR device (201) may measure a distance to an object using the distance measuring camera (275), and change the settings of the display module (240) when the distance is greater than or equal to a threshold value. For example, the AR device (201) may maintain the display performance of the display module (240) when the distance to the object is close to or less than the threshold value. According to one embodiment, the AR device (201) may recognize one of the objects located in the gaze direction (e.g., FOV) that the user is looking at with the gaze tracking camera (273), and may calculate the depth of the distance to the object through the depth camera or measure the distance to the object through the TOF camera. According to one embodiment, the RGB (red green blue) camera (277) can detect color-related information of an object and distance information to the object. According to one embodiment, the AR device (201) can include one type of camera by integrating the distance measurement camera (275) and the RGB camera (277). According to one embodiment, the gesture camera (271), the gaze tracking camera (273), the distance measurement camera (275), and / or the RGB camera (277) included in the camera module (270) may each be included in the AR device (201) or some of them may be implemented as integrated cameras.
[0070] According to one embodiment, all or part of the operations executed by the AR device (201) may be executed by one or more external electronic devices (e.g., external electronic devices 102, 104, or 108 of FIG. 1). For example, when the AR device (201) is to perform a certain function or service automatically or in response to a request from a user or another device, the AR device (201) may, instead of executing the function or service itself or in addition, request one or more external electronic devices to perform the function or at least a part of the service. The one or more external electronic devices that receive the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the AR device (201). The AR device (201) may process the result, either as is or additionally, and provide it as at least a part of a response to the request.
[0071] For example, an external electronic device may render content data executed in an application and transmit it to the AR device (201), and the AR device (201) that receives the data may output the content data (e.g., AR service image) to the display module (240). If the AR device (201) detects user movement through a specific sensor, the processor (220) of the AR device (201) may correct the rendering data received from the external electronic device based on the movement information and output it to the display module (240). Alternatively, the processor (220) of the AR device (201) may transmit the movement information to the external electronic device and request rendering so that the screen data is updated accordingly.
[0072] FIG. 3 is a diagram illustrating an AR device according to one embodiment.
[0073] Referring to FIG. 3, an AR device (201) that provides an image related to an augmented reality (AR) service to a user according to one embodiment may be configured in the form of at least one of glasses, goggles, a helmet, or a hat, but is not limited thereto.
[0074] For example, the AR device (201) may be a head-mounted device (HMD), a head-mounted display (HMD), or AR glasses.
[0075] The AR device (201) can provide an augmented reality service that outputs at least one virtual object so that it appears to overlap an area determined to be within the user's field of view (FoV). For example, the area determined to be within the user's field of view is an area determined to be recognizable by the user through the AR device (201), and may be an area that includes all or at least a portion of the display of the AR device (201).
[0076] The AR device (201) may further include at least some of the configurations and / or functions of FIGS. 1 and 2, and may be substantially identical to configurations overlapping with FIG. 1 or FIG. 2.
[0077] In one embodiment, the AR device (201) includes a first display (305), a second display (310), a screen display unit (315), an input optical member (320), a first transparent member (325a), a second transparent member (325b), a lighting unit (330a, 330b), a first PCB (335a), a second PCB (335b), a first hinge (340a), a second hinge (340b), a first camera (345) (e.g., a camera module (270) of FIG. 2), a plurality of microphones (e.g., a first microphone (350a), a second microphone (350b), a third microphone (350c)), a plurality of speakers (e.g., a first speaker (355a), a second speaker (355b)) (e.g., an audio module (250) of FIG. 2), a battery (360), a second camera (365a) (e.g., a camera of FIG. 2) module (270)), and a third camera (365b) (e.g., the camera module (270) of FIG. 2).
[0078] In one embodiment, the display (e.g., the first display (305) and / or the second display (310)) may include, for example, a liquid crystal display (LCD), a digital mirror device (DMD), a liquid crystal on silicon (LCoS), or a light emitting diode (LED) on silicon (LEDoS).
[0079] In one embodiment, when the display (e.g., the first display (305) and / or the second display (310)) is comprised of one of a liquid crystal display, a digital mirror display, or a silicon liquid crystal display, the AR device (201) may include a light source that illuminates a screen output area of the display (e.g., the first display (305) and / or the second display (310)).
[0080] In one embodiment, the AR device (201) (e.g., the processor (220) of FIG. 2) can detect a user's gaze direction (e.g., eye movement) through light-receiving pixels. For example, the AR device (201) can detect and track a gaze direction for the user's right eye and a gaze direction for the user's left eye through one or more light-receiving pixels constituting the first display (305) and one or more light-receiving pixels constituting the second display (310). The AR device (201) can determine the position of the center of the virtual image based on the gaze directions of the user's right and left eyes (e.g., the direction in which the pupils of the user's right and left eyes are gazing) detected through one or more light-receiving pixels.
[0081] In one embodiment, light emitted from displays (e.g., the first display (305) and the second display (310)) may pass through a lens (not shown) and a waveguide to reach a screen display unit (315) formed on a first transparent member (325a) positioned to face the user's right eye and a screen display unit (315) formed on a second transparent member (325b) positioned to face the user's left eye. For example, light emitted from displays (e.g., the first display (305) and the second display (310)) may pass through a waveguide to be reflected by a grating area formed on an input optical member (320) and the screen display unit (315) and be transmitted to the user's eyes. The first transparent member (325a) and / or the second transparent member (325b) may be formed of a glass plate, a plastic plate, or a polymer, and may be manufactured to be transparent or translucent.
[0082] In one embodiment, a lens (not shown) may be disposed in front of the displays (e.g., the first display (305) and the second display (310)). The lens (not shown) may include a concave lens and / or a convex lens. The lens may serve to adjust the focus so that a screen (e.g., an AR service image) output to the displays (e.g., the first display (305) and the second display (310)) can be viewed by the user's eyes. For example, light emitted from the display panel may pass through the lens and be transmitted to the user through a waveguide (e.g., a waveguide) formed within the lens. The lens may be configured as a Fresnel lens, a pancake lens, or a multi-channel lens.
[0083] In one embodiment, the screen display (315) or the transparent member (or window member) (e.g., the first transparent member (325a), the second transparent member (325b)) may include a lens including a waveguide, a reflective lens.
[0084] In one embodiment, the waveguide can be made of glass, plastic, or polymer, and can include nano-patterns formed on one surface of the inner or outer surface, for example, a grating structure having a polygonal or curved shape. According to one embodiment, light incident on one end of the waveguide can be propagated within the waveguide by the nano-patterns and provided to the user. In one embodiment, a waveguide composed of free-form prisms can provide the incident light to the user through a reflective mirror. The waveguide can include at least one diffractive element, for example, a diffractive optical element (DOE), a holographic optical element (HOE), or a reflective element, for example, a reflective mirror. In one embodiment, the waveguide can guide light emitted from a display (e.g., a first display (305), and / or a second display (310)) to the user's eyes by using at least one diffractive element or reflective element included in the waveguide.
[0085] According to various embodiments, the diffractive element may include an input optical member (320) and / or an output optical member (not shown). For example, the input optical member (320) may mean an input grating area, and the output optical member (not shown) may mean an output grating area. The input grating area may serve as an input terminal that diffracts (or reflects) light output from a light source (e.g., a micro LED) to transmit the light to a transparent member (e.g., a first transparent member (350a), a second transparent member (350b)) of the screen display unit (315). The output grating area may serve as an outlet that diffracts (or reflects) light transmitted to a transparent member (e.g., a first transparent member (350a), a second transparent member (350b)) of the waveguide to a user's eye.
[0086] According to various embodiments, the reflective element may include a total internal reflection (TIR) optical element or waveguide for total internal reflection. For example, total internal reflection may refer to a method of guiding light such that light (e.g., a virtual image) entering through an input grating region is reflected substantially 100% from one surface (e.g., a specific surface) of the waveguide, thereby transmitting substantially 100% of the light to the output grating region at an angle of incidence.
[0087] In one embodiment, light emitted from a display (e.g., a first display (305) and a second display (310)) may be guided along an optical path through an input optical member (320) into a waveguide. Light traveling inside the waveguide may be guided toward a user's eyes through an output optical member. The screen display unit (315) may be determined based on the light emitted toward the eyes.
[0088] According to one embodiment, the screen display unit (315) or the transparent member (or window member) (e.g., the first transparent member (325a), the second transparent member (325b)) may further include a transmittance adjusting member (not shown). The transmittance adjusting member may serve to adjust the light transmittance in response to the supplied voltage or supplied current for light transmitted through the first transparent member (325a) and the second transparent member (325b). The transmittance adjusting member may be coupled to the front or back of the lens, or may be coupled to the front of the optical system of the display (e.g., the first display (305) and / or the second display (310)). The transmittance adjusting member may adjust the light transmittance to be approximately 100% to approximately 0% depending on the supplied voltage (or current).
[0089] In one embodiment, the first camera (345) may be referred to as a high resolution (HR) or photo video (PV) camera and may include a high-resolution camera. The first camera (345) may include a color camera equipped with functions for obtaining high-quality images, such as an auto focus (AF) function and an optical image stabilizer (OIS). However, the first camera (345) is not limited thereto, and may include a global shutter (GS) camera or a rolling shutter (RS) camera.
[0090] In one embodiment, the second camera (365a) and the third camera (365b) may include cameras used for 3 degrees of freedom (3DoF), 6DoF head tracking, hand detection and tracking, gesture, and / or spatial recognition. For example, the second camera (365a) and the third camera (365b) may include a global shutter (GS) camera to detect and track head and hand movements.
[0091] In one embodiment, at least one sensor (e.g., a gyro sensor, an acceleration sensor, a geomagnetic sensor, and / or a gesture sensor), a second camera (365a), and a third camera (365b) can perform at least one of head tracking for 6DoF, pose estimation & prediction, gesture and / or spatial recognition, and simultaneous localization and mapping (SLAM) functions through depth shooting.
[0092] In one embodiment, the second camera (365a) and the third camera (365b) may be used separately as a camera for head tracking and a camera for hand tracking.
[0093] In one embodiment, the lighting units (330a, 330b) may have different uses depending on where they are attached. For example, the lighting units (330a, 330b) may be attached together with the second camera (365a) and the third camera (365b) mounted around a hinge (e.g., a first hinge (340a), a second hinge (340b)) connecting a frame (e.g., a temple) and a temple (e.g., a frame) or around a bridge connecting the temple and the frame. When shooting with a GS camera, the lighting units (330a, 330b) may be used as a means of supplementing the ambient brightness. For example, the lighting units (330a, 330b) may be used when it is difficult to detect a subject to be shot in a dark environment or due to mixing and reflection of multiple light sources.
[0094] In one embodiment, components (e.g., processor (220) and memory (230) of FIG. 2) constituting the AR device (201) may be located on a PCB (e.g., first PCB (335a), second PCB (335b)). The PCB may transmit electrical signals to the components constituting the AR device (201).
[0095] In one embodiment, multiple microphones (e.g., a first microphone (350a), a second microphone (350b), and a third microphone (350c)) can process external acoustic signals into electrical voice data. The processed voice data can be utilized in various ways depending on the function being performed (or the application being executed) on the AR device (201).
[0096] In one embodiment, a plurality of speakers (e.g., a first speaker (355a), a second speaker (355b)) can output audio data received from a communication module (e.g., a communication module (210) of FIG. 2) or stored in a memory (e.g., a memory (230) of FIG. 2).
[0097] In one embodiment, one or more batteries (360) may be included and may power components that make up the AR device (201).
[0098] According to one embodiment, a power line (not shown) of a battery (360) of an AR device (201) may be connected along the frame to a first display (305) (e.g., a first light source driver (620) of FIG. 6A) and a second display (310) (e.g., a second light source driver (630) of FIG. 6A). Since the displays (e.g., the first display (305) and / or the second display (310)) are driven by power supplied from the battery (360), a change in current due to LED turning on / off may cause a change in a magnetic field near the power line, which may induce a current in the adjacent first speaker (355a) and second speaker (355b), thereby generating noise during speaker operation.
[0099] FIG. 4 is a drawing for explaining an optical system of a display including a light source according to one embodiment.
[0100] Referring to FIG. 4, an optical system of a display (e.g., a reflective display) including a light source according to one embodiment may include a light source module (410), a first polarizing plate (411), a second polarizing plate (413), a display (420) (e.g., an LCoS display), and a lens (430).
[0101] The light source module (410) may include a light emitting diode (LED) or a laser diode (LD). The light source module (410) may emit light of, for example, R (red), G (green), and B (glue) colors.
[0102] The light source module (410) can be turned on by power supply from a battery (e.g., battery (189) of FIG. 1, battery (360) of FIG. 3) and can be turned off due to power cutoff.
[0103] According to one embodiment, the light source module (410) can operate each light source in a sequential driving manner. For example, the light source module (410) can be repeatedly operated in one cycle in which the R (red) color is turned off after emitting light, then the G (green) color is turned off after emitting light, then the B (blue) color is turned off after emitting light, and then the R (red) color is turned on again.
[0104] Light emitted from a light source can be reflected through a first polarizing plate (411) (e.g., a polarizing beam splitter) and a second polarizing plate (413) (e.g., a partially-reflective mirror) and reach the display (420). For example, the first polarizing plate (411) can serve to separate light emitted from the light source into two orthogonal polarization waves, a first wave (e.g., a P wave) and a second wave (e.g., an S wave), and provide the first wave and the second wave along different optical paths. The second polarizing plate (413) can serve to separate and image the light emitted from the display according to an image signal and transmit the image to the lens (430).
[0105] The display (410) may be implemented as a reflective display, for example, a liquid crystal on silicon (LCoS), a digital light processing (DLP), a laser scanning display (LSD), or a digital micro mirror device (DMD). The display (410) may receive an image signal transmitted from a processor of the electronic device (101) (for example, the processor (120) of FIG. 1), and may modulate light from a light source according to the received image signal and output the image to the lens (430) so that the corresponding image is projected. The lens (430) is an optical member that projects an image generated in the display (410) onto a waveguide, and may include at least one optical lens.
[0106] If the electronic device (101) is the AR device (201) illustrated in FIG. 3, the optical system illustrated in FIG. 4 may be included in each of the first display (e.g., the first display (305) of FIG. 3) and the second display (e.g., the second display (310) of FIG. 3).
[0107] Fig. 5 is a drawing showing the driving sequence and current consumption of a light source module included in an AR device according to a comparative example.
[0108] Referring to FIG. 5, an AR device according to a comparative (or conventional) embodiment may include the optical system illustrated in FIG. 4 in each of a first display (e.g., the first display (305) of FIG. 3) and a second display (e.g., the second display (310) of FIG. 3). For example, the first display may include a first LED module (e.g., a right LED), and the second display may include a second LED module (e.g., a left LED).
[0109] An electronic device according to a comparative example can synchronize the driving sync of a first light source module (e.g., right LED) and a second light source module (e.g., left LED) and control the turn-on / turn-off operation of the light sources by a sequential driving method.
[0110] According to the sequential driving method according to the comparative example, first, during the driving time of the first Red LED (510) and the second Red LED (520), current may be applied to turn on the first Red LED (510) and the second Red LED (520), and during the blank time, current may be cut off to turn off the first Red LED (510) and the second Red LED (520). Second, the first Green LED (515) and the second Green LED (525) may be turned on during the driving time and then turned off during the blank time, and third, the first Blue LED (517) and the second Blue LED (527) may be turned on during the driving time and then turned off during the blank time.
[0111] An AR device according to a comparative example may consume current from a battery during an LED turn-on period and may not consume current from the battery during an LED turn-off period.
[0112] For example, the voltage applied to each section in the light source module may be approximately 2.28 V for a red LED, approximately 3.16 V for a green LED, approximately 3.44 V for a blue LED, and approximately 4.0 V for the blank section. If the voltage and current applied to the LED are calculated to calculate the power consumption, the power consumption of one red LED can be approximately 513 mW, which is 0.225 A multiplied by 2.28 V.
[0113] As illustrated in FIG. 5, for the AR device, the power consumption during the turn-on time of two Red LEDs (510, 520) may be approximately 1026 mW. For the Green LED, since 0.121 A multiplied by 3.16 V is approximately 382 mW, the power consumption during the turn-on time of two Green LEDs (515, 525) may be approximately 764 mW, and for the Blue LED, since 0.137 A multiplied by 3.44 V is approximately 471 mW, the power consumption during the turn-on time of two Blue LEDs (517, 527) may be approximately 943 mW. In the blank period, since the current is 0 A, the power consumption may be 0 W.
[0114] As illustrated in FIG. 5, it can be confirmed that the sequential driving method according to the comparative example causes a rapid change in power at each point in time when the LED is turned on again after being turned off, and in particular, the maximum power change from 0 W to 1026 mW occurs at the point in time when the Blue LED is turned off and the RED LED is turned on.
[0115] Thus, the current changes due to the sequential driving method of the LED generate noise in the battery voltage (e.g., voltage fluctuations), and this battery voltage noise can affect other components of the electronic device. In particular, since the LED turn-on / turn-off section of the AR device is repeated periodically, the noise caused by the sudden current changes is expressed in the form of TDMA noise, and this affects the audio output module (e.g., speaker), so that the user can perceive the noise phenomenon.
[0116] For example, in the case of an AR device, as illustrated in FIG. 3, a power line of a battery (360) may be connected to each light source included in a display (e.g., a first display (305), a second display (310)) along a frame. Since a speaker is arranged between the battery (360) and the display, the power line connected to the light source may pass through the speaker and be connected to each light source. At this time, the inside of the speaker may include a coil. A change in current due to a periodic operation of turning on / off the light source module may cause a change in a magnetic field in the coil of the speaker along the power line, which may be expressed as speaker noise.
[0117] FIG. 6a illustrates a simplified block diagram of a light source module of an electronic device according to one embodiment, and FIG. 6b illustrates a circuit diagram of the light source module.
[0118] Referring to FIG. 6A, an electronic device according to one embodiment (e.g., the electronic device (101) of FIG. 1, the AR device (201) of FIGS. 2 and 3) may include a controller (610), a first light source driver (620), a second light source driver (630), and light sources (e.g., 621, 622, 623, 631, 632, 633). The electronic device illustrated in FIG. 6A may further include the components of FIG. 1 or the components illustrated in FIGS. 2 and 3.
[0119] The light sources may include, for example, a first R (Red) light source (621), a first G (Green) light source (622), and a first B (Blue) light source (623) connected to a first light source driver (620), and a second R (Red) light source (631), a second G (Green) light source (632), and a second B (Blue) light source (633) connected to a second light source driver (630). Each light source may include an LED or LD light source. Hereinafter, an example in which the light source is implemented as an LED will be described.
[0120] For convenience of explanation, FIG. 6B shows a circuit diagram of the controller (610) and the first light source driver (620) in the block diagram of FIG. 6A. As shown in FIG. 6B, the controller (610) can be connected to a power line (e.g., + line) and a ground line (e.g., - line) of the battery. The power line of the battery becomes the V_BAT power supply (PVIN) through the PMIC and is connected to the input power of the first light source driver (620) (e.g., LED1, LED2, LED 3), and the ground line can also be connected to the ground (PGND) of the first light source driver (620).
[0121] The first light source driver (620) and the second light source driver (630) can, under the control of the controller (610), provide driving current to each light source through the power line of the battery, or cut off the current supply to each light source. The first light source driver (620) and the second light source driver (630) can generate driving power for each light source by adjusting the input voltage (Vin) transmitted from the power supply module (e.g., PMIC and battery) to an output voltage (Vout) for driving each light source (e.g., LED). The output voltage may be a voltage required for driving each light source (or light-emitting element) (e.g., Red LED = 2.28 V, Green LED = 3.16 V, Blue LED = 3.44 V).
[0122] The controller (610) can set the turn-on / off time of each light source and control the operation of the light source drivers (e.g., the first light source driver (620) and the second light source driver (630)) in a sequential driving manner. For example, the sequential driving manner may be a method in which a 1-cycle pattern including the operation order of turn-on / turn-off of the red LED light source -> turn-on / turn-off of the green LED light source -> turn-on / turn-off of the blue LED light source is repeated. The controller (610) can transmit an enable signal to the first light source driver (620) and the second light source driver (630). The enable signal may include a high signal for applying power to each light source in a turn-on period and a low signal for cutting off power to each light source in a turn-off period, but this is an example and is not limited thereto.
[0123] According to one embodiment, the controller (610) may change the sync setting (or sync timing) or the light source driving setting so that the turn-off times of the first light source driver (620) and the second light source driver (630) do not overlap in the sequential driving mode, and so that the total power consumption of the first light source driver (620) and the second light source driver (630) does not become “0”. When the sync setting (or sync timing) or the light source driving setting is changed, the timing of one cycle set in the sequential driving mode may be set to remain the same.
[0124] For example, the controller (610) may shift or delay the sequence driving timing of the second light source driver (630) compared to the sequence driving timing of the first light source driver (620). As an example, the controller (610) may divide the LED turn-on time of the first light source driver (620) into three, and shift or delay the sync timing of the second light source driver (630) so that at the start of the second divided period, one LED light source of the second light source driver (630) is turned off, and at the end of the second divided period, another LED light source of the second light source driver (630) is turned on.
[0125] According to one embodiment, the controller (610) can change the light source driving settings of the first light source driver (620) by adjusting at least one of the driving time and / or driving current of the first light source driver (620) in a sequential driving manner.
[0126] According to one embodiment, the controller (610) checks the power consumption of each light source, and changes the light source driving settings so that the power consumption per hour becomes the same by increasing the driving time (or turn-on time) of a light source with a high power consumption compared to other light sources within one cycle and decreasing the driving time (or turn-on time) of a light source with a low power consumption.
[0127] For example, the controller (610) may change the light source drive settings (e.g., drive parameters such as drive current / drive time) of the first light source driver (620) to maintain a sync setting that is shifted or delayed with respect to the sync timing of the second light source driver (630), while increasing the drive time (or turn-on time) of the first Red LED (621) but decreasing the drive current, and decreasing the drive times (or turn-on times) of the first Green LED (622) and the first Blue LED (623) but increasing the drive current. In some cases, the controller (610) may also change to decrease the blank time of the first Green LED (622) and the first Blue LED (623) within one cycle.
[0128] According to one embodiment, the controller (610) may change the sync setting so that, in a sequential driving mode, a light source that is turned on in the second light source driver (630) is turned off when one of the light sources in the first light source driver (620) is turned off and another light source is turned on. Conversely, in a sequential driving mode, the controller (610) may change the sync setting so that, in a sequential driving mode, a light source that is turned on in the first light source driver (620) is turned off when one of the light sources in the second light source driver (630) is turned off and another light source is turned on.
[0129] According to one embodiment, the electronic device (101) may further include a processor (120) of FIG. 2. The processor (120) of FIG. 2 may control the controller (610) to change the sync settings and / or light source driving settings of each light source through the first light source driver (620) and the second light source driver (630).
[0130] According to some embodiments, although the controller (610) is illustrated as one in the illustrations of FIGS. 6A and 6B, the present invention is not limited thereto, and the controller (610) may be implemented as a first controller (not illustrated) connected to a first light source driver (620) and a second controller (not illustrated) connected to a second light source driver (630). In this case, the processor (120) may control the first controller and the second controller, or the first controller may be a master and the first controller may control the second controller to control the first light source driver (620) and the second light source driver (630).
[0131] An electronic device including a light source according to one embodiment (e.g., an electronic device (101) of FIG. 1, an electronic device (201) of FIGS. 2 and 3) may include a first display (e.g., a first display module (241) of FIG. 2, a first display (305) of FIG. 3) and a second display (e.g., a second display module (243) of FIG. 2, a second display (310) of FIG. 3). An electronic device (101) according to one embodiment may include a first light source driver (e.g., a first light source driver (620) of FIG. 6) included in the first display and controlling driving of a first red light source (e.g., 621 of FIG. 6), a first green light source (e.g., 622 of FIG. 6), and a first blue light source (e.g., 623 of FIG. 6). An electronic device (101) according to one embodiment may include a second light source driver (e.g., the second light source driver (630) of FIG. 6) that is included in the second display and controls driving of a second red light source (e.g., 631 of FIG. 6), a second green light source (e.g., 632 of FIG. 6), and a second blue light source (e.g., 633 of FIG. 6). An electronic device (101) according to one embodiment may include a controller (e.g., the controller (610) of FIG. 6, the processor (120) of FIG. 1, the processor (220) of FIG. 2) that is operatively connected to the first light source driver (620) and the second light source driver (630). According to one embodiment, the controller (610) can control the first light source driver (620) to repeat one cycle of the turn-on / turn-off operation of the first red light source (621), the turn-on / turn-off operation of the first green light source (622), and the turn-on / turn-off operation of the first blue light source (623) based on a sequential driving method.According to one embodiment, the controller (610) may be configured to operate in a changed sequence such that the second light source driver (630) increases the driving time of one light source among the second red light source (631), the second green light source (632), and the second blue light source (633) within the one cycle in a sequential driving manner while decreasing the driving current, and decreases the driving times of the other light sources while increasing the driving current.
[0132] According to one embodiment, each light source may include an LED (light emitting diode) or LD (laser diode) light source.
[0133] According to one embodiment, the controller (610) may be configured to divide the turn-on period of the light source connected to the second light source driver (620) into three, and shift or delay the sync timing of the first light source driver (620) so that at the start of the second divided period among the three divided periods, one light source among the light sources of the first light source driver (620) is turned off, and at the end of the second divided period, another light source among the light sources connected to the first light source driver (620) is turned on.
[0134] According to one embodiment, the electronic device (101) includes a see-through type AR device (201), and the first display and the second display may include at least one of LCOS (liquid crystal on silicon), DLP (digital light processing), LSD (laser scanning display), or DMD (digital micro mirror device).
[0135] According to one embodiment, the controller (610) may be configured to alternate the turn-off times of the first light source driver (620) and the second light source driver (630) so that they do not overlap, and to change the sync setting or sync timing of either of the first light source driver (620) and the second light source driver (630) so that the total power consumption of the first light source driver (620) and the second light source driver (630) does not become 0.
[0136] According to one embodiment, the controller (610) may be configured to change the sync setting so that a light source connected to the first light source driver (620) turns off and a light source turned on connected to the second light source driver (630) turns off when another light source is turned off.
[0137] An electronic device (101) according to one embodiment further includes a processor (e.g., processor (120) of FIG. 1, processor (220) of FIG. 2) operatively connected to the controller, and the processor (120, 220) may be configured to transmit, to the controller (610), a sequential control signal for controlling the operations of the first light source driver (620) and the second light source driver (630), and the controller (610) may be configured to control the operations of the first light source driver (620) and the second light source driver (630) by the sequential control signal transmitted from the processor.
[0138] According to one embodiment, the controller (610) may include a first controller (not shown) that controls the first light source driver (620) and a second controller (not shown) that controls the second light source driver (630).
[0139] According to one embodiment, the controller (610) may be set to change the driving parameters of each light source included in the sequential driving method.
[0140] The driving parameters according to one embodiment may include at least one of a driving time or turn-on time of the light source, a turn-off time of the light source, and a driving current of the light source.
[0141] According to one embodiment, the controller (610) may be configured to change the sync setting or light source driving setting of either the first light source driver (620) or the second light source driver (630) so that the turn-off times of the light sources between the first light source driver (620) and the second light source driver (630) do not overlap and are interleaved.
[0142] An electronic device (101) including a light source according to one embodiment may include a first display, a second display, a first light source driver for controlling driving of light sources included in the first display, a second light source driver for controlling driving of second light sources included in the second display, a controller operatively connected to the first light source driver and the second light source driver, and a memory for storing commands executable by the controller, the commands controlling the electronic device to repeat one cycle in a turn-on / turn-off operation order for each of the first light sources through the first light source driver, and controlling the electronic device to operate in a sequence in which a driving time of a specific light source among the second light sources is increased but a driving current is decreased based on the one cycle and a driving time of other light sources among the second light sources is decreased but a driving current is increased, and the first light sources and the second light sources include a red light source, a green light source, and a blue light source.
[0143] FIGS. 7 to 9 are diagrams illustrating the driving sequence and current consumption of a light source module included in an electronic device according to one embodiment. Hereinafter, in FIGS. 7 to 9, B (blank period) may denote a turn-off period of the light source.
[0144] According to one embodiment, the electronic device (101) may support a function of shifting or delaying the sequence driving timing of the second light source driver (730) (e.g., the second light source driver (630) of FIG. 6A) compared to the sequence driving timing of the first light source driver (720) (e.g., the first light source driver (620) of FIG. 6A). For example, as illustrated in FIG. 7, the controller (e.g., the controller (610) of FIG. 6) may divide the light source turn-on period of the first light source driver (710) into three, and shift or delay the sync timing of the second light source driver (720) so that at the start of the second divided period, one LED of the second light source driver (720) is turned off, and at the end of the second divided period, another LED of the second light source driver (720) is turned on.
[0145] In Fig. 7, the first light source driver (710) may be operated by a preset sequential driving method to turn on / off the first Red LED (711), turn on / off the first Green LED (713), and turn on / off the first Blue LED (715) in one cycle, and the one-cycle pattern may be repeated. At this time, the second light source driver (720) may be operated by a sync-changed sequence such that when the first Red LED (711) is turned on, the second Green LED (723) is turned on, and when the second divided section among the three divided sections of the first Red LED (711) turn-on section starts, the second Green LED (723) is turned off, and when the second divided section ends, the second Blue LED (725) is turned on. Due to this, when looking at the second light source driver (720) during the turn-on period of the first light source driver (710), it can be confirmed that three state changes occur, such as turn-on / turn-off / turn-on of the light sources connected to the second light source driver (720). For example, looking at the total power consumption of the first light source driver (710) and the second light source driver (720) illustrated in FIG. 7, it can be confirmed that when the first red LED (711) and the second green LED (723) are driven, approximately 895 mW is consumed, when the first red LED (711) is driven and the B (730) section, approximately 513 mW is consumed, when the first red LED (711) and the second blue LED (723) are driven, approximately 984 mW is consumed, when the B (730) section and the second blue LED (725) are driven, approximately 471 mW is consumed, when the first green LED (713) and the second blue LED (725) are driven, approximately 853 mW is consumed, and when the first green LED (713) and the B (730) section, approximately 382 mW is consumed.Hereinafter, it can be confirmed that there is no abrupt change in current consumption according to the comparative example shown in FIG. 5 as the turn-on / turn-off sync timing of the second red LED (721), the second green LED (723), and the second blue LED (725) is shifted or delayed even during the turn-on period of the first green LED (713) and the first blue LED (715).
[0146] According to one embodiment, the electronic device (101) may support a function of checking the power consumption of each light source and changing the driving time (or turn-on time) of a light source with a high power consumption compared to other light sources within one cycle, thereby changing the light source driving settings (e.g., driving parameters such as driving current / driving time) so that the instantaneous current consumption change of each light source becomes smooth.
[0147] For example, as illustrated in FIG. 8, when the power consumption of the red light source is greater than that of the blue light source or the green light source, the controller (610) may maintain the sync setting illustrated in FIG. 7, but increase the driving time (or turn-on time) and decrease the driving current of the first Red LED (811), and decrease the driving time (or turn-on time) and increase the driving current of the first Green LED (813) and the first Blue LED (815). For example, the first light source driver (810) (e.g., the first light source driver (620) of FIG. 6A) may lower the instantaneous current of the red light source by increasing the driving time (or turn-on time) of the first Red LED (811) while reducing the driving current (e.g., 225-ab) in a preset sequential driving method. The first light source driver (810) can maintain the brightness of each light source by decreasing the driving time and increasing the driving current of the first Green LED (813) (e.g., 121+a) and decreasing the driving time and increasing the driving current of the first Blue LED (815) (e.g., 137+b) to maintain the same 1 cycle. At this time, the second light source driver (820) (e.g., the second light source driver (630) of FIG. 6A) can maintain the sequence of the changed sync setting illustrated in FIG. 7, and the turn-on / turn-off operations of the second Red LED (821), the turn-on / turn-off of the second Green LED (823), and the turn-on / turn-off operations of the second Blue LED (825) can be repeated.
[0148] In some cases, the controller (610) may also change the light source driving settings (e.g., driving parameters such as driving current / driving time) of the second Red LED (821), the second Green LED (823), and the second Blue LED (825) connected to the second light source driver (820).
[0149] According to one embodiment, the controller (610) may also change the turn-off time (e.g., blank time) (830) to decrease in order to match the cycle based on the change in the driving time (or turn-on time) of each light source. For example, in the case of a red LED (e.g., the first red LED (811)), since the power consumption is greater than that of a green LED (e.g., the first green LED (813)) or a blue LED (e.g., the first blue LED (815)), the driving time (or turn-on time) is increased, but instead of lowering the instantaneous current amount, the average brightness of the light source can be maintained by adjusting the current amount of the other LEDs.
[0150] According to one embodiment, the electronic device (101) may support a function of changing the sync setting so that when one light source connected to the first light source driver (910) (e.g., the first light source driver (620) of FIG. 6A) is turned off, another light source connected to the second light source driver (920) (e.g., the second light source driver (630) of FIG. 6A) is turned off.
[0151] As illustrated in FIG. 9, the controller (610) can change the sync setting so that a light source that is turned on in the second light source driver (920) is turned off when one of the light sources of the first light source driver (910) is turned off and another light source is turned on. Conversely, the controller (610) can change the sync setting so that a light source that is turned on in the first light source driver (910) is turned off when one of the light sources of the second light source driver (920) is turned off and another light source is turned on. For example, in FIG. 9, the first light source driver (910) can repeat the turn-on / turn-off operations of the first Red LED (911), the turn-on / turn-off operations of the first Green LED (913), and the turn-on / turn-off operations of the first Blue LED (915) by a preset sequential driving method. The second light source driver (920) may repeat the turn-on / turn-off operations of the second Red LED (921), the turn-on / turn-off operations of the second Green LED (923), and the turn-on / turn-off operations of the second Blue LED (925) based on a sequence in which the sync is changed to start the B section (turn-off section) (930) of the second green LED (923) at the end point of the B section (turn-off section) (930) of the first Red LED (911).
[0152] Looking at the total power consumption of the first light source driver (910) and the second light source driver (920) illustrated in FIG. 9, as in FIG. 7, there is no section where the power consumption is “0”, and when comparing the current consumption according to the comparative example illustrated in FIG. 5, it can be confirmed that there is no sudden change in current.
[0153] As described above, the turn-off times (=blank times) between the first light source driver (620) and the second light source driver (630) are staggered so as not to overlap, and the sync setting (or sync timing) is changed so that the total power consumption of the first light source driver (620) and the second light source driver (630) does not become “0”, thereby attenuating the rapid current change due to the LED turn-on / turn-off, thereby preventing noise induced in the power line.
[0154] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0155] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.
[0156] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). TM) or directly between two user devices (e.g., smart phones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.
[0157] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
Claims
1. In an electronic device including a light source, First display; Second display; A first light source driver that controls driving of first light sources included in the first display; A second light source driver that controls the driving of second light sources included in the second display; A controller operatively connected to the first light source driver and the second light source driver, comprising a memory storing instructions executable by the controller; The above commands cause the electronic device to: The driving of the first light sources is controlled so that one cycle is repeated in the turn-on / turn-off operation order of each of the first light sources through the first light source driver, Controlling the driving of the second light sources so that the driving time of a specific light source among the second light sources is increased based on the first cycle while the driving current is decreased, and the driving time of other light sources among the second light sources is decreased while the driving current is increased, An electronic device wherein the first light sources and the second light sources include a red light source, a green light source, and a blue light source.
2. In paragraph 1, Each light source is an electronic device that includes an LED (light emitting diode) or LD (laser diode) light source.
3. In paragraph 1, The above commands cause the electronic device to: An electronic device further configured to shift or delay the sync timing of the second light source driver based on the sync timing of the first light source driver.
4. In paragraph 2 or 3, The above electronic device includes an AR device of see-through type, An electronic device wherein the first display and the second display include at least one of LCOS (liquid crystal on silicon), DLP (digital light processing), LSD (laser scanning display), or DMD (digital micro mirror device).
5. In paragraph 4, The above commands cause the electronic device to: An electronic device further configured to alternately cause the turn-off times of the first light source driver and the second light source driver to overlap each other, and to change the sync setting or sync timing of one of the first light source driver and the second light source driver so that the total power consumption of the first light source driver and the second light source driver does not become 0.
6. In paragraph 1 or paragraph 3, The above commands cause the electronic device to: An electronic device configured to change a sync setting so that a light source connected to the first light source driver is turned off and a light source that is turned on is turned off when another light source is turned off.
7. In paragraph 6, Further comprising a processor operatively connected to said controller, The above instructions cause the processor to: A sequential control signal for controlling the operation of the first light source driver and the second light source driver is transmitted to the controller, An electronic device wherein said controller is configured to control operations of said first light source driver and said second light source driver based on sequential control signals transmitted from said processor.
8. In paragraph 7, The above controller, An electronic device comprising a first controller controlling the first light source driver and a second controller controlling the second light source driver.
9. In paragraph 1, The above controller, An electronic device configured to change the driving parameters of each light source included in a sequential driving method set in relation to driving the first light source driver or the second light source driver.
10. In paragraph 9, The above driving parameters are, An electronic device comprising at least one of a driving time or turn-on time of a light source, a turn-off time of the light source, and a driving current of the light source.
11. In paragraph 1, The above commands cause the electronic device to: An electronic device further configured to change a sync setting or a light source driving setting of one of the first light source driver and the second light source driver so that the turn-off times of the first light sources and the second light sources do not overlap but intersect.
12. In paragraph 11, The above commands cause the electronic device to: An electronic device further configured to divide a turn-on period of a light source into three, and shift or delay the sync timing of the first light source driver so that at the start of a second divided period among the three divided periods, a specific light source among the first light sources is turned off, and at the end of the second divided period, a light source other than the specific light source among the first light sources is turned on.
13. In paragraph 12, The above commands cause the electronic device to: An electronic device further configured to operate in a changed sequence based on the sequential driving method of the first light source driver and / or the second light source driver so as to increase the driving time of a specific light source within the one cycle while reducing the driving current, and to decrease the driving times of other light sources while increasing the driving current.
14. In paragraph 11, Further comprising a processor operatively connected to said controller, The processor transmits a sequential control signal to the controller for controlling the operation of the first light source driver and the second light source driver, An electronic device wherein the controller is set to control operations of the first light source driver and the second light source driver by sequential control signals transmitted from the processor.
15. In paragraph 11, The above processor is set to change the driving parameters of each light source, An electronic device wherein the above driving parameters include at least one of a driving time or turn-on time of the light source, a turn-off time of the light source, and a driving current of the light source.
Citation Information
Patent Citations
Image display apparatus and image display method
JP2013061521A
Display device and light source for image display device
JP2014225725A
Picture display unit
JP2019047194A
System and method for rendering images in virtual reality and mixed reality devices
US20170330496A1
KR20210130206A
