Head mounted display device and control method thereof

Abstract

The present invention includes a head mounted display device and a control method thereof, the head mounted display device comprising: a display module configured to output light constituting a virtual image; an optical system which transmits light of the output virtual image to a user's eye and transmits external light; at least one tunable optical filter configured to electrically control the transmittance for each wavelength of the transmitted light; a memory for storing one or more instructions; and at least one processor for executing the one or more instructions stored in the memory, wherein the at least one processor acquires a target transmission spectrum including information about the preset transmittance for each wavelength, and controls the at least one tunable optical filter so that the adjusted transmission spectrum formed by the at least one tunable optical filter corresponds to the transmittance for each wavelength of the target transmission spectrum.

Description

Head-mounted display device and control method thereof

[0001] A head-mounted display device and a control method thereof are disclosed. Specifically, a head-mounted display device and a control method thereof for controlling a variable optical filter based on a target transmission spectrum are disclosed.

[0002] Light passing through a variable optical filter has its intensity reduced at each wavelength depending on the filter's transmittance spectrum. Users with eye conditions or low vision may need to prevent light of specific wavelengths from entering their eyes, depending on their individual ocular characteristics. Therefore, each user may have their own unique transmittance spectrum.

[0003] In one embodiment of the present disclosure, an augmented reality device may include an optical system for transmitting light of an output virtual image to a user's eye and transmitting external light, at least one tunable optical filter configured to electrically control transmittance according to wavelength of the transmitted light, a memory for storing one or more instructions, and at least one processor for executing one or more instructions stored in the memory. In one embodiment, the at least one processor may execute at least one instruction, thereby allowing the augmented reality device to obtain a target transmittance spectrum including information about preset transmittance according to wavelength. In one embodiment, the at least one processor may execute at least one instruction, thereby allowing the augmented reality device to control the at least one tunable optical filter such that an adjusted transmittance spectrum formed by the at least one tunable optical filter corresponds to the transmittance according to wavelength of the target transmittance spectrum.

[0004] A virtual reality device according to one embodiment of the present disclosure may include an optical system for transmitting light of an output image to a user's eyes, a memory for storing one or more instructions, and at least one processor for executing one or more instructions stored in the memory. In one embodiment, the at least one processor may execute at least one instruction, thereby allowing the augmented reality device to obtain RGB channel values ​​of a plurality of pixels of an original image. In one embodiment, the at least one processor may execute at least one instruction, thereby allowing the augmented reality device to obtain a target transmittance spectrum including information on transmittance for each preset wavelength. In one embodiment, the at least one processor may execute at least one instruction, thereby allowing the augmented reality device to obtain a corrected image by adjusting the RGB channel values ​​of a plurality of pixels based on the transmittance for each wavelength of the target transmittance spectrum. In one embodiment, the at least one processor may execute at least one instruction, thereby allowing the augmented reality device to display the corrected image on a display.

[0005] A method for controlling a head-mounted display device including at least one variable optical filter according to one embodiment of the present disclosure may include a step of acquiring a target transmittance spectrum including information on preset wavelength-specific transmittances. In one embodiment, the method may include a step of controlling the at least one variable optical filter such that an adjusted transmittance spectrum formed by the at least one variable optical filter corresponds to the wavelength-specific transmittances of the target transmittance spectrum.

[0006] According to one embodiment of the present disclosure, a computer-readable recording medium having recorded thereon a program for performing at least one of the control methods of the disclosed head-mounted display device on a computer may be provided.

[0007] FIG. 1 is a drawing for explaining the operation of a head mounted display device according to one embodiment of the present disclosure.

[0008] FIG. 2 is a plan view of a virtual reality device according to one embodiment of the present disclosure.

[0009] FIG. 3 is a plan view of a virtual reality device according to one embodiment of the present disclosure.

[0010] FIG. 4 is a drawing for explaining the structure of a variable optical filter according to one embodiment of the present disclosure.

[0011] FIG. 5 is a flowchart for explaining the operation of a head mounted display device according to one embodiment of the present disclosure.

[0012] FIG. 6 is a flowchart illustrating a method for controlling at least one variable optical filter in a head mounted display device according to one embodiment of the present disclosure.

[0013] FIGS. 7A and 7B are drawings for explaining a method for controlling a first variable optical filter in a head-mounted display device according to one embodiment of the present disclosure.

[0014] FIGS. 8A and 8B are drawings for explaining a method for controlling a second variable optical filter in a head-mounted display device according to one embodiment of the present disclosure.

[0015] FIGS. 9A and 9B are drawings for explaining a method for controlling a third variable optical filter in a head-mounted display device according to one embodiment of the present disclosure.

[0016] FIGS. 10A and 10B are drawings for explaining a method for controlling a fourth variable optical filter in a head-mounted display device according to one embodiment of the present disclosure.

[0017] FIG. 11 is a drawing for explaining an adjusted transmission spectrum formed by overlapping a plurality of transmission spectra according to one embodiment of the present disclosure.

[0018] FIG. 12 is a flowchart illustrating a method for controlling a head mounted display device according to one embodiment of the present disclosure based on the intensity of external light.

[0019] FIG. 13 is a drawing for explaining changes in the illuminance of external light passing through at least one variable optical filter according to one embodiment of the present disclosure.

[0020] FIG. 14 is a flowchart for explaining the operation of a head mounted display device according to one embodiment of the present disclosure.

[0021] FIG. 15 is a drawing for explaining a method for a head mounted display device according to one embodiment of the present disclosure to adjust RGB channel values ​​of a plurality of pixels.

[0022] FIG. 16 is a diagram for explaining a process of converting a color gamut of a display by a head mounted display device according to one embodiment of the present disclosure.

[0023] FIG. 17 is a flowchart illustrating a method for controlling a head mounted display device according to one embodiment of the present disclosure based on the brightness of the display.

[0024] FIG. 18 is a detailed configuration diagram of an augmented reality device according to one embodiment of the present disclosure.

[0025] FIG. 19 is a detailed configuration diagram of a virtual reality device according to one embodiment of the present disclosure.

[0026] The terms used in the embodiments of this specification have been selected from widely used, current terms, taking into account the functions of the present disclosure. However, these terms may vary depending on the intentions of those skilled in the art, precedents, the emergence of new technologies, etc. Furthermore, in certain cases, terms may be arbitrarily selected by the applicant, and in such cases, their meanings will be described in detail in the description of the relevant embodiments. Therefore, the terms used in this specification should not be defined simply as names of terms, but rather based on their meanings and the overall content of the present disclosure.

[0027] Singular expressions may include plural expressions unless the context clearly indicates otherwise. Terms used herein, including technical or scientific terms, have the same meaning as commonly understood by a person of ordinary skill in the art described herein.

[0028] Throughout this disclosure, when a part is said to "include" a component, this does not exclude other components, but rather implies the inclusion of other components, unless otherwise specifically stated. Furthermore, terms such as "part," "module," etc., used herein refer to a unit that processes at least one function or operation, which may be implemented in hardware or software, or a combination of hardware and software.

[0029] As used herein, the expression "configured to" can be used interchangeably with, for example, "suitable for," "having the capacity to," "designed to," "adapted to," "made to," or "capable of." The term "configured to" does not necessarily mean something is "specifically designed to" in hardware. Instead, in some contexts, the expression "a system configured to" can mean that the system, in conjunction with other devices or components, is "capable of." For example, the phrase "a processor configured to perform A, B, and C" can mean a dedicated processor for performing the operations (e.g., an embedded processor), or a generic-purpose processor (e.g., a CPU or application processor) that can perform the operations by executing one or more software programs stored in memory.

[0030] In the present disclosure, a processor is a component that controls a series of processes so that an electronic device operates according to the embodiments described below, and may be composed of one or more processors. One or more processors included in the processor may be circuitry such as a System on Chip (SoC), an Integrated Circuit (IC), etc. One or more processors included in the processor may be a general-purpose processor such as a Central Processing Unit (CPU), a Micro Processor Unit (MPU), an Application Processor (AP), a Digital Signal Processor (DSP), a graphics-only processor such as a Graphics Processing Unit (GPU), a Vision Processing Unit (VPU), an artificial intelligence-only processor such as a Neural Processing Unit (NPU), or a communication-only processor such as a Communication Processor (CP). When one or more processors included in the processor are artificial intelligence-only processors, the artificial intelligence-only processor may be designed with a hardware structure specialized for processing a specific artificial intelligence model.

[0031] In the present disclosure, a processor may include various processing circuits and / or multiple processors. For example, the term “processor” as used herein, including in the claims, may include various processing circuits, including at least one processor. At least one processor, one or more processors may be configured to perform various functions described herein, individually and / or collectively, in a distributed fashion. As used herein, “processor,” “at least one processor,” and “one or more processors” may be configured to perform various functions. However, these terms encompass, without limitation, situations where one processor performs some of the functions and other processor(s) perform other parts of the functions, and situations where a single processor may perform all of the functions. Furthermore, the at least one processor may include a combination of processors that perform various functions of the disclosed functions in a distributed manner. At least one processor may execute program instructions to achieve or perform various functions.

[0032] It should be understood that the blocks and combinations of flowcharts in each of the flowcharts in this disclosure can be implemented by one or more computer programs containing computer-executable instructions. The one or more computer programs may be stored entirely in a single memory, or may be divided and stored across multiple different memories.

[0033] In this disclosure, all functions or operations described in this document may be processed by a single processor or a combination of processors. A single processor or a combination of processors may be a circuitry that performs processing, and may include circuitry such as an Application Processor (AP), a Communication Processor (CP), a Graphical Processing Unit (GPU), a Neural Processing Unit (NPU), a Microprocessor Unit (MPU), a System on Chip (SoC), an Integrated Chip (IC), etc.

[0034] The processor can write data to memory, read data stored in memory, and process data according to predefined operating rules or artificial intelligence models, particularly by executing a program or at least one instruction stored in memory. Accordingly, the processor can perform the operations described in the following embodiments, and operations described as performed by electronic devices or detailed components included in the electronic devices in the following embodiments can be considered to be performed by the processor, unless otherwise specified.

[0035] When a component is referred to as being "connected" or "connected" to another component in this disclosure, it should be understood that the component may be directly connected or connected to the other component, but may also be connected or connected via another component in between, unless otherwise specifically stated.

[0036] In this disclosure, 'Augmented Reality (AR)' means displaying a virtual image together within a physical environment space of the real world or displaying a real object and a virtual image together.

[0037] In this disclosure, "virtual reality (VR)" refers to displaying an image of a virtual environment separated from the physical environment space of the real world. In one embodiment, virtual reality may include mixed reality (MR), in which information about the physical environment space of the real world is displayed together.

[0038] In the present disclosure, a 'head-mounted display device' may refer to an augmented reality device capable of expressing augmented reality or a virtual reality device capable of expressing virtual reality. In one embodiment, the head-mounted display device may be in the form of glasses worn by a user on the face, but is not necessarily limited to the examples described above.

[0039] In this disclosure, a "virtual image" refers to an image generated by an optical engine, and may include both static and dynamic images. These virtual images are observed alongside a real scene, and may be virtual images representing information about real objects within the real scene, information about the operation of an augmented reality device, control menus, and the like.

[0040] In the present disclosure, an 'optical system' may refer to at least one optical element for guiding light generated from a light source of an augmented reality device or a virtual reality device to a user's eyes. In one embodiment, the optical system included in the augmented reality device may include optical elements made of a transparent material for guiding a virtual image generated from an optical engine for generating a virtual image to the user's eyes and for viewing a scene in the real world at the same time. In one embodiment, the augmented reality device may include an optical element for changing the path of light having straightness in order to guide the light generated from the optical engine to the user's eyes since it must be able to observe a scene in the real world at the same time. In one embodiment, the optical system may change the path of light by using reflection by a mirror or the like, or may change the path of light by diffraction by a diffractive optical element such as a DOE (Diffractive optical element), a HOE (Holographic optical element), or the like, but is not necessarily limited to the examples described above.

[0041] In the present disclosure, a 'variable optical filter' may mean an optical device capable of adjusting or controlling the transmission spectrum of light incident on the 'variable optical filter'. The 'variable optical filter' may adjust the transmittance of a specific wavelength by an electrical or mechanical method, and may change the wavelength band and degree of light blocked, absorbed, or reflected by changing the characteristics of at least one layer constituting the variable optical filter using changes in electromagnetic force, changes in molecular arrangement, or changes in nanostructure incidence conditions, but is not limited thereto.

[0042] In the present disclosure, the term "transmittance spectrum" may refer to a graph or data indicating how much light is transmitted through a material depending on its wavelength. In one embodiment, the "transmittance spectrum" may include information on the transmittance by wavelength within a predetermined wavelength band.

[0043] In this disclosure, "color gamut" refers to a concept that can indicate the range of colors that a display can display. In one embodiment, the color gamut can be expressed as a triangle or polygon in the RGB color space. In one embodiment, the color of a pixel displayed on the display can be expressed as one of the colors included in the color gamut as the RGB channel values ​​change.

[0044] FIG. 1 is a drawing for explaining the operation of a head mounted display device according to one embodiment of the present disclosure.

[0045] In one embodiment, the head mounted display device (100) may include an augmented reality device (2000) and a virtual reality device (3000). In one embodiment, the head mounted display device (100) may include at least one variable optical filter (110). In one embodiment, the head mounted display device (100) may control the at least one variable optical filter (110) to adjust a transmission spectrum formed by each of the at least one variable optical filter (110). In other words, by controlling the at least one variable optical filter (110) by the head mounted display device (100), the intensity of light transmitted through the at least one variable optical filter (110) may be adjusted for each wavelength.

[0046] In one embodiment, the light transmitted through at least one variable optical filter (110) may include at least one of external light incident from the outside of the head mounted display device (100) and internal light output from an internal display module (or display) of the head mounted display device (100). In one embodiment, the light transmitted through at least one variable optical filter (110) may include multi-colored light (or composite light) in which lights of various wavelengths are mixed. Accordingly, the external light or the internal light may be transmitted through at least one variable optical filter (110), thereby blocking or reducing the intensity of light of a specific wavelength among lights of various wavelengths.

[0047] In one embodiment, the head mounted display device (100) may obtain a target transmission spectrum (120) including information on transmittance for each preset wavelength. In one embodiment, the target transmission spectrum (120) may be a transmission spectrum preset according to the eye characteristics of the user. For example, if the user of the head mounted display device (100) has an eye disease or low vision, light in a specific wavelength band may need to be blocked or its intensity reduced to protect the user's eyes. In other words, the target transmission spectrum may be formed such that light in a wavelength band that is not harmful to the user's eyes is transmitted as is or has a high transmittance, and light in a wavelength band that is harmful to the user's eyes is blocked or has a low transmittance. In one embodiment, since the type or degree of eye disease may vary for each user, the target transmission spectrum may include information on transmittance for each wavelength that is personalized for each user.

[0048] In one embodiment, the head mounted display device (100) can control at least one variable optical filter (110) such that an adjusted transmission spectrum (130) formed by at least one variable optical filter corresponds to a wavelength-specific transmittance of a target transmission spectrum (120). In one embodiment, the adjusted transmission spectrum (130) may refer to a transmission spectrum formed by controlling at least one variable optical filter (110). In one embodiment, when there are two or more variable optical filters (110), the adjusted transmission spectrum (130) may refer to a transmission spectrum formed by overlapping the transmission spectra of each of the at least one variable optical filter (110).

[0049] In one embodiment, the characteristics of the transmission spectrum that they can form may be limited depending on the characteristics of each of the at least one variable optical filter (110). In one embodiment, the characteristics of the transmission spectrum may include various types of information about the shape of the transmission spectrum determined based on at least one of a transmission band and a transmission rate change rate by wavelength. Accordingly, the head mounted display device (100) can form an adjusted transmission spectrum (130) that can closely achieve the effect of the target transmission spectrum (120) by controlling each of the at least one variable optical filter (110) of a limited number based on the characteristics of the target transmission spectrum (120).

[0050] In this way, according to one embodiment of the present disclosure, the head mounted display device (100) can protect the user's eyes from external light incident on the head mounted display device (100) and internal light generated from the head mounted display device (100) by forming an adjusted transmission spectrum (130) corresponding to a target transmission spectrum (120) suitable for the eye condition of each user.

[0051] FIG. 2 is a plan view of a virtual reality device according to one embodiment of the present disclosure.

[0052] Referring to FIG. 2, the augmented reality device (2000) may include a frame (2010), a display module (2100), an optical system (2200), a memory (2300), a light sensor (2400), and at least one processor (2800). However, the present invention is not limited to the examples described above, and some components may be omitted or other components may be added.

[0053] The frame (2010) includes other components of the augmented reality device (2000) and is configured to allow a user to wear the augmented reality device (2000), and may include glasses temples, a nose bridge, and the like, but is not necessarily limited to the examples described above. In one embodiment, left-eye optical components and right-eye optical components may be arranged or attached to the left and right sides of the frame (2010), or the left-eye optical components and right-eye optical components may be integrally formed and mounted on the frame (2010). In another example, some of the optical components may be arranged or attached to only one of the left and right sides of the frame (2010). In one embodiment, the frame (2010) may include two rims through which external light (EL) may be transmitted so that external light (EL) may be incident on the user's eyes, and the two rims may include or omit glasses lenses with or without refractive power (prescription).

[0054] The display module (2100) may be a component that generates and outputs light (IL) of a virtual image. The light (IL) of the virtual image output through the display module (2100) may be incident on the eyes of a user wearing the augmented reality device (2000). In one embodiment, the display module (2100) may include an optical engine of a projector including an image panel, an illumination optical system, a projection optical system, etc. In one embodiment, the display module (2100) may include a left-eye display module and a right-eye display module, and each display module may be arranged within a frame (2010), but is not necessarily limited thereto. In one embodiment, the left-eye display module may output light of a virtual image incident on the user's left eye, and the right-eye display module may output light of a virtual image incident on the user's right eye. Here, the light of the virtual image incident on the user's left eye and the light of the virtual image incident on the user's right eye may be different from each other. The user can experience a three-dimensional effect of the virtual image based on the light of different virtual images incident on the left and right eyes respectively.

[0055] In one embodiment, the display module (2100) may include a light source that outputs light, an image panel that forms a two-dimensional virtual image using the light output from the light source, and a projection optical system that projects the light of the virtual image formed on the image panel. The light source is an optical component that illuminates light and can generate light by controlling the color of RGB. The light source may be composed of, for example, a light-emitting diode (LED). The image panel may be composed of a reflective image panel that modulates the light illuminated by the light source into light containing a two-dimensional image and reflects it. The reflective image panel may be, for example, a DMD (Digital Micromirror Device) panel or an LCoS (Liquid Crystal on Silicon) panel, or any other known reflective image panel.

[0056] In one embodiment, the display module (2100) may include a light source that outputs light and a two-axis scanner that scans the light output from the light source in two dimensions. In another embodiment, the display module (2100) may include a light source that outputs light, a linear image panel that forms a linear image (i.e., a one-dimensional image) using the light output from the light source, and a one-axis scanner that scans the light of the linear image formed on the linear image panel.

[0057] In one embodiment, the display module (2100) can obtain image data constituting a virtual image from at least one processor (2800), generate a virtual image based on the obtained image data, and project light constituting the virtual image output from a light source through an emission surface onto the optical system (2200). In one embodiment, the at least one processor (2800) can provide image data including RGB channel values ​​of a plurality of pixels constituting the virtual image to the display module (2100), and the display module (2100) can control a light source based on the RGB channel values ​​of each of the plurality of pixels, thereby projecting the light constituting the virtual image onto the optical system (2200).

[0058] The optical system (2200) may be a component that transmits the light (IL) of the virtual image to the user's eyes and through which external light (EL) is transmitted. In one embodiment, the optical system (2200) may include a birdbath type optical system (or a reflective optical system) or a waveguide type optical system (or a waveguide optical system) depending on a method of transmitting the light (IL) of the virtual image emitted from the display module (2100) to the user's eyes, and is not necessarily limited to the examples described above. In one embodiment, the optical system (2200) may include optical elements such as a collimator that focuses or parallels the light generated from the optical engine and a combiner that changes the path of the light generated from the optical engine, and is not necessarily limited to the examples described above. In one embodiment, the light (IL) of the virtual image and the external light (EL) may transmit through the optical system (2200) and be incident on the user's eyes.

[0059] The light sensor (2400) may be a component that obtains information about the intensity of external light (EL) of the augmented reality device (2000). In one embodiment, the information about the external light (EL) may include at least one of the intensity of the external light (EL) at each of multiple wavelengths and the total intensity of the external light (EL) calculated based on the intensity of the light at each of multiple wavelengths.

[0060] In one embodiment, the light sensor (2400) may include photovoltaic cells that generate voltage and current based on light incident on the light sensor (2400), or a photoresistor that changes conductance based on light incident on the light sensor (2400). In one embodiment, the light sensor (2400) may obtain information about the intensity of external light (EL) based on the values ​​of voltage and current generated through the photovoltaic cells or the conductance of the photoresistor.

[0061] In one embodiment, the light sensor (2400) may include a camera or an image sensor of a camera capable of capturing an image by photographing the surroundings of the augmented reality device (2000). In one embodiment, the light sensor (2400) may capture an image of the surroundings of the augmented reality device (2000), extract information about pixel values ​​representing the brightness of a plurality of pixels constituting the captured image, and obtain information about the illuminance of external light (EL) based on the extracted information. However, the present invention is not necessarily limited to the above-described example, and the light sensor (2400) may obtain information about the illuminance of external light (EL) based on the amount of charge generated when the external light (EL) reaches the image sensor of the camera.

[0062] In one embodiment, the augmented reality device (2000) may include electronic components such as at least one processor (2800) and memory (2300), and the electronic components may be mounted on a PCB substrate, an FPCB substrate, or the like and positioned at one location of the frame (2010) or may be distributed at multiple locations. In one embodiment, the electronic components included in the augmented reality device (2000) may further include a communication interface, a camera, a user input unit, and the like, and specific details regarding the operation of the electronic components of the augmented reality device (2000) will be described again below with reference to FIG. 18.

[0063] In one embodiment, the augmented reality device (2000) may include at least one variable optical filter (110). In one embodiment, the at least one variable optical filter (110) may be positioned at at least one of a first position (P1_a) between the display module (2100) and the optical system (2000), a second position (P2_a) on the path of the external light (EL) before the external light (EL) is incident on the optical system (2200), a third position (P3_a) inside the optical system (2200), and a fourth position (P4_a) between the optical system (2200) and the user's eye. However, the present invention is not limited to the above-described example, and the at least one variable optical filter (110) may be positioned at a position through which at least one of the light (IL) of the virtual image and the external light (EL) may be transmitted.

[0064] In one embodiment, at least one variable optical filter (110) may be a component that is detachable from at least one of a first position (P1_a), a second position (P2_a), a third position (P3_a), and a fourth position (P4_a). In one embodiment, the at least one variable optical filter (110) and the augmented reality device (2000) may include at least one coupling means for attaching or detaching the at least one variable optical filter (110) to the augmented reality device (2000).

[0065] In one embodiment, the coupling means may be included in at least one variable optical filter (110) or may be included in a guide member used to attach at least one variable optical filter (110) to the augmented reality device (2000). For example, the coupling means may include a coupling groove and a corresponding coupling protrusion included in each of at least one variable optical filter (110) and the augmented reality device (2000), and the at least one variable optical filter (110) may be attached to or detached from the augmented reality device (2000) by the coupling groove and the coupling protrusion being coupled or detached from each other. As another example, the coupling means may include an object having a magnetic force and an object capable of responding to the magnetic force included in each of at least one variable optical filter (110) and the augmented reality device (2000), and the at least one variable optical filter (110) may be attached to or detached from the augmented reality device (2000) by the magnetic force. However, the type or structure of the coupling means is not necessarily limited to the above-described examples.

[0066] In one embodiment, when at least one variable optical filter (110) is coupled to the augmented reality device (2000) via a coupling means, electrodes of the at least one variable optical filter (110) and electronic components included in the augmented reality device (2000) (e.g., electrodes connected to the processor (2800)) may be electrically connected. In one embodiment, the at least one variable optical filter (110) attached to the augmented reality device (2000) may receive a signal from the processor (2800) via the connected electrode, and a transmission spectrum of the at least one variable optical filter (110) may be adjusted based on the received signal.

[0067] FIG. 3 is a plan view of a virtual reality device according to one embodiment of the present disclosure.

[0068] Referring to FIG. 3, a virtual reality device (3000) may include a frame (3010), a display (3100), an optical system (3200), a memory (3300), and at least one processor (3700). However, the present invention is not limited to the examples described above, and some components may be omitted or other components may be added.

[0069] The frame (3010) includes other components of the augmented reality device (3000) and is configured to allow a user to wear the virtual reality device (3010), and may include glasses temples, a nose bridge, and the like, but is not necessarily limited to the examples described above. In one embodiment, left-eye optical components and right-eye optical components may be arranged or attached to the left and right sides of the frame (3010), or the left-eye optical components and right-eye optical components may be integrally formed and mounted to the frame (3010). In another example, some of the optical components may be arranged or attached to only one of the left and right sides of the frame (3010).

[0070] The display (3100) is a component for displaying images and / or videos. Light (IL) of an image output from the display (3100) may be incident on the eyes of a user wearing the virtual reality device (3000). In one embodiment, the display (3100) may be configured as a physical device including at least one of a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode (OLED), a flexible display, a 3D display, and an electrophoretic display.

[0071] In one embodiment, the display (3100) may obtain image data constituting an image from at least one processor (3700) and output light corresponding to a plurality of pixels constituting the image based on the obtained image data. In one embodiment, light (IL) of the image output from the display (3100) may be projected onto the optical system (3200). In one embodiment, the display (3100) may include a left-eye display and a right-eye display, and each display may be arranged within a frame (3010), but is not necessarily limited thereto. In one embodiment, the left-eye display may output light of an image incident on the user's left eye, and the right-eye display may output light of an image incident on the user's right eye. Here, the light of the image incident on the user's left eye and the light of the image incident on the user's right eye may be different from each other. The user may feel a three-dimensional effect of the image based on the light of different images incident on each of the left and right eyes.

[0072] In one embodiment, the optical system (3200) may be a component that transmits light (IL) of an image to a user's eye. In one embodiment, the optical system (3200) may include at least one lens having a refractive power (degree) to focus or change the path of light (IL) of an image output from the display (3100). In one embodiment, the light (IL) of an image output from the display (3100) may pass through the optical system (3200) and enter the user's eye.

[0073] In an embodiment, the virtual reality device (3000) may include electronic components such as at least one processor (3700) and memory (3300), and the electronic components may be mounted on a PCB substrate, an FPCB substrate, or the like and positioned at one location of the frame (3010) or may be distributed and positioned at multiple locations. In one embodiment, the electronic components included in the virtual reality device (3000) may further include a communication interface camera and a user input unit, and specific details regarding the operation of the electronic components of the virtual reality device (3000) will be described again below with reference to FIG. 19.

[0074] In one embodiment, the virtual reality device (3000) may include at least one variable optical filter (110). In one embodiment, the at least one variable optical filter (110) may be positioned at at least one of a first position (P1_b) between the display (3100) and the optical system (3200), a second position (P2_b) within the optical system (3200), and a third position (P3_b) between the optical system (3200) and the user's eye. However, the present invention is not limited to the above-described example, and the at least one variable optical filter (110) may be positioned at a position through which light (IL) of an image may be transmitted.

[0075] In one embodiment, at least one variable optical filter (110) may be configured as one of a plurality of layers constituting the display (3100) or may be disposed between the plurality of layers of the display (3100). In one embodiment, the display (3100) may receive a signal controlling the at least one variable optical filter (110) from at least one processor (3700), and a transmission spectrum of the at least one variable optical filter (110) included in the display (3100) may be adjusted based on the received signal.

[0076] In one embodiment, at least one variable optical filter (110) may be a component that can be attached to at least one of a first position (P1_b), a second position (P2_b), and a third position (P3_b). In one embodiment, at least one variable optical filter (110) and the virtual reality device (3000) may include at least one coupling means for attaching and detaching the at least one variable optical filter (110) to the virtual reality device (3000). Since the specific details of the coupling means have been described in FIG. 2, a redundant description will be omitted.

[0077] FIG. 4 is a drawing for explaining the structure of a variable optical filter according to one embodiment of the present disclosure.

[0078] In one embodiment, at least one variable optical filter (110) is configured to adjust the wavelength-specific transmittance of transmitted light in response to a supply voltage or supply current input from the head mounted display device (100).

[0079] Referring to FIG. 4, at least one variable optical filter (110) may be a liquid crystal tunable filter (LCTF) including a first polarizer (111), a liquid crystal cell (112), a quartz plate (113), a second polarizer (114), and an electrode (115). However, the present invention is not limited to the above-described examples, and some components may be omitted or other components may be added. In addition, the at least one variable optical filter (110) may include one of various types of known variable optical filters, including a holographically-formed, polymer dispersed liquid crystal (H-PDLC) and an acousto-optical tunable filter (AOTF).

[0080] In one embodiment, the first polarizing plate (111) and the second polarizing plate (114) are components that can control the polarization state of light passing through at least one variable optical filter (110). Light incident on at least one variable optical filter (110) has its polarization state changed by the first polarizing plate (111) before being incident on the liquid crystal cell (112), and light that has passed through the liquid crystal cell (112) can have its polarization state changed by the second polarizing plate (114) before reaching the user's eyes.

[0081] The liquid crystal cell (112) is a configuration that can selectively control the transmittance of light according to the wavelength of the transmitted light. In one embodiment, the liquid crystal cell (112) may include a liquid crystal material whose molecule arrangement direction changes based on a surrounding electric field and at least one indium tin oxide (ITO) layer. In one embodiment, the at least one ITO layer may include a transparent conductor that can transmit light and may generate an electric field applied to the liquid crystal material based on a current or voltage applied to the liquid crystal cell (112). In one embodiment, the arrangement direction of the molecules of the liquid crystal material is changed based on the electric field generated in the at least one ITO layer, so that light of a specific wavelength transmitted through the liquid crystal cell (112) may be blocked or allowed to pass.

[0082] In one embodiment, the quartz plate (113) may be a component that supports components of at least one variable optical filter (110) and stably maintains a path for transmitted light. In one embodiment, the quartz plate (113) may include a material that is stable against temperature changes, thereby enabling at least one variable optical filter (110) to operate stably under various temperature conditions.

[0083] In one embodiment, the electrode (115) may be a component for providing a supply voltage or supply current input from the head mounted display device (100) to the liquid crystal cell (112). In one embodiment, the electrode (115) may be implemented as a transparent electrode, and it will be readily understood by those skilled in the art that the position and number of the electrodes (115) may be changed in accordance with the performance or structure of the head mounted display device (100).

[0084] In one embodiment, the transmission spectrum characteristics that the at least one variable optical filter (110) can form can be determined based on the structure or characteristics of at least one of the first polarizing plate (111), the liquid crystal cell (112), the quartz plate (113), and the second polarizing plate (114). For example, the at least one variable optical filter (110) can include at least one of a characteristic of blocking light of a preset wavelength band, a characteristic of a notch filter, a characteristic of a notch ND filter, and a characteristic of an ND filter, based on the structure or characteristics of at least one of the first polarizing plate (111), the liquid crystal cell (112), the quartz plate (113), and the second polarizing plate (114), but is not necessarily limited to the above-described examples. In one embodiment, at least one variable optical filter (110) may have a transmittance spectrum that the at least one variable optical filter (110) can form, depending on the type of the variable optical filter (110).

[0085] In one embodiment, at least one variable optical filter (110) may have a transmission spectrum that includes characteristics of a transmission spectrum of at least one variable optical filter (110) that can be adjusted based on a supply voltage or supply current input from a head mounted display device (100), and details thereof will be described below with reference to FIGS. 7 to 10.

[0086] FIG. 5 is a flowchart illustrating the operation of a head mounted display device according to one embodiment of the present disclosure. The operations of the head mounted display device (100) described in FIG. 5 may refer to the operation of a virtual reality device (2000) including at least one variable optical filter (110), or may refer to the operation of a virtual reality device (3000) including at least one variable optical filter (110), but are not necessarily limited thereto.

[0087] In step S510, the head mounted display device (100) may obtain a target transmission spectrum (120) including information on transmittance for each preset wavelength. In one embodiment, the target transmission spectrum (120) may be input through a user input unit or received from an external electronic device and stored in the head mounted display device (100). In one embodiment, the target transmission spectrum may include information on transmittance for each of a plurality of wavelengths spaced at a predetermined interval in a preset wavelength band. For example, the target transmission spectrum (120) may be obtained in the following data format.

[0088] Wavelength (nm) 515… 530… 645… 775… 905… 1035 Transmittance (%) 0… 10… 20… 40… 15… 0

[0089] That is, the target transmission spectrum (120) may be a discrete data format that is information on the transmittance for each of a plurality of wavelengths spaced at intervals of 5 nm in a wavelength band of 515 nm or more and 1035 nm or less. However, it is not necessarily limited to the above-described example. In step S520, the head mounted display device (100) may control at least one variable optical filter (110) so that the adjusted transmission spectrum (130) formed by the at least one variable optical filter (110) corresponds to the wavelength-specific transmittance of the target transmission spectrum (120). In one embodiment, the head mounted display device (100) may control at least one variable optical filter (110) so that the characteristics of the transmission spectrum of the at least one variable optical filter (110) correspond to the characteristics of the target transmission spectrum (120). Accordingly, the adjustable transmission spectrum (130) formed by at least one variable optical filter (110) includes the characteristics of the target transmission spectrum (120), thereby being able to correspond to the wavelength-specific transmittance of the target transmission spectrum (120).

[0090] FIG. 6 is a flowchart illustrating a method for controlling at least one variable optical filter in a head-mounted display device according to one embodiment of the present disclosure. Steps S610 to S640 of FIG. 6 may be included in step S520 of FIG. 5, but are not necessarily limited thereto.

[0091] In step S610, the head mounted display device (100) may identify a transmission band of the target transmission spectrum (120) based on the target transmission spectrum (120). In one embodiment, the transmission band may mean a continuous wavelength band including wavelengths having a transmittance that is not 0 or a transmittance that is greater than or equal to a threshold value, but is not necessarily limited thereto.

[0092] In step S620, the head mounted display device (100) can control at least one variable optical filter (110) so that the adjusted transmission spectrum (130) forms a transmission band. In one embodiment, the at least one variable optical filter (110) can include a first variable optical filter including a characteristic of blocking light of a preset wavelength band. For example, the transmission spectrum of the first variable optical filter can include a spectral characteristic of blocking transmission of light of a wavelength band higher than or lower than a specific wavelength, or can be a variable optical filter including a spectral characteristic of transmitting only light of a specific wavelength band and blocking transmission of light of the remaining wavelength bands, but is not necessarily limited to the above-described examples.

[0093] In one embodiment, the head mounted display device (100) can control the first variable optical filter so that the adjusted transmission spectrum (130) forms a transmission band. In other words, the head mounted display device (100) can control the first variable optical filter so that the transmission band of the transmission spectrum formed by the first variable optical filter corresponds to the transmission band of the target transmission spectrum (120). Accordingly, the adjusted transmission spectrum (130) formed by the first variable optical filter or a variable optical filter other than the first variable optical filter can form a transmission band of the target transmission spectrum (120).

[0094] In one embodiment, the head-mounted display device (100) can identify whether the target transmission spectrum (120) includes a preset spectral characteristic. The preset spectral characteristic may refer to a spectral characteristic determined based on a rate of change in transmittance of a preset wavelength band. In one embodiment, at least one variable optical filter (110) may include a characteristic corresponding to each of the preset spectral characteristics.

[0095] In one embodiment, the rate of change in transmittance of the preset wavelength band may include at least one of the difference between the transmittance of a specific wavelength among a plurality of wavelengths of the target transmittance spectrum (120) and the transmittance of the wavelength closest to the specific wavelength (hereinafter, instantaneous rate of change) and the difference between the transmittance of the minimum wavelength and the transmittance of the maximum wavelength in the preset wavelength band (hereinafter, average rate of change). For example, when the target transmittance spectrum (120) includes a transmittance band of 515 nm to 1035 nm, and a plurality of wavelengths within the transmittance band are spaced apart by 5 nm, the rate of change in transmittance of the transmittance of the transmittance of the transmittance band may refer to the differences between the transmittance of the plurality of wavelengths within the transmittance band and the transmittance of a wavelength that is 5 nm longer or shorter than each of the plurality of wavelengths, and the average rate of change in transmittance of the transmittance of the transmittance band may refer to the difference between the transmittance of the 515 nm wavelength and the transmittance of the 1035 nm wavelength. However, it is not necessarily limited to the above-described examples, and the change in transmittance may also mean the difference between the transmittance of a specific wavelength and the transmittance of a wavelength that is a predetermined distance away from the specific wavelength.

[0096] At step S640, if the head mounted display device (100) identifies that the target transmission spectrum (120) includes preset spectral characteristics (S630-Y), it can control at least one variable optical filter (110) so that the adjusted transmission spectrum (130) includes the preset spectral characteristics.

[0097] In one embodiment, at least one variable optical filter (110) may include a second variable optical filter having the characteristics of a notch filter. In one embodiment, the notch filter may be a variable optical filter having a spectral characteristic that selectively blocks only specific wavelengths, but is not necessarily limited to the examples described above.

[0098] In one embodiment, the head mounted display device (100) can identify, based on the target transmission spectrum (120), whether the target transmission spectrum (120) includes a first spectral characteristic in which a rate of change in transmittance within the transmission band is greater than or equal to a first threshold value from each of the minimum wavelength and the maximum wavelength of the transmission band to a first length.

[0099] In one embodiment, the head mounted display device (100) can control the second variable optical filter so that the adjusted transmission spectrum (130) includes the first spectral characteristic. In other words, the head mounted display device (100) can control the second variable optical filter so that the characteristics of the transmission spectrum formed by the second variable optical filter correspond to the first spectral characteristic of the target transmission spectrum (120). Accordingly, the adjusted transmission spectrum (130) formed by the first variable optical filter or the second variable optical filter and a different variable optical filter can include the first spectral characteristic of the target transmission spectrum (120).

[0100] In one embodiment, at least one variable optical filter (110) may include a third variable optical filter having the characteristics of a notch ND filter. In one embodiment, the notch ND filter may be a variable optical filter having spectral characteristics that selectively reduce the transmittance of only certain wavelengths, but is not necessarily limited to the examples described above.

[0101] In one embodiment, the head mounted display device (100) can identify whether the second spectral characteristic includes a second threshold value or greater in a transmittance change rate within a transmission band that is outside a second wavelength band of a length from the center of the transmission band.

[0102] In one embodiment, the head mounted display device (100) can control the third variable optical filter so that the adjusted transmission spectrum (130) includes the second spectral characteristic. In other words, the head mounted display device (100) can control the third variable optical filter so that the characteristics of the transmission spectrum formed by the third variable optical filter correspond to the second spectral characteristics of the target transmission spectrum (120). Accordingly, the adjusted transmission spectrum (130) formed by the third variable optical filter or a variable optical filter different from the third variable optical filter can include the second spectral characteristic of the target transmission spectrum (120).

[0103] In one embodiment, at least one variable optical filter (110) may include a fourth variable optical filter having characteristics of an ND filter. In one embodiment, the ND filter may be a variable optical filter having spectral characteristics that reduce transmittance across the entire wavelength band, but is not necessarily limited to the examples described above.

[0104] In one embodiment, the head mounted display device (100) can identify whether the target transmission spectrum includes a third spectral characteristic in which the transmission band is at least a third length within the transmission band, the transmittance differs by at least a third threshold value from the maximum transmittance of the target transmission spectrum, and the transmittance change rate is at most a fourth threshold value.

[0105] In one embodiment, the head mounted display device (100) can control the fourth variable optical filter so that the adjusted transmission spectrum includes the third spectral characteristic. In other words, the head mounted display device (100) can control the fourth variable optical filter so that the characteristics of the transmission spectrum formed by the fourth variable optical filter correspond to the third spectral characteristic of the target transmission spectrum (120). Accordingly, the adjusted transmission spectrum (130) formed by the fourth variable optical filter or a variable optical filter other than the fourth variable optical filter can include the third spectral characteristic of the target transmission spectrum (120).

[0106] In this way, a head mounted display device (100) according to one embodiment of the present disclosure can implement an adjusted transmission spectrum (130) corresponding to various types of target transmission spectra (120) by using a limited number of at least one variable optical filter (110).

[0107] FIGS. 7A and 7B are drawings for explaining a method for controlling a first variable optical filter in a head-mounted display device according to one embodiment of the present disclosure.

[0108] Referring to FIG. 7A, the head mounted display device (100) can identify a transmission band of the target transmission spectrum (700) based on the target transmission spectrum (700) and obtain information (720) about the transmission band of the identified target transmission spectrum. The target transmission spectrum (700) illustrated in FIGS. 7A, 8A, 9A, and 10 is merely an example of the target transmission spectrum (120) of FIG. 1 and is not necessarily limited thereto.

[0109] In one embodiment, the head mounted display device (100) can identify a continuous wavelength band including wavelengths whose transmittance is not 0 or whose transmittance is greater than or equal to a threshold value in the target transmittance spectrum (700) as a transmittance band (710). For example, the head mounted display device (100) can identify a wavelength band from 615 nm to 1035 nm, which is a continuous wavelength band in which the transmittance for each wavelength is not 0 in the target transmittance spectrum (700), as a transmittance band of the target transmittance spectrum (700), and is not necessarily limited to the above-described example.

[0110] In one embodiment, the information (720) about the transmission band of the transmission spectrum may include information about a wavelength band identified as the transmission band (710) in the target transmission spectrum (700). For example, the information (720) about the transmission band may include information that the identified transmission band (710) is from 615 nm to 1035 nm. However, the present invention is not necessarily limited to the above-described example, and the information (720) about the transmission band may further include various information used to specify the identified transmission band (710), such as the transmittance of each of a plurality of wavelengths within the transmission band (710), the instantaneous rate of change of the transmittance, and the average rate of change, or to control the first variable optical filter (110-1).

[0111] Referring to FIG. 7B, the head mounted display device (100) can adjust the transmission spectrum of the first variable optical filter (110-1) by controlling the first variable optical filter (110-1) based on information (720) about the transmission band. In one embodiment, the head mounted display device (100) can control the first variable optical filter (110-1) so that the transmission band of the transmission spectrum of the first variable optical filter (110-1) corresponds to the transmission band of the target transmission spectrum (700). Accordingly, the adjusted transmission spectrum (130) formed by the first variable optical filter (110-1) or at least one variable optical filter other than the first variable optical filter (110-1) can form the transmission band of the target transmission spectrum (700).

[0112] In one embodiment, the first variable optical filter (110-1) can adjust the transmission band of the transmission spectrum of the first variable optical filter (110-1) by changing at least one of the length of the transmission band and the center wavelength of the transmission band based on the supplied current or voltage. In one embodiment, the head mounted display device (100) can control the first variable optical filter (110-1) so that the transmission band of the transmission spectrum of the first variable optical filter (110-1) is included in the transmission band of the target transmission spectrum (700).

[0113] For example, the head mounted display device (100) can control the first variable optical filter (110-1) so that the transmission spectrum of the first variable optical filter (110-1) changes from the transmission spectrum before adjustment (730) to the transmission spectrum after adjustment (740) based on information (720) about the transmission band that the transmission band of the target transmission spectrum (700) is from 615 nm to 1035 nm. In this case, the transmission spectrum before adjustment (730) may include spectral characteristics that form a transmission band from 325 nm to 905 nm, and the transmission spectrum after adjustment (740) may include spectral characteristics that form a transmission band from 615 nm to 1035 nm, but is not necessarily limited to the above-described example.

[0114] In one embodiment, the transmission band of the transmission spectrum of the first variable optical filter (110-1) can be adjusted within a preset range of wavelength bands. In one embodiment, when the transmission band of the target transmission spectrum (700) is included within the preset range of wavelength bands within which the transmission band can be adjusted, the head mounted display device (100) can control the first variable optical filter (110-1) so that the transmission band of the transmission spectrum of the first variable optical filter (110-1) becomes the same as the transmission band of the target transmission spectrum (700). In one embodiment, when the transmission band of the target transmission spectrum (700) is not included within the preset range of wavelength bands within which the transmission band can be adjusted, the first variable optical filter (110-1) can be controlled so that the length of the wavelength band where the transmission band of the transmission spectrum of the first variable optical filter (110-1) and the transmission band of the target transmission spectrum (700) overlap becomes the longest.

[0115] FIGS. 8A and 8B are drawings for explaining a method for controlling a second variable optical filter in a head-mounted display device according to one embodiment of the present disclosure.

[0116] Referring to FIG. 8A, the head mounted display device (100) can identify whether the target transmission spectrum (700) includes a first spectral characteristic based on the target transmission spectrum (700), and obtain information about the identified first spectral characteristic.

[0117] In one embodiment, the head mounted display device (100) can identify whether a target transmission spectrum (700) includes a first spectral characteristic in which a rate of change in transmittance within a transmission band is greater than or equal to a first threshold value from each of the minimum wavelength and maximum wavelength of the transmission band to a first length, and obtain information (820) about the identified first spectral characteristic.

[0118] For example, it is assumed that the first length is 100 nm and the first threshold is 10%. In this case, the head mounted display device (100) can identify a case in which the transmittance change rate is 10% or more within the first partial transmittance band (810-1) among the first partial transmittance band (810-1) from the minimum wavelength of the transmittance band 515 nm to 100 nm and the second partial transmittance band (810-2) from the maximum wavelength of the transmittance band 1035 nm to 100 nm in the target transmittance spectrum (700). Here, the transmittance change rate of 10% or more may mean that the first partial transmittance band (810-1) includes a wavelength at which the instantaneous transmittance change rate is 10% or more, or that the average transmittance change rate of the first partial transmittance band (810-1) is 10% or more, and is not necessarily limited to the above-described example. If it is identified that the transmittance change rate is 10% or more within the first partial transmittance band (810-1), the head mounted display device (100) can identify that the target transmittance spectrum (700) includes the first spectral characteristic.

[0119] In one embodiment, the information about the first spectral characteristic (820) may include information about a transmission band identified as including the first spectral characteristic in the target transmission spectrum (700). For example, the information about the first spectral characteristic (820) may include information that the first spectral characteristic is identified within a first partial transmission band (810-1) from 515 nm to 615 nm. However, the information about the first spectral characteristic (820) is not necessarily limited to the above-described example, and the information about the first spectral characteristic (820) may further include various information used to specify the first spectral characteristic or to control the second variable optical filter (110-2), such as transmittance, instantaneous rate of change of transmittance, and average rate of change of each of a plurality of wavelengths in the first partial transmission band (810-1).

[0120] Referring to FIG. 8B, the head mounted display device (100) can adjust the transmission spectrum of the second variable optical filter (110-2) by controlling the second variable optical filter (110-2) based on information (820) about the first spectrum characteristic. In one embodiment, the head mounted display device (100) can control the second variable optical filter (110-2) so that the characteristics of the transmission spectrum of the second variable optical filter (110-2) correspond to the first spectral characteristics of the target transmission spectrum (700). Accordingly, the adjusted transmission spectrum (130) formed by the second variable optical filter (110-2) or at least one variable optical filter different from the second variable optical filter (110-2) can include the first spectral characteristics of the target transmission spectrum (700).

[0121] In one embodiment, the second variable optical filter (110-2) can adjust the transmission spectrum of the second variable optical filter (110-2) by changing the wavelength to be blocked based on the supplied current or voltage. In one embodiment, the head mounted display device (100) can control the second variable optical filter (110-2) so that the wavelength to be blocked of the transmission spectrum of the second variable optical filter (110-2) is included in a transmission band identified as including the first spectral characteristic of the target transmission spectrum (700).

[0122] For example, the head mounted display device (100) may control the second variable optical filter (110-2) to change the transmission spectrum of the second variable optical filter (110-2) from the pre-adjustment transmission spectrum (830) to the post-adjustment transmission spectrum (840) based on the information (820) about the first spectral characteristic that the first spectral characteristic is identified within the first partial transmission band (810-1) from 515 nm to 615 nm of the target transmission spectrum (700). In this case, the pre-adjustment transmission spectrum (830) may include a spectral characteristic that blocks transmission of light having a wavelength of 650 nm, and the post-adjustment transmission spectrum (840) may include a spectral characteristic that blocks transmission of light having a wavelength of 515 nm, but is not necessarily limited to the above-described example.

[0123] In one embodiment, a wavelength blocked in the transmission spectrum of the second variable optical filter (110-2) can be adjusted within a preset range of wavelength bands. In one embodiment, the head mounted display device (100) can control the second variable optical filter (110-2) so that the wavelength blocked in the transmission spectrum of the second variable optical filter (110-2) is included in the transmission band of the transmission spectrum (700) in which the first spectral characteristic is identified, when the transmission band of the target transmission spectrum (700) in which the first spectral characteristic is identified is included within the preset range of wavelength bands in which the wavelength blocked can be adjusted. In one embodiment, the head mounted display device (100) may control the second variable optical filter (110-2) so that the wavelength being blocked of the transmission spectrum of the second variable optical filter (110-2) becomes closest to the transmission band of the target transmission spectrum (700) with the first spectral characteristic identified, when the transmission band of the target transmission spectrum (700) with the first spectral characteristic identified is not included within a preset range of wavelength bands within which the wavelength being blocked can be adjusted.

[0124] FIGS. 9A and 9B are drawings for explaining a method for controlling a third variable optical filter in a head-mounted display device according to one embodiment of the present disclosure.

[0125] Referring to FIG. 9A, the head mounted display device (100) can identify whether the target transmission spectrum (700) includes a second spectral characteristic in which a rate of change in transmittance is greater than or equal to a second threshold value within a transmission band that deviates from a second length wavelength band from the center of the transmission band based on the target transmission spectrum (700), and can obtain information (920) about the identified second spectral characteristic.

[0126] For example, it is assumed that the second length is 100 nm and the second threshold value is 7%. In this case, the head mounted display device (100) has a center wavelength of 775 nm, which is the center of the transmission band of the target transmission spectrum (700). ) out of the second length 100 nm wavelength band, the first partial transmission band (910-1) from 515 nm to 675 nm and the second partial transmission band (910-2) from 875 nm to 1035 nm can be identified as having a transmittance change rate of 7% or more within the first partial transmission band (910-1). Here, the transmittance change rate of 7% or more within the first partial transmission band (910-1) may mean that the first partial transmission band (910-1) includes a wavelength at which the instantaneous transmittance change rate is 7% or more, or that the average change rate of the first partial transmission band (910-1) is 7% or more, and is not necessarily limited to the above-described example. If it is identified that the transmittance change rate is 7% or more within the first partial transmittance band (910-1), the head mounted display device (100) can identify that the target transmittance spectrum (700) includes the second spectral characteristic.

[0127] In one embodiment, the information about the second spectral characteristic (920) may include information about a transmission band identified as including the second spectral characteristic in the target transmission spectrum (700). For example, the information about the second spectral characteristic (920) may include information that the second spectral characteristic is identified within a first partial transmission band (910-1) from 515 nm to 675 nm. However, the present invention is not necessarily limited to the above-described example, and the information about the second spectral characteristic (920) may further include various information used to specify the second spectral characteristic or to control the third variable optical filter (110-3), such as the transmittance, the instantaneous rate of change in the transmittance, and the average rate of change of each of the plurality of wavelengths in the first partial transmission band (910-1).

[0128] Referring to FIG. 9B, the head mounted display device (100) can adjust the transmission spectrum of the third variable optical filter (110-3) by controlling the third variable optical filter (110-3) based on information (920) about the second spectrum characteristic. In one embodiment, the head mounted display device (100) can control the third variable optical filter (110-3) so that the characteristics of the transmission spectrum of the third variable optical filter (110-3) correspond to the second spectral characteristics of the target transmission spectrum (700). Accordingly, the adjusted transmission spectrum (130) formed by the third variable optical filter (110-3) or at least one variable optical filter different from the third variable optical filter (110-3) can include the second spectral characteristics of the target transmission spectrum (700).

[0129] In one embodiment, the third variable optical filter (110-3) may be configured to adjust the transmission spectrum of the third variable optical filter (110-3) by changing at least one of the wavelength at which the transmittance is reduced and the transmittance based on the supplied current or voltage. In one embodiment, the head mounted display device (100) may control the third variable optical filter (110-3) such that the wavelength at which the transmittance is reduced in the transmission spectrum of the third variable optical filter (110-3) is included in a transmission band identified as including the second spectral characteristic in the target transmission spectrum (700). In one embodiment, the head mounted display device (100) may control the third variable optical filter (110-3) such that the transmittance of the wavelength at which the transmittance is reduced in the transmission spectrum of the third variable optical filter (110-3) corresponds to the transmittance of the transmission band identified as including the second spectral characteristic in the target transmission spectrum (700). In other words, the head mounted display device (100) can control the third variable optical filter (110-3) so that the wavelength with the lowest transmittance in the transmission band identified as including the second spectral characteristic in the target transmittance spectrum (700) and the transmittance of that wavelength are included in the adjusted transmittance spectrum (130).

[0130] For example, the head mounted display device (100) may control the third variable optical filter (110-3) to change the transmission spectrum of the third variable optical filter (110-3) from the pre-adjustment transmission spectrum (930) to the post-adjustment transmission spectrum (940) based on information (920) about the second spectral characteristic that the second spectral characteristic is identified within the first partial transmission band (910-1) from 515 nm to 675 nm of the target transmission spectrum (700). In this case, the pre-adjustment transmission spectrum (940-1) may include a spectral characteristic in which the transmittance of light having a wavelength of 665 nm is 35%, and the post-adjustment transmission spectrum (940-2) may include a spectral characteristic in which the transmittance of light having a wavelength of 645 nm is 35%, but is not necessarily limited to the above-described example.

[0131] In one embodiment, the wavelength at which the transmittance is reduced in the transmission spectrum of the third variable optical filter (110-3) can be adjusted within a preset range of wavelength bands. In one embodiment, the head mounted display device (100) can control the third variable optical filter (110-3) so that the reduced wavelength of the transmission spectrum of the third variable optical filter (110-3) is included in the transmission band of the transmission spectrum (700) at which the second spectral characteristic is identified, when the transmission band of the target transmission spectrum (700) at which the second spectral characteristic is identified is included within the preset range of wavelength bands at which the reduced wavelength can be adjusted. In one embodiment, the head mounted display device (100) may control the third variable optical filter (110-3) so that the reduced wavelength of the transmission spectrum of the third variable optical filter (110-3) becomes closest to the transmission band of the target transmission spectrum (700) with the second spectral characteristic identified, when the transmission band of the target transmission spectrum (700) with the second spectral characteristic identified is not included within a preset range of wavelength bands within which the reduced wavelength can be adjusted.

[0132] FIGS. 10A and 10B are drawings for explaining a method for controlling a fourth variable optical filter in a head-mounted display device according to one embodiment of the present disclosure.

[0133] Referring to FIG. 10A, the head mounted display device (100) can identify, based on the target transmission spectrum (700), whether the target transmission spectrum (700) includes a third spectral characteristic in which the transmission band is a third length or longer within the transmission band, the transmittance is different from the maximum transmittance of the target transmission spectrum by a third threshold value or more, and the transmittance change rate is a fourth threshold value or less, and can obtain information (1020) about the identified third spectral characteristic.

[0134] For example, it is assumed that the third length is 100 nm or more, the third threshold value is 15%, and the fourth threshold value is 10%. In this case, the head mounted display device (100) can identify that the partial transmission band (1010) from 580 nm to 700 nm of the target transmission spectrum (700) has a length of 100 nm or more, a transmittance that is 15% or more different from the maximum transmittance of 45% of the target transmission spectrum, and a transmittance change rate is 10% or less. Here, the transmittance change rate of the partial transmission band (1010) being 10% or less may mean that the partial transmission band (1010) does not include a wavelength whose instantaneous transmittance change rate is 10% or more, or that the average change rate of the partial transmission band (1010) is 10% or less, and is not necessarily limited to the above-described example. When it is identified that the partial transmission band (1010) has a length of 100 nm or more, the transmittance is 15% or more different from the maximum transmittance of the target transmission spectrum of 45%, and the transmittance change rate is 10% or less, the head mounted display device (100) can identify that the target transmission spectrum (700) includes the third spectral characteristic.

[0135] In one embodiment, the information about the third spectral characteristic (930) may include information about a transmission band identified as including the third spectral characteristic in the target transmission spectrum (700). For example, the information about the third spectral characteristic (1020) may include information that the third spectral characteristic is identified in a partial transmission band (1010) from 580 nm to 700 nm. However, the present invention is not necessarily limited to the above-described example, and the information about the third spectral characteristic (1020) may further include various information used to specify the third spectral characteristic or to control the fourth variable optical filter (110-4), such as the transmittance, the instantaneous rate of change of the transmittance, and the average rate of change of each of a plurality of wavelengths in the partial transmission band (1010).

[0136] Referring to FIG. 10B, the head mounted display device (100) can adjust the transmission spectrum of the fourth variable optical filter (110-4) by controlling the fourth variable optical filter (110-4) based on information (1020) about the third spectral characteristic. In one embodiment, the head mounted display device (100) can control the fourth variable optical filter (110-4) so ​​that the characteristics of the transmission spectrum of the fourth variable optical filter (110-4) correspond to the third spectral characteristic of the target transmission spectrum (700). Accordingly, the adjusted transmission spectrum (130) formed by the fourth variable optical filter (110-4) or at least one variable optical filter other than the third variable optical filter (110-4) can include the third spectral characteristic of the target transmission spectrum (700).

[0137] In one embodiment, the fourth variable optical filter (110-4) can have a transmittance spectrum of the fourth variable optical filter (110-4) adjusted by changing the decreasing transmittance of the entire wavelength based on the supplied current or voltage. In one embodiment, the head mounted display device (100) can control the fourth variable optical filter (110-4) so ​​that the transmittance of the entire wavelength in the transmittance spectrum of the fourth variable optical filter (110-4) corresponds to the transmittance of a transmittance band identified as including the third spectral characteristic in the target transmittance spectrum (700). In other words, the head mounted display device (100) can control the fourth variable optical filter (110-4) so ​​that the maximum transmittance and the change rate of the transmittance of the transmittance band identified as including the third spectral characteristic in the target transmittance spectrum (700) are included in the adjusted transmittance spectrum (130).

[0138] For example, the head mounted display device (100) may control the fourth variable optical filter (110-4) to change the transmission spectrum of the fourth variable optical filter (110-4) from the transmission spectrum before adjustment (1030) to the transmission spectrum after adjustment (1040) based on information (1020) about the third spectral characteristic that the third spectral characteristic is identified within a partial transmission band (1010) from 580 nm to 700 nm of the target transmission spectrum (700). In this case, the transmission spectrum before adjustment (1040-1) may include a spectral characteristic having a transmittance of 55% of the entire wavelength, and the transmission spectrum after adjustment (1040-2) may include a spectral characteristic having a transmittance of 30% of the entire wavelength, but is not necessarily limited to the above-described example.

[0139] In one embodiment, the head mounted display device (100) can control the fourth variable optical filter (110-4) based on the transmittance of the target transmittance spectrum (700). In one embodiment, the head mounted display device (100) can control the fourth variable optical filter (110-4) so ​​that the average of the transmittances of the plurality of wavelengths of the adjusted transmittance spectrum (130) is less than or equal to the average of the transmittances of each of the plurality of wavelengths of the target transmittance spectrum (700). In one embodiment, the head mounted display device (100) can control the fourth variable optical filter (110-4) so ​​that the maximum transmittance of the adjusted transmittance spectrum (130) is less than or equal to the maximum transmittance of the target transmittance spectrum (700).

[0140] FIG. 11 is a diagram for explaining an adjusted transmission spectrum formed by overlapping a plurality of transmission spectra according to one embodiment of the present disclosure. The adjusted transmission spectrum (1150) of FIG. 11 is an example of the adjusted transmission spectrum (130) of FIG. 1, and may be a transmission spectrum corresponding to the wavelength-specific transmittance of the target transmission spectrum (700) of FIGS. 7 to 10. In addition, since the description of the method for controlling the first to fourth variable optical filters (110-1 to 110-4) has been described in FIGS. 7 to 10, the description of the overlapping content will be omitted.

[0141] Referring to FIG. 11, a transmission spectrum (1110) of a first variable optical filter, a transmission spectrum (1120) of a second variable optical filter, a transmission spectrum (1130) of a third variable optical filter, and a transmission spectrum (1140) of a fourth variable optical filter may be overlapped to form an adjusted transmission spectrum (1150).

[0142] As shown in Mathematical Expression 1 below, when the transmission spectra of different variable optical filters overlap, the wavelength-specific transmittance of each transmission spectrum can be multiplied to determine the wavelength-specific transmittance of the overlapped transmission spectrum.

[0143] [Mathematical Formula 1]

[0144] T_combined(λ) = T1(λ) * T2(λ)

[0145] Here, T1(λ) and T2(λ) are the transmission spectra of different variable optical filters, respectively, and T_combined(λ) is the transmission spectrum formed by overlapping the transmission spectra of different variable optical filters.

[0146] In one embodiment, light that transmits all of the first to fourth variable optical filters (110-1 to 110-4) may have its intensity of light reduced for each wavelength according to an adjusted transmission spectrum (1150). In one embodiment, light that transmits only some of the first to fourth variable optical filters (110-1 to 110-4) may have its intensity of light reduced for each wavelength by an adjusted transmission spectrum formed by overlapping the transmission spectra of the variable optical filters through which the light is transmitted.

[0147] In one embodiment, the adjusted transmission spectrum formed by overlapping the transmission spectra of the light-transmitting variable optical filters differs from the adjusted transmission spectrum (1150) in that it may not include the spectral characteristics of the transmission spectra of the non-transmitting variable optical filters. However, since it includes the spectral characteristics of the transmission spectra of the remaining light-transmitting variable optical filters, an eye-protecting effect based on a reduction in the intensity of light by wavelength that can be expected from the target transmission spectrum (120) can still be expected.

[0148] Referring to FIG. 2, when the head mounted display device (100) is an augmented reality device (2000), light (IL) of a virtual image and external light (EL) may be transmitted through at least one variable optical filter (110) and then incident on the user's eyes. In one embodiment, the variable optical filter through which the light (IL) of the virtual image is transmitted and the variable optical filter through which the external light (EL) is transmitted may be determined depending on where the at least one variable optical filter (110) is positioned in the augmented reality device (2000).

[0149] In one embodiment, the adjusted transmission spectrum (130) may include at least one of a first transmission spectrum formed by a variable optical filter through which light (IL) of a virtual image is transmitted among at least one variable optical filter (110) and a second transmission spectrum formed by external light (EL). For example, the first transmission spectrum may be a transmission spectrum formed by a variable optical filter disposed at at least one of a first position (P1_a), a third position (P3_a), and a fourth position (P4_a), and the second transmission spectrum may be a transmission spectrum formed by a variable optical filter disposed at at least one of a second position (P2_a), a third position (P3_a), and a fourth position (P4_a), but is not necessarily limited to the above-described examples.

[0150] In one embodiment, the priority of at least one variable optical filter (110) may be preset based on the spectral characteristics included in the at least one variable optical filter (110). For example, among the at least one variable optical filter (110), a first variable optical filter (110-1) including a characteristic of blocking light of a preset wavelength band and a fourth variable optical filter (110-4) including a characteristic of an ND filter may have a higher priority than a second variable optical filter (110-2) including a characteristic of a notch filter and a third variable optical filter (110-3) including a characteristic of a notch ND filter, but is not necessarily limited to the above-described example.

[0151] In one embodiment, the position at which at least one variable optical filter (110) is placed on the augmented reality device (2000) may be determined based on the priority of each of at least one variable optical filter (110). In one embodiment, at least one variable optical filter (110) may be placed at a position where both light (IL) of a virtual image and external light (EL) are transmitted, as a variable optical filter having a higher priority is placed, and at a position at which only one of light (IL) of a virtual image and external light (EL) is transmitted, as a variable optical filter having a lower priority is placed. For example, the first variable optical filter (110-1) and the fourth variable optical filter (110-4) may be positioned at at least one of the third position (P3_a) and the fourth position (P4_a), and the second variable optical filter (110-3) and the third variable optical filter (110-4) may be positioned at at least one of the first position (P1_a) and the second position (P2_a), but are not necessarily limited to the examples described above.

[0152] In one embodiment, when at least one variable optical filter (110) includes a plurality of spectral characteristics, the head mounted display device (100) can determine the spectral characteristics implemented by the at least one variable optical filter (110) based on the position at which the at least one variable optical filter (110) is arranged, and control the at least one variable optical filter (110) so that the adjusted transmission spectrum (130) includes the determined spectral characteristics.

[0153] In one embodiment, the head mounted display device (100) may determine that at least one variable optical filter (110) positioned at a position through which both the light (IL) of the virtual image and the external light (EL) are transmitted implements the spectral characteristics of the variable optical filter having a high priority, and at least one variable optical filter (110) positioned at a position through which only one of the light (IL) of the virtual image and the external light (EL) is transmitted implements the spectral characteristics of the variable optical filter having a low priority. For example, at least one variable optical filter (110) disposed at at least one of the second position (P2_a) and the third position (P3_a) may be determined to implement at least one of the spectral characteristics of the first variable optical filter (110-1) and the fourth variable optical filter (110-4), and at least one variable optical filter (110) disposed at at least one of the first position (P1_a) and the fourth position (P4_a) may be determined to implement at least one of the spectral characteristics of the second variable optical filter (110-2) and the third variable optical filter (110-3), but is not necessarily limited to the above-described examples.

[0154] FIG. 12 is a flowchart illustrating a method for controlling a head-mounted display device according to one embodiment of the present disclosure based on the intensity of external light. The head-mounted display device (100) of FIG. 12 may refer to the operation of an augmented reality device (2000) including an illumination sensor (2400) in FIG. 2.

[0155] In step S1210, the head mounted display device (100) can obtain information on the intensity of external light. In one embodiment, the illumination sensor (2400) can measure the information on the intensity of external light at preset time intervals, or in response to a signal requesting measurement of the intensity of external light. In one embodiment, the information on the intensity of external light measured by the illumination sensor (2400) can be stored in the head mounted display device (100).

[0156] In step S1220, the head mounted display device (100) can identify the illuminance of external light transmitted through at least one variable optical filter (110) based on the adjusted transmission spectrum (130) and the illuminance of the external light. In one embodiment, when the external light transmits only a portion of the at least one variable optical filter (110), the adjusted transmission spectrum (130) can include a transmission spectrum formed by overlapping the transmission spectra of at least one variable optical filter (110) through which the external light is transmitted among the at least one variable optical filter (110).

[0157] In step S1230, the head-mounted display device (100) may obtain information on a target illuminance, which is a preset illuminance. In one embodiment, the target illuminance may be input through a user input unit or received from an external electronic device and stored in the head-mounted display device (100). In one embodiment, the target illuminance may refer to an illuminance value preset according to the user's eye characteristics. For example, if the user of the head-mounted display device (100) has an eye disease or low vision, it is necessary to block light exceeding a certain intensity from reaching the eyes in order to protect the user's eyes. Accordingly, the target illuminance may include information on the maximum allowable illuminance individually for each user.

[0158] At step S1240, the head mounted display device (100) can control at least one variable optical filter (110) based on a result of comparing the illuminance of external light with the target illuminance. In one embodiment, by controlling at least one variable optical filter (110), the wavelength-specific transmittance of the adjusted transmittance spectrum (130) formed by the at least one variable optical filter (110) can be changed.

[0159] In one embodiment, the head mounted display device (100) can control the at least one variable filter (110) so that the illuminance of the identified external light becomes less than or equal to the target illuminance when the illuminance of the identified external light is greater than the target illuminance. In one embodiment, the head mounted display device (100) can control the at least one variable optical filter (110) through which the external light is transmitted to reduce the transmittance by wavelength of the adjusted transmission spectrum (130), thereby reducing the illuminance of the external light transmitted through the at least one variable optical filter (110).

[0160] In one embodiment, the head-mounted display device (100) can control the display module (2100) so that the illuminance of the light of the virtual image corresponds to the illuminance of the identified external light. In one embodiment, the illuminance of the light of the virtual image corresponds to the illuminance of the identified external light may mean that the light of the virtual image is adjusted so that the user can easily recognize the content represented by the light of the virtual image when the light of the virtual image is incident on the user's eyes together with the external light.

[0161] In one embodiment, the head mounted display device (100) can identify the illuminance of light of a virtual image transmitted through at least one variable optical filter (110) based on the adjusted transmission spectrum (130). In one embodiment, when the light of the virtual image transmits only a portion of the at least one variable optical filter (110), the adjusted transmission spectrum (130) can include a transmission spectrum formed by overlapping the transmission spectra of at least one variable optical filter (110) through which the light of the virtual image is transmitted among the at least one variable optical filter (110). In one embodiment, the head mounted display device (100) can compare the illuminance of light of the identified virtual image with the illuminance of identified external light, and control the display module (2100) based on the comparison result. For example, the head-mounted display device (100) can increase the illuminance of light of a virtual image transmitted through at least one variable optical filter (110) by the illuminance of external light transmitted through at least one variable optical filter (110), but is not necessarily limited to the above-described example.

[0162] In this way, the head mounted display device (100) according to one embodiment of the present disclosure controls at least one variable optical filter (110) based on the illuminance of external light, thereby preventing damage to the user's eyes caused by external light, while allowing the user to more easily recognize the content indicated by the light of the virtual image.

[0163] FIG. 13 is a drawing for explaining changes in the illuminance of external light passing through at least one variable optical filter according to one embodiment of the present disclosure.

[0164] Referring to FIG. 13, the head mounted display device (100) can identify the illuminance of external light transmitted through at least one variable optical filter (110) based on the illuminance of the external light and the first adjusted transmission spectrum (1310). For example, the illuminance of the external light is 400 lux, and the illuminance of the external light transmitted through at least one variable optical filter (110) can be identified as 300 lux.

[0165] In one embodiment, the head mounted display device (100) can control at least one variable optical filter (110) based on a result of comparing the illuminance of the identified external light with a target illuminance. For example, when the illuminance of the external light transmitted through the at least one variable optical filter (110) is 300 lux and the target illuminance is 250 lux, the head mounted display device (100) can control the at least one variable optical filter (110) so that the illuminance of the external light transmitted through the at least one variable optical filter (110) becomes lower than the target illuminance.

[0166] In one embodiment, at least one variable optical filter (110) may be controlled so that the first adjusted transmission spectrum (1310) may be changed to a second adjusted transmission spectrum (1320). The second adjusted transmission spectrum (1320) may be a transmission spectrum having a reduced wavelength-specific transmittance compared to the first adjusted transmission spectrum (1310). Accordingly, the illuminance of external light transmitted through the at least one variable optical filter (110) having a reduced wavelength-specific light intensity by the second adjusted transmission spectrum (1320) may be changed from 300 lux to 200 lux, which is lower than the target illuminance of 250 lux.

[0167] FIG. 14 is a flowchart illustrating the operation of a head mounted display device (100) according to one embodiment of the present disclosure. The head mounted display device (100) of FIG. 14 may refer to the operation of the virtual reality device (3000) of FIG. 3.

[0168] In step S1410, the head mounted display device (100) may obtain RGB channel values ​​of a plurality of pixels of the original image. In one embodiment, the RGB channel values ​​of the pixels may include an R (Red) channel value, a G (Green) channel value, and a B (Blue) channel value, and the color of the pixel displayed on the display (3100) may be determined based on each channel value. In one embodiment, the RGB channel values ​​may each be set to one value from 0 to 255, and are not necessarily limited to the above-described example.

[0169] In one embodiment, the original image may be one of a plurality of frames of an image displayed on the display (3100) of the head-mounted display device (100), or may be an image of a single frame. In one embodiment, the virtual reality device may obtain the original image, and obtain information about the RGB channel values ​​of each of the plurality of pixels constituting the original image from the obtained original image.

[0170] In step S1420, the head mounted display device (100) may obtain a target transmission spectrum including information on transmittance for each preset wavelength. In one embodiment, the target transmission spectrum may be input through a user input unit or received from an external electronic device and stored in the head mounted display device (100). In one embodiment, the target transmission spectrum (120) may be input through a user input unit or received from an external electronic device and stored in the head mounted display device (100). In one embodiment, the target transmission spectrum may include information on transmittance for each of a plurality of wavelengths spaced apart at a predetermined interval in a preset wavelength band. For example, the target transmission spectrum may include information on transmittance for each of a plurality of wavelengths spaced apart at an interval of 5 nm in a wavelength band of 1100 nm or less, but is not necessarily limited to the above-described example.

[0171] In step S1430, the head mounted display device (100) may acquire a corrected image by adjusting RGB channel values ​​of a plurality of pixels based on the transmittance for each wavelength of the target transmittance spectrum. In one embodiment, adjusting the RGB channel values ​​of the pixels may mean decreasing or increasing at least one of the R channel value, the G channel value, and the B channel value of the pixel. In other words, the corrected image may be composed of a plurality of pixels whose RGB channel values ​​have been changed from the original image.

[0172] In one embodiment, the head mounted display device (100) can identify a representative wavelength (1320) of a plurality of pixels based on RGB channel values ​​(1310) of the plurality of pixels. In one embodiment, when a pixel is displayed on the display (3100), light may be emitted from a light emitting element corresponding to each RGB channel based on the RGB channel values ​​of the pixel. In this case, the light emitted from the light emitting element corresponding to each RGB channel may be synthesized so that the pixel displayed on the display may exhibit a specific color. In one embodiment, the representative wavelength may mean a wavelength corresponding to a color of a pixel displayed on the display based on the RGB channel values ​​of the pixel.

[0173] In one embodiment, the representative wavelength may be a wavelength corresponding to a color displayed on a calibrated display based on the RGB channel values ​​of multiple pixels. Specific details regarding display calibration will be further described below with reference to FIG. 16.

[0174] In one embodiment, the head-mounted display device (100) can identify representative wavelengths of a plurality of pixels based on RGB channel values ​​of the plurality of pixels. In one embodiment, a representative wavelength corresponding to each RGB channel value of the pixel can be preset. For example, a representative wavelength corresponding to RGB channel values ​​(130, 0, 200) can be 405 nm, and a representative wavelength corresponding to RGB channel values ​​(200, 200, 10) can be 597 nm, but is not necessarily limited to the above-described examples.

[0175] In one embodiment, the RGB channel values ​​of a pixel and the corresponding representative wavelengths may be mapped and stored in a lookup table (LUT) in the head mounted display device (100). In one embodiment, the head mounted display device (100) may identify the representative wavelengths of the plurality of pixels by applying the RGB channel values ​​of the pixels obtained for identifying the representative wavelengths to the LUT in which the RGB channel values ​​and the representative wavelengths are mapped. However, the present invention is not necessarily limited to the above-described example, and the head mounted display device (100) may also identify the representative wavelengths through an artificial intelligence model or algorithm trained to input RGB channel values ​​and output representative wavelengths.

[0176] In one embodiment, the head mounted display device (100) can adjust RGB channel values ​​of a plurality of pixels based on the transmittance of a representative wavelength of the target transmittance spectrum (120). In one embodiment, the head mounted display device (100) can identify transmittances of representative wavelengths of a plurality of pixels among a plurality of wavelengths of the target transmittance spectrum (120) and adjust RGB channel values ​​of the plurality of pixels based on the transmittances of the identified representative wavelengths. In one embodiment, the head mounted display device (100) can reduce the RGB channel values ​​of the plurality of pixels by the transmittances of the representative wavelengths of the plurality of pixels of the target transmittance spectrum (120).

[0177] In step S1440, the head mounted display device (100) can display the acquired correction image on the display (3100). In one embodiment, if the original image is one of multiple frames of the image, the head mounted display device (100) can repeatedly perform steps S1410 to S1430 for other frames of the image to acquire a correction image composed of multiple frames and display the correction image on the display (3100).

[0178] In this way, the head mounted display device (100) according to one embodiment of the present disclosure can reduce the intensity of light in a wavelength band that is harmful to the user's eyes from light emitted from the display (3100) by displaying a corrected image in which the RGB channel values ​​of each pixel in the original image are adjusted based on the target transmission spectrum (120). Accordingly, the user's eyes can be protected from light emitted from the head mounted display device (100).

[0179] FIG. 15 is a drawing for explaining a method for a head mounted display device according to one embodiment of the present disclosure to adjust RGB channel values ​​of a plurality of pixels.

[0180] Referring to FIG. 15, the head mounted display device (100) can obtain a target transmission spectrum (700) including RGB channel values ​​(1510) of a plurality of pixels of an original image and information on transmittance for each preset wavelength.

[0181] In one embodiment, the head mounted display device (100) can identify representative wavelengths of the plurality of pixels based on RGB channel values ​​(1510) of the plurality of pixels. In one embodiment, the head mounted display device (100) can obtain information (1520) about representative wavelengths of the plurality of pixels based on the identification result. For example, the head mounted display device (100) can identify that the representative wavelength of the pixel P1 is 640 nm based on the RGB channel values ​​(255, 190, 0) of the pixel P1, but is not necessarily limited to the above-described example.

[0182] In one embodiment, the head mounted display device (100) can obtain information (1530) about the transmittance of the plurality of pixels based on information (1520) about the representative wavelengths of the plurality of pixels and the target transmittance spectrum (700). For example, the head mounted display device (100) can identify that the transmittance of the pixel P1 is 31% based on information that the transmittance of the pixel P1 at the representative wavelength of 640 nm of the target transmittance spectrum (700) is 31%, but is not necessarily limited to the above-described example.

[0183] In one embodiment, the head mounted display device (100) can obtain adjusted RGB channel values ​​(1540) of the plurality of pixels based on RGB channel values ​​(1510) of the plurality of pixels and information (1530) about transmittance of the plurality of pixels. For example, the head mounted display device (100) can reduce each of the R channel, G channel, and B channel values ​​of the RGB channel value (255, 190, 0) of the pixel P1 by 31% based on information that the RGB channel value of the pixel P1 is (255, 190, 0) and the pixel transmittance is 31%. Accordingly, the head mounted display device (100) can obtain adjusted RGB channel values ​​(69, 51, 0) of P1, and is not necessarily limited to the above-described example.

[0184] In one embodiment, the head mounted display device (100) can obtain a correction image composed of RGB channel values ​​(1540) of a plurality of adjusted pixels. In one embodiment, the head mounted display device (100) can display the obtained correction image on a display (3100).

[0185] FIG. 16 is a diagram illustrating a process of converting a color gamut of a display by a head-mounted display device according to one embodiment of the present disclosure. The head-mounted display device (100) of FIG. 16 may indicate the operation of a virtual reality device (3000) including at least one variable optical filter (110).

[0186] Referring to FIG. 16, the head mounted display device (100) can control at least one variable optical filter (110) so that an adjusted transmission spectrum (1610) formed by the at least one variable optical filter (110) corresponds to the wavelength-specific transmittance of the target transmission spectrum (700). In one embodiment, the head mounted display device (100) can control a first variable optical filter (110-1) including a characteristic of blocking light of a preset wavelength band so that the adjusted transmission spectrum (1610) forms a transmission band of the target transmission spectrum (700). In one embodiment, light of an image output from the display (3100) of the head mounted display device (100) can have its intensity of light reduced for each wavelength according to the adjusted transmission spectrum (1610) while transmitting through the at least one variable optical filter (110).

[0187] In one embodiment, the color gamut (1620) of the display (3100) and the adjusted color gamut (1630) formed by the light of the image output from the display (3100) passing through at least one variable optical filter (110) may be different from each other. Since the intensity of light of the image output from the display (3100) is reduced in each wavelength according to the adjusted transmission spectrum (1610), the color gamut (1620) of the display (3100) determined based on the light of the image that does not pass through at least one variable optical filter (110) and the adjusted color gamut (1630) determined based on the light of the image that passes through at least one variable optical filter (110) may be different from each other.

[0188] In one embodiment, the head mounted display device (100) can obtain information about an adjusted color gamut formed by light of an image output from the display (3100) passing through at least one variable optical filter (110).

[0189] In one embodiment, the head mounted display device (100) can obtain light spectrum information of a pixel displayed on the display (3100). In one embodiment, the light spectrum information may include information about the intensity of each wavelength set according to the RGB channel value of the pixel. For example, the head mounted display device (100) can obtain information about what spectrum the light of each pixel forms when a full red pixel with an RGB channel value of (255, 0, 0), a full green pixel with an RGB channel value of (0, 255, 0), and a full blue pixel with an RGB channel value of (0, 0, 255) are displayed on the display (3100), and the present invention is not necessarily limited to the above-described example. In one embodiment, the light spectrum information of the pixel may include information about the intensity of light of each wavelength, and may be input through a user input unit or received from another electronic device and stored in the head mounted display device (100).

[0190] In one embodiment, the head mounted display device (100) can obtain optical spectrum information of a pixel that has passed through at least one variable optical filter (110) based on the optical spectrum information of the pixel and the adjusted transmission spectrum. In one embodiment, the head mounted display device (100) can obtain information about an adjusted color gamut based on the optical spectrum information of the pixel that has passed through at least one variable optical filter (110). For example, the head mounted display device (100) can identify at what coordinates a complete red pixel, a complete green pixel, and a complete blue pixel are located in the RGB color space based on the optical spectrum information of the pixel that has passed through at least one variable optical filter (110). The head mounted display device (100) can obtain information about an adjusted color gamut by forming a color gamut based on the coordinates of the identified pixels.

[0191] In one embodiment, the head mounted display device (100) may calibrate the display (3100) so that the color gamut (1620) of the display corresponds to the adjusted color gamut (1630). In one embodiment, calibration may mean adjusting hardware parameters of the display, such as brightness, contrast, color temperature, gamma, etc., to express accurate color and brightness. In one embodiment, the color profile may be modified through calibration so that RGB channel values ​​mapped to the color gamut (1620) of the display are mapped to the adjusted color gamut (1630). In one embodiment, the display (3100) may display a plurality of pixels constituting an image on the display (3100) based on the modified color profile.

[0192] In one embodiment, the head mounted display device (100) can control activation of at least one variable optical filter (110). In one embodiment, the head mounted display device (100) can receive a user input for controlling activation of at least one variable optical filter (110) through a user input unit, and can activate or deactivate the at least one variable optical filter (110) based on the received user input.

[0193] In one embodiment, when at least one variable optical filter (110) is activated, the at least one variable optical filter (110) forms a transmission spectrum, so that the intensity of light transmitting the at least one variable optical filter (110) may be reduced for each wavelength according to the transmission spectrum. In one embodiment, the head mounted display device (100) may perform calibration of the above-described display (3100) together with steps S1410 to S1440 of FIG. 14 when at least one variable optical filter (110) is activated.

[0194] In one embodiment, when at least one variable optical filter (110) is deactivated, the at least one variable optical filter (110) does not form a transmission spectrum, so that light passing through the at least one variable optical filter (110) can be transmitted as is without a decrease in the intensity of light for each wavelength. In one embodiment, the head mounted display device (100) may perform steps S1410 to S1440 of FIG. 14 without performing calibration of the display (3100) described above when at least one variable optical filter (110) is deactivated. In one embodiment, the state in which at least one variable optical filter (110) is deactivated may mean a state in which the head mounted display device (100) does not include at least one variable optical filter (110).

[0195] FIG. 17 is a flowchart illustrating a method for controlling a head-mounted display device based on the brightness of a display according to one embodiment of the present disclosure. The head-mounted display device (100) of FIG. 17 may refer to the operation of a virtual reality device (3000) including a display (3100) in FIG. 3.

[0196] In step S1710, the head mounted display device (100) may obtain information on the target luminance, which is the preset luminance of the display (3100). In one embodiment, the target luminance may be input through a user input unit or received from an external electronic device and stored in the head mounted display device (100). In one embodiment, the target luminance may refer to a preset luminance value of the display according to the user's eye characteristics. For example, if the user of the head mounted display device (100) has an eye disease or low vision, it is necessary to block light exceeding a certain intensity from reaching the eyes in order to protect the user's eyes. Accordingly, the target illuminance may include information on the maximum luminance of the display (3100) that can be individually tolerated by the user.

[0197] At step S1720, the head mounted display device (100) can adjust the brightness of the display (3100) based on the result of comparing the brightness of the display (3100) with the target brightness. Here, adjusting the brightness of the display (3100) may mean controlling the display (3100) so that the brightness value of the display (3100) changes.

[0198] In one embodiment, the head mounted display device (100) may reduce the luminance of the display (3100) so that the luminance of the display (3100) becomes lower than the target luminance when the luminance of the display (3100) is greater than the target luminance. In one embodiment, the head mounted display device (100) may increase the luminance of the display (3100) so that the luminance of the display (3100) becomes closer to the target luminance when the luminance of the display (3100) is lower than the target luminance.

[0199] In one embodiment, the head mounted display device (100) can identify a luminance of the display (3100) reduced by the at least one variable optical filter (110) based on the adjusted transmission spectrum (130) and the luminance of the display (3100) when the at least one variable optical filter (110) is activated. In one embodiment, if the luminance of the identified display is greater than a target luminance, the head mounted display device (100) can reduce the luminance of the display (3100) so that the luminance of the display (3100) reduced by the at least one variable optical filter (110) becomes lower than the target luminance. In one embodiment, if the luminance of the identified display is less than the target luminance, the head mounted display device (100) can increase the luminance of the display (3100) so that the luminance of the display (3100) reduced by the at least one variable optical filter becomes closer to the target luminance.

[0200] In this way, the head mounted display device (100) according to one embodiment of the present disclosure prevents damage to the user's eyes caused by light generated from the display (3100), while allowing the user to more easily recognize content displayed on the display (3100).

[0201] FIG. 18 is a detailed configuration diagram of an augmented reality device according to one embodiment of the present disclosure.

[0202] Referring to FIG. 18, the augmented reality device (2000) may include a display module (2100), at least one variable optical filter (110), a memory (2300), an illuminance sensor (2400), a communication interface (2500), a camera (2600), a user input unit (2700), and at least one processor (2800). The display module (2100), at least one variable optical filter (110), the memory (2200), the illuminance sensor (2400), the communication interface (2500), the camera (2600), the user input unit (2700), and the at least one processor (2800) may each be electrically and / or physically connected to each other.

[0203] The components illustrated in FIG. 18 are merely in accordance with one embodiment of the present disclosure, and the components included in the augmented reality device (2000) are not limited to those illustrated in FIG. 18. The augmented reality device (2000) according to one embodiment of the present disclosure may not include some of the components illustrated in FIG. 18, and may further include components not illustrated in FIG. 18. In addition, descriptions of overlapping content with the components described in FIG. 2 among the components illustrated in FIG. 18 will be omitted.

[0204] The memory (2300) may store instructions or program codes for performing functions or operations of the augmented reality device (2000). In one embodiment, at least one instruction, algorithm, data structure, program code, and application program stored in the memory (2200) may be implemented in a programming or scripting language such as, for example, C, C++, Java, assembler, etc.

[0205] In one embodiment, the memory (2300) may include at least one of a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), a random access memory (RAM), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a mask ROM, a flash ROM, etc.), a hard disk drive (HDD), or a solid state drive (SSD).

[0206] In one embodiment, the memory (2300) may include a target transmission spectrum (120) including information on transmittance for each preset wavelength. In one embodiment, the memory (2300) may include information on target illuminance, which is a preset illuminance. In one embodiment, the information stored in the memory (2300) may be input through the user input unit (2700) or received from another electronic device through the communication interface (2500) and stored in the memory (2300). However, the present invention is not necessarily limited to the above-described examples, and the information stored in the memory (2300) may include various information necessary to perform the operations and functions of the augmented reality device (2000) disclosed herein.

[0207] In one embodiment, the communication interface (2500) is a component for the augmented reality device (2000) to communicate with an external electronic device. In one embodiment, the communication interface (2400) may perform data communication with the augmented reality device (2000) using at least one of data communication methods including wired LAN, wireless LAN, Wi-Fi, Bluetooth, zigbee, Wi-Fi Direct (WFD), infrared Data Association (IrDA), Bluetooth Low Energy (BLE), Near Field Communication (NFC), Wireless Broadband Internet (Wibro), World Interoperability for Microwave Access (WiMAX), Shared Wireless Access Protocol (SWAP), Wireless Gigabit Alliance (WiGig), and RF communication.

[0208] In one embodiment, the communication interface (2500) may transmit and receive at least one of information regarding a target transmission spectrum (120) and target illuminance from an external electronic device. However, the present invention is not necessarily limited to the above-described example, and various pieces of information necessary to perform the operations and functions of the augmented reality device (2000) disclosed herein may be transmitted and received with the external electronic device via the communication interface (2500).

[0209] The camera (2600) is a configuration that can obtain information about the external space by photographing the outside of the augmented reality device (2000). In one embodiment, the camera (2600) may include a single camera or three or more multi-cameras. In one embodiment, the camera (2600) may include a lens module, an image sensor, and an image processing module. The camera (2600) can obtain still images or moving images obtained by an image sensor (e.g., CMOS or CCD). The image processing module can process the still images or moving images obtained through the image sensor to extract necessary information. In one embodiment, the image captured by the camera (2600) or the information about the external space can be provided as an original image to at least one processor (2800). In one embodiment, the at least one processor (2800) can obtain information about the illuminance of external light based on the image acquired through the camera or the information about the external space.

[0210] The user input unit (2700) is a component for receiving various user inputs. In one embodiment, the user input unit (2700) may include a touch panel, a physical button, etc. In one embodiment, information input through the user input unit (2700) may be provided to at least one processor (2800). In one embodiment, information about a target transmission spectrum or information about target illuminance may be input through the user input unit (2800). However, the present invention is not necessarily limited to the above-described examples, and various information for performing the operations and functions of the augmented reality device (2000) disclosed herein may be input through the user input unit (2700).

[0211] At least one processor (2800) can execute one or more instructions of a program stored in a memory (2300). At least one processor (2800) may be configured with hardware components that perform arithmetic, logic, and input / output operations and signal processing. At least one processor (2800) may be configured with at least one of, for example, a Central Processing Unit (CPU), a microprocessor, a Graphic Processing Unit (GPU), Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), and Field Programmable Gate Arrays (FPGAs), but is not limited thereto.

[0212] In one embodiment, at least one processor (2800) can obtain a target transmission spectrum (120) including information on preset wavelength-specific transmittance. In one embodiment, at least one processor (2800) can control at least one variable optical filter (110) such that an adjusted transmission spectrum (130) formed by the at least one variable optical filter (110) corresponds to the wavelength-specific transmittance of the target transmission spectrum (120).

[0213] In one embodiment, at least one processor (2800) can identify a transmission band of a target transmission spectrum (120). In one embodiment, at least one processor (2800) can control a first variable optical filter such that the adjusted transmission spectrum (130) forms a transmission band.

[0214] In one embodiment, at least one processor (2800) can identify whether the target transmittance spectrum (120) includes a first spectral characteristic in which a rate of change in transmittance within the transmittance band is greater than or equal to a first threshold value from each of the minimum wavelength and the maximum wavelength of the transmittance band to a first length. In one embodiment, at least one processor (2800) can control the second variable optical filter such that the adjusted transmittance spectrum (130) includes the first spectral characteristic.

[0215] In one embodiment, at least one processor (2800) can identify whether the target transmittance spectrum (120) includes a second spectral characteristic having a transmittance change rate greater than or equal to a second threshold value within a transmittance band that is a second wavelength band away from a center of the transmittance band. In one embodiment, at least one processor (2800) controls a third variable optical filter such that the adjusted transmittance spectrum (130) includes the second spectral characteristic.

[0216] In one embodiment, at least one processor (2800) can identify whether the target transmission spectrum (120) includes a third spectral characteristic, wherein the transmission band is at least a third length within the transmission band, the transmittance differs by at least a third threshold value from the maximum transmittance of the target transmission spectrum (120), and the transmittance change rate is at most a fourth threshold value. In one embodiment, the at least one processor (2800) can control the fourth variable optical filter such that the adjusted transmission spectrum (130) includes the third spectral characteristic.

[0217] In one embodiment, at least one processor (2800) can identify the illuminance of external light transmitted through at least one variable optical filter (110)(110) based on the illuminance of the external light and the adjusted transmission spectrum (130). In one embodiment, at least one processor (2800) can obtain information about a target illuminance, which is a preset illuminance. In one embodiment, at least one processor (2800) can control at least one variable filter based on a result of comparing the illuminance of the identified external light with the target illuminance.

[0218] In one embodiment, at least one processor (2800) can control at least one variable filter so that the illuminance of the identified external light becomes less than or equal to the target illuminance when the illuminance of the identified external light is greater than the target illuminance.

[0219] In one embodiment, at least one processor (2800) can control the display module so that the illuminance of the virtual image corresponds to the illuminance of the identified external light.

[0220] In one embodiment, at least one processor (2800) can perform the operations and functions of the virtual reality device (2000) disclosed herein, including the above-described embodiments, and redundant descriptions will be omitted.

[0221] In this way, according to one embodiment of the present disclosure, the augmented reality device (2000) can protect the user's eyes from external light incident on the augmented reality device (2000) and internal light generated from the augmented reality device (2000) by forming an adjusted transmission spectrum (130) corresponding to a target transmission spectrum (120) suitable for the eye condition of each user.

[0222] FIG. 19 is a detailed configuration diagram of a virtual reality device according to an embodiment of the present disclosure. Referring to FIG. 19, the virtual reality device (3000) may include a display (3100), at least one variable optical filter (110), a memory (3300), a communication interface (3400), a camera (3500), a user input unit (3600), and at least one processor (3700). The display (3100), at least one variable optical filter (110), the memory (3300), the communication interface (3400), the camera (3500), the user input unit (3600), and the at least one processor (3700) may each be electrically and / or physically connected to each other.

[0223] The components illustrated in FIG. 19 are merely in accordance with one embodiment of the present disclosure, and the components included in the virtual reality device (3000) are not limited to those illustrated in FIG. 19. The virtual reality device (3000) according to one embodiment of the present disclosure may not include some of the components illustrated in FIG. 19, and may further include components not illustrated in FIG. 19. In addition, descriptions of overlapping content with the components described in FIG. 3 among the components illustrated in FIG. 19 will be omitted.

[0224] Memory (3300) may store commands or program codes for performing functions or operations of the virtual reality device (3000). Since the memory (3300) of FIG. 19 corresponds to the memory (2300) of FIG. 18, any duplicate content will be omitted.

[0225] In one embodiment, the memory (3300) may include an original image and a corrected image. In one embodiment, the memory (3300) may include information about a lookup table (LUT) in which RGB channel values ​​and corresponding representative wavelengths are mapped. In one embodiment, the memory (3300) may include information about a color gamut of the display (3100) and information about an optical spectrum of pixels displayed on the display (3100). In one embodiment, the memory (3300) may include information about a target luminance, which is information about a preset luminance value of the display (3100). In one embodiment, the information stored in the memory (3300) may be input through the user input unit (3600) or received from another electronic device through the communication interface (3400) and stored in the memory (3300). However, it is not necessarily limited to the examples described above, and the information stored in the memory (3300) may include various information necessary to perform the operation and function of the virtual reality device (3000) disclosed in this specification.

[0226] In one embodiment, the communication interface (3400) is a component for the augmented reality device (2000) to communicate with an external electronic device. Since the communication interface (3400) corresponds to the communication interface (2500) of FIG. 18, any duplicate details will be omitted.

[0227] In one embodiment, the communication interface (3400) may transmit and receive one of a lookup table (LUT) in which an original image, a corrected image, RGB channel values, and corresponding representative wavelengths are mapped, information about a color gamut of the display (3100), information about a light spectrum of a pixel displayed on the display (3100), and information about a preset luminance value of the display (3100). However, the present invention is not limited to the above-described example, and various pieces of information necessary to perform the operation and function of the virtual reality device (3000) disclosed herein may be transmitted and received with an external electronic device through the communication interface (3400).

[0228] In one embodiment, the camera (3500) is configured to acquire information about the external space by photographing the exterior of the virtual reality device (3000). Since the camera (3500) of FIG. 19 corresponds to the camera (2600) of FIG. 18, any overlapping details will be omitted.

[0229] The user input unit (3600) is a component for receiving various user inputs. In one embodiment, the user input unit (3600) may include a touch panel, a physical button, etc. In one embodiment, information input through the user input unit (3600) may be provided to at least one processor (3700). In one embodiment, information about a target transmission spectrum or information about target luminance may be input through the user input unit (3600). However, the present invention is not necessarily limited to the above-described examples, and various information for performing the operations and functions of the virtual reality device (3000) disclosed herein may be input through the user input unit (3600).

[0230] At least one processor (3700) can execute one or more instructions of a program stored in a memory (3300). At least one processor (3700) may be configured with hardware components that perform arithmetic, logic, and input / output operations and signal processing. At least one processor (3700) may be configured with at least one of, for example, a Central Processing Unit (CPU), a microprocessor, a Graphic Processing Unit (GPU), Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), and Field Programmable Gate Arrays (FPGAs), but is not limited thereto.

[0231] In one embodiment, at least one processor (3700) can obtain a target transmission spectrum (120) including information on preset wavelength-specific transmittance. In one embodiment, at least one processor (3700) can control at least one variable optical filter (110) such that an adjusted transmission spectrum (130) formed by the at least one variable optical filter (110) corresponds to the wavelength-specific transmittance of the target transmission spectrum (120).

[0232] In one embodiment, at least one processor (3700) can identify a transmission band of a target transmission spectrum (120). In one embodiment, at least one processor (3700) can control a first variable optical filter such that the adjusted transmission spectrum (130) forms a transmission band.

[0233] In one embodiment, at least one processor (3700) can identify whether the target transmission spectrum (120) includes a first spectral characteristic in which a rate of change in transmittance within the transmission band is greater than or equal to a first threshold value from each of the minimum wavelength and the maximum wavelength of the transmission band to a first length. In one embodiment, at least one processor (3700) can control the second variable optical filter such that the adjusted transmission spectrum (130) includes the first spectral characteristic.

[0234] In one embodiment, at least one processor (3700) can identify whether the target transmittance spectrum (120) includes a second spectral characteristic having a transmittance change rate greater than or equal to a second threshold value within a transmittance band that is a second wavelength band of a length from the center of the transmittance band. In one embodiment, at least one processor (3700) controls a third variable optical filter such that the adjusted transmittance spectrum (130) includes the second spectral characteristic.

[0235] In one embodiment, at least one processor (3700) can identify whether the target transmission spectrum (120) includes a third spectral characteristic, wherein the transmission band is at least a third length within the transmission band, the transmittance differs by at least a third threshold value from the maximum transmittance of the target transmission spectrum (120), and the transmittance change rate is at most a fourth threshold value. In one embodiment, the at least one processor (3700) can control the fourth variable optical filter such that the adjusted transmission spectrum (130) includes the third spectral characteristic.

[0236] In one embodiment, at least one processor (3700) can identify the illuminance of external light transmitted through at least one variable optical filter (110)(110) based on the illuminance of the external light and the adjusted transmission spectrum (130). In one embodiment, at least one processor (3700) can obtain information about a target illuminance, which is a preset illuminance. In one embodiment, at least one processor (3700) can control at least one variable filter based on a result of comparing the illuminance of the identified external light with the target illuminance.

[0237] In one embodiment, at least one processor (3700) can obtain RGB channel values ​​of a plurality of pixels of an original image. In one embodiment, at least one processor (3700) can obtain a target transmittance spectrum including information on transmittance for each preset wavelength. In one embodiment, at least one processor (3700) can obtain a corrected image by adjusting RGB channel values ​​of a plurality of pixels based on the transmittance for each wavelength of the target transmittance spectrum. In one embodiment, at least one processor (3700) can display the corrected image on a display.

[0238] In one embodiment, at least one processor (3700) can identify representative wavelengths of the plurality of pixels based on RGB channel values ​​of the plurality of pixels. In one embodiment, at least one processor (3700) can adjust RGB channel values ​​of the plurality of pixels based on transmittance of the representative wavelength of the target transmittance spectrum.

[0239] In one embodiment, at least one processor (3700) can reduce the RGB channel values ​​of the plurality of pixels by the transmittance of the representative wavelength.

[0240] In one embodiment, at least one processor (3700) can obtain information about an adjusted color gamut formed by light of an image passing through at least one variable optical filter. In one embodiment, at least one processor (3700) can perform calibration of the display so that the color gamut of the display corresponds to the adjusted color gamut.

[0241] In one embodiment, at least one processor (3700) may obtain information about a target luminance, which is the luminance of the display. In one embodiment, at least one processor (3700) may adjust the luminance of the display based on a result of comparing the luminance of the display with the target luminance.

[0242] In one embodiment, at least one processor (3700) can perform the operations and functions of the virtual reality device (3000) disclosed herein, including the above-described embodiments, and redundant descriptions will be omitted.

[0243] In this way, according to one embodiment of the present disclosure, the virtual reality device (3000) can reduce the intensity of light in a wavelength band that is harmful to the user's eyes from light emitted from the display (3100) by displaying a corrected image in which the RGB channel values ​​of each pixel in the original image are adjusted based on the target transmission spectrum (120). Accordingly, the user's eyes can be protected from light emitted from the virtual reality device (3000).

[0244]

[0245] Computer-readable storage media may be provided in the form of non-transitory storage media. Here, the term "non-transitory storage media" simply means a tangible device that does not contain signals (e.g., electromagnetic waves). This term does not distinguish between cases where data is permanently stored in the storage medium and cases where data is temporarily stored. For example, a "non-transitory storage medium" may include a buffer in which data is temporarily stored.

[0246] According to one embodiment, the method according to various embodiments disclosed in the present document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) through an application store or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product (e.g., a downloadable app) may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0247] Although the embodiments described above have been described with limited examples and drawings, those skilled in the art will appreciate that various modifications and variations can be made based on the above description. For example, appropriate results can still be achieved even if the described techniques are performed in a different order than described, and / or components such as the described computer system or modules are combined or combined in a different manner than described, or are replaced or substituted with other components or equivalents.

Claims

1. A display module (2100) configured to output light constituting a virtual image; An optical system (2200) that transmits the light of the above output virtual image to the user's eyes and allows external light to pass through; At least one tunable optical filter configured to electrically control the transmittance of transmitted light according to the wavelength; A memory (2300) storing one or more instructions; and At least one processor (2800) for executing one or more instructions stored in the memory (2300); The augmented reality device (2000) executes the at least one instruction by the at least one processor (2800). Obtain a target transmission spectrum (120) containing information on transmittance for each preset wavelength, An augmented reality device that controls the at least one variable optical filter (110) so that the adjusted transmission spectrum (130) formed by the at least one variable optical filter corresponds to the wavelength-specific transmittance of the target transmission spectrum.

2. In paragraph 1, At least one variable optical filter, A first variable optical filter comprising a characteristic of blocking light of a predetermined wavelength band, The augmented reality device (2000) executes the at least one instruction by the at least one processor (2800). Identify the transmission band of the above target transmission spectrum, An augmented reality device, wherein the first variable optical filter is controlled so that the adjusted transmission spectrum forms the transmission band.

3. In any one of paragraphs 1 and 2, At least one variable optical filter, A second variable optical filter comprising the characteristics of a notch filter, The augmented reality device (2000) executes the at least one instruction by the at least one processor (2800). Identifying whether the target transmission spectrum includes a first spectral characteristic in which a change in transmittance within the transmission band is greater than a first threshold value from each of the minimum wavelength and the maximum wavelength of the transmission band to a first length, An augmented reality device that controls the second variable optical filter so that the adjusted transmission spectrum includes the first spectral characteristic.

4. In any one of paragraphs 1 to 3, At least one variable optical filter, A third variable optical filter comprising the characteristics of a notch Neutral Density filter, The augmented reality device (2000) executes the at least one instruction by the at least one processor (2800). Identifying whether the target transmission spectrum includes a second spectral characteristic having a change in transmittance greater than or equal to a second threshold value within a transmission band that is outside a second wavelength band of a length from the center of the transmission band, An augmented reality device that controls the third variable optical filter so that the adjusted transmission spectrum includes the second spectral characteristic.

5. In any one of paragraphs 1 to 4, At least one variable optical filter, A fourth variable optical filter comprising the characteristics of an ND filter (Neutral Density filter), The augmented reality device (2000) executes the at least one instruction by the at least one processor (2800). Identifying whether the target transmission spectrum includes a third spectral characteristic in which the transmission band is a third length or longer within the transmission band, the transmittance differs by a third threshold value or more from the maximum transmittance of the target transmission spectrum, and the transmittance change rate is a fourth threshold value or less; An augmented reality device that controls the fourth variable optical filter so that the adjusted transmission spectrum includes the third spectral characteristic.

6. In any one of paragraphs 1 to 5, Further comprising a light sensor for obtaining information on the intensity of the external light; At least one processor of the above, Identifying the illuminance of external light transmitted through at least one variable optical filter (110) based on the illuminance of the external light and the adjusted transmission spectrum, Obtain information about the target illuminance, which is a preset illuminance, An augmented reality device that controls at least one variable filter based on a result of comparing the illuminance of the identified external light with the target illuminance.

7. In any one of paragraphs 1 to 6, The above adjusted transmission spectrum is, An augmented reality device comprising at least one of a first transmission spectrum formed by a variable optical filter through which light of the virtual image is transmitted, and a second transmission spectrum formed by a variable optical filter through which external light is transmitted.

8. Display (3100) that outputs images; An optical system (3200) that transmits the light of the printed image to the user's eyes; A memory (3300) storing one or more instructions; and At least one processor (3700) for executing one or more instructions stored in the memory; The virtual reality device (3000) executes the at least one instruction by the at least one processor (3700). Obtain the RGB channel values ​​of multiple pixels of the original image, Obtain a target transmission spectrum (120) containing information on transmittance for each preset wavelength, By adjusting the RGB channel values ​​of the plurality of pixels based on the wavelength-specific transmittance of the target transmittance spectrum, a correction image is obtained, A virtual reality device that displays the above-mentioned corrected image on the above-mentioned display.

9. In paragraph 8, The virtual reality device (3000) executes the at least one instruction by the at least one processor (3700). Identifying representative wavelengths of the plurality of pixels based on the RGB channel values ​​of the plurality of pixels, A virtual reality device that adjusts RGB channel values ​​of the plurality of pixels based on the transmittance of the representative wavelength of the target transmittance spectrum.

10. In any one of paragraphs 8 to 9, At least one processor of the above, A virtual reality device that reduces the RGB channel values ​​of the plurality of pixels by the transmittance of the representative wavelength.

11. In any one of paragraphs 8 to 10, further comprising at least one tunable optical filter configured to electrically control the transmittance of transmitted light according to the wavelength; The virtual reality device (3000) executes the at least one instruction by the at least one processor (3700). A virtual reality device that controls the at least one variable optical filter so that the adjusted transmission spectrum formed by the at least one variable optical filter corresponds to the wavelength-specific transmittance of the target transmission spectrum.

12. In any one of paragraphs 8 to 11, At least one variable optical filter, A first variable optical filter comprising a characteristic of blocking light of a predetermined wavelength band, At least one processor of the above, Identify the transmission band of the above target transmission spectrum, A virtual reality device, wherein the first variable optical filter is controlled so that the adjusted transmission spectrum forms the transmission band.

13. In any one of paragraphs 8 to 12, The virtual reality device (3000) executes the at least one instruction by the at least one processor (3700). Obtaining information about an adjusted color gamut formed by light of the image passing through at least one variable optical filter, A virtual reality device that performs calibration of the display so that the color gamut of the display corresponds to the adjusted color gamut.

14. In any one of paragraphs 8 to 13, The above representative wavelengths are A virtual reality device, wherein the wavelength corresponds to the color of the plurality of pixels displayed on the display on which the calibration was performed, based on the RGB channel values ​​of the plurality of pixels.

15. A method for controlling a head mounted display device including at least one variable optical filter, Step (S510) of obtaining a target transmission spectrum including information on transmittance for each preset wavelength; and A method comprising: a step (S610) of controlling the at least one variable optical filter so that the adjusted transmission spectrum formed by the at least one variable optical filter corresponds to the wavelength-specific transmittance of the target transmission spectrum.

Images