Light guide device and electronic device including same

Abstract

An embodiment provides a light guide device comprising: a first substrate; a first input diffraction element into which light is incident and a first output diffraction element through which the light is emitted, both the first input and output diffraction elements being disposed on the first substrate; and a reflection layer disposed on the first substrate, wherein the first input diffraction element passes the light therethrough and separates the light into first light that is diffracted and second light that is not diffracted, and the reflection layer reflects the second light toward the first input diffraction element.

Description

Light guide device and electronic device including the same

[0001] The embodiment relates to a light guide device and an electronic device including the same.

[0002] Virtual Reality (VR) refers to a specific environment or situation, or the technology itself, that is similar to reality but not real, created using artificial technology such as computers.

[0003] Augmented Reality (AR) is a technology that synthesizes virtual objects or information into the real environment to make them appear as objects that exist in the original environment.

[0004] Mixed reality (MR) or hybrid reality refers to the creation of new environments or information by merging the virtual and real worlds. In particular, it refers to real-time interaction between real and virtual worlds.

[0005] At this time, the created virtual environments and situations stimulate the user's five senses, allowing them to experience spatial and temporal experiences similar to reality, freely moving between reality and imagination. Furthermore, users can not only immerse themselves in these environments, but also interact with the objects embodied within them, using real devices to control and command them.

[0006] Recently, active research has been conducted on the gear and devices used in these fields. However, the need for miniaturization and improved optical performance of these devices is emerging.

[0007] The embodiment provides a light guide device with improved diffraction efficiency and an electronic device including the same.

[0008] In addition, a light guide device with improved optical performance and an electronic device including the same are provided.

[0009] The problem to be solved in the embodiment is not limited to this, and it can be said that the purpose or effect that can be understood from the solution or embodiment of the problem described below is also included.

[0010] A light guide device according to an embodiment includes a first substrate; a first input diffractive element disposed on the first substrate, through which light is incident, and a first exit diffractive element from which the light is emitted; and a reflective layer disposed on the first substrate, wherein the first input diffractive element passes the light and separates the light into a first light that is diffracted and a second light that is not diffracted, and the reflective layer can reflect the second light toward the first input diffractive element.

[0011] The above reflective layer overlaps the first input diffraction element in a first direction, and the first direction may be a direction perpendicular to the first substrate.

[0012] The light guide device according to the embodiment may include an intermediate layer disposed between the first input diffractive element and the reflective layer.

[0013] The first substrate may include a first surface onto which the light is incident and a second surface spaced apart from the first surface.

[0014] A light guide device in which the first input diffraction element and the first output diffraction element are arranged on the first surface.

[0015] The intermediate layer may be disposed on the second surface, and the reflective layer may be disposed on the intermediate layer.

[0016] The first input diffraction element and the first output diffraction element may be arranged on the second surface.

[0017] The intermediate layer may be disposed on the first input diffractive element, and the reflective layer may be disposed on the intermediate layer.

[0018] The second light can pass through the first input diffraction element after being reflected by the reflective layer.

[0019] The second light may include the second-1 light that passes through the first input diffraction element and is diffracted again and the second-2 light that is not diffracted.

[0020] The path of the above 2-1 light may be parallel to the path of the above 1 light.

[0021] The second light is incident on the first substrate and refracted, and the diffraction angle of the first light may be greater than the refraction angle of the second light.

[0022] The second light may be reflected by the reflective layer after being incident on the first substrate, and the second light may be diffracted by the first input diffraction element after being reflected by the reflective layer.

[0023] The diffraction angle of the first light and the refraction angle of the second light can satisfy mathematical expression 1.

[0024] [Mathematical Formula 1]

[0025]

[0026] (Here, t is the thickness of the first substrate, θ1 is the diffraction angle of the first light, and θ2 is the refraction angle of the second light)

[0027] The light guide device according to the embodiment may include an air gap between the first input diffractive element and the reflective layer.

[0028] A light guide device according to an embodiment includes: a first substrate and a second substrate spaced apart in the first direction; a second input diffractive element disposed on the second substrate, onto which light is incident; and a second exit diffractive element from which the light is emitted; wherein the light can sequentially pass through the second input diffractive element, the second substrate, the first input diffractive element, and the first substrate and be reflected by the reflective layer.

[0029] The second input diffraction element passes light of a first wavelength band and diffracts light of a second wavelength band different from the first wavelength band, and the reflection layer can reflect light of the first wavelength band.

[0030] The above reflective layer may not overlap with the above diffraction element in the first direction.

[0031] According to an embodiment, a light guide device with improved diffraction efficiency and an electronic device including the same can be provided.

[0032] In addition, a light guide device with improved optical performance and an electronic device including the same can be provided.

[0033] The various advantageous and beneficial effects of the present invention are not limited to the above-described contents, and will be more easily understood in the course of explaining specific embodiments of the present invention.

[0034] Figure 1 is a conceptual diagram showing an embodiment of an AI device,

[0035] FIG. 2 is a block diagram showing the configuration of an extended reality electronic device according to an embodiment of the present invention.

[0036] Figure 3 is a perspective view of an augmented reality electronic device according to an embodiment of the present invention;

[0037] Figure 4 is a schematic diagram of a light guide device according to an embodiment of the present invention.

[0038] Figures 5 to 7 are schematic diagrams of a light guide device according to another embodiment of the present invention.

[0039] FIG. 8 is a drawing showing the path of light passing through a light guide device according to an embodiment of the present invention.

[0040] Hereinafter, a preferred embodiment of the present invention will be described in detail with reference to the attached drawings.

[0041] However, the technical idea of ​​the present invention is not limited to some of the embodiments described, but can be implemented in various different forms, and within the scope of the technical idea of ​​the present invention, one or more of the components between the embodiments can be selectively combined or substituted for use.

[0042] In addition, terms (including technical and scientific terms) used in the embodiments of the present invention may be interpreted as having a meaning that can be generally understood by a person of ordinary skill in the technical field to which the present invention belongs, unless explicitly and specifically defined and described, and terms that are commonly used, such as terms defined in a dictionary, may be interpreted in consideration of the contextual meaning of the relevant technology.

[0043] Additionally, the terms used in the embodiments of the present invention are intended to describe the embodiments and are not intended to limit the present invention.

[0044] In this specification, the singular may also include the plural unless specifically stated otherwise in the phrase, and when it is described as “A and / or at least one (or more) of B, C”, it may include one or more of all combinations that can be combined with A, B, C.

[0045] Additionally, in describing components of embodiments of the present invention, terms such as first, second, A, B, (a), (b), etc. may be used.

[0046] These terms are intended only to distinguish one component from another, and are not intended to limit the nature, order, or sequence of the component.

[0047] And, when a component is described as being 'connected', 'coupled' or 'connected' to another component, it may include not only cases where the component is directly connected, coupled or connected to the other component, but also cases where the component is 'connected', 'coupled' or 'connected' by another component between the component and the other component.

[0048] Additionally, when described as being formed or arranged "above or below" each component, "above" or "below" includes not only cases where the two components are in direct contact with each other, but also cases where one or more other components are formed or arranged between the two components. Furthermore, when expressed as "above" or "below", it can include the meaning of a downward direction as well as an upward direction based on one component.

[0049] Figure 1 is a conceptual diagram illustrating an embodiment of an AI device.

[0050] Referring to FIG. 1, an AI system is connected to a cloud network (10) by at least one of an AI server (16), a robot (11), an autonomous vehicle (12), an XR device (13), a smartphone (14), or an appliance (15). Here, a robot (11), an autonomous vehicle (12), an XR device (13), a smartphone (14), or an appliance (15) to which AI technology is applied may be referred to as an AI device (11 to 15).

[0051] A cloud network (10) may refer to a network that constitutes part of a cloud computing infrastructure or exists within a cloud computing infrastructure. Here, the cloud network (10) may be configured using a 3G network, a 4G or LTE (Long Term Evolution) network, a 5G network, etc.

[0052] That is, each device (11 to 16) constituting the AI ​​system can be connected to each other through a cloud network (10). In particular, each device (11 to 16) can communicate with each other through a base station, but can also communicate with each other directly without going through a base station.

[0053] The AI ​​server (16) may include a server that performs AI processing and a server that performs operations on big data.

[0054] The AI ​​server (16) is connected to at least one of the AI ​​devices constituting the AI ​​system, such as a robot (11), an autonomous vehicle (12), an XR device (13), a smartphone (14), or a home appliance (15), through a cloud network (10), and can assist at least part of the AI ​​processing of the connected AI devices (11 to 15).

[0055] At this time, the AI ​​server (16) can train an artificial neural network according to a machine learning algorithm on behalf of the AI ​​devices (11 to 15), and can directly store the learning model or transmit it to the AI ​​devices (11 to 15).

[0056] At this time, the AI ​​server (16) can receive input data from the AI ​​devices (11 to 15), infer a result value for the received input data using a learning model, and generate a response or control command based on the inferred result value and transmit it to the AI ​​devices (11 to 15).

[0057] Alternatively, the AI ​​device (11 to 15) may infer a result value for input data using a direct learning model and generate a response or control command based on the inferred result value.

[0058] <AI+로봇>

[0059] Robots (11) can be implemented as guide robots, transport robots, cleaning robots, wearable robots, entertainment robots, pet robots, unmanned flying robots, etc. by applying AI technology.

[0060] The robot (11) may include a robot control module for controlling movement, and the robot control module may mean a software module or a chip that implements the same as hardware.

[0061] The robot (11) can obtain status information of the robot (11), detect (recognize) the surrounding environment and objects, generate map data, determine a movement path and driving plan, determine a response to user interaction, or determine an action using sensor information obtained from various types of sensors.

[0062] Here, the robot (11) can use sensor information acquired from at least one sensor among lidar, radar, and camera to determine a movement path and driving plan.

[0063] The robot (11) can perform the above-described operations using a learning model comprised of at least one artificial neural network. For example, the robot (11) can recognize its surroundings and objects using the learning model, and determine operations using the recognized surrounding environment information or object information. Here, the learning model may be learned directly by the robot (11) or by an external device such as an AI server (16).

[0064] At this time, the robot (11) may perform an action by generating a result using a direct learning model, but it may also perform an action by transmitting sensor information to an external device such as an AI server (16) and receiving the result generated accordingly.

[0065] The robot (11) can determine a movement path and a driving plan using at least one of map data, object information detected from sensor information, or object information acquired from an external device, and control a driving unit to drive the robot (11) according to the determined movement path and driving plan.

[0066] Map data may include object identification information for various objects positioned in the space where the robot (11) moves. For example, map data may include object identification information for fixed objects such as walls and doors, as well as movable objects such as flower pots and desks. Furthermore, object identification information may include name, type, distance, location, etc.

[0067] Additionally, the robot (11) can perform actions or drive by controlling the driving unit based on the user's control / interaction. At this time, the robot (11) can acquire intention information regarding the interaction based on the user's actions or voice utterances, and determine a response based on the acquired intention information to perform the action.

[0068] <AI+자율주행>

[0069] Autonomous vehicles (12) can be implemented as mobile robots, vehicles, unmanned aerial vehicles, etc. by applying AI technology.

[0070] An autonomous vehicle (12) may include an autonomous driving control module for controlling autonomous driving functions. The autonomous driving control module may refer to a software module or a chip implementing the same as hardware. The autonomous driving control module may be included internally as a component of the autonomous vehicle (12), but may also be configured as separate hardware and connected to the exterior of the autonomous vehicle (12).

[0071] An autonomous vehicle (12) can obtain status information of the autonomous vehicle (12), detect (recognize) the surrounding environment and objects, generate map data, determine a movement path and driving plan, or determine an action by using sensor information obtained from various types of sensors.

[0072] Here, the autonomous vehicle (12) can use sensor information acquired from at least one sensor among lidar, radar, and camera, similar to the robot (11), to determine the movement path and driving plan.

[0073] In particular, an autonomous vehicle (12) can recognize an environment or object in an area where the field of vision is obscured or an area beyond a certain distance by receiving sensor information from external devices, or can receive information recognized directly from external devices.

[0074] An autonomous vehicle (12) can perform the above-described operations using a learning model comprised of at least one artificial neural network. For example, the autonomous vehicle (12) can recognize its surroundings and objects using the learning model, and determine a driving route using the recognized surrounding environment information or object information. Here, the learning model may be learned directly by the autonomous vehicle (12) or by an external device such as an AI server (16).

[0075] At this time, the autonomous vehicle (12) may perform an action by generating a result using a direct learning model, but may also perform an action by transmitting sensor information to an external device such as an AI server (16) and receiving the result generated accordingly.

[0076] An autonomous vehicle (12) can determine a movement path and a driving plan using at least one of map data, object information detected from sensor information, or object information acquired from an external device, and control a driving unit to drive the autonomous vehicle (12) according to the determined movement path and driving plan.

[0077] Map data may include object identification information for various objects located in the space (e.g., road) where the autonomous vehicle (12) travels. For example, map data may include object identification information for fixed objects such as streetlights, rocks, and buildings, as well as movable objects such as vehicles and pedestrians. Furthermore, object identification information may include name, type, distance, location, and the like.

[0078] Additionally, the autonomous vehicle (12) can perform actions or drive by controlling the driving unit based on the user's control / interaction. At this time, the autonomous vehicle (12) can acquire intention information regarding the interaction based on the user's actions or voice utterances, and determine a response based on the acquired intention information to perform the action.

[0079] <AI+XR>

[0080] The XR device (13) can be implemented as an HMD (Head-Mount Display), a HUD (Head-Up Display) equipped in a vehicle, a television, a mobile phone, a smart phone, a computer, a wearable device, a home appliance, digital signage, a vehicle, a fixed robot, or a mobile robot by applying AI technology.

[0081] The XR device (13) can obtain information about the surrounding space or real objects by analyzing 3D point cloud data or image data acquired through various sensors or from an external device to generate location data and attribute data for 3D points, and can render and output an XR object to be output. For example, the XR device (13) can output an XR object including additional information about a recognized object in correspondence with the recognized object.

[0082] The XR device (13) can perform the above-described operations using a learning model composed of at least one artificial neural network. For example, the XR device (13) can recognize a real-world object from 3D point cloud data or image data using the learning model, and provide information corresponding to the recognized real-world object. Here, the learning model may be learned directly in the XR device (13) or learned from an external device such as an AI server (16).

[0083] At this time, the XR device (13) may perform an action by generating a result using a direct learning model, but may also perform an action by transmitting sensor information to an external device such as an AI server (16) and receiving the result generated accordingly.

[0084] <AI+로봇+자율주행>

[0085] Robots (11) can be implemented as guide robots, transport robots, cleaning robots, wearable robots, entertainment robots, pet robots, unmanned flying robots, etc. by applying AI technology and autonomous driving technology.

[0086] A robot (11) to which AI technology and autonomous driving technology are applied may refer to a robot itself with autonomous driving functions, or a robot (11) that interacts with an autonomous vehicle (12).

[0087] A robot (11) with autonomous driving function can be a general term for devices that move on their own along a given path without user control or move by determining the path on their own.

[0088] A robot (11) and a self-driving vehicle (12) with autonomous driving capabilities may use a common sensing method to determine one or more of a movement path or a driving plan. For example, a robot (11) and a self-driving vehicle (12) with autonomous driving capabilities may use information sensed through lidar, radar, and cameras to determine one or more of a movement path or a driving plan.

[0089] A robot (11) interacting with an autonomous vehicle (12) may exist separately from the autonomous vehicle (12), and may be linked to autonomous driving functions inside or outside the autonomous vehicle (12), or may perform actions linked to a user riding in the autonomous vehicle (12).

[0090] At this time, the robot (11) interacting with the autonomous vehicle (12) can control or assist the autonomous driving function of the autonomous vehicle (12) by acquiring sensor information on behalf of the autonomous vehicle (12) and providing it to the autonomous vehicle (12), or by acquiring sensor information and generating surrounding environment information or object information and providing it to the autonomous vehicle (12).

[0091] Alternatively, a robot (11) interacting with an autonomous vehicle (12) may monitor a user riding in the autonomous vehicle (12) or control the functions of the autonomous vehicle (12) through interaction with the user. For example, if the robot (11) determines that the driver is drowsy, it may activate the autonomous driving function of the autonomous vehicle (12) or assist in controlling the driving unit of the autonomous vehicle (12). Here, the functions of the autonomous vehicle (12) controlled by the robot (11) may include not only the autonomous driving function, but also functions provided by a navigation system or audio system installed inside the autonomous vehicle (12).

[0092] Alternatively, a robot (11) interacting with an autonomous vehicle (12) may provide information to the autonomous vehicle (12) or assist functions from outside the autonomous vehicle (12). For example, the robot (11) may provide traffic information, including signal information, to the autonomous vehicle (12), such as a smart traffic light, or may interact with the autonomous vehicle (12) to automatically connect an electric charger to a charging port, such as an automatic electric charger for an electric vehicle.

[0093] <AI+로봇+XR>

[0094] Robots (11) can be implemented as guide robots, transport robots, cleaning robots, wearable robots, entertainment robots, pet robots, unmanned flying robots, drones, etc. by applying AI technology and XR technology.

[0095] A robot (11) to which XR technology is applied may refer to a robot that is the subject of control / interaction within an XR image. In this case, the robot (11) is distinct from the XR device (13) and can be linked with each other.

[0096] When a robot (11) that is the target of control / interaction within an XR image obtains sensor information from sensors including a camera, the robot (11) or the XR device (13) can generate an XR image based on the sensor information, and the XR device (13) can output the generated XR image. In addition, the robot (11) can operate based on a control signal input through the XR device (13) or a user's interaction.

[0097] For example, a user can check an XR image corresponding to the viewpoint of a remotely connected robot (11) through an external device such as an XR device (13), and through interaction, adjust the autonomous driving path of the robot (11), control the operation or driving, or check information on surrounding objects.

[0098] <AI+자율주행+XR>

[0099] Autonomous vehicles (12) can be implemented as mobile robots, vehicles, unmanned aerial vehicles, etc. by applying AI technology and XR technology.

[0100] An autonomous vehicle (12) to which XR technology is applied may refer to an autonomous vehicle equipped with a means for providing XR images, an autonomous vehicle that is the subject of control / interaction within an XR image, etc. In particular, an autonomous vehicle (12) that is the subject of control / interaction within an XR image is distinct from an XR device (13) and can be linked with each other.

[0101] An autonomous vehicle (12) equipped with a means for providing XR images can acquire sensor information from sensors including cameras and output XR images generated based on the acquired sensor information. For example, the autonomous vehicle (12) can be equipped with a HUD to output XR images, thereby providing passengers with XR objects corresponding to real objects or objects on the screen.

[0102] At this time, when the XR object is output to the HUD, at least a part of the XR object may be output so as to overlap with an actual object toward which the passenger's gaze is directed. On the other hand, when the XR object is output to a display provided inside the autonomous vehicle (12), at least a part of the XR object may be output so as to overlap with an object on the screen. For example, the autonomous vehicle (12) may output XR objects corresponding to objects such as a road, another vehicle, a traffic light, a traffic sign, a two-wheeled vehicle, a pedestrian, a building, etc.

[0103] When an autonomous vehicle (12) that is the target of control / interaction within an XR image acquires sensor information from sensors including a camera, the autonomous vehicle (12) or the XR device (13) generates an XR image based on the sensor information, and the XR device (13) can output the generated XR image. In addition, the autonomous vehicle (12) can operate based on a control signal input through an external device such as the XR device (13) or a user's interaction.

[0104] [Augmented Reality Technology]

[0105] Extended Reality (XR) is a general term for Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR). VR technology provides real-world objects and backgrounds only as CG images, AR technology provides virtually created CG images on top of images of real objects, and MR technology is a computer graphics technology that provides virtual objects mixed and combined in the real world.

[0106] MR technology is similar to AR in that it presents both real and virtual objects simultaneously. However, while AR uses virtual objects to complement real objects, MR uses virtual and real objects on an equal footing.

[0107] XR technology can be applied to HMD (Head-Mount Display), HUD (Head-Up Display), mobile phones, tablet PCs, laptops, desktops, TVs, digital signage, etc., and devices to which XR technology is applied can be called XR devices.

[0108] Below, an electronic device providing augmented reality according to an embodiment of the present invention will be described. In particular, a projector applicable to augmented reality and an electronic device including the same will be described in detail.

[0109] Figure 2 is a block diagram showing the configuration of an extended reality electronic device (20) according to an embodiment of the present invention.

[0110] Referring to FIG. 2, the extended reality electronic device (20) may include a wireless communication unit (21), an input unit (22), a sensing unit (23), an output unit (24), an interface unit (25), a memory (26), a control unit (27), and a power supply unit (28). The components illustrated in FIG. 2 are not essential for implementing the electronic device (20), and thus, the electronic device (20) described in this specification may have more or fewer components than the components listed above.

[0111] More specifically, among the above components, the wireless communication unit (21) may include one or more modules that enable wireless communication between the electronic device (20) and a wireless communication system, between the electronic device (20) and another electronic device, or between the electronic device (20) and an external server. In addition, the wireless communication unit (21) may include one or more modules that connect the electronic device (20) to one or more networks.

[0112] This wireless communication unit (21) may include at least one of a broadcast reception module, a mobile communication module, a wireless Internet module, a short-range communication module, and a location information module.

[0113] The input unit (22) may include a camera or video input unit for inputting video signals, a microphone or audio input unit for inputting audio signals, and a user input unit (e.g., a touch key, a mechanical key, etc.) for receiving information from a user. Voice data or image data collected by the input unit (22) may be analyzed and processed into a user's control command.

[0114] The sensing unit (23) may include one or more sensors for sensing at least one of information within the electronic device (20), information about the surrounding environment surrounding the electronic device (20), and user information.

[0115] For example, the sensing unit (23) may include at least one of a proximity sensor, an illumination sensor, a touch sensor, an acceleration sensor, a magnetic sensor, a G-sensor, a gyroscope sensor, a motion sensor, an RGB sensor, an infrared sensor (IR sensor), a fingerprint recognition sensor, an ultrasonic sensor, an optical sensor (e.g., a photographing device), a microphone, a battery gauge, an environmental sensor (e.g., a barometer, a hygrometer, a thermometer, a radiation detection sensor, a heat detection sensor, a gas detection sensor, etc.), and a chemical sensor (e.g., an electronic nose, a healthcare sensor, a biometric recognition sensor, etc.). Meanwhile, the electronic device (20) disclosed in the present specification may utilize information sensed by at least two or more of these sensors in combination.

[0116] The output unit (24) is for generating output related to visual, auditory, or tactile sensations, and may include at least one of a display unit, an audio output unit, a haptic module, and an optical output unit. The display unit may be formed as a touch screen by forming a mutual layer structure with a touch sensor or by forming an integral structure. This touch screen may function as a user input means that provides an input interface between the augmented reality electronic device (20) and the user, and at the same time, may provide an output interface between the augmented reality electronic device (20) and the user.

[0117] The interface unit (25) serves as a passageway for various types of external devices connected to the electronic device (20). Through the interface unit (25), the electronic device (20) can receive virtual reality or augmented reality content from the external device, and can perform mutual interaction by exchanging various input signals, sensing signals, and data.

[0118] For example, the interface unit (25) may include at least one of a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device equipped with an identification module, an audio I / O (Input / Output) port, a video I / O (Input / Output) port, and an earphone port.

[0119] In addition, the memory (26) stores data that supports various functions of the electronic device (20). The memory (26) can store a plurality of application programs (or applications) that run on the electronic device (20), data for the operation of the electronic device (20), and commands. At least some of these application programs can be downloaded from an external server via wireless communication. In addition, at least some of these application programs can exist on the electronic device (20) from the time of shipment for the basic functions of the electronic device (20) (e.g., call receiving and making functions, message receiving and making functions).

[0120] In addition to operations related to the application program, the control unit (27) typically controls the overall operation of the electronic device (20). The control unit (27) can process signals, data, information, etc. input or output through the components discussed above.

[0121] In addition, the control unit (27) can control at least some of the components by driving an application program stored in the memory (26) to provide appropriate information to the user or process a function. Furthermore, the control unit (27) can operate at least two or more of the components included in the electronic device (20) in combination with each other to drive the application program.

[0122] In addition, the control unit (27) can detect the movement of the electronic device (20) or the user by using a gyroscope sensor, gravity sensor, motion sensor, etc. included in the sensing unit (23). Alternatively, the control unit (27) can detect an object approaching the electronic device (20) or the user by using a proximity sensor, a light sensor, a magnetic sensor, an infrared sensor, an ultrasonic sensor, a light sensor, etc. included in the sensing unit (23). In addition, the control unit (27) can also detect the movement of the user by using sensors provided in a controller that operates in conjunction with the electronic device (20).

[0123] Additionally, the control unit (27) can perform operations (or functions) of the electronic device (20) using an application program stored in the memory (26).

[0124] The power supply unit (28) receives external power or internal power under the control of the control unit (27) and supplies power to each component included in the electronic device (20). The power supply unit (28) includes a battery, and the battery may be provided in a built-in or replaceable form.

[0125] At least some of the above components may cooperate with each other to implement the operation, control, or control method of the electronic device according to various embodiments described below. Furthermore, the operation, control, or control method of the electronic device may be implemented on the electronic device by driving at least one application program stored in the memory (26).

[0126] Hereinafter, an electronic device described as an example of the present invention will be described based on an embodiment applied to an HMD (Head Mounted Display). However, embodiments of the electronic device according to the present invention may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a PDA (personal digital assistant), a PMP (portable multimedia player), a navigation device, a slate PC, a tablet PC, an ultrabook, and a wearable device. In addition to an HMD, the wearable device may include a smart watch, a contact lens, VR / AR / MR Glass, and the like.

[0127] FIG. 3 is a perspective view of an augmented reality electronic device according to an embodiment of the present invention.

[0128] As illustrated in FIG. 3, an electronic device according to an embodiment of the present invention may include a frame (100), a projector device (200), and a display unit (300).

[0129] The electronic device may be provided as a glass type (smart glass). The glass type electronic device is configured to be worn on the head of the human body and may include a frame (case, housing, etc.) (100) for this purpose. The frame (100) may be formed of a flexible material to facilitate wearing.

[0130] The frame (100) is supported by the head and provides a space for mounting various components. As illustrated, electronic components such as a projector device (200), a user input unit (130), or an audio output unit (140) may be mounted on the frame (100). In addition, a lens covering at least one of the left and right eyes may be detachably mounted on the frame (100).

[0131] The frame (100) may have a shape of glasses worn on the face of the user's body as shown in the drawing, but is not necessarily limited thereto, and may also have a shape of goggles or the like worn in close contact with the user's face.

[0132] Such a frame (100) may include a front frame (110) having at least one opening, and a pair of side frames (120) extending in the y direction (in FIG. 3) intersecting the front frame (110) and being parallel to each other.

[0133] The frame (100) may have the same or different length (DI) in the x direction and length (LI) in the y direction.

[0134] The project device (200) is provided to control various electronic components provided in an electronic device. The project device (200) may be used interchangeably with 'optical output device', 'optical projector device', 'light irradiation device', 'optical device', etc.

[0135] The projector device (200) can generate an image or a video of a sequence of images that are displayed to the user. The projector device (200) can include an image source panel that generates an image and a plurality of lenses that diffuse and converge light generated from the image source panel.

[0136] The project device (200) may be fixed to one of the two side frames (120). For example, the project device (200) may be fixed to the inside or outside of one of the side frames (120), or may be integrally formed by being built into the inside of one of the side frames (120). Alternatively, the project device (200) may be fixed to the front frame (110) or may be provided separately from the electronic device.

[0137] The display unit (300) may be implemented in the form of a head-mounted display (HMD). The HMD form refers to a display method that is mounted on the head and directly displays an image in front of the user's eyes. When the user wears the electronic device, the display unit (300) may be positioned to correspond to at least one of the left and right eyes so that the image can be directly displayed in front of the user's eyes. In this drawing, the display unit (300) is positioned in a portion corresponding to the right eye so as to output an image toward the user's right eye. However, as described above, the present invention is not limited thereto and may be positioned for both the left and right eyes.

[0138] The display unit (300) can allow the user to visually perceive the external environment while simultaneously displaying images generated by the projector device (200). For example, the display unit (300) can project images onto the display area using a prism.

[0139] The display unit (300) may be formed to be translucent so that the projected image and the general field of view in front (the range that the user sees through his eyes) can be viewed simultaneously. For example, the display unit (300) may be translucent and formed of an optical member including glass.

[0140] And the display unit (300) can be inserted into and fixed to an opening included in the front frame (110), or can be positioned on the back surface of the opening (i.e., between the opening and the user) and fixed to the front frame (110). In the drawing, an example in which the display unit (300) is positioned on the back surface of the opening and fixed to the front frame (110) is shown, but the display unit (300) can be positioned and fixed to various positions of the frame (100).

[0141] As illustrated in FIG. 3, when the electronic device projects image light from the projector device (200) onto one side of the display unit (300), the image light is emitted to the other side through the display unit (300), thereby allowing the user to see the image generated from the projector device (200).

[0142] Accordingly, the user can view the external environment through the opening of the frame (100) and simultaneously view the image generated by the projector device (200). That is, the image output through the display unit (300) can be seen to overlap with the general field of view. By utilizing these display characteristics, electronic devices can provide augmented reality (AR) that superimposes a virtual image on a real image or background and shows it as a single image.

[0143] Furthermore, in addition to these operations, images generated by the external environment and the projector device (200) may be presented to the user with a time difference for a short period of time that is not perceptible to the user. For example, within a single frame, the external environment may be presented to the user during one section, while images from the projector device (200) may be presented to the user during another section. Alternatively, both overlap and time difference may be provided.

[0144] The following display unit may be expressed as a light guide device. The light guide device according to the embodiment may correspond to the display unit included in the augmented reality electronic device according to the above embodiment.

[0145] Hereinafter, the first direction may correspond to the X-axis direction in the drawing, and the second direction may correspond to the Y-axis direction in the drawing. The first direction and the second direction may be directions perpendicular to each other. In addition, the third direction may correspond to the incident direction of light.

[0146] Figure 4 is a schematic diagram of a light guide device according to an embodiment of the present invention.

[0147] Referring to FIG. 4, the light guide device (300) according to the embodiment may include a first substrate (310), a first input diffractive element (320), a first output diffractive element (330), a reflective layer (340), a first transmission diffractive element (not shown), and a cover (not shown).

[0148] The light guide device (300) can change the path of light that is output from the projector device and then output the light to the outside again. The light can sequentially enter the first input diffraction element (320), the first substrate (310), the first transmission diffraction element, and the first output diffraction element (330) and be output to the outside again. The direction in which the light enters the light guide device (300) may be a third direction. The third direction may mean the direction in which the light enters or the opposite direction.

[0149] The first substrate (310) can serve as a path for transmitting light. A first input diffractive element (320), a first transmission diffractive element, a first output diffractive element (330), or a reflective layer (340) can be arranged on the first substrate (310). The light can be totally reflected within the first substrate (310) and travel along the interior of the first substrate (310). The first substrate (310) can include a waveguide. The first input diffractive element (320), the first transmission diffractive element, and the first output diffractive element (330) can be arranged spaced apart from each other on the first substrate (310). The first substrate (310) can be arranged in the second direction.

[0150] The first substrate (310) may include a first surface (S1) and a second surface (S2). The first surface (S1) may be a surface onto which light enters. In addition, the second surface (S2) may be a surface from which light exits. The second surface (S2) may be a surface spaced apart from the first surface (S1). The first surface (S1) and the second surface (S2) may be surfaces spaced apart in a first direction. The first surface (S1) and the second surface (S2) may be parallel to each other. The first surface (S1) and the second surface (S2) may be arranged parallel to each other along the second direction. A first input diffraction element (320), a first transmission diffraction element, a first output diffraction element (330), or a reflective layer (340) may be arranged on the first surface (S1) or the second surface (S2).

[0151] The first input diffraction element (320) can serve as a path through which light is incident. The first input diffraction element (320) can be placed on the first substrate (310). Light can be incident from the outside onto the light guide device (300) through the first input diffraction element (320) and transmitted through the first substrate (310). The first input diffraction element (320) can change the path of light by diffracting the light.

[0152] Light passing through the first input diffraction element (320) may be partially diffracted and partially passed through without being diffracted. The first input diffraction element (320) may allow light to pass through and separate the light into first light (l1) that is diffracted and second light (l2) that is not diffracted. The first light (l1) may be diffracted so that the path of the light may change by a certain angle. The second light (l2) that is not diffracted by the first input diffraction element (320) may be refracted by the first substrate (310) or may pass through the first substrate (310). The paths of the first light (l1) and the second light (l2) may be different.

[0153] The first transfer diffraction element can serve to change the path of light. The first transfer diffraction element can be arranged on the first substrate (310). The first transfer diffraction element can change the path of light incident through the first input diffraction element (320). The first transfer diffraction element can change the path of light so that it is directed toward the first output diffraction element (330). The first transfer diffraction element can change the path of light by diffracting the light.

[0154] The first exit diffraction element (330) can serve as a path through which light is emitted. The first exit diffraction element (330) can be disposed on the first substrate (310). Light can be emitted to the outside of the light guide device (300) through the first exit diffraction element (330). The first exit diffraction element (330) can receive light whose path has been changed from the first transmission diffraction element and emit it to the outside. The first exit diffraction element (330) can change the path of the light and emit it to the outside. The first exit diffraction element (330) can change the path of the light by diffracting the light.

[0155] The first input diffractive element (320) and the first output diffractive element (330) may include a plurality of protrusions. The plurality of protrusions may have a constant width, period, and height and may be arranged on the first input diffractive element (320) and the first output diffractive element (330). The plurality of protrusions may protrude in a first direction on the first input diffractive element (320) and the first output diffractive element (330). The plurality of protrusions may be arranged to be spaced apart from each other in the vector direction of the pattern including the protrusions. Depending on the width, period, and height of the plurality of protrusions, the path of light after passing through the first input diffractive element (320) and the first output diffractive element (330) may be changed differently.

[0156] The reflective layer (340) can serve to reflect light. The reflective layer (340) can be disposed on the first substrate (310). The reflective layer (340) can reflect light that has passed through the first input diffractive element (320). The light that has passed through the first input diffractive element (320) can pass through the first substrate (310) and reach the reflective layer (340) and be reflected by the reflective layer (340). The reflective layer (340) can reflect the light back toward the first input diffractive element (320). The reflective layer (340) can include a mirror coating layer.

[0157] The reflective layer (340) may overlap with the first input diffractive element (320) in the first direction. The reflective layer (340) may be arranged to overlap with the first input diffractive element (320) in the first direction to reflect light passing through the first input diffractive element (320). The reflective layer (340) and the first input diffractive element (320) may be arranged on the same surface or different surfaces of the first substrate (310). Referring to FIG. 4, the first input diffractive element (320) and the first output diffractive element (330) may be arranged on the first surface (S1) of the first substrate (310), and the reflective layer (340) may be arranged on the second surface (S2) of the first substrate (310). The reflective layer (340) may not overlap with the first output diffractive element (330) in the first direction.

[0158] The reflective layer (340) can reflect the second light (l2). The reflective layer (340) can reflect the second light (l2) so that the second light (l2) can reach the first input diffractive element (320) again. The second light (l2) can reach the first input diffractive element (320) and be diffracted. The second light (l2) can be diffracted by the first input diffractive element (320) and change its path. The second light (l2) can be diffracted by the first input diffractive element (320) and propagate along the inside of the first substrate (310). The second light (l2) can include the 2-1 light (l2-1) that passes through the first input diffractive element (320) and is diffracted again, and the 2-2 light (l2-2) that is not diffracted. The second-first light (l2-1) can be diffracted by the first input diffraction element (320) and then propagate through the interior of the first substrate (310). The path of the second-first light (l2-1) can be parallel to the path of the first light (l1). The reflection layer (340) can increase the incoupling efficiency of the light by reflecting the first light (l2) that has passed through the first input diffraction element (320) and allowing it to reach the first input diffraction element (320) again. The amount of light that is totally reflected and propagates through the interior of the first substrate (310) by the reflection layer (340) can be increased, thereby improving the optical performance of the electronic device.

[0159] Figures 5 to 8 are schematic diagrams of a light guide device according to another embodiment of the present invention.

[0160] Referring to FIG. 5, the light guide device (300) may include an intermediate layer (350). The intermediate layer (350) may be disposed between the first input diffractive element (320) and the reflective layer (340). The intermediate layer (350) may overlap the first input diffractive element (320) and the reflective layer (340) in a first direction. The intermediate layer (350) may be disposed on the second surface (S2) of the first substrate (310). A reflective layer (340) may be disposed on the intermediate layer (350). By disposing the intermediate layer (350), a total reflection angle may be maintained so that light diffracted by the first input diffractive element (320) may be totally reflected within the first substrate (310). The intermediate layer (350) may include a material having a refractive index similar to that of air.

[0161] Referring to FIG. 6, the first input diffractive element (320) and the first output diffractive element (330) may be arranged on the second surface (S2) of the first substrate (310). Light incident on the light guide device (300) may pass through the first substrate (310) and reach the first input diffractive element (320). The first light diffracted by the first input diffractive element (320) may propagate through total reflection within the first substrate (310). An intermediate layer (350) and a reflective layer (340) may be arranged on the first input diffractive element (320). The second light (l2) that is not diffracted by the first input diffractive element (320) may pass through the first input diffractive element (320) and the intermediate layer (350) and be reflected by the reflective layer (340). The second light (l2) may be reflected by the reflective layer (340), pass through the intermediate layer (350), and be diffracted by the first input diffraction element (320). Referring to FIG. 7, the intermediate layer (350) may include an air gap. The intermediate layer (350) may include an air gap so that the total reflection angle can be maintained when the light is totally reflected within the first substrate (310), thereby increasing the light transmission efficiency.

[0162] Referring to FIG. 7, the light guide device (300) may further include a second substrate (360), a second input diffractive element (370), and a second output diffractive element (380). The second substrate (360) may be spaced apart from the first substrate (310) in a first direction. The second substrate (360) may be placed on a path along which light is incident on the first substrate (310). The second input diffractive element (370) and the second output diffractive element (280) may be placed on the second substrate (360). Light may be incident through the second input diffractive element (370) and may be emitted through the second output diffractive element (380).

[0163] The second input diffraction element (370) can diffract light of a specific wavelength band. The second input diffraction element (370) can transmit light of a first wavelength band and diffract light of a second wavelength band different from the first wavelength band. The light of the second wavelength band can be diffracted by the second input diffraction element (370) and propagate through total reflection inside the second substrate (360). The light of the first wavelength band can pass through the second input diffraction element (370) and enter the first input diffraction element (320). In this case, the reflective layer (340) can reflect the light of the first wavelength band. The plurality of substrates of the light guide device (300) can transmit light of different wavelength bands, and the reflective layer (340) can be disposed on the substrate disposed at the bottom to reflect the light of the wavelength band transmitted by the substrate. Ultimately, the reflective layer (340) can increase the coupling efficiency of light of a specific wavelength band by reflecting light of a specific wavelength band and allowing it to reach the input diffraction element again. By increasing the amount of light of a specific wavelength band that is totally reflected and propagates within the first substrate (310) by the reflective layer (340), the optical performance of the electronic device can be improved.

[0164] FIG. 8 is a drawing showing the path of light passing through a light guide device according to an embodiment of the present invention.

[0165] Referring to Fig. 8, the second light (l2) is incident on the first substrate (310) and refracted, and the diffraction angle of the first light (l1) may be greater than the refracted angle of the second light (l2). The incident direction of the light may not be perpendicular to the first substrate (310). In this case, the second light (l2) that is not diffracted by the first input diffraction element (320) may be refracted by the first substrate (310). The second light (l2) may be reflected by the reflective layer (340) after being refracted by the first substrate (310). In addition, the second light (l2) may be reflected by the reflection layer (340) and then diffracted or reflected again by the first input diffraction element (320). The second light reflected by the first input diffraction element (320) may be repeatedly reflected by the reflection layer (340). At this time, since the refraction angle of the second light (l2) is smaller than the diffraction angle of the first light (l1), the second light (l2) may be reflected by the reflection layer (340) at a denser interval, and thus may be diffracted by the first input diffraction element (320) at a denser interval. Therefore, the incoupling efficiency of light may be increased, and the amount of light emitted may be increased. Ultimately, the optical performance and efficiency of the light guide device (300) may be improved.

[0166] The diffraction angle of the first light (l1) and the refraction angle of the second light (l2) can satisfy mathematical expression 1.

[0167]

[0168] (Here, t is the thickness of the first substrate, θ1 is the diffraction angle of the first light, and θ2 is the refraction angle of the second light)

[0169] Since the second direction movement width according to the refraction angle of the second light (l2) is smaller than the second direction movement width according to the diffraction angle of the first light (l1), the second light (l2) can be reflected at a denser interval on the reflective layer (340), and thus can be diffracted at a denser interval on the first input diffractive element (320). Accordingly, the incoupling efficiency of light can be increased, and the amount of light emitted can be increased. Ultimately, the optical performance and efficiency of the light guide device (300) can be improved.

Claims

1. First substrate; A first input diffraction element disposed on the first substrate, into which light is incident, and a first output diffraction element from which the light is emitted; and Including a reflective layer disposed on the first substrate, The first input diffraction element passes the light through and separates it into a first light that is diffracted and a second light that is not diffracted, The above reflective layer is a light guide device that reflects the second light toward the first input diffractive element.

2. In paragraph 1, The above reflective layer overlaps the first input diffractive element in the first direction, A light guide device in which the first direction is perpendicular to the first substrate.

3. In paragraph 1, A light guide device including an intermediate layer disposed between the first input diffraction element and the reflective layer.

4. In paragraph 3, A light guide device wherein the first substrate includes a first surface onto which the light is incident and a second surface spaced apart from the first surface.

5. In paragraph 4, A light guide device in which the first input diffraction element and the first output diffraction element are arranged on the first surface.

6. In paragraph 5, The above intermediate layer is arranged on the second surface, The above reflective layer is a light guide device disposed in the intermediate layer.

7. In paragraph 4, A light guide device in which the first input diffraction element and the first output diffraction element are arranged on the second surface.

8. In paragraph 7, The above intermediate layer is disposed on the first input diffractive element, The above reflective layer is a light guide device disposed in the intermediate layer.

9. In paragraph 1, A light guide device in which the second light is reflected by the reflective layer and then passes through the first input diffraction element.

10. In paragraph 9, A light guide device including the second light, which passes through the first input diffraction element and is diffracted again, and the second light, which is not diffracted.

Images