Electronic device and method for providing three-dimensional image
The electronic device uses light emitting modules and an eye tracker to adjust focal distance for three-dimensional image display, addressing driver distraction and fatigue by maintaining focus on the driving environment.
Patent Information
- Application Number
- JP2024074417
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-04-05
- Filing Date
- 2024-05-01
- Publication Date
- 2024-11-15
AI Technical Summary
When a driver views the driving environment ahead and adjusts focus to check navigation information or vehicle instruments, it reduces vehicle stability and increases eye fatigue.
An electronic device with first and second light emitting modules and an eye tracker adjusts the focal distance between images displayed on a vehicle's windshield based on the driver's eye position, using binocular parallax to provide three-dimensional images.
The device maintains driver focus on the forward environment while providing necessary information, reducing eye fatigue and enhancing vehicle stability.
Smart Images

Figure 2024160990000001_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to electronic devices and methods for providing three-dimensional images. [Background technology]
[0002] Various devices have been developed to allow a driver to obtain vehicle information while watching the driving environment ahead while driving. For example, a head-up display is installed in a vehicle, allowing the driver to obtain vehicle information without checking the instrument panel. The head-up display mounted in the vehicle can provide the driver with visual information via light reflected from the windshield glass of the vehicle. Summary of the Invention [Problem to be solved by the invention]
[0003] While a vehicle is traveling, a driver is gazing at the forward environment. If the driver moves his / her eyes to check navigation information or information through the vehicle's instrument panel while gazing at the forward environment, the stability of the vehicle's traveling may be reduced. When the driver gazes at the forward environment at a relatively distant distance and adjusts his / her focus to recognize visual information displayed through a device inside the vehicle, the degree of eye fatigue of the driver may increase. To solve this, a method is required for the driver to easily recognize visual information required while the vehicle is traveling.
[0004] The technical problems to be achieved in this specification are not limited to the above-mentioned technical problems, and other technical problems not described will be clearly understood by a person having ordinary skill in the art to which the present invention pertains from the following description. [Means for solving the problem]
[0005] The electronic device may include a first light emitting module, a second light emitting module, a screen configured to provide a user with an image by light emitted from the first light emitting module and the second light emitting module, and an eye tracker configured to sense an eye position of the user. The first light emitting module and the second light emitting module may be configured to adjust a focal distance between the image and the user's eyes based on the eye position of the user acquired via the eye tracker.
[0006] A method of operating an electronic device may include the steps of identifying an eye position of a driver of a vehicle, emitting light via a first light-emitting module toward a windshield of the vehicle to transmit a first image to a first eye of the driver, emitting light via a second light-emitting module toward a windshield of the vehicle to transmit a second image to a second eye of the driver, and controlling attitudes of the first light-emitting module and the second light-emitting module based on the identified driver's eye position. A focus of image information reflected by the windshield of the vehicle may be adjusted according to binocular disparity between a first virtual object in the first image and a second virtual object in the second image.
[0007] In one embodiment, a non-transitory computer readable storage medium storing one or more programs may include instructions, when executed by an electronic device, that cause the electronic device to identify an eye position of a driver of a vehicle. The one or more programs may include instructions, when executed by the electronic device, that cause the electronic device to emit light via a first light emitting module toward a windshield of the vehicle to convey a first image to a first eye of the driver. The one or more programs may include instructions, when executed by the electronic device, that cause the electronic device to emit light via a second light emitting module toward a windshield of the vehicle to convey a second image to a second eye of the driver. The one or more programs may include instructions, when executed by the electronic device, that cause the electronic device to control a posture of the first light emitting module and the second light emitting module based on the identified driver's eye position. A binocular disparity between a first virtual object in the first image and a second virtual object in the second image may adjust the focus of image information reflected by the windshield of the vehicle. Effect of the Invention
[0008] According to one embodiment, an electronic device and method for providing three-dimensional images can provide visual information within the driver's field of vision while the driver is looking ahead.
[0009] According to one embodiment, an electronic device and method for providing three-dimensional images can reduce eye fatigue for a user by displaying visual information at a location that corresponds to an external object that the driver is looking at.
[0010] The effects obtained by the present disclosure are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by a person having ordinary skill in the art to which the present disclosure pertains from the following description. [Brief description of the drawings]
[0011] [Figure 1] 4 shows an example of vehicle information provided via an electronic device mounted in a vehicle. [Diagram 2] An example of displaying vehicle information stereoscopically via an electronic device will be described. [Figure 3a] 1 illustrates the layout of components of an exemplary electronic device. [Figure 3b] 1 illustrates the optical path of visual information transmitted through light transmitted through components of an exemplary electronic device to the driver's eyes. [Figure 4a] 1 illustrates the layout of components of an exemplary electronic device that includes a projector. [Figure 4b] 1 illustrates the optical path of visual information transmitted through light transmitted to a driver's eyes via components of an exemplary electronic device, including a projector. [Diagram 5] FIG. 1 shows a block diagram of an exemplary electronic device installed in a vehicle. [Figure 6] 4 is a flowchart showing the operation of the electronic device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0012] The electronic device according to various embodiments disclosed herein may be a device in various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), an electronic device controlled by a portable communication device, a computer device, a portable multimedia device, a camera, an electronic device, or an electronic device mounted in a vehicle. The electronic device according to the embodiments disclosed herein is not limited to the aforementioned devices.
[0013] It should be understood that the various embodiments and the terms used therein are not intended to limit the technical features described herein to a particular embodiment, but include various modifications, equivalents, or alternatives of the embodiments. With respect to the description of the drawings, similar or related components may use similar reference numerals. The singular form of a noun corresponding to an item may include one or more of the item, unless the relevant context clearly indicates otherwise. In this specification, each of phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may include any of the items listed together in the corresponding phrase of the phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish the component from other corresponding components, and do not limit the component to other aspects (e.g., importance or order). When a (e.g., first) component is referred to as being "coupled" or "connected" to another (e.g., second) component, either in combination with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., by wire), wirelessly, or through a third component.
[0014] Various embodiments of the present specification may be implemented as software including one or more instructions stored in a storage medium readable by a machine. For example, a processor of the machine may retrieve and execute at least one of the one or more instructions stored in the storage medium. This allows the machine to operate to perform at least one function according to the retrieved at least one instruction. The one or more instructions may include a code generated by a compiler or a code that may be executed by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, the term "non-transitory" only means that the storage medium is a tangible device and does not include a signal (e.g., electromagnetic wave), and the term does not distinguish between a case where data is stored semi-permanently and a case where data is stored temporarily in the storage medium.
[0015] According to an embodiment, the method according to the various embodiments disclosed herein may be provided in a computer program product. The computer program product may be traded between a seller and a buyer as a commodity. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read only memory (CD-ROM)) or distributed online (e.g., downloaded or uploaded) via an application store or directly between two user devices (e.g., smartphone, electronic device in a vehicle). In case of online distribution, at least a part of the computer program product may be at least temporarily stored or temporarily generated in a machine-readable storage medium such as a memory of a manufacturer's server, an application store's server, or an intermediary server.
[0016] According to various embodiments, each of the components (e.g., modules or programs) may include one or more entities, and some of the entities may be located separately in different components. According to various embodiments, one or more of the aforementioned components or operations may be omitted, or one or more other components or operations may be added. Alternatively or additionally, multiple components (e.g., modules or programs) may be integrated into one component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as performed by the corresponding component of the multiple components before integration. According to various embodiments, the operations performed by the modules, programs, or other components may be performed sequentially, in parallel, iteratively, or empirically, or one or more of the operations may be performed in a different order, omitted, or one or more other operations may be added.
[0017] Hereinafter, with reference to the drawings, an embodiment of the present disclosure will be described in detail so that a person having ordinary skill in the art to which the present disclosure belongs can easily carry out the present disclosure. However, the present disclosure can be carried out in various different forms and is not limited to the embodiments described herein. In the description of the drawings, the same or similar components may be designated by the same or similar reference numerals. Furthermore, in the drawings and related description, for the sake of clarity and conciseness, descriptions of well-known functions and configurations may be omitted.
[0018] Fig. 1 shows an example of vehicle information provided via an electronic device mounted on a vehicle. Fig. 2 shows an example of vehicle information being displayed three-dimensionally via the electronic device.
[0019] 1, while the vehicle 1 is traveling, the vehicle 1 or an electronic device mounted on the vehicle 1 (e.g., electronic device 100 in FIG. 3a, electronic device 200 in FIG. 4a) can provide visual information to a driver (or user) aboard the vehicle 1. The vehicle 1 or an electronic device mounted on the vehicle 1 can provide visual information to the driver via a display mounted on the vehicle's instrument panel or inside the vehicle. The vehicle 1 or an electronic device mounted on the vehicle 1 can provide visual information to a user via a display (e.g., a head up display (HUD)) configured to be reflected on the windshield (or front glass) of the vehicle.
[0020] According to an embodiment, the vehicle 1 or the electronic device mounted on the vehicle 1 may be configured to provide visual information provided via the HUD in a stereoscopic manner. For example, the visual information provided via the HUD may have a perspective. The driver needs to change the focus of his / her eyes while driving to see the visual information displayed on the instrument panel, the in-car display, or the windshield via the HUD. For example, the driver may feel difficulty in responding to an emergency situation or experience increased eye fatigue by changing the field of view or changing the focus to confirm the visual information of the vehicle while gazing at an external object 20 (e.g., a road, a vehicle, or a background) of the vehicle 1.
[0021] According to an embodiment, the vehicle 1 or the electronic device mounted on the vehicle 1 may be configured to adjust the position of the display of visual information provided via the HUD. The vehicle 1 or the electronic device mounted on the vehicle 1 may display a visual object 11 on the virtual screen 10. The visual object 11 may include image information or an icon selected from at least one of a driving direction, a driving distance, a remaining distance, a moving path, a driving speed, surrounding position information, or a combination thereof. The focal distance between the visual object 11' displayed at a fixed position and the driver's eyes may be different from the focal distance between the external object 20 that the driver is gazing at and the driver's eyes. In order to identify the visual object 11' displayed at a fixed position, the driver may change the focal distance corresponding to the visual object 11' displayed at the fixed position, which may make it difficult to identify the surrounding environment and increase the degree of fatigue. According to an embodiment, the vehicle 1 or the electronic device mounted on the vehicle 1 may be configured to adjust the position of the virtual screen 10 on which the visual object 11 is displayed in order to maintain the driver's focal distance so as to reduce the degree of eye fatigue. For example, when the vehicle 1 or an electronic device mounted on the vehicle 1 identifies that the driver of the vehicle 1 is looking at an external object 20, it can adjust the virtual screen 10 on which the visual object 11 is displayed to be positioned at a point corresponding to the focal distance between the external object 20 and the eyes of the driver of the vehicle 1. A method for displaying the perspective of a visual object displayed on the virtual screen 10 will be described with reference to Figure 2.
[0022] With reference to FIG. 2, the vehicle 1 or electronic device disposed on the vehicle 1 may include a screen 40 disposed in front of a driver of the vehicle 1. The screen 40 may function as a part of the windshield of the vehicle. The screen 40 disposed on the windshield may function as a component of a HUD that provides a visual object 11 to a user. Although the screen 40 has been described as functioning as a part of the windshield of the vehicle 1, the embodiment is not so limited. For example, the screen 40 may be disposed or implemented on an element including a transparent glass or a transparent polymer disposed between the windshield of the vehicle 1 and the driver. An example of the structure of an electronic device including the screen 40 is described with reference to FIGS. 3a, 3b, 4a and 4b.
[0023] According to an embodiment, the screen 40 can perform functions related to augmented reality (AR) and / or mixed reality (MR). When the driver is in the vehicle 1, the screen 40 arranged or mounted on the windshield (or front glass) can combine visible light representing the surrounding environment transmitted through the windshield (or front glass) with light emitted through the screen 40. Since the screen 40 combines the light, the driver can see an image that is a mixture of the surrounding environment including objects outside the vehicle and the visual object 11 formed by the light emitted through the screen 40. The image of the visual object 11 may be displayed on a virtual screen 10 arranged outside the vehicle 1.
[0024] According to one embodiment, the screen 40 may include at least one light-emitting module 41a, 41b aligned toward each of the user's eyes e1, e2. The screen 40 may include a first light-emitting module 41a and a second light-emitting module 41b. The light-emitting element of the first light-emitting module 41a may be arranged to face the first eye e1 (e.g., the left eye of the driver) of the driver who is in the vehicle 1, and the light-emitting element of the second light-emitting module 41b may be arranged to face the second eye e2 (e.g., the right eye of the driver) of the driver who is in the vehicle 1.
[0025] The vehicle 1 or electronic device including the screen 40 can provide a virtual screen 10. The screen 40, the vehicle 1 or electronic device including the screen 40 can display a visual object 11 having a three-dimensional position in the virtual screen 10. The screen 40 can change a first position of the visual object 11a in the first image 30a provided through the light-emitting module of the first light-emitting module 41a and a second position of the visual object 11b in the second image 30b provided through the light-emitting module of the second light-emitting module 41b to change the distance of the visual object 11 in the virtual screen 10 recognized by the user. For example, by adjusting the difference between the first position and the second position, the screen 40, the vehicle 1 or electronic device including the screen can adjust the perspective of the visual object 11 in the virtual screen 10. As the difference between the first position and the second position increases, the binocular disparity a of the visual object 11 can increase. With the increase in the binocular disparity a, the screen 40 can provide a sensation that the visual object 11 in the virtual screen 10 is getting closer. For example, the visual object 11a in the first image 30a may be located at a first position, and the visual object 11b in the second image 30b may be located at a second position. The visual objects 11a and 11b may represent objects corresponding to each other. If the first position of the visual object 11a in the first image 30a is a point at a distance d1 from a point in the first image 30a, and the second position of the visual object 11b in the second image 30b is a point at a distance d2 from a point in the second image 30b, the screen 40 may display the visual object 11 as being located on the surface of the virtual screen 10. When the second position of the visual object 11b in the second image 30b is moved to the visual object 11b' in order to adjust the perspective of the visual object 11, the position of the visual object 11b' may be a point at a distance d2' from a point in the second image 30b.The moved visual object 11b' in the second image 30b increases the binocular disparity a, and the increased binocular disparity a allows the user to perceive the visual object 11 approaching from the virtual screen 10 on the screen 40.
[0026] The binocular disparity a of the visual object 11 may decrease as the difference between the first position and the second position decreases. As the binocular disparity a decreases, the screen 40 can provide a sensation that the visual object 11 in the virtual screen 10 is moving away. For example, the visual object 11a in the first image 30a can be located at a first position, and the visual object 11b' in the second image 30b can be located at a position different from the second position. In order to adjust the perspective of the visual object 11, when the position of the visual object 11b' in the second image 30b is moved to the second position of the visual object 11b, the position of the visual object 11b may be a point at a distance d2 from a point in the second image 30b. The binocular disparity a decreases due to the moved visual object 11b in the second image 30b, and the screen 40 can make the user recognize that the visual object 11 is moving away from the virtual screen 10 due to the decreased binocular disparity a.
[0027] According to an embodiment, the screen 40 or the electronic device including the screen 40 may be configured to track the driver's gaze using at least one optical input device (e.g., a camera) such as an eye tracker (e.g., eye tracker 130 in FIG. 3a or eye tracker 230 in FIG. 4a). The screen 40 or the electronic device including the screen 40 may be configured to identify the driver's gaze position and change the position of the visual object 11 provided to the driver when the driver gets into the vehicle, when the driver's posture in the vehicle changes, or when a change occurs in the driver's gaze gazing outside. According to an embodiment, the screen 40 or the electronic device including the screen 40 may perform a calibration related to the gaze position to compensate or reduce an error in the gaze position caused by the positional relationship.
[0028] In one embodiment, to perform the calibration, the screen 40 or an electronic device including the screen 40 can obtain calibration information related to gaze position. The calibration information may include information related to calculating the gaze position. For example, the calibration information may include at least one of images and / or videos captured using an eye tracker and / or a result of calculating the gaze position from the images and / or videos.
[0029] Figure 3a illustrates the layout of components of an exemplary electronic device, and Figure 3b illustrates the optical path of visual information transmitted through light transmitted through components of an exemplary electronic device to the driver's eyes.
[0030] 3a and 3b, the electronic device 100 may include a screen 110 and an eye-gaze tracker 130. The electronic device 100 may be mounted in a vehicle. The electronic device 100 may be implemented in an ECU (electronic control unit) included in the vehicle. The screen 110 may operate as a display that provides visual information to a user. The screen 110 may function as at least a part of a windshield of the vehicle (e.g., vehicle 1 in FIG. 1). For example, the screen 110 may be disposed adjacent to or integrated into the windshield of the vehicle (e.g., vehicle 1 in FIG. 1). The screen 110 may be referred to as a head-up display.
[0031] According to an embodiment, the screen 110 can operate as a transparent display. For example, the first light emitting module 111 and the second light emitting module 112 arranged in the screen 110 can include light emitting elements such as transparent organic light emitting diodes (OLEDs). The screen 110 can be configured to provide an image formed by light emitted from the first light emitting module 111 and the second light emitting module 112 to a user. The screen 110 operating as a transparent display can transmit light from outside the vehicle 1 to the inside of the vehicle 1. An image formed by light emitted from the first light emitting module 111 and the second light emitting module 112 may be displayed so as to be superimposed on an external environment formed by light transmitted to the inside of the vehicle 1 through the screen 110 operating as a transparent display. The first light emitting module 111 and the second light emitting module 112 can include a flexible and transparent substrate. For example, the first light emitting module 111 and the second light emitting module 112 can include a substrate formed of a transparent and flexible polymer (e.g., PI (polyimide)) on which a plurality of light emitting elements are arranged. The first light emitting module 111 and the second light emitting module 112 include a transparent substrate, and thus can transmit light transmitted from the outside of the vehicle 1 to the driver p of the vehicle 1. The first light emitting module 111 and the second light emitting module 112 are flexible, and thus can be disposed on the curved windshield 101.
[0032] The electronic device 100 can provide different images to each of the eyes of the driver p through the screen 110 so that the driver p feels a stereoscopic sensation. The first light-emitting module 111 and the second light-emitting module 112 may be configured to provide visual information toward the eye e of the driver p. The first light-emitting module 111 may be configured to provide visual information (e.g., the first image 30a in FIG. 2) to the first eye e1 of the driver p, and the second light-emitting module 112 may be configured to provide visual information (e.g., the second image 30b in FIG. 2) to the second eye e2 of the driver p. The first light-emitting module 111 and the second light-emitting module 112 may include a plurality of light-emitting elements 111a, 111b, ... 111n, 112a, 112b, ... 112n. The screen 110 may include inclined surfaces i1, i2 on which the multiple light-emitting elements 111a, 111b, ... 111n, 112a, 112b, ... 112n are arranged so that the multiple light-emitting elements 111a, 111b, ... 111n, 112a, 112b, ... 112n provide different images to both eyes of the user. The inclined surfaces i1, i2 may have an inclination with respect to the outer surface of the screen 110. The first inclined surface i1 having a first inclination and the second inclined surface i2 having a second inclination may be arranged alternately. The first inclined surface i1 may be inclined toward the first eye e1 of the driver p, and the second inclined surface i2 may be inclined toward the second eye e2 of the driver p.
[0033] According to an embodiment, the first light-emitting module 111 may include a plurality of first light-emitting elements 111a, 111b, ... 111n. Each of the plurality of first light-emitting elements 111a, 111b, ... 111n may be configured to emit light toward the first eye e1 of the driver p. The plurality of first light-emitting elements 111a, 111b, ... 111n of the first light-emitting module 111 may be arranged on an inclined surface so as to face the first eye e1 of the driver p. For example, the plurality of first light-emitting elements 111a, 111b, ... 111n may be arranged on a first inclined surface i1. The first inclined surface i1 may be inclined within the screen 110 so as to face the first eye e1 of the driver p. The first inclined surface i1 may have a first inclination with respect to the outer surface of the screen 110. The first light-emitting elements 111a, 111b, ... 111n arranged on the first inclined surface il can emit light toward the first eye e1 of the driver p. The first light-emitting elements 111a, 111b, ... 111n can form a plurality of pixels on each first inclined surface il. The first light-emitting elements 111a, 111b, ... 111n can correspond to sub-pixels constituting a pixel and can be configured to emit red light, blue light, or green light. A portion of the plurality of first light-emitting elements 111a, 111b, ... 111n arranged on one first inclined surface il can provide a portion of a first image (e.g., the first image 30a in FIG. 2) to the first eye e1 of the driver p. The plurality of first light-emitting elements 111a, 111b, ... 111n arranged on the entire first inclined surface il can provide the first image to the first eye e1 of the driver p.
[0034] The second light-emitting module 112 may include a plurality of second light-emitting elements 112a, 112b, 112n. Each of the plurality of second light-emitting elements 112a, 112b, ... 112n may be configured to emit light toward the second eye e2 of the driver p. The plurality of second light-emitting elements 112a, 112b, ... 112n of the second light-emitting module 112 may be arranged on an inclined surface so as to face the second eye e2 of the driver p. For example, the plurality of second light-emitting elements 112a, 112b, ... 112n may be arranged on a second inclined surface i2. The second inclined surface i2 may be inclined within the screen 110 so as to face the second eye e2 of the driver p. The second inclined surface i2 may have a second inclination with respect to the outer surface of the screen 110. The second light-emitting elements 112a, 112b, ... 112n arranged on the second inclined surface i2 can emit light toward the second eye e2 of the driver p. The second light-emitting elements 112a, 112b, ... 112n can form a plurality of pixels on each second inclined surface i2. The second light-emitting elements 112a, 112b, ... 112n can correspond to sub-pixels constituting a pixel and can be configured to emit red light, blue light, or green light. A portion of the plurality of second light-emitting elements 112a, 112b, ... 112n arranged on one second inclined surface i2 can provide a portion of a second image (e.g., the second image 30b in FIG. 2) to the second eye e2 of the driver p. The plurality of second light-emitting elements 112a, 112b, ... 112n arranged on the entire second inclined surface i2 can provide the second image to the second eye e2 of the driver p.
[0035] The first light-emitting module 111 and the second light-emitting module 112 can be configured to adjust the distance between the visual object 11 on the virtual screen (e.g., the virtual screen 10 in FIG. 2 ) provided via the screen 110 and the user p based on the binocular disparity between the first visual object 11a in the first image (e.g., the first image 30a in FIG. 2 ) provided from the first light-emitting module 111 to the first eye e1 of the driver p and the second visual object 11b in the second image (e.g., the second image 30b in FIG. 2 ) provided from the second light-emitting module 112 to the second eye e2 of the driver p. For example, the electronic device 100 can adjust the position of the first visual object in the first image provided from the first light-emitting module 111 and the second visual object in the second image to increase or decrease the binocular disparity.
[0036] According to an embodiment, the eye gaze tracker 130 may include at least one optical input device (e.g., a camera) configured to track the driver's gaze. In order to provide visual information (e.g., the visual object 11 in FIG. 1 ) to the user, the electronic device 100 may adjust the attitude of the first light-emitting module 111 and / or the second light-emitting module 112 based on the information acquired via the eye gaze tracker 130. The electronic device 100 may sense the position of the eye e or the eye focus position (or focal length) of the driver p of the vehicle 1 via the eye gaze tracker 130. The electronic device 100 may control the attitude of the first light-emitting module 111 and / or the second light-emitting module 112 based on the position of the eye e acquired via the eye gaze tracker 130. By controlling the attitude of the first light-emitting module 111 and / or the second light-emitting module 112, the image provided from the first light-emitting module 111 and the second light-emitting module 112 may be transmitted to the eye e of the driver p. The attitude of the first light-emitting module 111 and the second light-emitting module 112 can be adjusted by changing or tilting the vertical and / or horizontal inclinations of the inclined surfaces i1 and i2. For example, the inclined surfaces i1 and i2 may be separated from each other. The inclinations of the inclined surfaces i1 and i2 can be adjusted by actuators. The electronic device 100 can adjust the light paths l1 and l2 emitted from the light-emitting elements 111a, 111b, ... 111n, 112a, 112b, ... 112n arranged on the inclined surfaces i1 and i2 whose inclinations are adjusted by the actuators, so that they are directed toward the eye e of the driver p. For example, when the distance between the driver p and the screen 110 increases, the inclination of the first inclined surface i1 and the inclination of the second inclined surface i2 decreases, and the intersection of the light paths l1 and l2 can be moved to the eye e of the driver p. When the distance between the driver p and the screen 110 decreases, the inclination of the first inclined surface i1 and the inclination of the second inclined surface i2 increase, so that the intersection of the optical paths l1 and l2 can be moved to the eye e of the driver p.
[0037] Figure 4a shows the layout of components of an exemplary electronic device, including a projector, and Figure 4b shows the optical path of visual information transmitted through light transmitted through components of an exemplary electronic device, including a projector, to the driver's eyes.
[0038] 4a and 4b, the electronic device 200 may include a first light-emitting module 201, a second light-emitting module 202, a screen 210, and an eye-gaze tracker 230. The electronic device 200 may be implemented in an ECU (electronic control unit) included in a vehicle. The first light-emitting module 201, the second light-emitting module 202, and the screen 210 may operate as a display to provide visual information to a user.
[0039] The first light emitting module 201 and the second light emitting module 202 can be configured to adjust the focal distance between the image displayed on the virtual screen (e.g., the virtual screen 10 in FIG. 1) and the eye e of the driver p based on the position of the user's eyes acquired via the eye gaze tracker 230 (e.g., the eye gaze tracker 130 in FIG. 3a). The eye gaze tracker 230 may be substantially the same as or similar to the eye gaze tracker 130 in FIG. 3a. The first light emitting module 201 may be spaced apart from the second light emitting module 202. The first light emitting module 201 and the second light emitting module 202 may include a plurality of hardware assembled to emit light (or beams) representing pixels arranged in two dimensions. The manner in which the first light emitting module 201 and the second light emitting module 202 emit light may include a digital light processing (DLP) method, a liquid crystal on silicon (LCOS) method, a liquid crystal display (3LCD) method, an LCD method, and / or a laser method.
[0040] For example, the first light emitting module 201 and the second light emitting module 202 may include a combination of CRTs (cathode-ray tubes) for emitting light of each of the three primary colors in a color space, and lenses for magnifying the light emitted from each of the CRTs. For example, the first light emitting module 201 and the second light emitting module 202 implemented in a 3LCD format may include a combination of a light source (e.g., a lamp) for emitting light, an optical filter for splitting the light into light paths corresponding to each of the three primary colors, an LCD (liquid crystal display) panel disposed in each of the light paths, and a prism and / or lens for synthesizing the light output from the LCD panel. For example, the first light emitting module 201 and the second light emitting module 202 implemented in a DLP format may include a combination of a light source for emitting light, an optical filter for selecting one of the three primary colors from the light, a DMD (digital mirror device) for adjusting the reflection of the primary colors filtered by the optical filter, and a lens for magnifying the light reflected by the DMD. For example, the first light emitting module 201 and the second light emitting module 202 realized by the laser method may include a combination of a light source for emitting laser light, an optical filter, an actuator for adjusting the optical path of the laser light filtered by the optical filter, and hardware for reducing interference of the laser light such as speckles. From the viewpoint of requiring projection of light to display on a screen, at least one light emitting module of the above combination may be called a projection assembly or a beam projector. The first light emitting module 201 and the second light emitting module 202 may be configured as separate parts and disposed on the dashboard of the vehicle, the driver's seat of the vehicle, or the ceiling of the vehicle. The first light emitting module 201 and the second light emitting module 202 may be disposed in the interior of the vehicle capable of emitting light toward the screen 210 mounted in the windshield.
[0041] The screen 210 may be spaced apart from the first light emitting module 201 and the second light emitting module 202. The screen 210 may be disposed adjacent to a windshield of a vehicle (e.g., the vehicle 1 in FIG. 1) or may be incorporated into the windshield. The screen 210 may reflect light emitted from the first light emitting module 201 and the second light emitting module 202 to transmit visual information to the driver p. For example, the first light emitting module 201 and the second light emitting module 202 may emit light to the screen 210 along a path li of the incident light. The light transmitted to the screen 210 may be reflected by the film 220 in the screen 210. The light reflected by the film 220 in the screen 210 may be transmitted to the eye e of the driver p along a path lr of the reflected light. The film 220 may include a flexible and transparent material. The screen 210 may transmit light transmitted from outside the vehicle 1 to the driver of the vehicle 1 by including the transparent and flexible film 220. The flexibility of film 220 allows it to be placed on windshield 101, which has a curved surface.
[0042] The device including the first light emitting module 201, the second light emitting module 202, and the screen 210 is sometimes called a head-up display, since it displays information on the windshield or front glass of the vehicle.
[0043] According to an embodiment, the screen 210 may be formed by double bonding. For example, the screen 210 may include a first transparent layer 211, a second transparent layer 212, a film 220, a first bonding material 221, and a second bonding material 222. The first transparent layer 211 and the second transparent layer 212 may include a transparent material so that the driver can see the outside environment while maintaining the rigidity of the windshield. The first transparent layer 211 and the second transparent layer 212 may include tempered glass, glass, or a polymer material. The first transparent layer 211 may be spaced apart from the second transparent layer 212. The first transparent layer 211 and the second transparent layer 212 may define an interior space or volume of the screen 210. The film 220 may be disposed within the interior space or volume. For example, the film 220 may be disposed between the first transparent layer 211 and the second transparent layer 212. The film 220 can be configured to reflect light emitted from the first light emitting module 201 and the second light emitting module 202. The film 220 can have a wrinkled surface. For example, the film 220 can include a first inclined surface i1 and a second inclined surface i2. The first inclined surface i1 and the second inclined surface i2 may be arranged alternately and repeatedly.
[0044] The first slanted surface i1 may be configured to reflect light emitted from the first light-emitting module 201 to a first eye e1 of the driver p. The second slanted surface i2 may be configured to reflect light emitted from the second light-emitting module 202 to a second eye e2 of the driver p.
[0045] According to an embodiment, the electronic device 200 can provide different images to each of the eyes of the driver p so that the driver p feels a stereoscopic sensation. The first light-emitting module 201, the second light-emitting module 202, and the film 220 may be configured to provide visual information toward the eye e of the driver p. The first light-emitting module 201 can be configured to provide visual information (e.g., the first image 30a in FIG. 2) to the first eye e1 of the driver p through light reflected by the first inclined surface i1 of the film 220. The second light-emitting module 202 can be configured to provide visual information (e.g., the second image 30b in FIG. 2) to the second eye e2 of the driver p through light reflected by the second inclined surface i2 of the film 220. The inclined surfaces i1, i2 can have an inclination with respect to the outer surface of the screen 110. The first inclined surface i1 having the first inclination and the second inclined surface i2 having the second inclination can be arranged alternately. The first inclined surface i1 may be inclined toward a first eye e1 of the driver p, and the second inclined surface i2 may be inclined toward a second eye e2 of the driver p. The first inclined surface i1 may have a first inclination with respect to the outer surface of the screen 210. The second inclined surface i2 may have a second inclination with respect to the outer surface of the screen 210.
[0046] According to an embodiment, the first light-emitting module 201 can emit light to a first inclined surface il. For example, the first light-emitting module 201 can emit light along a path li1 of a first incident light. The first inclined surface il inclined toward the first eye e1 of the driver p can reflect the arriving light to the first eye e1 of the driver p along an optical path lr1 of a first reflected light. The light reflected by one first inclined surface il can provide a part of a first image (e.g., the first image 30a in FIG. 2) to the first eye e1 of the driver p. The light reflected by the entire first inclined surface il can provide the first image to the first eye e1 of the driver p.
[0047] According to an embodiment, the second light-emitting module 202 can emit light to the second inclined surface i2. For example, the second light-emitting module 202 can emit light along a second incident light path li2. The second inclined surface i2 inclined toward the second eye e2 of the driver p can reflect the arriving light to the second eye e2 of the driver p along a second reflected light path lr2. The light reflected on one second inclined surface i2 can provide a part of the second image (e.g., the second image 30b in FIG. 2) to the second eye e2 of the driver p. The light reflected on the entire second inclined surface i2 can provide the second image to the second eye e2 of the driver p.
[0048] The electronic device 200 may be configured to adjust the distance of a visual object provided through the screen 210 based on adjusting the binocular parallax via the first light-emitting module 201 and the second light-emitting module 202. For example, the first light-emitting module 201 and the second light-emitting module 202 may be configured to adjust the distance between the visual object 11 on the virtual screen (e.g., the virtual screen 10 in FIG. 2) provided through the screen 210 and the user p based on the binocular parallax between a first visual object 11a in a first image (e.g., the first image 30a in FIG. 2) provided to the first eye e1 of the driver p from the first light-emitting module 201 along a first incident light path li1 and a first reflected light path lr1, and a second visual object 11b in a second image (e.g., the second image 30b in FIG. 2) provided to the second eye e2 of the driver p from the second light-emitting module 112 along a second incident light path li2 and a second reflected light path lr2. For example, the electronic device 200 can adjust the position of a first visual object in a first image provided from the first light-emitting module 201 and a second visual object in a second image provided from the second light-emitting module 202 to increase or decrease binocular parallax. An image formed by reflecting the light emitted from the first light-emitting module 201 and the second light-emitting module 202 on a film can be displayed so as to be superimposed on an external environment formed by the light transmitted into the interior of the vehicle 1 through the screen 110.
[0049] According to an embodiment, the electronic device 200 can control the attitude of the first light-emitting module 201 and / or the second light-emitting module 202 based on the position of the eye e of the driver p acquired via the eye gaze tracker 230. The electronic device 200 can transmit an image provided from the first light-emitting module 201 and the second light-emitting module 202 to the eye e of the driver p by controlling the attitude of the first light-emitting module 201 and / or the second light-emitting module 202. The attitude of the first light-emitting module 201 and the second light-emitting module 202 can be adjusted via an actuator coupled to the first light-emitting module 201 and the second light-emitting module 202. The actuator can be configured to adjust the distance and / or the rotation (or tilting) of each of the light-emitting modules 201, 202 toward the screen.
[0050] When the position of the driver p's eye e acquired through the eye gaze tracker 230 is far from the screen 210, the electronic device 200 can move the light emitting modules 201, 202 away from the screen 210. The light emitting modules 201, 202 away from the screen 210 can emit light at a narrow incident angle toward the film 220 of the screen 210. The light emitted at a narrow incident angle can be reflected at a narrow reflection angle by the film 220 of the screen 210. The intersections of the reflected light paths lr1, lr2 along which the light reflected at a narrow reflection angle travels may be far apart. The electronic device 100 can adjust the reflected light paths lr1, lr2 to be directed toward the driver p's eye e by adjusting the positions of the light emitting modules 201, 202.
[0051] When the position of the driver p's eye e obtained via the eye gaze tracker 230 approaches the screen 210, the electronic device 200 can move the light emitting modules 201, 202 to approach the screen 210 in order to provide visual information (e.g., the visual object 11 in FIG. 1) to the user. The light emitting modules 201, 202 approaching the screen 210 can emit light at a wide incidence angle toward the film 220 of the screen 210. The light emitted at a wide incidence angle can be reflected at a wide reflection angle by the film 220 of the screen 210. The intersection of the reflected light paths lr1, lr2 along which the light reflected at a wide reflection angle travels may approach. The electronic device 200 can adjust the reflected light paths lr1, lr2 to be directed toward the driver p's eye e by adjusting the position of the light emitting modules 201, 202.
[0052] The tilted surfaces i1, i2 can be tilted separately from each other, similar to the tilted surfaces i1, i2 of Fig. 3b. Similar to the operation of Fig. 3b, the electronic device 200 can be configured to reflect light off the tilted surfaces i1, i2 and direct light along the reflected light paths lr1, lr2 to the eye e of the driver p based on the position of the eye e of the driver p identified via the eye tracker 230.
[0053] The screen 210 can transmit light outside the vehicle 1 to the inside of the vehicle 1. In order to reduce the film 220 disposed in the screen 210 from being identified by the driver p, the film 220 can be formed of a transparent material. The film 220 can have a different refractive index from the second transparent layer 212 to reflect the light transmitted through the second transparent layer 212. In order to reduce the driver p from identifying the film 220 due to the different refractive indexes, a refractive index matching material 236 can be filled between the first transparent layer 211 and the second transparent layer 212. The refractive index matching material 236 can compensate for the difference between the refractive index of the film 220 and the refractive index of the second transparent layer 212. The refractive index matching material 236 can be replaced with an anti-reflection material or an anti-reflection film.
[0054] The first bonding material 221 can be applied to one side of the first transparent layer 211 facing the film 220. The first bonding material 221 can bond the first transparent layer 211 and the refractive index matching material 236. If another material is filled between the first transparent layer 211 and the second transparent layer 212 to prevent the film 220 from being seen, the first bonding material 221 can bond the other material to the first transparent layer 211. The second bonding material 222 can be applied to one side of the second transparent layer 212 facing the film 220. The second bonding material 222 can bond the second transparent layer 212 and the refractive index matching material 236. If another material is filled between the first transparent layer 211 and the second transparent layer 212 to prevent the film 220 from being seen, the second bonding material 222 can bond the other material to the second transparent layer 212. The first bonding material 221 and the second bonding material 222 may include polyvinyl-butyral.
[0055] FIG. 5 shows a block diagram of an exemplary electronic device installed in a vehicle.
[0056] Referring to FIG. 5, an electronic device 500 (e.g., electronic device 100 of FIG. 3a and / or electronic device 200 of FIG. 4a) may include a processor 510, a screen 520 (e.g., screen 110 of FIG. 3a and / or screen 210 of FIG. 4a), a first light-emitting element 531 (e.g., first light-emitting element 111 of FIG. 3b or first light-emitting element 201 of FIG. 4b), a second light-emitting element 532 (e.g., second light-emitting element 112 of FIG. 3b or second light-emitting element 202 of FIG. 4b) and / or an eye-gaze tracker 540 (e.g., eye-gaze tracker 130 of FIG. 3a or eye-gaze tracker 230 of FIG. 4a).
[0057] The processor 510, the first light emitting element 531, the second light emitting element 532, and / or the eye tracker 540 may be electrically and / or operatively connected to each other. The operative coupling of each element may represent a direct connection or an indirect connection.
[0058] According to an embodiment, the processor 510 of the electronic device 100 may include hardware for processing data based on one or more instructions. The hardware for processing data may include, for example, an arithmetic and logic unit (ALU), a floating point unit (FPU), a field programmable gate array (FPGA), a central processing unit (CPU), and / or an application processor (AP). The number of processors 510 may be one or more. For example, the processor 510 may have a multi-core processor structure such as a dual core, a quad core, or a hexa core.
[0059] The screen 520 may be configured to output visual information to the driver of the vehicle. For example, the screen 520 may provide one or more images or videos provided from the processor 510 of the electronic device 500 to the user. The screen 520 may be configured to provide visual objects to the driver of the vehicle. The visual objects may represent objects displayed via the screen 520 for information transmission and / or interaction, such as text, images, icons, videos, sliders, and / or tables containing information related to the vehicle. The screen 520 may include a first light-emitting element 531 and a second light-emitting element 532. The first light-emitting element 531 and the second light-emitting element 532 may constitute pixels disposed within the screen 520. The image provided via the first light-emitting element 531 may be transmitted to one eye (e.g., the left eye) of the driver, and the image provided via the second light-emitting element 532 may be transmitted to another eye (e.g., the right eye) of the driver. The screen 520 can provide an image including a visual object with a stereoscopic effect based on the binocular parallax of the image provided via the first light-emitting element 531 and the second light-emitting element 532.
[0060] The eye tracker 540 of the electronic device 500 according to an embodiment may include a camera. The eye tracker 540 may include one or more light sensors (e.g., a Charged Coupled Device (CCD) sensor, a Complementary Metal Oxide Semiconductor (CMOS) sensor) that generate an electrical signal indicative of a color and / or brightness of light. The multiple light sensors included in the eye tracker 540 may be arranged in the form of a two-dimensional grid. The eye tracker 540 may acquire the electrical signals of each of the multiple light sensors substantially simultaneously to generate an image or frame including multiple pixels arranged in two dimensions corresponding to the light reaching the light sensors of the two-dimensional grid. For example, a video acquired using the eye tracker 540 may refer to a sequence of multiple images acquired according to a frame rate specified by the eye tracker 540. The eye tracker 540 may further include a flashlight arranged toward a direction in which light is received and for outputting light in that direction. The eye tracker 540 may acquire a video including a driver or the interior of a vehicle.
[0061] According to an embodiment, the electronic device 500 may further include a camera different from the eye tracker 540. The camera may be arranged facing a direction to receive light and may further include a flashlight for outputting light in the direction. For example, the electronic device 500 may obtain a video including an external environment of the vehicle through the camera, but is not limited thereto.
[0062] FIG. 6 is a flow chart showing the operation of the electronic device.
[0063] Referring to FIG. 6, in operation 601, the processor 510 (e.g., the processor 510 of FIG. 5) can be configured to identify the position of the user's (or driver's, passenger's) eyes. The processor 510 can identify the position of the user's eyes via an eye-gaze tracker (e.g., the eye-gaze tracker 540 of FIG. 5). The eye-gaze tracker 540 can capture the driver's surroundings to obtain an image of the driver's eyes. The eye-gaze tracker 540 can include multiple cameras. The multiple cameras can capture the driver's surroundings from various angles. The processor 510 can identify the driver's position and the driver's eye position from the captured image.
[0064] The eye position may refer to the position of the eyes on spatial coordinates stored in the electronic device 500. The processor 510 may be configured to obtain focal length information from the captured image, which is identified based on the eye gaze direction or the pupil or iris size direction. The processor 510 may identify the driver's eye coordinates, focal length and gaze direction from the image information related to the driver's eyes.
[0065] In operation 603, the processor 510 can be configured to control a first light-emitting element (e.g., the first light-emitting element 111a, 111b, ... 111n of FIG. 3b and / or the first light-emitting module 201 of FIG. 4b) and a second light-emitting element (e.g., the second light-emitting element 112a, 112b, ... 112n of FIG. 3b and / or the second light-emitting module 202 of FIG. 4b) based on the identified driver's eye coordinates, focal length and gaze direction.
[0066] According to one embodiment, the processor 510 can identify, via the eye gaze tracker 540, that the driver's eye position is moved from a first position to a second position. The processor 510 can be configured to adjust angles of the first light-emitting element (or the first light-emitting module) and the second light-emitting element (or the second light-emitting module) based on the identified driver's eye position, so as to move an end point of a path of light transmitted from the first light-emitting element (or the first light-emitting module) and the second light-emitting element (or the second light-emitting module) from the first position to the second position.
[0067] According to an embodiment, the processor 510 may be configured to adjust the position of the visual object in the virtual screen by controlling the first light-emitting module and the second light-emitting module based on the identified focal length. For example, to adjust the position of the visual object, the processor 510 may control the attitude of the first light-emitting module and the second light-emitting module. As another example, to adjust the position of the visual object, the processor 510 may be configured to adjust the position of the visual object in the first image provided via the first light-emitting module and the visual object in the second image provided via the second light-emitting module. The processor 510 may adjust the binocular disparity by adjusting the position of the visual object in the first image and the visual object in the second image. The driver may sense that the position of the visual object is approaching or moving away through the adjusted binocular disparity.
[0068] According to an embodiment, the processor 510 can acquire an image through an external camera (or a front camera) of the vehicle, and identify a visual object corresponding to an external object gazed by the user among the visual objects acquired through the front camera based on the identified eye position. The processor 510 can identify a focal distance between the external object and the user based on the identified visual object. Different from the above method, the processor 510 can identify a focal distance based on the identified eye position, and identify an external object located at the focal distance based on the identified focal distance. The processor 510 can be configured to provide image information including a visual object around an external object located at the focal distance (or an external object gazed by the user) based on the identified focal distance degree or eye position. The processor 510 can be configured to control the attitude of the first light-emitting element (or the first light-emitting module) and the second light-emitting element (or the second light-emitting module), or adjust the position of the visual object in the image provided from the first light-emitting element (or the first light-emitting module) and the second light-emitting element (or the second light-emitting module). The image information conveyed via the visual object or image may be information selected from at least one of the following: vehicle driving direction, distance traveled, remaining distance, travel path, surrounding position information, or a combination thereof.
[0069] According to the above embodiment, an electronic device may include a first light-emitting module, a second light-emitting module, a screen, and an eye-gaze tracker. The screen may be configured to provide an image to a user by the light emitted from the first light-emitting module and the second light-emitting module. The eye-gaze tracker may be configured to sense an eye position of the user. The first light-emitting module and the second light-emitting module may be configured to adjust a focal distance between the image and the user's eyes based on the eye position of the user acquired via the eye-gaze tracker.
[0070] According to an embodiment, the second light emitting module may be spaced apart from the first light emitting module. A screen spaced apart from the first light emitting module and the second light emitting module may include a first transparent layer, a second transparent layer, and a film. The second transparent layer may be spaced apart from the first transparent layer. The film may be disposed between the first transparent layer and the second transparent layer, may have a wrinkled surface, and may be transparent. The wrinkled surface of the film may include a first inclined surface toward the first light emitting module and a second inclined surface toward the second light emitting module. The first inclined surface may be configured to reflect the light emitted from the first light emitting module and transmit it to a first eye of the user. The second inclined surface may be configured to reflect the light emitted from the second light emitting module and transmit it to a second eye of the user.
[0071] According to one embodiment, the screen may further include a refractive index matching material filling a space between the first transparent layer and the second transparent layer, the refractive index matching material being capable of compensating for a refractive index difference between the second transparent layer through which light reflected by the film passes and the film.
[0072] According to one embodiment, the first light emitting module and the second light emitting module can be configured to emit light toward the film such that when the user looks at the screen, light reflected by the screen is transmitted to the user.
[0073] According to one embodiment, the first light-emitting module and the second light-emitting module can be configured to adjust the distance between the user and a visual object provided via the screen based on binocular disparity between a first visual object in a first image provided to the first eye of the user from the first light-emitting module and a second visual object in a second image provided to the second eye of the user from the second light-emitting module.
[0074] According to one embodiment, each of the first light-emitting module and the second light-emitting module may be configured to adjust its distance relative to the screen or tilt relative to the screen to provide visual information to the user's eye.
[0075] According to one embodiment, the screen may function as at least a part of a windshield of a vehicle in which the electronic device is mounted.
[0076] According to one embodiment, the first light emitting module and the second light emitting module can function as a projection device that provides an image via light reflected by the film of the screen.
[0077] According to one embodiment, one layer in the screen includes a wrinkled surface, and a first light-emitting element of the first light-emitting module and a second light-emitting element of the second light-emitting module include transparent organic light emitting diodes (OLEDs), and the wrinkled surface includes a first inclined surface on which each of the first light-emitting elements is disposed and facing a first eye of the user, and a second inclined surface on which each of the second light-emitting elements is disposed and facing the second light-emitting module.
[0078] According to one embodiment, the electronic device may further include an eye gaze tracker configured to identify an eye position of the user, and a processor operatively connected to the eye gaze tracker, the first light emitting module, and the second light emitting module, the processor may be configured to control a posture of the first light emitting module and the second light emitting module based on the eye position of the user obtained from the eye gaze tracker.
[0079] According to one embodiment, the processor can be configured to identify from the eye tracker that the position of the user's eyes is moved from a first position to a second position, and adjust the angles of the first light emitting module and the second light emitting module so as to transmit light emitted from the first light emitting module and the second light emitting module and transmitted to the first position to the second position.
[0080] According to one embodiment, the processor may be configured to control the attitude of the first light-emitting module and the second light-emitting module based on a focal length to change the position of a virtual object provided via the screen.
[0081] According to an embodiment, the electronic device may further include a front camera configured to capture an image related to an environment in front of the electronic device. The processor may be configured to identify a visual object captured via the front camera that corresponds to an external object gazed at by a user, identify a focal distance between the external object and the user's eye based on the identified visual object, and control the attitude of the first light-emitting module and the second light-emitting module based on the identified focal distance to provide image information on the focal distance.
[0082] According to one embodiment, to provide the image information, the processor may be configured to use the first light-emitting module to provide a first image corresponding to the image information to a first eye of the user, and to use the second light-emitting module to provide a second image corresponding to the image information to a second eye of the user, and to adjust a distance between a first virtual object in the first image and a second virtual object in the second image corresponding to the first virtual object to provide the image information on the focal length.
[0083] According to one embodiment, the image information may be selected from at least one of a driving direction, a driving distance, a remaining distance, a travel path, surrounding position information, or a combination thereof.
[0084] According to one embodiment, a side of the first transparent layer facing the film and a side of the second transparent layer facing the film may be coated with polyvinyl butyral.
[0085] According to one embodiment, the first transparent layer and the second transparent layer may comprise a glass or a polymeric material.
[0086] According to one embodiment, a method of operating an electronic device includes the steps of identifying an eye position of a driver in a vehicle, emitting light toward a windshield of the vehicle via a first light-emitting module to transmit a first image to a first eye of the driver, emitting light toward a windshield of the vehicle via a second light-emitting module to transmit a second image to a second eye of the driver, and controlling an attitude of the first light-emitting module and the second light-emitting module based on the identified eye position of the driver.
[0087] Binocular disparity between a first virtual object in the first image and a second virtual object in the second image can adjust the focus of image information reflected by the vehicle windshield.
[0088] According to one embodiment, the method may include adjusting a distance between a first virtual object in the first image and a second virtual object in the second image that corresponds to the first virtual object to provide image information on the focal length.
[0089] According to one embodiment, the image information may be selected from at least one of a driving direction, a driving distance, a remaining distance, a travel path, surrounding position information, or a combination thereof.
[0090] In one embodiment, a non-transitory computer readable storage medium storing one or more programs may include instructions, when executed by an electronic device, that cause the electronic device to identify an eye position of a driver in a vehicle. The one or more programs may include instructions, when executed by the electronic device, that cause the electronic device to emit light via a first light emitting module toward a windshield of the vehicle to convey a first image to a first eye of the driver. The one or more programs may include instructions, when executed by the electronic device, that cause the electronic device to emit light via a second light emitting module toward a windshield of the vehicle to convey a second image to a second eye of the driver. The one or more programs may include instructions, when executed by the electronic device, that cause the electronic device to control a posture of the first light emitting module and the second light emitting module based on the identified eye position of the driver. A binocular disparity between a first virtual object in the first image and a second virtual object in the second image may adjust the focus of image information reflected by the windshield of the vehicle.
[0091] The aforementioned devices may be implemented with hardware components, software components, and / or a combination of hardware and software components. For example, the devices and components described in the embodiments may be implemented using one or more general-purpose or special-purpose computers, such as a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications that run on the operating system. Furthermore, the processing device may also access, store, manipulate, process, and generate data in response to the execution of software. For ease of understanding, the processing device may be described as being one in which one is used, but a person skilled in the art may understand that the processing device may include multiple processing elements and / or multiple types of processing elements. For example, the processing device may include multiple processors or one processor and one controller. Additionally, other processing configurations are possible, such as parallel processors.
[0092] The software may include a computer program, code, instructions, or a combination of one or more of these, and may configure or instruct a processing device to operate in a desired manner, either individually or collectively. The software and / or data may be embodied in any type of machine, component, physical device, computer storage medium, or device to be interpreted by a processing device or to provide instructions or data to a processing device. The software may be distributed on computer systems connected to a network, and stored or executed in a distributed manner. The software and data may be stored on one or more computer-readable recording media.
[0093] The method according to the embodiment may be implemented in the form of program instructions that can be executed via various computer means and recorded on a computer-readable medium. In this case, the medium may continue to store the computer-executable program or may temporarily store it for execution or download. Furthermore, the medium may be various recording or storage means in the form of a single or multiple hardware combined, and may not be limited to a medium directly connected to any computer system, but may be distributed on a network. Examples of the medium may be those configured to store program instructions, including magnetic media such as hard disks, floppy disks, and magnetic tapes, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, ROMs, RAMs, flash memories, and the like. Other examples of the medium include recording media and storage media managed by application stores that distribute applications, sites that supply or distribute various other software, and servers.
[0094] Although the embodiments have been described above with reference to the limited embodiments and drawings, those skilled in the art may make various modifications and variations from the above description. For example, the described techniques may be performed in an order different from that described, and / or the components of the described systems, structures, devices, circuits, etc. may be combined or combined in a manner different from that described, or may be replaced or substituted by other components or equivalents, and still achieve suitable results.
Claims
1. 1. An electronic device comprising: A first light emitting module; A second light emitting module; a screen configured to provide a first image using light emitted from the first light emitting module and a second image using light emitted from the second light emitting module to a user; and an eye tracker configured to sense an eye position of the user; The electronic device, wherein the first light-emitting module and the second light-emitting module are configured to adjust a focal distance between the user's eye position sensed via the eye tracker and an image identifiable by the user based on binocular disparity between a visual object in the first image and a visual object in the second image.
2. the second light emitting module is spaced apart from the first light emitting module; The screen spaced apart from the first light emitting module and the second light emitting module includes: A first transparent layer; a second transparent layer spaced apart from the first transparent layer; and a transparent film disposed between the first transparent layer and the second transparent layer and having a wrinkled surface; the wrinkled surface of the film includes a first inclined surface toward the first light emitting module and a second inclined surface toward the second light emitting module; the first slanted surface is configured to reflect light emitted from the first light emitting module and transmit it to a first eye of the user; The electronic device of claim 1 , wherein the second angled surface is configured to reflect and transmit light emitted from the second light emitting module to a second eye of the user.
3. The screen comprises: further comprising an index matching material filling a space between the first transparent layer and the second transparent layer; The refractive index matching material is The electronic device according to claim 2 , wherein the film compensates for a difference in refractive index between the second transparent layer through which light reflected by the film passes and the film.
4. The first light emitting module and the second light emitting module include The electronic device of claim 2 , configured to emit light toward the film such that when the user views the screen, light reflected from the screen is transmitted to the user.
5. The first transparent layer and the second transparent layer are The electronic device of claim 2 comprising a glass or polymeric material.
6. 3. The electronic device of claim 2, wherein a side of the first transparent layer facing the film and a side of the second transparent layer facing the film are coated with polyvinyl butyral.
7. The screen comprises:
10. The electronic device of claim 1, wherein the electronic device functions as at least a portion of a windshield of a vehicle in which the electronic device is installed.
8. The first light emitting module and the second light emitting module include The electronic device of claim 1 , functioning as a projection device to provide an image via light reflected by the screen.
9. One layer in the screen is Including wrinkled surface, The first light-emitting element of the first light-emitting module and the second light-emitting element of the second light-emitting module are a transparent organic light emitting diode (OLED); 2. The electronic device of claim 1, wherein the wrinkled surface includes a first inclined surface on which each of the first light-emitting elements is disposed and facing a first eye of the user, and a second inclined surface on which each of the second light-emitting elements is disposed and facing the second light-emitting module.
10. an eye tracker configured to identify an eye position of the user; and a processor operatively connected to the gaze tracker, the first light emitting module, and the second light emitting module; The processor, The electronic device of claim 1 , configured to control an attitude of the first light-emitting module and the second light-emitting module based on a position of the user's eyes obtained from the eye tracker.
11. The processor, using the eye tracker to identify when the eye position of the user moves from a first position to a second position; 11. The electronic device of claim 10, configured to adjust angles of the first light emitting module and the second light emitting module to change a position of light emitted from the first light emitting module and the second light emitting module from the first position to the second position.
12. The processor, The electronic device of claim 10 , configured to control an attitude of the first light-emitting module and the second light-emitting module based on a focal length to change a position of a virtual object provided through the screen.
13. a forward camera configured to capture images relating to an environment in front of the electronic device; The processor, Identifying a visual object corresponding to an external object that a user gazes at among the visual objects acquired through the front camera; Identifying a focal distance between the external object and the user's eye based on the identified visual object; 13. The electronic device of claim 12, configured to control, based on the identified focal length, an attitude of the first light emitting module and the second light emitting module to provide image information on the focal length.
14. The processor, providing the image information by using the first light-emitting module to provide a first image corresponding to the image information to a first eye of the user and using the second light-emitting module to provide a second image corresponding to the image information to a second eye of the user; 14. The electronic device of claim 13, configured to adjust a distance between a first virtual object in the first image and a second virtual object in the second image that corresponds to the first virtual object to provide image information on the focal length.
15. The image information is The electronic device of claim 13 , wherein the information is selected from at least one of a driving direction, a driving distance, a remaining distance, a travel path, surrounding location information, or a combination thereof.
16. Each of the first light emitting module and the second light emitting module includes: The electronic device of claim 1 , configured to be adjusted in distance to or tilted relative to the screen to provide visual information to the user's eyes.
17. The first light emitting module and the second light emitting module include:
2. The electronic device of claim 1, configured to adjust a distance between a visual object provided through the screen and the user based on binocular disparity between a first visual object in a first image provided to a first eye of the user from the first light-emitting module and a second visual object in a second image provided to a second eye of the user from the second light-emitting module.
18. A method for operating a forelimb device, comprising: An operation of identifying an eye position of a driver in a vehicle; emitting light via a first light-emitting module toward a windshield of the vehicle to communicate a first image to a first eye of the driver; emitting light via a second light-emitting module toward a windshield of the vehicle to transmit a second image to a second eye of the driver; and and controlling the attitude of the first light-emitting module and the second light-emitting module based on the identified eye position of the driver; wherein binocular disparity between a first virtual object in the first image and a second virtual object in the second image adjusts the focus of image information reflected by the vehicle windshield.
19. 20. The method of claim 18, comprising adjusting a distance between a first virtual object in the first image and a second virtual object in the second image that corresponds to the first virtual object to display the image information at a position corresponding to the focal point.
20. The image information is 20. The method of claim 19, wherein the information is selected from at least one of a driving direction, a distance traveled, a remaining distance, a travel path, surrounding location information, or a combination thereof.
