Display device and control method of same

Abstract

A display for providing a 3D image is disclosed. One or more processors, when instructions are executed individually or collectively: display a user interface (UI) object on the display; identify an eye position of a user on the basis of a captured image obtained via a camera; display, on the basis of a first depth protruding from a UI object, a 3D pointer for selecting the UI object on the basis of the eye position of the user; identify, on the basis of the eye position of the user and a first display position of the UI object, a viewing range of the user corresponding to the UI object; and identify the UI object as selected when the 3D pointer is positioned within the viewing range of the user.

Description

Display device and control method thereof

[0001] The present disclosure relates to a display device and a control method thereof, and more particularly, to a display device providing 3D images and a control method thereof.

[0002] Advances in electronic technology have led to the development and proliferation of various types of electronic devices. In particular, display devices, used in a variety of settings, including homes, offices, and public spaces, have been continuously evolving in recent years.

[0003] Stereoscopy refers to three-dimensional technology. Recently, commercialized 3D displays primarily utilize binocular parallax. Binocular parallax offers the advantage of creating a three-dimensional effect on a single screen, such as a TV or theater screen. Methods utilizing binocular parallax can be categorized into stereoscopic (using glasses or other auxiliary devices) and autostereocopic (glassless) methods.

[0004] Recently, commercialization of glasses-free light field displays and glasses-free 3D displays utilizing eye-tracking is being continuously researched.

[0005] A display device for providing 3D images according to one or more embodiments of the present disclosure includes a display, a camera, a memory for storing instructions, and one or more processors including processing circuitry.

[0006] According to one or more embodiments, the one or more processors, when the instructions are individually or collectively executed, display a UI (User Interface) object on the display, identify a user's eye position based on a captured image acquired through the camera, display a three-dimensional pointer for selecting the UI object based on a first depth protruding from the UI object based on the user's eye position, identify a field of view of the user corresponding to the UI object based on the user's eye position and the first display position of the UI object, and identify the UI object as selected when the three-dimensional pointer is located in the field of view of the user.

[0007] According to one or more embodiments, the one or more processors, when the instructions are individually or collectively executed, identify a first direction based on the user's eye position and the three-dimensional pointer when the UI object is identified as selected, and control the display to display the UI object based on a second display position corresponding to the identified first direction.

[0008] According to one or more embodiments, the one or more processors, when the instructions are individually or collectively executed, identify a second depth corresponding to the UI object based on the first depth of the three-dimensional pointer, and control the display to display the UI object based on the identified second depth and the second display position.

[0009] According to one or more embodiments, when the three-dimensional pointer is spherical in shape, the first depth is a depth corresponding to a center of the sphere, and the one or more processors, when the instructions are individually or collectively executed, identify the second depth corresponding to one surface of the sphere among a depth range corresponding to the sphere when the three-dimensional pointer is spherical in shape.

[0010] According to one or more embodiments, the one or more processors, when the instructions are individually or collectively executed, change the user's field of view based on a margin area that includes the UI object while adjusting the depth of the UI object based on the identified second depth.

[0011] According to one or more embodiments, the one or more processors, when the instructions are individually or collectively executed, provide an animation effect by gradually adjusting the depth of the UI object to the second depth while adjusting the depth of the UI object based on the identified second depth.

[0012] According to one or more embodiments, the one or more processors, when the instructions are individually or collectively executed, identify a field of view of the user corresponding to the display based on an eye position of the user, and when another user is identified, identify a field of view of the other user corresponding to the display based on an eye position of the other user, and adjust a display position of a 3D pointer provided to the other user based on the field of view of the user corresponding to the display and the field of view of the other user corresponding to the display.

[0013] According to one or more embodiments, the one or more processors, when the instructions are individually or collectively executed, identify a size of a first virtual plane corresponding to the first depth of a 3D pointer provided to the user based on a field of view of the user corresponding to the display, identify a size of a second virtual plane corresponding to a third depth of a 3D pointer provided to the other user based on a field of view of the other user corresponding to the display, and adjust a display position of the 3D pointer provided to the other user based on the size of the first virtual plane, the size of the second virtual plane, and the display position of the 3D pointer provided to the user.

[0014] According to one or more embodiments, the one or more processors, when the instructions are individually or collectively executed, identify a position of a laser pointer generated by a laser controller, identify a second direction based on the position of the laser controller and the laser pointer when the UI object is identified as being selected by the laser pointer, and control the display to display the UI object based on a third display position corresponding to the identified second direction.

[0015] A method for controlling a display device providing a 3D image according to one or more embodiments of the present disclosure, comprising: displaying a UI (User Interface) object on a display; identifying a user's eye position based on a captured image acquired through a camera; displaying a 3D pointer for selecting the UI object based on the user's eye position based on a first depth protruding from the UI object; identifying a user's field of view corresponding to the UI object based on the user's eye position and a first display position of the UI object; and identifying the UI object as selected when the 3D pointer is located in the user's field of view.

[0016] A non-transitory computer-readable storage medium storing computer instructions that, when executed by a processor of a display device providing a 3D image according to one or more embodiments of the present disclosure, cause the display device to perform an operation, the operation including: displaying a UI object on a display; identifying a user's eye position based on a captured image acquired through a camera; displaying a 3D pointer for selecting the UI object based on the user's eye position based on a first depth protruding from the UI object; identifying a user's field of view corresponding to the UI object based on the user's eye position and the first display position of the UI object; and identifying the UI object as selected when the 3D pointer is located in the user's field of view.

[0017] FIG. 1A and FIG. 1B are drawings for explaining the operation of a display device according to one or more embodiments.

[0018] FIG. 2 is a block diagram illustrating a configuration of a display device according to one or more embodiments.

[0019] FIG. 3 is a drawing for explaining a 3D image display method that provides a three-dimensional effect of a display device according to one or more embodiments.

[0020] FIG. 4 is a drawing for explaining a three-dimensional pointer display process according to one or more embodiments.

[0021] FIG. 5 is a diagram illustrating a process for identifying a viewing range of a display device according to one or more embodiments.

[0022] FIG. 6 is a diagram illustrating a selection process of a UI object according to one or more embodiments.

[0023] FIG. 7 is a drawing for explaining an animation effect of a UI object according to one or more embodiments.

[0024] FIG. 8 is a diagram for explaining a process of identifying a movement direction of a UI object according to one or more embodiments.

[0025] FIG. 9 is a diagram illustrating a process of changing a user's field of view range according to one or more embodiments.

[0026] FIG. 10 is a diagram illustrating a three-dimensional pointer display process provided to another user of a display device according to one or more embodiments.

[0027] FIG. 11 is a diagram illustrating a process for adjusting a three-dimensional pointer display position provided to another user of a display device according to one or more embodiments.

[0028] FIG. 12 is a diagram illustrating a UI object selection process of a laser controller according to one or more embodiments.

[0029] FIG. 13 is a flowchart illustrating the operation of a display device according to one or more embodiments.

[0030] FIG. 14 is a flowchart illustrating the overall operation process of a display device according to one or more embodiments.

[0031] The terms used in the various embodiments of this disclosure have been selected from widely used, current terms, taking into account the functions of this disclosure. However, these terms may vary depending on the intentions of those skilled in the art, precedents, the emergence of new technologies, etc. Furthermore, in certain cases, terms may be arbitrarily selected by the applicant, and in such cases, their meanings will be described in detail in the description of the relevant disclosure. Therefore, the terms used in this disclosure should be defined based on the meaning of the terms and the overall content of this disclosure, rather than simply their names.

[0032] In this disclosure, expressions such as “has,” “can have,” “includes,” or “may include” indicate the presence of a corresponding feature (e.g., a component such as a number, function, operation, or part), and do not exclude the presence of additional features.

[0033] The expression "at least one of A and / or B" should be understood to mean either "A" or "B" or "A and B".

[0034] The expressions “first,” “second,” “first,” or “second,” etc., used in this disclosure can describe various components, regardless of order and / or importance, and are only used to distinguish one component from another, but do not limit the components.

[0035] When it is said that a component (e.g., a first component) is “(operatively or communicatively) coupled with / to” or “connected to” another component (e.g., a second component), it should be understood that the component may be directly coupled to the other component, or may be connected through another component (e.g., a third component).

[0036] Singular expressions include plural expressions unless the context clearly dictates otherwise. In this disclosure, terms such as "comprise" or "consist of" are intended to indicate the presence of a feature, number, step, operation, component, part, or combination thereof described in the specification, but should be understood not to preclude the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0037] In the present disclosure, a "module" or "part" performs at least one function or operation and may be implemented as hardware or software, or as a combination of hardware and software. Furthermore, multiple "modules" or multiple "parts" may be integrated into at least one module and implemented as at least one processor (not shown), excluding any "modules" or "parts" that need to be implemented as specific hardware.

[0038] In this disclosure, the term user may refer to a person using an electronic device or a device used by the person.

[0039] An embodiment of the present disclosure will be described in more detail with reference to the attached drawings below.

[0040] FIG. 1A and FIG. 1B are drawings for explaining the operation of a display device according to one or more embodiments.

[0041] According to one embodiment, the display device (100) can display a three-dimensional (3D) image through the display (110). Here, the display device (100) can be implemented as various types of display devices such as a TV, a monitor, a kiosk, a tablet PC, an electronic picture frame, a mobile phone, a large format display (LFD), a digital signage, a digital information display (DID), a video wall, a projector display, etc. However, in some cases, the display device (100) can be implemented as an image processing device (e.g., a set-top box, one connected box) that is connected to the display device and provides an image.

[0042] According to one embodiment, the display device (100) utilizes binocular parallax to generate a left-eye image (or first image) that can be recognized by the user's left eye (10) and a right-eye image (or second image) that can be recognized by the user's right eye (20), and can simultaneously display the left-eye image and the right-eye image using designated pixels of the display (110).

[0043] According to one embodiment, the display device (100) may include an optical structure disposed in front of the display (110) so that a left-eye image output from the display is substantially recognized by the user's left eye (10) and a right-eye image is substantially recognized by the user's right eye (20). Specifically, the display may include an optical structure so that a left-eye image output from the display is not recognized by the right eye (20) and a right-eye image is not recognized by the left eye (10).

[0044] For example, the display device (100) may include a lenticular lens structure (260) of FIG. 1A or a parallax barrier structure (270) of FIG. 1B that allows the left eye image and the right eye image to be recognized as the left eye (10) and the right eye (20), respectively.

[0045] Referring to FIG. 1A, a film (or glass) including a plurality of lenticular lenses (260) may be placed on the front of the display of the display device (100). According to one embodiment, the plurality of lenticular lenses (260) included in the film may cover each pixel column or each group including a plurality of pixel columns. On the display (110) of the display device (100), a left-eye image may be displayed on odd-numbered pixel columns (or groups) (220), and a right-eye image may be displayed on even-numbered pixel columns (or groups) (230).

[0046] According to one embodiment, the lenticular lenses covering the pixel column (220) on which the left-eye image is displayed may refract light corresponding to the output image in a direction corresponding to the position of the user's left eye (10), and the lenticular lenses covering the pixel column (230) on which the right-eye image is displayed may refract light corresponding to the output image in a direction corresponding to the position of the user's right eye (20). Here, the direction corresponding to the left-eye (10) position and the direction corresponding to the right-eye (20) position may be directions toward the positions of the user's left eye (10) and right eye (20) in each pixel column when the user looks straight ahead at a predetermined distance from the display. According to this structure, even if the left-eye image and the right-eye image are simultaneously output on the display panel (210), only the left-eye image can be substantially recognized through the user's left eye (10), and only the right-eye image can be substantially recognized through the user's right eye (20).

[0047] Referring to FIG. 1B, a parallax barrier (270) may be arranged on the front of the display (110) of the display device (100). According to one embodiment, the parallax barrier (270) may have a blocking bar (or black bar) (274) that blocks light output from the display (110) and a slit (272) that allows light to pass through, arranged in an intersecting manner. The horizontal width of the blocking bar (274) and the slit (272) may correspond to the horizontal width of a pixel row or a group including multiple pixel rows that intersect and output a left-eye image and a right-eye image.

[0048] As the blocking bar (274) and the slit (272) are arranged to intersect in the parallax barrier (270), the left eye image output from the odd pixel column (or group) (220) passes through the slit (272) and is recognized by the user's left eye (10), and the right eye image output from the even pixel column (or group) (230) can be recognized by the user's right eye (20).

[0049] In addition, the left eye image may be blocked by the blocking bar (274) in the direction toward the user's right eye (20) and may not be substantially recognized by the user's right eye (20), and the right eye image may be blocked by the blocking bar (274) in the direction toward the user's left eye (10) and may not be substantially recognized by the user's left eye (10).

[0050] In the present disclosure, the display device (100) is described as an example of implementing a 3D screen using the lenticular lens structure (260) of FIG. 1A or the parallax barrier structure (270) of FIG. 1B, but is not limited thereto, and the display device (100) may include a 3D display of another type.

[0051] FIG. 2 is a block diagram illustrating a configuration of a display device according to one or more embodiments.

[0052] According to FIG. 2, the display device (100) includes a display (110), a camera (120), a memory (130), and one or more processors (140). However, the present invention is not limited thereto, and the display device (100) may be implemented in a form in which some components are excluded, or may be implemented in a form in which other components are further included.

[0053] The display (110) is a configuration for displaying a three-dimensional 3D image. The display (110) may be implemented as a display module including a self-luminous element or a display module including a non-luminous element and a backlight. In addition, the display (110) may be implemented as an LFD display according to the above-described content. For example, the display may be implemented as various types of displays such as an LCD (Liquid Crystal Display), an OLED (Organic Light Emitting Diodes) display, an LED (Light Emitting Diodes), a micro LED, a Mini LED, a PDP (Plasma Display Panel), a QD (Quantum dot) display, a QLED (Quantum dot light-emitting diodes), etc. The display (110) may also include a driving circuit, a backlight unit, etc., which may be implemented in a form such as an a-si TFT, an LTPS (low temperature poly silicon) TFT, an OTFT (organic TFT), etc.

[0054] The camera (120) may be a device for identifying the position of the user's eyes located in front of the display device (100). The camera (120) may be implemented as various types of cameras, such as a depth camera, a stereo camera, an AI camera, an infrared camera, a motion camera, etc.

[0055] In one example, the camera (120) may be positioned to capture the front of the display (110). For example, the camera (120) may be positioned in the central area of ​​the upper bezel of the display (110). In one example, the camera (120) may be positioned in a direction and angle that allows it to capture the front of the display (110). In one example, the camera (130) may be positioned in a direction and angle that allows it to be recognized as facing the front of the display (110) when the user's gaze is directed forward in the captured image.

[0056] As an example, the camera (120) may be a device for identifying the user's eye position through eye-tracking.

[0057] The memory (130) can store at least one command, data, program, etc. required for the operation of the display device (100). For example, the memory (130) can store a photographed image captured by the camera (120). For example, the memory (120) can store the display position of a UI object identified by one or more processors (140).

[0058] The memory (130) may be implemented in the form of memory embedded in the display device (100) or in the form of memory detachable from the display device (100) depending on the purpose of data storage. For example, data for driving the display device (100) may be stored in a memory embedded in the display device (100), and data for the expansion function of the display device (100) may be stored in a memory detachable from the display device (100).

[0059] In the case of memory embedded in the display device (100), it may be implemented as at least one of volatile memory (e.g., dynamic RAM (DRAM), static RAM (SRAM), or synchronous dynamic RAM (SDRAM)), non-volatile memory (e.g., one time programmable ROM (OTPROM), programmable ROM (PROM), erasable and programmable ROM (EPROM), electrically erasable and programmable ROM (EEPROM), mask ROM, flash ROM, flash memory (e.g., NAND flash or NOR flash), hard drive, or solid state drive (SSD)).

[0060] The memory (130) may be implemented as a single memory that stores data generated in various operations according to the present disclosure, but is not limited thereto, and the memory (130) may be implemented to include multiple memories that each store different types of data or each store data generated in different stages.

[0061] One or more processors (140) control the overall operation of the display device (100). Specifically, one or more processors (140) may be connected to each component of the display device (100) to control the overall operation of the display device (100). For example, one or more processors (140) may be electrically connected to the display (110), the camera (120), and the memory (130) to control the overall operation of the display device (100). One or more processors (140) may include a processing circuit and may be configured with one or more processors.

[0062] One or more processors (140) can perform operations of the display device (100) according to various embodiments by executing one or more commands stored in the memory (130).

[0063] One or more processors (140) may include one or more of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), an Accelerated Processing Unit (APU), a Many Integrated Core (MIC), a Digital Signal Processor (DSP), a Neural Processing Unit (NPU), a hardware accelerator, or a machine learning accelerator. The one or more processors (140) may execute one or more programs or instructions stored in a memory. For example, the one or more processors may perform a method according to one or more embodiments of the present disclosure by executing one or more instructions stored in a memory.

[0064] When a method according to one or more embodiments of the present disclosure includes multiple operations, the multiple operations may be performed by one processor or by multiple processors. For example, when a first operation, a second operation, and a third operation are performed by a method according to one or more embodiments, the first operation, the second operation, and the third operation may all be performed by the first processor, or the first operation and the second operation may be performed by the first processor (e.g., a general-purpose processor) and the third operation may be performed by the second processor (e.g., an artificial intelligence-specific processor).

[0065] One or more processors (140) may be implemented as a single core processor including one core, or may be implemented as one or more multicore processors including multiple cores (e.g., homogeneous multicores or heterogeneous multicores). When one or more processors (140) are implemented as a multicore processor, each of the multiple cores included in the multicore processor may include an internal processor memory, such as a cache memory or an on-chip memory, and a common cache shared by the multiple cores may be included in the multicore processor. In addition, each of the multiple cores (or some of the multiple cores) included in the multicore processor may independently read and execute a program instruction for implementing a method according to one or more embodiments of the present disclosure, or all (or some) of the multiple cores may be linked to read and execute a program instruction for implementing a method according to one or more embodiments of the present disclosure.

[0066] When a method according to one or more embodiments of the present disclosure includes a plurality of operations, the plurality of operations may be performed by one core among the plurality of cores included in a multi-core processor, or may be performed by the plurality of cores. For example, when a first operation, a second operation, and a third operation are performed by a method according to one or more embodiments, the first operation, the second operation, and the third operation may all be performed by a first core included in the multi-core processor, or the first operation and the second operation may be performed by a first core included in the multi-core processor, and the third operation may be performed by a second core included in the multi-core processor.

[0067] In the embodiments of the present disclosure, a processor may mean a system on a chip (SoC) in which one or more processors and other electronic components are integrated, a single-core processor, a multi-core processor, or a core included in a single-core processor or a multi-core processor, wherein the core may be implemented as a CPU, a GPU, an APU, a MIC, a DSP, an NPU, a hardware accelerator, or a machine learning accelerator, but the embodiments of the present disclosure are not limited thereto. Hereinafter, for the convenience of description, one or more processors (140) will be referred to as a processor (140).

[0068] According to one embodiment, the processor (140) may display a UI (User Interface) object on the display (110). Here, the UI object may include an object, thumbnail, icon, or image in a 2D or 3D form. The UI object may be converted from a 2D image to a three-dimensional 3D image, or from a 3D image to a 2D image.

[0069] According to one embodiment, the processor (140) may identify the user's eye position based on the captured image acquired through the camera (120). Here, the user's eye position may be at least one of the position of the user's left eye, the position of the right eye, or the position between the eyebrows, which is the midpoint between the left and right eyes.

[0070] According to one embodiment, the processor (140) may display a three-dimensional pointer for selecting a UI object based on a first depth protruding from the UI object based on the user's eye position.

[0071] Here, the 3D pointer may be a graphic image that expresses the mouse pointer (or cursor) generated by the mouse controller in a three-dimensional 3D form. The 3D pointer may be displayed at a specific location on the display (110) corresponding to the distance and location (or specific coordinate value) moved by the user when the mouse controller is moved, and may be a graphic image for selecting a UI object based on the displayed location. For example, the 3D pointer may be expressed in various forms such as a sphere, an arrow, a hand shape, and a laser pointer. In the present disclosure, the 3D pointer will be described assuming a spherical shape.

[0072] A 3D pointer may be referred to in various ways, such as a 3D cursor, a spatial pointer, a stereoscopic pointer, a virtual pointer, etc., but in this disclosure, it will be described as a 3D pointer.

[0073] According to one embodiment, the processor (140) can identify the user's field of view corresponding to the UI object based on the user's eye position and the display position of the UI object (hereinafter, the first display position).

[0074] According to one embodiment, the processor (140) may identify a UI object as selected when a 3D pointer is positioned within the user's field of view.

[0075] FIG. 3 is a drawing for explaining a 3D image display method that provides a three-dimensional effect of a display device according to one or more embodiments.

[0076] According to one embodiment, the display device (100) can display a three-dimensional 3D image on the display (110) by utilizing the binocular disparity of the user's left eye (10) and right eye (20).

[0077] In the following, for convenience of explanation, the direction perpendicular to the display (110) of the display device (100) is defined as the z-axis direction, and the horizontal direction of the display is assumed to be perpendicular to the z-axis and the vertical direction is assumed to be the x-axis direction, and the y-axis direction is assumed to be vertical.

[0078] According to one embodiment, the display device (100) may provide a 3D image that provides a three-dimensional effect to the user by using a 3D display such as the lenticular lens structure (260) of FIG. 1A or the parallax barrier structure (270) of FIG. 1B. For example, the display device (100) may generate a left-eye image and a right-eye image, respectively, and display the left-eye image and the right-eye image crosswise through predetermined pixel columns (e.g., odd-numbered columns and even-numbered columns) of the display (110), so that the left-eye image may be recognized by the user's left eye (10) and the right-eye image may be recognized by the user's right eye (20).

[0079] Referring to FIG. 3, when a graphic object of a left-eye image and a graphic object of a right-eye image are output through adjacent pixels on a display (110), a graphic object (300) of a 3D image recognized by a user as the graphic object of the left-eye image and the graphic object of the right-eye image are output can be recognized at a position of the display (110) based on the z-axis direction from the user's line of sight.

[0080] Referring to FIG. 3, when the graphic object (311) of the left-eye image is positioned on the left (or -x direction) and the graphic object (321) of the right-eye image is positioned on the right (or +x direction) based on the x-axis direction, the graphic object (301) of the 3D image can be recognized at a position further from the display (110) based on the z-axis direction from the user's line of sight. When the distance between the graphic object (311) of the left-eye image and the graphic object (321) of the right-eye image is formed to be further than in the example of FIG. 3 (b), the graphic object (301) of the 3D image can be recognized at a position further from the user's line of sight based on the z-axis direction.

[0081] Referring to FIG. 3, when the graphic object (312) of the left eye image is positioned on the right (or +x direction) based on the x-axis direction and the graphic object (322) of the right eye image is positioned on the left, the graphic object (302) of the 3D image can be recognized at a position closer to the display (110) based on the z-axis direction from the user's line of sight. When the distance between the graphic object (312) of the left eye image and the graphic object (322) of the right eye image is formed to be greater than the example of (c) of FIG. 3, the graphic object (302) of the 3D image can be recognized at a position closer to the z-axis direction from the user's line of sight.

[0082] According to one embodiment, the display device (100) can control the depth of a 3D image perceived by a user by adjusting the relative positions and / or distances of the left-eye image and the right-eye image. For example, the display device (100) can render a left-eye image and a right-eye image including a graphic object corresponding to a graphic object of a 3D image to provide a 3D effect for a specific graphic object, and can determine the position of each graphic object on the left-eye image and the right-eye image according to the z-axis direction position of the determined graphic object.

[0083] FIG. 4 is a drawing for explaining a three-dimensional pointer display process according to one or more embodiments.

[0084] According to one embodiment, the display device (100) may display a three-dimensional pointer (420) based on a first depth (430) that protrudes more than a UI object displayed on the display (110). Here, the first depth (430) may include a virtual plane that protrudes in the +z-axis direction more than a plane (or three-dimensional space) on which the UI object displayed on the display (110) is located.

[0085] For example, the display device (100) can display a 3D pointer (420) at a location closer to the display (110) in the z-axis direction from the user's line of sight by utilizing the binocular disparity between the left and right eyes described above.

[0086] The 3D pointer (420) is a graphic image for selecting a UI object, and may be displayed at a position closer to the user's line of sight in the z-axis direction than the UI object displayed on the display (110). For example, the processor (140) may display the UI object in 2D and display the 3D pointer based on negative parallax. In a 3D image, parallax is the difference between two images, and when this value is negative (-), the 3D pointer appears to be in front of the screen. A parallax value that makes the 3D pointer appear to protrude from the screen may be referred to as negative parallax. This is because when the 3D pointer (420) is displayed at a position that is the same as or more sunken than the UI object in the z-axis direction from the user's line of sight, the 3D pointer may be covered by the UI object in the user's line of sight.

[0087] For example, the display device (100) can display the 3D pointer (420) based on the first depth (430) so that the center of the 3D pointer (420) is located on the first depth (430).

[0088] For example, the display device (100) may display a three-dimensional pointer (420) based on a distance (hereinafter, a first distance) from a user (410) to the display (110). Specifically, the display device (100) may display a three-dimensional pointer based on a first depth corresponding to a distance (hereinafter, a second distance (450)) that is a preset ratio from the first distance (440). Here, the preset ratio may be n (where n is an integer) %.

[0089] For example, if the distance from the user (410) to the display (110) is 1 m, and the preset ratio is 10%, the 3D pointer (420) may be displayed based on the first depth (430) that is 10 cm away from the display (110) based on the line of sight of the user (410). However, the maximum protrusion distance for three-dimensional effect may vary depending on the display characteristics of the LFD, and accordingly, the optimal viewing distance for a user who feels three-dimensional effect may also vary. For example, the display characteristics may include information such as size (or resolution), panel type, and hardware configuration. Accordingly, the first depth (430) may be determined by additionally considering the display characteristics of the LFD.

[0090] Referring to FIG. 4, the display device (100) can identify the eye position of the user (410) through the camera (120) and identify a first distance (440) based on the eye position. The display device (100) can display a three-dimensional pointer (420) based on a second distance (450) that is a preset ratio away from the first distance (440). The display device (100) can display a three-dimensional pointer (420) based on a first depth (430) that is a second distance (450) away from the display (110) in the +z-axis direction.

[0091] Referring to FIG. 4, a virtual plane corresponding to the first depth (430) may be positioned perpendicular to the z-axis, i.e., parallel to the x-axis, on a z-axis that is a second distance closer than the display (110) based on the z-axis direction from the user's line of sight. For example, a 3D pointer (420) may be displayed so that the center of the 3D pointer is positioned on a virtual plane corresponding to the first depth (430).

[0092] FIG. 5 is a diagram illustrating a process for identifying a viewing range of a display device according to one or more embodiments.

[0093] According to one embodiment, the display device (100) can identify a field of view (520) of a user (410) corresponding to a UI object (510) based on a first display position of the UI object (510). Here, the first display position may include (x, y) coordinate values ​​where the UI object (510) is located on the display (110). In addition, when the UI object (510) is in a 3D form, the first display position may include (x, y, z) coordinate values. In the present disclosure, for convenience of explanation, it is assumed that the UI object (510) is displayed in a 2D form on the display (110).

[0094] For example, as illustrated in FIG. 5, when a user (410) looks at a UI object (510) from the front, since the 3D pointer (420) is not positioned on the UI object (510) in the user's line of sight, the user (410) recognizes that the UI object (510) is not selected by the 3D pointer (420). For example, as illustrated in FIG. 5, when a user (410) looks at a UI object (510) from the left, since the 3D pointer (420) is positioned on the UI object (510) in the user's line of sight, the user (410) recognizes that the UI object (510) is selected by the 3D pointer (420).

[0095] In this way, since the 3D pointer (420) protrudes in the z-axis direction more than the UI object (510), the user (410) may recognize that the 3D pointer (420) has selected the UI object (510) or not selected it, depending on the user's position relative to the UI object (510).

[0096] The display device (100) can identify whether the UI object is selected based on whether the 3D pointer (420) is located within the user's field of vision (520) corresponding to the UI object (510), rather than whether the 3D pointer (420) and the UI object (510) are displayed overlapping on a 2D plane.

[0097] The field of view (520) of the user (410) may correspond to a virtual three-dimensional figure identified by connecting each edge border surrounding the UI object (510) from the eye position of the user (410). Specifically, the field of view (520) may be the interior of a virtual three-dimensional figure surrounded by a plurality of faces that connect each edge from the eye position of the user (410).

[0098] For example, as illustrated in FIG. 5, if the UI object (510) is a square shape, a pyramid-shaped three-dimensional figure connecting each border surrounding the UI object (510) from the eye position of the user (410) can be identified as the field of view (520) of the user (410).

[0099] For example, if the UI object is circular, a cylinder-shaped three-dimensional figure connecting the curve surrounding the UI object (510) from the eye position of the user (410) can be identified as the field of view (520) of the user (410).

[0100] FIG. 6 is a diagram illustrating a selection process of a UI object according to one or more embodiments.

[0101] According to one embodiment, when a three-dimensional pointer (420) is located within a field of view (520) of a user (410) corresponding to a UI object (510), the display device (100) can identify that the UI object (510) is selected and display the UI object (510) based on the second depth (610).

[0102] When a UI object (510) is selected, the display device (100) may display the UI object (510) so as to protrude in the +z-axis direction from the existing position corresponding to the UI object (510) before selection in order to visually highlight the selected object. For example, when a 3D pointer (420) is displayed so as to be located closest to the user (410), the UI object (510) may be displayed based on a second depth (610) corresponding to a distance further in the z-axis direction from the user's line of sight than the first depth (430) where the 3D pointer (420) is located. Accordingly, the display device (100) may identify the second depth (610) corresponding to the UI object (510) based on the first depth (430) of the 3D pointer (420).

[0103] In one embodiment, when the 3D pointer (420) is in the shape of a sphere, the display device (100) can identify a second depth (610) corresponding to one surface of the sphere among the depth ranges corresponding to the sphere.

[0104] Here, the second depth (610) may include a virtual plane that protrudes in the +z-axis direction from the plane (or three-dimensional space) where the UI object displayed on the display (110) is located, and in the -z-axis direction from the first depth (430) of the three-dimensional pointer (420).

[0105] Referring to FIG. 6, a first depth (430), a second depth (610), and a display (110) are sequentially illustrated from left to right. The second depth (610) may correspond to a virtual plane spaced apart from the first depth (430) by a distance corresponding to the radius of the three-dimensional pointer (420). For example, the second depth (610) may be a depth corresponding to one surface of the three-dimensional pointer (420).

[0106] FIG. 7 is a drawing for explaining an animation effect of a UI object according to one or more embodiments.

[0107] According to one embodiment, the display device (100) may provide an animation effect by gradually adjusting the depth of the UI object (510) to the second depth (610) while adjusting the depth of the UI object (510) based on the identified second depth (610).

[0108] Here, the animation effect may include a graphic effect in which graphic elements corresponding to the UI object move, expand, shrink, or protrude over time. For example, when a UI object is selected, the display device (100) may provide an animation effect in which the UI object protrudes gradually so as to come closer to the user over time. For example, when a UI object is selected, the display device (100) may provide an animation effect in which the colors of the remaining UI objects except for the selected UI object fade over time.

[0109] For example, a UI object (510) may have its depth adjusted in the z-axis direction based on a second depth (610). That is, the UI object (510) may have its depth adjusted in a direction perpendicular to the display (110) (+z-axis).

[0110] According to one embodiment, while adjusting the depth of the UI object (510), the field of view (520) of the user (410) corresponding to the UI object (510) may be gradually positioned closer to the user (410) based on the gaze of the user (410). In this case, if the position of the 3D pointer (420) does not change, the 3D pointer (420) may not be positioned in the field of view (520) of the user (410) that is gradually adjusted over time. That is, while the display device (100) adjusts the depth of the UI object (510) based on the second depth (610), the 3D pointer (420) may not be identified in the field of view (520).

[0111] Referring to FIG. 7, when a UI object (510) is selected, a 3D pointer (420) can be positioned in the field of view (710) of the user (410) corresponding to the UI object (510).

[0112] Referring to FIG. 7, while the depth of the UI object (510) is gradually adjusted to the second depth (610), the 3D pointer (420) may not be located in the changed field of view (720) of the user (410) corresponding to the UI object (510). In this case, the display device (100) may identify that the UI object (510) is not selected, and a problem may occur in readjusting the depth of the UI object (510).

[0113] FIG. 8 is a diagram for explaining a process of identifying a movement direction of a UI object according to one or more embodiments.

[0114] According to one embodiment, when a UI object is identified as being selected, the display device (100) can identify a first direction (820) based on the user's eye position (810) and the three-dimensional pointer (420).

[0115] According to an example, the display device (100) can identify virtual spatial coordinates (or first spatial coordinates) corresponding to the user's eye position (810) and virtual spatial coordinates (or second spatial coordinates) corresponding to the three-dimensional pointer (420). Based on the identified first spatial coordinates and second spatial coordinates, the display device (100) can identify direction vectors corresponding to the two coordinates.

[0116] For example, if the first spatial coordinates are (10, 6, 8) and the second spatial coordinates are (2, 4, 3), the display device (100) can identify the direction vector of (8, 2, 5) corresponding to the two coordinates. The display device (100) can identify the first direction (820) based on the identified direction vector.

[0117] Referring to FIG. 8, the display device (100) can identify a first direction (820) based on the user's eye position (810) and the three-dimensional pointer (420). The display device (100) can adjust the depth of the UI object (510) based on the first direction (820) rather than adjusting the depth in the +z-axis direction.

[0118] According to one embodiment, the display device (100) can control the display (110) to display a UI object (510) based on a second display position corresponding to the identified first direction (820).

[0119] The UI object (510) may have its depth adjusted based on a first direction (830) that is not in the direction perpendicular to the display (110), i.e., the +z-axis direction. In this case, the (x, y) coordinate values ​​on the plane corresponding to the first display position of the UI object (510) and the (x, y) coordinate values ​​on the plane corresponding to the second display position of the UI object (510) whose depth is adjusted based on the first direction (820) may be different. Accordingly, the display device (100) may display the UI object (830) based on the second display position corresponding to the first direction (820).

[0120] FIG. 9 is a diagram illustrating a process of changing a user's field of view range according to one or more embodiments.

[0121] According to one embodiment, the display device (100) may change the field of view (520) of the user (410) based on a margin area (910) that includes the UI object (510) while adjusting the depth of the UI object (510) based on the identified second depth (610).

[0122] Here, the margin area (910) may include an area that expands the area on the 2D surface including the UI object by a preset ratio. For example, if the size of the area including the UI object is 5x4 in width and height, and the preset ratio is 10%, the margin area (910) may have a size corresponding to 5.5x4.4 in width and height. Accordingly, the margin area (910) may be an area that combines the area including the UI object with the hatched area (930) illustrated in FIG. 9. The margin area (910) may be referred to in various ways, such as an extra area, an expansion area, a correction area, etc., but in the present disclosure, it will be described collectively as a margin area.

[0123] For example, when the eye position of the user (410) is changed while the depth of the UI object (510) is adjusted, the display device (100) can identify the field of view of the user (410) corresponding to the UI object (510) based on the changed eye position. In this case, before the eye position of the user is changed, the 3D pointer (420) is located within the field of view (520), but as the eye position of the user is changed, the 3D pointer (420) may be located outside the field of view (520).

[0124] The display device (100) may have a problem in that the 3D pointer (420) is identified as not being located within the field of view (520) when the user's head moves about 1 degree relative to the display (110) from the existing user position. Therefore, even when the user's gaze moves slightly, the display device (100) may change the user's field of view based on a margin area including the UI object in order to identify the UI object as being selected.

[0125] Referring to FIG. 9, the display device (100) can identify the user's field of view (920) based on the margin area (910). Even if the user's head moves slightly and the 3D pointer (420) is not located within the existing field of view (520), if it is located within the user's field of view (920) based on the margin area (910), the display device (100) can identify that the UI object (510) has been selected.

[0126] FIG. 10 is a diagram illustrating a three-dimensional pointer display process provided to another user of a display device according to one or more embodiments.

[0127] According to one embodiment, the display device (100) can adjust the display position of a 3D pointer provided to another user (or a second user) other than the user (410) (or the first user) when the other user (or the second user) is identified.

[0128] According to one embodiment, when another user is identified, the display device (100) can identify the user's field of view corresponding to the display (110) based on the eye position of the user (410), and can identify the other user's field of view corresponding to the display (110) based on the eye position of the other user.

[0129] According to one embodiment, the display device (100) can adjust the display position of a 3D pointer provided to another user based on the field of view of the user (410) corresponding to the display (110) and the field of view of another user corresponding to the display (110).

[0130] Referring to FIG. 10, when a first user (410) and a second user (1010) are located at a distance greater than a certain distance, the positions of the 3D pointers identified in the line of sight of the first user (410) and the second user (1010) may be different with respect to the UI object (510).

[0131] When the first user (410) is located to the left with respect to the UI object (510), the display device (100) can identify that the 3D pointer (1020) is located in the field of view (1030) of the first user (410) corresponding to the UI object (510). On the other hand, when the second user (1010) is located to the right with respect to the UI object (510), the display device (100) can identify that the 3D pointer (1040) is not located in the field of view (1050) of the second user (1010) corresponding to the UI object (510).

[0132] The display device (100) can display a 3D pointer (1060) so that the 3D pointer (1040) is positioned within the field of view (1050) of the second user (1010) by adjusting the position of the 3D pointer (1040) identified in the line of sight of the second user (1010) to the right.

[0133] FIG. 11 is a diagram illustrating a process for adjusting a three-dimensional pointer display position provided to another user of a display device according to one or more embodiments.

[0134] According to one embodiment, the display device (100) can identify the size of a first virtual plane (1110) corresponding to a first depth of a three-dimensional pointer (1020) provided to a first user (410) based on a field of view (1130) of the first user (410) corresponding to the display (110). Here, the first virtual plane (1110) may be a rectangular cross-section created by the intersection of the field of view (1130) of the first user (410) corresponding to the display (110) and the first depth, as illustrated in FIG. 11.

[0135] According to one embodiment, the display device (100) may identify the size of a second virtual plane (1120) corresponding to a third depth of a three-dimensional pointer (1040) provided to a second user (1010) based on a field of view (1140) of the second user (1010) corresponding to the display (110). Here, the third depth may include a virtual plane that protrudes in the +z-axis direction from a plane (or three-dimensional space) on which a UI object displayed on the display (110) is located based on the second user. Here, the second virtual plane (1120) may be a rectangular cross-section generated when the field of view (1140) of the second user (1010) corresponding to the display (110) and the third depth meet, as illustrated in FIG. 11.

[0136] For example, the size of the first virtual plane (1110) and the size of the second virtual plane (1120) may be different depending on the distance from the user to the display (110).

[0137] According to one embodiment, the display position of the 3D pointer (1040) provided to the second user (1010) can be adjusted based on the size of the first virtual plane (1110), the size of the second virtual plane (1120), and the display position of the 3D pointer (1020) provided to the first user (410).

[0138] The display device (100) can adjust the display position of the 3D pointer (1040) so that the 3D pointer (1040) can be positioned within the field of view (1050) of the second user (1010). For example, when the second user is located to the right of the first user, the display device (100) can adjust the display position of the 3D pointer (1040) provided to the second user (1010) to the right. For example, when the second user is located to the left of the first user, the display device (100) can adjust the display position of the 3D pointer (1040) provided to the second user (1010) to the left.

[0139] Referring to FIG. 11, the display device (100) can identify the size of the first virtual plane (1110) and the size of the second virtual plane (1120). For example, the display device (100) can identify that the ratio of the vertical length of the first virtual plane (1110) to the vertical length of the second virtual plane (1120) is 1 to 1.5.

[0140] The display device (100) can identify the coordinate value (e.g., (2, 2)) of the 3D pointer (1020) displayed on the first virtual plane (1110). The display device (100) can identify the coordinate value (e.g., (3, 3)) of the 3D pointer (1060) to be displayed on the second virtual plane (1120) based on the vertical ratio (1:1.5) of the identified first virtual plane (1110) and the second virtual plane (1120) and the coordinate value of the 3D pointer (1020) displayed on the first virtual plane (1110).

[0141] The display device (100) can adjust the position of a three-dimensional pointer (1040) displayed on the second virtual plane (1120) based on the corrected coordinate values ​​(3, 3).

[0142] FIG. 12 is a diagram illustrating a UI object selection process of a laser controller according to one or more embodiments.

[0143] According to one embodiment, the display device (100) can control the display (110) to display a UI object selected by the laser controller (200). The laser controller (200) may be a device that projects a laser so that a user (410) can interact with the display device (100) within a 3D environment that provides a three-dimensional image. For example, the user (410) can project a laser onto the display (110) through the laser controller (200) gripped with both hands, and when the projected laser comes into contact with a UI object, the user can select the UI object.

[0144] According to one embodiment, the display device (100) can identify the position of a laser pointer generated by the laser controller (200). The display device (100) receives information about the direction, position, and angle at which the laser is projected from the laser controller (200), and can identify the position of the laser pointer projected on the display (110) based on the received information.

[0145] Here, the laser pointer may be a pointer generated by the intersection of a laser projected from a laser controller (200) and a display (110). The laser pointer may be expressed in various shapes, such as a sphere, arrow, or hand shape, like the three-dimensional pointer described above.

[0146] According to one embodiment, when the display device (100) identifies that a UI object has been selected by a laser pointer, the display device (100) can identify a second direction based on the position of the laser controller (200) and the laser pointer. The method for identifying the second direction is the same as the method for identifying the first direction based on the laser controller (200) and the laser pointer, and thus a detailed description thereof will be omitted.

[0147] According to one embodiment, the display device (100) may control the display (110) to display a UI object based on a third display position corresponding to the identified second direction. The method for displaying a UI object based on the third display position corresponding to the second direction is the same as the method for displaying a UI object based on the second display position corresponding to the first direction, and thus a detailed description thereof will be omitted.

[0148] Referring to FIG. 12, the display device (100) can identify the position of the laser pointer generated from the laser controller (200) and identify a second direction (1210) based on the laser controller (200) and the laser pointer. The display device (100) can display the UI object (510) at a second depth based on a third display position corresponding to the second direction.

[0149] FIG. 13 is a flowchart illustrating the operation of a display device according to one or more embodiments.

[0150] Referring to FIG. 13, in operation 1310, the display device (100) can recognize the user based on an image captured through the camera (120).

[0151] In operation 1320, the display device (100) can identify a field of view corresponding to a UI object based on the UI object displayed on the display (110).

[0152] In operation 1330, the display device (100) can identify whether a 3D pointer corresponding to the mouse controller is located in a field of view corresponding to a UI object when the user moves the mouse controller.

[0153] In operation 1340, the display device (100) can display a UI object based on the second depth when the 3D pointer is located within the user's field of view (operation 1330, Y).

[0154] In operation 1350, the display device (100) can identify whether the user's head movement amount is within a preset threshold value.

[0155] In operation 1360, the display device (100) can maintain the UI object as selected if the amount of head movement of the user is within a preset threshold value (operation 1350, Y).

[0156] FIG. 14 is a flowchart illustrating the overall operation process of a display device according to one or more embodiments.

[0157] Referring to FIG. 14, in operation 1410, the display device (100) can display a UI object on the display.

[0158] In operation 1420, the display device (100) can identify the user's eye position based on the captured image acquired through the camera.

[0159] In operation 1430, the display device (100) can display a three-dimensional pointer for selecting a UI object based on a first depth protruding from the UI object based on the user's eye position.

[0160] In operation 1440, the display device (100) can identify the user's field of view corresponding to the UI object based on the user's eye position and the first display position of the UI object.

[0161] In operation 1450, the display device (100) can identify a UI object as selected when a 3D pointer is positioned within the user's field of view.

[0162] The method for displaying a 3D pointer based on a first depth protruding from a UI object and the method for identifying a user's field of view corresponding to a UI object have been specifically described in the various embodiments described above, so a redundant description thereof will be omitted.

[0163] The control method described in FIG. 14 can be performed by a display device (100) having the configuration of FIG. 2 described above, but is not necessarily limited thereto, and can also be performed by a display device having various configurations.

[0164] The various embodiments described above may be implemented as a single embodiment, or at least one embodiment may be combined with each other in whole or in part and implemented together in one device.

[0165] According to the various embodiments described above, the display device can provide interaction within a more accurate 3D environment by selecting a UI object overlapping with a 3D pointer based on the user's line of sight.

[0166] Meanwhile, the various embodiments described above may be applied to a product as an embodiment alone, but at least some of the contents may be implemented in combination with other embodiments of the present disclosure.

[0167] The various embodiments described above can be implemented as software including instructions stored in a machine-readable storage medium that can be read by a machine (e.g., a computer). The device is a device that can call instructions stored in the storage medium and operate according to the called instructions, and may include an electronic device (e.g., a display device (100)) according to the disclosed embodiments. When an instruction is executed by a processor, the processor can perform a function corresponding to the instruction directly or by using other components under the control of the processor. The instruction may include code generated or executed by a compiler or interpreter. The machine-readable storage medium can be provided in the form of a non-transitory computer-readable storage medium. Here, 'non-transitory' means that the storage medium does not contain a signal and is tangible, but does not distinguish between data being stored semi-permanently or temporarily in the storage medium.

[0168] Additionally, according to one embodiment of the present disclosure, the method according to the various embodiments described above may be provided as included in a computer program product.

[0169] Specifically, a non-transitory readable storage medium or a computer program product storing computer instructions for causing an operation to be performed, including a step of displaying a UI object on a display, a step of identifying a user's eye position based on a captured image acquired through a camera, a step of displaying a three-dimensional pointer for selecting a UI object based on the user's eye position based on a first depth protruding from the UI object, a step of identifying a user's field of view corresponding to the UI object based on the user's eye position and the first display position of the UI object, and a step of identifying the UI object as selected when the three-dimensional pointer is positioned in the user's field of view, may be provided.

[0170] The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or online through an application store (e.g., Play Store™). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created in a storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0171] In addition, computer instructions or programs for performing the control method of the display device according to the various embodiments described above may be stored in a non-transitory computer-readable medium. The computer instructions stored in such a non-transitory computer-readable medium, when executed by a processor of a specific device, cause the specific device to perform processing operations in the device according to the various embodiments described above. A non-transitory computer-readable medium refers to a medium that stores data semi-permanently and can be read by a device, rather than a medium that stores data for a short period of time, such as a register, cache, or memory. Specific examples of non-transitory computer-readable media may include a CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM, etc.

[0172] Although the preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above, and various modifications may be made by a person having ordinary skill in the art to which the present disclosure pertains without departing from the gist of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical idea or prospect of the present disclosure.

Claims

1. In a display device that provides 3D images, display; camera; memory that stores instructions; and one or more processors including processing circuitry; One or more of the above processors, When the above instructions are executed individually or collectively, Display the UI (User Interface) object on the above display, Identify the user's eye position based on the captured image obtained through the above camera, Displaying a three-dimensional pointer for selecting the UI object based on the user's eye position based on a first depth protruding from the UI object, Identifying the user's field of view corresponding to the UI object based on the user's eye position and the first display position of the UI object, A display device that identifies the UI object as selected when the three-dimensional pointer is positioned within the user's field of view.

2. In paragraph 1, One or more of the above processors, When the above instructions are executed individually or collectively, When the UI object is identified as selected, a first direction is identified based on the user's eye position and the 3D pointer, A display device that controls the display to display the UI object based on a second display position corresponding to the identified first direction.

3. In paragraph 2, One or more of the above processors, When the above instructions are executed individually or collectively, Identifying a second depth corresponding to the UI object based on the first depth of the three-dimensional pointer, A display device that controls the display to display the UI object based on the identified second depth and the second display position.

4. In paragraph 3, If the above 3D pointer is in the shape of a sphere, the first depth is the depth corresponding to the center of the sphere, One or more of the above processors, When the above instructions are executed individually or collectively, A display device that identifies the second depth corresponding to one surface of the sphere among the depth range corresponding to the sphere when the 3D pointer is in the shape of a sphere.

5. In paragraph 1, One or more of the above processors, When the above instructions are executed individually or collectively, A display device that changes the user's field of view range based on a margin area including the UI object while adjusting the depth of the UI object based on the identified second depth.

6. In paragraph 5, One or more of the above processors, When the above instructions are executed individually or collectively, A display device that provides an animation effect by gradually adjusting the depth of the UI object to the second depth while adjusting the depth of the UI object based on the identified second depth.

7. In paragraph 1, One or more of the above processors, When the above instructions are executed individually or collectively, Identifying the user's field of vision corresponding to the display based on the user's eye position, When another user is identified, the field of view of the other user corresponding to the display is identified based on the eye position of the other user, A display device that adjusts the display position of a 3D pointer provided to another user based on the field of view of the user corresponding to the display and the field of view of the other user corresponding to the display.

8. In paragraph 7, One or more of the above processors, When the above instructions are executed individually or collectively, Identifying the size of the first virtual plane corresponding to the first depth of the three-dimensional pointer provided to the user based on the user's field of view corresponding to the display, Identifying the size of a second virtual plane corresponding to the third depth of a 3D pointer provided to the other user based on the field of view of the other user corresponding to the display, A display device that adjusts the display position of a 3D pointer provided to another user based on the size of the first virtual plane, the size of the second virtual plane, and the display position of the 3D pointer provided to the user.

9. In paragraph 1, One or more of the above processors, When the above instructions are executed individually or collectively, Identify the position of the laser pointer generated by the laser controller, When the UI object is identified as being selected by the laser pointer, a second direction is identified based on the position of the laser controller and the laser pointer, A display device that controls the display to display the UI object based on a third display position corresponding to the identified second direction.

10. In a method for controlling a display device providing 3D images, A step of displaying a UI (User Interface) object on a display; A step of identifying the user's eye position based on a captured image acquired through a camera; A step of displaying a three-dimensional pointer for selecting the UI object based on a first depth protruding from the UI object based on the eye position of the user; A step of identifying the user's field of view corresponding to the UI object based on the user's eye position and the first display position of the UI object; and A control method comprising: a step of identifying the UI object as selected when the 3D pointer is positioned within the user's field of view; 11. In paragraph 10, When the UI object is identified as selected, a step of identifying a first direction based on the user's eye position and the 3D pointer; and A control method comprising: a step of displaying the UI object based on a second display position corresponding to the identified first direction; 12. In paragraph 11, The steps for displaying the above UI object are: A step of identifying a second depth corresponding to the UI object based on the first depth of the three-dimensional pointer; and A control method further comprising: a step of displaying the UI object based on the identified second depth and the second display position.

13. In paragraph 12, If the above 3D pointer is in the shape of a sphere, the first depth is the depth corresponding to the center of the sphere, The step of identifying the second depth is: A control method further comprising: a step of identifying the second depth corresponding to one surface of the sphere among the depth ranges corresponding to the sphere when the three-dimensional pointer is in the shape of a sphere.

14. In paragraph 10, A control method comprising: a step of changing the user's field of view range based on a margin area including the UI object while adjusting the depth of the UI object based on the identified second depth; 15. A non-transitory computer-readable storage medium storing computer instructions that, when executed by a processor of a display device providing 3D images, cause the display device to perform an operation, wherein the operation is: A step for displaying a UI object on a display; A step of identifying the user's eye position based on a captured image acquired through a camera; A step of displaying a three-dimensional pointer for selecting the UI object based on a first depth protruding from the UI object based on the eye position of the user; A step of identifying the user's field of view corresponding to the UI object based on the user's eye position and the first display position of the UI object; and A non-transitory computer-readable storage medium, comprising: a step of identifying the UI object as selected when the three-dimensional pointer is positioned within the user's field of view;

Images