Method for providing three-dimensional image, and electronic device supporting same
The electronic device uses eye tracking sensors to ensure accurate 3D image display by determining user location and switching target users, addressing viewing zone and crosstalk issues.
Patent Information
- Application Number
- PCT/KR2025/012128
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-09-12
- Filing Date
- 2025-08-11
- Publication Date
- 2026-02-19
AI Technical Summary
Existing electronic devices providing three-dimensional images face challenges in determining whether a user is within the viewing zone and in accurately identifying and tracking a target user among multiple users, leading to potential crosstalk issues when displaying 3D images.
The electronic device employs a sensor for eye tracking to determine the user's location and provides guides indicating whether a 3D image can be displayed without crosstalk, and identifies and switches target users as they move in and out of the viewing area.
Ensures accurate display of 3D images without crosstalk by dynamically adjusting based on user location and identifying the target user, enhancing the 3D imaging experience.
Smart Images

Figure KR2025012128_19022026_PF_FP_ABST
Abstract
Description
Method for providing three-dimensional images and electronic devices supporting the same
[0001] The present disclosure relates to a method for providing a three-dimensional image and an electronic device supporting the same.
[0002] Electronic devices can provide three-dimensional images (e.g., three-dimensional stereoscopic images). For example, the electronic devices can provide three-dimensional images using glasses (e.g., shutter glasses, polarized glasses) or using a glasses-free method.
[0003] The glasses-free method may be a method of implementing a three-dimensional image by using a lenticular lens or parallax barrier placed in front of the display to allow the user's left and right eyes to see different image information.
[0004] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above-described matters constitute prior art related to the present disclosure.
[0005] An electronic device including a 3D display utilizing a glasses-free method can obtain the positions of a user's eyes (e.g., the user's left and right eyes) using a sensor (e.g., a sensor for eye tracking). The electronic device can display a 3D image corresponding to the positions of the user's eyes through the 3D display, thereby providing the user with an appropriate 3D image (e.g., a 3D image provided without crosstalk).
[0006] If a user moves while an electronic device is displaying 3D images, the user may leave the area where the 3D images can be displayed (e.g., the viewing zone, described below). In such cases, the user may not receive appropriate 3D images from the electronic device without being aware that he or she has left the area where the 3D images can be displayed. Accordingly, the electronic device needs to provide information on whether the user is in a state where 3D images can be displayed.
[0007] In addition, while an electronic device provides a 3D image through a display, multiple users may be present in an area where the 3D image can be provided through the display. In this case, the electronic device may determine a target user (e.g., a user to whom a 3D image will be provided without crosstalk) among the multiple users and provide a 3D image corresponding to the determined target user. In this case, the electronic device needs to provide information about the target user to the multiple users (e.g., information about which user among the multiple users has been determined to be the target user, and the location of the user determined to be the target user). In addition, after determining the target user, if the target user leaves the area where the 3D image can be provided through the display, the electronic device may determine a new target user from among the remaining users, excluding the user who was determined to be the target user. In this case, the electronic device needs to provide information about the newly determined target user to the remaining users.
[0008] Various embodiments of the present disclosure relate to a method for providing a three-dimensional image and an electronic device supporting the same, which can provide a guide indicating whether a user is in a state in which a 3D image (e.g., an appropriate 3D image) can be provided based on a location of a user (e.g., a target user) obtained using a sensor for eye tracking and an area in which a 3D image can be provided through a display.
[0009] The technical problems to be solved by the present disclosure are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present invention belongs from the description below.
[0010] An electronic device according to one embodiment may include a display capable of displaying a 3D image using a glasses-free method, a sensor for eye tracking, at least one processor including a processing circuit, and a memory storing instructions. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to acquire a location of a user based on sensed data acquired through the sensor. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to provide a first guide indicating that the user is in a state in which the 3D image can be provided based on the acquired location of the user being included in a first area in which the 3D image is to be provided when the 3D image is displayed through the display. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display a 3D image to be provided to the user through the display without crosstalk based on the acquired location, based on the acquired location being included in the first area. The above instructions, when executed individually or collectively by the at least one processor, may cause the electronic device to provide a second guide indicating that the user is in a state in which the 3D image cannot be provided through the display based on the acquired user's location not being included in the first area.
[0011] According to one embodiment, a method for providing a 3D image in an electronic device may include an operation of acquiring a user's location based on sensing data acquired through a sensor for eye tracking. The method may include an operation of providing a first guide indicating that the user is in a state in which the 3D image can be provided based on whether the acquired user's location is included in a first area in which the 3D image is to be provided when the 3D image is displayed using a glasses-free method through a display of the electronic device. The method may include an operation of displaying a 3D image to be provided to the user without crosstalk through the display based on whether the acquired user's location is included in the first area. The method may include an operation of providing a second guide indicating that the user is in a state in which the 3D image cannot be provided through the display based on whether the acquired user's location is not included in the first area.
[0012] In one embodiment, a non-transitory computer-readable storage medium having recorded thereon computer-executable instructions, wherein the computer-executable instructions, when individually or collectively executed by at least one processor, may cause an electronic device to acquire a location of a user based on sensed data acquired through a sensor for eye tracking. The computer-executable instructions, when individually or collectively executed by at least one processor, may cause the electronic device to provide a first guide indicating that the user is in a state in which the 3D image can be provided based on the acquired location of the user being included in a first area in which the 3D image is to be provided when the 3D image is displayed using a glasses-free manner through a display of the electronic device. The computer-executable instructions, when individually or collectively executed by at least one processor, may cause the electronic device to display a 3D image to be provided to the user through the display without crosstalk based on the acquired location, based on the acquired location being included in the first area. The computer-executable instructions, when executed individually or collectively by at least one processor, may cause the electronic device to provide a second guide indicating that the user is in a state in which the 3D image cannot be provided through the display based on the acquired user's location not being included in the first area.
[0013] FIG. 1 is a block diagram of an electronic device within a network environment according to one embodiment.
[0014] FIG. 2 is a block diagram of an electronic device according to one embodiment.
[0015] FIG. 3 is a drawing for explaining binocular disparity according to one embodiment.
[0016] FIG. 4 is a flowchart illustrating a method for providing a 3D image according to one embodiment.
[0017] FIG. 5A is a drawing for explaining a first region according to one embodiment.
[0018] FIG. 5b is a drawing for explaining a first region according to one embodiment.
[0019] FIG. 6A is a drawing for explaining a first area according to one embodiment.
[0020] FIG. 6b is a drawing for explaining a first area according to one embodiment.
[0021] FIG. 7 is a drawing for explaining a method of providing a first guide or a second guide according to one embodiment.
[0022] FIG. 8 is a drawing for explaining a method of providing a first guide or a second guide according to one embodiment.
[0023] FIG. 9 is a drawing for explaining a method of providing a first guide or a second guide according to one embodiment.
[0024] FIG. 10 is a drawing for explaining a method of providing a first guide or a second guide according to one embodiment.
[0025] FIG. 11 is a drawing for explaining a method of displaying a screen based on a user's location according to one embodiment.
[0026] FIG. 12 is a flowchart illustrating a method for determining a target user according to one embodiment.
[0027] FIG. 13 is a diagram illustrating a method for determining a target user according to one embodiment.
[0028] FIG. 14 is a diagram illustrating a method for determining a target user according to one embodiment.
[0029] FIG. 15 is a diagram illustrating a method for determining a target user according to one embodiment.
[0030] FIG. 16 is a diagram illustrating a method for determining a target user according to one embodiment.
[0031] FIG. 17 is a drawing for explaining a method for providing a 3D image according to one embodiment.
[0032] FIG. 18 is a diagram illustrating a method for determining a target user according to one embodiment.
[0033] FIG. 19 is a diagram illustrating a method for determining a target user according to one embodiment.
[0034] FIG. 20 is a drawing for explaining a method for providing a 3D image according to one embodiment.
[0035] FIG. 21 is a diagram illustrating a method for changing a target user according to one embodiment.
[0036] FIG. 22 is a diagram illustrating a method for changing a target user according to one embodiment.
[0037] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100), according to one embodiment.
[0038] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).
[0039] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or calculations. According to one embodiment, as at least a part of the data processing or calculations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or a secondary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor)) that can operate independently or together therewith. For example, if the electronic device (101) includes a main processor (121) and a secondary processor (123), the secondary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a specified function. The secondary processor (123) may be implemented separately from the main processor (121) or as a part thereof.
[0040] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.
[0041] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).
[0042] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).
[0043] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
[0044] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.
[0045] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. In one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.
[0046] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).
[0047] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
[0048] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
[0049] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0050] A haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. In one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.
[0051] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.
[0052] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least a part of a power management integrated circuit (PMIC).
[0053] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0054] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).
[0055] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.
[0056] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas by, for example, the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).
[0057] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band.
[0058] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).
[0059] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.
[0060] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.
[0061] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.
[0062] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0063] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.
[0064] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smart phones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.
[0065] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
[0066] FIG. 2 is a block diagram of an electronic device (201) according to one embodiment.
[0067] Referring to FIG. 2, in one embodiment, an electronic device (201) may be included in the electronic device (101) of FIG. 1.
[0068] In one embodiment, the electronic device (201) may include communication circuitry (210), a display (220), a sensor (230), memory (240), and / or a processor (250).
[0069] In one embodiment, the communication circuit (210) may be included in the communication module (190) of FIG. 1.
[0070] In one embodiment, the display (220) may be included in the display module (160) of FIG. 1.
[0071] In one embodiment, the display (220) may be a display capable of displaying three-dimensional (3D) images using a glasses-free method.
[0072] In one embodiment, the display (220) may be a display capable of displaying a two-dimensional (hereinafter also referred to as “2D”) and / or three-dimensional (hereinafter also referred to as “3D”) screen using a glasses-free method.
[0073] In one embodiment, the display (220) may be a light field display. For example, the display (220) may display a 3D screen by generating a light field expressed as a vector distribution of light (e.g., intensity and direction of light) in space by a flat display and optical elements.
[0074] In one embodiment, the display (220) may be a display that includes a lenticular lens (also referred to as a “lenticular screen” or “lenticular sheet”) or a parallax barrier.
[0075] In one embodiment, the display (220) may be configured to display a 3D screen using a lenticular lens disposed on the display (220) (e.g., disposed on or attached to the front of the display panel). For example, the display (220) may separate left and right binocular screens (e.g., left and right binocular images) using the lenticular lens. The left and right screens separated by the lenticular lens may be incident on the left and right eyes of the user, respectively, to provide a 3D screen.
[0076] In one embodiment, the display (220) may be configured to display a 3D image using a parallax barrier disposed on the display (220). For example, the display (220) may display a 3D image using an optical configuration (e.g., an optical plate) in which barriers and apertures are disposed at regular intervals.
[0077] However, the display (220) may display a three-dimensional screen using a glasses-free method, but is not limited to the examples described above. For example, the display (220) may be implemented using a volumetric display method that creates a three-dimensional image in a physical three-dimensional space using voxels (Voxels: Volumetric pixels), which are pixels in space.
[0078] In one embodiment, the display (220) may be a display capable of simultaneously displaying a 2D screen and a 3D screen. For example, the display (220) may be a display capable of displaying a portion of the screen in 2D and another portion of the screen in 3D. For example, the display may be capable of simultaneously displaying a 2D screen and a 3D screen such that at least a portion of the 2D screen and at least a portion of the 3D screen overlap.
[0079] In one embodiment, the sensor (230) may be included in the sensor module (176) of FIG. 1.
[0080] In one embodiment, the sensor (230) may include a sensor for eye tracking (hereinafter also referred to as an “ET sensor”).
[0081] In one embodiment, the ET sensor may include an infrared depth sensor (or infrared camera) and an infrared (or visible light) eye tracking camera. However, the ET sensor is not limited to the examples described above and may include any sensor capable of tracking the position of the user's eyes. For example, the ET sensor may include an RGB camera.
[0082] In one embodiment, the ET sensor may be an under display camera (UDC) camera positioned under the display.
[0083] In one embodiment, the ET sensor may be configured to obtain (e.g., calculate) (or track) the positions of the user's eyes (e.g., the positions of the user's eyes relative to the position of the electronic device (201)) using sensing data (e.g., depth information or images) obtained through the ET sensor. For example, the ET sensor may be configured to obtain the distance between the user's eyes and the electronic device (201) (e.g., the display (220)) and the direction between the electronic device (201) and the user using information or images obtained through the ET sensor.
[0084] In one embodiment, the ET sensor may include multiple ET sensors. For example, the electronic device may include multiple ET sensors to acquire the user's location within a wider range (e.g., a wider field of view).
[0085] In one embodiment, the sensor (230) may include a sensor (or camera) (hereinafter also referred to as a “gesture sensor”) for recognizing a user’s gesture (e.g., a hand gesture).
[0086] In one embodiment, the memory (240) may be included in the memory (130) of FIG. 1.
[0087] In one embodiment, the memory (240) may store information necessary to perform an operation to provide a 3D image.
[0088] In one embodiment, the memory (240) may store instructions that, when executed individually or collectively by at least one processor (250) included in the electronic device (201), cause the electronic device (201) to provide a 3D image.
[0089] In one embodiment, the processor (250) may perform the overall operation of providing a 3D image. In one embodiment, the processor (250) may include one or more processors for providing a 3D image. Hereinafter, with reference to the drawings, the operation of the processor (250) for providing a 3D image will be described.
[0090] In FIG. 2, the electronic device (201) is illustrated as including a communication circuit (210), a display (220), a sensor (230), a memory (240), and a processor (250), but is not limited thereto. For example, the electronic device (201) may further include at least one of the components included in the electronic device (101) of FIG. 1. For example, the electronic device (201) may not include some components (e.g., the communication circuit (210)) among the communication circuit (210), the display (220), the sensor (230), the memory (240), and the processor (250).
[0091] FIG. 3 is a drawing for explaining binocular disparity according to one embodiment.
[0092] Referring to FIG. 3, in one embodiment, when a left-eye image and a right-eye image are simultaneously output on a screen (e.g., display (220)), binocular parallax may occur due to the distance between the left-eye image and the right-eye image, the position of the left-eye image, and the position of the right-eye image.
[0093] In one embodiment, reference numeral 301 may represent zero parallax. As illustrated in reference numeral 301, in zero parallax, left and right eye images (312, 313) are output at substantially the same points within the screen (311), such that the left eye (332) and right eye (333) of the user (331) may perceive (see) 3D images corresponding to the left and right eye images (312, 313) as being displayed within the screen (311) (e.g., at a depth equal to the depth of the screen (311)).
[0094] In one embodiment, reference numeral 302 may represent positive parallax. As illustrated in reference numeral 302, in positive parallax, by outputting the left eye image (312) on the screen (311) at a left position relative to the right eye image (313), the 3D image (321) may be perceived as being displayed behind the screen (311) (e.g., behind or below the display (220)).
[0095] In one embodiment, reference numeral 303 may represent negative parallax. As illustrated in reference numeral 303, in negative parallax, by outputting the left-eye image (312) to the right relative to the right-eye image (313) on the screen (311), the 3D image (321) may be perceived as being displayed in front of the screen (311) (e.g., in front of the display (220)) (e.g., as protruding in front of the screen (311).
[0096] Hereinafter, by positive parallax, the space formed behind the screen (311) (e.g., the depth of the screen (311)) based on the plane of the screen (e.g., the display (220)) may also be referred to as "positive parallax space." In addition, by negative parallax, the space formed in front of the screen based on the plane of the screen may also be referred to as "negative parallax space."
[0097] Hereinafter, an operation of an electronic device (201) outputting a 3D image (3D image data) through a display (220) so that the 3D image (e.g., a 3D object) (or a 2D image) is perceived or shown to the user as being located in a 3D space may be referred to as an operation of displaying a 3D image through the display (220).
[0098] FIG. 4 is a flowchart (400) for explaining a method of providing a 3D image according to one embodiment.
[0099] Referring to FIG. 4, in operation 401, in one embodiment, the processor (250) may obtain the user's location based on sensing data obtained through the sensor (230).
[0100] In one embodiment, the operation of the processor (250) to obtain the user's location may include the operation of the processor (250) to obtain the locations of the user's eyes (e.g., the user's left and right eyes). Hereinafter, for convenience of explanation, the terms "user's location" and "user's eye location" may be used interchangeably.
[0101] In one embodiment, the processor (250) can obtain sensing data through the ET sensor. The processor (250) can obtain depth information (e.g., a depth map or image) for the field of view area of the ET sensor based on the obtained sensing data. The processor (250) can determine whether a user (e.g., a user's face) is detected within the field of view area of the ET sensor based on the depth information. Based on detection of the user's face within the depth information, the processor (250) can obtain (e.g., calculate) the positions of the user's eyes (e.g., the left eye and the right eye) (e.g., the positions of the user's eyes relative to the position of the ET sensor) using the depth information (e.g., a portion corresponding to the user's face within the depth information).
[0102] In one embodiment, the operation of obtaining the position of the user's eyes may include obtaining the distance between the electronic device (201) (e.g., ET sensor) and the user's eyes, and the direction from the position of the electronic device (201) (e.g., ET sensor) to the position of the user's eyes.
[0103] In one embodiment, the processor (250) may perform an operation of acquiring a user's location based on sensed images acquired through the sensor (230) while a 2D image and / or a 3D image is displayed through the display (220). For example, the processor (250) may perform an operation of acquiring a user's location based on sensed data acquired through the sensor (230) while a 3D image is displayed through the display (220).
[0104] In one embodiment, the above-described examples illustrate, but are not limited to, obtaining the user's location by an ET sensor included in the electronic device (201). For example, the user's location may be obtained through a camera included in an external electronic device wirelessly connected to the electronic device (201). The processor (250) may obtain the user's location by receiving the user's location obtained from the external electronic device from the external electronic device through the communication circuit (210).
[0105] In operation 403, in one embodiment, the processor (250) may provide a first guide indicating that the user is in a state in which the 3D image can be provided, based on whether the user's location is included in an area (hereinafter referred to as a "first area") in which the 3D image can be provided when the 3D image is displayed through the display (220).
[0106] In one embodiment, the processor (250) may determine whether the user's location (e.g., the location of the user's eyes obtained in operation 401) is included in a first area that can be a 3D image through the display (220).
[0107] In one embodiment, the first area (also referred to as a “viewing zone” or “first space”) may be an area (e.g., a space) in which left-eye images and right-eye images of the entire 3D image displayed through the display (220) can be provided separately (without overlapping) to the user’s left and right eyes. The first area will be described below with reference to FIGS. 5A, 5B, 6A, and 6B.
[0108] FIG. 5 is a drawing for explaining a first area according to one embodiment.
[0109] FIG. 5b is a drawing for explaining a first region according to one embodiment.
[0110] FIG. 6A is a drawing for explaining a first area according to one embodiment.
[0111] FIG. 5b is a drawing for explaining a first region according to one embodiment.
[0112] Referring to FIGS. 5A, 5B, 6A, and 6B, in one embodiment, at reference numerals 501 and 502 of FIG. 5, the X-axis may represent a direction corresponding to the width of the display (220) (the display (220) including a lenticular lens or a parallax barrier), the Y-axis may represent a direction corresponding to the height of the display (220), and the Z-axis may represent a direction perpendicular to the display (220) (e.g., a direction corresponding to a distance from the display (220).
[0113] In one embodiment, reference numeral 501 may be a drawing for explaining a first region (A) that can be formed when one 3D pixel data (e.g., data of one left-eye pixel and data of one right-eye pixel) is output through the display (220).
[0114] In one embodiment, at reference numeral 501, a first region (A) may be formed based on a viewing angle (θ1) of the display (220) (e.g., a viewing angle formed from a single aperture formed between unit lenses or barriers of a lenticular lens) and a maximum distance at which a 3D image can be provided. The viewing angle (θ1) of the display (220) may be determined based on characteristics of the display (220).
[0115] In one embodiment, in reference numeral 501, lines (511-1, 511-2) may represent a range in which left-eye pixel data or right-eye pixel data can be provided to a user through a unit lens (a unit lens of a lenticular lens) positioned at a point (511) of the display (220). A viewing angle (θ1) of the display (220) may be an angle between lines (511-1, 511-2).
[0116] In one embodiment, at reference numeral 501 (and reference numeral 502), the distance (d1) may represent a maximum distance from the display (220) at which the left-eye image and the right-eye image of the 3D image can be provided separately (e.g., without the left-eye image and the right-eye image overlapping). For example, when a user (e.g., an eye of the user) is positioned at a distance less than the distance (d1) from the display (220), one pixel data (e.g., the left-eye pixel data or the right-eye pixel data) output from a location on the display (220) can be provided to either the left or the right eye of the user. When the user is positioned at a distance greater than the distance (d1) from the display (220), one pixel data (e.g., the left-eye pixel data or the right-eye pixel data) output from a location on the display (220) can be provided to both the left and right eyes of the user (and can be provided overlappingly to the left and right eyes of the user).
[0117] In one embodiment, at reference numeral 501, line (515) may represent positions that are spaced apart by a distance (d1) from line (514), which represents positions extending from the position of the display (220).
[0118] In one embodiment, at reference numeral 501, the first area (A) may be determined by point (511) and points (512, 513) where line (515) intersects lines (511-1, 511-2).
[0119] In one embodiment, reference numeral 502 may be a drawing for explaining a first area (B) formed in which a 3D image is output throughout the entire area of the display (220).
[0120] In one embodiment, at reference numeral 502, a first region (B) may be formed based on a viewing angle (θ2) of a unit lens (e.g., a unit lens of a lenticular lens) disposed at the far left of the display (220), a viewing angle (θ2) of a unit lens disposed at the far right of the display (220), and a maximum distance at which a 3D image can be provided. The viewing angle (θ2) may be substantially equal to the viewing angle (θ1).
[0121] In one embodiment, in reference numeral 502, lines (521-1, 521-2) may represent a range in which left-eye pixel data or right-eye pixel data can be provided through a unit lens (a unit lens of a lenticular lens) positioned at the leftmost point (521) of the display (220). Lines (522-1, 522-2) may represent a range in which left-eye pixel data or right-eye pixel data can be provided through a unit lens positioned at the rightmost point (522) of the display (220).
[0122] In one embodiment, at reference numeral 502, the first region (B) may be formed by points (531, 532, 533, 534) where lines (521-1, 521-2) and lines (522-1, 522-2) intersect.
[0123] In one embodiment, the distance (d2) may be the minimum distance at which a 3D image can be provided. For example, the distance (d2) may be the distance from the display (220) to the point (532) closest to the display (220) within the first region (B) (e.g., the distance between the line (514) and the line (516) passing through the point (532) and parallel to the width of the display (220).
[0124] In one embodiment, FIG. 5B may be a drawing for explaining a first area (C) formed in which a 3D image is output throughout the entire area of the display (220).
[0125] In one embodiment, in FIG. 5B, a first region (C) may be formed based on a viewing angle (θ3) of a unit lens (e.g., a unit lens of a lenticular lens) disposed at the leftmost side of the display (220), a viewing angle (θ3) of a unit lens disposed at the rightmost side of the display (220), and a maximum distance (d3) at which a 3D image can be provided. In one embodiment, the viewing angle (θ3) may be determined based on the characteristics of the display (220). In one embodiment, the angle between each of the directions in which the viewing angles of the unit lenses (e.g., the unit lenses of the lenticular lens) of the display (220) face (e.g., the directions in which the center line of the viewing angle (θ3) faces) and the direction in which the display (220) faces may vary depending on the characteristics of the display (220).
[0126] In one embodiment, in FIG. 5B, lines (541-1, 541-2) may represent a range in which left-eye pixel data or right-eye pixel data can be provided through a unit lens (a unit lens of a lenticular lens) positioned at the leftmost point (541) of the display (220). Lines (542-1, 542-2) may represent a range in which left-eye pixel data or right-eye pixel data can be provided through a unit lens positioned at the rightmost point (542) of the display (220).
[0127] In one embodiment, in FIG. 5b, the first region (C) may be formed by points (581, 582, 583) where lines (541-2), (542-1), and (553) (e.g., a line representing the maximum distance at which a 3D image can be provided) intersect.
[0128] In one embodiment, the distance (d4) may be the minimum distance at which a 3D image can be provided. For example, the distance (d4) may be the distance from the display (220) to the point (581) closest to the display (220) within the first region (C) (e.g., the distance between lines (551) and (552).
[0129] In one embodiment, in FIG. 5B, reference numeral 571 may represent a user located within the first area (C).
[0130] As described above, the first region (viewing zone) (e.g., region (A), region (B), region (C)) may be a region in which the left-eye image and the right-eye image of the entire 3D image displayed through the display (220) can be provided separately (without overlapping) to the left and right eyes of the user. For example, the first region may be a region in which each of the entire pixels of the display (220) displaying the 3D image can provide left-eye pixel data or right-eye pixel data to the user without crosstalk. For example, when a user (e.g., the user's eyes) is positioned within the first region, the first region may be a region (e.g., a space) in which a 3D image can be provided without crosstalk by an operation for processing a 3D image (e.g., an operation for processing a 3D image in software) performed in the electronic device (201) based on the user's position.
[0131] In one embodiment, the area outside the first area may be an area where a proper 3D image cannot be provided. For example, the area outside the first area may be an area where a 3D image cannot be provided without crosstalk even if the electronic device (201) performs a 3D image processing operation based on the user's location.
[0132] In one embodiment, the first region may be formed differently depending on the positions of pixels of the display (220) that outputs the 3D image. For example, the processor (250) may display a 3D image through one area within the display (220) and display a 2D image through the remaining area within the display (220) excluding the one area. In this case, the position (e.g., space) at which the first region is formed may vary depending on the area within the display (220) that displays the 3D image (e.g., positions of pixels in the area that displays the 3D image).
[0133] In one embodiment, the processor (250) may set a second region (hereinafter referred to as a “second region” or “safe region”) and a third region (hereinafter referred to as a “third region” or “danger region”) within the first region.
[0134] In one embodiment, the third region may be a region that includes a boundary (e.g., a boundary surface) of the first region (e.g., shares a boundary surface of the first region).
[0135] For example, in reference numeral 601 of FIG. 6A, the processor (250) can set a second area (A1) and a third area (A2) within the first area (A). The third area (A2) may be an area that includes a boundary of the first area (A) (e.g., a line connecting the point (511) and the point (512), a line connecting the point (511) and the point (513), and a line connecting the point (512) and the point (513)). For example, in reference numeral 602 of FIG. 6A, the processor (250) can set a second area (B1) and a third area (B2) within the first area (B). The third area (B2) may be an area including a boundary of the first area (B) (e.g., a line connecting point (531) and point (532), a line connecting point (532) and point (533), a line connecting point (533) and point (534), and a line connecting point (534) and point (531)).
[0136] For example, in FIG. 6B, the processor (250) can set a second area (C1) and a third area (C2) within the first area (C). The third area (C2) may be an area that includes a boundary of the first area (C) (e.g., a line connecting point (581) and point (582), a line connecting point (582) and point (583), and a line connecting point (583) and point (581).
[0137] In one embodiment, the third region may be an area closer to the outside of the first region than the second region. When the user is located in the third region, the user may be more likely to leave the first region due to movement than when the user is located in the second region.
[0138] In one embodiment, the second region may be an area within the first region excluding the third region. For example, as illustrated in reference numeral 601, the second region (A1) may be set as an area within the first region (A) excluding the third region (A2). For example, as illustrated in reference numeral 602, the second region (B1) may be set as an area within the first region (B) excluding the third region (B2). As illustrated in reference numeral 6b, the second region (C1) may be set as an area within the first region (C) excluding the third region (C2).
[0139] Referring back to FIG. 4, in one embodiment, the processor (250) may provide a first guide indicating that the user is in a state where a 3D image can be provided based on whether the user's location (e.g., the location of the user's eyes) is included in the first area.
[0140] In one embodiment, the processor (250) may display a 3D image to be crosstalk-provided to the user through the display (220) based on the user's location.
[0141] In operation 405, in one embodiment, the processor (250) may provide a second guide indicating that the user is in a state where the 3D image cannot be provided, based on the user's location (e.g., the location of the user's eyes) not being included in the first area.
[0142] Hereinafter, with reference to FIGS. 7 to 11, an operation of providing a first guide or a second guide and an operation of displaying a 3D image to be provided as crosstalk to a user through a display (220) based on the user's location will be described.
[0143] FIG. 7 is a drawing for explaining a method of providing a first guide or a second guide according to one embodiment.
[0144] FIG. 8 is a drawing for explaining a method of providing a first guide or a second guide according to one embodiment.
[0145] Referring to FIGS. 7 and 8, in one embodiment, the processor (250) may provide a guide including different colors, shapes, and / or texts depending on the user's location.
[0146] In one embodiment, the first guide may include a third guide (hereinafter referred to as the “third guide”) and a fourth guide (hereinafter referred to as the “fourth guide”).
[0147] In one embodiment, the third guide may be a guide that indicates a state in which the user is located in the second area (safe area) and can receive a 3D image through the display (220) when the user's location is included in the second area (safe area).
[0148] In one embodiment, the fourth guide may be a guide indicating that the user is located in the third area (danger area) and can receive a 3D image through the display (220) when the user's location is included in the third area (danger area).
[0149] In one embodiment, at reference numeral 701 of FIG. 7, the processor (250) can determine that the location of the user (711) (e.g., the location of the user (711) acquired through a sensor for eye tracking) is included in the second area (safe area) while a screen (710) including a 3D image (712) is displayed through the display (220). In one embodiment, at reference numeral 702, the processor (250) can generate a third guide (720) including an icon (721) representing the user (711), an object (723) displayed around the icon (721), and an indicator (722) indicating that the user (711) is located in the second area and can be provided with the 3D image (712), based on determining that the location of the user (711) is included in the second area. The processor (250) can display the third guide (720) through the display (220).
[0150] In one embodiment, the processor (250) may provide an indicator (722) (and object (723)) having a first color (e.g., green) to indicate to the third guide (720) that the user (711) is located in the second area and is in a state where a 3D image (712) can be provided.
[0151] In one embodiment, the processor (250), at reference numeral 703 of FIG. 7, can determine that the location of the user (711) is included in the third area (danger area) while a screen (730) including a 3D image (732) is displayed through the display (220).
[0152] In one embodiment, at reference numeral 704, the processor (250) may generate a fourth guide (740) including an icon (741) representing the user (711), an object (744) displayed around the icon (741), an indicator (722) indicating that the user (711) is located in the third area and is in a state where a 3D image (732) can be provided, and text (743) guiding the user (711) to move to the second area (safe area) based on determining that the location of the user (711) is included in the third area. The processor (250) may display the fourth guide (740) through the display (220).
[0153] In one embodiment, the processor (250) may provide an indicator (742) and text (743) (and object (744)) having a second color (e.g., orange) to indicate to the fourth guide (740) that the user (711) is located in the third area and is in a state where a 3D image (722) can be provided.
[0154] In one embodiment, the processor (250), at reference numeral 705 of FIG. 7, based on determining that the user (711) is located outside the first area, may display a screen (750) including a 2D image (752) through the display (220). In one embodiment, at reference numeral 706, the processor (250), based on determining that the location of the user (711) is not included in the first area, may generate a second guide (760) including an icon (761) representing the user (711), an object (764) displayed around the icon (761), an indicator (762) indicating that the user (711) is located outside the first area and cannot be provided with a 3D image (732), and text (763) indicating that the user (711) is out of the first area. The processor (250) can display the second guide (760) through the display (220).
[0155] In one embodiment, the processor (250) may provide an indicator (762) and text (763) (and object (764)) having a third color (e.g., red) to indicate that the user (711) is located above the first area and is not able to receive a 3D image.
[0156] In one embodiment, the processor (250) may provide a first guide including a first object (hereinafter referred to as “first object”) representing the first area and a second object (hereinafter referred to as “second object”) positioned within the first object and representing the user’s location, based on whether the user’s location is included in the first area.
[0157] In one embodiment, the processor (250) may provide a second guide including a first object representing the first area and a second object positioned outside the first object and representing the user's location, based on the user's location not being included in the first area.
[0158] In one embodiment, at reference numeral 801 of FIG. 8, the processor (250) may provide (e.g., display through the display (220)) a third guide (810) including a first object (811) representing a first area (e.g., area (A) of FIG. 5A) based on the user's location being included in a second area (safe area), a second object (851) positioned within the first object (811) and representing the user's location within the first area (e.g., distance and direction between the display (220) and the user), and / or an indicator (812) indicating that the user is located in the second area and is in a state in which a 3D image can be provided.
[0159] In one embodiment, the processor (250) may generate the first object (811) such that the shape of the first object (811) representing the first region corresponds to the shape of the first region (e.g., the shape of the first object (811) representing the first region is identical to the shape of the first region). For example, when the first region is formed as the first region (A) of reference numeral 501 of FIG. 5A, the processor (250) may generate the first object (811) such that the shape of the first object (811) is identical to the shape of the first region (A). For example, when the first region is formed as the first region (B) of reference numeral 502 of FIG. 5A, the processor (250) may generate the first object (811) such that the shape of the first object (811) is identical to the shape of the first region (A). For example, when the first region is formed as the first region (C) of FIG. 5b, the processor (250) can generate the first object (811) so that the shape of the first object (811) is the same as the shape of the first region (C).
[0160] In one embodiment, the processor (250) may generate the first object (811) such that the shape of the first object (811) representing the first area corresponds to the shape of the first area, and the first area is reduced to the first object (811) by a specified ratio.
[0161] In one embodiment, the processor (250) may display a first object (811) and a second object (851) through the display (220) based on a location of the first area (e.g., an actual location of the first area relative to a location of the display (220)) and a location of the user (e.g., an actual location of the user relative to a location of the display (220). For example, the processor (250) may generate the first object (811) by reducing the first area by a specified ratio, and determine a location of the second object (851) within the first object (811) such that the location of the user within the first area corresponds to the location of the second object (851) within the first object (811). The processor (250) can display the second object (851) within the first object (811) through the display (220) based on the position of the second object (851) determined within the first object (811). In one embodiment, the operations of creating (and displaying) the first object (811) and the second object (851) described above can be applied identically or similarly to the first objects (e.g., the first object (821), the first object (831), the first object (841)) and the second objects (e.g., the second object (852), the second object (853)) described below.
[0162] In one embodiment, the processor (250) may provide a first object (811) and an indicator (812) having a first color (e.g., green) to indicate that the user is located in the second area and is in a state where a 3D image can be provided.
[0163] In one embodiment, at reference numeral 802 of FIG. 8, the processor (250) may provide (e.g., display through the display (220)) a fourth guide (820) including a first object (821) representing a first area, a second object (852) positioned within the first object (821) and representing the location of the user within the first area (e.g., distance and direction between the display (220) and the user), an indicator (822) representing that the user is located in the third area and is in a state where a 3D image can be provided, and / or text (823) guiding the user to move to the second area, based on the user's location being included in the third area (danger area).
[0164] In one embodiment, the processor (250) may provide a first object (821), an indicator (822), and text (823) having a second color (e.g., orange) to indicate that the user is located in the third area and is in a state where a 3D image can be provided.
[0165] In one embodiment, at reference numeral 803 of FIG. 8, the processor (250) may provide (e.g., display through the display (220)) a second guide (830) including a first object (831) representing the first area based on the user being located outside the first area within the field of view of the ET sensor, a second object (853) positioned outside the first object (831) and indicating the location of the user (e.g., distance and direction between the display (220) and the user), an indicator (832) indicating that the user is located outside the first area within the field of view of the ET sensor and is in a state in which a 3D image cannot be provided, and / or text (833) indicating that the user is out of the first area.
[0166] In one embodiment, the processor (250) may provide a first object (831), an indicator (832), and text (833) having a third color (e.g., red) to indicate that the user is located outside the first area within the field of view of the ET sensor and is not able to receive a 3D image.
[0167] In one embodiment, at reference numeral 804 of FIG. 8, the processor (250) may provide (e.g., display via the display (220)) a fifth guide (840) including a first object (841) indicating a first area, an indicator (842) indicating that a user is not detected within the field of view of the ET sensor, and / or text (843) indicating that a user is not present within the field of view of the ET sensor, based on the user not being detected within the field of view of the ET sensor.
[0168] In one embodiment, the processor (250) may provide a first object (841), an indicator (842), and text (843) having a fourth color (e.g., gray) to indicate that the fifth guide (840) is not detected within the field of view of the ET sensor.
[0169] FIG. 9 is a drawing for explaining a method of providing a first guide or a second guide according to one embodiment.
[0170] FIG. 10 is a drawing for explaining a method of providing a first guide or a second guide according to one embodiment.
[0171] Referring to FIGS. 9 and 10, in one embodiment, the electronic device (201) may provide a first guide or a second guide through an external electronic device connected (e.g., wired or wirelessly) to the electronic device (201).
[0172] In one embodiment, at reference numeral 901, the processor (250) can confirm that the user (911) and the user (912) are located within the first area by receiving sensing data acquired through the ET sensor of the external electronic device (910) through the communication circuit (210) while a screen including a 3D image is displayed through the display (220). The processor (250) can determine the user (911) as a target user among the users (911) and (912). The target user may be a user to whom a 3D image will be provided without crosstalk. When one or more users are located within the first area, an operation of determining the target user among the one or more users will be described in detail below. The processor (250) can confirm that the location of the target user (e.g., the user (911)) is included in the second area based on the sensing data acquired through the external electronic device (910).
[0173] In one embodiment, at reference numeral 902, the processor (250) may control the external electronic device (910) to output an indicator (921) indicating that the target user (e.g., the user (911)) is located in the second area and is in a state where a 3D image can be provided, through a light-emitting unit (e.g., an LED light-emitting unit) disposed around the ET sensors (910-1, 910-2) included in the external electronic device (910), based on determining that the location of the target user (e.g., the user (911)) is included in the second area as a third guide.
[0174] In one embodiment, at reference numeral 902, the processor (250) may control the external electronic device (910) to output an indicator (722) having a first color (e.g., green) such that the indicator (921) indicates that a target user (e.g., user (911)) is located in a second area and is in a state where a 3D image can be provided.
[0175] In one embodiment, at reference numeral 903, a target user (e.g., user (911)) may be located in a third area (danger area). At reference numeral 904, the processor (250) may control the external electronic device (910) to output an indicator (921) indicating that the target user (e.g., user (911)) is located in the third area and is in a state where a 3D image can be provided, as a fourth guide, through light-emitting units (e.g., LED light-emitting units) arranged around ET sensors (910-1, 910-2) included in the external electronic device (910), based on confirmation that the location of the target user (e.g., user (911)) is included in the third area.
[0176] In one embodiment, at reference numeral 904, the processor (250) may control the external electronic device (910) to output an indicator (941) having a second color (e.g., orange) so that the indicator (941) indicates that a target user (e.g., user (911)) is located in a third area and is in a state where a 3D image can be provided.
[0177] In one embodiment, at reference numeral 905, a target user (e.g., user (911)) may be located outside a first area (e.g., outside a first area within a field of view of ET sensors (910-1, 910-2) of the external electronic device (910). At reference numeral 905, the processor (250) may control the external electronic device (910) to output an indicator (961) indicating that the target user (e.g., user (911)) is located outside the first area and cannot receive a 3D image, as a second guide, through a light-emitting unit (e.g., LED light-emitting unit) disposed around the ET sensors (910-1, 910-2) included in the external electronic device (910), based on determining that the target user (e.g., user (911)) is located outside the first area.
[0178] In one embodiment, at reference numeral 906, the processor (250) may control the external electronic device (910) to output an indicator (961) having a third color (e.g., red) to indicate that the target user (e.g., user (911)) is located outside the first area and is not able to receive a 3D image.
[0179] In one embodiment, at reference numeral 1001 of FIG. 10, the processor (250) may control the external electronic device (910) to display a third guide including a first object (1010) representing a first area (e.g., area (A) of FIG. 5A) and a second object (1021) positioned within the first object (1010) and representing a location of the target user (e.g., user (911)) within the first area through a display of the external electronic device (910) (e.g., a display positioned between ET sensors (910-1, 910-2) within the external electronic device (910)) based on the location of the target user (e.g., user (911)) being included in the second area (safe area).
[0180] In one embodiment, in reference numeral 1001, a first object (1010) representing a first region may include objects (1011, 1012, 1013, 1014) representing the first region and corresponding to distances from the display (220) (or a 3D image displayed within the display (220). For example, among the distances represented by the objects (1011, 1012, 1013, 1014), the object (1011) may represent a closest distance from the display (220), and the object (1014) may represent a farthest distance from the display (220). The lengths of the objects (1011, 1012, 1013, 1014) may each represent a width of the first region on an X-axis (e.g., the X-axis in FIG. 5A).
[0181] In one embodiment, as illustrated at reference numeral 1001, the third guide may further include an object (1022) indicating the location of a user (e.g., user (912)) that has not been determined as a target user, in addition to a second object (1021) indicating the location of a target user (e.g., user (911)).
[0182] In one embodiment, the processor (250) may generate the first object (1010) such that the shape of the first object (1010) representing the first area corresponds to the shape of the first area (e.g., the shape of the first object (1010) representing the first area is identical to the shape of the first area).
[0183] In one embodiment, similar to the operation of generating (and displaying) the first object (811) and the second object (851) through FIG. 8, the processor (250) may display the first object (1010) and objects representing users (e.g., the second object (1021) and an object representing a user not determined as a target user (1022)) through the display (220) based on the location of the first area (e.g., the actual location of the first area relative to the location of the display (220)) and the location of the user (e.g., the actual location of the user relative to the location of the display (220).
[0184] In one embodiment, at reference numeral 1002 of FIG. 10, the processor (250) may control the external electronic device (910) to display a fourth guide through the display (220) of the external electronic device (910), the fourth guide including a first object (1010) representing a first area and a second object (1021) positioned within the first object (1010) and representing a location of the target user (e.g., user (911)) within the first area (and an object (1022) representing a location of a user (e.g., user (912)) who is not determined as a target user), based on the location of the target user (e.g., user (911)) being included in a third area (danger area).
[0185] In one embodiment, at reference numeral 1003 of FIG. 10, the processor (250) may control the external electronic device (910) to display a second guide through the display (220) of the external electronic device (910), the second guide including a first object (1010) representing the first area and a second object (1021) representing the location of the target user (e.g., the user (911)) located outside the first area and positioned outside the first object (1010) (and an object (1022) representing the location of a user (e.g., the user (912)) who is not determined as the target user), based on the target user (e.g., the user (911)) being located outside the first area.
[0186] In one embodiment, at reference numerals 1001, 1002, and 1003, the processor (250) may cause an object representing a target user (e.g., user (911)) to be displayed in a different color and / or shape depending on the area to which the target user (e.g., user (911)) belongs. For example, at reference numeral 1001, when the target user is located in a second area, the second object (1021) may have a first color (e.g., green). At reference numeral 1002, when the target user is located in a third area, the second object (1021) may have a second color (e.g., green). At reference numeral 1003, when the target user is located outside the first area, the border of the second object (1021) may be a dotted line.
[0187] FIG. 11 is a drawing for explaining a method of displaying a screen based on a user's location according to one embodiment.
[0188] Referring to FIG. 11, in one embodiment, the processor (250) may display a 3D image through the display (220) so that the 3D image is provided to the user without crosstalk based on whether the location of the user (e.g., a user determined as a target user) is included in the first area. For example, the processor (250) may determine the locations of pixels of the display (220) at which the left-eye image and the right-eye image of the 3D image are to be displayed so that the left-eye image and the right-eye image of the 3D image are provided separately based on the location of the user (e.g., the user's viewpoint) based on whether the user is located within the first area. The processor (250) may display the left-eye image and the right-eye image of the 3D image at the locations of the determined pixels.
[0189] In one embodiment, as shown in reference numeral 1101 of FIG. 11, a user may be positioned in a second area (safe area) within a first area. The processor (250) may display a screen including a 3D image through the display (220) so that the user may view the 3D image without crosstalk at the user's position within the second area.
[0190] In one embodiment, at reference numeral 1102 of FIG. 11, a user (1141) may be located in a third area (a risk area) within a first area. The processor (250) may display a screen including a 3D image through the display (220) so that the user (1141) may view the 3D image without crosstalk at the user's (1141's) location within the third area.
[0191] In one embodiment, at reference numeral 1102, the processor (250) may display information (1122) through the display (220) that guides the user (1141) to move to a safe area (second area) based on the user (1141) being located in the third area.
[0192] In one embodiment, at reference numeral 1103 of FIG. 11, the user (1141) may be located outside the first area. The processor (250) may display a screen including a 2D image through the display (220) based on the user (1141) being located outside the first area.
[0193] In one embodiment, at reference numeral 1103, the processor (250) may display, through the display (220), information indicating that the user (1141) has left the first area and information (1131) indicating that the mode of the electronic device (201) will be switched from a mode of displaying a 3D image to a mode of displaying a 2D image, based on the user (1141) being located outside the first area.
[0194] In the examples described above, the 2D image is displayed based on the user (1141) being located outside the first area, but this is not limited thereto. For example, the processor (250) may display an image through the display (220) so that the 3D image is provided without crosstalk at a designated location (e.g., an optimal location set based on the characteristics of the display (220)).
[0195] Although not illustrated in FIG. 4, at least some of the operations included in FIG. 4 (e.g., obtaining the user's location based on sensing data acquired through the ET sensor) may be performed periodically or based on the occurrence of a specified event.
[0196] FIG. 12 is a flowchart (1200) illustrating a method for determining a target user according to one embodiment.
[0197] Referring to FIG. 12, in operation 1201, in one embodiment, the processor (250) may obtain the locations of one or more users via a sensor (230) (e.g., an ET sensor).
[0198] In one embodiment, the processor (250) may obtain depth information (e.g., a depth map or image) for a field of view of the sensor (230) based on sensing data obtained through the sensor (230). The processor (250) may detect faces of one or more users located within the field of view of the sensor (230) within the depth information. The processor (250) may obtain (e.g., calculate) the positions of eyes of one or more users based on the faces of one or more users detected within the depth information.
[0199] In one embodiment, the act of obtaining the position of each of the eyes of one or more users may include obtaining a distance between the electronic device (201) (e.g., ET sensor) and each of the eyes of the one or more users, and a direction from a position of the electronic device (201) (e.g., ET sensor) to a position of each of the eyes of the one or more users.
[0200] In operation 1203, in one embodiment, the processor (250) can identify at least one user located in the first area based on the locations of one or more users acquired in operation 1201.
[0201] In operation 1205, in one embodiment, the processor (250) may determine a target user from among at least one user (hereinafter also referred to as “at least one user”) located in the first area.
[0202] In one embodiment, the processor (250) may set priorities based on criteria (or conditions) specified for at least one user. The processor (250) may determine, among the at least one user, the user with the highest priority as the target user.
[0203] In one embodiment, the processor (250) may determine, as a target user, at least one user, a user located closest to a designated location, a user who made a gesture corresponding to a designated gesture, a user determined based on an input received from a controller (e.g., a remote control) capable of controlling the electronic device (201), or a user who uttered a designated voice.
[0204] In one embodiment, the processor (250) may determine, based on the 3D advertising content being displayed through the display (220), a user among at least one user having personal information corresponding to the 3D advertising content as the target user.
[0205] In one embodiment, the processor (250) may determine, based on the 3D game being displayed through the display (220), a user who wins the 3D game among at least one user as the target user.
[0206] However, the operation of determining a target user from among at least one user is not limited to the examples described above. Referring to the drawings below, the operation of determining a target user from among at least one user and the operation of displaying a 3D image based on the target user's location (and / or the target user's gesture) will be described in detail.
[0207] In one embodiment, the processor (250) may determine a target user from among at least one user located in the first area or display a 2D image through the display (220) based on whether the target user has moved outside the first area after the target user has been determined. However, the present invention is not limited thereto. For example, the processor (250) may determine whether the target user has moved to an area outside the first area within the field of view of the sensor (230) after the target user has been determined. The processor (250) may maintain the target user (or may not change the target user) based on whether the target user has moved back to the first area within a specified time from the time when the target user has left the first area.
[0208] FIG. 13 is a diagram illustrating a method for determining a target user according to one embodiment.
[0209] FIG. 14 is a diagram illustrating a method for determining a target user according to one embodiment.
[0210] Referring to FIGS. 13 and 14, in one embodiment, reference numeral 1301 of FIG. 13 may represent a situation in which multiple users (1311, 1312, 1313) (hereinafter also referred to as “viewers”) within a home view a screen (e.g., a 3D screen) displayed through a display (220).
[0211] In one embodiment, at reference numeral 1302 of FIG. 13, the processor (250) may perform an operation of recognizing a plurality of users (1311, 1312, 1313) located within a field of view area (1320) of a sensor (230) (e.g., an ET sensor).
[0212] In one embodiment, at reference numeral 1401 of FIG. 14, in one embodiment, the processor (250) may perform an operation of recognizing faces of multiple users (1311, 1312, 1313) through a sensor (230) (e.g., an ET sensor). While performing the operation of recognizing faces of multiple users (1311, 1312, 1313), the processor (250) may display information (1415) indicating that the operation of recognizing faces is being performed through the display (220). The processor (250) can display, through the display (220), a plurality of objects (1411-1, 1412-1, 1413-1) (e.g., icons) corresponding to each of the plurality of users (1311, 1312, 1313), and objects (1411-2, 1412-2, 1413-2) representing (e.g., focusing on) faces in the plurality of objects (1411-1, 1412-1, 1413-1), based on the recognition of faces of the plurality of users (1311, 1312, 1313).
[0213] In one embodiment, although not shown in FIG. 14, the processor (250) can determine that multiple users (1311, 1312, 1313) are located within the first area (viewing zone).
[0214] In one embodiment, the processor (250) may determine, among a plurality of users recognized by the sensor, a user located closest to a designated location as a target user. For example, the processor (250) may determine, among the plurality of users (1311, 1312, 1313), a user (1313) located closest to the location of the electronic device (201) as a target user. However, the present invention is not limited thereto. For example, among the plurality of users (1311, 1312, 1313), the processor (250) may determine, as a target user, a user located closest to an optimal location set based on the characteristics of the display (220).
[0215] In one embodiment, at reference numeral 1402, the processor (250) determines a user (1313) located closest to the location of the electronic device (201) among a plurality of users (1311, 1312, 1313) as a target user, and, based on this, displays the color of the object (1413-2) (and / or the object (1413-1)) through the display (220) so that the object (1413-2) (and / or the object (1413-1)) corresponding to the user (1313) determined as the target user is distinguished from the objects (1411-2, 1412-2) (and / or the objects (1411-1, 1412-1)) corresponding to other users (1311, 1312). 1412-1)) can be displayed in a different color. The processor (250) can display information (1416) asking whether to determine (e.g., designate) the user (1313) as the final target user through the display (220) based on determining the user (1313) located closest to the location of the electronic device (201) among the plurality of users (1311, 1312, 1313) as the target user.
[0216] In one embodiment, at reference numeral 1403, the processor (250) may display, through the display (220), information (1417) indicating that the user (1313) is determined as the final target user, based on determining the user (1313) as the final target user, along with information (1418) indicating that an operation of tracking the position of the user (1313) as the final target user (e.g., the position of the eyes of the user (1313)) will be performed based on determining the user (1313) as the final target user. The processor (250) may perform an operation such that a 3D image is provided to the user (1313) without crosstalk by tracking the position of the user (1313) as the final target user based on determining the user (1313) as the final target user.
[0217] In one embodiment, the processor (250) may determine a user as a target user based on an input received from a controller (e.g., a remote control) capable of controlling the electronic device (201). For example, in FIG. 14, the processor (250) may determine one of a plurality of users (1311, 1312, 1313) as a target user based on a user input using a remote control capable of controlling the electronic device (201).
[0218] In one embodiment, the processor (250) may determine a user based on a user's gesture as a target user. For example, in FIG. 14, the processor (250) may recognize a user's gesture using a gesture sensor. The processor (250) may determine one of a plurality of users (1311, 1312, 1313) as a target user based on the recognized gesture. However, the present invention is not limited thereto. The processor (250) may determine a user who has uttered a specified voice as a target user. For example, the processor (250) may acquire a voice through a microphone. The processor (250) may determine the user who has uttered the voice as a target user based on whether the acquired voice corresponds to a specified voice (e.g., a voice associated with target user settings).
[0219] FIG. 15 is a diagram illustrating a method for determining a target user according to one embodiment.
[0220] FIG. 16 is a diagram illustrating a method for determining a target user according to one embodiment.
[0221] Referring to FIGS. 15 and 16, in one embodiment, reference numeral 1501 of FIG. 15 may represent a situation in which a plurality of users (1511, 1512) in an external public place view a screen (e.g., a 3D screen) displayed through a display (220) of an electronic device (201) (e.g., a kiosk device, an electronic device (201) for displaying guidance information and / or advertisements).
[0222] In one embodiment, at reference numeral 1302 of FIG. 15, the processor (250) may perform an operation of recognizing a plurality of users (1511, 1512) located within a field of view area (1521) of a sensor (230) (e.g., an ET sensor).
[0223] In one embodiment, at reference numeral 1601 of FIG. 16, in one embodiment, the processor (250) may perform an operation of recognizing faces of multiple users (1511, 1512) through a sensor (230) (e.g., an ET sensor). After performing the operation of recognizing faces of multiple users (1511, 1512), the processor (250) may display information (1515) indicating that faces are recognized through the display (220). The processor (250) can display, through the display (220), a plurality of objects (1511-1, 1512-1) corresponding to each of the plurality of users (1511, 1512), and objects (1511-2, 1512-2) representing faces (e.g., focusing on faces) in the plurality of objects (1511-1, 1512-1), based on the recognition of the faces of the plurality of users (1511, 1512).
[0224] In one embodiment, although not shown in FIG. 16, the processor (250) can determine that multiple users (1511, 1512) are located within the first area (viewing zone).
[0225] In one embodiment, at reference numeral 1602, the processor (250) determines a user (1511) located closest to the location of the electronic device (201) among a plurality of users (1511, 1512) as a target user, and, based on this, the object (1511-2) (and / or object (1511-1)) corresponding to the user (1511) determined as the target user can be distinguished from the objects (1512-2) (and / or object (1512-1)) corresponding to other users (1512) by displaying the color of the object (1511-2) (and / or object (1511-1)) differently from the color of the objects (1512-2) (and / or object (1512-1)) through the display (220).
[0226] In one embodiment, at reference numeral 1602, the processor (250) may display, through the display (220), information (1525) indicating that an operation of tracking the location of the user (1511) as the target user (e.g., the location of the eyes of the user (1511)) will be performed, along with information (1526) indicating that the user (1511) is determined to be the target user, based on determining the user (1511) as the target user.
[0227] FIG. 17 is a drawing for explaining a method for providing a 3D image according to one embodiment.
[0228] Referring to FIG. 17, as described above, in one embodiment, the processor (250) may display a 3D image to be crosstalk-provided to the user through the display (220) based on the location of the user (e.g., target user).
[0229] In one embodiment, the processor (250) may control the display (220) to orient the 3D image toward the location of a user (e.g., a target user).
[0230] In one embodiment, the processor (250) may display a 3D image corresponding to the direction of the face of a user (e.g., a target user) (or the direction of the user's gaze) through the display (220).
[0231] In one embodiment, at reference numeral 1701 of FIG. 17, the processor (250) may display a 3D screen (1710) including a 3D image and a first guide (1715) to be crosstalk-provided to the user through the display (220) based on the location of the user (1711) (e.g., target user). The processor (250) may obtain (e.g., calculate) a direction toward which the face of the user (1711) is facing based on an image of the face of the user (1711) obtained through a sensor (230) (e.g., an ET sensor).
[0232] In one embodiment, at reference numeral 1702, the processor (250) may display the screen (1720) so that the screen (1710) appears to be rotated based on a direction corresponding to a direction in which the face of the user (1711) is facing. For example, the processor (250) may display the screen (1720) through the display (220) so that the screen (1720) appears to be facing the front of the face of the user (1711). For example, the processor (250) may display the screen (1720) through the display (220) so that the direction in which the screen (1720) is facing and the direction in which the face of the user (1711) is facing are perpendicular to each other. For example, as illustrated in reference numeral 1702, the processor (250) may control the display (220) such that the left side of the screen (1720) is displayed in negative parallax space and the right side of the screen (1720) is displayed in positive parallax space.
[0233] In one embodiment, when the display (220) displays a 3D image corresponding to the direction of the face (or the direction of the user's gaze) of the user (1711) (e.g., the target user), the user (1711) can perform more precise interactions with the screen (1720). For example, when the screen (1720) is displayed through the display (220) so that the screen (1720) appears to face the front of the user's (1711) face, the user (1711) can input more precise inputs with respect to executable objects (e.g., icons) included in the screen (1720) using the user's finger (or hand gesture (1712)).
[0234] In one embodiment, the processor (250) may perform operations to rotate, zoom in, zoom out, and / or close up a 3D image (or a screen including a 3D image) based on a hand gesture (1712).
[0235] FIG. 18 is a diagram illustrating a method for determining a target user according to one embodiment.
[0236] Referring to FIG. 18, in one embodiment, the processor (250) may determine a target user among a plurality of users based on content displayed through the display (220). For example, the processor (250) may determine a user who wins a 3D game among a plurality of users as a target user based on a screen of a 3D game displayed through the display (220).
[0237] In one embodiment, in FIG. 18, the processor (250) can identify multiple users (1821, 1822) (e.g., identities of the multiple users (1821, 1822)) based on information acquired through the sensor (230) (e.g., ET sensor). For example, the processor (250) can perform face recognition (e.g., facial recognition) on the multiple users (1821, 1822) based on information acquired through the sensor (230) (e.g., ET sensor). The processor (250) can identify (or authenticate) the multiple users (1821, 1822) by comparing features of faces acquired through face recognition with features of faces stored in the memory (240).
[0238] In one embodiment, when a 3D game application is executed, the processor (250) may acquire information on a plurality of users (1821, 1822) playing a 3D game based on user input. While the 3D game application is executed, the processor (250) may display a screen (1810) including a 3D object (1811) through the display (220). The processor (250) may, among the acquired information on the plurality of users (1821, 1822), identify information on a user who won the 3D game among the plurality of users (1821, 1822). The processor (250) may determine a user corresponding to the identified information among the identified plurality of users (1821, 1822) as a target user.
[0239] FIG. 19 is a diagram illustrating a method for determining a target user according to one embodiment.
[0240] Referring to FIG. 19, in one embodiment, the processor (250) may determine a target user from among a plurality of users based on content displayed through the display (220). For example, the processor (250) may determine a user having personal information corresponding to the 3D advertising content from among a plurality of users as the target user based on the 3D advertising content being displayed through the display (220).
[0241] In one embodiment, the processor (250) may display a screen (1910) including 3D advertising content (e.g., content advertising a perfume) via the display (220). The processor (250) may determine (e.g., predict) the gender and / or age group as personal information of a plurality of users (1921, 1922) by analyzing (e.g., using an artificial intelligence model) information (e.g., images) acquired via the sensor (230). For example, the processor (250) may recognize the faces of the plurality of users (1921, 1922) based on the information acquired via the sensor (230). The processor (250) can determine (e.g., predict) the gender and / or age group as personal information of the plurality of users (1921, 1922) based on the features of the recognized faces (or the items worn by the plurality of users (1921, 1922) and / or the hairstyles of the plurality of users (1921, 1922). The processor (250) can determine, among the plurality of users (1921, 1922), a user (1921) who has personal information corresponding to 3D advertising content as a target user. For example, the processor (250) can determine, among the plurality of users (1921, 1922), a user (1921) who is predicted to have a gender (e.g., female) and an age group (e.g., 30s to 40s) suitable for a perfume advertisement as 3D advertising content as a target user.
[0242] In one embodiment, the processor (250) can display 3D advertising content through the display (220) so that the user (1921) is provided with 3D advertising content without crosstalk after the user (1921) is determined as a target user.
[0243] FIG. 20 is a drawing for explaining a method for providing a 3D image according to one embodiment.
[0244] Referring to FIG. 20, in one embodiment, the processor (250) may control the display (220) so that a 3D object included in the 3D screen faces the position of a user (e.g., a target user).
[0245] In one embodiment, at reference numeral 2001 of FIG. 20, the processor (250) may display a screen (2010) including a 3D human object (2011) through the display (220).
[0246] In one embodiment, the processor (250) may rotate (and / or translate) the 3D person object (2011) so that the face (e.g., the eye-representing portion (2014)) within the 3D person object (2011) faces the position of the user (2012) while maintaining the background within the screen (2010). For example, the processor (250) may display the rotated (and / or translated) 3D person object (2011) through the display (220) such that the direction of the portion representing the face within the 3D person object (2011) (e.g., the direction indicated by the arrow (2015)) corresponds to the direction of the face of the user (2012). However, the present invention is not limited thereto, and for example, the processor (250) may perform operations of rotating, enlarging, reducing, and / or closing up the 3D person object (2011) based on a hand gesture (2013) of the user.
[0247] In one embodiment, reference numeral 2002 of FIG. 20 may represent an e-commerce situation. The processor (250) may display a screen (2020) including a 3D object (2021) representing a product through the display (220).
[0248] In one embodiment, the processor (250) may rotate (and / or translate) the 3D object (2021) representing the product so that the 3D object (2021) faces the position of the user (2022) while maintaining the background within the screen (2020). For example, the processor (250) may display the rotated (and / or translated) 3D object (2021) through the display (220) so that the direction in which the 3D object (2021) faces corresponds to the direction of the face of the user (2022). However, the present invention is not limited thereto, and for example, the processor (250) may perform operations of rotating, enlarging, reducing, and / or closing up the 3D object (2021) based on a hand gesture of the user.
[0249] FIG. 21 is a diagram illustrating a method for changing a target user according to one embodiment.
[0250] Referring to FIG. 21, in one embodiment, the processor (250) may determine a first user as a target user among a plurality of users located within a first area, and then, based on the passage of a specified time, determine a second user as a target user among the plurality of users.
[0251] In one embodiment, the processor (250) may determine a user (2111) located closest to the display (220) among a plurality of users (2111, 2112, 2113) located within the first area as a target user.
[0252] In one embodiment, at reference numeral 2101 of FIG. 21, the processor (250) may display a 3D screen (2120) including a first guide (2115) and an object (2110) indicating the passage of time through the display (220) based on determining the user (2111) as a target user.
[0253] In one embodiment, objects (2110) representing the passage of time (e.g., representing a count of time) may be sequentially displayed as objects (2131), (2132), (2133), and (2134) as time passes, as illustrated in reference numeral 2102. For example, based on the time point at which the user (2111) is determined as a target user, object (2131) may be displayed at a first time point, object (2132) may be displayed at a second time point after the first time point, object (2133) may be displayed at a third time point after the second time point, and object (2134) may be displayed at a fourth time point after the third time point.
[0254] In one embodiment, the processor (250) may determine, after a specified period of time has elapsed, among a plurality of users (2111, 2112, 2113), the user (2112) who is closest to the display (220) after the user (2111) as the target user.
[0255] FIG. 22 is a diagram illustrating a method for changing a target user according to one embodiment.
[0256] Referring to FIG. 22, in one embodiment, the processor (250) may determine a first user as a target user among a plurality of users located within a first area, and then determine a second user as a target user among the plurality of users based on completion of a task performed by the first user.
[0257] In one embodiment, at reference numeral 2201 of FIG. 22, the processor (250) can determine that multiple users (2221, 2222) are located within the first area through a sensor (e.g., an ET sensor).
[0258] In one embodiment, at reference numeral 2202 of FIG. 22, the processor (250) may determine a user (2221) located closest to the display (220) among a plurality of users (2221, 2222) located within the first area as a target user. Based on determining the user (2221) as the target user, the processor (250) may display the screen (2210) through the display (220) so that the user (2221) may be provided with a 3D image (2211) (e.g., a 3D object included in the screen (2210)) without crosstalk.
[0259] In one embodiment, the processor (250) may perform a task of ordering food based on input from a user (2221).
[0260] In one embodiment, the processor (250) may change the target user from user (2221) to user (2222) among multiple users (2221, 2222) based on the completion of a task of ordering food based on input from the user (2221).
[0261] An electronic device according to one embodiment may include a display capable of displaying a 3D image using a glasses-free method, a sensor for eye tracking, at least one processor including a processing circuit, and a memory storing instructions. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to acquire a location of a user based on sensed data acquired through the sensor. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to provide a first guide indicating that the user is in a state in which the 3D image can be provided based on the acquired location of the user being included in a first area in which the 3D image is to be provided when the 3D image is displayed through the display. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display a 3D image to be provided to the user through the display without crosstalk based on the acquired location, based on the acquired location being included in the first area. The above instructions, when executed individually or collectively by the at least one processor, may cause the electronic device to provide a second guide indicating that the user is in a state in which the 3D image cannot be provided through the display based on the acquired user's location not being included in the first area.
[0262] In one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to provide the first guide, which includes a first object representing the first area and a second object disposed within the first object and representing the location of the user, based on whether the acquired location of the user is included in the first area. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to provide the second guide, which includes the first object and the second object disposed outside the first object, based on whether the acquired location of the user is not included in the first area.
[0263] In one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to provide, as the first guide, a third guide indicating that the acquired user's location is included in the second area, based on the acquired user's location being included in the second area among the second area and the third area set within the first area. The third area may be an area within the first area including a boundary of the first area, and the second area may be an area within the first area excluding the third area. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to provide, as the first guide, a fourth guide indicating that the acquired user's location is included in the third area, based on the acquired user's location being included in the third area. The above instructions, when executed individually or collectively by the at least one processor, may cause the electronic device to provide the second guide indicating that the user is located outside the first area based on the acquired location of the user not being included in the first area.
[0264] In one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to acquire locations of one or more users based on sensed data acquired through the sensor. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to identify, based on the acquired locations, at least one user from among the one or more users located in the first area. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to determine, from among the at least one user, a target user to whom a 3D image is to be provided without crosstalk through the display.
[0265] In one embodiment, the instructions, when executed individually or collectively by the at least one processor, may cause the electronic device to determine, as the target user, among the at least one user, a user located closest to a designated location, a user who made a gesture corresponding to a designated gesture, a user determined based on input received from a controller configured to control the electronic device, or a user who uttered a designated voice.
[0266] In one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to determine, based on the 3D advertising content being displayed through the display, a user among the at least one user who has personal information corresponding to the 3D advertising content as the target user. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to determine, based on the screen of the 3D game being displayed through the display, a user who wins the 3D game as the target user among the at least one user.
[0267] In one embodiment, the instructions, when executed individually or collectively by the at least one processor, may cause the electronic device to control the display such that the 3D screen is oriented toward a location of the target user based on the target user being determined while the 3D screen is displayed through the display.
[0268] In one embodiment, the instructions, when executed individually or collectively by the at least one processor, may cause the electronic device to control the display such that a 3D object included in the 3D screen faces a location of the target user based on the target user being determined while the 3D screen is displayed through the display.
[0269] In one embodiment, the instructions, when executed individually or collectively by the at least one processor, may cause the electronic device to determine a target user from among at least one user located in the first area, or to display a 2D image through the display, based on the target user moving outside the first area after the target user has been determined.
[0270] In one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to determine a first user, from among the at least one user, who is located closest to the display, as the target user. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display a 3D screen corresponding to a location of the first user through the display. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to determine a second user, from among the at least one user, who is located closest to the display, excluding the first user, as the target user, based on completion of a task performed by the electronic device in response to an input from the first user. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display a 3D screen corresponding to a location of the second user through the display.
[0271] According to one embodiment, a method for providing a 3D image in an electronic device may include an operation of acquiring a user's location based on sensing data acquired through a sensor for eye tracking. The method may include an operation of providing a first guide indicating that the user is in a state in which the 3D image can be provided based on whether the acquired user's location is included in a first area in which the 3D image is to be provided when the 3D image is displayed using a glasses-free method through a display of the electronic device. The method may include an operation of displaying a 3D image to be provided to the user without crosstalk through the display based on whether the acquired user's location is included in the first area. The method may include an operation of providing a second guide indicating that the user is in a state in which the 3D image cannot be provided through the display based on whether the acquired user's location is not included in the first area.
[0272] In one embodiment, the operation of providing the first guide may include an operation of providing the first guide including a first object representing the first area and a second object positioned within the first object and representing the location of the user, based on whether the acquired location of the user is included in the first area. The operation of providing the second guide may include an operation of providing the second guide including the first object and the second object positioned outside the first object, based on whether the acquired location of the user is not included in the first area.
[0273] In one embodiment, the operation of providing the first guide may include an operation of providing a third guide, which indicates that the acquired user's location is included in the second area, as the first guide, based on whether the acquired user's location is included in the second area among the second area and the third area set within the first area. The third area may be an area within the first area that includes a boundary of the first area, and the second area may be an area within the first area excluding the third area. The operation of providing the first guide may include an operation of providing a fourth guide, which indicates that the acquired user's location is included in the third area, as the first guide, based on whether the acquired user's location is included in the third area. The operation of providing the first guide may include an operation of providing the second guide, which indicates that the user is located outside the first area, based on whether the acquired user's location is not included in the first area.
[0274] In one embodiment, the method may further include an operation of acquiring locations of one or more users based on sensing data acquired through the sensor. The method may further include an operation of identifying at least one user located in the first area among the one or more users based on the acquired locations. The method may further include an operation of determining a target user to whom a 3D image is to be provided without crosstalk through the display among the at least one user.
[0275] In one embodiment, the operation of determining the target user may include an operation of determining, as the target user, among the at least one user, a user located closest to a designated location, a user who made a gesture corresponding to a designated gesture, a user determined based on an input received from a controller configured to control the electronic device, or a user who uttered a designated voice.
[0276] In one embodiment, the operation of determining the target user may include an operation of determining, based on the 3D advertising content being displayed through the display, a user among the at least one user who has personal information corresponding to the 3D advertising content as the target user. The operation of determining the target user may include an operation of determining, based on the screen of the 3D game being displayed through the display, a user among the at least one user who wins the 3D game as the target user.
[0277] In one embodiment, the method may further include an action of controlling the display so that the 3D screen faces a location of the target user based on the target user being determined while displaying the 3D screen through the display.
[0278] In one embodiment, the method may further include an operation of controlling the display so that a 3D object included in the 3D screen faces a location of the target user based on the target user being determined while displaying the 3D screen through the display.
[0279] In one embodiment, the method may further include an operation of determining a target user from among at least one user located at a location included in the first area, based on whether the target user is not included in the first area after the target user is determined, or an operation of displaying a 2D image through the display.
[0280] In one embodiment, a non-transitory computer-readable storage medium having recorded thereon computer-executable instructions, wherein the computer-executable instructions, when individually or collectively executed by at least one processor, may cause an electronic device to acquire a location of a user based on sensed data acquired through a sensor for eye tracking. The computer-executable instructions, when individually or collectively executed by at least one processor, may cause the electronic device to provide a first guide indicating that the user is in a state in which the 3D image can be provided based on the acquired location of the user being included in a first area in which the 3D image is to be provided when the 3D image is displayed using a glasses-free manner through a display of the electronic device. The computer-executable instructions, when individually or collectively executed by at least one processor, may cause the electronic device to display a 3D image to be provided to the user through the display without crosstalk based on the acquired location, based on the acquired location being included in the first area. The computer-executable instructions, when executed individually or collectively by at least one processor, may cause the electronic device to provide a second guide indicating that the user is in a state in which the 3D image cannot be provided through the display based on the acquired user's location not being included in the first area.
[0281] Additionally, the structure of the data used in the embodiments of the present disclosure described above can be recorded on a computer-readable recording medium through various means. The computer-readable recording medium includes storage media such as magnetic storage media (e.g., ROM, floppy disk, hard disk, etc.) and optical reading media (e.g., CD-ROM, DVD, etc.).
Claims
1. In the electronic device (201), A display (220) capable of displaying 3D images using a glasses-free method; Sensor for eye tracking (230); At least one processor (250) comprising processing circuitry; and Includes a memory (240) that stores instructions, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Based on the sensing data obtained through the above sensor, the user's location is obtained, Based on the fact that the user's position obtained above is included in the first area where the 3D image is provided when the 3D image is displayed through the display: Provide a first guide indicating that the user is in a state where the 3D image can be provided, and Based on the acquired location, a 3D image is displayed to the user without crosstalk through the display, and An electronic device that causes a second guide to be provided, indicating that the user is in a state where the 3D image cannot be provided through the display, based on the fact that the user's acquired location is not included in the first area.
2. In paragraph 1, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Based on the fact that the acquired user's location is included in the first area, the first guide is provided, which includes a first object representing the first area and a second object positioned within the first object and representing the user's location, and An electronic device that causes the user to provide the second guide, which includes the first object and the second object positioned outside the first object, based on the user's acquired location not being included in the first area.
3. In paragraph 2, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Based on the fact that the acquired user's location is included in the second area among the second area and the third area set within the first area, a third guide is provided as the first guide, indicating that the acquired user's location is included in the second area - the third area is an area including the boundary of the first area within the first area, and the second area is an area excluding the third area within the first area -, Based on the fact that the acquired user's location is included in the third area, a fourth guide is provided as the first guide, indicating that the acquired user's location is included in the third area, and An electronic device that causes the user to provide the second guide indicating that the user is located outside the first area based on the acquired user's location not being included in the first area.
4. In any one of paragraphs 1 to 3, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Based on the sensing data obtained through the above sensor, the locations of one or more users are obtained, Based on the acquired locations, at least one user located in the first area is identified among the one or more users, and An electronic device that causes the user to determine a target user to whom a 3D image is to be provided without crosstalk through the display among the at least one user.
5. In paragraph 4, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: An electronic device that causes the target user to be determined among at least one user, a user located at a location closest to a designated location, a user who has made a gesture corresponding to a designated gesture, a user determined based on an input received from a controller configured to control the electronic device, or a user who has uttered a designated voice.
6. In paragraph 4, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Based on the 3D advertising content being displayed through the display, a user having personal information corresponding to the 3D advertising content among the at least one user is determined as the target user, and An electronic device that causes a user who wins the 3D game among the at least one user to be determined as the target user based on the screen of the 3D game being displayed through the display.
7. In paragraph 4, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: An electronic device that causes the display to be controlled so that the 3D screen faces the position of the target user based on the target user being determined while displaying the 3D screen through the display.
8. In paragraph 4, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: An electronic device that causes the display to be controlled so that a 3D object included in the 3D screen faces the position of the target user based on the target user being determined while displaying a 3D screen through the display.
9. In paragraph 4, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: After the target user is determined, based on the target user moving outside the first area: Determine a target user from among at least one user located in the first area, or An electronic device that causes a 2D image to be displayed through the above display.
10. In paragraph 4, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Among the at least one user, the first user located closest to the display is determined as the target user, A 3D screen corresponding to the location of the first user is displayed through the display, Based on the completion of a task performed on the electronic device by the input of the first user, a second user, who is located closest to the display, excluding the first user among the at least one user, is determined as the target user, and An electronic device that causes a 3D screen corresponding to the location of the second user to be displayed through the display.
11. A method for providing a 3D image in an electronic device, An action to obtain the user's location based on sensing data obtained through a sensor for eye tracking; An operation of providing a first guide indicating that the user is in a state in which the 3D image can be provided based on the fact that the acquired user's location is included in a first area in which the 3D image can be provided when the 3D image is displayed using a glasses-free method through the display of the electronic device; An operation of displaying a 3D image to be provided to the user without crosstalk through the display based on the acquired location of the user being included in the first area; and A method comprising an action of providing a second guide indicating that the user is in a state in which the 3D image cannot be provided through the display based on the user's acquired location not being included in the first area.
12. In paragraph 11, The operation of providing the first guide includes an operation of providing the first guide including a first object representing the first area and a second object positioned within the first object and representing the user's location, based on the fact that the acquired user's location is included in the first area, and A method wherein the action of providing the second guide includes an action of providing the second guide including the first object and the second object positioned outside the first object, based on the fact that the acquired user's location is not included in the first area.
13. In paragraph 12, The action that provides the above first guide is: An operation of providing a third guide indicating that the position of the user obtained as the first guide is included in the second area based on the position of the user being included in the second area among the second area and the third area set within the first area, wherein the third area is an area including the boundary of the first area within the first area, and the second area is an area excluding the third area within the first area; and An operation of providing a fourth guide indicating that the acquired user's location is included in the third area as the first guide, based on the acquired user's location being included in the third area, A method wherein the action of providing the first guide includes an action of providing the second guide indicating that the user is located outside the first area based on the acquired location of the user not being included in the first area.
14. In any one of paragraphs 11 to 13, An operation of acquiring the locations of one or more users based on sensing data acquired through the above sensor; An operation of identifying at least one user located in the first area among the one or more users based on the acquired locations; and A method further comprising the action of determining a target user among the at least one user to whom a 3D image is to be provided without crosstalk through the display.
15. A non-transitory computer-readable storage medium having computer-executable instructions recorded thereon, wherein the computer-executable instructions, when individually or collectively executed by at least one processor, cause an electronic device to: Based on the sensing data obtained through the sensor for eye tracking, the user's location is obtained, Based on the fact that the user's position obtained above is included in the first area where the 3D image is provided when the 3D image is displayed using a glasses-free method through the display of the electronic device: Provide a first guide indicating that the user is in a state where he or she can receive the 3D image, and Based on the acquired location, a 3D image is displayed to the user without crosstalk through the display, and A computer-readable storage medium that causes a second guide to be provided, indicating that the user is in a state where the 3D image cannot be provided through the display, based on the user's acquired location not being included in the first area.
Citation Information
Patent Citations
Display device and displaying method for glass free stereoscopic image
KR1020180107021A
Stereoscopic display device and display method thereof
US20230093023A1
System and method for holographic image display
US20230367262A1
Three-dimensional image display method using augmented reality, and device therefor
WO2024162709A1
KR20240025440A