Electronic device for displaying 3D content and control method thereof

Abstract

An electronic device is disclosed. The electronic device of the present disclosure comprises: a display for displaying a left-eye image and a right-eye image; a memory; and a processor electrically connected to the display and the memory, wherein the processor can store commands to: control the display to display a left-eye image and a right-eye image of a screen including a plurality of pieces of 2D content; identify that a piece of 2D content including depth information from among the plurality of pieces of 2D content is arranged in a set area on the basis of a scroll input of the screen; and display the piece of 2D content as 3D content.

Description

Electronic device for displaying 3D content and method for controlling the same

[0001] Embodiments of the present disclosure relate to an electronic device for displaying 3D content and a method for controlling the same.

[0002] The variety of services and additional features offered through electronic devices, such as smartphones, is steadily increasing. To enhance the utility of these devices and satisfy the diverse needs of users, telecommunications service providers and electronic device manufacturers are competitively developing electronic devices to offer a variety of features and differentiate themselves from competitors. Consequently, the various functions offered through electronic devices are also becoming increasingly sophisticated.

[0003] Additionally, electronic devices provide various GUIs (graphical user interfaces) for user interaction through displays.

[0004] According to one embodiment, an electronic device may include a display for displaying a left-eye image and a right-eye image, a memory, and a processor electrically connected to the display and the memory.

[0005] According to one embodiment, the memory may store instructions that, when executed by the processor, cause the electronic device to control the display to display a left-eye image and a right-eye image on a screen including a plurality of 2D contents, the 2D contents including 2D contents corresponding to 3D content.

[0006] According to one embodiment, the memory may store instructions that, when executed by the processor, cause the electronic device to determine, based on a user input for controlling the screen, that the 2D content corresponding to the 3D content among the plurality of 2D contents is placed in a set area.

[0007] In one embodiment, the memory may store instructions that, when executed by the processor, cause the electronic device to control the display to display the 2D content as 3D content.

[0008] According to one embodiment, a method of controlling an electronic device may include an operation of displaying a left-eye image and a right-eye image on a screen including a plurality of 2D contents including 2D contents corresponding to 3D content.

[0009] According to one embodiment, a method for controlling an electronic device may include an operation of confirming that the 2D content corresponding to the 3D content among the plurality of 2D contents is placed in a set area based on a user input for controlling the screen.

[0010] According to one embodiment, a method of controlling an electronic device may include an operation of displaying the 2D content as 3D content.

[0011] According to one embodiment, a non-transitory computer-readable recording medium storing one or more programs may include commands for controlling a display of an electronic device to display a left-eye image and a right-eye image on a screen including a plurality of 2D contents.

[0012] In one embodiment, the one or more programs may include instructions for the electronic device to identify the positions of the user's two eyes obtained through the at least one sensor.

[0013] According to one embodiment, the one or more programs may include commands for the electronic device to determine, based on a scroll input of the screen, that a 2D content including depth information among the plurality of 2D contents is placed in a set area.

[0014] In one embodiment, the one or more programs may include commands for controlling the display so that the electronic device displays the 2D content as 3D content based on the positions of the two eyes and the depth information.

[0015] According to one embodiment, an electronic device may include at least one sensor for identifying a position of a user's eyes, a display, and at least one processor electrically connected to the at least one sensor and the display.

[0016] According to one embodiment, the memory may store instructions that, when executed by the processor, cause the electronic device to control the display to display a screen including first 2D content and second 2D content corresponding to the 3D content.

[0017] According to one embodiment, the memory may store instructions that, when executed by the processor, cause the electronic device to determine that the second 2D content is placed in a set area of ​​the display based on a user input for controlling the screen.

[0018] In one embodiment, the memory may store instructions that, when executed by the processor, cause the electronic device to display the 3D content as a higher layer of the second 2D content.

[0019] FIG. 1 is a block diagram of an electronic device within a network environment according to one embodiment.

[0020] FIG. 2 is a flowchart illustrating a 3D content display operation of an electronic device according to one embodiment.

[0021] FIG. 3A is a diagram showing a screen including a plurality of 2D contents of an electronic device according to one embodiment.

[0022] FIG. 3b is a drawing for explaining an operation of changing 2D content including depth information among a plurality of 2D contents of an electronic device according to one embodiment to 3D mode.

[0023] FIG. 3c is a drawing for explaining an operation of displaying 3D content according to a scroll input of an electronic device according to one embodiment.

[0024] FIG. 3D is a drawing for explaining an operation of displaying 3D content according to a scroll input of an electronic device according to one embodiment.

[0025] FIG. 4A is a drawing for explaining a 3D content display area of ​​an electronic device according to one embodiment.

[0026] FIG. 4b is a diagram for explaining an operation of displaying 3D content based on a 3D content display area of ​​an electronic device according to one embodiment.

[0027] FIG. 5A is a drawing for explaining a structure for providing 3D content of an electronic device according to one embodiment.

[0028] FIG. 5b is a drawing for explaining a structure for providing 3D content of an electronic device according to one embodiment.

[0029] FIG. 6A is a diagram illustrating an operation of displaying 3D content based on a scroll input on a screen including 2D content of an electronic device according to one embodiment.

[0030] FIG. 6b is a diagram for explaining an operation of displaying 3D content of an electronic device according to one embodiment.

[0031] FIG. 7A is a diagram illustrating a screen including 2D content including depth information of an electronic device according to one embodiment.

[0032] FIG. 7b is a diagram for explaining an operation of displaying 3D content based on a scroll input of an electronic device according to one embodiment.

[0033] FIG. 8 is a diagram for explaining a display operation based on content characteristics of an electronic device according to one embodiment.

[0034] FIG. 9A is a diagram for explaining a 3D content display operation on an application screen of an electronic device according to one embodiment.

[0035] FIG. 9b is a drawing for explaining an operation of adjusting a 3D content display position on an application screen of an electronic device according to one embodiment.

[0036] FIG. 10A is a diagram for explaining a 3D content display operation on an application screen of an electronic device according to one embodiment.

[0037] FIG. 10b is a drawing for explaining an operation of adjusting a 2D content display position according to a 3D content display on an application screen of an electronic device according to one embodiment.

[0038] FIG. 11 is a drawing for explaining a 3D content display operation of a foldable device according to one embodiment.

[0039] FIG. 12A is a drawing for explaining an embodiment in which 3D advertising content is included in an application screen of an electronic device according to one embodiment.

[0040] FIG. 12b is a drawing for explaining an embodiment in which 3D advertising content is included in an application screen of an electronic device according to one embodiment.

[0041] FIG. 13 is a diagram for explaining an operation of displaying 3D content based on a user input of an electronic device according to one embodiment.

[0042] FIG. 14A is a diagram for explaining a 3D content display operation of an electronic device according to one embodiment.

[0043] FIG. 14b is a drawing for explaining an animation effect display operation of 3D content of an electronic device according to one embodiment.

[0044] FIG. 14c is a drawing for explaining an operation of displaying a 2D content screen after displaying an animation effect of 3D content of an electronic device according to one embodiment.

[0045] FIG. 14d is a diagram for explaining a selected 3D content display operation of an electronic device according to one embodiment.

[0046] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100), according to one embodiment. Referring to FIG. 1 , in the network environment (100), the electronic device (101) may communicate with the electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (104) or the server (108) via a second network (199) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0047] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0048] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0049] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0050] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0051] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0052] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0053] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0054] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0055] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0056] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) to an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0057] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0058] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0059] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0060] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0061] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0062] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0063] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0064] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0065] In one embodiment, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0066] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0067] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0068] FIG. 2 is a flowchart illustrating a 3D content display operation of an electronic device according to one embodiment.

[0069] Referring to FIG. 2, in operation 210, an electronic device (e.g., the electronic device (101) of FIG. 1 or the processor (120) of FIG. 1) may display a left-eye image and a right-eye image on a screen including a plurality of 2D contents. According to one embodiment, the plurality of 2D contents may include content that can be displayed in 3D.

[0070] According to one embodiment, the electronic device may control a display (e.g., the display module (160) of FIG. 1) to alternately display a plurality of left-eye images and a plurality of right-eye images in the left-right direction. According to one embodiment, the operation of displaying the left-eye images and the right-eye images will be described in more detail below with reference to FIGS. 5A and 5B.

[0071] According to one embodiment, the electronic device can display a plurality of 2D contents with depth information of 0. For example, since depth information is implemented through binocular parallax by the left-eye image and the right-eye image to make the 3D content appear three-dimensional, the electronic device can display the left-eye image and the right-eye image so that the depth information is 0 for the 2D content. According to one embodiment, the electronic device can display a plurality of 2D contents without parallax through the left-eye image and the right-eye image.

[0072] According to one embodiment, in operation 220, the electronic device may determine that a 2D content (or content that can be displayed in 3D) including depth information among a plurality of 2D contents is placed in a set area based on a user input for controlling a screen. For example, the user input for controlling the screen may include at least one of a scroll input, a swipe input, a navigation input method, or a pinch in / out. In the present disclosure, the scroll input inputted to the screen is not limited thereto, and at least one of a swipe input, a navigation input method, or a pinch in / out may be applied.

[0073] In one embodiment, an electronic device may switch a screen containing only 2D content to a 3D mode for displaying 3D content. For example, the electronic device may automatically switch to 3D mode when the screen contains 2D content with depth information, or may switch to 3D mode based on a user input selecting an icon to switch to 3D mode or a gesture input to switch to 3D mode.

[0074] According to one embodiment, in 3D mode, the electronic device may indicate that at least one 2D content including depth information among 2D contents included in the screen is 3D content. For example, the electronic device may indicate that the at least one 2D content including depth information is 3D content by displaying shading information, such as a shadow, on the at least one 2D content including depth information.

[0075] In one embodiment, it is possible to determine whether 2D content including depth information is placed in a set area based on a scroll input in 3D mode. For example, the scroll input may include not only a scrolling motion within a page, but also a drag, swipe, or flick motion for moving or switching screens.

[0076] According to one embodiment, the electronic device may further include a film disposed on at least a portion of the display to transmit the left-eye image and the right-eye image to provide 3D content. For example, the film may include at least one of a lenticular lens or a parallax barrier. The film may be configured to separate the light directions of the images such that the left-eye image is viewed by the user's left eye, and the right-eye image is viewed by the user's right eye.

[0077] According to one embodiment, the structure of the film placed on the display will be described in more detail with reference to FIGS. 5a and 5b below.

[0078] In some embodiments, the film may be disposed over the entire area of ​​the display, or may be disposed over a portion of the display.

[0079] In one embodiment, if the film is placed over the entire area of ​​the display, the set area may be an area set to display 3D content. In one embodiment, if the film is placed over a portion of the display, the set area may be a portion of the display where the film is placed.

[0080] According to one embodiment, various examples of the set area are described below with reference to FIG. 4a.

[0081] In one embodiment, in operation 230, the electronic device may display 2D content as 3D content. In one embodiment, the electronic device may display 2D content as 3D content based on at least one of binocular position information or depth information. In one embodiment, the electronic device may display content positioned within a set area in 3D.

[0082] According to one embodiment, the electronic device may identify the positions of the user's two eyes obtained through at least one sensor (e.g., the sensor module (176) of FIG. 1). For example, the electronic device may identify the positions of the user's two eyes through a camera (e.g., an RGB sensor) for obtaining images of the two eyes and / or a depth sensor (e.g., a ToF sensor or a Lidar sensor) for obtaining depth information.

[0083] In one embodiment, the electronic device may obtain binocular disparity based on the positions of the user's two eyes. The binocular disparity may be the distance between the user's right and left eyes.

[0084] In one embodiment, in addition to identifying the position of the user's eyes through at least one sensor, the electronic device may also identify the position of the eyes through facial recognition of the user or through detection of body parts other than the eyes.

[0085] According to one embodiment, the electronic device can display 2D content as 3D content by displaying left-eye images and right-eye images to have a three-dimensional effect corresponding to depth information based on binocular disparity.

[0086] In one embodiment, the electronic device may display 3D content that is enlarged in size compared to 2D content. For example, the electronic device may increase the size of the content displayed in 3D and display the 3D content as an overlay over surrounding 2D content.

[0087] In one embodiment, the electronic device may display 3D content at a depth closer to the depth at which the 2D content is displayed, making the 3D content appear relatively larger than other 2D content.

[0088] In one embodiment, based on the 3D content including information about animation effects (e.g., change in size, rotation, translation, tilt, morphing, perspective effect, volume effect), the electronic device can display 3D content including animation effects.

[0089] According to one embodiment, an electronic device may, in 3D mode, provide different three-dimensional effects based on the characteristics of content included on the screen. For example, among 2D contents included on the screen, 2D contents including depth information may provide a three-dimensional effect (e.g., (+) three-dimensional effect) that protrudes from the display based on the depth information.

[0090] According to one embodiment, the electronic device may display 2D content that does not include depth information as 2D content with a depth of 0 on the display without a three-dimensional effect. According to one embodiment, among 2D content that does not include depth information, the electronic device may display 2D content that includes information (e.g., icons, images, or text related to a service or function) with a depth of 0 on the display, and 2D content without information (e.g., wallpaper that provides a decorative effect) may provide a three-dimensional effect (e.g., (-) three-dimensional effect) as if it were moving away from the display.

[0091] According to one embodiment, when a plurality of 2D contents including depth information are included in a set area capable of displaying 3D content on a screen, the electronic device can sequentially display the plurality of 2D contents as 3D content or display all of the plurality of 2D contents as 3D content.

[0092] According to one embodiment, when a plurality of 2D contents including depth information are included in a set area capable of displaying 3D content, the electronic device may preferentially display 2D contents located at the top of the screen as 3D content.

[0093] According to one embodiment, when a plurality of 2D contents including depth information are included in a set area capable of displaying 3D content, the electronic device may preferentially display 2D contents with higher preference as 3D content based on user preference. For example, the preference may be based on selection as interested content, filtering keywords, and / or the number of times it has been displayed.

[0094] According to one embodiment, when a plurality of 2D contents including depth information are included in a set area capable of displaying 3D contents, the electronic device may preferentially display 2D contents with a high urgency and / or importance, such as a notification occurrence, as 3D contents.

[0095] In one embodiment, the electronic device may sequentially display a plurality of 2D contents including depth information as 3D content.

[0096] For example, the electronic device may change the 3D content into 2D content based on a scroll input received after displaying the 3D content and upon determining that the 3D content has moved out of the set area. In one embodiment, the electronic device may display the second 2D content as the second 3D content based on determining that the second 2D content including depth information is positioned in the set area.

[0097] According to one embodiment, the operation of sequentially displaying 3D content based on scroll input will be described in more detail with reference to FIGS. 3A to 3D below.

[0098] According to one embodiment, when a plurality of 2D contents including depth information are included in a set area capable of displaying 3D content, the electronic device can display the plurality of 2D contents including depth information included on the screen as a plurality of 3D contents, respectively, based on a scroll input.

[0099] According to one embodiment, an example of displaying multiple 3D contents on a screen will be described in more detail with reference to FIGS. 6A and 6B below.

[0100] According to one embodiment, the electronic device can control the display to display 3D content with an increased size at a location different from the scrolled input location. In this way, instability, such as 3D content breaking, can be prevented when the scrolled input location overlaps with the area where the 3D content is displayed. According to one embodiment, the operation of changing the location of the 3D content based on the scrolled input location will be described in more detail with reference to FIGS. 9A and 9B below.

[0101] According to one embodiment, an electronic device can change the position of 2D content that overlaps with 3D content whose size has been increased. For example, if 2D content, such as text that is a description of 3D content, is obscured by the 3D content, the electronic device can change the position of the 2D content so that the 2D content is not obscured by the 3D content. According to one embodiment, the position of the changed content may vary depending on the position of the binoculars. According to one embodiment, an operation of changing the position of 2D content obscured by 3D content will be described below with reference to FIGS. 10A and 10B .

[0102] In one embodiment, the electronic device may display a 3D advertisement in a set area based on the absence of scroll input for a set period of time after 3D content is displayed in the set area.

[0103] According to one embodiment, the electronic device may display a 3D advertisement in a set area, and then, based on a scroll input received, display 3D content in the set area.

[0104] According to one embodiment, an embodiment including a 3D advertisement on a screen is described in more detail with reference to FIGS. 12a and 12b below.

[0105] In this way, users can efficiently check 2D information and experience 3D information with various attributes with just one-hand scroll input without complex interactions.

[0106] FIG. 3A is a diagram showing a screen including a plurality of 2D contents of an electronic device according to one embodiment.

[0107] Referring to FIG. 3A, an electronic device (e.g., the electronic device (101) of FIG. 1 or the processor (120) of FIG. 1) may display a screen including a plurality of 2D contents (310). For example, the plurality of 2D contents (310) may include 2D contents that do not include depth information and 2D contents that include depth information.

[0108] In one embodiment, the screen may be a launch screen of an application, such as a home screen, a messenger, a photo album, or a browser.

[0109] According to one embodiment, the plurality of 2D contents (310) may include 2D contents corresponding to 2D contents and 3D contents.

[0110] According to one embodiment, the electronic device may display a button (311) for automatic 3D switching when the screen includes 2D content corresponding to 3D content. For example, the button (311) for automatic 3D switching is for switching a screen containing only 2D content to a 3D mode for displaying 3D content based on a user input.

[0111] In Fig. 3a, since it is before switching to 3D mode, the button (311) for automatic 3D switching may be in the OFF state.

[0112] FIG. 3b is a drawing for explaining an operation of changing 2D content including depth information among a plurality of 2D contents of an electronic device according to one embodiment to 3D mode.

[0113] Referring to FIG. 3b, the electronic device can confirm that among the plurality of 2D contents included in the screen, 2D content including depth information is included.

[0114] In one embodiment, the electronic device may switch a screen containing only 2D content to a 3D mode for displaying 3D content. For example, the electronic device may automatically switch to 3D mode when the screen contains 2D content with depth information, or may switch to 3D mode based on a user input selecting a button (312) to switch to 3D mode or a gesture input to switch to 3D mode.

[0115] According to one embodiment, in a 3D mode, the electronic device may indicate that at least one 2D content (320, 321, 322) including depth information among 2D contents included in the screen is 3D content. For example, the electronic device may indicate that the at least one 2D content (320, 321, 322) including depth information is 3D content by displaying shading information, such as a shadow.

[0116] In Fig. 3b, since the state is switched to 3D mode, the button (312) for 3D automatic switching may be in the ON state.

[0117] FIG. 3c is a drawing for explaining an operation of displaying 3D content according to a scroll input of an electronic device according to one embodiment.

[0118] Referring to FIG. 3c, the electronic device can display at least one 2D content that satisfies a set condition among at least one 2D content including depth information as 3D content (331) based on a scroll input (330).

[0119] For example, when the electronic device is switched to 3D mode, the electronic device may display 2D content placed in a set area among at least one 2D content including depth information based on a scroll input (330) as 3D content (331). According to an embodiment, the set area may be a part of the display where a film is placed, which is an area set to display 3D content. For example, the set area may include at least one of the upper area of ​​the screen, the middle area of ​​the screen, the area where the user's gaze lingers, and the area set by the user, among the parts of the display where the film is placed.

[0120] For example, the electronic device may display the 2D content located at the top among a plurality of 2D contents including depth information placed in a set area or the 2D content based on user preference as 3D content (331).

[0121] In one embodiment, the electronic device may display 3D content (331) to provide a three-dimensional effect that pops out from the display based on depth information. In one embodiment, the electronic device may display 3D content (331) of the same size or increased size and overlay it on surrounding 2D content.

[0122] In one embodiment, based on the 3D content including information about animation effects (e.g., change in size, rotation, translation, tilt, morphing, volume effect), the electronic device can display 3D content including animation effects.

[0123] According to one embodiment, an electronic device may, in 3D mode, provide different three-dimensional effects based on the characteristics of content included on the screen. For example, among 2D contents included on the screen, 2D contents including depth information may provide a three-dimensional effect (e.g., (+) three-dimensional effect) that protrudes from the display based on the depth information. For example, the electronic device may display 3D content in three dimensions so that the appearance of the 3D content corresponding to the direction in which the user views the 3D content is displayed.

[0124] In one embodiment, when a plurality of 2D contents are displayed at a first depth, the electronic device may display 2D contents that do not include depth information among the plurality of 2D contents at at least one of the first depth or a second depth further than the first depth.

[0125] According to one embodiment, the electronic device may display 2D content that does not include depth information as 2D content with a depth of 0 on the display without a three-dimensional effect. According to one embodiment, among 2D content that does not include depth information, the electronic device may display 2D content that includes information (e.g., icons, images, or text related to a service or function) with a depth of 0 on the display, and 2D content without information (e.g., wallpaper that provides a decorative effect) may provide a three-dimensional effect (e.g., (-) three-dimensional effect) as if it were moving away from the display.

[0126] FIG. 3D is a drawing for explaining an operation of displaying 3D content according to a scroll input of an electronic device according to one embodiment.

[0127] Referring to FIG. 3D, the electronic device may change the 3D content into 2D content (320) based on a scroll input (330) received after displaying the 3D content and upon confirmation that the 3D content has moved out of the set area. In one embodiment, the electronic device may display the second 2D content as second 3D content (332) based on confirmation that the second 2D content including depth information is placed in the set area.

[0128] In this way, you can check the 3D contents included on the screen based on the scroll input.

[0129] According to one embodiment, although FIGS. 3c and 3d illustrate displaying 3D content in an area where 2D content is located, 3D content may also be displayed in a set area, as illustrated in FIGS. 4a and 4b below.

[0130] FIG. 4A is a drawing for explaining a 3D content display area of ​​an electronic device according to one embodiment.

[0131] FIG. 4b is a diagram for explaining an operation of displaying 3D content based on a 3D content display area of ​​an electronic device according to one embodiment.

[0132] Referring to FIG. 4a, a film such as a lenticular lens or a parallax barrier can be placed over the full area or half area of ​​the display.

[0133] According to one embodiment, the electronic device may display 3D content in the central region (410) among the regions where the film is placed. For example, as illustrated in FIG. 4B, even if 2D content including depth information (e.g., 2D content included in a weather widget) is placed in the upper region, the electronic device may display 3D content (420) in the central region.

[0134] According to one embodiment, the electronic device may display 3D content in an area (411) where 2D content including depth information is located among the areas where the film is placed. For example, as illustrated in FIG. 4B , the electronic device may display 3D content (421) in an upper area where 2D content including depth information (e.g., 2D content included in a weather widget) is located.

[0135] In one embodiment, when the film is placed only in a portion of the display, the electronic device may display 3D content for 2D content that is positioned on top of the 2D content including depth information included in the area where the film is not placed, or for 2D content with the highest user preference, in the area where the film is placed (412). For example, as illustrated in FIG. 4B, 3D content (422) for 2D content including depth information included in the area where the film is not placed (e.g., 2D content included in a weather widget) may be displayed in the area where the film is placed.

[0136] FIG. 5A is a diagram illustrating a structure for providing 3D content in an electronic device according to one embodiment. For example, FIG. 5A illustrates a structure including a lenticular lens.

[0137] Referring to FIG. 5a, the electronic device can display left-eye images (510) and right-eye images (511) alternately on a display (160) (e.g., display module (160) of FIG. 1).

[0138] According to one embodiment, the electronic device may include a lenticular lens (520) on the display (160). For example, the lenticular lens (520) is one of the glass-free, glassless, naked eye stereoscopic 3D technologies, and may be a series of thin and long cylindrical convex lenses that change their design or express a three-dimensional effect depending on the angle. The direction of light propagation of an image can be distinguished left and right through the refractive index of the cylindrical convex lens.

[0139] In FIG. 5a, the left-eye image and the right-eye image in a vertically elongated shape are shown as being arranged alternately in the left-right direction, but according to one embodiment, the left-eye image and the right-eye image may be arranged alternately in a diagonal direction.

[0140] According to one embodiment, even if a lenticular lens (520) is not attached as a film on the display (160), an electro-active lenticular that changes the refractive index by applying voltage to the molecules of the electronic liquid crystal may be applied.

[0141] FIG. 5B is a diagram illustrating a structure for providing 3D content in an electronic device according to one embodiment. For example, FIG. 5B illustrates a structure including a parallax barrier.

[0142] Referring to FIG. 5b, the electronic device can display left-eye images (510) and right-eye images (511) alternately on the display (160).

[0143] According to one embodiment, the electronic device may include a parallax barrier (530) on the display (160). For example, the parallax barrier (530) may be one of the glass-free, glassless, naked eye stereoscopic 3D technologies, which may be a method of creating parallax between the left and right eyes by placing barriers (530) in front of the display (160). For example, the barriers (530) may be arranged in the same cycle as the image.

[0144] In one embodiment, when viewed from a certain distance, a left eye image is shown to the left eye and a right eye image is shown to the right eye through a slit opened between the barriers, and the image of the other eye may be blocked by the barriers (530).

[0145] In one embodiment, the electronic device may provide 3D content even when not in a frontal view by generating and displaying left-eye and right-eye images through pupil tracking of the user.

[0146] FIG. 6A is a diagram illustrating an operation of displaying 3D content based on a scroll input on a screen including 2D content of an electronic device according to one embodiment.

[0147] Referring to FIG. 6A, an electronic device (e.g., the electronic device (101) of FIG. 1 or the processor (120) of FIG. 1) may display a screen (610) including a plurality of 2D contents (611, 612, 613). For example, the screen (610) may be a home screen or an application execution screen.

[0148] According to one embodiment, when a scroll input (61) is received through the screen (610), the electronic device can change to a 3D mode and sequentially display 3D content one by one according to the arrangement order.

[0149] For example, an electronic device may display a screen (620) including A content (621) as 3D content. The 3D content may be overlaid on other 2D content and may be increased in size.

[0150] According to one embodiment, when a scroll input is received while A content (621) is displayed as 3D content, the electronic device may display A content again as 2D content and display B content as 3D content.

[0151] In this way, when multiple 2D contents including depth information are included, the electronic device can sequentially display 3D contents.

[0152] FIG. 6b is a diagram for explaining an operation of displaying 3D content of an electronic device according to one embodiment.

[0153] Referring to FIG. 6b, the electronic device can display a plurality of 2D contents including depth information on a screen (630, 640, 650) including a plurality of 3D contents.

[0154] For example, the electronic device can display at least partially overlapping screens (630) in the order of A content > B content > C content, with A content being placed on the topmost layer, with different sizes in the order of A content > B content > C content through resizing.

[0155] According to one embodiment, the electronic device can display a screen (640) with different sizes in the order of A content > B content > C content through size adjustment, and where A content, B content, and C content do not overlap.

[0156] According to one embodiment, the electronic device can display a screen (650) in which content A, content B, and content C all have the same size and do not overlap.

[0157] FIG. 7A is a diagram illustrating a screen including 2D content including depth information of an electronic device according to one embodiment.

[0158] Referring to FIG. 7A, an electronic device (e.g., the electronic device (101) of FIG. 1 or the processor (120) of FIG. 1) may display a home screen (710) including a plurality of 2D contents with or without depth information. For example, the home screen (710) may also display content (711) including depth information as 2D content.

[0159] FIG. 7b is a diagram for explaining an operation of displaying 3D content based on a scroll input of an electronic device according to one embodiment.

[0160] Referring to FIG. 7B, the electronic device can switch to 3D mode when 2D content containing depth information is included. For example, the electronic device can display 2D content as 3D content (720) based on the depth information.

[0161] In one embodiment, while in 3D mode, the electronic device may determine whether the changed screen contains content with depth information based on a received user interaction (e.g., scroll, drag, swipe).

[0162] According to one embodiment, when a page is moved through a drag input (71) on a home screen, if the displayed page includes content including depth information, the electronic device may display 3D content (730) based on the depth information.

[0163] FIG. 8 is a diagram for explaining a display operation based on content characteristics of an electronic device according to one embodiment.

[0164] Referring to FIG. 8, an electronic device (e.g., the electronic device (101) of FIG. 1 or the processor (120) of FIG. 1) may, in 3D mode, provide different three-dimensional effects based on the characteristics of content included in the screen. For example, among 2D contents included in the screen, 2D contents including depth information may be displayed as 3D contents (820, 821, 822, 823) including a three-dimensional effect (e.g., (+) three-dimensional effect) that pops out from the display based on the depth information.

[0165] According to one embodiment, the electronic device may display 2D content that does not include depth information as 2D content (810) without a depth of 0 on the display. According to one embodiment, among 2D content that does not include depth information, the electronic device may display 2D content that includes information (e.g., icons, images, or text related to a service or function) with a depth of 0 on the display, and 2D content without information (e.g., wallpaper providing a decorative effect) (830) may provide a three-dimensional effect (e.g., (-) three-dimensional effect) such that the content appears to be moving away from the display.

[0166] In this way, the more (+) stereoscopic the 3D content is, the closer it is to the user's field of vision, providing a realistic stereoscopic effect. On the other hand, the more (-) stereoscopic the 3D content is, the farther it is from the user's field of vision, which can help with immersion depending on the distance and blur processing.

[0167] FIG. 9A is a diagram for explaining a 3D content display operation on an application screen of an electronic device according to one embodiment.

[0168] Referring to FIG. 9A, an electronic device (e.g., the electronic device (101) of FIG. 1 or the processor (120) of FIG. 1) may display an execution screen (910) of an application. For example, the execution screen (910) of the application may be an execution screen of a messenger application. According to an embodiment, the execution screen (910) of the application may include a plurality of 2D contents (e.g., images or texts). For example, the plurality of 2D contents may include 2D contents including depth information and 2D contents not including depth information.

[0169] According to one embodiment, when a scroll input (91) is received, the electronic device may switch to a 3D mode and display 2D content including depth information as 3D content (920) based on the depth information. For example, the electronic device may display 3D content in an area where 2D content including depth information is located, or display 3D content (920) in a central area.

[0170] In one embodiment, the electronic device may display 3D content (920) with increased size and may apply animation effects to the 3D content (920).

[0171] According to one embodiment, if the scroll input continues after displaying the 3D content (920), the 3D content for the 2D content including depth information may be displayed starting from the area that the user has not read.

[0172] In one embodiment, the electronic device may display 3D content for 2D content including depth information from a user-specified section. In one embodiment, if a celebratory event, such as a birthday message, is included, 3D content related to the celebratory event may be preferentially displayed.

[0173] FIG. 9b is a drawing for explaining an operation of adjusting a 3D content display position on an application screen of an electronic device according to one embodiment.

[0174] Referring to FIG. 9b, when 3D content (930) and user interaction (92) collide, the position of the 3D content (931) can be changed to an area that does not collide with the user interaction (92).

[0175] In this way, when the area where 3D content is displayed and the area where user interaction is received overlap at least partially, causing the 3D content to be broken, the position of the 3D content can be corrected to prevent the breaking phenomenon.

[0176] FIG. 10A is a diagram for explaining a 3D content display operation on an application screen of an electronic device according to one embodiment.

[0177] Referring to FIG. 10A, an electronic device (e.g., the electronic device (101) of FIG. 1 or the processor (120) of FIG. 1) may display an application execution screen (1010). For example, the application execution screen (1010) may be a browser application execution screen. According to an embodiment, the application execution screen (1010) may include a plurality of 2D contents (e.g., images or text). For example, the plurality of 2D contents may include 2D contents including depth information and 2D contents not including depth information.

[0178] In one embodiment, when a scroll input (1011) is received, the electronic device may switch to 3D mode and display an indicator (1020) indicating that the content is 2D and includes depth information. For example, the indicator may be a shadow, such as a shading effect, or a shading effect applied to the entire image.

[0179] According to one embodiment, when a scroll input (1021) is received while the electronic device is switched to 3D mode, the electronic device may display 3D content (1030) based on depth information. For example, the electronic device may display 3D content (1030) in an area where 2D content including depth information is located, or display the 3D content in a central area.

[0180] In one embodiment, the electronic device may display 3D content (1030) with increased size and may apply animation effects to the 3D content (1030).

[0181] In one embodiment, 2D content (e.g., text) that does not include depth information may remain as 2D content.

[0182] FIG. 10b is a drawing for explaining an operation of adjusting a 2D content display position according to a 3D content display on an application screen of an electronic device according to one embodiment.

[0183] Referring to FIG. 10B, when displaying 3D content (1030) with an increased size, surrounding 2D content (e.g., text) may be obscured. In one embodiment, the electronic device may change the position of the 2D content (1040) so that the surrounding 2D content is not obscured by the 3D content (1030) with an increased size. For example, the electronic device may move the position of the 2D content (1040) downward.

[0184] In this way, visibility and readability can be ensured by moving the position of 2D content so that surrounding 2D content is not obscured by the display of 3D content.

[0185] FIG. 11 is a drawing for explaining a 3D content display operation of a foldable device according to one embodiment.

[0186] Referring to FIG. 11, an electronic device (e.g., electronic device (101) of FIG. 1 or processor (120) of FIG. 1) can display 3D content in an area where scroll input (or swipe, flick) is possible.

[0187] For example, 3D content (1110) according to scroll input can be displayed not only on the front display of the electronic device, but also on the edge display, the rear display or cover display if the electronic device is a foldable device, and the rolling area if the electronic device is a rollable device.

[0188] According to one embodiment, the area where the 3D content (1110) is displayed may be an area where a film, such as a lenticular lens or a parallax barrier, is placed.

[0189] FIG. 12A is a drawing for explaining an embodiment in which 3D advertising content is included in an application screen of an electronic device according to one embodiment.

[0190] Referring to FIG. 12A, an electronic device (e.g., the electronic device (101) of FIG. 1 or the processor (120) of FIG. 1) may, when 3D content (1211) is displayed in an area (1210) capable of displaying 3D content and no user interaction is received for a set period of time, preferentially place a 3D advertisement (1220) in the area (1210) capable of displaying 3D content.

[0191] FIG. 12b is a drawing for explaining an embodiment in which 3D advertising content is included in an application screen of an electronic device according to one embodiment.

[0192] Referring to FIG. 12b, when a user interaction (1230) (e.g., scroll, drag, swipe, flick) is received while a 3D advertisement (1220) is displayed in an area capable of displaying 3D content, the electronic device can display the 3D content (1211) that was displayed before the 3D advertisement in the area capable of displaying 3D content again.

[0193] FIG. 13 is a diagram for explaining an operation of displaying 3D content based on a user input of an electronic device according to one embodiment.

[0194] Referring to FIG. 13, an electronic device (e.g., the electronic device (101) of FIG. 1 or the processor (120) of FIG. 1) may display a first area (1300) of an application execution screen on a display (e.g., the display module (160) of FIG. 1). According to an embodiment, the application execution screen may include a first area (1300) displayed on the display and a first invisible area (1305) not displayed on the display. For example, the first area (1300) may include the top of the application execution screen. The first invisible area (1305) may be a lower area of ​​the first area (1300).

[0195] According to one embodiment, the first region (1300) may include a plurality of 2D contents. For example, the plurality of 2D contents may include 2D contents (1320, 1321) corresponding to 2D contents that do not include depth information and 3D contents that include depth information. According to one embodiment, the electronic device may display the plurality of 2D contents as a single layer.

[0196] According to one embodiment, 2D content (1320, 1321) corresponding to 3D content may include depth information.

[0197] According to one embodiment, 2D content (1320, 1321) corresponding to 3D content may include an indicator (e.g., a dot or icon) indicating that it is 3D content.

[0198] According to one embodiment, the electronic device may display 2D content (1320, 1321) corresponding to 3D content by casting a shadow (or shade) on the included object.

[0199] According to one embodiment, when the electronic device receives a user input (or view switching input) (1308) for changing an area displayed on the display during the execution screen of an application, the electronic device may display a second area (1301) on the display during the execution screen of the application. For example, the user input may include a scroll, a swipe, a pinch zoom, and / or a gaze input.

[0200] According to one embodiment, the second area (1301) may be an area that overlaps a portion of the first area (1300) of the application execution screen and is moved downward. According to one embodiment, a second invisible area (1306-1) may be positioned above the second area (1301), and a third invisible area (1306-2) may be positioned below the second area (1301).

[0201] According to one embodiment, when the electronic device confirms that the first 2D content (1320) corresponding to the 3D content is placed in a set area (e.g., an area where a film for displaying 3D content is placed, an upper area, a central area, or an area set by a user among the areas where the film for displaying 3D content is placed), the electronic device may display the first 3D content (1330) based on binocular information (1304) (e.g., the distance between the binoculars) and depth information.

[0202] For example, if the electronic device determines that the first 2D content (1320) corresponding to the 3D content is placed in a set area by a user input while displaying a plurality of second contents at a first depth, the electronic device may display the first 3D content (1330) at a second depth closer than the first depth. For example, the electronic device may display the first 3D content (1330) as a layer higher than the layer (1325) including the plurality of 2D contents. According to one embodiment, the electronic device may blur or darken the entire layer (1325) including the plurality of 2D contents.

[0203] According to one embodiment, when the first 3D content (1330) is displayed at a second depth, the electronic device may display the first 2D content (1320) corresponding to the first 3D content (1330) at a third depth that is further than the first depth. For example, the electronic device may display the first 2D content (1320) corresponding to the first 3D content (1330) as a lower layer than the layer (1325) including the plurality of 2D contents.

[0204] According to one embodiment, the depth of at least a portion of the first 2D content (1320) corresponding to the first 3D content (1330) may be maintained at the first depth and included in a layer (1325) including a plurality of 2D contents. According to one embodiment, blurring, reducing transparency, or darkening applied to the entire layer (1325) including a plurality of 2D contents may be omitted.

[0205] According to one embodiment, when the electronic device receives a user input (or view switching input) (1309) for changing the area displayed on the display while displaying the second area (1302) on the display, the electronic device may display the third area (1302) on the display in the execution screen of the application. For example, the user input may include a scroll, a swipe, a pinch zoom, and / or a gaze input.

[0206] According to one embodiment, the third area (1302) may be an area that overlaps part of the second area (1301) of the application execution screen and is moved downward. According to one embodiment, a fourth invisible area (1307) may be positioned above the third area (1302).

[0207] In one embodiment, when the third area (1302) is displayed on the display, the electronic device can determine that the first 2D content (1320) has moved out of the set area and the second 2D content (1321) has been placed in the set area.

[0208] According to one embodiment, when the electronic device determines that the second 2D content (1321) is placed in the set area, the electronic device can display the second 3D content (1331) based on binocular information (1304) (e.g., distance between the binoculars) and depth information.

[0209] For example, the electronic device may display the second 3D content (1331) at a second depth closer to the first depth. For example, the electronic device may display the second 3D content (1331) as a layer above the layer (1325) containing the plurality of 2D contents. According to one embodiment, the electronic device may blur, reduce the transparency, or darken the entire layer (1325) containing the plurality of 2D contents.

[0210] According to one embodiment, when the second 3D content (1331) is displayed at a second depth, the electronic device may display the second 2D content (1321) corresponding to the second 3D content (1331) at a third depth that is further than the first depth. For example, the electronic device may display the second 2D content (1321) corresponding to the second 3D content (1331) as a lower layer than the layer (1325) including the plurality of 2D contents.

[0211] According to one embodiment, the depth of at least a portion of the second 2D content (1321) corresponding to the second 3D content (1331) may be maintained at the first depth and included in a layer (1325) including a plurality of 2D contents. According to one embodiment, blurring, reducing transparency, or darkening applied to the entire layer (1325) including a plurality of 2D contents may be omitted.

[0212] According to one embodiment, when binocular information (1340) changes beyond a certain range, the electronic device can update 3D content based on the changed binocular information.

[0213] FIG. 14A is a diagram for explaining a 3D content display operation of an electronic device according to one embodiment.

[0214] FIG. 14b is a drawing for explaining an animation effect display operation of 3D content of an electronic device according to one embodiment.

[0215] Referring to FIG. 14A, an electronic device (e.g., the electronic device (101) of FIG. 1 or the processor (120) of FIG. 1) may display a first area (1400) of an application execution screen on a display (e.g., the display module (160) of FIG. 1). According to one embodiment, the application execution screen may include a first area (1400), a first invisible area (1401-1) positioned at an upper portion of the first area (1400), and a second invisible area (1401-2) positioned at a lower portion of the first area (1400).

[0216] According to one embodiment, when the electronic device determines that the first 2D content corresponding to the first 3D content is placed in a set area based on a user input received while a plurality of 2D contents are displayed, the electronic device may display the first 3D content (1410). For example, the electronic device may display the first 3D content (1410) in a layer higher than the plurality of 2D contents.

[0217] According to one embodiment, if the first 3D content (1410) includes an animation effect, the electronic device may display the first 3D content (1411) with the animation effect (e.g., rotation) reflected, as illustrated in FIG. 14b.

[0218] FIG. 14c is a drawing for explaining an operation of displaying a 2D content screen after displaying an animation effect of 3D content of an electronic device according to one embodiment.

[0219] FIG. 14d is a diagram for explaining a selected 3D content display operation of an electronic device according to one embodiment.

[0220] Referring to FIG. 14c, after the animation effect of the first 3D content (1411) ends, the electronic device may display a screen including a plurality of 2D contents (1420, 1421, 1422). For example, after the animation effect of the first 3D content (1411) ends, the electronic device may display the first 3D content (1411) again as the first 2D content (1420).

[0221] According to one embodiment, when a user input (1430) for selecting a second 2D content (1421) from among a plurality of 2D contents (1420, 1421, 1422) is received, the electronic device may display a second 3D content (1440) corresponding to the second 2D content (1421), as illustrated in FIG. 14D . For example, the user input (1430) may include a touch input or a gaze input.

[0222] According to one embodiment, the electronic device may sequentially display a plurality of 2D contents (1420, 1421, 1422) as 3D contents over time. For example, as illustrated in FIG. 14A, the electronic device may display a first 3D content (1410), and then, after a set period of time, change the first 3D content (1410) to a first 2D content (1420), and display a second 3D content (1440), as illustrated in FIG. 14D.

[0223] According to one embodiment, an electronic device (e.g., 101 of FIG. 1) may include a display (e.g., 160 of FIG. 1) for displaying a left-eye image and a right-eye image, a memory (e.g., 130 of FIG. 1), and a processor (e.g., 120 of FIG. 1) electrically connected to the display and the memory.

[0224] According to one embodiment, the memory may store instructions that, when executed by the processor, cause the electronic device to control the display to display a left-eye image and a right-eye image on a screen including a plurality of 2D contents, the left-eye image and the right-eye image including 2D contents (e.g., 320, 321 of FIG. 3) corresponding to 3D contents (e.g., 331, 332 of FIG. 3).

[0225] According to one embodiment, the memory may store instructions that, when executed by the processor, cause the electronic device to determine, based on a user input (e.g., 330 of FIG. 3) for controlling the screen, that the 2D content corresponding to the 3D content among the plurality of 2D contents is placed in a set area.

[0226] In one embodiment, the memory may store instructions that, when executed by the processor, cause the electronic device to control the display to display the 2D content as 3D content.

[0227] According to one embodiment, the electronic device may further include a film disposed on at least a portion of the display to transmit the left-eye image and the right-eye image to provide 3D content.

[0228] In one embodiment, the film may include at least one of a lenticular lens or a parallax barrier.

[0229] According to one embodiment, the electronic device may further include at least one sensor for identifying the position of the user's eyes.

[0230] According to one embodiment, the memory may store instructions that, when executed by the processor, cause the electronic device to identify the positions of the user's eyes obtained through the at least one sensor.

[0231] According to one embodiment, the memory may store instructions that, when executed by the processor, cause the electronic device to display, when the plurality of 2D contents are displayed at a first depth, 2D content that does not include depth information among the plurality of 2D contents at at least one of the first depth or a second depth further than the first depth, based on the positions of the two eyes.

[0232] In one embodiment, the memory may store instructions that, when executed by the processor, cause the electronic device to control the display to display the 3D content with an increased size compared to the 2D content.

[0233] In one embodiment, the memory may store instructions that, when executed by the processor, cause the electronic device to control the display to display the increased-size 3D content at a location different from the location of the user input.

[0234] In one embodiment, the memory may store instructions that, when executed by the processor, cause the electronic device to control the display to change the position of 2D content overlapping the increased-size 3D content.

[0235] In one embodiment, the memory may store instructions that, when executed by the processor, cause the electronic device to control the display to display the 3D content including the animation effect based on the 3D content including information about the animation effect.

[0236] According to one embodiment, the memory may store instructions that, when executed by the processor, cause the electronic device to change the 3D content into the 2D content based on a user input received after displaying the 3D content and based on confirmation that the 3D content is outside the set area.

[0237] According to one embodiment, the memory may store instructions that, when executed by the processor, cause the electronic device to control the display to display the second 2D content as second 3D content based on determining that the second 2D content including depth information is positioned in the set area.

[0238] According to one embodiment, the memory may store instructions that, when executed by the processor, cause the electronic device to control the display to display a plurality of 2D contents including depth information included in the screen as a plurality of 3D contents, respectively, based on the user input.

[0239] According to one embodiment, the memory may store instructions that, when executed by the processor, cause the electronic device to display a 3D advertisement in the set area based on the absence of user input for a set period of time after the 3D content is displayed in the set area.

[0240] According to one embodiment, the memory may store instructions that, when executed by the processor, cause the electronic device to control the display to display the 3D content in the set area based on a user input received after displaying the 3D advertisement.

[0241] According to one embodiment, a method of controlling an electronic device may include an operation of displaying a left-eye image and a right-eye image on a screen including a plurality of 2D contents including 2D contents corresponding to 3D content.

[0242] According to one embodiment, a method for controlling an electronic device may include an operation of confirming that the 2D content corresponding to the 3D content among the plurality of 2D contents is placed in a set area based on a user input for controlling the screen.

[0243] According to one embodiment, a method of controlling an electronic device may include an operation of displaying the 2D content as 3D content.

[0244] According to one embodiment, the operation of displaying the 3D content may include displaying the 3D content through a film disposed on at least a portion of a display of the electronic device so as to transmit the left-eye image and the right-eye image to provide the 3D content.

[0245] In one embodiment, the film may include at least one of a lenticular lens or a parallax barrier.

[0246] According to one embodiment, the method for controlling the electronic device may further include an operation of identifying the positions of the user's two eyes obtained through at least one sensor of the electronic device.

[0247] According to one embodiment, the control method of the electronic device may further include an operation of displaying, when the plurality of 2D contents are displayed at a first depth, 2D content that does not include depth information among the plurality of 2D contents at at least one of the first depth or a second depth further than the first depth based on the positions of the two eyes.

[0248] According to one embodiment, the operation of displaying the 3D content may display the 3D content in a size that is increased compared to the 2D content.

[0249] In one embodiment, the act of displaying the 3D content may display the 3D content with the increased size at a location different from the location of the user input.

[0250] In one embodiment, the method may further include changing the position of 2D content overlapping the increased-size 3D content.

[0251] According to one embodiment, the act of displaying the 3D content may display the 3D content including the animation effect based on the 3D content including information about the animation effect.

[0252] According to one embodiment, the control method of the electronic device may further include an operation of changing the 3D content into the 2D content based on a user input received after displaying the 3D content and based on confirmation that the 3D content is outside the set area.

[0253] According to one embodiment, a control method of an electronic device may further include an operation of displaying the second 2D content as second 3D content based on confirmation that the second 2D content including depth information is placed in the set area.

[0254] According to one embodiment, the operation of displaying the 3D content may display a plurality of 2D contents including depth information included in the screen as a plurality of 3D contents, respectively, based on the scroll input.

[0255] According to one embodiment, the control method of the electronic device may further include an operation of displaying a 3D advertisement in the set area based on the absence of a user input for a set period of time after the 3D content is displayed in the set area.

[0256] According to one embodiment, the control method of the electronic device may further include an operation of displaying the 3D content in the set area based on a user input received after displaying the 3D advertisement.

[0257] According to one embodiment, a non-transitory computer-readable recording medium storing one or more programs may include commands for controlling a display of an electronic device to display a left-eye image and a right-eye image on a screen including a plurality of 2D contents.

[0258] In one embodiment, the one or more programs may include instructions for the electronic device to identify the positions of the user's two eyes obtained through the at least one sensor.

[0259] According to one embodiment, the one or more programs may include commands for the electronic device to determine, based on a scroll input of the screen, that a 2D content including depth information among the plurality of 2D contents is placed in a set area.

[0260] In one embodiment, the one or more programs may include commands for controlling the display so that the electronic device displays the 2D content as 3D content based on the positions of the two eyes and the depth information.

[0261] According to one embodiment, the electronic device may further include a film disposed on the display to transmit the left-eye image and the right-eye image to provide 3D content.

[0262] In one embodiment, the film may include at least one of a lenticular lens or a parallax barrier.

[0263] In one embodiment, the film may be disposed on a portion of the display.

[0264] In one embodiment, the one or more programs may include commands that control the display to cause the electronic device to display the 3D content in an increased size compared to the 2D content.

[0265] In one embodiment, the one or more programs may include commands for controlling the display so that the electronic device displays the increased-size 3D content at a location other than the scroll input location.

[0266] In one embodiment, the one or more programs may include instructions for controlling the display so that the electronic device changes the position of 2D content overlapping the increased-size 3D content.

[0267] In one embodiment, the one or more programs may include commands for controlling the display of the electronic device to display the 3D content including the animation effect based on the 3D content including information about the animation effect.

[0268] In one embodiment, the one or more programs may include commands for the electronic device to change the 3D content into the 2D content based on a scroll input received after displaying the 3D content and based on determining that the 3D content is outside the set area.

[0269] In one embodiment, the one or more programs may include commands for controlling the display to display the second 2D content as second 3D content based on the electronic device determining that the second 2D content including depth information is positioned in the set area.

[0270] In one embodiment, the one or more programs may include commands for controlling the display so that the electronic device displays a plurality of 2D contents including depth information included in the screen as a plurality of 3D contents, respectively, based on the scroll input.

[0271] In one embodiment, the one or more programs may include instructions for the electronic device to display a 3D advertisement in the set area based on the absence of a scroll input for a set period of time after the 3D content is displayed in the set area.

[0272] In one embodiment, the one or more programs may include commands for controlling the display to display the 3D content in the set area based on a scroll input received after the electronic device displays the 3D advertisement.

[0273] According to one embodiment, an electronic device may include at least one sensor for identifying a position of a user's eyes, a display, and at least one processor electrically connected to the at least one sensor and the display.

[0274] According to one embodiment, the memory may store instructions that, when executed by the processor, cause the electronic device to control the display to display a screen including first 2D content and second 2D content corresponding to the 3D content.

[0275] According to one embodiment, the memory may store instructions that, when executed by the processor, cause the electronic device to determine that the second 2D content is placed in a set area of ​​the display based on a user input for controlling the screen.

[0276] In one embodiment, the memory may store instructions that, when executed by the processor, cause the electronic device to display the 3D content as a higher layer of the second 2D content.

[0277] Electronic devices according to the embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments disclosed in this document are not limited to the aforementioned devices.

[0278] The embodiments of this document and the terminology used herein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish the corresponding component from other corresponding components and do not limit the corresponding components in any other respect (e.g., importance or order). When a component (e.g., a first) is referred to as "coupled" or "connected" to another (e.g., a second) component, with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., by wire), wirelessly, or through a third component. The term "module" as used in the embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be an integral component, or the smallest unit or part of the component that performs one or more functions.For example, according to one embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0279] One embodiment of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0280] According to one embodiment, the method according to one embodiment disclosed in this document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0281] According to one embodiment, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and arranged in other components. According to one embodiment, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to one embodiment, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In electronic devices, A display showing left-eye images and right-eye images; memory; and comprising a processor electrically connected to the display and the memory; The above memory, when executed by the processor, causes the electronic device to: Controlling the display to display a plurality of 2D contents including content that can be displayed in 3D without parallax through left-eye images and right-eye images; Based on the user input, it is confirmed that the content that can be displayed in 3D among the plurality of 2D contents is placed within the set area, An electronic device storing commands that control the display to display the content placed within the set area in 3D.

2. In paragraph 1, Further comprising a film arranged on at least a portion of the display to transmit the left-eye image and the right-eye image to provide 3D content; The above film, An electronic device comprising at least one of a lenticular lens or a parallax barrier.

3. In paragraph 1, further comprising at least one sensor for identifying the position of the user's eyes; The above memory, when executed by the processor, causes the electronic device to: Identifying the position of the user's eyes obtained through at least one of the above sensors, An electronic device storing commands that cause a 2D content not including depth information among the plurality of 2D contents to be displayed at a first depth, based on the positions of the two eyes, at least one of the first depth and a second depth further than the first depth.

4. In any one of paragraphs 1 to 3, The above memory, when executed by the processor, causes the electronic device to: An electronic device storing commands that control the display to display 3D content of an increased size than the 2D content.

5. In paragraph 4, The above memory, when executed by the processor, causes the electronic device to: An electronic device controlling the display to display the increased size 3D content at a location different from the location of the user input.

6. In paragraph 4 or 5, The above memory, when executed by the processor, causes the electronic device to: An electronic device storing commands that control the display to change the position of 2D content overlapping the 3D content whose size is increased.

7. In any one of paragraphs 1 to 6, The above memory, when executed by the processor, causes the electronic device to: An electronic device storing commands for controlling the display to display the 3D content including the animation effect, based on the 3D content including information about the animation effect.

8. In any one of paragraphs 1 to 7, The above memory, when executed by the processor, causes the electronic device to: Based on the user input received after displaying the 3D content, if it is confirmed that the 3D content is out of the set area, the 3D content is changed to the 2D content, An electronic device storing commands that control the display to display the second 2D content as second 3D content based on confirmation that the second 2D content including depth information is placed in the set area.

9. In any one of paragraphs 1 to 8, The above memory, when executed by the processor, causes the electronic device to: An electronic device storing commands that control the display to display a plurality of 2D contents including depth information as a plurality of 3D contents, respectively, based on the user input.

10. In any one of paragraphs 1 to 9, The above memory, when executed by the processor, causes the electronic device to: After the 3D content is displayed in the above-mentioned area, based on the absence of user input for a set period of time, a 3D advertisement is displayed in the above-mentioned area. An electronic device storing commands for controlling the display to display the 3D content in the set area based on a user input received after displaying the 3D advertisement.

11. In a method for controlling an electronic device, An operation of displaying a plurality of 2D contents including corresponding content that can be displayed in 3D without parallax through the left-eye image and the right-eye image; An operation of confirming that the content capable of being displayed in 3D among the plurality of 2D contents is placed within a set area based on user input; and A method for controlling an electronic device, comprising: an operation of displaying the content placed within the above-described set area in 3D; 12. In paragraph 11, The action of displaying the above 3D content is: Displaying the 3D content through a film placed on at least a portion of a display area of ​​the electronic device so as to provide 3D content by transmitting the left-eye image and the right-eye image, The above film, A method of controlling an electronic device comprising at least one of a lenticular lens or a parallax barrier.

13. In paragraph 11, An action of identifying the position of the user's two eyes obtained through at least one sensor of the electronic device; A control method of an electronic device, further comprising: an operation of displaying, while the plurality of 2D contents are displayed at a first depth, 2D content not including depth information among the plurality of 2D contents at at least one of the first depth or a second depth further than the first depth based on the positions of the two eyes.

14. In any one of paragraphs 11 to 13, The action of displaying the above 3D content is: A method of controlling an electronic device for displaying 3D content having a size increased from that of the 2D content.

15. In paragraph 14, The action of displaying the above 3D content is: A method of controlling an electronic device for displaying 3D content with increased size at a location different from the location of the user input.

Images