Electronic device and screen display method

Abstract

The electronic device according to an embodiment of the present disclosure may include a display for displaying a three-dimensional (3D) screen, a camera, a memory for storing instructions, and at least one processor, wherein the instructions, when executed by the at least one processor, cause the electronic device to: identify whether a first screen, which corresponds to an application being run on the display and has a two-dimensional image, contains personal information for which security is needed; generate disparity information on the basis of characteristics of the personal information if the first screen contains the personal information; and control the display so that at least a portion of the first screen is displayed as a second screen exhibiting parallax to a left eye and right eye, on the basis of the disparity information.

Description

Electronic devices and screen display methods

[0001] The present disclosure relates to an electronic device and a screen display method.

[0002] Various electronic devices, such as smart phones, tablet PCs, laptop PCs, and wearable devices, may include 3D (dimensions) display devices.

[0003] Humans can perceive objects in three dimensions due to binocular disparity. 3D display devices can display screens in three dimensions by mimicking the way humans perceive objects based on binocular disparity.

[0004] Electronic devices such as smartphones, tablet PCs, laptop PCs, and wearable devices have become increasingly portable, but there is a problem that the screen displayed on the electronic device may be exposed to others in a way that the user did not intend.

[0005] The purpose of the electronic device and screen display method of the present disclosure is to display a screen corresponding to a running application in three dimensions using a 3D display device.

[0006] An electronic device according to one embodiment of the present disclosure may include a display displaying a dimensional screen.

[0007] An electronic device according to one embodiment of the present disclosure may include a camera disposed on the same plane as the display.

[0008] An electronic device according to one embodiment of the present disclosure may include at least one processor.

[0009] An electronic device according to one embodiment of the present disclosure includes a memory for storing instructions,

[0010] The instructions according to one embodiment of the present disclosure, when executed by the at least one processor, may cause the electronic device to identify whether a first screen corresponding to an application running on the display and having a two-dimensional image includes personal information requiring security, and if so, generate disparity information based on a characteristic of the personal information, and control the display to display at least a portion of the first screen as a second screen having parallax to the left and right eyes based on the disparity information.

[0011] A screen display method according to one embodiment of the present disclosure corresponds to an application running on a display displaying a three-dimensional screen, and may include an operation of checking whether a first screen having a two-dimensional image contains personal information requiring security.

[0012] A screen display method according to one embodiment of the present disclosure may include an operation of generating disparity information based on characteristics of the personal information, if the personal information is included.

[0013] A screen display method according to one embodiment of the present disclosure may include an operation of controlling the display to display at least a portion of the first screen as a second screen having parallax to the left and right eyes based on the disparity information.

[0014] The electronic device and screen display method of the present disclosure can protect information from others by using a 3D display device to display a screen corresponding to a running application in three dimensions.

[0015] In connection with the description of the drawings, the same or similar reference numerals may be used for the same or similar components.

[0016] FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments of the present disclosure.

[0017] FIG. 2A is a drawing of an electronic device according to one embodiment of the present disclosure viewed from a first direction (1).

[0018] FIG. 2b is a drawing of an electronic device according to one embodiment of the present disclosure viewed from a second direction (2).

[0019] FIG. 3A is a diagram illustrating a method for displaying a three-dimensional image according to one embodiment of the present disclosure.

[0020] FIG. 3b is a diagram illustrating a method for displaying a three-dimensional image according to one embodiment of the present disclosure.

[0021] FIG. 4 is a flowchart illustrating a screen display method of an electronic device according to one embodiment of the present disclosure.

[0022] FIG. 5 is a flowchart illustrating a screen display method of an electronic device according to one embodiment of the present disclosure.

[0023] FIG. 6 is a diagram illustrating an operation of setting a security mode of an electronic device according to one embodiment of the present disclosure.

[0024] FIG. 7 is a diagram illustrating a method for registering a user in an electronic device according to one embodiment of the present disclosure.

[0025] FIG. 8A is a diagram exemplifying text that may be displayed on a display before disparity information is applied according to one embodiment of the present disclosure.

[0026] FIG. 8b is a diagram exemplifying text that may be displayed on a display after first disparity information is applied according to one embodiment of the present disclosure.

[0027] FIG. 8C is a diagram exemplifying text that may be displayed on a display after second disparity information is applied according to one embodiment of the present disclosure.

[0028] FIG. 9A is a diagram showing a user registered in an electronic device of the present disclosure looking at a first execution screen displayed in three dimensions.

[0029] FIG. 9b is a diagram illustrating a case where a user who is not registered in the electronic device of the present disclosure views a first execution screen displayed in three dimensions.

[0030] FIG. 9c is a diagram illustrating a case where a user who is not registered in the electronic device of the present disclosure views a first execution screen displayed in three dimensions.

[0031] FIG. 10A is a diagram showing a user registered in an electronic device of the present disclosure looking at a second execution screen displayed in three dimensions.

[0032] FIG. 10b is a diagram illustrating a case where a user who is not registered in the electronic device of the present disclosure views a second execution screen displayed in three dimensions.

[0033] FIG. 10c is a diagram illustrating a case where a user who is not registered in the electronic device of the present disclosure views a first execution screen displayed in three dimensions.

[0034] FIG. 11A is a diagram showing a user registered in an electronic device of the present disclosure looking at a third execution screen displayed in three dimensions.

[0035] FIG. 11b is a diagram illustrating a case where a user who is not registered in the electronic device of the present disclosure views a third execution screen displayed in three dimensions.

[0036] FIG. 11c is a diagram illustrating a case where a user who is not registered in the electronic device of the present disclosure views a second execution screen displayed in three dimensions.

[0037] FIG. 12A is a diagram showing a user registered in an electronic device of the present disclosure looking at a fourth execution screen displayed in three dimensions.

[0038] FIG. 12b is a diagram illustrating a case where a user who is not registered in the electronic device of the present disclosure views a fourth execution screen displayed in three dimensions.

[0039] FIG. 12c is a diagram illustrating a case where a user who is not registered in the electronic device of the present disclosure views a fourth execution screen displayed in three dimensions.

[0040] FIG. 13 is a diagram showing a user registered in an electronic device of the present disclosure looking at a fifth execution screen displayed in three dimensions.

[0041] FIG. 14a is a diagram showing a user registered in an electronic device of the present disclosure looking at a sixth execution screen displayed in three dimensions.

[0042] FIG. 14b is a diagram showing a user registered in the electronic device of the present disclosure looking at the sixth execution screen displayed in three dimensions.

[0043] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments.

[0044] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0045] The processor (120) may control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) by executing, for example, software (e.g., a program (140)), and may perform various data processing or calculations. According to one embodiment, as at least a part of the data processing or calculation, the processor (120) may store a command or data received from another component (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the command or data stored in the volatile memory (132), and store the resulting data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or processor) or a secondary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together therewith. For example, if the electronic device (101) includes a main processor (121) and a secondary processor (123), the secondary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a specified function. The secondary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0046] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0047] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0048] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0049] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0050] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0051] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0052] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0053] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0054] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) to an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0055] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0056] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0057] The camera module (180) can capture still images and moving images. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0058] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0059] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0060] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0061] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0062] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0063] According to various embodiments, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0064] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0065] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0066] FIG. 2a is a drawing of an electronic device (101) according to one embodiment of the present disclosure viewed from a first direction (1).

[0067] FIG. 2b is a drawing of an electronic device (101) according to one embodiment of the present disclosure viewed from a second direction (2).

[0068] In one embodiment, the electronic device (101) may include a display (260), a first camera (281), and a visual tracking sensor (282).

[0069] In one embodiment, the display (260) may be identical to the display module (160) of FIG. 1. The display (260) may be a 3D (dimensions) display. The display (260), under the control of the processor (120), may display a 3D screen with a three-dimensional effect or depth based on binocular disparity of the screen being displayed on the display (260). The electronic device (101), under the control of the processor (120), may generate a first image (or first image) corresponding to the left eye and a second image (or second image) corresponding to the right eye based on disparity information. The electronic device (101), under the control of the processor (120), may simultaneously display the generated first image (or first image) and second image (or second image).

[0070] In one embodiment, the user's gaze and the first image (or first image) and the second image (or second image) must match so that the user can perceive the screen displayed on the display (260) in three dimensions. The electronic device (101) can track the gaze of the user (or observer) using the first camera (281) and / or the visual tracking sensor (282). The electronic device (101) can obtain gaze information through the first camera (281) and / or the visual tracking sensor (282). The electronic device (101) can control the display positions on the display (260) of the first image (or first image) displayed on the left eye and the second image (or second image) displayed on the right eye based on the gaze information through the processor (120).

[0071] In one embodiment, disparity information may be information regarding the degree of separation between the images displayed to the left eye and the images displayed to the right eye when images from different viewpoints are displayed to the left and right eyes. Depending on the degree of separation between the images displayed to the left eye and the images displayed to the right eye, the user may perceive the images displayed on the display (260) as three-dimensional or overlapping.

[0072] In one embodiment, the first camera (281) may be a vision sensor. The first camera (281) and / or the eye tracking sensor (282) may be disposed on the same plane as the display (260). The first camera (281) includes an image sensor and may recognize an object (e.g., a face, a hand, a stylus pen (210).

[0073] In one embodiment, the visual tracking sensor (282) can detect the positions of the user's left and right eyes based on images acquired by the first camera (281).

[0074] In one embodiment, the electronic device (101) can, under the control of the processor (120), identify the visual and / or ocular image acquired by the first camera (281).

[0075] In one embodiment, the electronic device (101) may, under the control of the processor (120), transmit identified visual and / or ocular features to the visual tracking sensor (282).

[0076] In one embodiment, the vision tracking sensor (282) can track vision based on identified vision and / or eye features.

[0077] In one embodiment, the electronic device (101) may include a second camera (283). The second camera (283) may include at least one of a wide-angle camera, a telephoto camera, and / or a depth camera.

[0078] In one embodiment, the first camera (281) and / or the second camera (283) may be identical to the camera module (180) of FIG. 1.

[0079] In one embodiment, the display (260) may further include a touch panel for receiving touch input. The display (260) may receive touch input from a hand and / or a stylus pen (210). The electronic device (260) may receive input from the stylus pen (210). The stylus pen (210) may include an input button or an input area.

[0080] In one embodiment, the electronic device (101) can, under the control of the processor (120), detect input (e.g., touch, hovering, button input) received through a hand and / or a stylus pen (210) and control an object (e.g., a three-dimensional object) included in a screen displayed on the display (260).

[0081] In one embodiment, the electronic device (101) can detect a user's gesture input through the first camera (281) and / or the second camera (283) under the control of the processor (120) and control an object (e.g., a three-dimensional object) included in a screen displayed on the display (260).

[0082] Control operations of an object (e.g., a three-dimensional object) included in a screen displayed on the display (260) may include, for example, rotation, translation, and / or scale transformation of the object (e.g., a three-dimensional object).

[0083] FIG. 3A is a diagram illustrating a method for displaying a three-dimensional image using a display (260) according to one embodiment of the present disclosure.

[0084] FIG. 3b is a diagram illustrating a method for displaying a three-dimensional image using a display (260) according to one embodiment of the present disclosure.

[0085] In one embodiment, a display (260) capable of displaying a three-dimensional image may include special slits (302, 322) in front of a screen (2301) to allow the left eye (311) and the right eye (312) to view different pixels (L, R). For example, the slits that allow the left eye (311) and the right eye (312) to view different pixels may be lenticular lenses (302). The slits that allow the left eye (311) and the right eye (312) to view different pixels may be parallax barriers (322).

[0086] In one embodiment, the display (260) displays optically separated multi-view images, using a lenticular lens (302) or a parallax barrier (322) to project light corresponding to images from different viewpoints onto the user's left eye (311) and right eye (312), thereby allowing the user to experience a three-dimensional effect.

[0087] FIG. 4 is a flowchart illustrating a screen display method of an electronic device (101) according to one embodiment of the present disclosure.

[0088] In one embodiment, the electronic device (101) may include a memory (130) that stores instructions. The instructions, when executed by at least one processor (120), may cause the electronic device (101) to perform the screen display method of the electronic device (101) of FIG. 4.

[0089] In one embodiment, the electronic device (101), under the control of the processor (120), in operation 401, may determine whether a first screen corresponding to an application running on the display (260) contains personal information requiring security.

[0090] In one embodiment, the instructions, when executed by at least one processor (120), may cause the electronic device (101), in operation 401, to determine whether a first screen corresponding to an application running on the display (260) contains personal information that requires security.

[0091] In one embodiment, the first screen may be a two-dimensionally implemented image or video.

[0092] In one embodiment, personal information may be information about an individual that can directly or indirectly identify the individual. Personal information may include, for example, an individual's name, signature, address, phone number, date of birth, personal password, identification (ID), sensitive information, credit information, employee record information, photographs, biometric information, location information, internet address information, and / or personal records (e.g., schedule). Sensitive information may include, for example, information about race, ethnicity, political affiliation, religion, philosophy, health, sexual orientation, etc. For example, personal information may include not only information about the user of the electronic device (101), but also any information that can identify the individual.

[0093] In one embodiment, the electronic device (101), under the control of the processor (120), may generate disparity information based on characteristics of the personal information in operation 403.

[0094] In one embodiment, the instructions, when executed by at least one processor (120), may cause the electronic device (101) to, in operation 403, generate disparity information based on characteristics of the personal information.

[0095] In one embodiment, the electronic device (101), under the control of the processor (120), in operation 403, may generate disparity information based on characteristics of the personal information when personal information is included in the first screen.

[0096] In one embodiment, the instructions, when executed by at least one processor (120), may cause the electronic device (101), in operation 403, to generate disparity information based on characteristics of the personal information, if the personal information is included in the first screen.

[0097] In one embodiment, the electronic device (101), under the control of the processor (120), may, in operation 403, determine whether personal information is text or an image, and generate disparity information based on the determination result.

[0098] In one embodiment, the instructions, when executed by at least one processor (120), may cause the electronic device (101) to, in operation 403, determine whether personal information is text or an image, and generate disparity information based on the determination result.

[0099] In one embodiment, the electronic device (101) may pre-store characteristics of personal information or data or a database regarding personal information in the memory (130). The electronic device (101) may determine whether information included in the first screen is personal information based on the data or database stored in the memory (130). The electronic device (101) may identify characteristics of personal information based on the data or database stored in the memory (130).

[0100] In one embodiment, the property of personal information may be an attribute of the personal information. The property of personal information may be, for example, metadata. Under the control of the processor (120), the electronic device (101) may determine whether the personal information is text or an image based on the property of the personal information.

[0101] In one embodiment, the electronic device (101) can determine the degree of separation between the image displayed on the left eye and the image displayed on the right eye based on the characteristics of the personal information. For example, if the degree of separation between the image displayed on the left eye and the image displayed on the right eye is applied equally without considering the characteristics of the personal information, there is a problem that some personal information may be easily read by others. In one embodiment, the electronic device (101) can determine the degree of separation between the image displayed on the left eye and the image displayed on the right eye so that at least one or more of the information regarding the size of the text, the spacing between the text, the font of the text, the size of the object included in the image, the shape of the object included in the image, or the color of the object included in the image, which has been identified based on the characteristics of the personal information, is not easily readable even if exposed to others. The electronic device (101) can control the display (260) to display a second screen based on the determined degree of separation between the image displayed on the left eye and the image displayed on the right eye.

[0102] For example, the electronic device (101) may include in the memory (130) disparity information corresponding to information about the size of text, the spacing between texts, the font of texts, the size of objects included in an image, the shape of objects included in an image, or the color of objects included in an image, which are identified based on the characteristics of personal information.

[0103] In one embodiment, the electronic device (101) can check disparity information corresponding to the characteristics of personal information from the memory (130). Based on the disparity information corresponding to the characteristics of personal information, the electronic device (101) can control the display (260) to display a second screen.

[0104] The electronic device (101), under the control of the processor (120), may generate disparity information based on at least one of the text size, kerning, and font when determining that the personal information includes text. If the personal information includes text, the characteristics of the personal information may include at least one of the text size, kerning, and font.

[0105] In one embodiment, the electronic device (101), under the control of the processor (120), in operation 403, if it determines that the personal information includes an image (e.g., a photograph), can identify an object included in the image.

[0106] In one embodiment, the instructions, when executed by at least one processor (120), may cause the electronic device (101), in operation 403, to identify an object contained in an image (e.g., a photograph) if the personal information is determined to include the image.

[0107] In one embodiment, the electronic device (101), under the control of the processor (120), may generate disparity information based on characteristics of an object included in an image, in operation 403.

[0108] In one embodiment, the instructions, when executed by at least one processor (120), may cause the electronic device (101) to, in operation 403, generate disparity information based on characteristics of an object included in an image.

[0109] In one embodiment, the objects included in the image may include, for example, objects, animals, people, and / or text. The electronic device (101), under the control of the processor (120), in operation 403, may identify at least one piece of information regarding the size, shape, or color of the object included in the image. If the personal information includes an image, the characteristics of the personal information may include at least one piece of information regarding the size, shape, or color of the object included in the image.

[0110] In one embodiment, the electronic device (101), under the control of the processor (120), in operation 403, if the personal information includes an image (e.g., a photograph), may generate disparity information based on at least one of information regarding the size, shape, or color of an object included in the image.

[0111] In one embodiment, the instructions, when executed by at least one processor (120), may cause the electronic device (101) to, in operation 403, generate disparity information based on at least one of information regarding the size, shape, or color of an object included in an image, if the personal information includes an image (e.g., a photograph).

[0112] In one embodiment, if the object included in the image is text, the electronic device (101), under the control of the processor (120), in operation 403, may generate disparity information based on at least one of the size, kerning, and font of the text.

[0113] In one embodiment, the instructions, when executed by at least one processor (120), may cause the electronic device (101) to, in operation 403, generate disparity information based on at least one of a size, kerning, and font of the text, if the object included in the image is text.

[0114] In one embodiment, the disparity information may be information about the degree of separation between the image displayed to the left eye and the image displayed to the right eye when images from different viewpoints are displayed on the display (260).

[0115] In one embodiment, the electronic device (101) can obtain gaze information through the first camera (281) and / or the visual tracking sensor (282). The electronic device (101) can control the display positions of the first image (or first image) displayed on the left eye and the second image (or second image) displayed on the right eye on the display (260) based on the gaze information through the processor (120).

[0116] In one embodiment, since the electronic device (101) displays a three-dimensional image (or video) on the display (260) in response to a user whose gaze is being tracked, when a user whose gaze is not being tracked looks at the display (260), the first image (or first image) displayed on the left eye and the second image (or second image) displayed on the right eye may appear separated and overlapped depending on the disparity information (or degree of separation), making it difficult to read text included in the personal information. If the degree of separation is greater than a specified range, a person other than the user may be able to read it, so the electronic device (101) may generate the disparity information based on the characteristics of the personal information.

[0117] In one embodiment, the electronic device (101), under the control of the processor (120), in operation 405, may control the display (260) to display a second screen corresponding to the running application by overlapping at least a portion of the first screen based on disparity information. The electronic device (101), under the control of the processor (120), may control the second screen to be displayed in response to the gaze of a subject (e.g., a registered user) whose eyes are tracked by the first camera (281).

[0118] In one embodiment, the instructions, when executed by at least one processor (120), may cause the electronic device (101) to control the display (260) to display a second screen corresponding to the running application, overlapping at least a portion of the first screen based on the disparity information, at operation 405.

[0119] In one embodiment, the electronic device (101), under the control of the processor (120), may control the display (260) to display at least a portion of the first screen as a second screen having parallax to the left and right eyes based on the disparity information in operation 405.

[0120] In one embodiment, the instructions, when executed by at least one processor (120), may cause the electronic device (101) to control the display (260) to display at least a portion of the first screen as a second screen having parallax to the left and right eyes based on the disparity information, in operation 405.

[0121] In one embodiment, the second screen may be a three-dimensionally displayed image or video. Since the second screen is displayed on the display (260) separately as a first image (or first image) displayed to the left eye and a second image (or second image) displayed to the right eye, at least a portion of the first image (or first image) displayed to the left eye and the second image (or second image) displayed to the right eye may appear to overlap. The degree to which the first image (or first image) displayed to the left eye and the second image (or second image) displayed to the right eye overlap may vary depending on the viewing angle of the display (260).

[0122] In one embodiment, when displaying a second screen, the electronic device (101) may, under the control of the processor (120), display the entire second screen as a three-dimensional image or video. In one embodiment, when displaying a second screen, the electronic device (101) may, under the control of the processor (120), display an area corresponding to personal information on the second screen as a three-dimensional image or video.

[0123] FIG. 5 is a flowchart illustrating a screen display method of an electronic device (101) according to one embodiment of the present disclosure.

[0124] In one embodiment, the electronic device (101) may include a memory (130) that stores instructions. The instructions, when executed by at least one processor (120), may cause the electronic device (101) to perform the screen display method of the electronic device (101) of FIG. 5.

[0125] In one embodiment, the electronic device (101), under the control of the processor (120), may set a security mode in operation 501.

[0126] In one embodiment, the instructions, when executed by at least one processor (120), may cause the electronic device (101) to set a secure mode in operation 501.

[0127] In one embodiment, the security mode may be an operation that controls the display of a three-dimensional image or video for the entire screen and / or an area containing personal information on a screen containing personal information. The security mode may be turned on / off according to the user's settings.

[0128] In one embodiment, when the security mode is turned on or set, the electronic device (101) may display a three-dimensional image or video of the entire screen and / or an area containing personal information on the display (260). When the security mode is turned off, the electronic device (101) may display a two-dimensional image of the screen on the display (260).

[0129] In one embodiment, when the security mode is turned on or set, if the electronic device (101) determines that a user other than a registered user is viewing the display (260), the electronic device may display a three-dimensional image or video of the entire screen and / or an area containing personal information for the screen containing personal information.

[0130] In one embodiment, the electronic device (101) may execute a settings application and / or a control panel capable of setting a security mode based on user input.

[0131] In one embodiment, the electronic device (101), under the control of the processor (120), may determine, in operation 503, whether an unregistered user has been detected through a camera (e.g., the first camera (281)).

[0132] In one embodiment, the instructions, when executed by at least one processor (120), may cause the electronic device (101) to determine, in operation 503, whether an unregistered user has been detected via a camera (e.g., a first camera (281)). In one embodiment, the electronic device (101), under control of the processor (120), may determine, in operation 503, whether an unregistered user has been detected via a camera (e.g., a first camera (281)).

[0133] In one embodiment, the instructions, when executed by at least one processor (120), may cause the electronic device (101) to determine, in operation 503, whether an unregistered user has been detected via a camera (e.g., a first camera (281)).

[0134] In one embodiment, if an unregistered user is detected, the electronic device (101) may branch from operation 503 to operation 505.

[0135] In one embodiment, if an unregistered user is not detected or a registered user is detected, the electronic device (101) may continue to display the running screen.

[0136] In one embodiment, the electronic device (101), under the control of the processor (120), may determine, in operation 503, whether the eyes of multiple users have been detected through a camera (e.g., the first camera (281)).

[0137] In one embodiment, the instructions, when executed by at least one processor (120), may cause the electronic device (101) to, in operation 503, determine whether multiple users' eyes have been detected via a camera (e.g., a first camera (281)).

[0138] In one embodiment, when multiple users' eyes are detected, the electronic device (101) may branch from operation 503 to operation 505.

[0139] In one embodiment, if the eyes of multiple users are not detected and only the eyes of registered users are detected, the electronic device (101) can continue to display the running screen.

[0140] In one embodiment, the electronic device (101), under the control of the processor (120), may determine, in operation 503, whether a user has been detected through a camera (e.g., a first camera (281)).

[0141] In one embodiment, the instructions, when executed by at least one processor (120), may cause the electronic device (101) to determine, in operation 503, whether a user has been detected via a camera (e.g., a first camera (281)).

[0142] In one embodiment, if a user is not detected, the electronic device (101) may branch from operation 503 to operation 505.

[0143] In one embodiment, when a user (e.g., a registered user) is detected, the electronic device (101) may continue to display the running screen.

[0144] However, this is not limited thereto, and operation 503 may be omitted, and operation 501 may branch to operation 505 when the security mode is turned on or set. If the security mode is not set in operation 501, the electronic device (101) may continue to display the running screen.

[0145] In one embodiment, the electronic device (101), under the control of the processor (120), in operation 505, may identify whether a first screen corresponding to an application running on the display (260) contains personal information requiring security.

[0146] In one embodiment, the instructions, when executed by at least one processor (120), may cause the electronic device (101), in operation 505, to identify whether a first screen corresponding to an application running on the display (260) contains personal information requiring security.

[0147] In one embodiment, the first screen may be a two-dimensionally implemented image or video.

[0148] In one embodiment, the electronic device (101), under the control of the processor (120), in operation 507, may generate at least one of disparity information, pattern information, or contrast information based on characteristics of the personal information.

[0149] In one embodiment, the instructions, when executed by at least one processor (120), may cause the electronic device (101) to, in operation 507, generate at least one of disparity information, pattern information, or contrast information based on characteristics of the personal information.

[0150] In one embodiment, the electronic device (101), under the control of the processor (120), in operation 507, when personal information is included in the first screen, may generate at least one of disparity information, pattern information, or contrast information based on characteristics of the personal information.

[0151] In one embodiment, the instructions, when executed by at least one processor (120), may cause the electronic device (101), in operation 507, to generate at least one of disparity information, pattern information, or contrast information based on characteristics of the personal information, if the personal information is included in the first screen.

[0152] In one embodiment, the electronic device (101), under the control of the processor (120), may, in operation 507, determine whether personal information is text or an image, and generate disparity information based on the determination result.

[0153] In one embodiment, the instructions, when executed by at least one processor (120), may cause the electronic device (101), in operation 507, to determine whether personal information is text or an image and to generate disparity information based on the determination result.

[0154] In one embodiment, the property of personal information may be an attribute of the personal information. The property of personal information may be, for example, metadata. Under the control of the processor (120), the electronic device (101) may determine whether the personal information is text or an image based on the property of the personal information.

[0155] In one embodiment, the electronic device (101) can determine the degree of separation between the image displayed on the left eye and the image displayed on the right eye based on the characteristics of the personal information. For example, if the degree of separation between the image displayed on the left eye and the image displayed on the right eye is applied equally without considering the characteristics of the personal information, there is a problem that some personal information may be easily read by others. In one embodiment, the electronic device (101) can determine the degree of separation between the image displayed on the left eye and the image displayed on the right eye so that at least one or more of the information regarding the size of the text, the spacing between the text, the font of the text, the size of the object included in the image, the shape of the object included in the image, or the color of the object included in the image, which has been identified based on the characteristics of the personal information, is not easily readable even if exposed to others. The electronic device (101) can control the display (260) to display a second screen based on the determined degree of separation between the image displayed on the left eye and the image displayed on the right eye.

[0156] For example, the electronic device (101) may include in the memory (130) disparity information corresponding to information about the size of text, the spacing between texts, the font of texts, the size of objects included in an image, the shape of objects included in an image, or the color of objects included in an image, which are identified based on the characteristics of personal information.

[0157] In one embodiment, the electronic device (101) can check disparity information corresponding to the characteristics of personal information from the memory (130). Based on the disparity information corresponding to the characteristics of personal information, the electronic device (101) can control the display (260) to display a second screen.

[0158] In one embodiment, the electronic device (101), under the control of the processor (120), if it determines that the personal information includes text, may generate disparity information based on at least one of the text's size, kerning, and font. If the personal information includes text, the characteristics of the personal information may include at least one of the text's size, kerning, and font.

[0159] In one embodiment, the electronic device (101), under the control of the processor (120), in operation 507, if it is determined that the personal information includes an image (e.g., a photograph), can identify an object included in the image.

[0160] In one embodiment, the instructions, when executed by at least one processor (120), may cause the electronic device (101) to, in operation 507, identify an object contained in an image (e.g., a photograph) if the personal information is determined to include the image.

[0161] In one embodiment, the electronic device (101), under the control of the processor (120), may, in operation 507, generate disparity information based on characteristics of an object included in an image.

[0162] In one embodiment, the instructions, when executed by at least one processor (120), may cause the electronic device (101), in operation 507, to generate disparity information based on characteristics of an object included in an image.

[0163] In one embodiment, the objects included in the image may include, for example, objects, animals, people, and / or text. The electronic device (101), under the control of the processor (120), in operation 507, may identify at least one piece of information regarding the size, shape, or color of the object included in the image. If the personal information includes an image, the characteristics of the personal information may include at least one piece of information regarding the size, shape, or color of the object included in the image.

[0164] In one embodiment, the electronic device (101), under the control of the processor (120), in operation 507, if the personal information includes an image (e.g., a photograph), may generate disparity information based on at least one of information regarding the size, shape, or color of an object included in the image.

[0165] In one embodiment, the instructions, when executed by at least one processor (120), may cause the electronic device (101) to, in operation 507, generate disparity information based on at least one of information regarding the size, shape, or color of an object included in an image (e.g., a photograph), if the personal information includes an image.

[0166] In one embodiment, if the object included in the image is text, the electronic device (101), under the control of the processor (120), in operation 507, may generate disparity information based on at least one of the size, kerning, and font of the text.

[0167] In one embodiment, the instructions, when executed by at least one processor (120), may cause the electronic device (101) to, in operation 507, generate disparity information based on at least one of a size, kerning, and font of the text.

[0168] In one embodiment, the disparity information may be information about the degree of separation between the image displayed to the left eye and the image displayed to the right eye when images from different viewpoints are displayed on the display (260).

[0169] In one embodiment, the electronic device (101) can obtain gaze information through the first camera (281) and / or the visual tracking sensor (282). The electronic device (101) can control the display positions of the first image (or first image) displayed on the left eye and the second image (or second image) displayed on the right eye on the display (260) based on the gaze information through the processor (120).

[0170] In one embodiment, since the electronic device (101) displays a three-dimensional image (or video) on the display (260) in response to a user whose gaze is being tracked, when a user whose gaze is not being tracked looks at the display (260), the first image (or first image) displayed on the left eye and the second image (or second image) displayed on the right eye may appear separated and overlapped depending on the disparity information (or degree of separation), making it difficult to read text included in the personal information. If the degree of separation is greater than a specified range, a person other than the user may be able to read it, so the electronic device (101) may generate the disparity information based on the characteristics of the personal information.

[0171] In one embodiment, the pattern information may be information that is superimposed and / or added to a three-dimensional image (or video) being displayed on the display (260). For example, the pattern information may include a stripe pattern. The pattern included in the pattern information may be translucent.

[0172] In one embodiment, the electronic device (101) can display a pattern included in the pattern information by overlaying it on a three-dimensional image (or video) being displayed on the display (260).

[0173] In one embodiment, contrast information may be information that is superimposed and / or added to a three-dimensional image (or video) being displayed on the display (260). The contrast information may include a contrast ratio of the display (260).

[0174] In one embodiment, the electronic device (101) can change the contrast ratio of a three-dimensional image (or video) being displayed on the display (260) based on contrast information.

[0175] In one embodiment, the electronic device (101), under the control of the processor (120), may control the display (260) to display a second screen corresponding to the running application by overlapping at least a portion of the first screen based on at least one of disparity information, pattern information, or contrast information, in operation 509.

[0176] In one embodiment, the instructions, when executed by at least one processor (120), may cause the electronic device (101) to control the display (260) to display a second screen corresponding to the running application, overlapping at least a portion of the first screen based on at least one of disparity information, pattern information, or contrast information, in operation 509.

[0177] In one embodiment, the electronic device (101), under the control of the processor (120), may control the display (260) to display at least a portion of the first screen as a second screen having parallax to the left and right eyes based on at least one of disparity information, pattern information, or contrast information, in operation 509.

[0178] In one embodiment, the instructions, when executed by at least one processor (120), may cause the electronic device (101) to control the display (260) to display at least a portion of the first screen as a second screen having parallax to the left and right eyes based on at least one of disparity information, pattern information, or contrast information, in operation 509.

[0179] In one embodiment, the electronic device (101), under the control of the processor (120), can control the second screen to be displayed in response to the gaze of a subject (e.g., a registered user) whose eyes are tracked by the first camera (281).

[0180] In one embodiment, the second screen may be a three-dimensionally displayed image or video. The second screen may be a screen in which a pattern included in the pattern information is superimposed on the three-dimensionally displayed image or video. The second screen may be a screen in which the contrast ratio of the three-dimensionally displayed image or video is changed based on contrast information.

[0181] FIG. 6 is a diagram illustrating an operation of setting a security mode of an electronic device (101) according to one embodiment of the present disclosure.

[0182] In one embodiment, the electronic device (101) may, under the control of the processor (160), execute a control panel (601) upon receiving a user input. The control panel (601) may be an execution screen of a settings application. The control panel (601) may be an API that can access the settings application. For example, the control panel (601) may turn on / off at least one setting, such as Wi-Fi connection, airplane mode, short-range wireless communication, and / or muting of audio volume, according to a user input. The control panel (601) may include a setting regarding a secure mode (603). The secure mode (603) may be turned on / off according to a user input.

[0183] FIG. 7 is a diagram illustrating a method for registering a user in an electronic device (101) according to one embodiment of the present disclosure.

[0184] In one embodiment, the electronic device (101) may, under the control of the processor (120), register a user (710) using the first camera (281) and display the registration process (701) or recognition (701) on the display (260).

[0185] FIG. 8A is a diagram exemplifying text that may be displayed on a display (260) before disparity information is applied according to one embodiment of the present disclosure.

[0186] FIG. 8b is a diagram exemplarily showing text that may be displayed on a display (260) after first disparity information is applied according to one embodiment of the present disclosure.

[0187] FIG. 8c is a diagram exemplarily showing text that may be displayed on a display (260) after second disparity information is applied according to one embodiment of the present disclosure.

[0188] Referring to FIG. 8a, text that may be displayed on the display (260) before disparity information is applied may be, for example, “Lorem Ipsum is a standard filler text used to present graphic elements or visual presentations in publishing or graphic design.”

[0189] Referring to FIGS. 8B and 8C, when the first disparity information or the second disparity information is applied, the electronic device (101) can display the text “Lorem Ipsum is a standard fill text used to show graphic elements or visual presentations in the publishing or graphic design fields” by separating the first image (or first image) displayed on the left eye and the second image (or second image) displayed on the right eye based on the first disparity information or the second disparity information. When the first image (or first image) displayed on the left eye and the second image (or second image) displayed on the right eye are separately displayed, the text can be displayed overlapping depending on the viewing angle of the user.

[0190] In one embodiment, the degree of separation between the first image (or first image) displayed on the left eye and the second image (or second image) displayed on the right eye of the second disparity information may be greater than the degree of separation of the first disparity information. The electronic device (101), under the control of the processor (120), may determine the degree of separation or disparity information based on the size of the text, the spacing between the texts, and / or the font (or typeface). For example, if the size of the text displayed on the display (260) is A cm, the electronic device (101) may determine the degree of separation or disparity information from half of A cm to A cm. If the text includes a letter spacing or font that allows part of the text to be recognized even if the degree of separation or disparity information is halved, from 1 / 2 A cm to A cm, the electronic device (101) can adjust the degree of separation or disparity information under the control of the processor (120).

[0191] FIG. 9a is a drawing showing a user registered in the electronic device (101) of the present disclosure looking at a first execution screen (910) displayed in three dimensions.

[0192] FIG. 9b is a drawing showing a user who is not registered in the electronic device (101) of the present disclosure looking at the first execution screen (910) displayed in three dimensions.

[0193] FIG. 9c is a drawing showing a user who is not registered in the electronic device (101) of the present disclosure looking at the first execution screen (910) displayed in three dimensions.

[0194] The application running in FIGS. 9A, 9B, and 9C may be a browser. The first execution screen (910) may be a login interface for an Internet address accessed via the browser. The first execution screen (910) may include a user interface including guidance text (911) such as "Please enter your password," an ID for login (912), a password for login (913), and a virtual keypad (914).

[0195] In one embodiment, the electronic device (101), under the control of the processor (120), can identify whether the first execution screen (910) of the browser, which is a running application, contains personal information requiring security.

[0196] In one embodiment, if the first execution screen (910) includes personal information such as an ID (912) for login or a password (913) for login, the electronic device (101) may, under the control of the processor (120), generate disparity information based on the characteristics of the personal information. The personal information included in the first execution screen (910) may be text.

[0197] In one embodiment, the electronic device (101) may, under the control of the processor (120), display on the display (260) a first execution screen (910) divided into a first image (or first image) displayed on the left eye and a second image (or second image) displayed on the right eye based on disparity information.

[0198] The 901 screen may be a three-dimensional screen viewed by a user registered in the electronic device (101). Since the electronic device (101) tracks the gaze of the registered user and adjusts the first image (or first image) displayed on the left eye and the second image (or second image) displayed on the right eye to display the images, the degree to which the images appear to overlap may be small.

[0199] Screens 903 and 905 may be 3D screens viewed by users who are not registered with the electronic device (101). Unregistered users may have difficulty identifying the content of personal information due to the overlapping of the first image (or first image) displayed on the left eye and the second image (or second image) displayed on the right eye. Screen 903 may be implemented as a 3D screen that retracts inward, while screen 905 may be implemented as a 3D screen that protrudes outward.

[0200] FIG. 10A is a drawing showing a user registered in the electronic device (101) of the present disclosure looking at a second execution screen (1010) displayed in three dimensions.

[0201] FIG. 10b is a drawing showing a user who is not registered in the electronic device (101) of the present disclosure looking at a second execution screen (1010) displayed in three dimensions.

[0202] FIG. 10c is a drawing showing a user who is not registered in the electronic device (101) of the present disclosure looking at the first execution screen (1010) displayed in three dimensions.

[0203] The application running in FIGS. 10A, 10B, and 10C may be a messenger. The second execution screen (1010) may be an interface of the messenger. The second execution screen (1010) may include a user interface including a received message text (1011) such as “Please tell me your ID and password” received from a conversation partner, a transmitted text (1012) such as “Your ID and password,” a virtual keypad (1013), and / or a text (1014) about the conversation partner, such as “Wife.”

[0204] In one embodiment, the electronic device (101), under the control of the processor (120), can identify whether the second execution screen (1010) of the messenger, which is a running application, contains personal information requiring security.

[0205] In one embodiment, if the second execution screen (1010) includes personal information such as transmission text (1012), the electronic device (101) may, under the control of the processor (120), generate disparity information based on the characteristics of the personal information. The personal information included in the second execution screen (1010) may be text.

[0206] In one embodiment, the electronic device (101) may, under the control of the processor (120), display a second execution screen (1010) on the display (260) by dividing the first image (or first image) displayed on the left eye and the second image (or second image) displayed on the right eye based on disparity information.

[0207] The 1001 screen may be a three-dimensional screen viewed by a user registered in the electronic device (101). Since the electronic device (101) tracks the gaze of the registered user and adjusts the first image (or first image) displayed on the left eye and the second image (or second image) displayed on the right eye to display the images, the degree to which the images appear to overlap may be small.

[0208] Screens 1003 and 1005 may be 3D screens viewed by users who are not registered with the electronic device (101). For unregistered users, the first image (or first image) displayed on the left eye and the second image (or second image) displayed on the right eye may overlap, making it difficult to identify the content of personal information. Screen 1003 may be implemented as a 3D screen that retracts inward, while screen 1005 may be implemented as a 3D screen that protrudes outward.

[0209] FIG. 11a is a drawing showing a user registered in the electronic device (101) of the present disclosure looking at a third execution screen (1110) displayed in three dimensions.

[0210] FIG. 11b is a drawing showing a user who is not registered in the electronic device (101) of the present disclosure looking at a third execution screen (1110) displayed in three dimensions.

[0211] FIG. 11c is a drawing showing a user who is not registered in the electronic device (101) of the present disclosure looking at a second execution screen (1110) displayed in three dimensions.

[0212] The running application in FIGS. 11A, 11B, and 11C may be a memo application. The third execution screen (1110) may be an interface of the memo application. The third execution screen (1110) may include personal information, such as memo content (1111), as a user interface. For example, the memo content (1111) may include information about areas to be modified or added when the memo writer prepares to draw while performing a task, such as drawing a picture, such as "prepare project list," "tree: it does not match with size of shadow," and "watch."

[0213] In one embodiment, the electronic device (101), under the control of the processor (120), can identify whether the third execution screen (1110) of the memo application, which is a running application, contains personal information requiring security.

[0214] In one embodiment, if the third execution screen (1110) includes personal information such as memo content (1111), the electronic device (101) may, under the control of the processor (120), generate disparity information based on the characteristics of the personal information. The personal information included in the third execution screen (1110) may be text.

[0215] In one embodiment, the electronic device (101) may, under the control of the processor (120), display a third execution screen (1110) on the display (260) by dividing the third image (or first image) displayed on the left eye and the second image (or second image) displayed on the right eye based on disparity information.

[0216] The 1101 screen may be a three-dimensional screen viewed by a user registered in the electronic device (101). Since the electronic device (101) tracks the gaze of the registered user and adjusts the first image (or first image) displayed on the left eye and the second image (or second image) displayed on the right eye to display the images, the degree to which the images appear to overlap may be small.

[0217] Screens 1103 and 1105 may be 3D screens viewed by users who are not registered with the electronic device (101). For unregistered users, the first image (or first image) displayed on the left eye and the second image (or second image) displayed on the right eye may overlap, making it difficult to identify the content of personal information. Screen 1103 may be implemented as a 3D screen that retracts inward, while screen 1105 may be implemented as a 3D screen that protrudes outward.

[0218] FIG. 12a is a drawing showing a user registered in the electronic device (101) of the present disclosure looking at a fourth execution screen (1210) displayed in three dimensions.

[0219] FIG. 12b is a drawing showing a user who is not registered in the electronic device (101) of the present disclosure looking at the fourth execution screen (1210) displayed in three dimensions.

[0220] FIG. 12c is a drawing showing a user who is not registered in the electronic device (101) of the present disclosure looking at the fourth execution screen (1210) displayed in three dimensions.

[0221] The running application in FIGS. 12A, 12B, and 12C may be a scheduler or calendar. The fourth execution screen (1210) may be a scheduler or calendar interface. The fourth execution screen (1210) may include personal information, such as schedule reservations (1211), as a user interface.

[0222] In one embodiment, the electronic device (101), under the control of the processor (120), can identify whether a fourth execution screen (1210) of a running application, such as a scheduler or calendar, contains personal information requiring security.

[0223] In one embodiment, if the fourth execution screen (1210) includes personal information such as a schedule reservation (1211), the electronic device (101) may, under the control of the processor (120), generate disparity information based on the characteristics of the personal information. The personal information included in the fourth execution screen (1210) may be text.

[0224] In one embodiment, the electronic device (101) may, under the control of the processor (120), display on the display (260) a fourth execution screen (1210) divided into a first image (or first image) displayed on the left eye and a second image (or second image) displayed on the right eye based on disparity information.

[0225] The 1201 screen may be a three-dimensional screen viewed by a user registered in the electronic device (101). Since the electronic device (101) tracks the gaze of the registered user and adjusts the first image (or first image) displayed on the left eye and the second image (or second image) displayed on the right eye to display the images, the degree to which the images appear to overlap may be small.

[0226] Screens 1203 and 1205 may be 3D screens viewed by users who are not registered with the electronic device (101). For unregistered users, the first image (or first image) displayed on the left eye and the second image (or second image) displayed on the right eye may overlap, making it difficult to identify the content of personal information. Screen 1203 may be implemented as a 3D screen that retracts inward, while screen 1205 may be implemented as a 3D screen that protrudes outward.

[0227] FIG. 13 is a drawing showing a user registered in the electronic device (101) of the present disclosure looking at the fifth execution screen (1310) displayed in three dimensions.

[0228] The application running in FIG. 13 may be an image viewer or gallery. The fifth execution screen (1310) may include personal information, such as a first photo (1311). The first photo (1311) may be, for example, a photo related to an OTP (one-time password).

[0229] In one embodiment, the electronic device (101), under the control of the processor (120), can identify whether the fifth execution screen (1310) of the running application, such as an image viewer or gallery, contains personal information requiring security.

[0230] In one embodiment, if the fifth execution screen (1310) includes personal information such as the first photo (1311), the electronic device (101) may, under the control of the processor (120), generate disparity information and / or pattern information based on the characteristics of the personal information. The personal information included in the fifth execution screen (1310) may be an image.

[0231] Referring to screen 1301, the electronic device (101) can, under the control of the processor (120), display a fifth execution screen (1310) on the display (260) by dividing the first image (or first image) displayed on the left eye and the second image (or second image) displayed on the right eye based on disparity information, while simultaneously displaying a sprite pattern (1312).

[0232] FIG. 14a is a drawing showing a user registered in the electronic device (101) of the present disclosure looking at the sixth execution screen (1410) displayed in three dimensions.

[0233] FIG. 14b is a drawing showing a user registered in the electronic device (101) of the present disclosure looking at the sixth execution screen (1410) displayed in three dimensions.

[0234] In FIG. 14A, the running application may be an image viewer or gallery. The sixth running screen (1410) may include personal information, such as a second photo (1411). The second photo (1411) may be a photo containing text, such as a memo, for example.

[0235] In one embodiment, the electronic device (101), under the control of the processor (120), can identify whether the sixth execution screen (1410) of the running application, such as an image viewer or gallery, contains personal information requiring security.

[0236] In one embodiment, if the sixth execution screen (1410) includes personal information such as a second photo (1411), the electronic device (101) may, under the control of the processor (120), generate disparity information and / or pattern information based on the characteristics of the personal information. The personal information included in the sixth execution screen (1410) may be an image.

[0237] Referring to screen 1401, the electronic device (101) can, under the control of the processor (120), display a sixth execution screen (1410) on the display (260) by dividing the first image (or first image) displayed on the left eye and the second image (or second image) displayed on the right eye based on disparity information, while simultaneously displaying a sprite pattern (1412).

[0238] In one embodiment, if the sixth execution screen (1410) includes personal information such as a second photo (1411), the electronic device (101) may, under the control of the processor (120), generate disparity information and / or contrast information based on the characteristics of the personal information. The personal information included in the sixth execution screen (1410) may be an image.

[0239] Referring to screen 1403, the electronic device (101) can, under the control of the processor (120), display the sixth execution screen (1410) on the display (260) by dividing it into a first image (or first image) displayed on the left eye and a second image (or second image) displayed on the right eye based on disparity information, while simultaneously displaying a contrast effect (1413).

[0240] In one embodiment, the electronic device (101) includes a display (260) for displaying a three-dimensional screen, a camera (e.g., a first camera (281) or a visual tracking sensor (282)), a memory (130) for storing instructions; and at least one processor (120), the instructions, when executed by the at least one processor (120), cause the electronic device (101) to respond to an application running on the display (260), identify whether a first screen having a two-dimensional image contains personal information requiring security, and if so, generate disparity information based on characteristics of the personal information, and control the display (260) to display at least a portion of the first screen as a second screen having parallax for the left and right eyes based on the disparity information.

[0241] In one embodiment, the second screen may be displayed in response to the gaze of a subject whose eyes are tracked by a camera (e.g., a first camera (281) or a visual tracking sensor (282)).

[0242] In one embodiment, the instructions, when executed by at least one processor (120), may cause the electronic device (101) to control the display (260) to display the entire first screen as a second screen having a parallax difference between the left and right eyes.

[0243] In one embodiment, the instructions, when executed by at least one processor (120), may cause the electronic device (101) to control the display (260) to display an area corresponding to the first information on the first screen on a second screen having a parallax difference between the left and right eyes.

[0244] In one embodiment, the instructions, when executed by at least one processor (120), may cause the electronic device (101) to generate at least one of pattern information or contrast information, if personal information is included, and control the display (260) to display the second screen based on at least one of the disparity information, the pattern information, and the contrast information.

[0245] In one embodiment, the instructions, when executed by at least one processor (120), may cause the electronic device (101) to register a user captured using a camera (e.g., a first camera (281) or a visual tracking sensor (282)), and to control the display (260) to display a second screen if detection of the user fails, an unregistered user is detected, or multiple users are detected through the camera (e.g., the first camera (281) or the visual tracking sensor (282)).

[0246] In one embodiment, the instructions, when executed by at least one processor (120), may cause the electronic device (101) to determine whether the first screen contains personal information requiring security when a secure mode is set.

[0247] In one embodiment, the security mode can be set through at least one of the settings application or the control panel.

[0248] In one embodiment, the characteristics of the personal information may include at least one of the size, kerning, and font of the text, if the personal information includes text.

[0249] In one embodiment, the characteristics of the personal information may include at least one of information regarding the size, shape, or color of an object included in the image, if the personal information includes an image.

[0250] In one embodiment, the instructions, when executed by at least one processor (120), may cause the electronic device (101) to identify disparity information corresponding to characteristics of personal information stored in the memory (130) and to control display of a second screen based on the identified disparity information.

[0251] In one embodiment, a screen display method of an electronic device (101) may include an operation of checking whether a first screen having a two-dimensional image includes personal information requiring security, an operation of generating disparity information based on characteristics of the personal information if the first screen includes personal information, and an operation of controlling the display (260) to display at least a portion of the first screen as a second screen having parallax for the left and right eyes based on the disparity information, corresponding to an application running on a display (260) displaying a three-dimensional screen.

[0252] In one embodiment, a screen display method of an electronic device (101) may include an operation of controlling a display (260) to display the entire first screen as a second screen having a parallax difference between the left and right eyes.

[0253] In one embodiment, a screen display method of an electronic device (101) may include an operation of controlling a display (260) to display an area corresponding to first information on a first screen as a second screen having a parallax difference between the left and right eyes.

[0254] In one embodiment, the screen display method of the electronic device (101) may include an operation of generating at least one of pattern information or contrast information, if personal information is included, and an operation of controlling the display (260) to display a second screen based on at least one of disparity information, pattern information, and contrast information.

[0255] In one embodiment, a screen display method of an electronic device (101) may include an operation of registering a user captured using a camera (e.g., a first camera (281) or a visual tracking sensor (282)), and an operation of controlling the display (260) to display a second screen when detection of a user fails, an unregistered user is detected, or multiple users are detected through the camera (e.g., the first camera (281) or the visual tracking sensor (282)).

[0256] In one embodiment, the screen display method of the electronic device (101) may include an operation of checking whether the first screen contains personal information requiring security when the security mode is set.

[0257] In one embodiment, a screen display method of an electronic device (101) may include an operation of checking disparity information corresponding to a characteristic of personal information stored in a memory (130), and an operation of controlling display of a second screen based on the checked disparity information.

[0258] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0259] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0260] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0261] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0262] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0263] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In electronic devices, A display that displays a three-dimensional image; camera; Memory for storing instructions; and Contains at least one processor, The above instructions, when executed by the at least one processor, cause the electronic device to: Corresponding to the application running on the above display, identify whether the first screen having a two-dimensional image contains personal information requiring security, If the above personal information is included, disparity information is generated based on the characteristics of the above personal information, and An electronic device that controls the display to display at least a portion of the first screen as a second screen having parallax to the left and right eyes based on the disparity information.

2. In paragraph 1, The second screen above is An electronic device that displays information corresponding to the line of sight of a subject whose eyes are tracked by the camera.

3. In paragraph 1, An electronic device wherein the instructions, when executed by the at least one processor, cause the electronic device to control the display to display the entire first screen as a second screen having a parallax difference between the left and right eyes.

4. In paragraph 1, The above instructions, when executed by the at least one processor, cause the electronic device to: An electronic device that controls the display to display an area corresponding to the first information on the first screen as a second screen having a parallax difference between the left and right eyes.

5. In paragraph 1, The above instructions, when executed by the at least one processor, cause the electronic device to: If the above personal information is included, at least one of pattern information or contrast information is generated, An electronic device that controls the display to display a second screen based on at least one of the disparity information, the pattern information, and the contrast information.

6. In paragraph 1, The above instructions, when executed by the at least one processor, cause the electronic device to: Register the user captured using the above camera, An electronic device that controls the display to display the second screen when detection of a user fails, an unregistered user is detected, or multiple users are detected through the camera.

7. In paragraph 1, The above instructions, when executed by the at least one processor, cause the electronic device to: When the security mode is set, it checks whether the first screen contains the personal information that requires security. The above security mode is It is set through at least one of the Settings application or Control Panel, The characteristics of the above personal information are If the above personal information contains text, it includes at least one of the size, letter spacing, and font of the text; An electronic device that includes at least one piece of information regarding the size, shape, or color of an object included in the image, if the above personal information includes an image.

8. In paragraph 1, The above instructions, when executed by the at least one processor, cause the electronic device to: Check the disparity information corresponding to the characteristics of the personal information stored in the above memory, An electronic device that controls display of the second screen based on verified disparity information.

9. In the method of displaying the screen of an electronic device, An action corresponding to an application running on a display displaying a three-dimensional screen, and checking whether the first screen having a two-dimensional image contains personal information requiring security; If the above personal information is included, an operation of generating disparity information based on the characteristics of the above personal information; and A method comprising: controlling the display to display at least a portion of the first screen as a second screen having parallax to the left and right eyes based on the disparity information.

10. In paragraph 9, The second screen above is A method of displaying information corresponding to the line of sight of a subject whose eyes are tracked by a camera.

11. In paragraph 9, A method comprising an action of controlling the display to display the entire first screen as a second screen having a parallax difference between the left and right eyes.

12. In paragraph 9, A method including an action of controlling the display to display an area corresponding to the first information on the first screen as the second screen having a parallax difference between the left eye and the right eye.

13. In paragraph 9, If the above personal information is included, an operation of generating at least one of pattern information or contrast information; and A method comprising an action of controlling the display to display a second screen based on at least one of the disparity information, the pattern information, and the contrast information.

14. In paragraph 9, An action of registering a user photographed using the above camera; and A method comprising an action of controlling the display to display the second screen when detection of a user fails, an unregistered user is detected, or multiple users are detected through the camera.

15. In paragraph 9, When the security mode is set, it includes an action to check whether the first screen contains the personal information that requires security, The above security mode is is set via at least one of the Settings application or Control Panel, The characteristics of the above personal information are If the above personal information contains text, it includes at least one of the size, letter spacing, and font of the text; A method of including at least one of information regarding the size, shape or color of an object included in the image, if the personal information includes an image.

Images