Electronic device, method, and non-transitory storage medium for changing screen displayed on display

Abstract

The present document relates to an electronic device, a method, and a non-transitory storage medium for changing a screen displayed on a display. According to one embodiment, the electronic device may comprise: a display; at least one processor including a processing circuit; and a memory for storing instructions. The instructions, when executed individually or collectively by the at least one processor, may instruct the electronic device to: display, on the display, a screen including a first image indicating first information; on the basis of performing a security function for the screen, identify information related to at least one pixel of an inner part or an outer part with respect to a boundary between an object indicating the first information included in the first image and a background excluding the object; on the basis of the information related to the pixel, obtain a second image in which at least one of the inner part or the outer part is adjusted; obtain a third image in which the background included in the first image is blurred; obtain a fourth image in which the first information is processed so as not to be visually identified at a specified distance or more, by using the second image and the third image; and replace the first image displayed on the screen with the fourth image. Various other embodiments are also possible.

Description

Electronic device, method, and non-temporary storage medium for changing a screen displayed on a display

[0001] The present disclosure relates to an electronic device, a method, and a non-transient storage medium for changing a screen displayed on a display.

[0002] Various services and additional functions provided through electronic devices, such as portable electronic devices like smartphones, are gradually increasing. To enhance the utility value of these devices and satisfy the needs of diverse users, telecommunications service providers or electronic device manufacturers are competitively developing devices to offer various functions and differentiate themselves from competitors. Consequently, the various functions provided through electronic devices are also becoming increasingly sophisticated.

[0003] An electronic device may display a screen containing personal information or sensitive information. For example, the electronic device may display private personal information, financial transaction information, or information subject to confidentiality obligations. In this case, to prevent others from viewing the said personal information or sensitive information, the electronic device may modify the personal information or sensitive information included on the screen so that only the user can identify it.

[0004] The information described above may be provided as related art for the purpose of aiding understanding of the present disclosure. No claim or determination is made as to whether any of the foregoing may be applied as prior art related to the present disclosure.

[0005] According to one embodiment, the electronic device may include a display, at least one processor including a processing circuit, and a memory for storing instructions.

[0006] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the display to display a screen including a first image representing first information.

[0007] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to check information related to at least one pixel of an inner part or an outer part based on the boundary between an object representing the first information included in the first image and a background excluding the object, based on performing a security function for the screen.

[0008] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to acquire a second image in which at least one of the inner part or the outer part is adjusted based on information related to the pixel.

[0009] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the background included in the first image to be blurred in a third image.

[0010] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to acquire a fourth image using the second image and the third image. According to one embodiment, the fourth image may be processed so that the first information is not visually identifiable beyond a specified distance.

[0011] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the first image displayed on the screen to be replaced with the fourth image.

[0012] According to one embodiment, a method of operation in an electronic device may include an operation of displaying a screen including a first image representing first information on a display of the electronic device.

[0013] According to one embodiment, the method may include an operation of checking information related to at least one pixel of an inner part or an outer part based on the boundary between an object representing the first information included in the first image and a background excluding the object, based on performing a security function for the screen.

[0014] According to one embodiment, the method may include the operation of obtaining a second image in which at least one of the inner part or the outer part is adjusted based on information related to the pixel.

[0015] According to one embodiment, the method may include the operation of obtaining a third image in which the background included in the first image is blurred.

[0016] According to one embodiment, the method may include the operation of acquiring a fourth image using the second image and the third image. According to one embodiment, the fourth image may be processed so that the first information is not visually identifiable from a distance greater than a specified distance.

[0017] According to one embodiment, the method may include the operation of replacing the first image displayed on the screen with the fourth image.

[0018] According to one embodiment, in a non-transient storage medium storing one or more programs, the one or more programs may include instructions that, when executed by at least one processor of an electronic device, cause the electronic device to perform an operation of displaying a screen including a first image representing first information on a display of the electronic device.

[0019] According to one embodiment, the one or more programs may include instructions that, when executed by at least one processor of an electronic device, cause the electronic device to perform an operation of checking information related to at least one pixel of an inner part or an outer part based on the boundary between an object representing the first information included in the first image and a background excluding the object, based on performing a security function for the screen.

[0020] According to one embodiment, the one or more programs may include instructions that, when executed by at least one processor of an electronic device, cause the electronic device to execute an operation to acquire a second image in which at least one of the inner part or the outer part is adjusted based on information related to the pixel.

[0021] According to one embodiment, the one or more programs may include instructions that, when executed by at least one processor of an electronic device, cause the electronic device to execute an operation of acquiring a third image in which the background included in the first image is blurred.

[0022] According to one embodiment, the one or more programs may include instructions that, when executed by at least one processor of the electronic device, cause the electronic device to execute an operation of acquiring a fourth image using the second image and the third image. According to one embodiment, the fourth image may be processed so that the first information is not visually identifiable from a distance greater than a specified distance.

[0023] According to one embodiment, the one or more programs may include instructions that cause the electronic device to perform an operation of replacing the first image displayed on the screen with the fourth image when executed by at least one processor of the electronic device.

[0024] FIG. 1 is a schematic diagram of an electronic system according to one embodiment.

[0025] FIG. 2 is a schematic block diagram of an electronic device according to one embodiment.

[0026] FIG. 3 is a diagram illustrating an example of modifying information included on a screen in an electronic device according to one embodiment.

[0027] FIG. 4 is a diagram illustrating an example of modifying information included on a screen in an electronic device according to one embodiment.

[0028] FIG. 5 is a diagram illustrating a method of operation in an electronic device according to one embodiment.

[0029] FIG. 6 is a diagram showing an example of a method of operation in an electronic device according to one embodiment.

[0030] FIG. 7 is a diagram illustrating an example of adjusting the security distance in an electronic device according to one embodiment.

[0031] FIG. 8 is a drawing showing an example of an image processed so that it is not visible to the naked eye from a specified distance or greater in an electronic device according to one embodiment.

[0032] FIG. 9 is a drawing showing an example of an image processed so that it is not visible to the naked eye from a specified distance or greater in an electronic device according to one embodiment.

[0033] FIG. 10 is a drawing showing an example of an image processed so that it is not visible to the naked eye from a specified distance or greater in an electronic device according to one embodiment.

[0034] In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components.

[0035] Hereinafter, embodiments of the present disclosure are described in detail with reference to the drawings so that those skilled in the art can easily implement them. However, the present disclosure may be embodied in various different forms and is not limited to the embodiments described herein. In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Furthermore, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and brevity. The term "user" as used in the embodiments of the present disclosure may refer to a person using an electronic device or a device using an electronic device (e.g., an artificial intelligence electronic device).

[0036] FIG. 1 is a block diagram of an electronic device (101) in a network environment (100) according to various embodiments.

[0037] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or with at least one of an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) through a server (108). According to one embodiment, the electronic device (101) may include a processor (120), memory (130), input module (150), sound output module (155), display module (160), audio module (170), sensor module (176), interface (177), connection terminal (178), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some embodiments, at least one of these components (e.g., connection terminal (178)) may be omitted from the electronic device (101), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (176), camera module (180), or antenna module (197)) may be integrated into a single component (e.g., display module (160)).

[0038] The processor (120) can control at least one other component (e.g., hardware or software component) of the electronic device (101) connected to the processor (120) by executing software (e.g., program (140)), for example, and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can store commands or data received from other components (e.g., sensor module (176) or communication module (190)) in volatile memory (132), process the commands or data stored in volatile memory (132), and store the resulting data in non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., central processing unit or application processor) or an auxiliary processor (123) that can operate independently or together with it (e.g., graphics processing unit, neural processing unit (NPU), image signal processor, sensor hub processor, or communication processor). For example, if the electronic device (101) includes a main processor (121) and an auxiliary processor (123), the auxiliary processor (123) may be configured to use lower power than the main processor (121) or to be specialized for a designated function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as part thereof.

[0039] The auxiliary processor (123) may control at least some of the functions or states associated with at least one component of the electronic device (101) (e.g., display module (160), sensor module (176), or communication module (190)) on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (123) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (180) or communication module (190)). According to one embodiment, the auxiliary processor (123) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.

[0040] The memory (130) can store various data used by at least one component of the electronic device (101) (e.g., processor (120) or sensor module (176)). The data may include, for example, input data or output data for software (e.g., program (140)) and related commands. The memory (130) may include volatile memory (132) or non-volatile memory (134).

[0041] The program (140) may be stored as software in memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0042] The input module (150) can receive commands or data to be used for a component of the electronic device (101) (e.g., processor (120)) from outside the electronic device (101) (e.g., user). The input module (150) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0043] The sound output module (155) can output a sound signal to the outside of the electronic device (101). The sound output module (155) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.

[0044] The display module (160) can visually provide information to an external (e.g., user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.

[0045] The audio module (170) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150) or output sound through the sound output module (155) or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (101).

[0046] The sensor module (176) can detect the operating state of the electronic device (101) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0047] The interface (177) may support one or more specified protocols that can be used for the electronic device (101) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (102)). According to one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0048] The connection terminal (178) may include a connector through which the electronic device (101) can be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0049] The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module (179) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.

[0050] The camera module (180) can capture still images and video. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0051] The power management module (188) can manage the power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).

[0052] The battery (189) can supply power to at least one component of the electronic device (101). According to one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0053] The communication module (190) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may include one or more communication processors that operate independently of the processor (120) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (104) through a first network (198) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can identify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (196).

[0054] The wireless communication module (192) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (192) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (192) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), external electronic device (e.g., electronic device (104)), or network system (e.g., second network (199)). According to one embodiment, the wireless communication module (192) can support a Peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 164 dB or less) for realizing mMTC, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for realizing URLLC.

[0055] An antenna module (197) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (198) or a second network (199), may be selected from the plurality of antennas, for example, by a communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (197).

[0056] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.

[0057] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.

[0058] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) through a server (108) connected to a second network (199). Each of the external electronic devices (102, or 104) may be the same or different type of device as the electronic device (101). According to one embodiment, all or part of the operations performed on the electronic device (101) may be performed on one or more of the external electronic devices (102, 104, or 108). For example, if the electronic device (101) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (101) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (101) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or neural networks. According to one embodiment, the external electronic device (104) or the server (108) may be included within a second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0059] The number of processors (120) may be one or more. For example, the processor (120) may have the structure of a multi-core processor such as a dual core, a quad core, or a hexa core.

[0060] The processor (120) can control the operations of the electronic device (101) by executing instructions stored in memory (130). For example, the processor (120) may correspond to a plurality of processors that divide and collectively perform a plurality of operations among the processors.

[0061] FIG. 2 is a diagram showing the configuration of an electronic device according to one embodiment.

[0062] Referring to FIG. 2, an electronic device (101) according to one embodiment (e.g., the electronic device (101) of FIG. 1) may include a processor (210), a memory (220), and a display (230). The electronic device (201) is not limited thereto and may be configured to include various other components or to exclude some of the components.

[0063] According to one embodiment, a processor (210) (e.g., processor (120) of FIG. 1) may display a screen for various functions (e.g., applications) running on an electronic device (201) on a display (230) (e.g., display (160) of FIG. 1). For example, the screen may include an application execution screen, a home screen, a lock screen, or a pop-up window.

[0064] According to one embodiment, the processor (210) may display on the display (230) a screen containing an original image (orglmg) (e.g., the first image) representing the first information. For example, the first information may include letters, numbers, symbols and / or images contained within the screen. The first information may be sensitive information, such as private personal information, financial transaction information, information subject to confidentiality obligations, and / or information that only the user is allowed to view.

[0065] According to one embodiment, the processor (210) can perform a security function to modify the information included on the screen so that the first information included on the screen is not visible to others located near the electronic device, and only the user can see the screen displayed in real time with the naked eye. According to one embodiment, the processor (210) can display an object capable of user interaction on the screen to execute the security function. According to one embodiment, the processor (210) can display a setting screen (e.g., an editing screen) on the display (230) to set information (e.g., information related to pixels) necessary for performing the security function.

[0066] According to one embodiment, the processor (210) can perform a security function to perform an operation to modify the first information so that only the user can visually view the first information on the screen.

[0067] According to one embodiment, the processor (210) can acquire a modified image containing modified first information and display a screen on the display (230) in which the original image has been replaced with the modified image.

[0068] According to one embodiment, the processor (210) may be a hardware module or a software module (e.g., an application program) and may be a hardware component (function) or a software element (program) comprising at least one of various sensors provided in the electronic device (201), an input / output interface, a module for managing the state or environment of the electronic device (201), or a communication module.

[0069] According to one embodiment, the processor (210) may include, for example, one or more combinations of hardware, software, or firmware. The processor (210) may be configured to omit at least some of the components or to include additional components for performing image processing operations in addition to the components.

[0070] According to one embodiment, the memory (220) (e.g., the memory (130) of FIG. 1) may store information and / or data associated with the operation of the electronic device (201). According to one embodiment, the memory (220) may store at least one instruction (or command) that causes at least one operation of the electronic device (201). When executed by the processor (210), the at least one instruction may cause the electronic device (201) to perform the corresponding operation.

[0071] According to one embodiment, the memory (220) can store various data generated during program execution, including a program used for functional operation (e.g., the program (140) of FIG. 1). The memory (240) may largely include a program area (e.g., the program (140) of FIG. 1) and a data area (not shown). The program area (140) may store related program information for operating the electronic device (201), such as an operating system (OS) (e.g., the operating system (142) of FIG. 1) that boots the electronic device (201). The data area (not shown) may store transmitted and / or received data and generated data according to one embodiment. Additionally, the memory (220) may be configured to include at least one storage medium among flash memory, hard disk, multimedia card micro type memory (e.g., secure digital (SD) or extreme digital (XD) memory), RAM, and ROM. According to one embodiment, the memory (220) may store information related to a screen displayed on a display and information related to pixels used to modify the screen (e.g., modulation parameters). In addition, the memory (220) may store information necessary to modify the screen.

[0072] According to one embodiment, the display (230) may display a screen related to a function executed in the electronic device (201). According to one embodiment, the display (230) may display a setting screen (e.g., an editing screen) for screen modification. According to one embodiment, the display (240) may be implemented in the form of a touch screen. When the display (240) is implemented in the form of a touch screen together with an input module, it may display various information generated according to the user's touch actions. According to one embodiment, the display (240) may be composed of at least one of an LCD (liquid crystal display), TFT-LCD (thin film transistor LCD), OLED (organic light emitting diodes), LED, AMOLED (active matrix organic LED), micro LED, mini LED, flexible display, and 3-dimensional display. Additionally, some of these displays may be configured to be transparent or light-transmitting so that the outside can be seen through them. This can be configured in the form of a transparent display including a TOLED (transparent OLED). According to one embodiment, in addition to the display (230), it may further include other display modules mounted thereon (e.g., an extended display or a flexible display).

[0073] FIG. 3 is a diagram illustrating an example of modifying information included on a screen in an electronic device according to one embodiment, and FIG. 4 is a diagram illustrating an example of modifying information included on a screen in an electronic device according to one embodiment. Here, when describing FIG. 3 and FIG. 4, the configurations of the electronic device (201) will be described with reference to FIG. 2.

[0074] Referring to FIGS. 3 and 4, a processor (210) of an electronic device (201) according to one embodiment may display on a display (230) a screen containing a first image (310) (e.g., original image (orglmg)) representing first information (311) (e.g., letters, numbers, symbols or images).

[0075] A processor (210) according to one embodiment can identify information (e.g., modulation parameters) related to at least one pixel of an inner part (413) (e.g., inline) or an outer part (415) (e.g., outline) based on the boundary (411) (e.g., edge) between an object (401) (e.g., a character) representing first information included in a first image (310) (e.g., original image) and a background excluding the object. Information related to pixels is information for modifying pixels corresponding to an object (401), and may include a first modulation value (e.g., edge sigma) for adjusting the thickness of at least one of the inner part (413) or the outer part (415), an amplification ratio for adjusting the contrast of at least one of the colors of the inner part (413) or the outer part (415), a threshold value (e.g., a threshold indicating a minimum pixel difference) for adjusting the softness of at least one of the colors of the inner part (413) or the outer part (415), and a second modulation value (e.g., blur sigma) for adjusting the image quality (e.g., sharpness) of the background. Here, the first modulation value may be a modulation value of a low-frequency filter or a high-frequency filter using a low-frequency filter, and the larger the value, the thicker the thickness of at least one of the inner part (413) or the outer part (415). The second modulation value may be a modulation value of a low-frequency filter, and the larger the value, the blurrier the background becomes. As the amplification ratio increases, the difference between the boundary (411) and the background can increase. As the threshold value increases, the detected boundary can decrease.

[0076] A processor (210) according to one embodiment can identify (e.g., detect or calculate) a first value (extractedLines) representing the thickness of at least one of an inner part (413) (e.g., inline) or an outer part (415) (e.g., outline) through <Equation 1>. In the following <Equation 1>, orgImg represents the original image, and LPF(orgImg, egdg_simga) may represent parameters of a low-pass filter based on the original image and the first modulation value.

[0077] [Mathematical Formula 1]

[0078] extractedLines = orgImg - LPF(orgImg, egdg_simga)

[0079] A processor (210) according to one embodiment may obtain a second image (320) in which at least one of an inner part (413) (e.g., inline) or an outer part (415) (e.g., outline) of an object (401) is adjusted through a high-frequency filter configured using at least one high-frequency filter or at least one low-frequency filter based on information related to pixels. The high-frequency filter may include an indirect method using a low-frequency filter (high-frequency image = original image - low-frequency filter image) and / or a direct method (e.g., a Laplacian filter or a Sobel / Prewitt filter). For example, parameters for adjusting the filter may be sigma used in a Gaussian filter and a kernel size (3x3, 5x5) used in at least one of a Laplacian or Sobel filter.

[0080] A processor (210) according to one embodiment can increase the first value to a specified amplification ratio based on identifying that the first value exceeds a threshold value.

[0081] A processor (210) according to one embodiment can reduce the first value by a specified ratio (e.g., 1 / 2 times) based on identifying that the absolute value of the first value is below a threshold value.

[0082] A processor (210) according to one embodiment can obtain a third image (330) (e.g., blurImg = LPF(orgImg, blur_sigma)) in which the background included in the first image (e.g., orgImg) is blurred based on a second modulation value through a low-frequency filter.

[0083] A processor (210) according to one embodiment can use the second image (320) and the third image (330) to obtain a fourth image (340) (e.g., a hybrid image) in which the first information is processed so that it is not visually identifiable from a distance greater than a specified distance.

[0084] A processor (210) according to one embodiment may set a different modulation method based on user information (e.g., age group or vision information), content type, or user selection.

[0085] A processor (210) according to one embodiment can obtain a fourth image (340-1) through a first method of subtracting a second image from a third image, for example, when the user is a person with average vision between the ages of 20 and 40. In the fourth image (340-1) obtained through the first method, at least one of the colors of the inner part (413) or the outer part (415) may be inverted.

[0086] A processor (210) according to one embodiment can, for example, acquire a fourth image (340-2) through a second method by adding a second image to a third image when the user is a person with presbyopia of age or older. In the fourth image (340-2) acquired through the second method, the colors of the inner part (413) and the outer part (415) are not inverted, and an effect can be applied to make the object corresponding to the first information appear thin.

[0087] A processor (210) according to one embodiment can replace the first image (310) displayed on the screen with a fourth image (340: 340-1 or 340-2) and display it on the display (230).

[0088] According to one embodiment, the processor (210) may pre-set a security distance to perform a screen transformation operation. The processor (210) may set the security distance to a specified reference distance value (e.g., 80 cm) and automatically transform the screen based on the set security distance. Before performing the screen transformation, the processor (210) may transform the screen based on the security distance selected in the settings screen through user interaction. The security distance may be pre-set according to user information (e.g., age, vision and / or medical history information), content information (e.g., type of content such as a browser, social media app, or messenger), or information related to the first information within the screen (e.g., font and background color).

[0089] According to one embodiment, the processor (210) can set a selected distance as a security distance among the distances provided through an object for adjusting the security distance (e.g., a first object) included in the setting screen. Based on identifying user input for adjusting the security distance, the processor (210) identifies the security distance set as the distance selected by the user, checks information (e.g., modulation parameters) related to a pixel designated in correspondence with the identified security distance and the selected security distance, and uses the information related to the identified pixel to modify the screen (703) so that the first information within the screen (703) is not visually recognized at the selected security distance.

[0090] According to one embodiment, the processor (210) can adjust the security distance to a distance desired by the user, such as a close distance or a far distance, based on a reference distance (e.g., 80 cm) included in a first object for adjusting the security distance on a setting screen through user interaction. According to one embodiment, the processor (210) can set the first modulation value (e.g., edge sigma) to increase (e.g., increase the thickness of the inner or outer part), the second modulation value to decrease (e.g., decrease the blurring of the background), the amplification ratio to increase (e.g., increase the contrast value), and the threshold value to decrease (e.g., increase the detected boundary value) based on identifying that a far distance has been selected based on the reference distance. According to one embodiment, the processor (210) can be configured to decrease a first modulation value (e.g., edge sigma) (e.g., decrease the thickness of the inner or outer part) and increase a second modulation value (e.g., increase the blurring of the background), decrease the amplification ratio (e.g., decrease the contrast value), and increase a threshold value (e.g., decrease the detected boundary value) based on identifying that a short distance is selected based on a reference distance.

[0091] An electronic device according to one embodiment (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2) may implement a related software module (e.g., the program (140) of FIG. 1) for changing a screen displayed on a display. The memory of the electronic device (e.g., the memory (130) of FIG. 1 and / or the memory (420) of FIG. 4) may store instructions (e.g., instructions) to implement the software module. At least one processor (e.g., processor (120) of FIG. 1 and / or processor (210) of FIG. 2) can execute instructions stored in memory to implement a software module and can control hardware associated with the function of the software module (e.g., sensor module (176) of FIG. 1, camera module (180), communication module (190) of FIG. 1 and / or communication circuit (250) of FIG. 2, display module (160) of FIG. 1 and / or display (230) of FIG. 2).

[0092] A software module of an electronic device (101, 201) according to one embodiment may be configured to include a kernel (or a hardware abstraction layer (HAL)), a framework (e.g., middleware (144) of FIG. 1), and an application (e.g., application (146) of FIG. 1). At least some of the software modules may be preloaded onto the electronic device (101, 201) or downloadable from a server (e.g., server (108)).

[0093] According to one embodiment, the kernel may include, for example, a system resource manager or a device driver, but may be configured to include other modules, not limited thereto. The system resource manager may perform control, allocation, or reclamation of system resources. The device driver may include, for example, a display driver, a camera driver, a Bluetooth driver, a shared memory driver, a USB driver, a keypad driver, a WIFI driver, an audio driver, or an IPC (inter-process communication) driver.

[0094] According to one embodiment, the framework may provide functions commonly required by the application, or provide various functions to the application through an application programming interface (API) (not shown) so that the application can efficiently use limited system resources within the electronic device (101, 201). The framework may include modules that form combinations of various functions of the components. The framework may provide modules specialized for each type of operating system to provide differentiated functions. The framework may dynamically delete some existing components or add new components. According to one embodiment, the application may include an application received from an external electronic device (e.g., a server (108) or an electronic device (102, 104)). According to one embodiment, the application may include a preloaded application or a third-party application downloadable from the server. The components of the software module and the names of the components according to the illustrated embodiment may vary depending on the type of operating system. According to one embodiment, at least a portion of the software module may be implemented in software, firmware, hardware, or a combination of at least two of these. At least a portion of the software module may be implemented (e.g., executed) by a processor (e.g., an application processor (AP)). At least a portion of the software module may include, for example, a module, a program, a routine, a set of instructions, or a process for performing at least one function.

[0095] According to one embodiment, the application may be configured to include an application (e.g., a module, a manager, or a program) for changing the screen displayed on the display. The application may include an application received from an external electronic device (e.g., a server (108) or an electronic device (102, 104)). According to one embodiment, the application may include a preloaded application or a third-party application downloadable from the server. The components of the software module and the names of the components according to the illustrated embodiments may vary depending on the type of operating system. According to one embodiment, at least a portion of the software module may be implemented as software, firmware, hardware, or a combination of at least two of these. At least a portion of the software module may be implemented (e.g., executed) by a processor (e.g., AP). At least a portion of the software module may include, for example, a module, a program, a routine, a set of instructions, or a process for performing at least one function.

[0096] As such, in one embodiment, the main components of an electronic device have been described through the electronic device (101, 201) of FIGS. 1 and 2. However, in various embodiments, the components illustrated in FIGS. 1 and 2 are not all essential components, and the electronic device (101, 201) may be implemented with more components than those illustrated, or with fewer components. Additionally, the positions of the main components of the electronic device (101, 201) described above through FIGS. 1 and 2 may be changed according to various embodiments.

[0097] According to one embodiment, an electronic device (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2) may include a display (e.g., the display (160) of FIG. 1 and / or the display (230) of FIG. 2), at least one processor including a processing circuit (e.g., the processor (120) of FIG. 1 and / or the processor (210) of FIG. 2), and a memory for storing instructions (e.g., the memory (130) of FIG. 1 and / or the memory (220) of FIG. 2).

[0098] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the display to display a screen including a first image representing first information.

[0099] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to check information related to at least one pixel of an inner part or an outer part based on the boundary between an object representing the first information included in the first image and a background excluding the object, based on performing a security function for the screen.

[0100] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to acquire a second image in which at least one of the inner part or the outer part is adjusted based on information related to the pixel.

[0101] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the background included in the first image to be blurred in a third image.

[0102] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to acquire a fourth image using the second image and the third image. According to one embodiment, the fourth image may be processed so that the first information is not visually identifiable beyond a specified distance.

[0103] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the first image displayed on the screen to be replaced with the fourth image.

[0104] According to one embodiment, information related to the pixel may include a first modulation value for adjusting the thickness of at least one of the inner part or the outer part, an amplification ratio for adjusting the contrast of at least one of the colors of the inner part or the outer part, a threshold value for adjusting the softness of at least one of the colors of the inner part or the outer part, and a second modulation value for adjusting the image quality of the background.

[0105] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to acquire a first value by detecting the thickness of at least one of the inner part or the outer part through a high-frequency filter configured using at least one low-frequency filter, acquire the second image by increasing the first value by the amplification ratio based on identifying that the first value exceeds the threshold value, and acquire the second image by decreasing the first value by a specified ratio based on identifying that the absolute value of the first value is less than or equal to the threshold value.

[0106] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to acquire the third image based on the at least one second modulation value using the at least one low-frequency filter.

[0107] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to subtract the second image from the third image to generate the fourth image with color inversion applied around the boundary.

[0108] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to generate the fourth image by adding the second image to the third image, with the effect of making the object appear thinner applied without color inversion.

[0109] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to control the display to display a setting screen for adjusting the security distance so that the information is not visually identifiable at a distance greater than the specified distance based on user information and content information and a specified reference distance value.

[0110] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to set information related to the pixel to increase the first modulation value, decrease the second modulation value, increase the amplification ratio, and decrease the threshold value based on identifying that the security distance has been adjusted to a distance value exceeding the reference distance value.

[0111] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the first modulation value to decrease, the second modulation value to increase, the amplification ratio to decrease, and the threshold value to increase, based on identifying that the security distance has been adjusted to a distance value less than the reference distance value.

[0112] FIG. 5 is a diagram illustrating an example of a method of operation in an electronic device according to one embodiment, and FIG. 6 is a diagram illustrating an example of a method of operation in an electronic device according to one embodiment. In the following embodiments, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, and at least two operations may be performed in parallel.

[0113] Referring to FIGS. 5 and 6, in operation 501, an electronic device according to one embodiment (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2) may display a screen containing a first image (e.g., the first image (310) of FIG. 3 or the original image) representing first information on a display (e.g., the display module (160) of FIG. 1 and / or the display (230) of FIG. 2). For example, the screen may include an application execution screen, a home screen, a lock screen, or a pop-up window. The first information may be sensitive information, such as private personal information, financial transaction information, information subject to confidentiality obligations, and / or information that only the user wants to view.

[0114] In operation 503, according to one embodiment, the electronic device can identify information related to at least one pixel in an inner part or an outer part based on the boundary between an object representing first information included in a first image and a background excluding the object, based on performing a security function for the screen. According to one embodiment, the electronic device can identify information (e.g., modulation parameters) related to at least one pixel in an inner part (e.g., inner part (413) of FIG. 4) or an outer part (e.g., outer part (415) of FIG. 4) based on the boundary between an object (401) representing first information included in a first image (e.g., object (401) of FIG. 4) and a background excluding the object (401) (e.g., boundary (411) of FIG. 4). The information related to the pixels is information for modifying pixels corresponding to an object, and may include a first modulation value (e.g., edge sigma) for adjusting the thickness of at least one of the inner or outer parts, an amplification ratio for adjusting the contrast of at least one of the colors of the inner or outer parts, a threshold value for adjusting the softness of at least one of the colors of the inner or outer parts, and a second modulation value (e.g., blur sigma) for adjusting the image quality (e.g., sharpness) of the background. Here, the first modulation value may be a modulation value of a low-frequency filter or a high-frequency filter using a low-frequency filter, and the larger the value, the thicker the thickness of at least one of the inner part (413) or the outer part (415). The second modulation value may be a modulation value of a low-frequency filter, and the larger the value, the blurrier the background may become. The larger the amplification ratio, the greater the difference between the boundary (411) and the background may become. The larger the threshold value, the smaller the detected boundary may become.

[0115] In operation 505, according to one embodiment, the electronic device may acquire a second image (e.g., the second image (320) of FIG. 3) that adjusts at least one of the inner part or outer part of an object (401) based on information related to a specified pixel. According to one embodiment, the electronic device may identify (e.g., detect) the thickness (e.g., first value) of at least one of the inner part or outer part of an object corresponding to the first information through a high-frequency filter configured using at least one low-frequency filter based on a first modulation value. According to one embodiment, the electronic device may increase the first value by a specified amplification ratio based on identifying that the first value exceeds the threshold value by comparing the identified thickness with a threshold value. According to one embodiment, the electronic device may decrease the first value by a specified ratio (e.g., 1 / 2 times) based on identifying that the absolute value of the first value is less than or equal to the threshold value. According to one embodiment, the electronic device can acquire a second image adjusted by reflecting at least one of the deformed inner part or the deformed outer part.

[0116] In operation 507, according to one embodiment, the electronic device can obtain a third image (e.g., the third image (330) of FIG. 3) in which the background included in the first image is blurred. According to one embodiment, the electronic device can obtain a third image (e.g., blurImg = LPF(orgImg, blur_sigma)) in which the background included in the first image (e.g., orgImg) is blurred based on a second modulation value through a low-frequency filter.

[0117] In operation 509, according to one embodiment, the electronic device can use the second image and the third image to obtain a fourth image (e.g., the fourth image of FIG. 3 (340: 340-1 or 340-2)) in which the first information is processed so that it is not visually identifiable from a distance greater than specified.

[0118] According to one embodiment, the electronic device may set a different modulation method based on user information (e.g., age group or vision information), content type, or user selection. According to one embodiment, the electronic device may obtain a fourth image (340-1) through a first method of subtracting a second image from a third image, for example, when the user is a person with average vision between the ages of 20 and 40. The fourth image (340-1) obtained through the first method (e.g., method A) may be transformed into an object (651) in which at least one of the colors of the inner part (413) (e.g., inner part (413) of FIG. 4) or the outer part (e.g., outer part (415) of FIG. 4) of the object (401) is inverted, as shown in FIG. 6. According to one embodiment, the electronic device can obtain a fourth image (340-2) through a second method (method B) by adding a second image to a third image, for example, when the user is a person with presbyopia in their 40s or older. The fourth image (340-2) obtained through the second method can be transformed into an object (653) to which the object (401) corresponding to the first information is made to appear thin, without the color of the inner part (413) (e.g., the inner part (413) in FIG. 4) or the outer part (e.g., the outer part (415) in FIG. 4) of the object (401) being inverted, as shown in FIG. 6. According to one embodiment, as shown in FIG. 6, the electronic device can verify the color through a pixel-shaped graph (613) of the object (401) of the first image (e.g., the original image). According to one embodiment, the electronic device can determine the colors of the object (401) and the background (611) through a pixel-shaped graph of the object (401) of the second image (e.g., high-frequency image) (e.g., user image pixel shape (621, 623) and surfer image pixel shape (631, 633)) as shown in FIG. 6.According to one embodiment, the electronic device may have a fourth image (e.g., the fourth image (340-1, 340-2) of FIG. 3) obtained through the first method and the second method, which may be a hybrid image formed by synthesizing the second image and the third image, and may see that the color of the inner part (413) (e.g., the inner part (413) of FIG. 4) or the outer part (e.g., the outer part (415) of FIG. 4) is inverted, as shown in the graphs (641, 643) representing the pixel shape of the hybrid image. The graphs (621, 623, 631, 633, 641, 643) may represent pixel intensity (e.g., 0 to 255) in the gray channel, and may represent a brighter color as the value increases.

[0119] In operation 511, according to one embodiment, the electronic device can replace the first image displayed on the screen with a fourth image and display it on the display.

[0120] FIG. 7 is a diagram illustrating an example of adjusting the security distance in an electronic device according to one embodiment.

[0121] Referring to FIG. 7, an electronic device (201) according to one embodiment (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2) can set a security distance such that first information included in a screen (301) is not visible to others at a specified distance or greater. The electronic device (201) can set the security distance by user interaction through a setting screen (701) (e.g., a privacy screen setting screen) displayed on a display (230) (e.g., the display (160) of FIG. 1 and / or the display (230) of FIG. 2). The setting screen (701) may include a screen to be modified (703), a first object (710) for adjusting the security distance, and a second object (720) for detailed settings. The first object (710) may include a distance control object (711) set in the form of a bar, for example, to set a security distance at regular intervals, and may include a message (e.g., "It becomes difficult to recognize from about 80cm") or a visual effect (e.g., a bold circle displaying the reference distance (711)) to guide others to a reference distance (711) (e.g., minimum distance) that is difficult to recognize with the naked eye. The second object (720) may include information for detailed settings to modify the screen (703) (e.g., user's eyesight (e.g., 1.2), presence of eye disease (e.g., none), font and background color fixed (e.g., X, black)). The third object (730) may include content information for the screen (701) (e.g., content type such as a browser, social media app, or messenger).

[0122] According to one embodiment, an electronic device (201) selects a security distance through user interaction on a first object (710), checks information related to a designated pixel (e.g., modulation parameter) corresponding to the selected security distance, and can modify the screen (703) so that the first information within the screen (703) is not visually recognized at the selected security distance using the information related to the identified pixel. Here, the information related to the designated pixel (e.g., modulation parameter) may include a first modulation value (e.g., edge sigma) for adjusting the thickness of at least one of the inner or outer parts, an amplification ratio for adjusting the contrast of at least one of the colors of the inner or outer parts, a threshold value for adjusting the softness of at least one of the colors of the inner or outer parts, and a second modulation value (e.g., blur sigma) for adjusting the image quality (e.g., sharpness) of the background.

[0123] According to one embodiment, the electronic device (201) can adjust the security distance to a close (e.g., short distance) or a far distance based on a reference distance (711) (e.g., 80 cm) included in the first object (710) based on user information (e.g., age group or vision information) and / or content type. According to one embodiment, the electronic device (201) can adjust the security distance to a distance desired by the user, to a close distance or a far distance based on a reference distance (713) (e.g., 80 cm) within the distance control object (711) included in the first object (710) through user interaction.

[0124] According to one embodiment, the electronic device (201) can be configured to increase a first modulation value (e.g., edge sigma) (e.g., increase the thickness of the inner or outer part) and decrease a second modulation value (e.g., decrease the blurring of the background) based on identifying that the security distance is adjusted to a distance far from the reference distance (713) (e.g., a distance value exceeding the reference distance value), increase the amplification ratio (e.g., increase the contrast value), and decrease the threshold value (e.g., increase the detected boundary value).

[0125] According to one embodiment, the electronic device (201) can be configured to decrease a first modulation value (e.g., edge sigma) (e.g., decrease the thickness of the inner or outer part) and increase a second modulation value (e.g., increase the blurring of the background), decrease the amplification ratio (e.g., decrease the contrast value), and increase a threshold value (e.g., decrease the detected boundary value) based on identifying that the security distance is adjusted to a distance close to the reference distance (713).

[0126] FIGS. 8, 9, and 10 are drawings illustrating examples of images processed so that they are not visible to the naked eye from a specified distance or greater in an electronic device according to one embodiment.

[0127] Referring to FIG. 8, an electronic device (201) according to one embodiment (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2) can acquire an image (e.g., a fourth image) by modifying the text so that an object representing text, which is first information included in a screen (810) of text content displayed on a display (230) (e.g., the display (160) of FIG. 1 and / or the display (230) of FIG. 2) in real time is not visually recognized by others, and can display a modified screen (820, 830) including the acquired image on the display (230) in real time. The modified screen (820) may include an image (e.g., a fourth image) processed in a first manner (a contrast effect applied through color inversion). The modified screen (830) may include an image (e.g., a fourth image) processed in a second manner (an effect applied to make the object appear thin).

[0128] Referring to FIG. 9, an electronic device (201) according to one embodiment (e.g., the electronic device (101) of FIG. 1 and the electronic device (201) of FIG. 2) can acquire an image (e.g., a fourth image) by deforming an object so that the object representing the first information, a message (e.g., a message including text, images and / or symbols), included in the screen (910) of a messenger application displayed on a display (230) in real time is not visually recognized by others, and can display a deformed screen (920, 930) including the acquired image on the display (230) in real time. The deformed screen (920) may include an image (e.g., a fourth image) processed in a first manner (a contrast effect applied through color inversion). The deformed screen (930) may include an image (e.g., a fourth image) processed in a second manner (an effect applied to make the object appear thin).

[0129] Referring to FIG. 10, an electronic device (201) according to one embodiment (e.g., the electronic device (101) of FIG. 1 and the electronic device (201) of FIG. 2) can acquire an image (e.g., a fourth image) by deforming an object representing a keypad or pattern, which is first information included in a screen (1010) of a lock function (PIN) displayed on a display (230) in real time, so that the object is not visually recognized by others, and can display a deformed screen (1020, 1030) including the acquired image on the display (230) in real time. The deformed screen (1020) may include an image (e.g., a fourth image) processed in a first manner (a contrast effect applied through color inversion). The deformed screen (1030) may include an image (e.g., a fourth image) processed in a second manner (an effect applied to make the object appear thin).

[0130] An electronic device according to one embodiment can modify screens of various contents, applications, or functions, including private personal information, financial transaction information, information subject to confidentiality obligations, or information set by the user to be protected, in addition to the screens described as examples in FIGS. 8 to 10, so that they are not recognized by the naked eye of others.

[0131] According to one embodiment, a method of operation in an electronic device (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2) may include an operation of displaying a screen containing a first image representing first information on a display of the electronic device (e.g., the display (160) of FIG. 1 and / or the display (230) of FIG. 2).

[0132] According to one embodiment, the method may include an operation of checking information related to at least one pixel of an inner part or an outer part based on the boundary between an object representing the first information included in the first image and a background excluding the object, based on performing a security function for the screen.

[0133] According to one embodiment, the method may include the operation of obtaining a second image in which at least one of the inner part or the outer part is adjusted based on information related to the pixel.

[0134] According to one embodiment, the method may include the operation of obtaining a third image in which the background included in the first image is blurred.

[0135] According to one embodiment, the method may include the operation of acquiring a fourth image using the second image and the third image. According to one embodiment, the fourth image may be processed so that the first information is not visually identifiable from a distance greater than a specified distance.

[0136] According to one embodiment, the method may include the operation of replacing the first image displayed on the screen with the fourth image.

[0137] According to one embodiment, information related to the pixel may include a first modulation value for adjusting the thickness of at least one of the inner part or the outer part, an amplification ratio for adjusting the contrast of at least one of the colors of the inner part or the outer part, a threshold value for adjusting the softness of at least one of the colors of the inner part or the outer part, and a second modulation value for adjusting the image quality of the background.

[0138] According to one embodiment, the operation of acquiring the second image may include: acquiring a first value by detecting the thickness of at least one of the inner part or the outer part through a high-frequency filter configured using at least one low-frequency filter; acquiring the second image by increasing the first value by the amplification ratio based on identifying that the first value exceeds the threshold value; and acquiring the second image by decreasing the first value by a specified ratio based on identifying that the absolute value of the first value is less than or equal to the threshold value.

[0139] According to one embodiment, the operation of acquiring the third image may include acquiring the third image based on the at least one second modulation value using the at least one low-frequency filter.

[0140] According to one embodiment, the operation of acquiring the fourth image may include the operation of generating the fourth image with color inversion applied around the boundary portion by subtracting the second image from the third image.

[0141] According to one embodiment, the operation of acquiring the fourth image may include the operation of adding the second image to the third image to generate the fourth image with an effect applied to make the object appear thin without color inversion.

[0142] According to one embodiment, the method may further include an operation of displaying a setting screen on the display to adjust the security distance so that the information is not visually identifiable at a distance greater than the specified distance, based on user information and content information.

[0143] According to one embodiment, the method may further include an operation of setting information related to the pixel to increase the first modulation value, decrease the second modulation value, increase the amplification ratio, and decrease the threshold value based on identifying that the security distance has been adjusted to a distance value exceeding the reference distance value.

[0144] According to one embodiment, the method may further include an operation of setting information related to the pixel to decrease the first modulation value, increase the second modulation value, decrease the amplification ratio, and increase the threshold value based on identifying that the security distance has been adjusted to a distance value less than the reference distance value.

[0145] According to one embodiment, in a non-transient storage medium storing one or more programs, the one or more programs may include instructions that, when executed by at least one processor (e.g., processor (120) of FIG. 1 and / or processor (210) of FIG. 2) of an electronic device (e.g., electronic device (101) of FIG. 1 and / or electronic device (201) of FIG. 2), cause the electronic device to perform an operation of displaying a screen including a first image representing first information on a display of the electronic device (e.g., display (160) of FIG. 1 and / or display (230) of FIG. 2).

[0146] According to one embodiment, the one or more programs may include instructions that, when executed by at least one processor of an electronic device, cause the electronic device to perform an operation of checking information related to at least one pixel of an inner part or an outer part based on the boundary between an object representing the first information included in the first image and a background excluding the object, based on performing a security function for the screen.

[0147] According to one embodiment, the one or more programs may include instructions that, when executed by at least one processor of an electronic device, cause the electronic device to execute an operation to acquire a second image in which at least one of the inner part or the outer part is adjusted based on information related to the pixel.

[0148] According to one embodiment, the one or more programs may include instructions that, when executed by at least one processor of an electronic device, cause the electronic device to execute an operation of acquiring a third image in which the background included in the first image is blurred.

[0149] According to one embodiment, the one or more programs may include instructions that, when executed by at least one processor of the electronic device, cause the electronic device to execute an operation of acquiring a fourth image using the second image and the third image. According to one embodiment, the fourth image may be processed so that the first information is not visually identifiable from a distance greater than a specified distance.

[0150] According to one embodiment, the one or more programs may include instructions that cause the electronic device to perform an operation of replacing the first image displayed on the screen with the fourth image when executed by at least one processor of the electronic device.

[0151] This document can prevent screens displayed on electronic devices in public places, such as public transportation, outdoors, and workspaces, from being easily exposed to others, from preventing users' personal information from being easily stolen through voyeurism, and from preventing users' personal tastes and tendencies from being indiscriminately exposed to others in public places. In addition, various effects that can be identified directly or indirectly through this document may be provided. The effects obtainable from this disclosure are not limited to those mentioned above, and other unmentioned effects will be clearly understood by those skilled in the art to which this disclosure belongs from the description below.

[0152] Furthermore, the embodiments disclosed in this document are presented for the purpose of explaining and understanding the disclosed technical content and are not intended to limit the scope of the technology described in this document. Accordingly, the scope of this document should be interpreted to include all modifications or various other embodiments based on the technical concept of this document.

[0153] The electronic device according to the various embodiments disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this document is not limited to the devices described above.

[0154] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as “coupled” or “connected” to another (e.g., 2nd) component, with or without the terms “functionally” or “communicationly,” it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.

[0155] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0156] Various embodiments of the present document may be implemented as software (e.g., program (140)) comprising one or more instructions stored in a storage medium (e.g., internal memory (136) or external memory (138)) readable by a machine (e.g., electronic device (101)). For example, a processor (e.g., processor (120)) of the machine (e.g., electronic device (101)) may call at least one of the one or more instructions stored in the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.

[0157] According to one embodiment, the method according to the various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or an application store (e.g., Play Store). TM It can be distributed online (e.g., downloaded or uploaded) through ) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0158] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In an electronic device (101, 201), Display(160 230); At least one processor (120, 210) including a processing circuit; and It includes memory (130, 220) for storing instructions, When the above instructions are executed individually or collectively by the at least one processor, the electronic device: A screen including a first image (310) representing first information is displayed on the display, and Based on performing a security function for the above screen, information related to at least one pixel of an inner part (413) or an outer part (415) is checked based on the boundary between an object (401) representing the first information included in the first image and the background excluding the object, and Based on information related to the pixel above, a second image (320) is obtained by adjusting at least one of the inner part or the outer part, and A third image (330) in which the background included in the first image is blurred is obtained, and A fourth image (340) is obtained using the second image and the third image, and the fourth image is processed so that the first information is not visible to the naked eye from a distance greater than the specified distance, and An electronic device that causes the first image displayed on the screen above to be replaced with the fourth image.

2. In Paragraph 1, The information related to the pixel includes a first modulation value for adjusting the thickness of at least one of the inner part or the outer part, an amplification ratio for adjusting the contrast of at least one of the colors of the inner part or the outer part, a threshold value for adjusting the softness of at least one of the colors of the inner part or the outer part, and a second modulation value for adjusting the image quality of the background, and when the instructions are executed individually or collectively by the at least one processor, the electronic device: A first value is obtained by detecting the thickness of at least one of the inner part or the outer part through a high-frequency filter configured using at least one low-frequency filter, and Based on identifying that the first value exceeds the threshold, the first value is increased by the amplification ratio to obtain the second image, and An electronic device that causes the second image to be obtained by lowering the first value by a specified ratio based on identifying that the absolute value of the first value is less than or equal to the threshold value.

3. In claim 1 or 2, when the instructions are executed individually or collectively by the at least one processor, the electronic device: An electronic device that causes to acquire the third image using the at least one low-frequency filter based on the at least one second modulation value.

4. In any one of claims 1 to 3, when the instructions are executed individually or collectively by the at least one processor, the electronic device: An electronic device that causes the generation of the fourth image with color inversion applied around the boundary portion by subtracting the second image from the third image.

5. In any one of claims 1 to 4, when the instructions are executed individually or collectively by the at least one processor, the electronic device: An electronic device that causes the generation of the fourth image to have the effect of making the object appear thin without color inversion applied by adding the second image to the third image.

6. In any one of claims 1 to 5, when the instructions are executed individually or collectively by the at least one processor, the electronic device: Based on user information and content information, the display is controlled to display a setting screen for adjusting the security distance so that the first information is not visually identifiable at a distance greater than the specified distance, based on a specified standard distance value. An electronic device that causes information related to the pixel to be set to increase the first modulation value, decrease the second modulation value, increase the amplification ratio, and decrease the threshold value based on identifying that the security distance is adjusted to a distance value exceeding the reference distance value.

7. In any one of claims 1 through 6, when the instructions are executed individually or collectively by the at least one processor, the electronic device: An electronic device that causes information related to the pixel to be set to decrease the first modulation value, increase the second modulation value, decrease the amplification ratio, and increase the threshold value based on identifying that the security distance is adjusted to a distance value less than the reference distance value.

8. A method of operation in an electronic device (101, 201), An operation of displaying a screen including a first image (310) representing first information on a display (160, 230) of the electronic device; Based on performing a security function for the above screen, an operation to check information related to at least one pixel of an inner part (413) or an outer part (415) based on the boundary between an object (401) representing the first information included in the first image and the background excluding the object; The operation of obtaining a second image (320) in which at least one of the inner part or the outer part is adjusted based on information related to the pixel above; The operation of obtaining a third image (330) in which the background included in the first image is blurred; The operation of obtaining a fourth image (340) using the second image and the third image, wherein the fourth image is processed so that the first information is not visually identifiable at a distance greater than that specified; and A method comprising the operation of replacing the first image displayed on the screen with the fourth image.

9. In Paragraph 8, The information related to the pixel includes a first modulation value for adjusting the thickness of at least one of the inner part or the outer part, an amplification ratio for adjusting the contrast of at least one of the colors of the inner part or the outer part, a threshold value for adjusting the softness of at least one of the colors of the inner part or the outer part, and a second modulation value for adjusting the image quality of the background, and the operation of acquiring the second image is, An operation to obtain a first value by detecting the thickness of at least one of the inner part or the outer part through a high-frequency filter configured using at least one low-frequency filter; An operation to acquire the second image by increasing the first value by the amplification ratio based on identifying that the first value exceeds the threshold; and A method comprising the operation of obtaining the second image by lowering the first value by a specified ratio based on identifying that the absolute value of the first value is less than or equal to the threshold value.

10. In claim 8 or 9, the operation of acquiring the third image is, A method comprising the operation of acquiring the third image based on the at least one second modulation value using at least one low-frequency filter.

11. In any one of claims 8 to 10, the operation of acquiring the fourth image is, A method comprising the operation of subtracting the second image from the third image to generate the fourth image with color inversion applied around the boundary.

12. In any one of claims 8 to 11, the operation of acquiring the fourth image is, A method comprising the operation of adding the second image to the third image to generate the fourth image to which the effect of making the object appear thin without color inversion is applied.

13. In any one of paragraphs 8 to 12, the method is, An operation to display a setting screen on the display for adjusting a security distance based on a designated reference distance value, so that the first information is not visually identifiable at a distance greater than the designated distance, based on user information and content information; and A method further comprising the operation of setting information related to the pixel to increase the first modulation value, decrease the second modulation value, increase the amplification ratio, and decrease the threshold value based on identifying that the security distance is adjusted to a distance value exceeding the reference distance value.

14. In any one of paragraphs 8 to 13, the above method is, A method further comprising the operation of setting information related to the pixel to decrease the first modulation value, increase the second modulation value, decrease the amplification ratio, and increase the threshold value, based on identifying that the security distance is adjusted to a distance value less than the reference distance value.

15. In a non-transient storage medium storing one or more programs, the one or more programs, when executed by at least one processor (120, 210) of an electronic device (101, 201), cause the electronic device: An operation of displaying a screen including a first image (310) representing first information on a display (160, 230) of the electronic device; Based on performing a security function for the above screen, an operation to check information related to at least one pixel of an inner part (413) or an outer part (415) based on the boundary between an object (401) representing the first information included in the first image and the background excluding the object; The operation of obtaining a second image (320) in which at least one of the inner part or the outer part is adjusted based on information related to the pixel above; The operation of obtaining a third image (330) in which the background included in the first image is blurred; The operation of obtaining a fourth image (340) using the second image and the third image, wherein the fourth image is processed so that the first information is not visually identifiable at a distance greater than that specified; and A non-transient storage medium comprising commands to execute an operation of replacing the first image displayed on the screen with the fourth image.

Images