Electronic device for reconstructing background image
By using posture sensors and processors in electronic devices, monitoring device posture and application screen changes, dynamically adjusting the background image display area, solving the problem of the background image being covered, and achieving the effect of users fully viewing the background image.
Patent Information
- Application Number
- CN202380066702.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-10-04
- Filing Date
- 2023-03-22
- Publication Date
- 2025-04-22
AI Technical Summary
On electronic devices, the background image is easily overwritten by the screen performed by the application, making it difficult for the user to fully view the background image.
By introducing posture sensors and processors into electronic devices, monitoring posture changes of the device and visual changes of the application execution screen, dynamically adjusting the background image display area to ensure that the background image is repositioned and displayed in the blank area.
It enables users to fully view the background image when using the application, improves the user experience, and solves the problem of the background image being overwritten through dynamic adjustments.
Smart Images

Figure CN119866633A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to an electronic device for reconstructing an image used as a background on a screen of the electronic device. Background Art
[0002] Various types of images may be applied as background images on a screen (e.g., a home screen or a lock screen) of an electronic device. For example, an image generated by a camera of an electronic device may be configured as a background image. The electronic device may change the background image according to a specified standard. For example, the background image may be changed every time a predetermined period of time has passed or every time a display is turned off and then turned on again. Summary of the invention
[0003] Technical issues
[0004] If an application is executed on an electronic device, an image configured as a background on the screen of the electronic device may be covered by the application execution screen, and therefore, it may be difficult for the user to fully view the background image.
[0005] An embodiment of the present disclosure may provide an electronic device that enables a user to fully view a background image by relocating the background image in an area not covered by an application execution screen (hereinafter, a blank area). The technical problems to be solved in the present disclosure are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by those skilled in the art to which the present invention belongs from the following description.
[0006] Solution to the problem
[0007] According to an embodiment, an electronic device may include: a housing of the electronic device; a display, the display being disposed in the housing; a posture sensor configured to generate data for recognizing a posture of the electronic device; a processor operably connected to the posture sensor and the display; and a memory operably connected to the processor and configured to store an application. The memory may store instructions, which, when executed, cause the processor to perform operations. The instructions may cause the processor to: display a first background image in a first background image display area, the first background image display area being configured to display a background image in a display area activated to display visual information on the display. The instructions may cause the processor to: monitor, based on data received from the posture sensor, whether the posture of the electronic device is changed from a first posture corresponding to a portrait mode to a second posture corresponding to a landscape mode or from the second posture to the first posture. The instructions may cause the processor to: monitor whether there is a visual change in an execution screen of an application in the activated display area. The instructions may cause the processor to: configure a second background image display area in the activated display area based on recognizing a change in the posture of the electronic device or a visual change in an application execution screen as a result of the monitoring, the second background image display area having a size reduced from that of the first background image display area. The instructions may cause the processor to reconstruct the first background image into a second background image to be displayed in the second background image display area. The instructions may cause the processor to display the second background image in the second background image display area.
[0008] According to an embodiment, a method for operating an electronic device may include: displaying a first background image in a first background image display area, the first background image display area being configured to display the background image in a display area activated to display visual information on a display of the electronic device. The method may include: monitoring whether the posture of the electronic device is changed from a first posture corresponding to a portrait mode to a second posture corresponding to a landscape mode or from the second posture to the first posture based on data received from a sensor provided in the electronic device. The method may include: monitoring whether there is a visual change in an execution screen of an application in the activated display area. The method may include: configuring a second background image display area in the activated display area based on recognizing a change in the posture of the electronic device or a visual change in an application execution screen as a result of the monitoring, the second background image display area having a size reduced from that of the first background image display area. The method may include: reconstructing the first background image into a second background image to be displayed in the second background image display area. The method may include: displaying the second background image in the second background image display area.
[0009] Advantageous Effects of the Invention
[0010] According to various embodiments, the electronic device can enable the user to fully view the background image when using the application. In addition, various effects that can be understood directly or indirectly through this document can be provided. BRIEF DESCRIPTION OF THE DRAWINGS
[0011] Figure 1 is a block diagram of an electronic device in a network environment according to various embodiments.
[0012] Figure 2 is an exploded perspective view of an electronic device having a bar-type housing structure according to an embodiment.
[0013] Figures 3a to 3f An electronic device having a foldable housing structure in an in-folding manner according to an embodiment is shown.
[0014] Figures 4a to 4d An electronic device having a slidable housing structure according to an embodiment is shown.
[0015] Figure 5 is a block diagram of an electronic device according to an embodiment.
[0016] Figure 6 is a diagram showing connections between modules configured in the electronic device 500 .
[0017] Figure 7is a flowchart illustrating an operation for providing a background image service to a user according to an embodiment.
[0018] Figure 8a and Figure 8b is a diagram illustrating an operation for reconstructing a tile-type background image.
[0019] Figure 9a and 9b is a diagram illustrating an operation for reconstructing an object-type background image.
[0020] Fig.10a and Fig.10b is a diagram showing an operation for reconstructing a landscape-type background image.
[0021] Fig.11 is a diagram showing a screen layer structure according to an embodiment.
[0022] Fig.12 is a diagram illustrating connections among an application monitoring module, a background image display area reconfiguration module, and a background image service module according to an embodiment.
[0023] Fig.13 is a flowchart illustrating an operation for managing a database related to a background image display area according to an embodiment.
[0024] Fig.14 is a diagram showing connections among a gesture monitoring module, a state monitoring module, a background image display area reconfiguration module, and a background image service module according to an embodiment.
[0025] Fig.15 is a flowchart illustrating an operation for managing a database related to a background image display area according to an embodiment.
[0026] Fig.16 is a diagram showing connections among a background image monitoring module, a feature extraction module, a background image reconstruction module, and a background image service module according to an embodiment.
[0027] Fig.17 is a flowchart illustrating an operation for managing a database related to extracting feature information of a background image according to an embodiment. DETAILED DESCRIPTION
[0028] Figure 1 1 is a block diagram illustrating an electronic device 101 in a network environment 100 according to various embodiments. Figure 1, the electronic device 101 in the network environment 100 may communicate with the electronic device 102 via the first network 198 (e.g., a short-range wireless communication network), or communicate with at least one of the electronic device 104 or the server 108 via the second network 199 (e.g., a long-range wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 via the server 108. According to an embodiment, the electronic device 101 may include a processor 120, a memory 130, an input module 150, a sound output module 155, a display module 160, an audio module 170, a sensor module 176, an interface 177, a connection terminal 178, a haptic module 179, a camera module 180, a power management module 188, a battery 189, a communication module 190, a user identification module (SIM) 196, or an antenna module 197. In some embodiments, at least one of the above components (e.g., the connection terminal 178) may be omitted from the electronic device 101, or one or more other components may be added to the electronic device 101. In some embodiments, some of the above-described components (eg, sensor module 176, camera module 180, or antenna module 197) may be implemented as a single integrated component (eg, display module 160).
[0029] The processor 120 may run, for example, software (e.g., program 140) to control at least one other component (e.g., hardware component or software component) of the electronic device 101 connected to the processor 120, and may perform various data processing or calculations. According to one embodiment, as at least part of the data processing or calculation, the processor 120 may store a command or data received from another component (e.g., sensor module 176 or communication module 190) in the volatile memory 132, process the command or data stored in the volatile memory 132, and store the resultant data in the non-volatile memory 134. According to an embodiment, the processor 120 may include a main processor 121 (e.g., a central processing unit (CPU) or an application processor (AP)) or an auxiliary processor 123 (e.g., a graphics processing unit (GPU), a neural processing unit (NPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP)) that is independent of or combined with the main processor 121 in operation. For example, when the electronic device 101 includes a main processor 121 and an auxiliary processor 123, the auxiliary processor 123 may be adapted to consume less power than the main processor 121, or adapted to be dedicated to a specific function. The auxiliary processor 123 may be implemented as a separate part from the main processor 121, or as part of the main processor 121.
[0030] When the main processor 121 is in an inactive (e.g., sleep) state, the auxiliary processor 123 (rather than the main processor 121) may control at least some of the functions or states related to at least one component among the components of the electronic device 101 (e.g., display module 160, sensor module 176, or communication module 190), or when the main processor 121 is in an active state (e.g., running an application), the auxiliary processor 123 may control at least some of the functions or states related to at least one component among the components of the electronic device 101 (e.g., display module 160, sensor module 176, or communication module 190) together with the main processor 121. According to an embodiment, the auxiliary processor 123 (e.g., an image signal processor or a communication processor) may be implemented as part of another component (e.g., camera module 180 or communication module 190) that is functionally related to the auxiliary processor 123. According to an embodiment, the auxiliary processor 123 (e.g., a neural processing unit) may include a hardware structure dedicated to artificial intelligence model processing. The artificial intelligence model may be generated through machine learning. For example, such learning may be performed by the electronic device 101 where the artificial intelligence is executed or via a separate server (e.g., server 108). The learning algorithm may include, but is not limited to, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, for example. The artificial intelligence model may include multiple artificial neural network layers. The artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), or a deep Q network or a combination of two or more thereof, but is not limited thereto. Additionally or optionally, the artificial intelligence model may include a software structure in addition to a hardware structure.
[0031] The memory 130 may store various data used by at least one component of the electronic device 101 (e.g., the processor 120 or the sensor module 176). The various data may include, for example, software (e.g., the program 140) and input data or output data for commands related thereto. The memory 130 may include a volatile memory 132 or a non-volatile memory 134.
[0032] The program 140 may be stored as software in the memory 130 , and may include, for example, an operating system (OS) 142 , middleware 144 , or applications 146 .
[0033] The input module 150 may receive commands or data to be used by other components (e.g., the processor 120) of the electronic device 101 from outside the electronic device 101 (e.g., a user). The input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus).
[0034] The sound output module 155 can output sound signals to the outside of the electronic device 101. The sound output module 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as playing multimedia or playing records. The receiver can be used to receive incoming calls. Depending on the embodiment, the receiver can be implemented as a separate part from the speaker, or as part of the speaker.
[0035] The display module 160 may visually provide information to the outside (e.g., user) of the electronic device 101. The display device 160 may include, for example, a display, a holographic device, or a projector, and a control circuit for controlling a corresponding one of the display, the holographic device, and the projector. According to an embodiment, the display module 160 may include a touch sensor adapted to detect a touch or a pressure sensor adapted to measure the strength of a force caused by a touch.
[0036] The audio module 170 may convert sound into an electrical signal, or vice versa. According to an embodiment, the audio module 170 may obtain sound via the input module 150, or output sound via the sound output module 155 or an earphone of an external electronic device (e.g., electronic device 102) directly (e.g., wired) or wirelessly connected to the electronic device 101.
[0037] The sensor module 176 may detect an operating state (e.g., power or temperature) of the electronic device 101 or an environmental state (e.g., a user's state) outside the electronic device 101, and then generate an electrical signal or data value corresponding to the detected state. According to an embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, an atmospheric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illumination sensor.
[0038] The interface 177 may support one or more specific protocols to be used to connect the electronic device 101 directly (e.g., wired) or wirelessly to an external electronic device (e.g., the electronic device 102). According to an embodiment, the interface 177 may include, for example, a high-definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.
[0039] The connection end 178 may include a connector, wherein the electronic device 101 can be physically connected to an external electronic device (e.g., the electronic device 102) via the connector. According to an embodiment, the connection end 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0040] The haptic module 179 may convert the electric signal into mechanical stimulation (eg, vibration or motion) or electric stimulation that can be recognized by the user via his sense of touch or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electric stimulator.
[0041] The camera module 180 may capture still images or moving images. According to an embodiment, the camera module 180 may include one or more lenses, an image sensor, an image signal processor, or a flash.
[0042] The power management module 188 may manage power supply to the electronic device 101. According to an embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).
[0043] The battery 189 may power at least one component of the electronic device 101. According to an embodiment, the battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0044] The communication module 190 may support establishing a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (e.g., electronic device 102, electronic device 104, or server 108), and perform communication via the established communication channel. The communication module 190 may include one or more communication processors capable of operating independently from the processor 120 (e.g., an application processor (AP)) and supporting direct (e.g., wired) communication or wireless communication. According to an embodiment, the communication module 190 may include a wireless communication module 192 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (e.g., a local area network (LAN) communication module or a power line communication (PLC) module). A corresponding one of these communication modules can communicate with an external electronic device via a first network 198 (e.g., a short-range communication network such as Bluetooth, Wireless Fidelity (Wi-Fi) Direct, or Infrared Data Association (IrDA)) or a second network 199 (e.g., a long-range communication network such as a traditional cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or a wide area network (WAN))). These various types of communication modules can be implemented as a single component (e.g., a single chip), or these various types of communication modules can be implemented as multiple components separated from each other (e.g., multiple chips). The wireless communication module 192 can identify and authenticate the electronic device 101 in a communication network (such as the first network 198 or the second network 199) using user information (e.g., an International Mobile Subscriber Identity (IMSI)) stored in the user identification module 196.
[0045] The wireless communication module 192 can support 5G networks after 4G networks and next-generation communication technologies (e.g., new radio (NR) access technology). NR access technology can support enhanced mobile broadband (eMBB), massive machine type communication (mMTC), or ultra-reliable low-latency communication (URLLC). The wireless communication module 192 can support high-frequency bands (e.g., millimeter wave bands) to achieve, for example, high data transmission rates. The wireless communication module 192 can support various technologies for ensuring performance on high-frequency bands, such as, for example, beamforming, massive multiple-input multiple-output (massive MIMO), full-dimensional MIMO (FD-MIMO), array antennas, analog beamforming, or massive antennas. The wireless communication module 192 can support various requirements specified in the electronic device 101, an external electronic device (e.g., electronic device 104), or a network system (e.g., a second network 199). According to an embodiment, the wireless communication module 192 may support a peak data rate for implementing eMBB (e.g., 20 Gbps or greater), loss coverage for implementing mMTC (e.g., 164 dB or less), or U-plane delay for implementing URLLC (e.g., 0.5 ms or less for each of the downlink (DL) and uplink (UL), or 1 ms or less for a round trip).
[0046] The antenna module 197 may transmit or receive a signal or power to or from the outside of the electronic device 101 (e.g., an external electronic device). According to an embodiment, the antenna module 197 may include an antenna including a radiation element formed of a conductive material or a conductive pattern formed in or on a substrate (e.g., a printed circuit board (PCB)). According to an embodiment, the antenna module 197 may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication scheme used in a communication network (such as the first network 198 or the second network 199) may be selected from the plurality of antennas by, for example, the communication module 190 (e.g., the wireless communication module 192). A signal or power may then be transmitted or received between the communication module 190 and the external electronic device via the selected at least one antenna. According to an embodiment, another component (e.g., a radio frequency integrated circuit (RFIC)) other than the radiation element may be additionally formed as a part of the antenna module 197.
[0047] According to various embodiments, the antenna module 197 may form a millimeter wave antenna module. According to an embodiment, the millimeter wave antenna module may include a printed circuit board, a radio frequency integrated circuit (RFIC), and a plurality of antennas (e.g., array antennas), wherein the RFIC is disposed on a first surface (e.g., bottom surface) of the printed circuit board, or adjacent to the first surface and capable of supporting a designated high frequency band (e.g., millimeter wave band), and the plurality of antennas are disposed on a second surface (e.g., top surface or side surface) of the printed circuit board, or adjacent to the second surface and capable of transmitting or receiving signals of the designated high frequency band.
[0048] At least some of the above components may be connected to each other via an inter-peripheral communication scheme (e.g., a bus, a general purpose input output (GPIO), a serial peripheral interface (SPI), or a mobile industry processor interface (MIPI)) and communicatively transfer signals (e.g., commands or data) therebetween.
[0049] According to an embodiment, a command or data may be sent or received between the electronic device 101 and the external electronic device 104 via the server 108 connected to the second network 199. Each of the electronic device 102 or the electronic device 104 may be a device of the same type as the electronic device 101, or a device of a different type from the electronic device 101. According to an embodiment, all or some operations to be run on the electronic device 101 may be run on one or more of the external electronic device 102, the external electronic device 104, or the server 108. For example, if the electronic device 101 should automatically perform a function or service or should perform a function or service in response to a request from a user or another device, the electronic device 101 may request the one or more external electronic devices to perform at least part of the function or service instead of running the function or service, or the electronic device 101 may request the one or more external electronic devices to perform at least part of the function or service in addition to running the function or service. The one or more external electronic devices that receive the request may perform the requested at least part of the function or service, or perform another function or another service related to the request, and transmit the result of the execution to the electronic device 101. The electronic device 101 may provide the result as at least a partial reply to the request with or without further processing the result. To this end, cloud computing technology, distributed computing technology, mobile edge computing (MEC) technology, or client-server computing technology, for example, may be used. The electronic device 101 may use, for example, distributed computing or mobile edge computing to provide ultra-low latency services. In another embodiment, the external electronic device 104 may include an Internet of Things (IoT) device. The server 108 may be an intelligent server using machine learning and / or neural networks. According to an embodiment, the external electronic device 104 or the server 108 may be included in the second network 199. The electronic device 101 may be applied to intelligent services (e.g., smart homes, smart cities, smart cars, or health care) based on 5G communication technology or IoT-related technologies.
[0050] The electronic device according to various embodiments may be one of various types of electronic devices. The electronic device may include, for example, a portable communication device (e.g., a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a household appliance. According to an embodiment of the present disclosure, the electronic device is not limited to those electronic devices described above.
[0051] It should be understood that the various embodiments of the present disclosure and the terms used therein are not intended to limit the technical features set forth herein to specific embodiments, but include various changes, equivalent forms or alternative forms for the corresponding embodiments. For the description of the accompanying drawings, similar reference numerals may be used to refer to similar or related elements. It will be understood that the nouns in the singular form corresponding to the term may include one or more things unless the relevant context clearly indicates otherwise. As used herein, each of the phrases such as "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C" and "at least one of A, B or C" may include any one or all possible combinations of the items listed together with the corresponding one of the multiple phrases. As used herein, terms such as "1st" and "2nd" or "first" and "second" may be used to simply distinguish the corresponding component from another component, and do not limit the component in other aspects (e.g., importance or order). It will be understood that if an element (e.g., a first element) is referred to as being “coupled with another element (e.g., the second element)”, “coupled to another element (e.g., the second element)”, “connected with another element (e.g., the second element)”, or “connected to another element (e.g., the second element)” with or without the terms “operably” or “communicatively” being used, it means that the element may be directly (e.g., wired) connected to the other element, wirelessly connected to the other element, or connected to the other element via a third element.
[0052] As used in connection with various embodiments of the present disclosure, the term "module" may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with other terms (e.g., "logic," "logic block," "portion," or "circuit"). A module may be a single integrated component adapted to perform one or more functions or a minimum unit or portion of the single integrated component. For example, according to an embodiment, a module may be implemented in the form of an application specific integrated circuit (ASIC).
[0053] The various embodiments described herein may be implemented as software (e.g., program 140) including one or more instructions stored in a storage medium (e.g., internal memory 136 or external memory 138) that can be read by a machine (e.g., electronic device 101). For example, under the control of a processor, a processor (e.g., processor 120) of the machine (e.g., electronic device 101) may call at least one of the one or more instructions stored in the storage medium and execute the at least one instruction with or without the use of one or more other components. This enables the machine to operate to perform at least one function according to the at least one instruction called. The one or more instructions may include code generated by a compiler or code that can be run by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Among them, the term "non-transitory" only means that the storage medium is a tangible device and does not include a signal (e.g., an electromagnetic wave), but the term does not distinguish between data being semi-permanently stored in the storage medium and data being temporarily stored in the storage medium.
[0054] According to an embodiment, the method according to various embodiments of the present disclosure may be included and provided in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be published in the form of a machine-readable storage medium (e.g., a compact disk read-only memory (CD-ROM)), or may be published online (e.g., downloaded or uploaded) via an application store (e.g., Play StoreTM), or may be distributed (e.g., downloaded or uploaded) directly between two user devices (e.g., smart phones). If published online, at least part of the computer program product may be temporarily generated, or at least part of the computer program product may be at least temporarily stored in a machine-readable storage medium (such as a manufacturer's server, an application store's server, or a memory of a forwarding server).
[0055] According to various embodiments, each of the above-mentioned components (e.g., a module or a program) may include a single entity or multiple entities, and some of the multiple entities may be separately arranged in different components. According to various embodiments, one or more of the above-mentioned components may be omitted, or one or more other components may be added. Alternatively or additionally, multiple components (e.g., a module or a program) may be integrated into a single component. In this case, according to various embodiments, the integrated component may still perform the one or more functions of each of the multiple components in the same or similar manner as a corresponding one of the multiple components performing one or more functions before integration. According to various embodiments, the operations performed by a module, a program or another component may be performed sequentially, in parallel, repeatedly or in a heuristic manner, or one or more of the operations may be run or omitted in a different order, or one or more other operations may be added.
[0056] Hereinafter, for ease of explanation, the surface of a display (e.g., a flexible display) that is visually exposed to a user may be referred to as the front surface of the electronic device 101. In addition, the surface opposite to the front surface may be referred to as the rear surface of the electronic device 101. In addition, the surface surrounding the space between the front surface and the rear surface may be referred to as the side surface of the electronic device 101. The term "state" may refer to the structural form, posture, or shape of the electronic device 101 (or a display, a slider, or a housing constituting the electronic device 101). In addition, in this document, the term "state" may be used as a term indicating whether software (e.g., an application) is being executed, whether the execution screen of the corresponding software is being displayed on the display, or whether the position of the execution screen is changed on the display.
[0057] The strip-type housing structure may be applied to an electronic device (e.g., a smartphone or a tablet PC) 101. For example, the strip-type housing structure may include a plate (or cover) forming a front surface of the electronic device 101, a plate forming a rear surface of the electronic device 101, and a frame structure forming a side surface surrounding the front and rear surfaces. A display may be provided on the front surface.
[0058] The foldable housing structure can be applied to an electronic device (e.g., a smart phone, a tablet PC, a notebook PC) 101. For example, the electronic device 101 can have a foldable housing structure in which the housing is divided into two parts relative to a folding axis. A first display area of a display (e.g., a flexible display) can be provided in the first housing, and a second display area of the display can be provided in the second housing. The foldable housing structure can be implemented in an inward folding manner, in which the first display area and the second display area face each other when the electronic device 101 is in a folded state. Alternatively, the foldable housing structure can be implemented in an out-folding manner, in which the first display area and the second display area are opposite to each other when the electronic device 101 is in a folded state.
[0059] A slidable (or rollable) housing structure can be applied to an electronic device (e.g., a smart phone, a tablet PC, a notebook PC) 101. The electronic device 101 may include a slidable housing and a rollable display (e.g., a flexible display), the slidable housing including a housing (or a first housing) and a slider (or a second housing), a track structure (e.g., a track structure having a gear combination between a rack gear and a pinion) for sliding the slider into and out of the housing. The slider may be divided into a portion that can slide into the housing (hereinafter, a slide-in portion) and a portion that remains exposed to the outside. The entire display (or most of the display area) may be exposed to the outside through the front surface in the slide-out state, and in the slide-out state, the entirety of the slide-in portion of the slider slides out of the housing (in other words, in the first state, the open state, the extended state, or the unfolded state). When the slide-in portion of the slider slides into the housing, the display may also be received inside the housing. The display can also be divided into a portion (e.g., a first display area or a first portion) that remains exposed to the outside and a portion (e.g., a second display area, a second portion, or a bendable portion) that can slide into the housing. When switched to the slide-in state (in other words, in the second state, the closed state, the reduced state, or the rolled-in state), in the slide-in state, the entire slide-in portion of the slider slides into the housing, and the entire second display area of the display can be accommodated inside the housing. In an embodiment, when switching from the slide-out state to the slide-in state, a portion of the display (e.g., the second display area) can be moved to the rear surface via the side surface instead of sliding into the housing. As illustrated above, the electronic device 101 can have a sliding structure in which a portion of the display slides into the housing or a sliding structure in which a portion of the display moves from the front surface to the rear surface. In the display, only the portion exposed by the front surface can be determined as an activated display area (hereinafter, an activation area) for displaying visual information. The portion that slides into the housing or moves to the rear surface can be determined as an inactive area in which visual information is not displayed.
[0060] Figure 2 is an exploded perspective view of an electronic device 300 having a bar-type housing structure according to an embodiment.
[0061] refer to Figure 2 , the electronic device 200 (for example, Figure 1 The electronic device 101 in the embodiment may include a side surface frame structure (or side frame) 210, a first support member (or first support frame) 211, a front cover (or window) 220, a display 230 (eg, Figure 1 , a display module 160 in FIG. 1 ), one or more printed circuit boards 240 and 241 , a battery 250 (eg, Figure 1The front cover 220 may form a first surface (or front surface) of the electronic device 200 facing a first direction, and the back cover 280 may form a second surface (or back surface) of the electronic device 200 facing a second direction opposite to the first direction. The side surface frame structure 210 may be made of a combination of a metal (e.g., SUS) and a polymer. The side surface frame structure 210 may form a side surface surrounding a space between the first surface and the second surface. According to an embodiment, a structure including a first surface, a second surface, and a side surface may be referred to as a shell (or shell structure).
[0062] The printed circuit boards 240 and 241 may be arranged to be supported by the first support member 211 and / or the second support member 260. The first support member 211 may be coupled to the side surface frame structure 210. The first support member 211 may include a structure (e.g., metal or polymer) extending from the side surface frame structure 210. The first support member 211 may be formed of, for example, a metal and / or a non-metal material (e.g., polymer). The display 230 may be coupled to one side of the second support member 260, and the printed circuit board 240 or 241 may be coupled to the other side. The processor 120, the memory 130, and / or the interface 177 may be mounted on the printed circuit boards 240 and 241. According to an embodiment, the printed circuit boards 240 and 241 may include a main board 240 and a sub-board 241. The first support member 211 may include a main board support member 211a supporting the main board 240 and a sub-board support member 211b supporting the sub-board 241. The battery 250 may be arranged to be supported by the first support member 211 and / or the second support member 260.
[0063] Figures 3a to 3f An electronic device 300 having a foldable housing structure in an inward folding manner according to an embodiment is shown. Specifically, Figure 3a and Figure 3b shows the front surface of the electronic device 300 in an unfolded (flat or open) state, Figure 3c The rear surface of the electronic device 300 in a folded (or closed) state is shown. Figure 3d The rear surface of the electronic device 300 in the unfolded state is shown. Figure 3e The front surface of the electronic device 300 is shown in a partially folded state (in other words, a partially unfolded state, or an intermediate state (free stop state) between the fully folded state and the fully unfolded state), and Figure 3f is an exploded perspective view of the electronic device 300 .
[0064] refer to Figures 3a to 3f , the electronic device 300 (for example, Figure 1The electronic device 101 in the embodiment may include a foldable housing including a first housing 310, a second housing 320, and a hinge assembly 340, the hinge assembly 340 connecting the first housing 310 and the second housing 320 so that the second housing 320 can rotate relative to the first housing 310. The electronic device 300 may include a flexible or foldable display 399 and a sensor module (e.g., Figure 1 Sensor module 176 in.
[0065] The display 399 may be arranged from the first housing 310 across the hinge assembly 340 to the second housing 320. The display 399 may be divided into a first display area 311 arranged in the internal space of the first housing 310 and a second display area 321 arranged in the internal space of the second housing 320 based on the folding axis A. When viewed from the front, a sensor module (e.g., a light sensor) may be arranged below the sensor area (or light-transmitting area) 342a of the first display area 311. The position and / or size of the sensor area 342a within the first display area 311 may be determined by the position and / or size of the illuminance sensor arranged thereunder. For example, the size (e.g., diameter) of the sensor area 342a may be determined based on the field of view (FOV) of the illuminance sensor. In an embodiment, the sensor area 342a may be configured to have a lower pixel density and / or a lower wiring density than the surrounding area in order to improve light transmittance.
[0066] The hinge assembly 340 can be implemented in a folding manner so that when the electronic device 300 is moved from the unfolded state (eg, Figure 3a state) to the collapsed state (for example, Figure 3c 310 and 320. When the foldable housings 310 and 320 are in a state in which the two display areas 311 and 321 face each other, the two display areas 311 and 321 face each other. For example, when the electronic device 300 is in an unfolded state, the two display areas 311 and 321 may face substantially the same direction. When the electronic device switches from the unfolded state to the folded state, the two display areas 311 and 321 may rotate in the direction in which they face each other. The hinge assembly 340 may be configured so that the foldable housings 310 and 320 have resistance to rotation. When an external force exceeding the resistance is applied to the foldable housings 310 and 320, the foldable housings 310 and 320 may rotate.
[0067] Based on the angle formed between the two display areas 311 and 321, the state of the electronic device 300 can be defined. For example, when the angle between the two display areas 311 and 321 is about 180 degrees, the state of the electronic device 300 can be defined as an unfolded (flat or open) state. When the angle between the two display areas 311 and 321 is between about 0 degrees and 10 degrees, the state of the electronic device 300 can be defined as a folded (or closed) state. When the two display areas 311 and 321 form an angle that is greater than the angle in the folded state and less than the angle in the unfolded state (for example, between about 10 degrees and 179 degrees), the state of the electronic device 300 can be defined as an intermediate state (in other words, a partially folded or partially unfolded state), such as Figure 3e shown.
[0068] Based on the state of the electronic device 300, an activation area on which visual information (e.g., text, image, or icon) is to be displayed can be determined on the display 399. For example, when the electronic device 300 is in the intermediate state, the processor 120 can determine two or one of the first display area 311 and the second display area 321 as the activation area. The processor 120 can determine the first display area 311 or the second display area 321 with relatively less movement as the activation area. For example, when the user holds the housing of the electronic device 300 with one hand and opens the other housing with a finger (e.g., thumb) of the same hand or the other hand, the processor 120 can switch from the folded state to the intermediate state, and therefore, the electronic device 300 can determine the display area of the housing (e.g., housing with relatively less movement) held as the activation area. When the electronic device 300 is in the unfolded state, the entire display area of the display 399 (both the first display area 311 and the second display area 321) can be determined as the activation area.
[0069] According to an embodiment, in the unfolded state, the first housing 310 may include a first surface (first display area) 311 facing a first direction (e.g., front direction) (z-axis direction) and a second surface 312 facing a second direction (e.g., rear direction) (-z-axis direction) opposite to the first surface 311. In the unfolded state, the second housing 320 may include a third surface (second display area) 321 facing the first direction (e.g., z-axis direction) and a fourth surface 322 facing the second direction (e.g., -z-axis direction). The electronic device 300 may operate in such a manner that the first surface 311 of the first housing 310 and the third surface 321 of the second housing 320 face the same first direction (e.g., z-axis direction) in the unfolded state, and the first surface 311 and the third surface 321 face each other in the folded state. The electronic device 300 may operate in such a manner that the second surface 312 of the first housing 310 and the fourth surface 322 of the second housing 320 face the same second direction (-z-axis direction) in the unfolded state, and the second surface 312 and the fourth surface 322 face opposite directions to each other in the folded state.
[0070] According to an embodiment, the first housing 310 may include a first side frame 313 that at least partially forms an appearance of the electronic device 300 and a first back cover 314 that is coupled to the first side frame 313 and forms at least a portion of a second surface 312 of the electronic device 300. According to an embodiment, the first side frame 313 may include a first side surface 313a, a second side surface 313b extending from one end of the first side surface 313a, and a third side surface 313c extending from the other end of the first side surface 313a. According to an embodiment, the first side frame 313 may be formed in a rectangular (e.g., square or quadrilateral) shape by the first side surface 313a, the second side surface 313b, and the third side surface 313c.
[0071] According to an embodiment, the second housing 320 may include a second side frame 323 that at least partially forms the appearance of the electronic device 300 and a second back cover 324 that is coupled to the second side frame 323 and forms at least a portion of the fourth surface 322 of the electronic device 300. According to an embodiment, the second side frame 323 may include a fourth side surface 323a, a fifth side surface 323b extending from one end of the fourth side surface 323a, and a sixth side surface 323c extending from the other end of the fourth side surface 323a. According to an embodiment, the second side frame 323 may be formed into a rectangular shape by the fourth side surface 323a, the fifth side surface 323b, and the sixth side surface 323c.
[0072] According to an embodiment, the electronic device 300 may include a first protective cover 315 (eg, a first protective frame or a first decorative member) coupled along an edge of the first housing 310. The electronic device 300 may include a second protective cover 325 (eg, a second protective frame or a second decorative member) coupled along an edge of the second housing 320.
[0073] According to an embodiment, the electronic device 300 may include a sub-display 331 provided separately from the display 399. The sub-display 331 may be provided to be at least partially exposed through the second surface 312 of the first housing 310, thereby displaying state information of the electronic device 300 in the folded state. The sub-display 331 may be provided to be visible from the outside through at least a portion of the first back cover 314. In a certain embodiment, the sub-display 331 may be provided on the fourth surface 322 of the second housing 320. In this case, the sub-display 331 may be provided to be visible from the outside through at least a portion of the second back cover 324.
[0074] According to an embodiment, the electronic device 300 may include at least one of an input device 303, audio output devices 301 and 302, camera modules 305 and 308, a key input device 306, a connector port 307, and a sensor module (not shown). When viewed from the front, the sensor module (e.g., Figure 1 The sensor module 176) and the camera 305 can be set below the display 399.
[0075] According to an embodiment, the electronic device 300 may be operated to maintain the intermediate state using the hinge assembly 340. In this case, the electronic device 300 may display different contents on a first display area corresponding to the first surface 311 and a second display area corresponding to the third surface 321. For example, the processor 120 of the electronic device 300 may control the display 399 to display an application execution screen on the first display area and a background image on the second display area.
[0076] refer to Figure 3f, the electronic device 300 may include a first side frame 313, a second side frame 323, and a hinge assembly 340 rotatably connecting the first side frame 313 and the second side frame 323. According to an embodiment, the electronic device 300 may include a first support plate 3131 extending at least partially from the first side frame 313 and a second support plate 3231 extending at least partially from the second side frame 323. According to an embodiment, the first support plate 3131 may be integrally formed with the first side frame 313 or structurally coupled to the first side frame 313. Similarly, the second support plate 3231 may be integrally formed with the second side frame 323 or structurally coupled to the second side frame 323. According to an embodiment, the electronic device 300 may include a display 399, and the display 399 is configured to be supported by the first support plate 3131 and the second support plate 3231. According to an embodiment, the electronic device 300 may include a first back cover 314 and a second back cover 324, the first back cover 314 is coupled to the first side frame 313 and provides a first space between the first back cover 314 and the first support plate 3131, and the second back cover 324 is coupled to the second side frame 323 and provides a second space between the second side frame 323 and the second support plate 3231. In a certain embodiment, the first side frame 313 and the first back cover 314 may be formed integrally. In a certain embodiment, the second side frame 323 and the second back cover 324 may be formed integrally. According to an embodiment, the electronic device 300 may include a first housing 310 provided by the first side frame 313, the first support plate 3131 and the first back cover 314. According to an embodiment, the electronic device 300 may include a second housing 320 provided through the second side frame 323, the second support plate 3231 and the second back cover 324.
[0077] Although not shown, the hinge assembly 340 may include a first arm structure (e.g., a first support plate 3131) coupled to the first housing 310, a second arm structure (e.g., a second support plate 3231) coupled to the second housing 320, and a detent structure in physical contact with the first arm structure and the second arm structure, so that the first housing 310 and the second housing 320 have resistance to rotation. Due to the contact force of the detent structure (e.g., a force pushing the first arm structure and the second arm structure), the foldable housings 310 and 320 may have resistance to rotation.
[0078] According to an embodiment, the electronic device 300 may include a first board assembly 361 (e.g., a main printed circuit board), a camera assembly 363, a first battery 371, or a first bracket 351 disposed in a first space between the first side frame 313 and the first rear cover 314. According to an embodiment, the camera assembly 363 may include a plurality of cameras (e.g., Figure 3a and Figure 3c305 and 308 in the camera module 305 and 308), and can be electrically connected to the first board assembly 361. According to an embodiment, the first bracket 351 may provide a support structure and improved rigidity for supporting the first board assembly 361 and / or the camera assembly 363. According to an embodiment, the electronic device 300 may include a second board assembly 362 (e.g., a sub-printed circuit board), an antenna 390 (e.g., a coil member), a second battery 372, or a second bracket 352 disposed in a second space between the second side frame 323 and the second back cover 324. According to an embodiment, the electronic device 300 may include a wire member 380 (e.g., a flexible printed circuit board (FPCB)) that is disposed to extend from the first board assembly 361 across the hinge assembly 340 to a plurality of electronic components (e.g., the second board assembly 362, the second battery 372, or the antenna 390) disposed between the second side frame 323 and the second back cover 324, and provide electrical connection.
[0079] According to an embodiment, the electronic device 300 may include a hinge cover 341, which supports the hinge assembly 340 and is configured to be exposed to the outside when the electronic device 300 is in a folded state, and to be accommodated inside the first space and the second space when the electronic device 300 is in an unfolded state so as to be invisible from the outside.
[0080] According to an embodiment, the electronic device 300 may include a first protective cover 315 coupled along an edge of the first side frame 313. According to an embodiment, the electronic device 300 may include a second protective cover 325 coupled along an edge of the second side frame 323. In the display 399, an edge of the first display area 311 may be protected by the first protective cover 315. An edge of the second display area 321 may be protected by the second protective cover 325. A protective cap 335 may be provided in an area corresponding to the hinge assembly 340 in order to protect a portion bent at an edge of the display 399.
[0081] Figures 4a to 4d An electronic device 400 having a slidable housing structure according to an embodiment is shown. Specifically, Figure 4a and Figure 4b is a diagram showing the front surface and the rear surface of the electronic device 400 in a slid-in state. Figure 4c and Figure 4d 4 is a diagram showing the front and rear surfaces of the electronic device 400 in a slid-out state.
[0082] refer to Figures 4a to 4d , the electronic device 400 (for example, Figure 1The electronic device 101 in the embodiment may include a first housing (or housing) 410, a second housing (or sliding member) 420, and a rollable display 430 (e.g., a flexible display, an expandable display, or a stretchable display), the second housing (or sliding member) 420 is coupled to be slidable from the first housing 410 along a specified direction (e.g., direction ① or direction ②) (e.g., ±y-axis direction), and the rollable display 430 is provided to be supported by at least a portion of the first housing 410 and the second housing 420. According to an embodiment, the electronic device 400 may be configured such that the second housing 420 slides out in a first direction (direction ①) relative to the first housing 410 held by the user or slides in a second direction (direction ②) opposite to the first direction (direction ①). According to an embodiment, at least a portion of the second housing 420 including the second space 4201 may be accommodated in the first space 4101 of the first housing 410, thereby switching to a slide-in state. According to an embodiment, the electronic device 400 may include a supporting member (e.g., a bendable member, a multi-joint hinge module, or a multi-bar assembly) that at least partially forms the same plane with a portion of the second housing 420 in a slid-out state, and is at least partially accommodated in the first space 4101 of the first housing 410 in a slid-in state. According to an embodiment, in the slid-in state, at least a portion of the rollable display 430 may be accommodated in the first space 4101 of the first housing 410 to be bent while being supported by the supporting member, thereby being arranged to be invisible from the outside. According to an embodiment, in the slid-out state, at least a portion of the rollable display 430 may be arranged to be visible from the outside while being supported by the supporting member that at least partially forms the same plane with the second housing 420.
[0083] The first housing 410 may include a first side member 411. According to an embodiment, the first side member 411 may include a first side surface 4111 having a first length along a first direction (e.g., a y-axis direction), a second side surface 4112 extending from the first side surface 4111 along a direction substantially perpendicular to the first side surface 4111 (e.g., an x-axis direction) to have a second length shorter than the first length, and a third side surface 4113 extending from the second side surface 4112 substantially parallel to the first side surface 4111 to have the first length. According to an embodiment, the first housing 410 may include a first extension member 412 extending from at least a portion of the first side member 411 to at least a portion of the first space 4101. According to an embodiment, the first extension member 412 may be integrally formed with the first side member 411. In a certain embodiment, the first extension member 412 may be formed separately from the first side member 411 and may be structurally coupled to the first side member 411.
[0084] The second housing 420 may include a second side member 421. The second side member 421 may include a fourth side surface 4211 at least partially corresponding to the first side surface 4111 and having a third length, a fifth side surface 4212 extending from the fourth side surface 4211 in a direction substantially parallel to the second side surface 4112 and having a fourth length shorter than the third length, and a sixth side surface 4213 extending from the fifth side surface 4212 to correspond to the third side surface 4113 and having the third length. According to an embodiment, at least a portion of the second side member 421 may include a second extension member 422 extending to at least a portion of the second space 4201 of the second housing 420. According to an embodiment, the second extension member 422 may be integrally formed with the second side member 421. In a certain embodiment, the second extension member 422 may be formed separately from the second side member 421 and structurally coupled to the second side member 421.
[0085] According to an embodiment, the first side surface 4111 and the fourth side surface 4211 may be coupled to be slidable relative to each other. The third side surface 4113 and the sixth side surface 4213 may be coupled to be slidable relative to each other. According to an embodiment, in the slid-in state, the fourth side surface 4211 may be arranged to overlap with the first side surface 4111 so as to be substantially invisible from the outside. In the slid-in state, the sixth side surface 4213 may be arranged to overlap with the third side surface 4113 so as to be substantially invisible from the outside. In a certain embodiment, in the slid-in state, at least a portion of the fourth side surface 4211 and the sixth side surface 4213 may be arranged to be at least partially visible from the outside. According to an embodiment, in the slid-in state, the second extension member 422 may be arranged to overlap with the first extension member 412 so as to be substantially invisible from the outside.
[0086] The first housing 410 may include a first back cover 413 coupled to at least a portion of the first side member 411. According to an embodiment, the first back cover 413 may be configured to be coupled to at least a portion of the first extension member 412. In a certain embodiment, the first back cover 413 may be integrally formed with the first side member 411. In a certain embodiment, the first back cover 413 may extend to at least a portion of the first side member 411. In a certain embodiment, at least a portion of the first extension member 412 may be replaced by the first back cover 413.
[0087] The second housing 420 may include a second back cover 423 coupled to at least a portion of the second side member 421. According to an embodiment, the second back cover 423 may be configured to be coupled to at least a portion of the second extension member 422. In a certain embodiment, the second back cover 423 may be integrally formed with the second side member 421. In a certain embodiment, the second back cover 423 may extend to at least a portion of the second side member 421. In a certain embodiment, at least a portion of the second extension member 422 may be replaced by the second back cover 423.
[0088] According to an embodiment, the rollable display 430 may include a first portion 430a (e.g., a flat portion) that is always visible from the outside and a second portion 430b (e.g., a bendable portion) that extends from the first portion 430a and is at least partially accommodated in the first space 4101 of the first housing 410 so as to be invisible from the outside in the slid-in state. According to an embodiment, the first portion 430a may be arranged to be supported by the second housing 420, and the second portion 430b may be arranged to be at least partially supported by a support member. According to an embodiment, when the second housing 420 slides out along the first direction (direction ①), the second portion 430b of the rollable display 430 may be arranged to form a substantially same plane as the first portion 430a and may be visible from the outside. According to an embodiment, when the second housing 420 slides along the second direction (direction ②), the second portion 430b of the rollable display 430 may be accommodated in the first space 4101 of the first housing 410 so as to bend so that it is invisible from the outside. Therefore, the electronic device 400 may be configured such that a display area exposed to the outside and displaying visual information on the rollable display 430 may change as the second housing 420 slides from the first housing 410 in a designated direction (eg, ±y-axis directions).
[0089] According to an embodiment, the rollable display 430 may change its length in the first direction (direction ①) according to the sliding movement of the second housing 420. For example, in the slid-in state, the rollable display 430 may have a first display area (e.g., the first portion 430a) corresponding to the first length L1. According to an embodiment, when the second housing 420 slides a second length L2 from the first housing 410 in the slid-out state, the rollable display 430 may be extended to have a third display area corresponding to a third length L3 greater than the first length L1 and including the first display area and the second display area (e.g., the second portion 430b).
[0090] The electronic device 400 may include at least one of an input device (e.g., microphone 403-1), an audio output device (e.g., call receiver 406 and / or speaker 407), sensor modules 404 and 417, a camera module (e.g., first camera module 405 or second camera module 416), a connector port 408, a key input device 419, or an indicator (not shown) disposed in the second space 4201 of the second housing 420. According to an embodiment, the electronic device 400 may include another input device (e.g., microphone 403) disposed in the first housing 410. According to an embodiment, the electronic device 400 may be configured to exclude at least one of the above components or to further include other components. According to an embodiment, at least one of the above components may also be disposed in the first space 4101 of the first housing 410.
[0091] The input device may include a microphone 403-1. In a certain embodiment, the input device (e.g., microphone 403-1) may include a plurality of microphones configured to detect the direction of the sound. The sound output device may include, for example, a call receiver 406 and a speaker 407. According to an embodiment, the sound may be output to the outside from the speaker 407 through at least one speaker hole formed at a position (e.g., the fifth side surface 4212) that is always exposed to the outside, regardless of the sliding state. According to an embodiment, the connector port 408 may be exposed to the outside through a connector port hole formed in the second housing 420 in the slid-out state. In a certain embodiment, the connector port 408 may be exposed to the outside through an opening formed in the first housing 410 to correspond to the connector port hole in the slid-in state. In a certain embodiment, the call receiver 406 may include a speaker (e.g., a piezoelectric speaker) that operates without a separate speaker hole.
[0092] The sensor modules 404 and 417 may generate an electrical signal or data value corresponding to an internal operating state or an external environmental state of the electronic device 400. The sensor modules 404 and 417 may include, for example, a first sensor module 404 (e.g., a proximity sensor or an illumination sensor) disposed on the front surface of the electronic device 400 and / or a second sensor module 417 (e.g., a heart rate monitoring (HRM) sensor) disposed on the rear surface of the electronic device 400. According to an embodiment, when viewed from the front of the electronic device 400, the first sensor module 404 may be disposed below the rollable display 430. According to an embodiment, the first sensor module 404 and / or the second sensor module 417 may include at least one of a proximity sensor, an illumination sensor, a time of flight (TOF) sensor, an ultrasonic sensor, a fingerprint recognition sensor, a posture sensor, a gyroscope sensor, an atmospheric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, or a humidity sensor.
[0093] The camera module may include a first camera module 405 disposed on the front surface of the electronic device 400 and a second camera module 416 disposed on the rear surface of the electronic device 400. According to an embodiment, the electronic device 400 may further include a flash (not shown) located near the second camera module 416. According to an embodiment, the camera modules 405 and 416 may include one or more lenses, image sensors, and / or image signal processors. According to an embodiment, when viewed from the front of the electronic device 400, the first camera module 405 may be disposed below the rollable display 430 and configured to capture an object through a portion of the activation area of the rollable display 430.
[0094] According to an embodiment, the first camera module 405 and / or the first sensor module 404 may be arranged to communicate with the external environment through a transmissive area or a perforated opening formed in the rollable display 430 in the second space 4201 of the second housing 420. According to an embodiment, the area of the rollable display 430 facing the first camera module 405 may be formed as a transmissive area with a specified transmittance as a part of the display area for displaying content. According to an embodiment, the transmissive area may be formed to have a transmittance in the range of about 5% to about 20%. For example, the transmissive area of the rollable display 430 may include an area having a lower pixel arrangement density and / or a wire density than the surrounding area. For example, the transmissive area may replace the above-mentioned opening. The first camera module 405 may include a camera, also referred to as an under-display camera (UDC), which is located below the display 430 and receives light through the transmissive area of the display 430. In a certain embodiment, the first sensor module 404 may be disposed in an internal space of the electronic device 400 to perform its function without being visually exposed through the rollable display 430 .
[0095] The electronic device 400 may include a wireless communication circuit (eg, Figure 1 According to an embodiment, the electronic device 400 may include a frame antenna A provided by a conductive first side member 411 of the first housing 410. For example, the frame antenna A may include a conductive portion 427 provided on at least a portion of a second side surface 4112 and a third side surface 4113 of the first side member 411, and electrically separated by one or more segmenting portions 4271 and 4272 formed of a non-conductive material (e.g., a polymer). According to an embodiment, the electronic device 400 may include a side cover 4112a provided on the second side surface 4112 to cover at least a portion of at least one segmenting portion 4271. In a certain embodiment, the frame antenna A may be provided on at least one of the first side surface 4111, the second side surface 4112, and the third side surface 4113. In a certain embodiment, the frame antenna A may be provided on at least one of the fourth side surface 4211, the fifth side surface 4212, and the sixth side surface 4213 of the second housing 420.
[0096] According to an embodiment, switching from the slide-in state to the slide-out state or from the slide-out state to the slide-in state may be automatically performed. For example, the switching of the state may be performed by gear engagement between a sliding motor including a pinion gear disposed in the first space 4101 of the first housing 410 and a rack gear disposed in the second space 4201 of the second housing 420 and engaged with the pinion gear. For example, when a trigger operation for switching the state is detected, a processor (e.g., Figure 1 The processor 120 in the rollable display 430 may drive a slide motor provided inside the electronic device 400. According to an embodiment, the trigger operation may include selecting (eg, touching) an object displayed on the rollable display 430 or manipulating a physical button (eg, a key button) included in the electronic device 400.
[0097] Based on the posture of the electronic device, the display mode of the electronic device can be determined as a vertical mode (or portrait mode) or a horizontal mode (or landscape mode). Figure 1 In the embodiment, the sensor module 176 may include a sensor (e.g., an acceleration sensor or a gyroscope sensor) that identifies the relative position of the side in the housing structure of the electronic device 101 and generates data for identifying the movement and direction of the electronic device 101. The processor 120 may recognize the posture of the electronic device based on the data received from the sensor, and determine the display mode as a landscape mode or a portrait mode based on the recognized posture. The processor 120 may display visual information on the display based on the determined display mode.
[0098] The processor 120 may classify the display area of the display into one or more areas based on the state of the electronic device. The size (area) of the screen to be displayed in the display area (e.g., an application execution screen or a background image) does not change depending on the state change, and the width and height of the screen may be reversed depending on the posture change. For example, if the size of the screen in the portrait mode is M (width) * N (height), the size of the screen in the landscape mode may be N (width) * M (height).
[0099] According to an embodiment, in an electronic device having an outward folding type foldable shell structure, if the electronic device is identified as being in a folded state, the processor 120 may divide the display area into two display areas facing opposite directions. In an electronic device having an outward folding type foldable shell structure, if it is identified that the electronic device is in a partially folded state and the angle between the first shell and the second shell falls within a specified first angle range (e.g., between about 90 degrees and 120 degrees), the processor 120 may divide the display area into two display areas. In an electronic device having an outward folding type foldable shell structure, if it is identified that the electronic device is in an unfolded state or a partially folded state, wherein the angle between the first shell and the second shell falls within a specified second angle range (e.g., between about 120 degrees and 179 degrees), the processor 120 may determine the display area as one without dividing it.
[0100] According to an embodiment, in an electronic device having a foldable housing structure of an inward folding type, if it is recognized that the electronic device is in a partially folded state and the angle between the first housing and the second housing falls within a specified first angle range (e.g., between about 90 degrees and 120 degrees), the processor 120 may divide the display area into two display areas. For example, if the electronic device is recognized as being in a partially folded state Figure 3e In the state shown, the processor 120 can control the display to display a background image in one of the first display area 311 and the second display area 312, and display an application execution screen in the other. In an electronic device having a foldable shell structure of an inward folding type, if it is identified that the electronic device is in an unfolded state or a partially folded state, wherein the angle between the first shell and the second shell falls within a specified second angle range (e.g., between about 120 degrees and 179 degrees), the processor 120 can determine the display area as one without dividing it. The processor 120 can display the background image in an area identified as a blank area in the first display area. The processor 120 can display the background image in an area identified as a blank area in the second display area. If the display area is determined to be one without dividing it, the processor 120 can display the background image in an area identified as a blank area in the entire display area.
[0101] According to an embodiment, in an electronic device having a bar-type housing structure, the processor 120 may determine the display area as one without dividing it. The processor 120 may display a background image in an area identified as a blank area among the entire display area.
[0102] According to an embodiment, in an electronic device having a slidable housing structure, the processor 120 may determine the display area as one without dividing it. The processor 120 may display a background image in an area identified as a blank area in the display area exposed to the outside.
[0103] Based on the application executed by the processor 120, a corresponding execution screen may be displayed on a portion of the display. The processor 120 may configure at least a portion of a blank area of the entire display area of the display that is not covered by the application execution screen and does not include an area where the application execution screen is displayed (hereinafter, the application display area) as a display area for displaying a background image (hereinafter, the background image display area). The position and / or size of the application execution screen may change on the display, for example, depending on user input (e.g., a touch gesture), and therefore, the background image display area may need to be reconfigured. In this document, reconfiguration of the background image display area may be defined as changing the position of the background image display area and / or adjusting (reducing or increasing) its size on the display.
[0104] Based at least on the occurrence of a triggering event that causes reconfiguration of the background image display area, the electronic device may reconfigure the background image display area and display the background image in the reconfigured background image display area.
[0105] According to an embodiment, in an electronic device having a bar-type housing structure, a trigger event may include a change in a display mode discovered as a result of monitoring the posture of the electronic device (e.g., a change in the display mode from a horizontal mode to a vertical mode, or vice versa). The trigger event may include a visual change in an application execution screen recognized as a result of monitoring the state of the application (e.g., the application execution screen is called to the home screen, the display of the application execution screen is terminated, or the position of the application execution screen is changed on the home screen).
[0106] According to an embodiment, in an electronic device having a foldable housing structure or a slidable housing structure, a trigger event may include a change in a display mode. A trigger event may include a visual change in an application execution screen. A trigger event may include a state change recognized as a result of monitoring the state of the electronic device.
[0107] As the background image display area is reconfigured, reconstruction (in other words, editing or modification) of the background image may be required. For example, reconstruction may be to reduce the size of the background image (e.g., a tile-type image) while increasing the number of images to fill the background image display area. According to an embodiment, reconstruction may be to process the image so that the main object of the background image (e.g., the object closest to the center of the image or the object with the largest size among the objects present in the background image, which is identified as a result of image recognition of the background image) is located at the center of the background image display area. According to an embodiment, reconstruction may reduce the size of the background image (e.g., a horizontal image) while maintaining its aspect ratio. The processor 120 may display the reconstructed background image in the background image display area.
[0108] Figure 5 is a block diagram of an electronic device 500 according to an embodiment. Figure 6 1 is a diagram showing connections between modules 541 to 548 configured in the electronic device 500 .
[0109] refer to Figure 5 and Figure 6 , the electronic device 500 may include a posture sensor 510, a state sensor 520, a display 530, a posture monitoring module 541, a state monitoring module 542, an application monitoring module 543, a background image monitoring module 544, a feature extraction module 545, a background image display area reconfiguration module (hereinafter, referred to as a reconfiguration module) 546, a background image reconstruction module (hereinafter, referred to as a reconstruction module) 547, a background image service module 548, a memory 588 and a processor 599. The above components of the electronic device 500 may be operably or electrically connected to each other. Modules 541 to 548 may be implemented in software. For example, the background image service module 548 may be an application (e.g., Figure 1 The remaining modules 541 to 547 may be included in the middleware (e.g., Figure 1 Modules 541 to 548 may be stored as instructions in a non-volatile memory (eg, Figure 1 134) and loaded into a volatile memory (e.g., Figure 1 volatile memory 132) and then by processor 599 (e.g., Figure 1 At least one of modules 541 to 548 may be executed by a processor dedicated to background image service (eg, auxiliary processor 123). If the electronic device 500 is implemented to have a bar-type housing structure, the state sensor 520 and the state monitoring module 542 may be omitted from the electronic device 500.
[0110] The posture sensor 510 may be configured to include a gyroscope sensor and / or an acceleration sensor, and may identify the relative position of the side in the housing structure of the electronic device 500, and generate data for identifying the movement and direction of the electronic device 500. Based on the data received from the posture sensor 510, the processor 120 may recognize the posture of the electronic device 500, and determine the display mode as a horizontal mode or a vertical mode based on the recognized posture. The processor 120 may display visual information on the display based on the determined display mode. For example, a first axis (e.g., Figure 2 The direction facing the x-axis in the figure can be configured to be the same as the direction in which the first side of the housing structure of the electronic device 500 extends. The second axis of the posture sensor 510 (eg, Figure 2 The direction facing the y-axis in the image may be configured to be the same as the direction in which the second side of the housing structure, which is perpendicular to the first side and relatively longer, extends. If the first axis direction of the posture sensor 510 is identified as being the same as or opposite to the direction of gravity, the processor 120 may determine that the display mode is the horizontal mode, and
[0111] The visual information corresponding to the horizontal mode is configured. If the second axis direction of the posture sensor 510 is recognized to be the same as or opposite to the gravity direction, the processor 120 may determine the display mode as the vertical mode and configure the visual information corresponding to the vertical mode.
[0112] The state sensor 520 may generate data for identifying the state of the electronic device 500. In an embodiment, if the electronic device 500 has a foldable housing structure, the state sensor 520 may include a sensor (e.g., an encoder or a Hall sensor) attached to a hinge assembly (e.g., the hinge assembly 340 in FIG. 3) and generating and outputting data corresponding to an angle. According to an embodiment, the state sensor 520 may include a motion sensor (e.g., an acceleration sensor and / or a gyroscope sensor) disposed in the internal space of the housing of the electronic device 500. For example, the state sensor 520 may include a first motion sensor disposed in a first housing (e.g., the first housing 310 in FIG. 3) and generating data corresponding to a posture (position) and / or motion (e.g., angular velocity and / or acceleration) of the first housing, and a second motion sensor disposed in a second housing (e.g., the second housing 320 in FIG. 3) and generating data corresponding to a posture and / or motion of the second housing. The state sensor 520 may be configured as a combination of a Hall sensor and an acceleration sensor. In a certain embodiment, one of the two motion sensors may be used as the posture sensor 510. The processor 599 may recognize the state of the electronic device 500 using the data received from the state sensor 520. For example, the processor 599 may calculate the angle formed between the first housing 310 and the second housing 320 using the data received from the state sensor 520, and recognize the state of the electronic device 500 based on the data obtained as a result of the calculation.
[0113] In an embodiment, if the electronic device 500 has a slidable housing structure, the state sensor 520 may include a sensor (eg, an encoder or a Hall sensor) attached to a sliding member (eg, a reference Figure 4c The state sensor 520 may include a gear (e.g., a pinion) that moves the second housing 420 of the display 530, and when the gear rotates by the force transmitted from the slide motor or the force transmitted from the user through the slide, data corresponding to the rotation angle is generated and output. According to an embodiment, the state sensor 520 may include a sensor (e.g., a pressure sensor) that is provided on a bendable portion of the display 530 and generates data corresponding to the curvature of the portion. Based on the data received from the state sensor 520, the processor 599 may recognize the state of the electronic device 500 as a slide-in state or a slide-out state.
[0114] The posture monitoring module 541 can monitor the posture of the electronic device 500 using the data generated by the posture sensor 510, and provide the monitoring result (posture change) to the reconfiguration module 546 and the background image service module 548. For example, the posture monitoring module 541 can provide a posture change event as the monitoring result to the reconfiguration module 546 and the background image service module 548, the posture change event indicating a change from a first posture corresponding to the horizontal mode to a second posture corresponding to the vertical mode, or vice versa.
[0115] The state monitoring module 542 may monitor the state of the electronic device 500 using data generated by the state sensor 520, and provide the monitoring result to the reconfiguration module 546 and the background image service module 548. According to an embodiment, the state monitoring module 542 may provide the reconfiguration module 546 and the background image service module 548 with a state change event indicating a change from a folded state to an intermediate state, a change from an intermediate state to an unfolded state, or vice versa as a monitoring result. The state monitoring module 542 may provide information indicating an angle between two shells in a foldable shell structure together with the event to the reconfiguration module 546 and the background image service module 548. According to an embodiment, the state monitoring module 542 may provide the reconfiguration module 546 and the background image service module 548 with a state change event indicating a change from a slide-in state to a slide-out state, or vice versa.
[0116] The application monitoring module 543 can monitor the state of the application stored in the memory 588, and provide the monitoring result to the reconfiguration module 546 and the background image service module 548. Here, the monitoring target may include an application that can provide visual information to the user or provide an execution screen (user interface screen) for interaction with the user. The monitoring target may include a preloaded application or a third-party application that can be downloaded from the server 108. The application monitoring module 543 may provide an application change event as a monitoring result to the reconfiguration module 546 and the background image service module 548, and the application change event is an event such as calling the application execution screen to the main screen, ending the display of the application execution screen, or changing the position of the application display area on the main screen. The application monitoring module 543 may provide the identification information (e.g., process ID) of the corresponding application together with the event to the reconfiguration module 546 and the background image service module 548. The application monitoring module 543 may provide the position information (e.g., the coordinates of the upper left corner and the width and height of the display area) of the application display area to display the application execution screen together with the event to the reconfiguration module 546 and the background image service module 548.
[0117] The background image monitoring module 544 may monitor whether a background image change event occurs to display a second background image to replace the first background image being displayed on the display. If a background image change event occurs, the background image monitoring module 544 may notify the feature extraction module 545 and the background image service module 548 of the occurrence of the background image change event. If the background image change event is generated by the background image service module 548, the background image monitoring module 544 may ignore the occurrence of the background image change event without notifying the feature extraction module 545 and the background image service module 548. For example, the fact that the first background image and the second background image are stored in a folder may indicate that the background image change event is generated by the background image service module 548. Therefore, if the first background image and the second background image are stored in the same folder, the background image monitoring module 544 may not react to the occurrence of the background image change event. If the background image change event is generated by another module (e.g., an operating system), the background image monitoring module 544 may react to the occurrence of the background image change event and notify the feature extraction module 545 and the background image service module 548 of the background image change event. The background image monitoring module 544 may provide information about the first background image and information about the second background image to the feature extraction module 545 and the background image service module 548. For example, the background image information provided to the feature extraction module 545 and the background image service module 548 may include a file name, a folder name, a folder path, or unique identification information (e.g., a hash value) of the corresponding image.
[0118] In response to receiving a background image change event from the background image monitoring module 544, the feature extraction module 545 can extract information representing the features of the corresponding image from the background image (e.g., the second background image), and store the extracted feature information in the first memory area 601 allocated for feature information storage in the memory 588. If the background image needs to be reconstructed, the background image reconstruction module 547 can identify the corresponding feature information from the first memory area 601. The feature information extracted by the feature extraction module 545 may include information about the type of the corresponding image (e.g., tile, landscape, or portrait), identification information for identifying the main object from the objects present in the image, location information indicating the location of the main object in the corresponding image (e.g., the coordinates of the upper left corner of the corresponding main object, and the width and height of the main object), or information about whether to allow arbitrary reconstruction of the corresponding image. Whether reconstruction is allowed is determined by the business operator who provides or generates the corresponding image, and can be defined in the metadata of the corresponding image. The above-mentioned feature information can be extracted from the metadata of the corresponding image file. The identification information can be extracted using an artificial intelligence model. For example, the artificial intelligence model can be machine-learned to output feature information as a result value of a given input value (image). The feature extraction module 545 may input the background image as an input value to the artificial intelligence model. The feature extraction module 545 may obtain feature information from the result value output by the artificial intelligence model.
[0119] The reconfiguration module 546 may reconfigure the background image display area based on the monitoring results provided from the monitoring modules 541, 542, and 543, and store the size and position information about the reconfigured background image display area in the second memory area 602 allocated for storing the position information of the background image display area in the memory 588. If the screen of the electronic device 500 needs to be reconstructed, the background image service module 548 may identify the corresponding position information from the second memory area 602.
[0120] According to an embodiment, the reconfiguration module 546 may receive an event of calling the application execution screen to the main screen while displaying the background image through the entire display area configured as the background image display area of the display 530 from the application monitoring module 543. The reconfiguration module 546 may reduce the background image display area so as not to overlap with the application execution screen called to the main screen. The reconfiguration module 546 may provide the position information of the reduced background image display area to the background image service module 548.
[0121] According to an embodiment, the reconfiguration module 546 may receive an event from the application monitoring module 543 to terminate the display of the application execution screen so as not to overlap each other while the background image and the application execution screen are being displayed. In response to the termination of the display of the application execution screen, the reconfiguration module 546 may enlarge the background image display area to, for example, the entire display area. The reconfiguration module 546 may provide the position information of the enlarged background image display area to the background image service module 548.
[0122] According to an embodiment, the reconfiguration module 546 may receive an event from the application monitoring module 543 that changes the position of the application display area so as not to overlap each other while the background image and the application execution screen are being displayed. The application execution screen may be displayed in the application display area whose position is changed. In response to the change in the position of the application execution screen, the reconfiguration module 546 may reconfigure the background image display area (e.g., reduce the size or change the position to be displayed) so that it does not overlap with the application execution screen. The reconfiguration module 546 may provide the position information of the reconfigured background image display area to the background image service module 548.
[0123] According to an embodiment, the reconfiguration module 546 may receive an event from the posture monitoring module 541 indicating a change from a first posture corresponding to a horizontal mode to a second posture corresponding to a vertical mode, or vice versa, while the background image and the application execution screen are being displayed so as not to overlap each other. In response to the change in posture, the reconfiguration module 546 may reconfigure the background image display area (e.g., reduce the size or change the position to be displayed) so that it does not overlap with the application execution screen. The reconfiguration module 546 may provide the position information of the reconfigured background image display area to the background image service module 548.
[0124] According to an embodiment, the reconfiguration module 546 may receive an event indicating a state change from the state monitoring module 542 while the background image and the application execution screen are being displayed so as not to overlap each other. In response to the state change, the reconfiguration module 546 may reconfigure the background image display area (e.g., reduce the size or change the position to be displayed) so that it does not overlap with the application execution screen. The reconfiguration module 546 may provide the position information of the reconfigured background image display area to the background image service module 548.
[0125] The reconstruction module 547 may reconstruct the background image to be displayed in the background image display area reconfigured by the reconfiguration module 546 based on the feature information received from the feature extraction module 545. The reconstruction module 547 may provide the reconstructed background image to the background image service module 548.
[0126] According to an embodiment, the reconstruction module 547 may reconstruct the background image (eg, a tile type image) by reducing the size of the background image while increasing the number of the background images so as to fill the background image display area.
[0127] According to an embodiment, the reconstruction module 547 can reconstruct the background image by processing the image so that the main object of the background image (for example, the object closest to the center of the image or the object with the largest size among the objects present in the background image, which is identified as a result of image recognition of the background image) is located in the center of the background image display area.
[0128] According to an embodiment, the reconstruction module 547 may reconstruct the background image by reducing the size of the background image (eg, landscape image) to fit the background image display area while maintaining the aspect ratio of the background image display area.
[0129] The background image service module 548 may display the background image reconstructed by the reconstruction module 547 in the background image display area reconfigured by the reconfiguration module 546 .
[0130] Figure 7 is a flowchart showing an operation for providing a background image service to a user according to an embodiment. The processor 599 may execute the above modules 541 to 548 to perform Figure 7 Operations in . Figure 8a and Figure 8b is a diagram illustrating an operation for reconstructing a tile-type background image. Figure 9a and 9b is a diagram illustrating an operation for reconstructing an object-type background image. Fig.10a and Fig.10b is a diagram showing an operation for reconstructing a landscape-type background image. Fig.11 is a diagram showing a screen layer structure according to an embodiment.
[0131] In operation 710, the processor 599 may identify whether a condition is satisfied for reconstructing the screen of the electronic device 500 being displayed on the display 530. The reason for identifying whether the screen reconstruction condition is satisfied is that if screen reconstruction (e.g., background image display area reconstruction and / or background image reconstruction) is frequently performed, the performance of the electronic device 500 may be degraded and unnecessary power consumption may be caused.
[0132] According to an embodiment, if no additional gesture change event occurs within a specified time (eg, several seconds) from the time when the gesture change event occurs by the gesture monitoring module 541 , the screen reconstruction condition may be considered to be satisfied.
[0133] According to an embodiment, if no additional state change event occurs within a specified time from the time when the state change event occurs in the state monitoring module 542 , it may be considered that the screen reconstruction condition is satisfied.
[0134] According to an embodiment, if a display end event (or a call event) does not occur within a specified time from the time when the application monitoring module 543 generates a call event that calls the application execution screen to the main screen (or a display end event that ends the display of the application execution screen), the screen reconstruction condition may be considered to be satisfied. If the display of the application execution screen is terminated within a specified time after the application execution screen is called to the main screen (or vice versa), the screen reconstruction condition may be considered not to be satisfied.
[0135] According to an embodiment, if no additional event (e.g., a call event, a display end event, or a position change event) occurs within a specified time from the time when the application monitoring module 543 changes the position change event of the application execution screen on the main screen, and if the ratio of the blank area to the activation area on the display 530 where visual information is being displayed is greater than or equal to a specified value, the screen reconstruction condition may be considered to be satisfied. If no additional event occurs within a specified time from the time when the position change event occurs and if the ratio of the blank area to the entire display area (activation area) calculated after the position change event is greater than the ratio of the blank area to the entire display area calculated before the position change event by a specified value or more, the screen reconstruction condition may be considered to be satisfied. Here, the display area (activation area) of the display 530 activated to display visual information may be the entire display area of the display 530 in the bar-type electronic device 500, may be changed depending on the degree of folding of the foldable housing in the foldable electronic device 500 (e.g., the entire display area in the unfolded state or one of the first display area and the second display area divided by the hinge assembly in the partially folded state), and may be the portion of the display area of the display 530 in the slidable electronic device 500 that is exposed to the outside.
[0136] According to an embodiment, if no additional background image change event occurs from the time when the background image change event occurs by the background image monitoring module 544, it may be considered that the screen reconstruction condition is satisfied.
[0137] If the screen reconstruction condition is satisfied, the processor 599 may reconfigure the background image display area based on the result of monitoring the posture, state, and application in operation 715. If the posture, state, and application have not changed (e.g., if there is a change only in the background image) as a result of monitoring, the processor 599 may skip operation 715 and perform operation 720.
[0138] In operation 720, the processor 599 may collect information indicating the size and position of an area configured as a background image display area in the active area of the display 530 and information indicating features of a background image to be displayed in the configured background image display area, which are the basis for screen reconstruction.
[0139] According to an embodiment, the processor 599 may obtain the size and position information of the display area (e.g., at least a portion of the area configured as a blank area) capable of fully displaying the background in the activation area of the display 530 by monitoring the result of the application. The processor 599 may store the size and position information of the background image display area obtained by monitoring the result of the application in, for example, the second memory area 602. If the screen reconstruction condition is met, the processor 599 may obtain (collect) the size and position information of the background image display area from the second memory area 602.
[0140] According to an embodiment, the processor 599 may obtain feature information from the background image, and store the obtained feature information together with the corresponding background image and its identification information (e.g., hash value) in, for example, the first memory area 601. Based on the occurrence of an event indicating an application change, the processor 599 may obtain feature information of the first background image being displayed on the display 530 from the first memory area 601. According to an embodiment, the processor 599 may obtain feature information of the second background image from the first memory area 601 based on the occurrence of an event that triggers the background image to change from the first background image to the second background image. According to an embodiment, the processor 599 may also obtain feature information of the first background image being displayed on the display 530 from the first memory area 601 based on the occurrence of a posture change event or a state change event.
[0141] In operation 730, the processor 599 may determine whether to allow reconstruction of the background image based on the collected feature information. If it is recognized that the collected feature information includes information indicating that reconstruction is allowed, the processor 599 may perform operation 750. If it is recognized that the collected feature information includes information indicating that reconstruction is not allowed, the processor 599 may select another background image that allows reconstruction from, for example, the first memory area 601, collect feature information of the selected background image from the first memory area 601, and then perform operation 750.
[0142] In operation 750, the processor 599 may reconstruct the background image based on the feature information collected in operation 720 or operation 740. First, the processor 599 may identify the type of the background image from the feature information. The processor 599 may reconstruct the background image based on the identified type. An embodiment for type-based background image reconstruction operation will be described with reference to FIGS. 8 to 10.
[0143] refer to Figure 8a and Figure 8b , the processor 599 may display a first background image 811 of a tile type in a first background image display area 821 (e.g., the entire display area of the display 530). When an event occurs to call the application execution screen to the display 530, the processor 599 may configure an application display area 830 in the display area of the display 530. The processor 599 may configure a second background image display area 822 that is smaller (reduced in area) than the first background image display area 821 so as not to overlap with the application display area 830. The processor 599 may generate a second background image 812 by reducing the size of the first background image 811 but increasing the number of images so that they fill up the second background image display area 822.
[0144] Return to reference Figure 8a and Figure 8b If an event that terminates the execution of the application occurs while the application execution screen 840 is being displayed in the application display area 830 and while the second background image 812 is being displayed in the second background image display area 822, the processor 599 may reconfigure the area in which the background image is to be displayed into the first background image display area 811 and reconstruct the background image to be displayed in the first background image display area 811 as the first background image 811.
[0145] refer to Figure 9a and Figure 9b , the processor 599 may display a first background image 911 of an object type in a first background image display area 921 (e.g., the entire display area of the display 530). If an event occurs to call the application execution screen to the display 530, the processor 599 may configure an application display area 930 in the display area of the display 530. The processor 599 may configure a second background image display area 922 that is smaller than the first background image display area 921 so as not to overlap with the application display area 930. The processor 599 may process the first background image 911 so that a main object 911a of the first background image 911 (e.g., an object closest to the center of the image or an object with the largest size among the objects present in the first background image 911, which is recognized as a result of image recognition of the first background image 911) is located at the center of the second background image display area 922, thereby generating a second background image 912.
[0146] Return to reference Figure 9a and Figure 9bIf an event that terminates the execution of the application occurs while the application execution screen 940 is being displayed in the application display area 930 and while the second background image 912 is being displayed in the second background image display area 922, the processor 599 may reconfigure the area in which the background image is to be displayed into the first background image display area 911 and reconstruct the background image to be displayed in the first background image display area 911 into the first background image 911.
[0147] refer to Fig.10a and Fig.10b , the processor 599 may display a landscape-type first background image 1011 in a first background image display area 1021 (e.g., the entire display area of the display 530). If an event occurs to call the application execution screen to the display 530, the processor 599 may configure an application display area 1030 in the display area of the display 530. The processor 599 may configure a second background image display area 1022 that is smaller than the first background image display area 1021 so as not to overlap with the application display area 1030. The processor 599 may reduce the first background image 1011 to conform to the width or height of the second background image display area 1022 while maintaining its aspect ratio, thereby generating the second background image 1012. For example, the width and height of the first background image 1011 may be W1 and H1, respectively. The processor 599 may reduce the width and height from W1 and H1 to W2 and H2 while maintaining the aspect ratio, and reduce the width to conform to the width W3 of the second background image display area 1022.
[0148] Return to reference Fig.10a and Fig.10b If an event that terminates the execution of the application occurs while the application execution screen 1040 is being displayed in the application display area 1030 and the second background image 1012 is being displayed in the second background image display area 1022, the processor 599 can reconfigure the area where the background image is to be displayed into the first background image display area 1021, and reconstruct the background image to be displayed in the first background image display area 1021 as the first background image 1011.
[0149] In operation 760, the processor 599 may reconstruct the screen using the reconstructed background image, and display the reconstructed screen on the activated display area (activation area) of the display 530 to display visual information. Here, the activation area where the reconstructed screen is to be displayed may be the entire display area of the display 530 in the bar-type electronic device 500. It may change depending on the degree of folding of the foldable shell in the foldable electronic device 500. For example, if the electronic device 500 is in an unfolded state, the entire display area of the display 530 may be configured as an activation area. If the electronic device 500 is in a partially folded state, one of the first display area and the second display area divided by the hinge assembly may be configured as an activation area. According to an embodiment, even if the electronic device 500 is in a partially folded state, the entire display area of the display 530 may be configured as an activation area. If the electronic device 500 is configured as a slidable type, a portion of the display area of the display 530 exposed to the outside may be configured as an activation area. Reference will be made to Fig.11 An embodiment of an operation of displaying a reconstruction screen in an active area is described.
[0150] refer to Fig.11 , the processor 599 may generate an image of a specified monochrome (e.g., white) filling the entire activation area as a first layer image 1110. The processor 599 may generate a second layer image 1120 filling the entire activation area. The processor 599 may generate the second layer image 1120 having a representative color (e.g., a color having the highest proportion among the colors constituting the background image) from the background image reconstructed in operation 750. Alternatively, the processor 599 may generate the second layer image 1120 by processing the background image reconstructed in operation 750 to appear blurred (so-called blur processing). The processor 599 may synthesize the layer images 1110, 1120, and 1140 by superimposing the second layer image 1120 on the first layer image 1110 and superimposing the third layer image 1140 as the background image reconstructed in operation 750 on an area 1130 corresponding to the background image display area in the second layer image 1120, thereby generating a background screen 1100 to be displayed in the activation area. The processor 110 may display a background screen 1100 including a reconstructed background image on the active area of the display 530. The processor 110 may display the application execution screen as a foreground screen of the background screen 1100. For example, the processor 110 may display the application execution screen on the second layer image 1120 so as not to overlap with the third layer image 1140 as the background image.
[0151] Fig.12 is a diagram illustrating connections among the application monitoring module 543, the background image display area reconfiguration module 546, and the background image service module 548 according to an embodiment.
[0152] The reconfiguration module 546 can receive application change events from the application monitoring module 543 as a result of monitoring performed by the application monitoring module 543, such as a call event that calls the application execution screen to the activation area of the display 530, an end event that terminates the display of the application execution screen in the activation area of the display 530, or a position change event that changes the position of the application execution screen in the activation area.
[0153] The reconfiguration module 546 may manage the second memory area 602 based on the type of application change event received from the application monitoring module 543. For example, when a call event is received, the reconfiguration module 546 may store identification information (e.g., process ID) of the application corresponding to the called application execution screen in the second memory area 602. In addition, when a call event is received, the reconfiguration module 546 may configure the background image display area so as not to overlap with the called application execution screen, and store the size and position information of the configured background image display area in the second memory area 602. When a position change event is received, the reconfiguration module 546 may reconfigure the background image display area so as not to overlap with the application execution screen whose position is changed, and update the existing size and position information stored in the second memory area 602 with the size and position information of the reconfigured background image display area. When an end event is received, the reconfiguration module 546 may delete the identification information of the corresponding application from the second memory area 602. In addition, when an end event is received, the reconfiguration module 546 can reconfigure the background image display area to the entire activation area, and update the existing size and position information stored in the second memory area 602 with the size and position information of the reconfigured background image display area.
[0154] If the background image service module 548 requests the size and position information of the background image display area for screen reconstruction, the reconstruction module 546 may obtain the corresponding information from the second memory area 602 and provide it to the background image service module 548 .
[0155] Fig.13 is a flowchart showing the operation of managing a database related to a background image display area according to an embodiment. The processor 599 may execute the above modules 543, 546 and 548 to perform Fig.13 You can Figure 7 Before executing operation 710 Fig.13 Operations in .
[0156] In operation 1310, the processor 599 may recognize that a change related to the state of the application has occurred. For example, the processor 599 may recognize that the application execution screen has been called to the display 530, the display of the application execution screen has ended, or the position of the application execution screen has changed on the display 530.
[0157] In operation 1320, the processor 599 may manage the corresponding database (e.g., the second memory area 602) based on the type of change identified (e.g., call, display end, or position change). If the type of change is display end, the processor 599 may delete the identification information of the corresponding application from the database. If the type of change is call, the processor 599 may store the size of the application execution screen, the position information about the display area of the display 530, and the identification information of the corresponding application in the database. If the type of change is position change, the processor 599 may update the existing position information stored in the database with the changed position information about the display area of the display 530.
[0158] Fig.14 is a diagram showing connections among a gesture monitoring module 541, a state monitoring module 542, a background image display area reconfiguration module 546, and a background image service module 548 according to an embodiment.
[0159] The reconfiguration module 546 may receive an event from the posture monitoring module 541 as a monitoring result performed by the posture monitoring module 541, the event indicating a change from a first posture corresponding to the horizontal mode to a second posture corresponding to the vertical mode, or vice versa. Here, the posture change event may be generated by the operating system 1401 and sent to the reconfiguration module 546 through the posture monitoring module 541.
[0160] The reconfiguration module 546 may receive a state change event from the state monitoring module 542 as a monitoring result performed by the state monitoring module 542. According to an embodiment, the reconfiguration module 546 may receive a state change event from the state monitoring module 542, the state change event indicating a change from a folded state to an intermediate state, from an intermediate state to an unfolded state, or vice versa. In addition, the reconfiguration module 546 may receive information indicating an angle between two shells in a foldable shell structure from the state monitoring module 542. According to an embodiment, the reconfiguration module 546 may receive a state change event from the state monitoring module 542, the state change event indicating a change from a slide-in state to a slide-out state, or vice versa. Here, the state change event and the angle information may be generated by the operating system 1401 and sent to the reconfiguration module 546 via the state monitoring module 542.
[0161] The reconfiguration module 546 can manage the second memory area 602 based on the events and information received from the posture monitoring module 541 and the state monitoring module 542. For example, when a state change event is received, the reconfiguration module 546 can update the existing state information stored in the second memory area 602 with information indicating the state after the change. The reconfiguration module 546 can update the existing angle information stored in the second memory area 602 with the angle information received from the state monitoring module 542.
[0162] The reconfiguration module 546 may classify the display area of the display 530 into one or more areas based on the updated state and angle information in the second memory area 602. The reconfiguration module 546 may configure at least a portion of the display area identified as a blank area as a background image display area, and store (newly store or update) the configuration information (size and position information) in the second memory area 602.
[0163] In an electronic device 500 having a foldable shell structure of an outward folding type, according to an embodiment, if the electronic device 500 is identified as being in a folded state, the reconfiguration module 546 may divide the display area into two display areas facing opposite directions. If it is identified that the electronic device 500 is in a partially folded state and the angle between the first shell and the second shell falls within a specified first angle range (e.g., between about 90 degrees and 120 degrees), the reconfiguration module 546 may divide the display area into two display areas. If it is identified that the electronic device 500 is in an unfolded state or a partially folded state, wherein the angle between the first shell and the second shell falls within a specified second angle range (e.g., between about 120 degrees and 179 degrees), the reconfiguration module 546 may determine the display area as one without dividing it.
[0164] In the electronic device 500 having a foldable housing structure of an inward folding type, according to an embodiment, if it is recognized that the electronic device 500 is in a partially folded state and the angle between the first housing and the second housing falls within a specified first angle range (e.g., between about 90 degrees and 120 degrees), the reconfiguration module 546 may divide the display area into two display areas. For example, if the electronic device 500 is recognized as being in a partially folded state Figure 3eThe state shown, the reconfiguration module 546 can display the background image in one of the first display area 311 and the second display area 312, and display the application execution screen in the other. If it is identified that the electronic device 500 is in an expanded state or a partially folded state, wherein the angle between the first shell and the second shell falls within a specified second angle range (for example, between about 120 degrees and 179 degrees), the reconfiguration module 546 can determine the display area as one without dividing it. The reconfiguration module 546 can configure the area identified as a blank area in the first display area as a background image display area. The reconfiguration module 546 can configure the area identified as a blank area in the second display area as a background image display area. If the display area is determined to be one without dividing it, the processor 120 can configure at least a portion of the area identified as a blank area in the entire display area as a background image display area.
[0165] In the electronic device 500 having a strip-type housing structure, according to an embodiment, the reconfiguration module 546 may determine the display area as one without dividing it. The processor 120 may configure at least a portion of the area identified as a blank area in the entire display area as a background image display area.
[0166] In the electronic device 500 with a slidable housing structure, according to an embodiment, the reconfiguration module 546 can determine the display area as one without dividing it. The reconfiguration module 546 can configure at least a portion of the area identified as a blank area in the display area exposed to the outside as a background image display area.
[0167] If the background image service module 548 requests information about the number of display areas and the size and position of the background image display area for screen reconstruction, the reconstruction module 546 can obtain the corresponding information from the second memory area 602 and provide it to the background image service module 548.
[0168] Fig.15 is a flowchart showing the operation of managing a database related to a background image display area according to an embodiment. The processor 599 may execute the above modules 541, 542, 546 and 548 to perform Fig.15 You can Figure 7 Before executing operation 710 Fig.15 Operations in .
[0169] At operation 1510, the processor 599 may recognize that a change has occurred with respect to the posture and / or state of the electronic device 500. Here, the posture change and the state change have been described above (eg, see Fig.14), so the description will be omitted.
[0170] In operation 1520 , the processor 599 may store information related to the change of posture and / or state (eg, posture information, state information, and angle information) in a database (eg, the second memory area 602 ).
[0171] In operation 1530, the processor 599 may classify the display area of the display 530 into one or more areas based on the information stored in the database. Fig.14 ), the display area can be classified into one or two areas depending on the type of shell structure applied to the electronic device 500.
[0172] At operation 1540 , the processor 599 may configure at least a portion of the area identified as the blank area in the classified display area as a background image display area, and store (newly store or update) the configuration information (size and position information) in the second memory area 602 .
[0173] Fig.16 is a diagram showing connections among a background image monitoring module 544, a feature extraction module 545, a background image reconstruction module 547, and a background image service module 548 according to an embodiment.
[0174] The feature extraction module 545 may receive a background image change event as a monitoring result performed by the background image monitoring module 544 from the background image monitoring module 544 to display a second background image by replacing the first background image being displayed on the display 530. The background image change event may be generated by the operating system 1601 and sent to the feature extraction module 545 through the background image monitoring module 544.
[0175] In response to receiving the background image change event, the feature extraction module 545 can obtain the identification information of the second background image. For example, the feature extraction module 545 can calculate the hash value of the second background image as the unique identification information of the second background image. The feature extraction module 545 can identify whether the unique identification information (hash value) is stored in the first memory area 601, and if there is unique identification information matching it as a result of the identification, the event reception is ignored without responding. If there is no matching unique identification information as a result of the identification, the feature extraction module 545 can extract feature information from the second background image and store the extracted feature information together with the second background image and its unique identification information in the first memory area 601. The feature information stored in the first memory area 601 may include information indicating whether arbitrary reconstruction of the corresponding background image is allowed.
[0176] If the reconstruction module 547 requests the background image and its feature information to reconstruct the background image, the feature extraction module 545 may obtain the background image and its feature information from the first memory area 601 and provide them to the background image reconstruction module 547. The reconstruction module 547 may reconstruct the background image to be displayed in the background image display area reconfigured by the reconfiguration module 546. The reconstruction module 547 may provide the reconstructed background image to the background image service module 548.
[0177] Fig.17 is a flowchart showing the operation of managing a database related to extracting feature information of a background image according to an embodiment. The processor 599 may execute the above modules 544, 545, 547 and 548 to perform Fig.17 You can Figure 7 Before executing operation 710 Fig.17 Operations in .
[0178] In operation 1710, the processor 599 may recognize the occurrence of an event requesting a change from a first background image being displayed on the display 530 to a second background image. For example, the background image change event may occur whenever a predetermined period of time passes or whenever the display 530 is turned off and then on.
[0179] In operation 1720, the processor 599 may obtain unique identification information of the second background image in response to the background image change request. For example, the processor 599 may calculate a hash value (unique identification information) of the second background image.
[0180] In operation 1730 , the processor 599 may recognize that the obtained unique identification information is not stored in the database (eg, the first memory area 601 ).
[0181] In operation 1740, the processor 599 may extract feature information from the second background image and store the extracted feature information together with the second background image and its unique identification information in a database.
[0182] Fig.18 is a flowchart illustrating an operation for providing a background image service according to an embodiment.
[0183] In operation 1810 , the processor 599 may display a first background image in a first background image display area configured to display a background image in a display area activated to display visual information on the display 530 .
[0184] In operation 1820, the processor 599 may monitor whether the posture of the electronic device 500 is changed from a first posture corresponding to the portrait mode to a second posture corresponding to the landscape mode or from the second posture to the first posture based on the data received from the posture sensor 510. In addition, the processor 599 may monitor whether there is a visual change on the application execution screen in the activated display area.
[0185] In operation 1830, based on recognizing a change in the posture of the electronic device 500 or a visual change in the application execution screen, the processor 599 may configure a second background image display area in the activated display area, the size of which is reduced from the first background image display area.
[0186] At operation 1840, the processor 599 may reconstruct the first background image into a second background image to be displayed in the second background image display area. The processor 599 may display the second background image in the second background image display area.
[0187] According to an embodiment, an electronic device (e.g., electronic device 500) may include: a housing of the electronic device; a display (e.g., display 530) disposed in the housing; a posture sensor (e.g., posture sensor 510) configured to generate data for recognizing a posture of the electronic device; a processor (e.g., processor 599) operably connected to the posture sensor and the display; and a memory (e.g., memory 588) operably connected to the processor and configured to store an application. The memory may store instructions that, when executed, cause the processor to perform operations. The instructions may cause the processor to: display a first background image in a first background image display area, the first background image display area being configured to display a background image in a display area activated to display visual information on the display. The instructions may cause the processor to: monitor whether the posture of the electronic device is changed from a first posture corresponding to a portrait mode to a second posture corresponding to a landscape mode or from the second posture to the first posture based on data received from the posture sensor. The instructions may cause the processor to: monitor whether there is a visual change in the execution screen of the application in the activated display area. The instructions may cause the processor to configure a second background image display area in the activated display area based on recognizing a change in the posture of the electronic device or a visual change in an application execution screen as a result of the monitoring, the second background image display area having a size reduced from that of the first background image display area. The instructions may cause the processor to reconstruct the first background image into a second background image to be displayed in the second background image display area. The instructions may cause the processor to display the second background image in the second background image display area.
[0188] The instructions may cause the processor to: recognize, as an event indicating a visual change of the application execution screen, a call event for calling the application execution screen to the activated display area, a display end event for terminating the display of the application execution screen in the activated display area, or the occurrence of a position change event for changing the position of the application execution screen in the activated display area.
[0189] The instructions may cause the processor to configure the second background image display area in the activated display area so as not to overlap with the application execution screen based on recognition of the occurrence of the calling event.
[0190] The instructions may cause the processor to configure the second background image display area in the activated display area so as not to overlap with the application execution screen whose position has been changed based on the recognition of the occurrence of the position change event.
[0191] The instructions may cause the processor to configure, based on recognition of occurrence of the display end event, an area for displaying the background image from the second background image display area to the first background image display area.
[0192] The instructions may cause the processor to rebuild the first background image into the second background image based on the display end event not occurring within a specified time from the time when the calling event occurs.
[0193] The instructions may cause the processor to rebuild the first background image into the second background image based on the call event not occurring within a specified time from the time when the display end event occurs.
[0194] The instructions may cause the processor to reconstruct the first background image into the second background image based on the fact that an additional event does not occur within a specified time from the time when the position change event occurs and the ratio of the blank area not occupied by the application execution screen to the activated display area is greater than or equal to a specified value.
[0195] The instructions may cause the processor to reconstruct the first background image into the second background image based on the ratio of the blank area to the activated display area after the position change event occurs being greater than the ratio of the blank area to the entire display area before the position change event occurs by a specified value or more.
[0196] The housing may be a foldable housing including a first housing, a second housing, and a hinge assembly, wherein the hinge assembly is configured to connect the first housing and the second housing to be rotatable. The display may be a flexible display extending from the first housing across the hinge assembly to the second housing. The electronic device may further include a state sensor (e.g., a state sensor 520) configured to generate data corresponding to an angle between the first housing and the second housing. The instructions may cause the processor to: identify, based on the angle data received from the state sensor, that the state of the electronic device changes from a folded state to an unfolded state or from the unfolded state to the folded state. The instructions may cause the processor to: configure the second background image display area in the activated display area based on identifying a posture change of the electronic device, a visual change of the application execution screen, or a state change of the electronic device.
[0197] The housing may be a slidable housing including a first housing and a second housing, the second housing being configured to slide into the first housing or slide out from the first housing. The display may be a flexible display having a portion that slides into the first housing when the second housing slides into the first housing. The electronic device may further include a state sensor configured to generate data for identifying a slide-in state and a slide-out state, wherein the slide-in portion of the second housing is accommodated in the first housing and the slide-out state, wherein the slide-in portion of the second housing slides out of the first housing. The instructions may cause the processor to: based on the data received from the state sensor, identify that the state of the electronic device changes from the slide-in state to the slide-out state or from the slide-out state to the slide-in state. The instructions may cause the processor to: configure the second background image display area in the activated display area based on a change in the posture of the electronic device, a visual change in the application execution screen, or a change in the state of the electronic device.
[0198] The instructions may cause the processor to reconstruct the first background image into the second background image based on that an additional state change is not recognized within a specified time from a time when a state change of the electronic device is recognized.
[0199] The instructions may cause the processor to reconstruct the first background image into the second background image based on that an additional gesture change is not recognized within a specified time from when a gesture change of the electronic device is recognized.
[0200] The instructions may cause the processor to extract feature information from the first background image, and reconstruct the first background image into the second background image based on the feature information including information indicating that reconstruction is allowed.
[0201] The instructions may cause the processor to: identify the type of the first background image from the feature information. The instructions may cause the processor to: reconstruct the first background image into the second background image based on the identified type.
[0202] The instructions may cause the processor to generate the second background image by reducing the size of the first background image and increasing the number of the first background image to fill the second background image display area based on the identified type being a tile.
[0203] The instructions may cause the processor to generate the second background image by processing the first background image so that a main object of the first background image is located at the center of a display area of the second background image based on the identified type being an object.
[0204] The instructions may cause the processor to generate the second background image by reducing the first background image to fit a width or height of a second background image display area while maintaining an aspect ratio of the first background image based on the identified type being landscape.
[0205] According to an embodiment, a method for operating an electronic device may include: displaying a first background image in a first background image display area, the first background image display area being configured to display the background image in a display area activated to display visual information on a display of the electronic device. The method may include: monitoring whether the posture of the electronic device is changed from a first posture corresponding to a portrait mode to a second posture corresponding to a landscape mode or from the second posture to the first posture based on data received from a sensor provided in the electronic device. The method may include: monitoring whether there is a visual change in an execution screen of an application in the activated display area. The method may include: configuring a second background image display area in the activated display area based on recognizing a change in the posture of the electronic device or a visual change in an application execution screen as a result of the monitoring, the second background image display area having a size reduced from that of the first background image display area. The method may include: reconstructing the first background image into a second background image to be displayed in the second background image display area. The method may include: displaying the second background image in the second background image display area.
[0206] Monitoring whether there is a visual change in the application execution screen may include: identifying the occurrence of a call event for calling the application execution screen to the activated display area, a display end event for terminating the display of the application execution screen in the activated display area, or a position change event for changing the position of the application execution screen in the activated display area.
Claims
1. An electronic device, comprising: A housing of the electronic device; a display, the display being disposed in the housing; a posture sensor configured to generate data for identifying a posture of the electronic device; a processor operatively connected to the gesture sensor and the display; as well as a memory operatively connected to the processor and configured to store an application, The memory stores instructions which, when executed, cause the processor to: displaying a first background image in a first background image display area, the first background image display area being configured to display a background image in a display area activated to display visual information on the display; Based on data received from the posture sensor, monitoring whether the posture of the electronic device changes from a first posture corresponding to the portrait mode to a second posture corresponding to the landscape mode or from the second posture to the first posture; monitoring whether there is a visual change in an execution screen of an application in the activated display area; configuring a second background image display area in the activated display area, the second background image display area having a size reduced from that of the first background image display area, based on recognizing a change in the posture of the electronic device or a visual change in an application execution screen as a result of the monitoring; reconstructing the first background image into a second background image to be displayed in the second background image display area; and The second background image is displayed in the second background image display area.
2. The electronic device according to claim 1, wherein: The instructions cause the processor to recognize, as an event indicating a visual change of the application execution screen, the occurrence of a call event for calling the application execution screen to the activated display area, a display end event for terminating the display of the application execution screen in the activated display area, or a position change event for changing the position of the application execution screen in the activated display area.
3. The electronic device according to claim 2, wherein: The instructions cause the processor to: Based on the identification of the occurrence of the calling event, configuring the second background image display area in the activated display area so as not to overlap with the application execution screen; Based on the recognition of the occurrence of the position change event, configuring the second background image display area in the activated display area so as not to overlap with the application execution screen whose position has changed; as well as Based on the recognition of the occurrence of the display end event, the area for displaying the background image is configured from the second background image display area to the first background image display area.
4. The electronic device according to claim 2, wherein: The instructions cause the processor to: reconstructing the first background image into the second background image based on the display end event not occurring within a specified time from the time when the calling event occurs; reconstructing the first background image into the second background image based on that the calling event does not occur within a specified time from the time when the display end event occurs; reconstructing the first background image into the second background image based on that an additional event does not occur within a specified time from the time when the position change event occurs and that a ratio of a blank area not occupied by the application execution screen to the activated display area is greater than or equal to a specified value; as well as The first background image is reconstructed into the second background image based on that a ratio of a blank area to the activated display area after the position change event occurs is greater than a ratio of a blank area to the entire display area before the position change event occurs by a specified value or more.
5. The electronic device according to any one of claims 1 to 4, in, The housing is a foldable housing, comprising a first housing, a second housing and a hinge assembly, wherein the hinge assembly is configured to connect the first housing and the second housing to be rotatable. wherein the display is a flexible display extending from the first housing across the hinge assembly to the second housing, The electronic device further includes a state sensor configured to generate data corresponding to an angle between the first shell and the second shell. The instructions cause the processor to: recognizing that the state of the electronic device changes from a folded state to an unfolded state or from the unfolded state to the folded state based on the angle data received from the state sensor; and Based on recognizing a posture change of the electronic device, a visual change of the application execution screen, or a state change of the electronic device, the second background image display area is configured in the activated display area.
6. The electronic device according to any one of claims 1 to 4, in, The housing is a slidable housing, comprising a first housing and a second housing, wherein the second housing is configured to slide into or out of the first housing, wherein the display is a flexible display, and the flexible display has a portion that slides into the first shell when the second shell slides into the first shell, The electronic device further comprises a state sensor, wherein the state sensor is configured to generate data for identifying a slide-in state and a slide-out state, wherein the slide-in portion of the second shell is accommodated in the first shell, and wherein the slide-out state the slide-in portion of the second shell slides out of the first shell. The instructions cause the processor to: Based on the data received from the state sensor, recognizing that the state of the electronic device changes from the slide-in state to the slide-out state or from the slide-out state to the slide-in state; and The second background image display area is configured in the activated display area based on a change in the posture of the electronic device, a visual change in the application execution screen, or a change in the state of the electronic device.
7. The electronic device according to claim 5 or 6, wherein: The instructions cause the processor to reconstruct the first background image into the second background image based on failure to recognize an additional state change within a specified time from a time when a state change of the electronic device is recognized.
8. The electronic device according to any one of claims 1 to 7, wherein: The instructions cause the processor to reconstruct the first background image into the second background image based on failure to recognize an additional gesture change within a specified time from a time when a gesture change of the electronic device is recognized.
9. The electronic device according to any one of claims 1 to 8, wherein: The instructions cause the processor to: Extracting feature information from the first background image; and Based on the feature information including information indicating that reconstruction is allowed, the first background image is reconstructed into the second background image.
10. The electronic device according to claim 9, wherein: The instructions cause the processor to: identifying a type of the first background image from the feature information; and Based on the identified type, the first background image is reconstructed into the second background image.
11. The electronic device according to claim 10, wherein: The instructions cause the processor to generate the second background image by reducing the size of the first background image and increasing the number of the first background image to fill the second background image display area based on the identified type being a tile.
12. The electronic device according to claim 10, wherein: The instructions cause the processor to generate the second background image by processing the first background image so that a main object of the first background image is located at a center of a display area of the second background image based on the identified type being an object.
13. The electronic device according to claim 10, wherein: The instructions cause the processor to generate the second background image by reducing the first background image to fit within a width or height of a second background image display area while maintaining an aspect ratio of the first background image based on the identified type being landscape.
14. A method for operating an electronic device, the method comprising: displaying a first background image in a first background image display area, the first background image display area being configured to display a background image in a display area activated to display visual information on a display of the electronic device; Based on data received from a sensor provided in the electronic device, monitoring whether the posture of the electronic device changes from a first posture corresponding to a portrait mode to a second posture corresponding to a landscape mode or from the second posture to the first posture; monitoring whether there is a visual change in an execution screen of an application in the activated display area; configuring a second background image display area in the activated display area, the second background image display area having a size reduced from that of the first background image display area, based on recognizing a change in the posture of the electronic device or a visual change in an application execution screen as a result of the monitoring; reconstructing the first background image into a second background image to be displayed in the second background image display area; as well as The second background image is displayed in the second background image display area.
15. The method according to claim 14, wherein: The monitoring whether there is a visual change on the application execution screen comprises: Identify the occurrence of a call event for calling an application execution screen to the activated display area, a display end event for terminating the display of the application execution screen in the activated display area, or a position change event for changing the position of the application execution screen in the activated display area.