Electronic device comprising plurality of displays, and control method therefor
By using sensors to detect folding angles and orientations, the electronic device optimizes content display across multiple displays, addressing reduced usable area issues and enhancing user experience while conserving power.
Patent Information
- Application Number
- PCT/KR2025/000884
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-03-12
- Filing Date
- 2025-01-15
- Publication Date
- 2025-07-31
Smart Images

Figure KR2025000884_31072025_PF_FP_ABST
Abstract
Description
Electronic device including multiple displays and method for controlling the same
[0001] Embodiments of the present disclosure relate to an electronic device including a plurality of displays and a method for controlling the same.
[0002] The variety of services and additional features offered through electronic devices, such as smartphones, is steadily increasing. To enhance the utility of these devices and satisfy the diverse needs of users, telecommunications service providers and electronic device manufacturers are competitively developing electronic devices to offer a variety of features and differentiate themselves from competitors. Consequently, the various functions offered through electronic devices are also becoming increasingly sophisticated.
[0003] An electronic device may be placed in various states (e.g., folded, sliding, etc.) depending on user control while displaying an application execution screen. When the state of at least one housing of the electronic device changes according to user control, such as folding or sliding, an area on the display having a different size and aspect ratio is primarily used by the user. In particular, there are cases where an area on the display that is smaller than before the change due to the state change of at least one housing of the electronic device is primarily used by the user.
[0004] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above is applicable as prior art related to the present disclosure.
[0005] According to one embodiment, an electronic device may include a first housing including a first side and a second side opposite the first side, a second housing including a third side and a fourth side opposite the third side, a hinge structure rotatably connecting the first housing and / or the second housing, a first display disposed on the first side and the third side, a second display disposed on the second side, an electronic ink display disposed on the fourth side, at least one first sensor for sensing a folding angle between the first housing and the second housing, at least one second sensor for sensing an orientation of the electronic device, at least one processor, and a memory storing instructions.
[0006] According to one embodiment, when the instructions are executed by the at least one processor, the electronic device can obtain the folding angle sensed by the at least one first sensor.
[0007] In one embodiment, when the instructions are executed by the at least one processor, the electronic device can obtain an orientation of the electronic device sensed by the at least one second sensor.
[0008] In one embodiment, when the instructions are executed by the at least one processor, the electronic device can determine whether the electronic ink display satisfies a set condition that the electronic ink display is visible, based on at least one of the folding angle or the orientation of the electronic device, while the first content is displayed on the electronic ink display.
[0009] According to one embodiment, when the instructions are executed by the at least one processor, the electronic device may display second content corresponding to the first content on the second display based on satisfaction of the set condition.
[0010] According to one embodiment, a method for controlling an electronic device includes a first housing including a first side and a second side opposite to the first side, a second housing including a third side and a fourth side opposite to the third side, a hinge structure rotatably connecting the first housing and the second housing, a first display disposed on the first side and the third side, a second display disposed on the second side, an electronic ink display disposed on the fourth side, at least one first sensor for sensing a folding angle between the first housing and the second housing, and at least one second sensor for sensing a direction of the electronic device, the method may include an operation of acquiring a folding angle sensed by the at least one first sensor.
[0011] According to one embodiment, the method for controlling the electronic device may include an operation of obtaining a direction of the electronic device sensed by the at least one second sensor.
[0012] According to one embodiment, the control method of the electronic device may include an operation of determining whether the electronic ink display satisfies a set condition that the electronic ink display can be viewed, based on at least one of the folding angle or the orientation of the electronic device, while the first content is displayed on the electronic ink display.
[0013] According to one embodiment, the control method of the electronic device may include an operation of displaying second content corresponding to the first content on the second display based on satisfaction of the set condition.
[0014] According to one embodiment, a non-transitory computer-readable recording medium storing one or more programs may include instructions that cause an electronic device including a first housing including a first side and a second side opposite the first side, a second housing including a third side and a fourth side opposite the third side, a hinge structure rotatably connecting the first housing and the second housing, a first display disposed on the first side and the third side, a second display disposed on the second side, an electronic ink display disposed on the fourth side, at least one first sensor for sensing a folding angle between the first housing and the second housing, and at least one second sensor disposed in the second housing for sensing an orientation of the electronic device, to obtain the folding angle sensed by the at least one first sensor.
[0015] According to one embodiment, the one or more programs may include instructions that cause the electronic device to obtain an orientation of the electronic device sensed by the at least one second sensor.
[0016] According to one embodiment, the one or more programs may include instructions that cause the electronic device to determine whether a set condition that the electronic ink display is visible is satisfied based on at least one of the folding angle or the orientation of the electronic device while the first content is displayed on the electronic ink display.
[0017] According to one embodiment, the one or more programs may include instructions that cause the electronic device to display second content corresponding to the first content on the second display based on satisfying a set condition.
[0018] FIG. 1 is a block diagram of an electronic device within a network environment according to one embodiment.
[0019] FIG. 2 is an exemplary drawing showing an unfolded state of an electronic device according to one embodiment of the present disclosure.
[0020] FIG. 3 is an exemplary drawing showing a folded state of the electronic device of FIG. 2.
[0021] FIG. 4 is a drawing for explaining the structure of an electronic ink display according to one embodiment of the present disclosure.
[0022] FIG. 5 is a drawing for explaining the arrangement of sensors of an electronic device according to an embodiment of the present disclosure.
[0023] FIG. 6 is a flowchart illustrating an operation of displaying content related to content displayed on an electronic ink display of an electronic device on a second display according to an embodiment of the present disclosure.
[0024] FIG. 7 is a flowchart illustrating an operation of displaying content related to content displayed on an electronic ink display of an electronic device on a second display according to an embodiment of the present disclosure.
[0025] FIG. 8A is a drawing for explaining a sensing value of an electronic device when the electronic device is in a folded state according to one embodiment of the present disclosure.
[0026] FIG. 8b is a drawing for explaining a sensing value of an electronic device when the electronic device is in a folded state according to one embodiment of the present disclosure.
[0027] FIG. 9 is a drawing for explaining a sensing value of an electronic device when the electronic device is in a semi-folded state according to one embodiment of the present disclosure.
[0028] FIG. 10 is a drawing for explaining a sensing value of an electronic device when the electronic device is in an unfolded state according to one embodiment of the present disclosure.
[0029] FIG. 11A is a drawing for explaining set conditions under which an electronic ink display can be displayed when an electronic device is in a folded state according to one embodiment of the present disclosure.
[0030] FIG. 11b is a drawing for explaining set conditions under which an electronic ink display can be viewed when the electronic device is in a semi-folded state according to one embodiment of the present disclosure.
[0031] FIG. 11c is a drawing for explaining set conditions under which an electronic ink display can be viewed when an electronic device is in an unfolded state according to one embodiment of the present disclosure.
[0032] FIG. 12 is a drawing for explaining set conditions under which an electronic ink display of an electronic device can be displayed according to an embodiment of the present disclosure.
[0033] FIG. 13A is a diagram illustrating an operation of displaying content related to content displayed on an electronic ink display of an electronic device on a second display based on a user input, according to an embodiment of the present disclosure.
[0034] FIG. 13b is a diagram illustrating an operation of displaying content related to content displayed on an electronic ink display of an electronic device on a second display based on a user input according to an embodiment of the present disclosure.
[0035] FIG. 14 is a drawing for explaining a theme image displayed on an electronic ink display and a second display of an electronic device according to one embodiment of the present disclosure.
[0036] FIG. 15A is a diagram for explaining an operation of setting content to be displayed on an electronic ink display through a user input on a second display of an electronic device according to an embodiment of the present disclosure.
[0037] FIG. 15b is a diagram illustrating an operation of controlling a second display and an electronic ink display through a user input of an electronic device according to an embodiment of the present disclosure.
[0038] FIG. 16A is a diagram for explaining an operation of displaying content on a second display of an electronic device according to an embodiment of the present disclosure.
[0039] FIG. 16b is a diagram for explaining an operation of displaying content on a second display and an electronic ink display of an electronic device according to an embodiment of the present disclosure.
[0040] FIG. 16c is a diagram for explaining an operation of setting content to be displayed on a second display and an electronic ink display of an electronic device according to an embodiment of the present disclosure.
[0041] FIG. 17A is a diagram for explaining an operation of setting content to be displayed on a second display and an electronic ink display of an electronic device according to an embodiment of the present disclosure.
[0042] FIG. 17b is a diagram for explaining an operation of setting content to be displayed on an electronic ink display of an electronic device according to an embodiment of the present disclosure.
[0043] FIG. 18 is a drawing for explaining an operation of setting content to be displayed on an electronic ink display of an electronic device according to an embodiment of the present disclosure.
[0044] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100), according to one embodiment. Referring to FIG. 1 , in the network environment (100), the electronic device (101) may communicate with the electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (104) or the server (108) via a second network (199) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).
[0045] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.
[0046] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.
[0047] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).
[0048] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).
[0049] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
[0050] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.
[0051] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.
[0052] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).
[0053] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
[0054] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
[0055] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0056] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.
[0057] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.
[0058] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).
[0059] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0060] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).
[0061] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.
[0062] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).
[0063] In one embodiment, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band.
[0064] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).
[0065] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In one embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.
[0066] FIG. 2 is an exemplary drawing showing an unfolded state of an electronic device according to one embodiment of the present disclosure.
[0067] FIG. 2 is an exemplary drawing showing an unfolded state of a foldable type electronic device (200) according to one embodiment of the present disclosure.
[0068] Referring to FIG. 2, an electronic device (200) according to one embodiment of the present disclosure may be a foldable type that can be folded or unfolded, and may include a first housing (210), a second housing (220), and a flexible or foldable display (230) (hereinafter, abbreviated as “display (230)”) arranged in a space provided by the first housing (210) and the second housing (220) (e.g., a display module (160) of FIG. 1).
[0069] According to one embodiment of the present disclosure, a surface on which a display (230) is arranged may be defined as a front surface of an electronic device (200). The front surface of the electronic device (200) may be formed by a front plate (e.g., a glass plate or a polymer plate including various coating layers) having at least a portion that is substantially transparent. In addition, a surface opposite to the front surface may be defined as a rear surface of the electronic device (200). The rear surface of the electronic device (200) may be formed by a substantially opaque rear plate (hereinafter referred to as a “rear cover”). The rear cover may be formed by, for example, coated or colored glass, ceramic, polymer, metal (e.g., aluminum, stainless steel (STS), or magnesium), or a combination of at least two of the above materials. In addition, a surface surrounding a space between the front surface and the rear surface may be defined as a side surface of the electronic device (200). The side surface may be formed by a side bezel structure (or "side member") that is coupled to the front plate and the back cover and comprises metal and / or polymer. In some embodiments, the back cover and the side bezel structure may be formed integrally and comprise the same material (e.g., a metal material such as aluminum).
[0070] An electronic device (200) according to one embodiment of the present disclosure may include at least one of a display (230), a microphone hole (241), a speaker hole (243, 245), a sensor module (255), a camera module (253), a key input device (211, 212, 213), and a connector hole (214). According to one embodiment, the key input device (211, 212, 213) may include a sensor (e.g., a fingerprint sensor). According to one embodiment, the electronic device (200) may omit at least one of the components (e.g., the key input device (211, 212, 213)) or additionally include another component (e.g., a light-emitting element).
[0071] According to one embodiment of the present disclosure, the display (230) may be a display in which at least a portion of the display may be transformed into a flat or curved surface. According to one embodiment, the display (230) may include a folding area (231c), a first area (231a) disposed on one side (e.g., the upper side of the folding area (231c) illustrated in FIG. 2) with respect to the folding area (231c), and a second area (231b) disposed on the other side (e.g., the lower side of the folding area (231c) illustrated in FIG. 2). However, the division of the areas of the display (230) illustrated in FIG. 2 is exemplary, and the display (230) may be divided into a plurality of areas (e.g., four or more or two) depending on the structure or function. For example, in the embodiment illustrated in FIG. 2, the display (230) may be divided into regions by a folding region (231c) or a folding axis (A-A'), but the display (230) may also be divided into regions by another folding region (231c) or another folding axis (e.g., a folding axis perpendicular to the folding axis (A-A')).
[0072] According to one embodiment of the present disclosure, a microphone hole (241) may be arranged inside a microphone for acquiring external sounds, and in some embodiments, multiple microphones may be arranged to detect the direction of sounds. The speaker holes (243, 245) may include an external speaker hole (243) and a call receiver hole (245). In some embodiments, the speaker holes (243, 245) and the microphone hole (241) may be implemented as a single hole, or a speaker may be included without the speaker holes (243, 245) (e.g., a piezo speaker). The positions and numbers of the microphone holes (241) and the speaker holes (243, 245) may vary depending on the embodiment.
[0073] According to one embodiment of the present disclosure, the camera module (253) may include a first camera device (251) disposed on a first surface (210a) of a first housing (210) of the electronic device (200), and a second camera device (253) disposed on a second surface (210b). In addition, the electronic device (200) may further include a flash (not shown). The camera devices (251, 253) may include one or more lenses, an image sensor, and / or an image signal processor. The flash (not shown) may include, for example, a light-emitting diode or a xenon lamp.
[0074] According to one embodiment of the present disclosure, the sensor module (255) may generate an electric signal or data value corresponding to an internal operating state of the electronic device (200) or an external environmental state. Although not illustrated in the drawing, the electronic device (200) may additionally or alternatively include another sensor module (e.g., the sensor module (176) of FIG. 1) in addition to the sensor module (255) provided on the second surface (210b) of the first housing (210). The electronic device (200) according to one embodiment of the present disclosure may include, as a sensor module, at least one of a proximity sensor, a fingerprint sensor, an HRM sensor, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, an angle sensor, or an illuminance sensor. An electronic device (200) according to an embodiment of the present disclosure can distinguish between an upper side and a lower side of the electronic device (200) using data acquired by a gyro sensor when the electronic device (200) is in a folded state. For example, an electronic device (200) according to an embodiment of the present disclosure can determine that a side equipped with a gyro sensor is an upper side if data acquired by a gyro sensor has substantially changed from data at a specific point in time. Conversely, an electronic device (200) according to an embodiment of the present disclosure can determine that a side equipped with a gyro sensor is a lower side if data acquired by a gyro sensor has not substantially changed from data at a specific point in time. An electronic device (200) according to an embodiment of the present disclosure can determine a folded angle of the electronic device (200) using an angle sensor disposed around a folding axis (A-A'). However, according to various embodiments of the present disclosure, various techniques for determining the angle at which the electronic device (200) is folded can be applied to the embodiments disclosed in the present disclosure.
[0075] According to one embodiment of the present disclosure, the key input devices (211, 212, 213) may be disposed on a side of a foldable housing (e.g., the first housing (210) or the second housing (220)). In one embodiment, the electronic device (200) may not include some or all of the above-mentioned key input devices (211, 212, 213), and the key input devices that are not included may be implemented in other forms, such as soft keys, on the display (230). In some embodiments, the key input devices may be configured so that key input is implemented by a sensor module (e.g., a gesture sensor).
[0076] According to one embodiment of the present disclosure, the connector hole (214) may be configured to accommodate a connector (e.g., a USB connector) for transmitting and receiving power and / or data to and from an external electronic device, or, additionally or alternatively, a connector for transmitting and receiving audio signals to and from an external electronic device.
[0077] According to one embodiment of the present disclosure, a foldable housing may be implemented by combining a first housing (210), a second housing (220), a first rear cover, a second rear cover, and a hinge structure. The foldable housing of the electronic device (200) according to one embodiment of the present disclosure is not limited to the shape and combination illustrated in FIG. 2, and may be implemented by combining and / or combining other shapes or parts. For example, in one embodiment, the first housing (210) and the first rear cover may be formed integrally, and the second housing (220) and the second rear cover may be formed integrally. According to various embodiments disclosed in the present disclosure, the term 'housing' may mean a combination and / or combined configuration of various other parts that are not mentioned. For example, it can be described that the first area (231a) of the display (230) forms one side of the first housing (210), and it can be described that the first area (231a) of the display (230) is arranged or attached to one side of the first housing (210).
[0078] According to one embodiment of the present disclosure, the first housing (210) may be connected to a hinge structure and include a first face (210a) facing a first direction and a second face (210b) facing a second direction opposite to the first direction. The second housing (220) may be connected to a hinge structure and include a third face (220a) facing a third direction and a fourth face (220b) facing a fourth direction opposite to the third direction, and may rotate or pivot about the hinge structure (or folding axis (A-A')) with respect to the first housing (210).
[0079] According to one embodiment of the present disclosure, the first housing (210) and the second housing (220) are arranged on both sides (or upper / lower sides) with respect to the folding axis (A-A') as the center, and may have an overall symmetrical shape with respect to the folding axis (A-A'). The angle or distance between the first housing (210) and the second housing (220) may vary depending on whether the state of the electronic device (200) is an unfolded state (or unfolded state), a folded state (or folded state), or a partially unfolded (or partially folded) intermediate state (or semi-folded state). According to one embodiment, the first housing (210), unlike the second housing (220), may additionally include various sensors, but may have a mutually symmetrical shape in other areas.
[0080] According to one embodiment of the present disclosure, at least a portion of the first housing (210) and the second housing (220) may be formed of a metallic or non-metallic material having a rigidity of a size selected to support the display (230). At least a portion formed of the metallic material may serve as a ground plane or a radiating conductor of the electronic device (200), and when served as a ground plane, may be electrically connected to a ground line formed on a printed circuit board.
[0081] According to one embodiment of the present disclosure, the first rear cover is disposed on one side (e.g., the upper side in FIG. 2) of the folding axis (A-A') on the rear of the electronic device (200) and may have, for example, a substantially rectangular periphery, the periphery of which may be wrapped by the first housing (210) (and / or the side bezel structure). Similarly, the second rear cover is disposed on the other side (e.g., the lower side in FIG. 2) of the folding axis (A-A') on the rear of the electronic device (200) and may have its periphery wrapped by the second housing (220) (and / or the side bezel structure).
[0082] According to one embodiment of the present disclosure, the first rear cover and the second rear cover may have substantially symmetrical shapes with respect to the folding axis (A-A'). However, the first rear cover and the second rear cover do not necessarily have mutually symmetrical shapes, and the electronic device (200) may include the first rear cover and the second rear cover of various shapes. In one embodiment, the first rear cover may be formed integrally with the first housing (210), and the second rear cover may be formed integrally with the second housing (220).
[0083] According to one embodiment of the present disclosure, the first rear cover, the second rear cover, the first housing (210), and the second housing (220) may form a space in which various components of the electronic device (200) may be arranged. According to one embodiment, one or more components may be arranged or visually exposed on the rear surface of the electronic device (200). For example, at least a portion of the sub-display (239) may be visually exposed through the first rear cover. According to one embodiment, one or more components or sensors may be visually exposed through the first rear cover. In various embodiments, the components or sensors may include a proximity sensor, a rear camera, and / or a flash.
[0084] According to one embodiment, at least a portion of the electronic ink display (250) may be visually exposed through the second rear cover. Unlike outputting information visualized by light, the electronic ink display (250) may display visualized information by changing the positions of particles (particles having different charges) contained within the electronic ink display (250) via a power signal. Each particle may be distinguished by a different color.
[0085] In one embodiment, one or more components or sensors may be visually exposed through the second rear cover. In various embodiments, the components or sensors may include a proximity sensor, a rear camera, and / or a flash. In one embodiment, the electronic ink display (250) may include a through-hole formed in an area corresponding to at least the camera module and / or the sensor module.
[0086] According to one embodiment, the structure of the electronic ink display (250) exposed through the second rear cover will be described in more detail with reference to FIG. 4 below.
[0087] According to one embodiment of the present disclosure, a first camera device (251) exposed on the front side of the electronic device (200) through one or more openings or a second camera device (253) exposed through the first rear cover may include one or more lenses, an image sensor, and / or an image signal processor. A flash (not shown) may include, for example, a light-emitting diode or a xenon lamp. In some embodiments, two or more lenses (infrared camera, wide-angle and telephoto lenses) and image sensors may be arranged on one side of the electronic device (200).
[0088] According to one embodiment of the present disclosure, the electronic device (200) can be configured to be in a folded state or an unfolded state.
[0089] For example, the first housing (210) and the second housing (220) can rotate with respect to each other between a first position facing each other and a second position unfolded by a specified angle from the first position (e.g., a state illustrated in FIG. 2). In FIG. 2, a state in which the first housing (210) and the second housing (220) unfold to form an angle of approximately 180 degrees is exemplified, and in a folded state, for example, in the first position, the first region (231a) and the second region (231b) of the display (230) are positioned to face each other, and the folding region (231c) can be deformed into a curved shape.
[0090] According to one embodiment of the present disclosure, the electronic device (200) can be implemented in two ways: 'in-folding', in which the first region (231a) and the second region (231b) are folded to face each other, and 'out-folding', in which the first region (231a) and the second region (231b) are folded to face opposite directions. For example, in a folded state in the in-folding manner, the first region (231a) and the second region (231b) can be substantially concealed, and in a fully unfolded state, the first region (231a) and the second region (231b) can be arranged to face substantially the same direction. For example, in the folded state in an out-folding manner, the first region (231a) and the second region (231b) may be arranged to face opposite directions and be visually exposed to the outside, and in the fully unfolded state, the first region (231a) and the second region (231b) may be arranged to face substantially the same direction. According to one embodiment, the folded state will be described below with reference to FIG. 3.
[0091] According to one embodiment of the present disclosure, the display (230) may include a display panel and a window member, and may be formed of a flexible material. Although not separately illustrated, it will be readily understood by those skilled in the art that the display (230) or the display panel includes various layers, such as a light-emitting layer, a substrate(s) encapsulating the light-emitting layer, an electrode or wiring layer, and / or an adhesive layer(s) bonding adjacent different layers. According to one embodiment of the present disclosure, when the display (230) (e.g., the folding area (231c)) is deformed into a flat shape and a curved shape, a relative displacement may occur between the layers forming the display (230). The relative displacement due to the deformation of the display (230) may increase as the point is further from the folding axis (A-A') and / or as the thickness of the display (230) increases.
[0092] According to one embodiment of the present disclosure, the window member may function as a protective film for protecting the display panel. The thin film plate as the protective film may be made of a material that protects the display panel from external impact, is scratch-resistant, and reduces wrinkles in the folding area (231c) even during repeated folding and unfolding operations of the housings (210, 220). For example, the material of the thin film plate may include a transparent polyimide film (CPI) or ultra-thin glass (UTG).
[0093] According to various embodiments, the electronic device (200) may further include a protective member (206)(s) or a decorative cover (219, 229)(s) disposed on at least a portion of an edge of the display (230) on the front surface (e.g., the first side (210a) or the third side (220a)). The protective member (206) or the decorative cover (219, 229) may prevent at least a portion of an edge of the display (230) from contacting a mechanical structure (e.g., the first housing (210) or the second housing (220)) and may provide a decorative effect on the exterior of the electronic device (200).
[0094] FIG. 3 is an exemplary drawing illustrating a folded state of the electronic device of FIG. 2. For example, FIG. 3 illustrates a state folded in an 'in-folding' manner.
[0095] Referring to FIG. 3, an electronic device (e.g., electronic device (101) of FIG. 1 or electronic device (200) of FIG. 2) can be changed from an unfolded state as shown in FIG. 2 to a folded state.
[0096] According to one embodiment, when the electronic device is folded in an 'in-folding' manner, a first region (e.g., a first region (231a) of FIG. 2) and a second region (e.g., a second region (231b) of FIG. 2) of a flexible display (e.g., a display module (160) of FIG. 1) may be folded to face each other and be substantially concealed.
[0097] According to one embodiment, the first rear cover (e.g., the first rear cover of FIG. 2) and the second rear cover (e.g., the second rear cover of FIG. 2), which are arranged to face substantially the same direction in the unfolded state, may be arranged to face opposite directions in the folded state so as to be visually exposed to the outside.
[0098] In one embodiment, in the folded state, one or more components may be positioned or visually exposed through the first rear cover or the second rear cover. For example, in the folded state, at least a portion of the sub-display (239), a sensor module (e.g., a proximity sensor), a rear camera, and / or a flash may be visually exposed through the first rear cover.
[0099] According to one embodiment, in a folded state, the electronic device (200) may provide content (or content) through the sub-display (239). For example, the content may include a standby screen and / or an application execution screen. For example, the standby screen may include date information, time information, battery charge information, and / or notification information such as event occurrence.
[0100] According to one embodiment, the type, arrangement, shape, and / or size of the sub-display (239), the type, size, and / or arrangement of the sensor module and / or the rear camera are not limited thereto.
[0101] For example, in the folded state, at least a portion of the electronic ink display (250) may be visually exposed through the second rear cover.
[0102] According to one embodiment, the electronic device (200) may provide content via the electronic ink display (250). For example, the content may include an image. For example, the image may be a theme image, an ID card image, or a ticket image. According to one embodiment, the ID card image or ticket image may include a code image containing information such as a QR code or a barcode.
[0103] According to one embodiment, the type and / or number of at least one component visually exposed through the rear cover (e.g., the first rear cover or the second rear cover) is not limited to FIG. 3.
[0104] According to one embodiment, although the electronic device is illustrated and described as being folded in an 'in-folding' manner in FIG. 3, it may also be folded in an 'out-folding' manner, and when folded in an 'out-folding' manner, a first area (e.g., a first area (231a) in FIG. 2) of a flexible display (e.g., a display module (160) in FIG. 1) exposed to the outside may be a sub-display (239), and a second area (e.g., a second area (231b) in FIG. 2) may be an electronic ink display (250).
[0105] FIG. 4 is a drawing for explaining the structure of an electronic ink display according to one embodiment of the present disclosure.
[0106] Referring to FIG. 4, an electronic ink display (250) (e.g., an electronic ink display (250) of FIG. 2) may be placed on a fourth surface (e.g., a fourth surface (220b) of FIG. 2) which is the rear surface of a second housing (e.g., a second housing (220) of FIG. 2) of an electronic device (e.g., an electronic device (101) of FIG. 1 or an electronic device (200) of FIG. 2).
[0107] In one embodiment, the electronic ink display (250) may include an electronic ink layer (410), an adhesive layer (420), and a cover layer (430) including particles having different charges. In one embodiment, the electronic ink layer (410) includes particles having different charges and may display visualized information by changing the positions of the particles through a power signal.
[0108] According to one embodiment, the cover layer (430) may be plastic or glass placed on the outermost surface of the electronic ink display (250) to protect the electronic ink display (250) and components of the electronic device (200). The cover layer (430) may have a transparency greater than a set value.
[0109] According to one embodiment, an adhesive layer (420) is disposed between an electronic ink layer (410) and a cover layer (430), and can adhere the electronic ink layer (410) and the cover layer (430).
[0110] In one embodiment, although FIG. 4 illustrates that only the electronic ink display (250) is disposed on the fourth surface (e.g., the fourth surface (220b) of FIG. 2), the present invention is not limited thereto, and when a camera module and / or a sensor module are disposed on at least a portion of the fourth surface, the electronic ink layer (410) and the adhesive layer (420) may include a through hole formed in an area corresponding to the camera module and / or the sensor module. The through hole may be covered by the cover layer (430). In one embodiment, such as in an under display camera (UDC), the electronic ink layer (410) and the adhesive layer (420) may not have a through hole formed therein.
[0111] In one embodiment, the electronic ink display (250) may further include a touch panel. In one embodiment, the touch panel may be positioned between the electronic ink layer (410) and the adhesive layer (420) or between the adhesive layer (420) and the cover layer (430). In one embodiment, the touch panel may also be positioned beneath the electronic ink layer (410).
[0112] FIG. 5 is a drawing for explaining the arrangement of sensors of an electronic device according to an embodiment of the present disclosure.
[0113] Referring to FIG. 5, an electronic device (e.g., an electronic device (101) of FIG. 1 or an electronic device (200) of FIG. 2) may include a first housing (e.g., a first housing (210) of FIG. 2) including a first surface (or side) (510) (e.g., a first surface (210a) of FIG. 2) and a second surface (511) opposite the first surface (e.g., a second surface (210b) of FIG. 2), a second housing (e.g., a second housing (220) of FIG. 2) including a third surface (512) (e.g., a third surface (220a) of FIG. 2) and a fourth surface (513) opposite the third surface (513) (e.g., a fourth surface (220b) of FIG. 2).
[0114] According to one embodiment, the electronic device may include a first display (e.g., display module (160) of FIG. 1 or display (230) of FIG. 2) disposed on the first side (510) and the third side (512), a second display (or cover display) (e.g., display module (160) of FIG. 1 or sub-display (239) of FIG. 2) disposed on the second side, and an electronic ink display (e.g., electronic ink display (250) of FIG. 2) disposed on the fourth side.
[0115] According to one embodiment, the electronic device (200) may include a plurality of sensors. For example, the plurality of sensors may include a plurality of inertial sensors. The inertial sensor may include at least one of an accelerometer and / or a gyro sensor (e.g., a gyroscope). For example, the acceleration sensor may identify (or measure, detect) acceleration of the electronic device (200) in three directions of the x-axis, the y-axis, and the z-axis, and may measure, estimate, and / or detect a force being applied to the electronic device (200) using the measured acceleration. For example, the gyro sensor may identify (or measure, detect) angular velocity of the electronic device in three directions of the x-axis, the y-axis, and the z-axis, and may measure and / or detect a rotation amount (e.g., a rotation angle or a tilt) of the electronic device (200) for each axis using the measured angular velocity information of each axis.
[0116] According to one embodiment, the electronic device (200) may detect an inclination angle of the electronic device (200) with respect to the ground surface and / or a direction in which the electronic device (200) is facing in a three-dimensional coordinate system using data (or sensing data) acquired from at least one of a plurality of sensors. In addition, the electronic device (200) may acquire an impulse (e.g., acceleration differentiated with respect to time) for each axis direction based on data representing the state of the electronic device (200). For example, the impulse may include a jerk or a rate of change in acceleration, which may include a degree to which acceleration changes.
[0117] According to one embodiment, the electronic device (200) may include a first inertial sensor (520) (e.g., sensor module (176) of FIG. 1) disposed within a first housing and a second inertial sensor (521) (e.g., sensor module (176) of FIG. 1) disposed within a second housing.
[0118] In one embodiment, the first inertial sensor (520) may sense the orientation and / or rotation of the first housing. In one embodiment, the second inertial sensor (521) may sense the orientation and / or rotation of the second housing.
[0119] According to one embodiment, the electronic device (200) can determine a folding angle between the first housing and the second housing based on the direction and / or rotation of the first housing sensed by the first inertial sensor (520) and the direction and / or rotation of the second housing sensed by the second inertial sensor (521).
[0120] According to one embodiment, the electronic device (200) may include a plurality of light sensors. The light sensors may sense the light level around the electronic device. According to one embodiment, the electronic device (200) may include a first light sensor (530) disposed on a first side (510) where the first display is visually exposed, a second light sensor (531) disposed on a second side (511) where the second display is visually exposed, and a third light sensor (532) disposed on a fourth side (513) where the electronic ink display is visually exposed. According to one embodiment, the electronic device (200) may identify a covered side among the first side (510), the second side (511), and the fourth side (513) based on the sensing values of each of the light sensors (530, 531, 532). For example, the electronic device (200) can determine whether the first side (510), the second side (511), and / or the fourth side (513) are covered by a hand, a face, an object, the floor, or a wall based on the sensing values of each light sensor (530, 531, 532). In one embodiment, whether the third side (512) is covered by the first side (510) can be applied.
[0121] According to one embodiment, the electronic device (200) can determine whether the electronic device (200) is located in a pocket or a bag based on the sensing values of each light sensor (530, 531, 532).
[0122] According to one embodiment, the electronic device (200) may include a Hall sensor and / or a geomagnetic sensor. For example, the Hall sensor and / or the geomagnetic sensor may include a transmitter for generating a magnetic field of a specific frequency and a receiver for receiving the magnetic field generated by the transmitter, and may obtain status information of the electronic device (200) (e.g., a moving direction or moving distance of the housing (210, 220) of FIG. 2). For example, the geomagnetic sensor may measure a direction using a magnetic field and magnetic force lines, and the Hall sensor may detect the strength of a magnetic field to obtain status information of the electronic device (200).
[0123] According to one embodiment, the Hall sensor may include one or more magnets and / or one or more magnetic sensors. At least one of the one or more magnets included in the Hall sensor, or one or more magnetic sensors, may be positioned at different locations within the electronic device (200). The positional relationship of the one or more magnets and / or one or more magnetic sensors within the electronic device (200) may change depending on the state (or shape) of the electronic device (200).
[0124] According to one embodiment, the electronic device (200) can measure changes in positional relationships through one or more magnetic sensors. The changes in positional relationships can cause changes in the magnetic field formed by one or more magnets. The electronic device (200) can obtain a power signal representing the change in the magnetic field using a Hall sensor. For example, the electronic device (200) can use a power signal acquired from the Hall sensor to determine a posture or state (e.g., a folded state (or folded state), an unfolded state (or unfolded state), a semi-folded (or partially unfolded (or partially folded) intermediate state, a flex mode) (or an angle of the state). For example, the electronic device can receive data representing the state of the electronic device (200) from the Hall sensor. For example, the Hall sensor can output data representing the shape of the first display. The shape of the first display can change as it is folded or unfolded based on the folding axis. The Hall sensor can output different data representing the shape of the first display.
[0125] According to one embodiment, the electronic device (200) may determine whether to activate the first display and / or the second display based on the posture and / or usage conditions of the electronic device (200) sensed based on at least one of an inertial sensor (520, 521), a light sensor (530, 531, 532), and a Hall sensor.
[0126] FIG. 6 is a flowchart illustrating an operation of displaying content related to content displayed on an electronic ink display of an electronic device on a second display according to an embodiment of the present disclosure.
[0127] Referring to FIG. 6, in operation 610, an electronic device (e.g., the electronic device (101) of FIG. 1, the processor (120) of FIG. 1, or the electronic device (200) of FIG. 2) may obtain a folding angle between a first housing (e.g., the first housing (210) of FIG. 2) and a second housing (e.g., the second housing (220) of FIG. 2) sensed by at least one first sensor (e.g., the sensor module (176) of FIG. 1, the first inertial sensor (520) of FIG. 5, or the second inertial sensor (521) of FIG. 5)) and may obtain a direction of the electronic device sensed by at least one second sensor (e.g., the sensor module (176) of FIG. 1, the first inertial sensor (520) of FIG. 5, or the second inertial sensor (521) of FIG. 5).
[0128] According to one embodiment, at least a portion of the at least one first sensor and the at least one second sensor may be the same sensor. For example, the at least one first sensor and the at least one second sensor may include a first inertial sensor disposed in the first housing (e.g., the first inertial sensor 520 of FIG. 5) and a second inertial sensor disposed in the second housing (e.g., the second inertial sensor 521 of FIG. 5). According to one embodiment, the electronic device may acquire an orientation of the first housing acquired by the first inertial sensor and an orientation of the second housing acquired by the second inertial sensor. According to one embodiment, the electronic device may acquire an orientation of the electronic device based on the orientation of the first housing and the orientation of the second housing. According to one embodiment, the electronic device may acquire a folding angle between the first housing and the second housing based on the orientation of the first housing and the orientation of the second housing.
[0129] According to one embodiment, at least one first sensor may include a Hall sensor. According to one embodiment, the electronic device may determine the folding angle between the first housing and the second housing through the Hall sensor. For example, if a magnet is disposed in one of the first housing and the second housing and a magnetic sensor is disposed in the other, the electronic device may determine the folding angle between the first housing and the second housing based on the magnetic value sensed by the Hall sensor.
[0130] According to one embodiment, the at least one first sensor may further include at least one of an acceleration sensor, a gyro sensor, a light sensor, or a proximity sensor. For example, the electronic device may determine the folding angle based on the degree of rotation of at least one of the first housing or the second housing sensed through the acceleration sensor or the gyro sensor. According to one embodiment, the electronic device may also determine the folding angle based on the distance between the first housing and the second housing sensed through the light sensor or the proximity sensor.
[0131] According to one embodiment, the at least one second sensor may further include at least one of an acceleration sensor, a gyro sensor, a light sensor, or a proximity sensor. For example, the electronic device may determine the orientation of the electronic device based on the degree of rotation of the electronic device sensed by the acceleration sensor or the gyro sensor. According to one embodiment, the electronic device may also determine the orientation of the electronic device based on a change in ambient illuminance or a change in distance to a surrounding object sensed by the light sensor or the proximity sensor.
[0132] According to one embodiment, in operation 620, the electronic device may determine whether the electronic ink display satisfies a set condition for being visible, based on at least one of a folding angle or an orientation of the electronic device, while the first content is displayed on the electronic ink display (e.g., the electronic ink display (250) of FIG. 2). For example, the electronic device may determine whether the electronic ink display satisfies a set condition for being visible, based on at least one of a direction of the first housing, a direction of the second housing, or a folding angle.
[0133] According to one embodiment, the set condition under which the electronic ink display can be viewed may be a condition related to the position, orientation, or posture of the electronic device in which the electronic ink display can be viewed by the user or a person nearby. For example, the electronic device may determine that the set condition is satisfied when it is confirmed that the fourth side (e.g., the fourth side (513) of FIG. 5) on which the electronic ink display is arranged is raised at a set angle or more from the ground, based on at least one of the orientation of the first housing or the orientation of the second housing. According to one embodiment, when the fourth side is raised at a set angle or more from the ground, it may be determined that the set condition under which the electronic ink display can be viewed is satisfied regardless of whether the folding state of the electronic device is an unfolded state, a semi-folded state, or a folded state.
[0134] In one embodiment, a case in which the fourth side is determined to be erected at an angle greater than a set angle from the ground based on the orientation of the electronic device will be described with reference to FIGS. 11a, 11b, and 11c below.
[0135] According to one embodiment, the electronic device may determine that the set condition for making the electronic ink display visible is satisfied when a value sensed by a third illuminance sensor (e.g., the third illuminance sensor (532) of FIG. 5) for sensing the illuminance around the fourth surface is equal to or greater than a set value. According to one embodiment, the electronic device may determine that the set condition is not satisfied when the value sensed by the third illuminance sensor is less than the set value. For example, when the value sensed by the third illuminance sensor is less than the set value, the electronic ink display is covered, and thus the set condition for making the electronic ink display visible is determined to not be satisfied.
[0136] According to one embodiment, the electronic device may determine that the first display is facing downwards based on at least one of the direction of the first housing or the direction of the second housing, wherein the folding angle is within a range corresponding to unfolding, and the first display is facing downwards based on at least one of the direction of the first housing or the direction of the second housing, and may determine that the set condition is satisfied based on a value sensed by the first light sensor (e.g., the first light sensor (531) of FIG. 5) being less than a set value. According to one embodiment, the electronic device may determine that the set condition that the electronic ink display is visible is satisfied when the electronic device is in an unfolded state and is face down with the first display touching the floor. According to one embodiment, when the first display touches the floor, the first display will be invisible, and therefore, the electronic device may switch the first display to a low-power state (e.g., an inactive state or an always-on display (AOD) state).
[0137] In one embodiment, even if the first display is not touching the floor, if the electronic device is in an unfolded state with the first display facing downward, the electronic device can determine that the set condition for the electronic ink display to be visible is satisfied. In one embodiment, if the first display is facing downward and not touching the floor, the electronic device can maintain the first display's activation because the first display is in a visible state (e.g., when the user is lying down and viewing the first display).
[0138] In one embodiment, the electronic device may determine the orientation of the electronic device in which the electronic ink display is visible based solely on the orientation of the second housing, or based solely on the orientation of the first housing and the folding angle between the first housing and the second housing.
[0139] In one embodiment, the electronic ink display may display first content. In one embodiment, the first content may be selected based on a user input received through a second display. For example, the electronic device may display a plurality of contents on the second display, and based on receiving a user input selecting a first content from the plurality of contents through the second display, the electronic device may display the selected first content on the electronic ink display.
[0140] An electronic device according to one embodiment can set conditions for displaying desired content on an electronic ink display (e.g., location and time at which the selected content is to be displayed) using a second display, and can display a preview of the content to be displayed on the electronic ink display through the second display.
[0141] According to one embodiment, the operation of selecting first content to be displayed on the electronic ink display based on user input via the second display is described in more detail with reference to FIGS. 15A and 15B below.
[0142] In one embodiment, the electronic device may set a set condition under which the electronic ink display is visible without being obscured by an opaque case and determine whether the set condition is satisfied.
[0143] For example, the electronic device can determine that the case of the electronic device is mounted via an NFC module (e.g., the communication module (190) of FIG. 1). According to one embodiment, if the illuminance value of the third illuminance sensor for sensing the illuminance around the fourth surface (e.g., the fourth surface (513) of FIG. 5) is greater than a set value, the mounted case is likely to be a transparent case, and thus the electronic device can set a set condition under which the electronic ink display can be viewed and determine whether the set condition is satisfied.
[0144] In one embodiment, if the illuminance value of the third illuminance sensor for sensing the illuminance around the fourth surface is less than the set value, the mounted case may be an opaque case, and thus the electronic device may determine that the set condition for displaying the electronic ink display is not set or that the set condition is not satisfied.
[0145] In one embodiment, if the mounting of the case is not confirmed via the NFC module, the electronic device may set a set condition under which the electronic ink display can be viewed, and determine whether the set condition is satisfied based on the illuminance value of the third illuminance sensor for sensing the illuminance around the fourth surface.
[0146] According to one embodiment, in operation 630, the electronic device may display second content corresponding to the first content on a second display (e.g., the display module (160) of FIG. 1 or the sub-display (239) of FIG. 2) based on satisfaction of a set condition.
[0147] In one embodiment, the electronic device may display second content on the second display when the electronic ink display satisfies a set condition that the electronic ink display is visible to the user and / or a person nearby. In one embodiment, when the electronic ink display is not visible to the user or a person nearby, for example, when the electronic ink display is covered by a hand or the floor, or when the electronic device is placed in a pocket or a bag, the electronic device may not display second content related to the first content displayed on the electronic ink display on the second display.
[0148] In one embodiment, when the second content is not displayed on the second display, the second display may be switched to a low power state (e.g., inactive state or AOD state) or may display a default screen based on the position, folding angle, and / or orientation of the electronic device.
[0149] According to one embodiment, the electronic device may display a theme image on the second display and the electronic ink display. According to one embodiment, the first content displayed on the electronic ink display may be a portion of an image or a portion of a video, and the second content displayed on the second display may be a remaining portion of an image or a remaining portion of a video. According to one embodiment, the operation of displaying the theme image on the second display and the electronic ink display will be described in more detail below with reference to FIG. 14.
[0150] According to one embodiment, the electronic device can sense ambient illuminance by at least one illuminance sensor (e.g., illuminance sensors 530, 531, 532 of FIG. 5) and display second content on a second display with the same brightness as the first content based on the ambient illuminance.
[0151] Since electronic ink displays do not emit light on their own, it may be difficult to view content on the electronic ink display when the ambient light level is low. The electronic device may create a table related to the light values of a third light sensor applied to the electronic ink display, and based on the light values sensed by the third light sensor, adjust the brightness of a second display displaying content with the same theme as the content displayed on the electronic ink display, or deactivate (OFF) at least some of the light-emitting elements of the second display.
[0152] According to one embodiment, the second display may include a plurality of red (R) light-emitting elements, a plurality of green (G) light-emitting elements, and a plurality of blue (B) light-emitting elements. According to one embodiment, the electronic device may change colors included in the second content to colors with lower power consumption, corresponding to colors included in the first content, by deactivating some of the red (R) light-emitting elements, the green (G) light-emitting elements, and the blue (B) light-emitting elements. According to one embodiment, the electronic device may display the second content with changed colors on an always on display (AOD) screen.
[0153] For example, when light-emitting elements (e.g., OLED elements) produce black, all of the R / G / B light-emitting elements need to be turned off, but when producing white, all of the R / G / B light-emitting elements need to be turned on, which consumes more power. In addition, among the R / G / B light-emitting elements, the blue (B) light-emitting element requires a high level of energy to emit light, so the electronic device can change the color by turning off some of the R / G / B light-emitting elements or turning off some of the B light-emitting elements. As a result, the electronic device can reduce power consumption by displaying the color-changed content on the second display.
[0154] In one embodiment, when the battery capacity is low, the electronic device may lower the brightness of the secondary display or disable a light sensor (e.g., a third light sensor). The electronic device may also disable the secondary display to prevent it from displaying secondary content.
[0155] In one embodiment, the electronic device may change the first content displayed on the electronic ink display to third content associated with at least one of the preset time or preset location based on satisfaction of at least one of the preset time or preset location.
[0156] According to one embodiment, the electronic device may change the second content displayed on the second display to fourth content related to the third content based on the third content being displayed on the electronic ink display. For example, the third content and the fourth content may not be the same theme image, but may be images of different content associated with a time or location. According to one embodiment, the operation of changing the content displayed on the electronic ink display and / or the content displayed on the second display based on a specific time or location will be described in more detail with reference to FIGS. 16A, 16B, 16C, 17A, 17B, and 18 below.
[0157] FIG. 7 is a flowchart illustrating an operation of displaying content related to content displayed on an electronic ink display of an electronic device on a second display according to an embodiment of the present disclosure.
[0158] Referring to FIG. 7, in operation 701, an electronic device (e.g., the electronic device (101) of FIG. 1, the processor (120) of FIG. 1, or the electronic device (200) of FIG. 2) can check whether an opaque case is mounted.
[0159] According to one embodiment, the electronic device can determine whether a case is mounted via an NFC module (e.g., a communication module (190) of FIG. 1). According to one embodiment, when a case is mounted, the electronic device can determine whether an opaque case is mounted on the rear surface of the electronic device via a third illuminance sensor (e.g., a third illuminance sensor (532) of FIG. 5) that senses the ambient illuminance of a fourth surface (e.g., a fourth surface (513) of FIG. 5) on which an electronic ink display (e.g., an electronic ink display (250) of FIG. 2) is disposed.
[0160] According to one embodiment, if it is determined that an opaque case is mounted (operation 701 - Yes), in operation 702, the electronic device may not set a condition. According to one embodiment, if the value sensed by the third illuminance sensor is less than the set value, the electronic device may determine that the electronic ink display is not being used due to the mounting of the opaque case, and thus may not set a condition under which the electronic ink display can be viewed. By not setting a condition, the electronic device does not need to monitor whether the electronic ink display satisfies the condition for being visible depending on the position, orientation, and / or folding angle of the electronic device, and thus power consumption can be reduced.
[0161] According to one embodiment, if it is determined that an opaque case is not mounted (operation 701 - No), in operation 703, the electronic device can determine whether the set condition for displaying the electronic ink display is satisfied. For example, if the value sensed by the third illuminance sensor is greater than or equal to the set value, the electronic device determines that the case is not mounted or that a transparent case is mounted, and can identify the position and / or attitude (e.g., direction and / or folding angle) of the electronic device using the first illuminance sensor (e.g., the first illuminance sensor (530) of FIG. 5 ), the second illuminance sensor (e.g., the second illuminance sensor (531) of FIG. 5 ), the third illuminance sensor, the first inertial sensor (e.g., the first inertial sensor (520) of FIG. 5 ), and the second inertial sensor (e.g., the second inertial sensor (521) of FIG. 5 ).
[0162] According to one embodiment, an operation of identifying a posture of an electronic device using a first inertial sensor and a second inertial sensor will be described in more detail with reference to FIGS. 8a, 8b, 9, 10, 11a, 11b, 11c and 12.
[0163] According to one embodiment, the electronic device may identify the folding angle of the electronic device through a Hall sensor in addition to the inertial sensor.
[0164] In one embodiment, if the electronic ink display satisfies the set condition of visibility (operation 703 - Yes), then in operation 704, the electronic device can determine whether the ambient illuminance of the fourth surface satisfies the set condition.
[0165] In one embodiment, the electronic device may use a third ambient light sensor positioned on a fourth surface within the second housing where the electronic ink display is positioned to determine whether the ambient light conditions satisfy the set conditions. For example, the electronic device may determine whether the electronic ink display is not obscured by a hand, floor, or wall based on the ambient light sensed by the third ambient light sensor.
[0166] According to one embodiment, if the ambient illuminance of the fourth surface satisfies the set condition (operation 704 - Yes), in operation 705, the electronic device may display content (e.g., second content) related to the content (e.g., first content) of the electronic ink display on the second display. For example, the electronic device may display the first content, which is a portion of an image or a portion of a video, on the electronic ink display, and if the set condition is satisfied, the second content, which is a remaining portion of an image or a remaining portion of a video displayed on the second display, may be displayed.
[0167] According to one embodiment, an electronic device may display second content related to first content displayed on an electronic ink display as an always-on display (AOD) screen on a second display. The electronic device may determine the ambient illuminance through at least one light sensor (e.g., a first light sensor disposed in a first housing toward a first display and / or a second light sensor disposed in a first housing toward a second display). According to one embodiment, the electronic device may determine whether the reflected light is due to the light emission of a display (e.g., a first display, a second display) rather than an external light source by additionally considering the color (e.g., frequency components of each RGB color) in addition to the intensity of light received through the at least one light sensor.
[0168] According to one embodiment, the electronic device can adjust the brightness of a second display displaying content of the same theme as the content of the electronic ink display based on ambient light sensed by at least one light sensor.
[0169] In one embodiment, the electronic device may display the second content on the AOD screen by changing the color of the second content to a color that consumes less power, if the second display uses a light-emitting element (e.g., OLED) that consumes different power depending on the color.
[0170] In one embodiment, when the AOD mode is turned off via a touch or physical key on the second display, the electronic device may display the second content on the second display by changing the color to the same as the first content displayed on the electronic ink display.
[0171] In one embodiment, when a video (e.g., an animation) with the same theme as the content of the electronic ink display is displayed on the second display, the electronic device may display it in the form of a still image to reduce power consumption in AOD mode.
[0172] In one embodiment, when the second content is displayed on the second display, the first display may be activated (on) or deactivated (off). For example, when the electronic device is in a folded state, the electronic device may deactivate the first display and activate the second display. In one embodiment, the electronic device may display the second content on the second display when a set condition for displaying the electronic ink display is satisfied.
[0173] In one embodiment, when the electronic device is in an unfolded or semi-folded state, the electronic device may activate the first display and deactivate the second display, but may activate the second display to display second content if a set condition for displaying the electronic ink display is satisfied. In this case, the first display may be activated.
[0174] In one embodiment, when the electronic device is in an unfolded state, the first display may be deactivated if certain conditions are met, as described below.
[0175] In one embodiment, in operation 706, the electronic device may determine whether the unfolding, voice call, and ambient illuminance of the first side are less than a set value.
[0176] In one embodiment, the device may deactivate the first display if the device is unfolding, making a voice call, and the ambient light level of the first side is below a set value (operation 706 - Yes), in operation 707.
[0177] In one embodiment, when the electronic device is in an unfolded state, a voice call function is running, and the ambient light of the first surface is below a set value, the electronic device may determine that the first display is in contact with the user's face and deactivate the first display.
[0178] In one embodiment, when the electronic device is in an unfolded state, the first display is facing downward, and the ambient illuminance of the first surface is less than a set value, the electronic device may determine that the first display is lying face down on the floor, and the electronic device may deactivate the first display.
[0179] In one embodiment, if the electronic device is not in a semi-folded state, a voice call is not in progress, or the ambient light level of the first side is not less than a set value (action 706 - No), the electronic device may keep the first display in an activated state. For example, if the electronic device is in a semi-folded state, is not in a voice call, or the ambient light level of the first side is greater than or equal to a set value, the electronic device may keep the first display in an activated state.
[0180] In one embodiment, even when the device is in an unfolded state and the ambient light level of the first surface is below a set value, when not on a voice call or when the first display is not facing downwards, the electronic device can keep the first display in an activated state by determining that only the first light sensor, and not the entire first display, is covered by the finger.
[0181] In one embodiment, if the condition for displaying the electronic ink display is not satisfied (operation 703 - No), in operation 708, the electronic device can determine the folding angle of the electronic device. In one embodiment, even if the ambient illuminance of the fourth surface does not satisfy the set condition (operation 704 - No), the electronic device can proceed to operation 708 to determine the folding angle of the electronic device.
[0182] According to one embodiment, the electronic device can determine a folding angle between the first housing and the second housing based on the orientation and / or rotation of the first housing sensed through an inertial sensor disposed in the first housing and the orientation and / or rotation of the first housing sensed through an inertial sensor of the second housing.
[0183] In one embodiment, the electronic device can determine the folding angle of the electronic device through a Hall sensor. For example, the folding angle can be determined based on the magnetic strength sensed by a magnet disposed in one of the first housing and the second housing and a magnetic sensor disposed in the other.
[0184] In one embodiment, when the folding angle of the electronic device is in an unfolding or semi-folding state (operation 708 - unfolding or semi-folding), in operation 709, the electronic device can activate the first display and deactivate the second display.
[0185] According to one embodiment, even if the second display is inactive, the electronic device can activate the second display and display second content when a user input is received to activate the second display, such as a touch, swipe, or physical key on the second display. This can prevent malfunctions on the second display and reduce power consumption.
[0186] According to one embodiment, when the folding angle of the electronic device is in a folding state (operation 708 - folding), in operation 710, the electronic device can deactivate the first display and display a default screen on the second display.
[0187] In one embodiment, when the electronic ink display is not visible to the user or a person nearby, the electronic device may display a default screen (e.g., clock information, date information, battery information, notification information) without displaying the second content corresponding to the first content.
[0188] The operations in Fig. 7 may be performed in different orders, and at least two operations may be performed in parallel.
[0189] In this way, the electronic device can determine whether to activate the first display and the second display based on the posture of the electronic device based on the sensing values of the plurality of inertial sensors, the sensing values of the plurality of light sensors, and the currently executing function.
[0190] Some of the various embodiments of whether the first display and the second display are activated according to the sensing values of the plurality of inertial sensors, the sensing values of the plurality of light sensors, and the currently executing function may be as shown in Table 1 below.
[0191]
[0192] Referring to Table 1, if the ambient illuminance value measured by the first to third illuminance sensors, such as case #1, does not meet the threshold value (e.g., inside a pocket or bag), the electronic device can disable (turn off) both the first display and the second display, regardless of the values of the inertial sensors.
[0193] According to one embodiment, case #2 may be a state in which the electronic device is in a folded state and lying face down on the floor, such as the second folding state (820) of FIG. 8A below. According to one embodiment, in case #2, since the electronic device is in a folded state, the measurement value of the first illuminance sensor may not meet the threshold value, and since the second display is in a face down state facing the floor, the measurement value of the second illuminance sensor may not meet the threshold value, and the measurement value of the third illuminance sensor may meet the threshold value. According to one embodiment, in case #2, the electronic device may deactivate both the first display and the second display.
[0194] According to one embodiment, case #3 may be a state in which the electronic device is placed on the floor in a folded state, such as the first folding state (810) of FIG. 8A below. According to one embodiment, in case #3, since the electronic device is in a folded state, the measurement value of the first illuminance sensor may not meet the threshold value, and since the second display is placed facing the ceiling, the measurement value of the second illuminance sensor may meet the threshold value, and the measurement value of the third illuminance sensor may not meet the threshold value. According to one embodiment, in case #3, the electronic device may deactivate the first display and activate the second display.
[0195] According to one embodiment, case #4 may be a state in which the electronic device is in a folded state and then stands up, such as the third folding state (830) of FIG. 8B below. According to one embodiment, in case #4, since the electronic device is in a folded state, the measurement value of the first illuminance sensor may not meet the threshold value, and since the electronic device is in a standup state, the measurement values of the second illuminance sensor and the third illuminance sensor may meet the threshold value. According to one embodiment, in case #4, the electronic device may deactivate the first display and activate the second display.
[0196] According to an embodiment, case #5-1 and case #8 may be a state in which the electronic device is laid face down on the floor in an unfolded state, such as the second unfolded state (1020) of FIG. 10 below. According to an embodiment, in case #5-1, since the surroundings of the electronic device are dark (e.g., at night), the measurement values of the first to third light sensors may not meet the threshold values. According to an embodiment, in case #8, since the surroundings of the electronic device are bright (e.g., during the day), and the electronic device is laid face down on the floor in an unfolded state, the measurement values of the first light sensor may not meet the threshold values, and the measurement values of the second and third light sensors may meet the threshold values. According to an embodiment, in case #5-1 and case #8, the electronic device may deactivate the first display and activate the second display.
[0197] According to an embodiment, case #5-2 and case #9 may be a state in which the electronic device is laid on the floor in an unfolded state, such as the first unfolded state (1010) of FIG. 10 below. According to an embodiment, in case #5-2, since the surroundings of the electronic device are dark (e.g., at night), the measurement values of the first to third light sensors may not meet the threshold values. According to an embodiment, in case #9, since the surroundings of the electronic device are bright (e.g., during the day) and the electronic device is laid on the floor in an unfolded state facing the ceiling, the measurement value of the first light sensor may meet the threshold values, and the measurement values of the second and third light sensors may not meet the threshold values. According to an embodiment, in case #5-2 and case #9, the electronic device may activate the first display and deactivate the second display.
[0198] According to an embodiment, case #5-3, case #6, and case #7 may be a state in which a general call function is being executed while the electronic device is unfolded as illustrated in FIG. 12 below. For example, a state in which the general call function is being executed may be a state in which the electronic device is held in the user's hand and a portion of the first display is brought close to the user's face and / or ear. According to an embodiment, in case #5-3, since the surroundings of the electronic device are dark (e.g., at night), the measurement values of the first light sensor to the third light sensor may not meet the threshold value. According to an embodiment, in case #6 and case #7, the surroundings of the electronic device are bright (e.g., during the day), and depending on where the user holds the electronic device, the measurement values of the second light sensor or the third light sensor may not meet the threshold value. According to an embodiment, in case #5-3, case #6, and case #7, the electronic device may deactivate the first display because the first display is brought close to the user's face. In one embodiment, for case #5-3, case #6 and case #7, the electronic device can activate the second display since the electronic ink display is at least partially exposed.
[0199] According to one embodiment, case #11-1 may be a state in which the electronic device is placed on the floor in a partially unfolded intermediate state, such as the first semi-folded state (910) of FIG. 9 below. According to one embodiment, in case #11-1, since the electronic device is in a partially unfolded intermediate state, the measurement values of the first illuminance sensor and the second illuminance sensor may meet threshold values, and since the electronic device is placed on the floor, the measurement value of the third illuminance sensor may not meet the threshold value. According to one embodiment, in case #11-1, in which the first camera is activated (first CAM ON), the electronic device may operate in a dual display mode that activates both the first display and the second display.
[0200] According to one embodiment, case #10 may be a state in which a user holds the first housing with his / her hand while the electronic device is in a partially unfolded intermediate state, such as a semi-folded state. According to one embodiment, in case #10, since the user holds the first housing with his / her hand while the electronic device is in a partially unfolded intermediate state, the measurement value of the second illuminance sensor may not meet the threshold value, and the measurement values of the first illuminance sensor and the third illuminance sensor may meet the threshold value. According to one embodiment, in case #10, the electronic device may activate the first display and deactivate the second display.
[0201] According to one embodiment, case #11-2 may be a state in which the user holds the second housing with his / her hand while the electronic device is in a partially unfolded intermediate state, such as a semi-folded state. According to one embodiment, in case #11-2, since the user holds the second housing with his / her hand while the electronic device is in a partially unfolded intermediate state, the measurement value of the third illuminance sensor may not meet the threshold value, and the measurement values of the first illuminance sensor and the second illuminance sensor may meet the threshold value. According to one embodiment, in case #11-2, the electronic device may activate the first display, and activate or deactivate the second display depending on the angle between the electronic ink display and the ground. For example, if the electronic ink display is determined to be visible from the surroundings when the electronic ink display is at a set angle or more with the ground, the electronic device may also activate the second display.
[0202] In one embodiment, case #12 may be a state in which the electronic device is in a partially unfolded intermediate state, such as a semi-folded state, and the first display is face down so that it faces the floor. In one embodiment, in case #12, since the electronic device is in a partially unfolded intermediate state and the first display is face down so that it faces the floor, the measurement values of the first light sensor, the second light sensor, and the third light sensor may meet threshold values. In one embodiment, in case #12, the electronic device may deactivate the first display and activate the second display.
[0203] In this way, by displaying content related to the content displayed on the electronic ink display on a secondary display, the usability of the electronic ink display can be improved, and the effect of attaching a case to the electronic device can be provided. Furthermore, by displaying content related to the content displayed on the electronic ink display on the secondary display only when the electronic ink display is displayed, power consumption can be reduced.
[0204] FIG. 8A is a drawing for explaining a sensing value of an electronic device when the electronic device is in a folded state according to one embodiment of the present disclosure.
[0205] FIG. 8b is a drawing for explaining a sensing value of an electronic device when the electronic device is in a folded state according to one embodiment of the present disclosure.
[0206] Referring to FIGS. 8A and 8B, the X-axis of the first inertial sensor (520) (e.g., the first inertial sensor (520) of FIG. 5) may be parallel to an axis between the first housing (e.g., the first housing (210) of FIG. 2) and the second housing (e.g., the second housing (220) of FIG. 2). The Z-axis of the first inertial sensor (520) may be a direction in which the first display (e.g., the display (230) of FIG. 2) faces. The Y-axis of the first inertial sensor (520) may be a direction perpendicular to the X-axis and the Z-axis.
[0207] According to one embodiment, the plurality of axes of the second inertial sensor (521) (e.g., the second inertial sensor (521) of FIG. 5) may be configured identically to the plurality of axes of the first inertial sensor (520). An electronic device (e.g., the electronic device (101) of FIG. 1, the processor (120) of FIG. 1, or the electronic device (200) of FIG. 2) may identify an angle between a direction in which a first surface of the first housing (e.g., the first surface (510) of FIG. 5) and a third surface of the second housing (e.g., the third surface (512) of FIG. 5)) are facing, based on data acquired using the first inertial sensor (520) and data acquired using the second inertial sensor (521).
[0208] Referring to FIG. 8a, the first folding state (810) may be a state in which the X-axis value of the first inertial sensor is 0, the Y-axis value is 0, and the Z-axis value is -90, the X-axis value of the second inertial sensor is 0, the Y-axis value is 0, and the Z-axis value is 90, and the first surface of the first housing and the third surface of the second housing are in contact with each other so as to face oppositely along the Z-axis, and the first light sensor (530) may be covered by folding.
[0209] According to one embodiment, the first folding state (810) may be a state in which the fourth side of the second housing (e.g., the fourth side (513) of FIG. 5) is in contact with the floor and the second side of the first housing (e.g., the second side (511) of FIG. 5) is visible, such that the second light sensor (531) is not covered.
[0210] According to one embodiment, the electronic device may deactivate the first display in the first folding state (810), activate the second display when the value sensed by the second light sensor (531) is equal to or greater than a set value, and deactivate the second display when the value sensed by the second light sensor (531) is less than the set value (e.g., in a pocket, in a bag). According to one embodiment, when a user input (e.g., a touch, a swipe, a physical key) for activating the second display is received while the second display is in a deactivated state, the electronic device may switch the second display to be activated.
[0211] According to one embodiment, the second folding state (820) may be a state in which the X-axis value of the first inertial sensor is 0, the Y-axis value is 0, and the Z-axis value is 90, and the X-axis value of the second inertial sensor is 0, the Y-axis value is 0, and the Z-axis value is -90, the first surface of the first housing and the third surface of the second housing are in contact with each other so as to face oppositely along the Z-axis, and the first light sensor is covered by the folding.
[0212] According to one embodiment, the second folding state (820) may be a state in which the second side of the first housing touches the floor and the fourth side of the second housing is visible, and the third light sensor (532) is not covered.
[0213] According to one embodiment, the electronic device may deactivate the first display in the second folding state (820) and deactivate the second display when the value sensed by the second light sensor (531) is less than the set value.
[0214] Referring to FIG. 8b, the third folding state (830) may be a state in which the X-axis value of the first inertial sensor is 0, the Y-axis value is -90, and the Z-axis value is 0, the X-axis value of the second inertial sensor is 0, the Y-axis value is 90, and the Z-axis value is 0, and the first surface of the first housing and the third surface of the second housing are in contact with each other so as to face oppositely along the Z-axis, and the first light sensor (530) may be covered by folding.
[0215] According to one embodiment, the third folding state (830) may be a state in which both the second side of the first housing and the fourth side of the second housing are visible, and the second light sensor (531) and the third light sensor (e.g., the third light sensor (532) of FIG. 8A) are not covered.
[0216] According to one embodiment, the electronic device may deactivate the first display in the third folding state (830), activate the second display when the value sensed by the second light sensor (531) is equal to or greater than a set value, and deactivate the second display when the value sensed by at least one of the second light sensor (531) or the third light sensor is less than the set value (e.g., in a pocket, in a bag). According to one embodiment, when a user input (e.g., a touch, a swipe, a physical key) for activating the second display is received while the second display is in a deactivated state, the electronic device may switch the second display to be activated.
[0217] FIG. 9 is a drawing for explaining a sensing value of an electronic device when the electronic device is in a semi-folded state according to one embodiment of the present disclosure.
[0218] Referring to FIG. 9, the first semi-folding state (910) may be a state in which the X-axis value of the first inertial sensor is 0, the Y-axis value is 90, and the Z-axis value of the second inertial sensor is 0, the Y-axis value is 0, and the Z-axis value is 90, such that the angle formed by the first surface of the first housing and the third surface of the second housing is approximately 90 degrees, the first illuminance sensor (530) and the second illuminance sensor (531) are not covered, and the third illuminance sensor (532) is covered by the floor.
[0219] In one embodiment, the electronic device can activate the first display and deactivate the second display in the first semi-folded state (910).
[0220] In one embodiment, when a user input (e.g., a touch, a swipe, a physical key) is received to activate the second display while the second display is inactive, the electronic device can switch the second display to active.
[0221] In one embodiment, when a specific function, such as taking a photo or video, is executed in a semi-folded state, the electronic device may display a preview screen displayed on the first display on the second display as well.
[0222] According to one embodiment, when a specific function, such as taking a selfie or video, is executed using the front camera in a semi-folded state, content related to the content displayed on the electronic ink display can be displayed on the second display according to the user's settings.
[0223] FIG. 10 is a drawing for explaining a sensing value of an electronic device when the electronic device is in an unfolded state according to one embodiment of the present disclosure.
[0224] Referring to FIG. 10, the first unfolded state (1010) may be a state in which the X-axis value of the first inertial sensor is 0, the Y-axis value is 0, and the Z-axis value is 90, and the X-axis value of the second inertial sensor is 0, the Y-axis value is 0, and the Z-axis value is 90, so that the first surface of the first housing and the third surface of the second housing are parallel, the first illuminance sensor (530) is not covered, and the second illuminance sensor (531) and the third illuminance sensor (532) are covered by the floor.
[0225] According to one embodiment, the electronic device can activate the first display and deactivate the second display in the first unfolded state (1010).
[0226] According to one embodiment, the second unfolded state (1020) may be a state in which the X-axis value of the first inertial sensor is 0, the Y-axis value is 0, and the Z-axis value is -90, the X-axis value of the second inertial sensor is 0, the Y-axis value is 0, and the Z-axis value is -90, the first surface of the first housing and the third surface of the second housing are parallel, the second illuminance sensor (531) and the third illuminance sensor (532) are not covered, and the first illuminance sensor (530) is covered by the floor.
[0227] In one embodiment, the electronic device can deactivate the first display and activate the second display in the second unfolded state (1020). In one embodiment, since the electronic ink display is visible, the electronic device can display second content related to the first content displayed on the electronic ink display on the second display.
[0228] FIG. 11A is a drawing for explaining set conditions under which an electronic ink display can be displayed when an electronic device is in a folded state according to one embodiment of the present disclosure.
[0229] FIG. 11b is a drawing for explaining set conditions under which an electronic ink display can be viewed when the electronic device is in a semi-folded state according to one embodiment of the present disclosure.
[0230] FIG. 11c is a drawing for explaining set conditions under which an electronic ink display can be viewed when an electronic device is in an unfolded state according to one embodiment of the present disclosure.
[0231] Referring to FIG. 11a, when an electronic device (e.g., an electronic device (101) of FIG. 1) is folded, if it is confirmed that a fourth surface (1110) (e.g., a fourth surface (513) of FIG. 5) on which an electronic ink display (e.g., an electronic ink display (250) of FIG. 2) is disposed is raised at a set angle (1130) or more from the ground (1120), it can be confirmed that the set condition for the electronic ink display to be visible is satisfied.
[0232] Referring to FIG. 11b, when it is confirmed that the fourth surface (1110) (e.g., the fourth surface (513) of FIG. 5) on which the electronic device (e.g., the electronic device (101) of FIG. 1) has an electronic ink display (e.g., the electronic ink display (250) of FIG. 2) placed in a semi-folded state is raised at a set angle (1131) or more from the ground (1120), it can be confirmed that the set condition for the electronic ink display to be visible is satisfied.
[0233] Referring to FIG. 11c, when it is confirmed that the fourth surface (1110) (e.g., the fourth surface (513) of FIG. 5) on which the electronic ink display (e.g., the electronic ink display (250) of FIG. 2) is disposed in the unfolded state of the electronic device (e.g., the electronic device (101) of FIG. 1) is raised at a set angle (1132) or more from the ground (1120), it can be confirmed that the set condition for the electronic ink display to be visible is satisfied.
[0234] According to one embodiment, the electronic device may be determined to not satisfy the set condition when the fourth surface (1110) is erected at a set angle (1130, 1131, 1132) or more from the ground (1120), but the value sensed by the third illuminance sensor (e.g., the third illuminance sensor (532) of FIG. 5) disposed on the fourth surface is less than the set value.
[0235] According to one embodiment, when a set condition is satisfied, the electronic device can activate a second display (e.g., the sub-display (239) of FIG. 2) and display second content related to the first content displayed on the electronic ink display on the second display.
[0236] According to one embodiment, the electronic device may store a table in which activation of the first display and the second display is mapped to each angle (1130, 1131, 1132) between the fourth surface (1110) and the ground (1120). According to one embodiment, the electronic device may activate both the first display and the second display based on the angle (1130, 1131, 1132) between the fourth surface (1110) and the ground (1120), or may deactivate the first display and switch only the second display on / off.
[0237] FIG. 12 is a drawing for explaining set conditions under which an electronic ink display of an electronic device can be displayed according to an embodiment of the present disclosure.
[0238] Referring to FIG. 12, when the voice call function is running in the unfolded state, the X-axis value of the first inertial sensor (520) is 45, the Y-axis value is 40, and the Z-axis value is 15, and the X-axis value of the second inertial sensor (521) is 45, the Y-axis value is 40, and the Z-axis value is 15, so that the first side of the first housing and the third side of the second housing are parallel, and the electronic device (e.g., the electronic device (101) of FIG. 1 or the electronic device (200) of FIG. 2) may be tilted. According to one embodiment, the first light sensor (530) may be covered by the face, the second light sensor (531) may not be covered, and the third light sensor (532) may be covered by the hand.
[0239] In one embodiment, the electronic device may deactivate the first display when the first light sensor (530) is covered by the face during a voice call. In one embodiment, the electronic device may display second content related to the first content displayed on the electronic ink display on the second display when the third light sensor (532) is covered but the entire electronic ink display is not covered by the hand during a voice call function.
[0240] According to one embodiment, the electronic device can activate the first display and deactivate the second display in the first unfolded state (1010) (e.g., the first unfolded state (1010) of FIG. 10).
[0241] FIG. 13A is a diagram illustrating an operation of displaying content related to content displayed on an electronic ink display of an electronic device on a second display based on a user input, according to an embodiment of the present disclosure.
[0242] FIG. 13b is a diagram illustrating an operation of displaying content related to content displayed on an electronic ink display of an electronic device on a second display based on a user input according to an embodiment of the present disclosure.
[0243] Referring to FIG. 13A, an electronic device (e.g., the electronic device (101) of FIG. 1, the processor (120) of FIG. 1, or the electronic device (200) of FIG. 2) may display second content (1330) related to the first content (1310) on the second display when a second display (239) (e.g., the sub-display (239) of FIG. 2) is in an inactive state (e.g., in an unfolded state, a semi-folded state, or in a pocket or a bag) is received while the first content (1310) is displayed on the electronic ink display (e.g., the electronic ink display (250) of FIG. 2).
[0244] Referring to FIG. 13B, when the electronic device receives a user input (1321) (e.g., swipe, zoom in, zoom out) to activate the second display (239) while the first content (1310) is displayed on the electronic ink display and the second display (239) is in an inactive state (e.g., in an unfolded state, a semi-folded state, or in a pocket or a bag), the electronic device may display the second content (1330) related to the first content (1310) on the second display.
[0245] According to one embodiment, in addition to receiving user input on the second display, the electronic device may also activate the second display based on user input via a physical key. For example, as illustrated in Table 2 below, the second display may be activated via a combination of physical keys.
[0246]
[0247] According to one embodiment, referring to Table 2, when the second display is deactivated in the unfolded state, the electronic device can activate (on) the second display and display the same content as the content displayed on the electronic ink display when 'Vol KEY (e.g., key input device (211) of FIG. 2)_UP' and 'PWR KEY (e.g., key input device (212) of FIG. 2)' are simultaneously selected.
[0248] In one embodiment, the electronic device may add an option to 'operate in secondary display AOD mode' instead of 'voice recognition call' or 'power off menu' when 'PWR KEY Long Click' is performed when the secondary display is disabled in the unfolded state.
[0249] In one embodiment, the electronic device may operate the second display in AOD mode based on a user input for activating the second display. To reduce power consumption in AOD mode, the electronic device may check the ambient lighting conditions through a second light sensor and adjust the brightness of the second content displayed on the second display.
[0250] According to one embodiment, the electronic device can change colors included in the second content to colors that consume less power by deactivating some of the plurality of red (R) light-emitting elements, the plurality of green (G) light-emitting elements, and the plurality of blue (B) light-emitting elements included in the second display.
[0251] In one embodiment, when a user input to disable the AOD mode is received while the second content is displayed in colors that consume less power, the electronic device may change the color of the second content to the same color as the first content and display it.
[0252] In one embodiment, if no user input is received to keep the second display activated for a set period of time after the second display is activated based on user input, the electronic device may deactivate the second display. In one embodiment, the set period of time for automatically deactivating the second display may be changed by a user setting.
[0253] FIG. 14 is a drawing for explaining a theme image displayed on an electronic ink display and a second display of an electronic device according to one embodiment of the present disclosure.
[0254] Referring to FIG. 14, an electronic device (e.g., an electronic device (101) of FIG. 1, a processor (120) of FIG. 1, or an electronic device (200) of FIG. 2) can display a theme image (1410, 1420) on an electronic ink display (e.g., an electronic ink display (250) of FIG. 2) and a second display (e.g., a display module (160) of FIG. 1 or a sub-display (239) of FIG. 2).
[0255] For example, the electronic device may display second content (1412), which is different content having the same theme as the first content (1411) displayed on the electronic ink display. In one embodiment, the second content (1412) may be identical to at least a portion of the first content (1411). In one embodiment, the second content (1412) may be a rotated version of at least a portion of the first content (1411). In one embodiment, the second content (1412) may be different content having the same color and style as the first content (1411).
[0256] According to one embodiment, the electronic device may display first content (1421), which is a portion of an image (1420) or a portion of a video, on an electronic ink display, and second content (1422), which is a remaining portion of an image (1420) or a remaining portion of a video, on a second display.
[0257] FIG. 15A is a diagram for explaining an operation of setting content to be displayed on an electronic ink display through a user input on a second display of an electronic device according to an embodiment of the present disclosure.
[0258] Referring to FIG. 15A, an electronic device (e.g., an electronic device (101) of FIG. 1, a processor (120) of FIG. 1, or an electronic device (200) of FIG. 2) can display a content list (1511) to be displayed on an electronic ink display (250) (e.g., an electronic ink display (250) of FIG. 2) on a second display (239) (e.g., a sub-display (239) of FIG. 2).
[0259] According to one embodiment, the electronic device may display a first content (1520) selected from a content list (1511) on an electronic ink display (250).
[0260] According to one embodiment, the electronic device may display second content (1521) related to the first content (1520) on the second display (239) when a set condition for displaying the electronic ink display (250) is satisfied. According to one embodiment, the electronic device may check information such as the authority, usage period, and / or usage count of the content to be displayed on the electronic ink display on the second display (239).
[0261] According to one embodiment, the electronic device may set conditions for displaying desired content on the electronic ink display (e.g., location and / or time at which the selected content is to be displayed) through the second display (239), and may display a preview of the content to be displayed on the electronic ink display through the second display.
[0262] In one embodiment, the electronic device may display selected content on an electronic ink display according to a user's settings.
[0263] FIG. 15b is a diagram illustrating an operation of controlling a second display and an electronic ink display through a user input of an electronic device according to an embodiment of the present disclosure.
[0264] Referring to FIG. 15b, the electronic device can display a content list (1530) including a plurality of contents on the second display.
[0265] According to one embodiment, the electronic device may select content via a left / right swipe input (1531), and upon receiving a swipe input (1532) directed toward the electronic ink display, the electronic device may display the selected content (1533) on the electronic ink display. For example, if the electronic ink display is arranged under the second display in an unfolded state (e.g., in the -Y direction), the electronic device may display the selected content (1533) on the electronic ink display upon receiving a downward swipe input (1532) on the second display. According to one embodiment, if the hinge structure is arranged over the second display in a folded state (e.g., in the in-folding manner of FIG. 3), the electronic device may display the selected content (1533) on the electronic ink display upon receiving an upward swipe input (1532) on the second display.
[0266] According to one embodiment, when the electronic device receives a swipe input (1541) from the electronic ink display toward a second display (e.g., +Y direction) while the first content (1540) is displayed on the electronic ink display, the electronic device may display information (1542) related to the first content (1540) on the second display.
[0267] FIG. 16A is a diagram for explaining an operation of displaying content on a second display of an electronic device according to an embodiment of the present disclosure.
[0268] Referring to FIG. 16A, an electronic device (e.g., an electronic device (101) of FIG. 1, a processor (120) of FIG. 1, or an electronic device (200) of FIG. 2) can identify at least one piece of code information (1611) (e.g., a QR code, a barcode) using a camera (e.g., a camera module (180) of FIG. 1 or a camera device (251, 253) of FIG. 2). The at least one piece of code information can include information about content.
[0269] For example, the electronic device can obtain code information (1611) included in the ticket (1610) by using a camera disposed on a first display (e.g., the display module (160) of FIG. 1 or the display (230) of FIG. 2). According to one embodiment, the electronic device can display a preview image of at least a portion of the ticket (1610) obtained through the camera on a second display (239) (e.g., the display module (160) of FIG. 1 or the sub-display (239) of FIG. 2) and obtain information about the content by identifying at least one piece of code information (1611) from a code image (1620) included in the preview image. For example, if the ticket (1610) is an airline ticket, the electronic device can capture code information (e.g., a QR code or a barcode) included in the airline ticket to obtain airline ticket information (e.g., departure point, destination, flight schedule, flight number, gate, and / or seat number).
[0270] FIG. 16b is a diagram for explaining an operation of displaying content on a second display and an electronic ink display of an electronic device according to an embodiment of the present disclosure.
[0271] Referring to FIG. 16B, when the electronic device is located at a location associated with code information (e.g., code information (1611) of FIG. 16A) and / or a time associated with the code information arrives, the electronic device may display a ticket image (1630) on the electronic ink display (250) (e.g., the electronic ink display (250) of FIG. 2). According to one embodiment, the electronic device may display a ticket image (1630) generated based on information about the acquired content on the electronic ink display (250). For example, the ticket image (1630) may include a departure point, a destination, a flight schedule, a flight number, a gate, and / or a seat number. According to one embodiment, the ticket image (1630) may further include a code image.
[0272] According to one embodiment, when a ticket image (1630) is displayed on the electronic ink display (250), the electronic device may display an image (1640) related to the ticket image (1630) on the second display (239). For example, if the ticket image (1630) is an airline ticket image, the electronic device may display an airport map image on the second display. According to one embodiment, the electronic device may determine the current location of the electronic device based on GPS, and display a navigation screen to the boarding gate based on the current location of the electronic device on the second display.
[0273] In one embodiment, the electronic device may restore the ticket image (1630) displayed on the electronic ink display (250) and the image (1640) associated with the ticket image (1630) displayed on the second display (239) to the original image when the electronic device is located at a location associated with the code information and / or moves out of a time associated with the code information.
[0274] According to one embodiment, the electronic device may set a ticket image (1630) to be displayed on the electronic ink display (250) and an image (1640) related to the ticket image (1630) to be displayed on the second display (239) by user input when the electronic device is located at a location associated with the code information and / or a time associated with the code information occurs. For example, as illustrated in FIG. 16A, when obtaining code information (1611) using a camera, the electronic device may set a ticket image (1630) to be displayed on the electronic ink display (250) and an image (1640) related to the ticket image (1630) to be displayed on the second display (239) by user input when the electronic device is located at a location associated with the code information (1611) and / or a time associated with the code information (1611) occurs.
[0275] According to one embodiment, the electronic device may be positioned at a location associated with the code information and / or the time associated with the code information may be set by user input as illustrated in FIG. 16c.
[0276] FIG. 16c is a diagram for explaining an operation of setting content to be displayed on a second display and an electronic ink display of an electronic device according to an embodiment of the present disclosure.
[0277] Referring to FIG. 16C, the electronic device may set a date and / or time at which an image related to code information (e.g., code information (1611) of FIG. 16A) is to be displayed on the electronic ink display (e.g., ticket image (1630) of FIG. 16B) via a screen (1650) that sets a time at which the image related to code information (e.g., code information (1611) of FIG. 16A) is to be displayed on the electronic ink display. According to one embodiment, the electronic device may display the screen (1650) that sets a time at which the image is to be displayed on the electronic ink display on a second display.
[0278] According to one embodiment, the electronic device may set a location where an image related to code information is to be displayed on the electronic ink display through a screen (1660) for setting a location where an image related to code information is to be displayed on the electronic ink display. According to one embodiment, the electronic device may display the screen (1660) for setting a location for displaying an image related to code information on the first display. For example, the screen (1660) for setting a location may be set through a map application.
[0279] In one embodiment, the electronic device may, upon receiving user input, select a time and / or location associated with code information, select an image to be displayed on the electronic ink display and / or an image to be displayed on the second display, and then apply the time and / or location associated with code information, the image to be displayed on the electronic ink display, and / or the image to be displayed on the second display, based on the user input, via a message (1670) to confirm application.
[0280] FIG. 17A is a diagram for explaining an operation of setting content to be displayed on a second display and an electronic ink display of an electronic device according to an embodiment of the present disclosure.
[0281] Referring to FIG. 17A, an electronic device (e.g., the electronic device (101) of FIG. 1, the processor (120) of FIG. 1, or the electronic device (200) of FIG. 2) can set a schedule to display selected content on the electronic ink display and the second display through a linked calendar application screen (1710).
[0282] For example, when a date is selected through a calendar application screen (1710), the electronic device may display a screen (1720) for setting a time to display the selected content on the electronic ink display and the second display among the selected dates. According to one embodiment, the electronic device may also select a location to display the selected content on the electronic ink display and the second display through the screen (1720) for setting the time.
[0283] For example, when visiting a baseball stadium, if the electronic device wishes to display selected content on the electronic ink display and the secondary display, the electronic device may set the date, time, and / or location of the baseball stadium visit based on user input. In one embodiment, the electronic device may independently set the time condition or location condition, or may set both conditions to be satisfied.
[0284] According to one embodiment, when a date and time for displaying selected content on the electronic ink display and the second display are set, the electronic device may display a screen for selecting content to be displayed on the electronic ink display and the second display, as illustrated in FIG. 17b.
[0285] FIG. 17b is a diagram for explaining an operation of setting content to be displayed on an electronic ink display of an electronic device according to an embodiment of the present disclosure.
[0286] Referring to FIG. 17b, the electronic device may receive user input to select content (1730) to be displayed on the electronic ink display and content (1740) to be displayed on the second display at a set schedule and / or location.
[0287] For example, the electronic device may be configured to display content (1730) related to a baseball team on the electronic ink display and a map screen (1740), such as a seating chart of a baseball stadium, on a second display having a higher resolution, based on user input.
[0288] In one embodiment, the electronic device may, based on user input, select a time and / or location through a linked application, select content (1730) to be displayed on the electronic ink display and / or a map screen (1740) to be displayed on the second display, and then display a message (1750) to confirm application (e.g., on the first display). For example, when user input is received through the message (1750), the linked application may apply the time and / or location input, the content (1730) to the electronic ink display, and / or the map screen (1740) to be displayed on the second display.
[0289] According to one embodiment, the electronic device may utilize time and / or GPS information to display selected content (1730, 1740) on the electronic ink display and / or the second display only at a set time and / or location.
[0290] In one embodiment, when moving out of a set time and / or location, the electronic device may automatically revert to its original image.
[0291] FIG. 18 is a diagram for explaining an operation of setting content to be displayed on an electronic ink display of an electronic device according to an embodiment of the present disclosure.
[0292] Referring to FIG. 18, an electronic device (e.g., an electronic device (101) of FIG. 1, a processor (120) of FIG. 1, or an electronic device (200) of FIG. 2) can set a location to display selected content on an electronic ink display and a second display through a linked map application screen (1810) (or a navigation application screen).
[0293] In one embodiment, the electronic device may receive user input selecting content (1820) to be displayed on the electronic ink display at a set location and content (1830) to be displayed on the second display.
[0294] For example, the electronic device may be configured to display content (1820) related to a baseball team on the electronic ink display and a map screen (1830), such as a seating chart of a baseball stadium, on a second display having a higher resolution, based on user input.
[0295] In one embodiment, the electronic device may, based on user input, select a location through a linked application, select content (1820) to be displayed on the electronic ink display and / or a map screen (1830) to be displayed on the second display, and then display a message (1840) to confirm application (e.g., on the first display). For example, when user input is received through the message (1840), the linked application may apply the entered location, content (1820) to the electronic ink display, and / or map screen (1830) to be displayed on the second display.
[0296] According to one embodiment, the electronic device may utilize GPS information to display selected content (1820, 1830) on the electronic ink display and / or the second display only at set locations.
[0297] In one embodiment, when the electronic device leaves the set location, the electronic device can automatically revert to its original image.
[0298] In this way, by displaying content related to the content displayed on the electronic ink display on a secondary display, the usability of the electronic ink display can be improved, and the effect of attaching a case to the electronic device can be provided. Furthermore, by displaying content related to the content displayed on the electronic ink display on the secondary display only when the electronic ink display is displayed, power consumption can be reduced.
[0299] The technical problems to be achieved in the present disclosure are not limited to the technical problems mentioned above, and other technical problems not mentioned will be clearly understood by a person having ordinary knowledge in the technical field to which the present disclosure pertains.
[0300] According to one embodiment, an electronic device (e.g., an electronic device (101) of FIG. 1 or an electronic device (200) of FIG. 2) comprises a first housing (e.g., a first housing (210) of FIG. 2) including a first side (e.g., a first side (210a) of FIG. 2 or a first side (510) of FIG. 5) and a second side opposite to the first side (e.g., a second side (210b) of FIG. 2 or a second side (511) of FIG. 5), a second housing (e.g., a second housing (220) of FIG. 2) including a third side (e.g., a third side (220a) of FIG. 2 or a third side (512) of FIG. 5) and a fourth side opposite to the third side (e.g., a fourth side (220b) of FIG. 2 or a fourth side (513) of FIG. 5), and a second housing rotatably connecting the first housing and / or the second housing. A hinge structure, a first display (e.g., a display module (160) of FIG. 1 or a display (230) of FIG. 2) disposed on the first surface and the third surface, a second display (e.g., a display module (160) of FIG. 1 or a sub-display (239) of FIG. 2) disposed on the second surface, an electronic ink display (e.g., an electronic ink display (250) of FIG. 2) disposed on the fourth surface, at least one first sensor (e.g., a sensor module (176) of FIG. 1, a first inertial sensor (520) of FIG. 5 or a second inertial sensor (520) of FIG. 5) for sensing a folding angle between the first housing and the second housing, at least one second sensor (e.g., a sensor module (176) of FIG. 1, a first inertial sensor (520) of FIG. 5 or a second inertial sensor (520) of FIG. 5) for sensing a direction of the electronic device, at least one processor (e.g., a processor of FIG. 1) It may include a processor (120)) and a memory (e.g., memory (130) of FIG. 1) that stores instructions.
[0301] According to one embodiment, when the instructions are executed by the at least one processor, the electronic device can obtain the folding angle sensed by the at least one first sensor.
[0302] In one embodiment, when the instructions are executed by the at least one processor, the electronic device can obtain an orientation of the electronic device sensed by the at least one second sensor.
[0303] In one embodiment, when the instructions are executed by the at least one processor, the electronic device can determine whether the electronic ink display satisfies a set condition that the electronic ink display is visible, based on at least one of the folding angle or the orientation of the electronic device, while the first content is displayed on the electronic ink display.
[0304] According to one embodiment, when the instructions are executed by the at least one processor, the electronic device may display second content corresponding to the first content on the second display based on satisfaction of the set condition.
[0305] According to one embodiment, when the instructions are executed by the at least one processor, the electronic device can determine that the set condition is satisfied if it is determined that the fourth side is raised at a set angle or more from the ground based on at least one of the folding angle or the orientation of the electronic device.
[0306] According to one embodiment, the electronic device may further include a light sensor on the fourth surface (e.g., the sensor module (176) of FIG. 1 or the third light sensor (532) of FIG. 5).
[0307] According to one embodiment, when the instructions are executed by the at least one processor, the electronic device can display the second content on the second display based on satisfying the set condition when the value sensed by the light sensor on the fourth surface is greater than or equal to the set value.
[0308] According to one embodiment, when the instructions are executed by the at least one processor, the electronic device can determine that the set condition is not satisfied if the value sensed by the light sensor on the fourth surface is less than the set value.
[0309] According to one embodiment, the electronic device may further include a light sensor on the first surface (e.g., the sensor module (176) of FIG. 1 or the third light sensor (532) of FIG. 5).
[0310] In one embodiment, when the instructions are executed by the at least one processor, the electronic device can determine that the folding angle is within a range corresponding to unfolding and that the first display is facing downward based on at least one of the orientations of the electronic device.
[0311] In one embodiment, when the instructions are executed by the at least one processor, the electronic device can determine that the set condition is satisfied based on a value sensed by the light sensor on the first surface being less than a set value, and switch the first display to a low power state.
[0312] In one embodiment, the first content may be a portion of an image or a portion of a video.
[0313] In one embodiment, the second content may be a remaining portion of the image or a remaining portion of the video.
[0314] According to one embodiment, the electronic device may further include at least one light sensor (e.g., the sensor module (176) of FIG. 1 or the third light sensor (532) of FIG. 5).
[0315] In one embodiment, when the instructions are executed by the at least one processor, the electronic device can sense ambient illuminance by the at least one illuminance sensor.
[0316] In one embodiment, when the instructions are executed by the at least one processor, the electronic device may display the second content at the same brightness as the first content based on the ambient illuminance.
[0317] According to one embodiment, the second display may include a plurality of R (red) light-emitting elements, a plurality of G (green) light-emitting elements, and a plurality of B (blue) light-emitting elements.
[0318] In one embodiment, when the instructions are executed by the at least one processor, the electronic device can change colors included in the second content corresponding to colors included in the first content to colors that consume less power by deactivating some of the plurality of R (red) light-emitting elements, the plurality of G (green) light-emitting elements, and the plurality of B (blue) light-emitting elements.
[0319] According to one embodiment, when the instructions are executed by the at least one processor, the electronic device can display the second content with changed colors on an always on display (AOD) screen.
[0320] In one embodiment, when the instructions are executed by the at least one processor, the electronic device can change the first content displayed on the electronic ink display to third content associated with at least one of the preset time or the preset location, based on satisfaction of at least one of the preset time or the preset location.
[0321] In one embodiment, when the instructions are executed by the at least one processor, the electronic device can change the second content displayed on the second display to fourth content related to the third content based on the third content being displayed on the electronic ink display.
[0322] In one embodiment, when the instructions are executed by the at least one processor, the electronic device can display a plurality of contents on the second display.
[0323] In one embodiment, when the instructions are executed by the at least one processor, the electronic device may display the first content on the electronic ink display based on receiving a user input selecting the first content from among the plurality of contents through the second display.
[0324] According to one embodiment, the electronic device may further include a light sensor on the fourth surface.
[0325] According to one embodiment, the electronic device may further include an NFC module (e.g., the communication module (190) of FIG. 1).
[0326] According to one embodiment, when the instructions are executed by the at least one processor, the electronic device can display the second content on the second display based on satisfying the set condition when the value sensed by the light sensor on the fourth surface is greater than or equal to the set value.
[0327] According to one embodiment, when the instructions are executed by the at least one processor, the electronic device may not set the condition when the case mounting is confirmed by the NFC module and the value sensed by the first light sensor is less than the set value.
[0328] According to one embodiment, a method for controlling an electronic device includes a first housing including a first side and a second side opposite to the first side, a second housing including a third side and a fourth side opposite to the third side, a hinge structure rotatably connecting the first housing and the second housing, a first display disposed on the first side and the third side, a second display disposed on the second side, an electronic ink display disposed on the fourth side, at least one first sensor for sensing a folding angle between the first housing and the second housing, and at least one second sensor for sensing a direction of the electronic device, the method may include an operation of acquiring a folding angle sensed by the at least one first sensor.
[0329] According to one embodiment, the method for controlling the electronic device may include an operation of obtaining a direction of the electronic device sensed by the at least one second sensor.
[0330] According to one embodiment, the control method of the electronic device may include an operation of determining whether the electronic ink display satisfies a set condition that the electronic ink display can be viewed, based on at least one of the folding angle or the orientation of the electronic device, while the first content is displayed on the electronic ink display.
[0331] According to one embodiment, the control method of the electronic device may include an operation of displaying second content corresponding to the first content on the second display based on satisfaction of the set condition.
[0332] According to one embodiment, the operation of checking whether the set condition is satisfied may be performed by checking that the set condition is satisfied when it is confirmed that the fourth side is raised at an angle greater than the set angle from the ground based on either the folding angle or the direction of the electronic device.
[0333] According to one embodiment, the operation of displaying the second content may display the second content on the second display based on satisfying the set condition when the value sensed by the light sensor on the fourth surface is equal to or greater than a set value.
[0334] According to one embodiment, the operation of checking whether the set condition is satisfied may be performed by checking that the set condition is not satisfied when the value sensed by the light sensor on the fourth surface is less than the set value.
[0335] According to one embodiment, the operation of checking whether the set condition is satisfied may include checking that the folding angle is within a range corresponding to unfolding, that the first display is facing downward based on the direction of the electronic device, and that the set condition is satisfied based on a value sensed by a light sensor on the first surface being less than a set value, and switching the first display to a low power state.
[0336] In one embodiment, the first content may be a portion of an image or a portion of a video.
[0337] In one embodiment, the second content may be a remaining portion of the image or a remaining portion of the video.
[0338] According to one embodiment, the operation of displaying the second content may sense ambient illuminance by at least one light sensor and display the second content at the same brightness as the first content based on the ambient illuminance.
[0339] According to one embodiment, the second display may include a plurality of R (red) light-emitting elements, a plurality of G (green) light-emitting elements, and a plurality of B (blue) light-emitting elements.
[0340] According to one embodiment, the operation of displaying the second content may change colors included in the second content corresponding to colors included in the first content to colors with low power consumption by deactivating some of the plurality of R (red) light-emitting elements, the plurality of G (green) light-emitting elements, and the plurality of B (blue) light-emitting elements, and display the second content with the changed colors on an AOD (always on display) screen.
[0341] According to one embodiment, the control method of the electronic device may further include an operation of changing the first content displayed on the electronic ink display to third content associated with at least one of the preset time or the preset location, based on at least one of the preset time or the preset location being satisfied.
[0342] According to one embodiment, a non-transitory computer-readable recording medium storing one or more programs may include instructions that cause an electronic device including a first housing including a first side and a second side opposite the first side, a second housing including a third side and a fourth side opposite the third side, a hinge structure rotatably connecting the first housing and the second housing, a first display disposed on the first side and the third side, a second display disposed on the second side, an electronic ink display disposed on the fourth side, at least one first sensor for sensing a folding angle between the first housing and the second housing, and at least one second sensor disposed in the second housing for sensing an orientation of the electronic device, to obtain the folding angle sensed by the at least one first sensor.
[0343] According to one embodiment, the one or more programs may include instructions that cause the electronic device to obtain an orientation of the electronic device sensed by the at least one second sensor.
[0344] According to one embodiment, the one or more programs may include instructions that cause the electronic device to determine whether a set condition that the electronic ink display is visible is satisfied based on at least one of the folding angle or the orientation of the electronic device while the first content is displayed on the electronic ink display.
[0345] According to one embodiment, the one or more programs may include instructions that cause the electronic device to display second content corresponding to the first content on the second display based on satisfying a set condition.
[0346] In one embodiment, the one or more programs may include instructions that cause the electronic device to determine that the set condition is satisfied when it is determined that the fourth surface is raised at a set angle or more from the ground based on at least one of the direction of the first housing or the direction of the second housing.
[0347] According to one embodiment, the electronic device may further include a light sensor on the fourth surface.
[0348] According to one embodiment, the one or more programs may include instructions that cause the electronic device to display the second content on the second display based on satisfying the set condition when a value sensed by the light sensor on the fourth surface is greater than or equal to a set value.
[0349] According to one embodiment, the one or more programs may include instructions that cause the electronic device to determine that the set condition is not satisfied if a value sensed by the light sensor on the fourth surface is less than the set value.
[0350] According to one embodiment, the electronic device may further include a light sensor on the first surface.
[0351] In one embodiment, the one or more programs may include instructions that cause the electronic device to determine that the folding angle is within a range corresponding to unfolding and that the first display is facing downward based on at least one of the direction of the first housing or the direction of the second housing.
[0352] According to one embodiment, the one or more programs may include instructions that cause the electronic device to determine that the set condition is satisfied based on a value sensed by the light sensor on the first surface being less than a set value, and to switch the first display to a low power state.
[0353] In one embodiment, the first content may be a portion of an image or a portion of a video.
[0354] In one embodiment, the second content may be a remaining portion of the image or a remaining portion of the video.
[0355] According to one embodiment, the electronic device may further include at least one light sensor.
[0356] According to one embodiment, the one or more programs may include instructions that cause the electronic device to sense ambient illuminance by the at least one illuminance sensor.
[0357] In one embodiment, the one or more programs may include instructions that cause the electronic device to display the second content at the same brightness as the first content based on the ambient illuminance.
[0358] According to one embodiment, the second display may include a plurality of R (red) light-emitting elements, a plurality of G (green) light-emitting elements, and a plurality of B (blue) light-emitting elements.
[0359] According to one embodiment, the one or more programs may include instructions that cause the electronic device to change colors included in the second content corresponding to colors included in the first content to colors that consume less power by deactivating some of the plurality of R (red) light-emitting elements, the plurality of G (green) light-emitting elements, and the plurality of B (blue) light-emitting elements.
[0360] According to one embodiment, the one or more programs may include instructions causing the electronic device to display the second content with changed colors on an always on display (AOD) screen.
[0361] In one embodiment, the one or more programs may include instructions that cause the electronic device to change the first content displayed on the electronic ink display to third content associated with at least one of the preset time or the preset location based on satisfaction of at least one of the preset time or the preset location.
[0362] In one embodiment, the one or more programs may include instructions that cause the electronic device to change the second content displayed on the second display to fourth content related to the third content based on the third content being displayed on the electronic ink display.
[0363] In one embodiment, the one or more programs may include instructions that cause the electronic device to display a plurality of contents on the second display.
[0364] In one embodiment, the one or more programs may include instructions that cause the electronic device to display the first content on the electronic ink display based on receiving a user input selecting the first content from among the plurality of contents through the second display.
[0365] According to one embodiment, the electronic device may further include a light sensor on the fourth surface.
[0366] According to one embodiment, the electronic device may further include an NFC module.
[0367] According to one embodiment, the one or more programs may include instructions that cause the electronic device to display the second content on the second display based on satisfying the set condition when a value sensed by the light sensor on the fourth surface is greater than or equal to a set value.
[0368] According to one embodiment, the one or more programs may include instructions for not setting the condition when the electronic device confirms that the case is mounted by the NFC module and a value sensed by the light sensor on the fourth surface is less than the set value.
[0369] According to one embodiment, the method may be implemented in the form of program instructions that can be executed by various computer means and recorded on a computer-readable medium. The medium may continuously store a computer-executable program or temporarily store it for execution or download. Furthermore, the medium may be a variety of recording or storage means in the form of a single or multiple hardware devices combined. It is not limited to media directly connected to a computer system, but may also be distributed across a network.
[0370] The effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned will be clearly understood by a person having ordinary skill in the art to which the present disclosure pertains.
[0371] Electronic devices according to the embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments disclosed in this document are not limited to the aforementioned devices.
[0372] The embodiments of this document and the terminology used herein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.
[0373] The term "module" used in the embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0374] One embodiment of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.
[0375] According to one embodiment, the method according to one embodiment disclosed in this document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.
[0376] According to one embodiment, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to one embodiment, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to one embodiment, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
Claims
1. In electronic devices, A first housing comprising a first side and a second side opposite to the first side; A second housing comprising a third side and a fourth side opposite to the third side; A hinge structure that rotatably connects the first housing and / or the second housing; A first display disposed on the first side and the third side; A second display disposed on the second surface; An electronic ink display disposed on the fourth surface; At least one first sensor for sensing a folding angle between the first housing and the second housing; At least one second sensor for sensing the orientation of the electronic device; at least one processor; and Contains memory that stores instructions, The instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Obtaining the folding angle sensed by at least one first sensor, Obtaining the direction of the electronic device sensed by at least one second sensor, In a state where first content is displayed on the electronic ink display, it is determined whether the electronic ink display satisfies a set condition that can be shown based on at least one of the folding angle or the orientation of the electronic device, An electronic device characterized in that it includes instructions set to display second content corresponding to the first content on the second display based on satisfaction of the above-mentioned set condition.
2. In paragraph 1, The instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: An electronic device characterized in that it further includes an instruction set to determine that the set condition is satisfied when it is confirmed that the fourth side is raised at an angle greater than a set angle from the ground based on at least one of the folding angle or the direction of the electronic device.
3. In paragraph 1 or 2, Further comprising a light sensor on the fourth surface, The instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: An instruction set to display the second content on the second display based on satisfying the set condition when the value sensed by the light sensor on the fourth surface is greater than or equal to a set value, and An electronic device characterized in that it further includes an instruction set to determine that the set condition is not satisfied when the value sensed by the light sensor on the fourth surface is less than the set value.
4. In any one of paragraphs 1 to 3, Further comprising a light sensor on the first surface, The instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: An electronic device characterized in that the folding angle is within a range corresponding to unfolding, and based on the direction of the electronic device, the first display is facing downwards, and based on the value sensed by the light sensor on the first surface being less than a set value, the set condition is determined to be satisfied, and further includes instructions set to switch the first display to a low power state.
5. In any one of paragraphs 1 to 4, The above first content includes a portion of an image or a portion of a video, An electronic device, characterized in that the second content includes a remaining portion of the image or a remaining portion of the video.
6. In any one of paragraphs 1 to 5, further comprising at least one light sensor, The instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: sense ambient illuminance by the at least one illuminance sensor; and An electronic device further comprising instructions configured to display the second content at the same brightness as the first content based on the ambient illuminance.
7. In any one of paragraphs 1 to 6, The second display includes a plurality of R (red) light-emitting elements, a plurality of G (green) light-emitting elements, and a plurality of B (blue) light-emitting elements, The instructions, when the instructions are individually or collectively executed by the at least one processor, cause the electronic device to: change the colors included in the second content corresponding to the colors included in the first content to colors with low power consumption by deactivating some of the plurality of R (red) light-emitting elements, the plurality of G (green) light-emitting elements, and the plurality of B (blue) light-emitting elements; and An electronic device characterized in that it further includes instructions set to display the second content with the changed colors on an AOD (always on display) screen.
8. In any one of paragraphs 1 to 7, The instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: An electronic device further comprising instructions configured to change the first content displayed on the electronic ink display to third content associated with at least one of the preset time or the preset location based on satisfaction of at least one of the preset time or the preset location.
9. In paragraph 8, The instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: An electronic device characterized in that it further includes instructions set to change the second content displayed on the second display to fourth content related to the third content based on the third content being displayed on the electronic ink display.
10. In any one of paragraphs 1 to 9, The instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: An instruction set to display a plurality of contents on the second display, and An electronic device characterized in that it further includes instructions set to display the first content on the electronic ink display based on receiving a user input for selecting the first content from among the plurality of contents through the second display.
11. In any one of paragraphs 1 to 10, A light sensor on the fourth surface, and Including an NFC module, The instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: An instruction set to display the second content on the second display based on the value sensed by the light sensor on the fourth surface being greater than or equal to a set value and satisfying the set condition, and An electronic device characterized in that it further includes an instruction set not to set the condition when the case mounting is confirmed by the NFC module and the value sensed by the light sensor on the fourth surface is less than the set value.
12. In a non-transitory recording medium, the non-transitory recording medium is configured to store computer-readable instructions, which, when executed by at least one processor of an electronic device, cause the electronic device to: Obtaining a folding angle sensed by at least one first sensor disposed in a first housing of the electronic device, Obtaining the direction of the electronic device sensed by at least one second sensor disposed on the electronic device, In a state where first content is displayed on an electronic ink display arranged on the electronic device, it is determined whether the electronic ink display satisfies a set condition that can be shown based on at least one of the folding angle or the direction of the electronic device, and A non-transitory recording medium characterized in that it includes instructions set to display second content corresponding to the first content on a second display disposed on a second surface of the electronic device based on satisfaction of the above-described set condition.
13. In paragraph 12, The above instructions, when executed by at least one processor of the electronic device, cause the electronic device to: A non-transitory recording medium characterized in that it further includes an instruction set to determine that the set condition is satisfied when it is confirmed that the fourth side of the electronic device is raised at a set angle or more from the ground based on either the folding angle or the direction of the electronic device.
14. In paragraph 12 or 13, The instructions, when executed by at least one processor of the electronic device, cause the electronic device to: display the second content on the second display based on satisfying the set condition when the value sensed by the light sensor on the fourth surface is greater than or equal to a set value; and A non-transitory recording medium characterized in that it further includes an instruction set to determine that the set condition is not satisfied when the value sensed by the light sensor on the fourth surface is less than the set value.
15. In any one of paragraphs 12 to 14, The above instructions, when executed by at least one processor of the electronic device, cause the electronic device to: An instruction set to determine that the folding angle is within a range corresponding to unfolding, and that the first display disposed on the first side and the third side of the electronic device is facing downward based on the orientation of the electronic device, and A non-transitory recording medium characterized in that it further includes an instruction set to determine that the set condition is satisfied based on a value sensed by the light sensor on the first surface being less than a set value, and to switch the first display to a low power state.
Citation Information
Patent Citations
Portable device with user interface
JP2016119115A
Electronic device
KR1020170085344A
Uniaxial helical driven seeker and method for extending search range
KR1020240021449A
Painting device for vehicle interior materials
KR102427554B1
KR20220017152A