Electronic device for controlling display corresponding to direction of external electronic device, operating method thereof, and storage medium

Abstract

An electronic device (101) according to one embodiment may comprise: a first display (260); a second display (261) arranged in a direction opposite to the direction of the first display; a memory (130, 530); and at least one processor (120, 520). According to one embodiment, a memory may store instructions that, when executed by at least one processor, cause an electronic device to output content through a first display. According to one embodiment, instructions may be configured to cause an electronic device to identify an electronic device-based orientation of an external electronic device connected to the electronic device through a short-range communication scheme while outputting content. According to one embodiment, instructions may be configured to cause the electronic device to remain outputting content through a first display in response to identifying that a direction of the external electronic device is within a first range of directions, and to output content through a second display in response to identifying that the direction of the external electronic device is within a second range of directions.

Description

Technical Field

[0001] Embodiments of the present disclosure relate to an electronic device for controlling a display corresponding to a direction of an external electronic device, an operating method thereof, and a storage medium. Background Art

[0002] Due to the development of electronic technology, various types of flexible electronic devices have been developed. Such flexible electronic devices can ensure portability while providing a larger display. For example, since the flexible electronic device is deformable by a user applying a force, it can provide a foldable, bendable or rollable display.

[0003] An electronic device including a foldable flexible display can display a screen on a display (or display area) in various sizes. For example, when the electronic device is folded in half, the user can view the screen (e.g., content screen) without holding it. In the folded state, the screen can be displayed only through the internal display of the electronic device, or for specific applications (e.g., camera applications), the screen can be displayed through an external display according to user settings. However, an electronic device including multiple foldable displays can display content in various display areas. Therefore, if the display is adaptively switched to display content according to the user's position, the usability of the electronic device can be increased. Summary of the invention

[0004] Means of solving the problem

[0005] According to an embodiment, the electronic device 101 includes a first display 260, a second display 261 arranged in a direction opposite to the first display, a memory (130 or 530), and at least one processor 120 or 520. According to an embodiment, the memory stores instructions that, when executed by the electronic device, cause the electronic device to output content through the first display. According to an embodiment, the instructions are configured to cause the electronic device to identify the direction of an external electronic device connected to the electronic device via a short-range communication scheme relative to the electronic device while outputting content. According to an embodiment, the instructions are configured to cause the electronic device to keep outputting content through the first display in response to identifying that the direction of the external electronic device is within a first direction range, and to output content through the second display in response to identifying that the direction of the external electronic device is within a second direction range.

[0006] According to an embodiment, a method for controlling a display corresponding to a direction of an external electronic device by an electronic device, the method comprising: outputting content through a first display of the electronic device. According to an embodiment, the method may include, while outputting the content, identifying a direction of an external electronic device connected to the electronic device through a short-range communication scheme relative to the electronic device. According to an embodiment, the method may include maintaining output of content through the first display in response to identifying that the direction of the external electronic device is within a first direction range. According to an embodiment, the method may include outputting content through a second display arranged in a direction opposite to the first display in response to identifying that the direction of the external electronic device is within a second direction range.

[0007] According to an embodiment, a non-volatile storage medium stores instructions configured to enable the electronic device to execute at least one operation when executed by at least one processor 120 or 520 of the electronic device 101. The at least one operation includes: outputting content through a first display of the electronic device; while outputting the content, identifying the direction of an external electronic device connected to the electronic device through a short-range communication scheme relative to the electronic device; in response to identifying that the direction of the external electronic device is within a first direction range, maintaining the output of the content through the first display; and in response to identifying that the direction of the external electronic device is within a second direction range, outputting the content through a second display disposed in a direction opposite to the first display.

[0008] According to an embodiment, the electronic device 101 includes a short-range communication circuit, a display (260), a UWB circuit, a memory (130 or 530) and at least one processor (120 or 520). According to an embodiment, the memory stores instructions that, when executed by at least one processor, cause the electronic device to control the short-range communication circuit to establish a communication link with an external electronic device. According to an embodiment, the instructions are configured to cause the electronic device to control the UWB circuit to perform a ranging operation to obtain information related to the distance and direction of the electronic device from the external electronic device. According to an embodiment, the instructions are configured to cause the electronic device to control the display to perform a first operation based on the direction of the external electronic device being within a defined range of directions when the external electronic device is within the ranging distance of the UWB circuit. According to an embodiment, the instructions are configured to cause the electronic device to control the display to perform a second operation based on the direction of the external electronic device being outside a defined range of directions when the external electronic device is within the ranging distance of the UWB circuit. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] Figure 1 is a block diagram illustrating an electronic device in a network environment according to an embodiment.

[0010] Figure 2 2 are views illustrating an unfolded state and a folded state of an electronic device according to an embodiment.

[0011] Figure 3 is a view showing a partially folded state of the electronic device according to the embodiment.

[0012] Figure 4 is a perspective view showing various states of the electronic device according to the embodiment.

[0013] Figure 5 is a block diagram showing an internal configuration of an electronic device according to an embodiment.

[0014] Figure 6a is a view illustrating an example of outputting the content being played through the display of the first type electronic device according to a change in the position of the external electronic device according to an embodiment.

[0015] Figure 6b is an exemplary view illustrating a control screen in an external electronic device when the external electronic device is located at a side of an electronic device according to an embodiment.

[0016] Figure 6c is a view illustrating an example of outputting the content being played through the display of the second type electronic device according to a change in the position of the external electronic device according to an embodiment.

[0017] Figure 6d is a view illustrating an example of outputting the content being played through the display of the third type electronic device according to a change in the position of the external electronic device according to an embodiment.

[0018] Figure 7 is a flowchart illustrating the operation of the electronic device according to the embodiment.

[0019] Figure 8 is a flowchart illustrating an operation of an electronic device for controlling a display corresponding to a position of an external electronic device according to an embodiment.

[0020] Figure 9a is an exemplary view illustrating display switching when an external electronic device moves to a rear direction range of the electronic device according to an embodiment.

[0021] Figure 9b is an exemplary view illustrating display switching when an external electronic device moves to a front direction range of the electronic device according to an embodiment.

[0022] Fig.9c are exemplary views illustrating display switching according to movement of another type of an external electronic device to a rear surface of an electronic device according to an embodiment.

[0023] Fig.10is a flowchart illustrating an operation of an electronic device for controlling a display corresponding to an external electronic device located at a side of the electronic device according to an embodiment.

[0024] Fig.11a is an exemplary view illustrating display switching when an external electronic device moves to a side range of an electronic device according to an embodiment.

[0025] Fig.11b 2 is an exemplary view illustrating display switching when an external electronic device moves from a side range to a rear range of an electronic device according to an embodiment.

[0026] Fig.12 is a view illustrating a signal flow among an electronic device for mirroring, an external electronic device, and an external display device according to an embodiment.

[0027] Fig.13 2 is an exemplary view illustrating display switching when an external electronic device moves toward an external display device according to an embodiment.

[0028] Fig.14 are exemplary views illustrating display switching when an external electronic device moves from an external display device to an electronic device according to an embodiment.

[0029] Fig.15 2 is an exemplary view illustrating display switching when an external electronic device moves in an up / down direction of an electronic device according to an embodiment.

[0030] Fig.16 is an exemplary view illustrating display switching according to a distance from an external electronic device according to an embodiment.

[0031] Throughout the specification and drawings, the same or similar reference numbers may be used to refer to the same or similar elements. DETAILED DESCRIPTION

[0032] Figure 1 1 is a block diagram illustrating an electronic device 101 in a network environment 100 according to various embodiments. Figure 1, the electronic device 101 in the network environment 100 may communicate with the electronic device 102 via the first network 198 (e.g., a short-range wireless communication network), or communicate with at least one of the electronic device 104 or the server 108 via the second network 199 (e.g., a long-range wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 via the server 108. According to an embodiment, the electronic device 101 may include a processor 120, a memory 130, an input module 150, a sound output module 155, a display module 160, an audio module 170, a sensor module 176, an interface 177, a connection terminal 178, a haptic module 179, a camera module 180, a power management module 188, a battery 189, a communication module 190, a user identification module (SIM) 196, or an antenna module 197. In an embodiment, at least one of the above components (e.g., the connection terminal 178) may be omitted from the electronic device 101, or one or more other components may be added to the electronic device 101. According to an embodiment, some of the components (eg, the sensor module 176 , the camera module 180 , or the antenna module 197 ) may be integrated into a single component (eg, the display module 160 ) 11 .

[0033] The processor 120 may run, for example, software (e.g., program 140) to control at least one other component (e.g., hardware component or software component) of the electronic device 101 connected to the processor 120, and may perform various data processing or calculations. According to one embodiment, as at least part of the data processing or calculation, the processor 120 may store a command or data received from another component (e.g., sensor module 176 or communication module 190) in the volatile memory 132, process the command or data stored in the volatile memory 132, and store the resultant data in the non-volatile memory 134. According to an embodiment, the processor 120 may include a main processor 121 (e.g., a central processing unit (CPU) or an application processor (AP)) or an auxiliary processor 123 (e.g., a graphics processing unit (GPU), a neural processing unit (NPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP)) that is operationally independent or combined with the main processor 121. For example, when the electronic device 101 includes a main processor 121 and an auxiliary processor 123, the auxiliary processor 123 may be configured to consume less power than the main processor 121, or to be dedicated to a specified function. The auxiliary processor 123 may be implemented separately from the main processor 121, or as part of the main processor 121.

[0034] When the main processor 121 is in an inactive (e.g., sleep) state, the auxiliary processor 123 (rather than the main processor 121) may control at least some of the functions or states related to at least one component among the components of the electronic device 1011 (e.g., the display module 160, the sensor module 176, or the communication module 190), or when the main processor 121 is in an active state (e.g., running an application), the auxiliary processor 123 may control at least some of the functions or states related to at least one component among the components of the electronic device 101 (e.g., the display module 160, the sensor module 176, or the communication module 190) together with the main processor 121. According to an embodiment, the auxiliary processor 123 (e.g., an image signal processor or a communication processor) may be implemented as part of another component (e.g., a camera module 180 or a communication module 190) that is functionally related to the auxiliary processor 123. According to an embodiment, the auxiliary processor 123 (e.g., a neural processing unit) may include a hardware structure dedicated to artificial intelligence model processing. The artificial intelligence model may be generated by machine learning. For example, such learning may be performed by the electronic device 101 where the artificial intelligence is executed or via a separate server (e.g., server 108). The learning algorithm may include, but is not limited to, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, for example. The artificial intelligence model may include multiple artificial neural network layers. The artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), or a deep Q network or a combination of two or more thereof, but is not limited thereto. Additionally or alternatively, the artificial intelligence model may include a software structure in addition to a hardware structure.

[0035] The memory 130 may store various data used by at least one component of the electronic device 101 (e.g., the processor 120 or the sensor module 176). The various data may include, for example, software (e.g., the program 140) and input data or output data for commands related thereto. The memory 130 may include a volatile memory 132 or a nonvolatile memory 134.

[0036] The program 140 may be stored as software in the memory 130 , and may include, for example, an operating system (OS) 142 , middleware 144 , or applications 146 .

[0037] The input module 150 may receive commands or data to be used by other components (e.g., the processor 120) of the electronic device 101 from outside (e.g., a user) of the electronic device 101. The input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus).

[0038] The sound output module 155 can output sound signals to the outside of the electronic device 101. The sound output module 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as playing multimedia or playing records. The receiver can be used to receive incoming calls. Depending on the embodiment, the receiver can be implemented as a separate part from the speaker, or as part of the speaker.

[0039] The display module 160 may visually provide information to the outside of the electronic device 101 (e.g., a user). The display device 160 may include, for example, a display, a holographic device, or a projector, and a control circuit for controlling a corresponding one of the display, the holographic device, and the projector. According to an embodiment, the display module 160 may include a touch sensor configured to detect a touch or a pressure sensor configured to measure the strength of a force generated by a touch.

[0040] The audio module 170 may convert sound into an electrical signal, or vice versa. According to an embodiment, the audio module 170 may obtain sound via the input module 150, or output sound via the sound output module 155 or an earphone of an external electronic device (e.g., electronic device 102) directly (e.g., wired) or wirelessly connected to the electronic device 101.

[0041] The sensor module 176 may detect an operating state (e.g., power or temperature) of the electronic device 101 or an environmental state (e.g., a state of a user) outside the electronic device 101, and then generate an electrical signal or data value corresponding to the detected state. According to an embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, an atmospheric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illumination sensor.

[0042] The interface 177 may support one or more specific protocols to be used to connect the electronic device 101 directly (e.g., wired) or wirelessly to an external electronic device (e.g., the electronic device 102). According to an embodiment, the interface 177 may include, for example, a high-definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.

[0043] The connection end 178 may include a connector, wherein the electronic device 101 can be physically connected to an external electronic device (e.g., the electronic device 102) via the connector. According to an embodiment, the connection end 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0044] The haptic module 179 may convert the electrical signal into mechanical stimulation (eg, vibration or motion) or electrical stimulation that can be recognized by the user via his sense of touch or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulator.

[0045] The camera module 180 may capture still images or moving images. According to an embodiment, the camera module 180 may include one or more lenses, an image sensor, an image signal processor, or a flash.

[0046] The power management module 188 may manage power supply to the electronic device 101. According to an embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0047] The battery 189 may power at least one component of the electronic device 101. According to an embodiment, the battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0048] The communication module 190 may support establishing a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (e.g., electronic device 102, electronic device 104, or server 108), and perform communication via the established communication channel. The communication module 190 may include one or more communication processors capable of operating independently from the processor 120 (e.g., an application processor (AP)) and supporting direct (e.g., wired) communication or wireless communication. According to an embodiment, the communication module 190 may include a wireless communication module 192 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (e.g., a local area network (LAN) communication module or a power line communication (PLC) module). A corresponding one of these communication modules can communicate with an external electronic device via a first network 198 (e.g., a short-range communication network such as Bluetooth, Wireless Fidelity (Wi-Fi) Direct, or Infrared Data Association (IrDA)) or a second network 199 (e.g., a long-range communication network such as a traditional cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a local area network (LAN) or a wide area network (WAN))). These various types of communication modules can be implemented as a single component (e.g., a single chip), or these various types of communication modules can be implemented as multiple components separated from each other (e.g., multiple chips). The wireless communication module 192 can identify or authenticate the electronic device 101 in a communication network (such as the first network 198 or the second network 199) using user information (e.g., an International Mobile Subscriber Identity (IMSI)) stored in the user identification module 196.

[0049] The wireless communication module 192 can support 5G networks after 4G networks and next-generation communication technologies (e.g., new radio (NR) access technology). NR access technology can support enhanced mobile broadband (eMBB), massive machine type communication (mMTC), or ultra-reliable low-latency communication (URLLC). The wireless communication module 192 can support high-frequency bands (e.g., millimeter wave bands) to achieve, for example, high data transmission rates. The wireless communication module 192 can support various technologies for ensuring performance on high-frequency bands, such as, for example, beamforming, massive multiple-input multiple-output (massive MIMO), full-dimensional MIMO (FD-MIMO), array antennas, analog beamforming, or massive antennas. The wireless communication module 192 can support various requirements specified in the electronic device 101, an external electronic device (e.g., electronic device 104), or a network system (e.g., a second network 199). According to an embodiment, the wireless communication module 192 may support a peak data rate for implementing eMBB (e.g., 20 Gbps or greater), loss coverage for implementing mMTC (e.g., 164 dB or less), or U-plane delay for implementing URLLC (e.g., 0.5 ms or less for each of the downlink (DL) and uplink (UL), or 1 ms or less round trip).

[0050] The antenna module 197 may transmit a signal or power to the outside (e.g., an external electronic device) or receive a signal or power from the outside (e.g., an external electronic device). According to an embodiment, the antenna module 197 may include an antenna including a radiator, and the radiator is formed by a conductive body or a conductive pattern formed in a substrate (e.g., a printed circuit board (PCB)) or formed on a substrate. According to an embodiment, the antenna module 197 may include a plurality of antennas (e.g., an antenna array). In this case, at least one antenna suitable for a communication scheme used in a communication network (such as the first network 198 or the second network 199) may be selected from the plurality of antennas by, for example, the communication module 190 (e.g., the wireless communication module 192). Subsequently, a signal or power may be sent or received between the communication module 190 and the external electronic device via the selected at least one antenna. According to an embodiment, another component (e.g., a radio frequency integrated circuit (RFIC)) other than the radiator may also be formed as a part of the antenna module 197.

[0051] According to various embodiments, the antenna module 197 may form a millimeter wave antenna module. According to an embodiment, the millimeter wave antenna module may include a printed circuit board, a radio frequency integrated circuit (RFIC), and a plurality of antennas (e.g., array antennas), wherein the RFIC is disposed on a first surface (e.g., bottom surface) of the printed circuit board, or adjacent to the first surface and capable of supporting a specified high frequency band (e.g., millimeter wave band), and the plurality of antennas are disposed on a second surface (e.g., top surface or side surface) of the printed circuit board, or adjacent to the second surface and capable of transmitting or receiving signals of the specified high frequency band.

[0052] At least some of the above components may be connected to each other via an inter-peripheral communication scheme (e.g., a bus, a general purpose input output (GPIO), a serial peripheral interface (SPI), or a mobile industry processor interface (MIPI)) and communicatively transmit signals (e.g., commands or data) therebetween.

[0053] According to an embodiment, a command or data may be sent or received between the electronic device 101 and the external electronic device 104 via the server 108 connected to the second network 199. The external electronic device 102 or the electronic device 104 may each be a device of the same type as the electronic device 101, or a device of a different type from the electronic device 101. According to an embodiment, all or some operations to be executed in the electronic device 101 may be executed in one or more of the external electronic device 102, the external electronic device 104, or the server 108. For example, if the electronic device 101 should automatically execute a function or service or should execute a function or service in response to a request from a user or another device, the electronic device 101 may request the one or more external electronic devices to execute at least part of the function or service instead of executing the function or service, or the electronic device 101 may request the one or more external electronic devices to execute at least part of the function or service in addition to executing the function or service. The one or more external electronic devices receiving the request may execute at least part of the function or service requested, or execute another function or another service related to the request, and transmit the result of the execution to the electronic device 101. The electronic device 101 may provide the result as at least a partial reply to the request in the case of further processing the result or in the case of not further processing the result. To this end, cloud computing technology, distributed computing technology, mobile edge computing (MEC) technology or client-server computing technology, for example, may be used. The electronic device 101 may use, for example, distributed computing or mobile edge computing to provide ultra-low latency services. In another embodiment, the external electronic device 104 may include an Internet of Things (IoT) device. The server 108 may be an intelligent server using machine learning and / or neural networks. According to an embodiment, the external electronic device 104 or the server 108 may be included in the second network 199. The electronic device 101 may be applied to intelligent services (e.g., smart homes, smart cities, smart cars or health care) based on 5G communication technology or IoT-related technologies.

[0054] Figure 2 2 are views illustrating an unfolded state and a folded state of an electronic device according to an embodiment.

[0055] refer to Figure 2In an embodiment, the electronic device 101 may include a foldable housing and a flexible or foldable display 260 disposed in a space formed by the foldable housing. The foldable housing may have a shape that is substantially symmetrical about a folding axis (e.g., axis A). According to an embodiment, the surface on which the first flexible display 260 is disposed may be defined as a first surface 210a of the electronic device 101, and the surface opposite to the first surface 210a may be defined as a second surface 220a. Here, the surface on which the first display 260 is disposed may be defined as a first surface 210a or a front surface of the electronic device 101, and the surface opposite to the front surface may be defined as a second surface 220a or a rear surface of the electronic device 101.

[0056] like Figure 2 As shown in (a) of FIG. 1 , the first display 260 may be formed to occupy the entire first surface 210a of the electronic device 101, and as shown in FIG. Figure 2 As shown in (b), the second display 261 can be formed to occupy at least a portion of the second surface 220a. In this case, the first display 260 can be pivoted by a separate hinge module, and the second display 261 can be fixed to the housing. For example, the hinge structure can be configured to fold or unfold inwardly or outwardly. For example, a freestop hinge can maintain the folded state (i.e., fully folded state) of the electronic device 101 at various angles.

[0057] For example, the second display 261 may be provided on any one of a pair of housings provided on opposite sides relative to the folding axis (e.g., axis A). According to an embodiment, the first display 260 may refer to a flexible display, at least a portion of which may be deformed into a flat or curved surface. The first display 260 may include a first area (or first display area) 260a provided on one side of the folding axis (e.g., axis A) and a second area (or second display area) 260b provided on the opposite side of the folding axis.

[0058] For example, when the electronic device 101 is in an unfolded state (eg, a flat state), a surface of the first display area 260a and a surface of the second display area 260b may form 180 degrees therebetween and face the same direction (eg, a forward direction of the electronic device 101).

[0059] like Figure 2As shown in (c), when the electronic device 101 is in a folded state (i.e., a fully folded state), the surface of the first display area 260a and the surface of the second display area 260b of the first display 260 may face each other while forming a narrow angle (e.g., an angle between 0 degrees and 10 degrees) therebetween. According to an embodiment, in the folded state (i.e., a fully folded state) of the electronic device 101, the second display 261 may be disposed on any one of a pair of shells disposed on opposite sides of a folding axis (e.g., axis A), but this is an example, and in another embodiment, the second display 261 may be configured with most of the rear surface 220a depending on the structure or function. For example, the electronic device 101 may include a second display 261, at least a portion of which is visually exposed through a rear cover. Therefore, it should be noted that the size and shape of the first display 260 and the second display 261 are not limited thereto. In addition, as Figure 2 The division of the first display 260 shown in (a) is just an example, and the first display 260 may be divided into a plurality of (eg, four or more, or two) regions depending on the structure or function.

[0060] Figure 3 is a view showing a partially folded state of the electronic device according to the embodiment.

[0061] like Figure 3 As shown, the electronic device 101 may have a partially unfolded state based on a folding axis (e.g., A-A'). The electronic device 101 may have a state in which the second housing structure 310 stands upright on the contact surface when the first housing structure 320 contacts the contact surface (e.g., a floor or a table). In this way, the electronic device 101 including a flexible display can be folded or bent around an axis. According to an embodiment, in a partially folded state of the electronic device 101, the first display 260 may be divided vertically into a first display area 260a and a second display area 260b relative to the folding axis. The first display area 260a corresponding to the upper side of the folding axis viewed by the user may be referred to as the upper area of ​​the first display 260 (or the internal display), and the second display area 260b corresponding to the lower side may be referred to as the lower area of ​​the first display 260 (or the internal display). At least one of the first display area 260a or the second display area 260b may include a front camera.

[0062] if Figure 3 The electronic device 101 shown in the figure is in a state where the first display 260 is partially folded, and the display or display area displayed to the user can be based on the following Figure 4 The installation state (or posture) shown varies. Figure 41 is a perspective view showing various partially folded states of the electronic device according to the embodiment.

[0063] The electronic device 101 can have various partially folded states 400a, 400b, 400c, and 400d, such as Figure 4 The electronic device 101 may have a state of standing up while being folded in half, similar to a compact shape. According to an embodiment, if the electronic device 101 is as Figure 4 400a to 400c shown in the state (or posture), the first display (for example, Figure 2 At least one area (or one surface) of 260) can remain turned on, and the second display (e.g., Figure 2 In other words, in the partially folded state, either the first display or the second display can be in an open state, while the other can be in a closed state. In addition, according to an embodiment, when the electronic device 101 supports the first housing structure (e.g., Figure 3 320) and a second housing structure (eg, Figure 3 310) so that the side surface of the main body is as Figure 4 When contact is made as shown in 400d, in the standing state 400d of the electronic device 101, one area (or one surface) of the display may be kept in the turned-on state, and another area (or another surface) may be turned off.

[0064] As described above, when the first display 260 is partially folded so that the first display area (eg, Figure 3 260a) and a second display area (eg, Figure 3 260b) is separated, the area of ​​the first display area and the second display area exposed to the user may vary depending on the installation state of the electronic device 101. Figure 2 In the case where the electronic device 101 shown includes a plurality of displays, the display exposed to the user of the first display 260 and the second display 261 may also vary. Therefore, if the display outputting the image is determined according to the position of the user, the usability of the electronic device may be increased.

[0065] In an embodiment, when the electronic device 101 including multiple displays outputs an image with at least a portion of the first display 260 folded, the electronic device 101 can adaptively change the display area to correspond to the position of the user by recognizing the position of the user. Here, the state in which the first display 260 is partially folded may be referred to as a "flexible mode" as distinct from the fully folded state, and the partially folded state of the electronic device 101 may be maintained at various angles.

[0066] In this case, as the folding ratio of the electronic device, the electronic device may be folded in half with respect to the middle of the electronic device, but the folding ratio around the axis may also be achieved differently.

[0067] Here, an axis may be preset or arbitrary. A preset axis may mean that only a specific area (e.g., a partial area including the axis) of the flexible display of the electronic device 101 is bendable. On the other hand, an arbitrary axis may mean that the entire area of ​​the display of the electronic device 101 is bendable. Figures 2 to 4 The electronic device 101 is shown folded in half about an axis passing through the center of the electronic device 101 , but one of ordinary skill in the art will appreciate that the location of the axis is not limited.

[0068] Furthermore, in the following detailed description, reference may be made to the “front surface” or “rear surface” of the electronic device 101. Figure 3 320) or a second housing structure (e.g., Figure 3 310) how the relative position (eg, folded state or unfolded state), wherein Figure 2 The surface on which the first display 260 is disposed is defined as the “front surface of the electronic device 101”, and the surface on which the second display 261 facing opposite to the surface on which the first display 260 is disposed is defined as the “rear surface of the electronic device 101”. In addition, the first display 260 may be referred to as an internal display, and the second display 261 opposite to the first display 260 may be referred to as an external display. According to an embodiment, reference may be made to “a configuration in which the electronic device 101 includes multiple displays”, and herein, the “display” may refer to a flexible display. For example, Figure 2 or Figure 3 The first display 260 may refer to a flexible display.

[0069] In the following description, components that are easily understood from the description of the above-mentioned embodiments may be referred to with or without the same reference numerals, and their detailed description may be omitted. According to an embodiment of the present disclosure, the electronic device 101 may be implemented by selectively combining the configurations of different embodiments, and the configuration of one embodiment may be replaced by the configuration of another embodiment. However, it should be noted that the present invention is not limited to specific drawings or embodiments.

[0070] Figure 5 is a block diagram 500 showing an internal configuration of an electronic device according to an embodiment.

[0071] refer to Figure 5 According to an embodiment, the electronic device 101 (eg, Figure 1 The electronic device 101 may include a processor 520 (eg, Figure 1processor 120) and display 560 (e.g., Figure 1 According to an embodiment, the electronic device 101 (eg, Figure 1 The electronic device 101 may include a memory 530 (eg, Figure 1 Memory 130), sensor 576 (e.g., Figure 1 sensor module 176) and / or communication module 590 (e.g., Figure 1 Communication module 190). Not Figure 5 All components of the electronic device 101 are necessary components, but the electronic device 101 can use Figure 5 The components can be implemented with more or fewer components.

[0072] The display 560 may be a flexible display. According to an embodiment, the display 560 may include Figure 2 The first display 260 and the second display 261 are shown. For example, when the first display 260 is partially folded, the first display 260 may be divided into a first display area and a second display area. According to an embodiment, the partially folded state (e.g., folded mode) of the first display 260 may refer to a state in which at least a portion of the first display 260 and at least a portion of the second display 261 are both visually exposed to the outside.

[0073] The communication module 590 may be communicatively connected to the external electronic device 102. According to an embodiment, the communication module 590 may be connected to the same or more external electronic devices (eg, Figure 1 Here, n is a natural number greater than 1. In addition, the communication module 590 can be wirelessly connected to the external electronic device 102 in various communication schemes, and can be connected to an external display device (eg, TV) to provide a mirroring service.

[0074] According to an embodiment, the electronic device 101 may communicate with the external electronic device 102 based on a first communication scheme (e.g., a short-range communication scheme), and recognize the direction of the external electronic device 102 based on a second communication scheme (e.g., a UWB communication scheme or a BLE communication scheme). The communication module 590 may operate based on the first communication scheme and / or the second communication scheme.

[0075] According to an embodiment, the communication module 590 may operate based on at least one of an ultra wideband (UWB) communication scheme or a Bluetooth low energy (BLE) communication scheme.

[0076] For example, the communication module 590 may include a UWB communication module. The UWB communication module may support UWB communication between the electronic device 101 and the external electronic device 102. The UWB communication module may measure the distance between the electronic device 101 and the external electronic device 102 through UWB communication. The UWB communication module may measure the direction (e.g., angle of arrival (AOA)) of the external electronic device 102 using multiple antennas.

[0077] When describing the external electronic device 102, the words similar to Figure 1 The configuration of the embodiment or by Figure 1 The detailed description of the configuration of the embodiments can be easily understood.

[0078] According to an embodiment, described below is an example in which the electronic device 101 is a device that outputs content such as a video, the external electronic device 102 is a wearable electronic device that can be worn (or removed) on at least a part of the user's body (e.g., a wearable watch, an ear wearable device, and / or a head-mounted display (HMD)), and the external display device 104 is a device connected to the electronic device 101 or the external electronic device 102 to output a mirrored screen corresponding to the screen output by the display of the electronic device 101, such as a TV, but the embodiments of the present disclosure are not limited to this.

[0079] In the embodiment, an example of controlling the display of the electronic device 101 based on the direction of one external electronic device 102 relative to the electronic device 101 in the folded mode is described, but the display may be controlled relative to two or more external electronic devices 102. For example, when a user wears a plurality of external electronic devices 102 including a wearable watch and a head mounted display, the processor 520 may be connected to the n external electronic devices 102 through a 1:n connection supported by the communication module 590.

[0080] In an embodiment, since the external electronic device 102 such as a head-mounted display includes a camera (e.g., a time-of-flight (ToF) camera or an eye tracking camera), not only the distance information from the electronic device 101 can be grasped, but also the user's line of sight can be tracked.

[0081] In an embodiment, the processor 520 may obtain information related to the user's position from n external electronic devices 102. User position related information may be used to identify the position or direction of the user relative to the electronic device 101. For example, the processor 520 may receive user position related information, which may combine distance information, user line of sight information, user direction information, and / or user height information received from n external electronic devices 102 with the electronic device 101. The processor 520 may determine the user's mobile position based on the received user position related information, and perform display control corresponding to the determined user position. In this way, when two or more external electronic devices are used, the accuracy of determining the user's mobile position may be improved.

[0082] The sensor 576 may include a sensor (e.g., a digital Hall sensor or a 9-axis sensor) for determining an operating state (e.g., an unfolded state, a folded state, and / or an intermediate state) and a folding angle. According to an embodiment, the Hall sensor may include one or more magnets and / or one or more magnetic sensors. At least one of the one or more magnets and / or one or more magnetic sensors included in the Hall sensor may be set at different positions in the electronic device 101. The positional relationship between the one or more magnets and / or one or more magnetic sensors in the electronic device 101 may vary depending on the shape of the electronic device 101. The electronic device 101 may measure the change in the positional relationship through one or more magnetic sensors. The change in the positional relationship may cause a change in the magnetic field formed by the one or more magnets. The electronic device 101 may use the Hall sensor to obtain a power signal indicating a change in the magnetic field. For example, the electronic device 101 may use the power signal obtained from the Hall sensor to identify the state of the electronic device 101 (e.g., an unfolded state, a folded state, and / or an intermediate state). For example, the electronic device 101 may receive data indicating the state of the electronic device 101 from the Hall sensor. For example, the Hall sensor may output data indicating the shape of the first display 260. The shape of the first display 260 may vary as it moves along the folding axis (eg, Figure 2 The shape of the first display 260 may be changed by folding or unfolding the first display 260 along the folding axis (axis A). For example, the Hall sensor may output different data indicating the shape of the first display 260. The data indicating the shape of the first display 260 may include the angle at which the first display 260 is folded along the folding axis. For example, the electronic device 101 may identify a partially folded state (e.g., a flex mode) of the first display 260 in response to recognizing that the angle at which the first display 260 is folded relative to the folding axis is included in a specified angle range (e.g., an angle range between 10 and 160 or an angle range between 50 and 150).

[0083] According to an embodiment, the sensor 576 may include a gyro sensor, an accelerometer and / or a geomagnetic sensor for detecting the state (e.g., posture) of the electronic device 101. For example, the electronic device 101 may use a geomagnetic sensor to determine a relative azimuth relative to a reference azimuth. The electronic device 101 may use a geomagnetic sensor to determine a relative azimuth relative to a reference azimuth and a UWB angle of arrival (AOA) to obtain a final azimuth using UWB using a geomagnetic sensor. The sensor 576 may be used as a 9-axis motion sensor using a gyro sensor, an accelerometer and a geomagnetic sensor. In addition to the foregoing, the sensor 576 may include a strain sensor that outputs a strain value for indirectly measuring the folding angle of the electronic device 101.

[0084] The processor 520 may detect the physical state and / or the change of the physical state of the electronic device 101 based on the data received from the sensor 576. The processor 520 may detect the change (e.g., folding event or unfolding event) of the operating state (e.g., the unfolded state, the folded state and / or the partially folded intermediate state). For example, when the first housing structure (e.g., Figure 3 320) and a second housing structure (eg, Figure 3 When the angle between the electronic device 101 and the electronic device 101 corresponds to a specified angle range based on a sensor capable of detecting a change in an operating state, it can be determined that the electronic device 101 is in a partially unfolded (or partially folded) state.

[0085] The processor 520 may run at least one application and visually output content corresponding to the application through the display 560. For example, the processor 520 may output content (e.g., an image) played through the display 560 in response to selection of a video-related application. Here, the image (or image data) may be a result output by the currently running application, and may include at least one of data objects such as video data, audio data, or display information created when the application is running. In addition, the image through the display 560 may be referred to as content, or may also be referred to as data related to the running application, screen data, or application running screen.

[0086] The processor 520 may run the application in response to a user's request to run the application. According to an embodiment, the processor 520 may display content on the display 560 according to the running of the application in a partially folded state of the display 560. For example, the processor 520 may provide content through any one of the multiple displays according to user settings.

[0087] According to an embodiment, the processor 520 can change the display according to the user's position to output content and provide the content. Therefore, even if the user's position faces the front surface or the rear surface of the electronic device 101, the electronic device 101 can provide content through the display viewed by the user, thereby allowing the user to watch continuously. For example, in a partially folded state of the first display 260, if the user runs a video playback application, the processor 520 can display the running screen of the application through at least a portion of the first display 260. While displaying the running screen of the application, the processor 520 can identify the user's position and display the running screen of the application through at least a portion of the second display 261 when the user is located at the rear side. In this way, when the display that provides content is switched according to the user's position, the user can identify the content through the display in several directions even without separate manipulation.

[0088] According to an embodiment, a wearable electronic device that can be worn on a user's body part can be used for the purpose of identifying the user's direction. The wearable electronic device can be an external electronic device 102, and the electronic device 101 can be connected to the external electronic device 102 to identify the direction of the external electronic device 102. For example, the electronic device 101 and the external electronic device 102 can be devices that communicate with each other by logging in using the same user account.

[0089] Therefore, the processor 520 can identify the direction of the external electronic device 102, thereby determining the direction of the user relative to the position of the electronic device 101. Therefore, the processor 520 can determine the display corresponding to the direction of the external electronic device 102, and display the running screen of the application through the determined display.

[0090] According to an embodiment, the processor 520 may discover a nearby connectable external electronic device 102 through the communication module 590, and connect to the external electronic device 102 based on the discovery. The processor 520 may identify whether the connected external electronic device 102 is in a state of being worn on a body part of the user. For example, at least one sensor may be used to identify whether the external electronic device 102 is worn, and the electronic device 101 may identify the wearing state based on information about the wearing state sent from the external electronic device 102.

[0091] According to an embodiment, the processor 520 may provide a function for changing the display corresponding to the direction of the external electronic device 102 while outputting content. This function may be enabled or disabled through a setting menu. Therefore, when this function is set to be enabled, the processor 520 may continuously track the direction of the external electronic device 102 while displaying content through a partial area of ​​the display 560.

[0092] According to an embodiment, the processor 520 may recognize a direction of the external electronic device 102 relative to the electronic device 101 based on at least one of the UWB communication scheme or the BLE communication scheme of the communication module 590 .

[0093] For example, a UWB angle of arrival (AOA) measurement scheme based on a UWB communication scheme is a scheme that uses a time difference between multiple antenna signals, and can identify the direction of the external electronic device 102 based on a signal received using the antenna of the communication module 590, and identify the distance of the external electronic device 102 from the electronic device 101. For example, the electronic device 101 may also include an antenna module (e.g., a UWB antenna) for identifying the direction and / or distance of the external electronic device 102. For example, the antenna module may include multiple antennas for measuring the direction and / or distance of the external electronic device 102. For example, the electronic device 101 may use at least two antennas among the multiple antennas included in the antenna module to measure the distance and / or direction (or angle (e.g., AOA)) from the external electronic device 102. The direction of the external electronic device 102 may be represented by an angle.

[0094] According to an embodiment, it should be understood that identifying the direction of the external electronic device 102 includes identifying a direction from the electronic device 101 toward the external electronic device 102 .

[0095] According to an embodiment, the electronic device 101 may also identify the location of the external electronic device 102 based on the location of the electronic device 101. For example, the coordinate value of the external electronic device 102 may be identified in a predetermined 3D coordinate system centered on the location of the electronic device 101.

[0096] According to an embodiment, the processor 520 may detect the external electronic device 102 based on the BLE communication scheme, and then enable UWB signal scanning for UWB AOA measurement. For example, if the external electronic device 102 is discovered through the BLE communication scheme, the processor 520 may enable UWB signal scanning by transmitting information necessary for UWB communication through BLE communication. The processor 520 may connect to the external electronic device 102 through UWB communication using the transmitted information. According to an embodiment, the processor 520 may broadcast a ranging message (e.g., a ranging control message or a ranging request message) to the external electronic device 102. The processor 520 may broadcast a ranging request message at a first transmission interval. The processor 520 may receive a ranging response message (e.g., a response message) from the external electronic device 102 that has received the ranging request message, and identify the relative position of the external electronic device 102 to the electronic device 101.

[0097] In the foregoing description, the UWB communication scheme or the BLE communication scheme of the communication module 590 is used as an example to identify the position of the external electronic device 102, but it may not be limited to this. For example, the processor 520 may use the sensor 576 to detect the external electronic device 102 in any one of the upper, lower, left, and right directions relative to the front center axis of the electronic device 101. To this end, the sensor 576 may include at least one of an infrared sensor, an ultrasonic sensor, a motion sensor, a 3D sensor, and a visual sensor, but the type of sensor is not limited to this. The combination of information sensed by at least two of the sensors can be used to identify the posture (or posture), position, and direction of the external electronic device 102. In addition, a camera (for example, Figure 1 The camera module 180) and the lidar can be used to identify the posture (or posture), position and direction of the external electronic device 102.

[0098] The processor 520 may identify the position of the external electronic device 102 while outputting the content through the first display 260 among the multiple displays. When the direction of the external electronic device 102 corresponds to the first direction range, the processor 520 may continue to output the content through the first display 260. On the other hand, when the direction of the external electronic device 102 corresponds to the second direction range, the processor 520 may control the output of the content through the second display 261 disposed opposite to the first display 260. Here, reference may be made to Figure 6a and Figure 6b To define the first direction range and the second direction range. Figure 6a is a view showing an example of outputting a content being played by a first type electronic device through display switching according to a position of an external electronic device according to an embodiment. Figure 6b 1 is an example view showing a control screen in an external electronic device when the external electronic device is located on a side surface of the electronic device according to an embodiment. According to an embodiment, the first type electronic device 101 may include a flexible display. The first type electronic device 101 may have a state of standing up while being folded in half, similar to a compact shape.

[0099] refer to Figure 6a , in the partially folded state of the first display 260 of the electronic device 101, the first display area 260a may be the upper area, and the second display area 260b may be the lower area. Figure 6aAs shown in (a), when the external electronic device 102 is located in the direction of the front surface of the electronic device 101, the external electronic device 102 can be detected in the first recognition range 610 facing the direction of the front surface 210a of the electronic device 101. In response to detecting the external electronic device 102 in the first recognition range 610, the electronic device 101 can output content through the first display 260 (also called the "main display") set on the front surface 210a. The first recognition range 610 can be referred to as a "front range". For example, when a video-related application is running in the folding mode, a playback image can be displayed in the first display area 260a of the first display 260, and control items related to the control of the playback image can be displayed in the second display area 260b. Here, the image displayed by the first display 260 can be referred to as content (or several contents), or can also be referred to as data related to the running application, screen data, or application running screen.

[0100] In an embodiment, the front range may be a predetermined azimuth range (eg, within 30 degrees) relative to the normal direction of the first display area 260a.

[0101] According to an embodiment, the user wearing the external electronic device 102 may move while outputting (or displaying) content through the first display 260. Figure 6a As shown in (b), when the external electronic device 102 is located in the side range (also called "blind spot") of the electronic device 101, the external electronic device 102 that was detected in the first recognition range 610 may no longer be detected. For example, when the external electronic device 102 is not detected in the first recognition range 610 in a state where the playback image is displayed in the first display area 260a of the first display 260, the electronic device 101 may perform an operation of reducing the brightness of the first display 260 (e.g., performing dimming). Figure 6a (b) shows lowering the brightness when the external electronic device 102 falls outside the field of view as an example of the control operation of the first display 260. However, the control operation of the first display 260 when falling outside the field of view may not be limited thereto.

[0102] For another example, when the external electronic device 102 is not detected within the first recognition range 610 (for example, when the external electronic device 102 is in a blind spot), a control function related to playback of displayed content through the external electronic device 102 may be provided, such as Figure 6bTherefore, the control operation of the first display 260 can be changed according to the selection of the control function through the external electronic device 102. For example, when the pause function is selected by the external electronic device 102, the electronic device 101 can stop outputting the content playback through the first display 260. In addition, subtitles of the playback content can be provided (i.e., displayed) by the external electronic device 102.

[0103] According to an embodiment, Figure 6a As shown in (c), when the external electronic device 102 is positioned on the rear surface 220a of the electronic device 101, as the user wearing the external electronic device 102 moves, the external electronic device 102 can be detected within the second recognition range 620 facing the rear surface 220a of the electronic device 101. The second recognition range 620 may be referred to as a "rear range". In an embodiment, the rear range may be a predetermined azimuth range (e.g., within 30 degrees) relative to the normal direction of the second display 261.

[0104] refer to Figure 6a (c), in the partially folded state of the first display 260 of the electronic device 101, when the user moves to the second recognition range 620 facing the rear surface 220a, the display exposed to the user can change. In other words, the user can see the second display 261 set on the rear surface 220a of the electronic device 101. For example, the playback content can be displayed on the second display 261 (also called a "sub-display") in a direction corresponding to the position of the external electronic device 102, and the first display 260 (i.e., the main display) can be turned off.

[0105] According to an embodiment, as the user wearing the external electronic device 102 moves, when the external electronic device 102 is detected within the second recognition range 620, the processor 520 may turn off at least one area (or one surface) of the first display 260 and output content through the second display 261 corresponding to the direction of the external electronic device 102. In this case, the processor 520 may stop outputting content through the first display 260 while turning off at least one area (or one surface) of the first display 260 and turning on the second display 261 to output content.

[0106] Here, the first recognition range 610 may refer to a first range relative to the upper display area 260a of the first display 260 in the partially folded state of the first display 260. In addition, the second recognition range 620 may refer to a second range relative to the second display 261 of the electronic device 101 in the partially folded state of the first display 260, corresponding to a direction opposite to the first recognition range 610.

[0107] According to an embodiment, the processor 520 may continuously track the external electronic device 102 in an omnidirectional range based on at least one of the UWB communication scheme or the BLE communication scheme. However, when the user is at a position outside the first recognition range 610, although the direction of the external electronic device 102 is recognizable, the user may not be able to recognize the screen content despite looking at the display 560. Therefore, the first recognition range 610 and the second recognition range 620 may be determined based on a field of view (e.g., a viewing angle) that enables user recognition when the user views the display 560. For example, the first recognition range 610 may correspond to a field of view relative to the first display 260, and the second recognition range 620 may correspond to a field of view relative to the second display 261. According to an embodiment, the first recognition range 610 may be a field of view (e.g., within a viewing angle) of a scene captured by the front camera assuming that the front camera is set at the center of the upper display area 260a of the first display 260. For example, the first recognition range 610 may be the range of a picture captured when viewing an object (e.g., a user) through a camera (e.g., a front camera or a rear camera), and the camera may have a viewing angle within a predetermined range, and the recognition range may vary depending on the viewing angle of the camera. In an embodiment, although the viewing angle of the camera is described as an example for the purpose of describing the recognition range, this is only for better understanding, and the first recognition range 610 should be understood as a range of fields of view that can be recognized when a user views the display. For example, the first recognition range 610 may be determined as an angle θ, the second recognition range 620 may be determined as an angle β, and the width of the recognition range, such as the angle θ and the angle β, may vary as needed.

[0108] For example, the recognition range may vary depending on the folding angle of the partially folded state (e.g., folding mode) of the first display 260. For example, for the first recognition range 610 and the second recognition range 620 of the field of view corresponding to the upper display (e.g., the upper display area 260a), the recognition range (or recognizable range) may be wider at a folding angle of 90 degrees or more and narrower at an angle of 90 degrees or less relative to the upper display area 260a folded vertically (i.e., 90 degrees).

[0109] According to an embodiment, the processor 520 may adaptively change the target display of the output (or playback) content corresponding to the direction of the external electronic device 102 among multiple displays. In addition, the processor 520 may control the display of the output content in various ways according to the repositioning of the user. For example, when it is recognized that the external electronic device 102 moves away from the first recognition range 610, the user may be regarded as no longer watching the first display 260, and then the processor 520 may reduce the brightness of the first display 260. In this case, although the brightness of the first display 260 is reduced, the content output by the first display 260 may be maintained. For example, the processor 520 may control to increase the volume of the output content according to the distance that the external electronic device 102 worn by the user moves away from the electronic device 101. In addition, the processor 520 may control brightness adjustment and volume adjustment at the same time. For example, when it is recognized that the external electronic device 102 moves away from the first recognition range 610, the processor 520 may control to stop the content output by the first display 260.

[0110] Thereafter, the processor 520 may turn off the first display 260 in response to detecting that the direction of the external electronic device 102 is outside the first recognition range 610 and within the second recognition range 620. For example, in response to a predetermined time elapsed after the external electronic device 102 moves out of the first recognition range 610 and is detected in the second recognition range 620, the processor 520 may turn off the first display 260.

[0111] According to an embodiment, even if the external electronic device 102 is detected outside the first recognition range 610 and in the second recognition range 620, the processor 520 may control to keep outputting the content through the first display 260. For example, even if the external electronic device 102 is detected outside the first recognition range 610 and in the second recognition range 620, the processor 520 controls to output the same content through each of the first display 260 and the second display 261 so that other users who are viewing the content through the first display 260 can also view the content.

[0112] Figure 6c is a view illustrating an example of outputting the content being played through the display of the second type electronic device according to a change in the direction of the external electronic device according to an embodiment.

[0113] like Figure 6c As shown, the first display 260 of the flexible display can be formed to occupy the entire first surface of the electronic device 101, and the second display 261 of the flexible display can be formed to occupy at least a portion of the second surface. In this case, the first display 260 can be pivoted by a separate hinge module, and the second display 261 can be fixed to the housing.

[0114] like Figure 6c As shown in (a) of FIG. 1 , when the electronic device 101 is in an upright state, it is detected that the electronic device 101 is in the first recognition range 610, and the processor 520 can output content through the first display 260. Figure 6c As shown in (b), the electronic device 101 is detected to be in the second recognition range 620 , and the processor 520 can output content through the second display 261 .

[0115] Figure 6d is a view illustrating an example of outputting the content being played through the display of the third type electronic device according to a change in the position of the external electronic device according to an embodiment.

[0116] like Figure 6d As shown in (a) of FIG. 5 , when the electronic device 101 is detected in the first recognition range 610 when the first display 260 is folded outward, the processor 520 may output content through the first display area 260c of the first display 260. Figure 6d As shown in (b), if the electronic device 101 is detected in the second recognition range 620 , the processor 520 can output content through the second display area 260 d of the first display 260 .

[0117] In this way, the display can be controlled in various ways corresponding to the direction in which the external electronic device 102 is located relative to the electronic device 101, and this is referred to below. Figures 8 to 16 Detailed description.

[0118] The memory 530 may store instructions that, when executed, enable the processor 520 to perform various operations. According to an embodiment, the memory 530 may be operably connected to the display 560, the sensor 576, the communication module 590, and the processor 520, and store instructions to control: outputting content through the first display 260 in a partially folded state of the first display 260, identifying the direction of the external electronic device 102 relative to the electronic device 101 while outputting content, maintaining output (or continuing to output content) content through the first display 260 in response to identifying that the direction of the external electronic device 102 is within the first direction range, and outputting content through the second display 261 in response to identifying that the direction of the external electronic device 102 is within the second direction range.

[0119] According to an embodiment, the electronic device 101 includes a first display 260, a second display 261 arranged in a direction opposite to the first display, at least one processor 120, 520, and a memory 130, 530 storing instructions, which, when executed by the electronic device, cause the electronic device to output content through the first display. According to an embodiment, the instructions are configured to cause the electronic device to identify the direction of an external electronic device connected to the electronic device via a short-range communication scheme relative to the electronic device while outputting content. According to an embodiment, the instructions are configured to cause the electronic device to keep outputting content through the first display in response to recognizing that the direction of the external electronic device is within a first direction range, and to output content through the second display in response to recognizing that the direction of the external electronic device is within a second direction range.

[0120] According to an embodiment, when the first display is partially folded, the first display is divided into a first display area and a second display area, and a folding axis is provided between the first display area and the second display area, wherein the first direction range may be within a front direction range relative to the first display area, and the second direction range may be within a rear direction range relative to the first direction range.

[0121] According to an embodiment, the instructions are configured to cause the electronic device to: in response to identifying that the external electronic device falls outside a first direction range while maintaining output of content through a first display, identify whether the direction of the external electronic device is within a second direction range, and in response to identifying that the direction of the external electronic device is within the second direction range, output content through a second display.

[0122] According to an embodiment, the instructions are configured to enable the electronic device to identify whether the direction of the external electronic device falls outside the first direction range while maintaining output of content through the first display, and in response to identifying that the direction of the external electronic device falls outside the first direction range, reduce the brightness of the first display.

[0123] According to an embodiment, the instruction is configured to cause the electronic device to control the external electronic device to output guidance information about the content being output while maintaining the content output through the first display in response to recognizing that the external electronic device is outside the first direction range and outside the second direction range. The guidance information may include at least one of subtitles representing the content being output, playback time information of the content being output, and whether to stop playing the content being output.

[0124] According to an embodiment, the instructions are configured to cause the electronic device to: in response to identifying that the direction of the external electronic device falls outside a first direction range, identify the direction of the external electronic device relative to the electronic device, and in response to identifying that the identified direction of the external electronic device is within a second direction range after a predetermined time, provide guidance related to a playback time point of content to be output through a second display.

[0125] According to an embodiment, the instructions are configured to cause the electronic device to identify a direction of the external electronic device relative to the electronic device based on at least one of an ultra-wideband (UWB) communication scheme or a Bluetooth low energy (BLE) communication scheme.

[0126] According to an embodiment, the instructions are configured to cause the electronic device to recognize connection with the external electronic device, and recognize whether the connected external electronic device is worn on a body part of the user, and recognize a direction of the external electronic device relative to the electronic device.

[0127] According to an embodiment, the instructions are configured to cause the electronic device to identify the external display device for mirroring content and output an image through the external display device in response to the external electronic device being at a predetermined distance or more from the electronic device, in response to recognizing the external display device.

[0128] According to an embodiment, when the first display is partially folded, the first display can be divided into a first display area and a second display area, with a folding axis between the first display area and the second display area, and the instructions are configured to enable the electronic device to identify the height of the external electronic device relative to the electronic device, and determine one of the first display area and the second display area to output content in response to the direction of the external electronic device within a first direction range and the height of the external electronic device.

[0129] According to an embodiment, the electronic device 101 includes a short-range communication circuit, a display (260), a UWB circuit, a memory (130 or 530) and at least one processor (120 or 520). According to an embodiment, the memory stores instructions, which, when executed by at least one processor, cause the electronic device to control the short-range communication circuit to establish a communication link with an external electronic device. According to an embodiment, the instructions are configured to cause the electronic device to control the UWB circuit to perform a ranging operation to obtain information related to the distance and direction of the external electronic device relative to the electronic device. According to an embodiment, the instructions are configured to cause the electronic device to control the display to perform a first operation based on the direction of the external electronic device being within a defined range of directions when the external electronic device is within the ranging distance of the UWB circuit. According to an embodiment, the instructions are configured to cause the electronic device to control the display to perform a second operation based on the direction of the external electronic device being outside a defined range of directions when the external electronic device is within the ranging distance of the UWB circuit.

[0130] Figure 7 is a flowchart showing the operation of the electronic device according to the embodiment. Figure 7 , the operation method may include operations 705 to 720. Figure 7 Each operation of the operation method may be performed by an electronic device (eg, Figures 1 to 6b at least one electronic device 101 or at least one processor of an electronic device (eg, Figure 1 The processor 120 or Figure 2 In an embodiment, at least one of operations 705 to 720 may be omitted or changed in order, or other operations may be added.

[0131] In operation 705, the electronic device 101 may output content through the first display 260. According to an embodiment, the electronic device 101 may display a running screen of an application through the first display 260. For example, the application may include a video playback application, but is not limited thereto.

[0132] In operation 710, the electronic device 101 may identify the direction of the external electronic device 102 connected to the electronic device through a short-range communication scheme relative to the electronic device 101 while outputting content. According to an embodiment, the electronic device 101 may identify the connection with the external electronic device 102, and identify whether the connected external electronic device 102 is worn on a body part of a user. The electronic device 101 may identify the direction of the external electronic device 102 relative to the electronic device 101 based on the external electronic device 102 being recognized as being worn.

[0133] According to an embodiment, the electronic device 101 may recognize a direction and / or a distance of the external electronic device 102 relative to the electronic device 101 based on at least one of the UWB communication scheme or the BLE communication scheme.

[0134] In operation 715, in response to recognizing that the direction of the external electronic device 102 is within the first direction range, the electronic device 101 may continue to output content through the first display 260. For example, in the case where it is determined that the user wearing the external electronic device 102 is within the first direction range (e.g., Figure 6a and Figure 6b When the electronic device 101 is within the first recognition range 610 of the first display 260, the electronic device 101 can continuously output content through at least a portion of the display area of ​​the first display 260. Here, the content playback screen can be displayed through the first display area 260a (or the upper display area), and the control screen related to the content playback can be displayed through the second display area 260b (or the lower display area).

[0135] In operation 720, in response to recognizing that the direction of the external electronic device 102 is within the second direction range, the electronic device 101 may output content through the second display 261 disposed opposite to the first display 260. For example, in the case where it is determined that the user wearing the external electronic device 102 is within the second direction range (e.g., Figure 6a and Figure 6b When the electronic device 101 is in the second recognition range 620 of the first display 260, the electronic device 101 can output the content that was displayed by the first display 260 on the second display 261. Therefore, the content playback screen can be displayed by at least a partial area of ​​the second display 261.

[0136] According to an embodiment, the aspect ratios of the first display 260 and the second display 261 may be different from each other. Therefore, as the user moves, when outputting content on the first display 260 or the second display 261, the electronic device 101 may change (or optimize) the aspect ratio (e.g., horizontal-vertical ratio) of the played content to correspond to the display aspect ratio corresponding to the output target.

[0137] According to an embodiment, when the first display is partially folded, the first display is divided into a first display area and a second display area, a folding axis is provided between the first display area and the second display area, and the first direction range may be within a front direction range relative to the first display area, and the second direction range is within a rear direction range relative to the front direction range.

[0138] According to an embodiment, the electronic device 101 may use the position of the external electronic device 102 and the direction of the external electronic device 102 relative to the electronic device 101 to identify the recognition range (e.g., the first recognition range 610 or the second recognition range 620). According to an embodiment, the electronic device 101 may use the position of the external electronic device 102 to identify the recognition range (e.g., the first recognition range 610 or the second recognition range 620). According to an embodiment, the electronic device 101 may use the direction of the external electronic device 102 relative to the electronic device 101 to identify the recognition range (e.g., the first recognition range 610 or the second recognition range 620).

[0139] According to an embodiment, when the direction of the external electronic device 102 falls outside the first direction range while the content is output through the first display 260, the electronic device 101 may identify whether the direction of the external electronic device 102 is within the second direction range. For example, when the external electronic device 102 worn on the user's body falls within the first direction range, the electronic device 101 may identify whether the direction of the external electronic device 102 is within the second direction range. Figure 6a When the external electronic device is outside the first direction range (e.g., the first recognition range 610) shown in (b) or (c), the electronic device 101 can identify whether the external electronic device is detected in the second direction range (e.g., the second recognition range 620).

[0140] According to an embodiment, the electronic device 101 may identify whether the direction of the external electronic device 102 falls outside the first direction range while maintaining output of content through the first display 260, and if it falls outside the first direction range, reduce the brightness of the first display 260. For example, when falling outside the first direction range, the electronic device 101 may assume that the user is no longer facing and viewing the first display 260, and reduce the brightness of the first display 260 to save battery.

[0141] According to an embodiment, in response to recognizing that the direction of the external electronic device 102 is within the second direction range, the electronic device 101 may output content through the second display 261. For example, the electronic device 101 may output content that was output through the first display 260 on the second display 261.

[0142] According to an embodiment, in response to recognizing that the direction of the external electronic device 102 falls outside the first direction range and does not correspond to the second direction range, the electronic device 101 can control the external electronic device 102 to output guidance information about the content being output while maintaining the output of the content through the first display 260.

[0143] According to an embodiment, the guide information may include at least one of subtitles showing the content being output, play time information about the content being output, or whether to pause playback of the content being output (see Figure 6b ).

[0144] For example, in a state where the direction of the external electronic device 102 falls outside the first direction range, although the brightness of the first display 260 is reduced to save battery, the electronic device 101 can continue to output the sound of the content being output. In addition, in a state where content including subtitles is being output, guide information (e.g., subtitle information) about the content being output can be transmitted from the electronic device 101 to the external electronic device 102. Therefore, the external electronic device 102 can output (or display) the guide information about the content being output on the electronic device 101 through a picture or as a voice, thereby allowing the user to recognize the content even without viewing the first display 260. In addition, by receiving the guide information, the external electronic device 102 can display the playback time information about the content being output. Therefore, even without viewing the first display 260, the user can recognize the part of the entire content that is being played and the playback speed. In addition, when the direction of the external electronic device 102 falls outside the first direction range and is not within the second direction range, the electronic device 101 may regard it as a state in which the user cannot see the content, and based on the guidance information received from the electronic device 101, the external electronic device 102 may display an item for selecting whether to stop playing the content being output (see Figure 6b ).

[0145] According to an embodiment, if the direction of the external electronic device 102 falls outside the first direction range, the electronic device 101 can identify the direction of the external electronic device 102 relative to the electronic device 101, and when the identified direction of the external electronic device 102 is within the second direction range after a predetermined time, the electronic device 101 can provide guidance related to the playback time point of the content to be output through the second display 261.

[0146] For example, a predetermined time (e.g., three seconds) after the direction of the external electronic device 102 falls outside the first direction range, the electronic device 101 can reduce the brightness of the first display 260 to save battery and transmit guidance information about the content being output (e.g., subtitle information corresponding to the currently played portion of the video) on the external electronic device 102. If the external electronic device 102 is detected in the second direction range after a predetermined time (e.g., 30 seconds), the electronic device 101 can output the image that was once output through the first display 260 on the second display 261 of the electronic device 101. In addition, when the external electronic device 102 is detected in the first direction range again after another predetermined time, the electronic device 101 can change the brightness of the first display 260 back to the previous brightness. In addition, in another embodiment, considering the state in which the user cannot see the content through the first display 260 due to the user moving from the front range facing the front surface 210a to the rear range facing the rear surface 220a, the electronic device 101 can provide guidance related to the playback time point of the content to be output through the second display 261. For example, the electronic device 101 may provide the user with a function for re-identifying (or viewing) content from a point in time when the content falls outside the first direction range, so that the user can view the content again through the second display 261 from the portion of the content displayed on the first display 260 when the content falls outside the first direction range.

[0147] According to an embodiment, the electronic device 101 may continuously or periodically identify the direction and / or distance of the external electronic device 102 relative to the electronic device 101 while outputting content. For example, the electronic device 101 may identify whether the distance between the external electronic device 102 and the electronic device 101 is a predetermined distance or greater. If the distance between the external electronic device 102 and the electronic device 101 is equal to or greater than the predetermined distance, the electronic device 101 may identify another external display device (e.g., Figure 1104) for mirroring the content to the external display device 104. The electronic device 101 may control output of an image through the external display device 104 in response to recognizing the external display device 104, so that when the distance between the external electronic device 102 and the electronic device 101 increases to a predetermined distance, the user may view the image again from the portion of the content displayed on the electronic device 101 through the external display device 104.

[0148] Figure 8 is a flowchart illustrating an operation of an electronic device for controlling a display corresponding to a position of an external electronic device according to an embodiment. Figure 8 , the operating method may include operations 805 to 850. Figure 8 Each operation of the operation method may be performed by an electronic device (eg, Figures 1 to 6b at least one electronic device 101 or at least one processor of an electronic device (eg, Figure 1 The processor 120 or Figure 2 In an embodiment, at least one of operations 805 to 850 may be omitted or changed in order, or other operations may be added.

[0149] To better understand Figure 8 For a description, see Figure 9a and Figure 9b . Figure 9a is an exemplary view showing display switching when the external electronic device moves to the rear direction range of the electronic device. Figure 9b is an exemplary view illustrating display switching when an external electronic device moves to a front direction range of the electronic device according to an embodiment.

[0150] In operation 805, the electronic device 101 may run a video application in a folding mode. The folding mode may refer to a state in which a display is partially folded. For example, when a video application is running in a partially folded state (i.e., folding mode) of a portion of an internal display (e.g., the first display 260), the electronic device 101 may play a video through a partial display area (e.g., the upper display area 260a) of the internal display. In an embodiment, the electronic device 101 may provide a function of playing a video through a display corresponding to the direction of the user among a plurality of displays. In order to identify the direction of the user relative to the electronic device 101, an external electronic device 102 may be used, and the external electronic device 102 may be a wearable electronic device that may be worn on a body part of the user.

[0151] In operation 810, the electronic device 101 may identify whether the electronic device 101 is in a state of being connected (e.g., wirelessly connected for communication) with the worn external electronic device 102. In operation 815, the electronic device 101 may identify the direction in which the external electronic device 102 is positioned relative to the electronic device 101 (e.g., the front direction range of the electronic device 101 in the flex mode), corresponding to the recognition of the state of being connected with the worn external electronic device 102.

[0152] In operation 820 , the electronic device 101 may identify whether the external electronic device 102 is located in a front direction range or a rear direction range of the electronic device 101 .

[0153] Corresponding to the external electronic device 102 being located in the front direction range of the electronic device 101, the electronic device 101 may determine in operation 825 whether a video is being played through an external display (e.g., the second display 261). Unless the video is being played through the external display, the electronic device 101 may continue to play the video through the internal display in operation 830. On the other hand, in operation 835, when the video is being played through the external display, the electronic device 101 may switch the display playing the video to the internal display according to the external electronic device 102 being located in the front direction range. According to an embodiment, when switching to the internal display (e.g., the first display 260) to play the video, it may be determined which area of ​​the upper or lower display area of ​​the internal display is used to display the video according to the application being run or according to the user's selection.

[0154] At the same time, corresponding to the external electronic device 102 being located within the rear direction range of the electronic device 101, the electronic device 101 may determine in operation 840 whether the video is being played through the internal display. Unless the video is played through the internal display, the electronic device 101 may continue to play the video through the external display (e.g., the second display 261) in operation 845. On the other hand, in operation 850, when the video is played through the internal display, the electronic device 101 may switch the display playing the video to the external display according to the location of the external electronic device 102 within the rear range. According to an embodiment, unless the video playback through the video application is terminated, operations 820 to 850 may be repeatedly performed, and operations 820 to 850 related to switching the display for playing the video on the electronic device 101 according to the direction of the external electronic device 102 may be referred to as operation A.

[0155] refer to Figure 9a, when the electronic device 101 plays a video through the internal display in the turned-on state, the external electronic device 102 worn on the user's body may move (910) to the rear direction range of the electronic device 101 due to the user's movement, as shown in 900a. When it is detected that the external electronic device 102 is within the rear direction range of the electronic device 101, the video playback through the internal display can be stopped, and then the external display can be turned on to play the video through the external display, as shown in 900b. In this way, the display used to play the video can be determined to correspond to the direction faced by the external electronic device 102 and the electronic device 101, and the electronic device 101 can, for example, switch from the internal display to the external display and resume video playback through the switched external display, as shown in 900b.

[0156] refer to Figure 9b , as shown in 900c, when playing a video through the external display in the turned-on state, the external electronic device 102 may move (920) into the front direction range of the electronic device 101 due to the movement of the user. The electronic device 101 may identify the movement into the front direction range of the electronic device 101 by tracking the movement direction of the external electronic device 102 relative to the electronic device 101. When the external electronic device 102 is detected within the front direction range of the electronic device 101, the video playback through the external display may be stopped, and then the internal display may be turned on to play the video through the internal display, as shown in 900d.

[0157] According to an embodiment, the electronic device 101 can continuously track the direction of the external electronic device 102 relative to the electronic device 101 while playing the video to determine the moving direction. In this way, the display for providing the video can be switched according to the position of the user wearing the external electronic device 102, so that the user can recognize the video through the display in several directions even without separate manipulation on the user side.

[0158] Fig.9c 2 is an exemplary view illustrating display switching according to movement of another type of external electronic device onto a rear surface of an electronic device according to an embodiment.

[0159] refer to Fig.9c, the display can be controlled based on two or more external electronic devices 102 and 102b. For example, the user can be in a state of wearing multiple external electronic devices including a wearable watch 102 and a head-mounted display 102b. In addition, in addition to devices configured to be worn on the user's body, such as the head-mounted display 102b, the external electronic device may also include a glasses-type AR glasses device. Without limitation, the external electronic device may be implemented in various other forms that can be worn on the user's body. For example, the external electronic device may include a ring-shaped wearable device (e.g., a smart ring) that can be worn on the user's finger.

[0160] In an embodiment, since the external electronic device 102 such as a head-mounted display includes a camera (eg, a ToF camera or an eye tracking camera), not only the distance information of the electronic device 101 can be grasped but also the user's line of sight can be tracked.

[0161] like Fig.9c As shown in (a), corresponding to the external electronic devices 102 and 102b being located in the front range of the electronic device 101, the electronic device 101 can play through the internal display 260.

[0162] like Fig.9c As shown in (b), corresponding to the external electronic devices 102 and 102b being located within the rear direction range of the electronic device 101, the electronic device 101 can play through the external display 261.

[0163] Fig.10 is a flowchart illustrating an operation of an electronic device for controlling a display corresponding to an external electronic device located at a side of the electronic device according to an embodiment. Fig.10 , the operating method may include operations 1005 to 1045. Fig.10 Each operation of the operation method may be performed by an electronic device (eg, Figures 1 to 6b at least one electronic device 101 or at least one processor of an electronic device (eg, Figure 1 The processor 120 or Figure 2 In an embodiment, at least one of operations 1005 to 1045 may be omitted or changed in order, or other operations may be added.

[0164] To better understand Fig.10 For a description, see Fig.11a and Fig.11b . Fig.11a are exemplary views showing display switching when an external electronic device moves into a side range of the electronic device. Fig.11b1 is an example view showing display switching when an external electronic device moves from a side range to a rear range of an electronic device according to an embodiment. Here, a "side range" (also referred to as a blind area) is a range that faces neither the first surface 210a of the electronic device 101 nor the second surface 220a of the electronic device 101. In other words, the side range is a range other than the front range 610 and the second range 620 near the electronic device 101.

[0165] Operations 1005 to 1015 are respectively related to Figure 8 Operations 805 to 815 are the same, and their detailed descriptions will not be repeated.

[0166] In operation 1020, the electronic device 101 may identify whether the external electronic device 102 is located within the side range of the electronic device 101. For example, if the direction of the external electronic device 102 relative to the electronic device 101 falls within the first recognition range (e.g., Figure 6a and Figure 6b 610) and / or outside the first position or direction range corresponding to the second recognition range (e.g., Figure 6a and Figure 6b If the electronic device 101 is outside the second position or direction range corresponding to 620 of the electronic device 101, the electronic device 101 can recognize that the electronic device 101 is located within the side range of the electronic device 101. According to an embodiment, as the user wearing the external electronic device 102 moves, when the external electronic device 102 is located in a range (for example, a side range) outside the first recognition range and / or the second recognition range, the user may not be able to recognize the screen content even though he is looking at the display.

[0167] When the external electronic device 102 is detected to be within the side range of the electronic device 101, in operation 1025, the electronic device 101 may reduce the brightness of the internal display that is playing the video. In addition, in operation 1030, the electronic device 101 may control the output of playback information (e.g., subtitles) through the external electronic device 102. According to an embodiment, when the external electronic device 102 is detected to be within the side range of the electronic device 101, any one of operation 1025 or operation 1030 may be performed. In other words, any one of operation 1025 or operation 1030 may be omitted.

[0168] Thereafter, operation A related to switching the display to play a video on the electronic device 101 corresponding to the direction of the external electronic device 102 may be performed, and operation A is related to Figure 8 Operations 820 to 850 are the same and their detailed descriptions are omitted.

[0169] In operation 1035, when playing a video through an external display or an internal display corresponding to the position or direction of the external electronic device 102, the electronic device 101 can identify whether the external electronic device 102 has been located in the side range for a predetermined time. If the positioning reaches the predetermined time, a message for asking whether to play the video from the unwatched portion (for example, a portion of the video played when the external electronic device 102 moves away from the front range 610 or the rear range 620) can be output by the external electronic device 102 in operation 1040. If the external electronic device 102 is not located in the side range for a predetermined time, it can be identified in operation 1045 whether the video playback is terminated. Therefore, unless the video playback is terminated, the electronic device 101 can repeat the above operation.

[0170] For example, refer to Fig.11a , the electronic device 101 can continuously track the direction change (or movement direction) of the external electronic device 102. When the electronic device 101 plays a video through an internal display in an on state, the external electronic device 102 worn on the user's body may move to the side range of the electronic device 101 due to the user's movement, as shown in 1100a. When the external electronic device 102 is detected to be within the side range of the electronic device 101, the electronic device 101 can reduce the brightness of the internal display that is playing the video, as shown in 1100b. In addition, according to an embodiment, the electronic device 101 can provide information related to video playback to the external electronic device 102, so that the external electronic device 102 outputs information related to video playback (for example, subtitle information).

[0171] refer to Fig.11b As shown in 1100c, due to the movement of the user, the external electronic device 102 may move from a position in the side range of the electronic device 101 to the rear range of the electronic device 101. When the electronic device 101 is located in the side range for a predetermined time (e.g., three seconds or longer), the brightness of the internal display may be reduced to save battery. When the external electronic device 102 is detected to be in the rear range of the electronic device 101 due to the movement of the user, as shown in 1100d, the electronic device 101 may turn off the internal display and play the video through the external display (e.g., the second display 261).

[0172] When the external electronic device 102 that was once in the side range of the electronic device 101 is detected in the rear range (or the front range), the user has not yet watched the video because he / she stayed in the side range. In an embodiment, the electronic device 101 can provide a function for playing the video from the unwatched part according to the user's selection. For example, as shown in 1100d, the electronic device 101 can provide the user with a function for playing the video from the part that has not been watched since it falls outside the first direction range (for example, Figure 6aand Figure 6b The function of recognizing (or viewing) the video again from the time point of the first recognition range 610 of the external electronic device 102, and the user's selection of such a function can be obtained through the external electronic device 102. Unless the user selects a menu that pops up on the display of the external electronic device 102, the pop-up window can be automatically removed within a specified time (e.g., 10 seconds).

[0173] Fig.12 is a view showing a signal flow among an electronic device, an external electronic device, and an external display device for mirroring according to an embodiment. In an embodiment, at least one of operations 1205 to 1260 may be omitted or changed in order, or other operations may be added.

[0174] To better understand Fig.12 For a description, see Fig.13 and Fig.14 . Fig.13 2 is an exemplary view illustrating display switching when an external electronic device moves toward another external display device according to an embodiment. Fig.14 2 is an exemplary view illustrating display switching when an external electronic device is moved back from another external display device to an electronic device according to an embodiment.

[0175] Fig.12 Operations 1205 and 1210 are respectively Figure 8 Operations 805 and 810 are the same, and detailed descriptions thereof are omitted.

[0176] In operation 1215, the electronic device 101 may recognize the distance from the external electronic device 102. For example, the electronic device 101 may recognize the distance from the electronic device 101 to the external electronic device 102 based on a wireless communication scheme such as a UWB communication scheme and a BLE communication scheme.

[0177] In operation 1220, the electronic device 101 may identify a state where the electronic device 101 is away from the external electronic device 102 by a first threshold distance (e.g., 3 meters) or more. When away from the first threshold distance or more, in operation 1225, the electronic device 101 may identify whether there is a mirrorable external display device 104. On the contrary, unless away from the first threshold distance or more, the electronic device 101 may perform operation 1230.

[0178] When there is a mirrorable external display device 104, the external electronic device 102 may identify the distance from the external display device 104 in operation 1235. In operation 1240, the external electronic device 102 may identify whether the external electronic device 102 is within a second threshold distance (e.g., 2 meters) from the external display device 104. Here, the second threshold distance may be smaller than the first threshold distance, and the smaller second threshold distance may mean that the external electronic device 102 is positioned closer to the external display device 104 than the electronic device 101. If not within the second threshold distance, although there is a mirrorable external display device 104 around the external electronic device 102, it means that it is farther than the electronic device 101, so that mirroring may not be performed.

[0179] On the contrary, when the external display device 104 is within the second threshold distance, the external electronic device 102 may display a mirroring related pop-up window in operation 1245. According to an embodiment, the external electronic device 102 may display a pop-up window including an item capable of selecting whether to mirror the played video screen through the discovered external display device 104.

[0180] In operation 1250, the external electronic device 102 may identify whether to accept the mirroring, and if the user chooses to accept the mirroring, the external display device 104 may indicate the acceptance. Correspondingly, in operation 1260, the external display device 104 may display the mirroring screen.

[0181] refer to Fig.13 , as shown in 1300a, the external electronic device 102 may be away from the electronic device 101 by a first threshold distance or more, and the mirrorable external display device 104 may be found within a second threshold distance. In this case, as shown in 1300b, the external electronic device 102 may output (e.g., display) content to inquire whether to mirror to the external display device 104. When the user selects mirroring, the display of the electronic device 101 that is playing the video may be turned off, and a screen according to the video playback may be output through the external display device 104, as shown in 1300c. This is the "mirror" function.

[0182] When the mirrored screen is displayed on the external display device 104, the external electronic device 102 may continuously recognize the distance from the external display device 104 to the external electronic device 102 in operation 1235. Therefore, when the distance from the external display device 104 reaches the second threshold distance or more, the mirroring may be stopped.

[0183] Therefore, in operation 1230, the electronic device 101 may play a video through a display among several displays (e.g., the first display 260 and the second display 261) of the electronic device 101, corresponding to the direction in which the external electronic device 102 is located relative to the electronic device 101. For example, the electronic device 101 may perform operation 1230 when there is no mirrorable external display device 104 around or the external electronic device 102 is away from the external display device 104 by a second threshold distance or more during mirroring.

[0184] refer to Fig.14 , when the external electronic device 102 reaches a second threshold distance or more away from the external display device 104 due to the movement of the user, and the distance from the electronic device 101 to the external electronic device 102 is within the first threshold distance after the user moves toward the electronic device 101, as shown in 1400a, the external electronic device 102 may output (e.g., display) content to inquire whether to stop mirroring through the external display device 104, as shown in 1400b. When the user chooses to stop mirroring, mirroring through the external display device 104 may be stopped, and as shown in 1400c, the electronic device 101 may play a video through the display of the electronic device 101 corresponding to the direction of the external electronic device 102 relative to the electronic device 101.

[0185] In About Fig.14 In the embodiment of 1400c, as Figure 6a and Figure 6b , an example of identifying whether the direction of the external electronic device 102 is in the first recognition range 610 or in the second recognition range 620 of the electronic device 101 and switching to a display corresponding to the identified direction is described, but the embodiments of the present disclosure may not be limited thereto. For example, when using the UWB communication scheme, the electronic device 101 can not only identify at least one of the direction and / or distance of the external electronic device 102, but also identify the vertical movement of the external electronic device 102 relative to the electronic device 101.

[0186] Fig.15 2 is an exemplary view illustrating display switching when an external electronic device moves in an up / down direction of an electronic device according to an embodiment.

[0187] like Fig.15As shown, the external electronic device 102 worn on the user's body can move in an upward direction or a downward direction according to the user's movement, and the electronic device 101 can identify the vertical movement through UWB height tracking and UWB direction tracking. According to an embodiment, based on the upward / downward movement of the external electronic device 102, the display to play the video can be switched between the upper display area (e.g., the display area located at the upper position of the first display area 260a and the second display area 260b) and the lower display area (e.g., the display area located at the lower position of the first display area 260a and the second display area 260b) separated according to the partial folding of the first display 260. For example, when the upward movement of the external electronic device 102 is detected in a state where content is displayed in the upper display area of ​​the first display 260, the electronic device 101 can switch the display playing the content to the lower display area and display the content on the lower display area.

[0188] According to an embodiment, when the external electronic device 102 moves upward or downward, the electronic device 101 may control content display in a manner of switching from a lower display area to an upper display area or from an upper display area to a lower display area.

[0189] like Fig.15 As shown, the state of displaying an image in the lower display area may be a state in which the user is looking down, that is, a state in which the wearable watch (i.e., the external electronic device 102) is positioned upward. When the wearable watch moves from the upper position to the lower position in the state in which the content is displayed in the lower display area, the electronic device 101 may switch the display of the playing content to the upper display area. In addition, when the movement of the wearable device from the lower position to the upper position is detected in the state in which the image is displayed in the upper display area, the electronic device 101 may switch the display of the playing content to the lower display area. In an embodiment, the upper position may be a position higher than the electronic device 101, and the lower position may be a position at substantially the same height as the electronic device 101. In another embodiment, the upper position may be a position within a predetermined angle range relative to the normal direction of the second display area 260b, and the lower position may be a position within a predetermined angle range relative to the normal direction of the first display area 260a.

[0190] Fig.16 is an exemplary view illustrating display switching according to a distance from an external electronic device according to an embodiment.

[0191] refer to Fig.16, the user can set a function for controlling zooming in / out according to the distance from the electronic device 101 to the external electronic device 102 through a setting menu. The electronic device 101 can also identify the distance from the external electronic device 102 according to the UWB communication scheme. In this way, the UWB AOA measurement scheme can measure the distance as well as the azimuth and elevation of the external electronic device 102. For example, when capturing through a camera application, the electronic device 101 can identify the distance from the external electronic device 102, and switch the function of the camera application to a wide-angle capture function or a telephoto capture function according to the distance from the external electronic device 102. In addition, the electronic device 101 can identify the distance from the external electronic device 102 when displaying an exercise video through a health application, and zoom in or out and display the characters in the exercise video according to the distance from the external electronic device 102.

[0192] The electronic device according to various embodiments of the present disclosure may be one of various types of electronic devices. The electronic device may include, for example, a portable communication device (e.g., a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a household appliance. According to an embodiment of the present disclosure, the electronic device is not limited to the electronic device described above.

[0193] It should be understood that the various embodiments of the present disclosure and the terms used therein are not intended to limit the technical features set forth herein to specific embodiments, but include various changes, equivalents or replacements of the corresponding embodiments. Regarding the description of the accompanying drawings, similar reference numerals may be used to refer to similar or related elements. It should be understood that the singular form of the noun corresponding to the project may include one or more things, unless the relevant context clearly indicates otherwise. As used herein, each of the phrases such as "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C" and "at least one of A, B or C" may include all possible combinations of the items enumerated together in the corresponding phrase in the phrase. As used herein, terms such as "1st" and "2nd", or "first" and "second" may be used to simply distinguish the corresponding component from another component, and do not limit the component in other aspects (e.g., importance or order). It should be understood that if an element (e.g., a first element) is referred to as being "coupled," "coupled to," "connected to," or "connected to" another element (e.g., a second element) with or without the term "operably" or "communicatively," this means that the element can be coupled to the other element directly (e.g., wired), wirelessly, or via a third element.

[0194] As used herein, the term "module" may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with other terms (e.g., "logic," "logic block," "portion," or "circuit"). A module may be a single integrated component, or a minimum unit, or a portion thereof, adapted to perform one or more functions. For example, according to an embodiment, a module may be implemented in the form of an application specific integrated circuit (ASIC).

[0195] Various embodiments as described herein may be implemented as software (e.g., program 140) including one or more instructions readable by a machine (e.g., electronic device 101) stored in a storage medium (e.g., internal memory 136 or external memory 138). For example, a processor (e.g., processor 120) of a machine (e.g., electronic device 101) may call at least one of the one or more instructions stored in the storage medium and execute the instructions under the control of the processor with or without one or more other components. This allows the operating machine to perform at least one function according to at least one instruction called. One or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Among them, the term "non-transitory" simply means that the storage medium is a tangible device and does not include signals (e.g., electromagnetic waves), but the term does not distinguish between the case where data is semi-permanently stored at a location in the storage medium and the case where data is temporarily stored at a location in the storage medium.

[0196] According to an embodiment, the method according to various embodiments of the present disclosure may be included in a computer program product and provided in the computer program product. The computer program product may be traded as a commodity between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., a compact disc read-only memory (CD-ROM)), or via an application store (e.g., Play Store TM ) online distribution (e.g., download or upload), or directly between two user devices (e.g., smartphones). If distributed online, at least a portion of the computer program product may be temporarily generated or at least temporarily stored in a machine-readable storage medium, such as a memory of a manufacturer's server, a server of an application store, or a relay server.

[0197] According to various embodiments, each component (e.g., module or program) in the components described above may include a single entity or multiple entities. Some of the multiple entities may be separately arranged in different components. According to various embodiments, one or more of the above components may be omitted, or one or more other components may be added. Alternatively or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, according to various embodiments, the integrated component may still perform one or more functions of each component in the multiple components in the same or similar manner as that performed by the corresponding components in the multiple components before integration. According to various embodiments, the operation run by a module, program or another component may be run sequentially, in parallel, repeatedly or heuristically, or one or more operations may be run in different orders or omitted, or one or more other operations may be added.

[0198] According to an embodiment, a non-volatile storage medium stores instructions configured to enable the electronic device to perform at least one operation when executed by at least one processor 120 or 520 of the electronic device 101. The at least one operation includes: outputting content through a first display of the electronic device; while outputting the content, identifying the direction of an external electronic device connected to the electronic device through a short-range communication scheme relative to the electronic device; in response to identifying that the direction of the external electronic device is within a first direction range, maintaining the output of the content through the first display; and in response to identifying that the direction of the external electronic device is within a second direction range, outputting the content through a second display arranged in a direction opposite to the first display.

Claims

1. An electronic device (101), comprising: A first display (260); A second display (261), the second display being arranged in a direction opposite to the first display; at least one processor (120, 520); as well as A memory (130, 530), wherein the memory stores instructions, which, when executed by the electronic device, cause the electronic device to: outputting content via the first display, while outputting the content, identifying a direction of an external electronic device connected to the electronic device through a short-range communication scheme relative to the electronic device, In response to recognizing that the direction of the external electronic device is within a first direction range, maintaining output of the content through the first display, and In response to recognizing that the direction of the external electronic device is within a second direction range, outputting the content through the second display.

2. The electronic device according to claim 1, in, When the first display is partially folded, the first display is divided into a first display area and a second display area, and a folding axis is provided between the first display area and the second display area. wherein the first direction range is within a front direction range relative to the first display area, and Wherein, the second direction range is within a rear direction range opposite to the front direction range.

3. The electronic device according to claim 1 or 2, wherein: The instructions further cause the electronic device to: In response to recognizing that the direction of the external electronic device falls outside the first direction range while maintaining output of the content through the first display, recognizing whether the direction of the external electronic device is within the second direction range, and In response to recognizing that the direction of the external electronic device is within the second direction range, the content is output through the second display.

4. The electronic device according to any one of claims 1 to 3, wherein: The instructions further cause the electronic device to: while maintaining outputting the content through the first display, identifying whether the direction of the external electronic device falls outside the first direction range, and In response to recognizing that the direction of the external electronic device falls outside the first direction range, the brightness of the first display is reduced.

5. The electronic device according to any one of claims 1 to 4, wherein: The instructions further cause the electronic device to: In response to recognizing that the direction of the external electronic device falls outside the first direction range and falls outside the second direction range, controlling the external electronic device to output guide information about the content being output while maintaining output of the content through the first display, and The guide information includes at least one of the following: subtitles indicating the content being output, playback time information about the content being output, or whether to stop playing the content being output.

6. The electronic device according to any one of claims 1 to 5, wherein: The instructions further cause the electronic device to: In response to identifying that the direction of the external electronic device falls outside the first direction range, identifying the direction of the external electronic device relative to the electronic device, and In response to identifying that the identified direction of the external electronic device is within the second direction range after a predetermined time, guidance related to a playback time point of content to be output through the second display is provided.

7. The electronic device according to any one of claims 1 to 6, wherein: The instructions also cause the electronic device to identify a direction and / or a distance of the external electronic device relative to the electronic device based on at least one of an ultra-wideband (UWB) communication scheme or a Bluetooth low energy (BLE) communication scheme.

8. The electronic device according to any one of claims 1 to 7, wherein: The instructions also cause the electronic device to: identifying a connection with the external electronic device, and It is identified whether the connected external electronic device is worn on a body part of a user, and based on the external electronic device being identified as being worn, a direction of the external electronic device relative to the electronic device is identified.

9. The electronic device according to any one of claims 1 to 8, wherein: The instructions further cause the electronic device to: in response to identifying that the external electronic device is at a predetermined distance or more from the electronic device, identifying an external display device for mirroring the content, and In response to identifying the external display device, the content is output through the external display device.

10. The electronic device according to any one of claims 1 to 9, wherein: When the first display is partially folded, the first display is divided into a first display area and a second display area, with a folding axis between the first display area and the second display area, and The instructions further cause the electronic device to: identifying a height of the external electronic device relative to the electronic device, and In response to the position of the external electronic device being within the first direction range and the height of the external electronic device, one of the first display area and the second display area is determined to output the content.

11. A method for controlling a display corresponding to a direction of an external electronic device by an electronic device, the method comprising: outputting content through a first display of the electronic device; while outputting the content, identifying a direction of the external electronic device connected to the electronic device through a short-range communication scheme relative to the electronic device; In response to recognizing that the direction of the external electronic device is within a first direction range, maintaining output of the content through the first display; as well as In response to recognizing that the direction of the external electronic device is within a second direction range, the content is output through a second display disposed in a direction opposite to the first display.

12. The method according to claim 11, wherein: When the first display is partially folded, the first display is divided into a first display area and a second display area, and a folding axis is provided between the first display area and the second display area. wherein the first direction range is within a front direction range relative to the first display area, and Wherein, the second direction range is within a rear direction range opposite to the front direction range.

13. The method according to claim 11 or 12, further comprising: While the content is output through the first display, when the direction of the external electronic device falls outside the first direction range, identifying whether the direction of the external electronic device is within the second direction range; as well as In response to recognizing that the direction of the external electronic device is within the second direction range, the content is output through the second display.

14. The method according to any one of claims 11 to 13, further comprising: While maintaining outputting the content through the first display, identifying whether the direction of the external electronic device falls outside the first direction range; as well as In response to recognizing that the direction of the external electronic device falls outside the first direction range, the brightness of the first display is reduced.

15. A non-volatile storage medium storing instructions, the instructions being configured to, when executed by at least one processor (120) of an electronic device (101), enable the electronic device to perform at least one operation, the at least one operation comprising: outputting content through a first display of the electronic device; while outputting the content, identifying a direction of an external electronic device connected to the electronic device through a short-range communication scheme relative to the electronic device; In response to recognizing that the direction of the external electronic device is within a first direction range, maintaining output of the content through the first display; as well as In response to recognizing that the direction of the external electronic device is within a second direction range, the content is output through a second display disposed in a direction opposite to the first display.

Images