Electronic device and method for controlling video playback on basis of relative position with audio device

Abstract

An electronic device according to various embodiments of the present specification may comprise: a housing including a plurality of sub-housings; a display disposed on the housing and having a display region which displays an image and is changeable in correspondence with an arrangement of the sub-housings; a communication circuit; a memory for storing a plurality of instructions; and at least one processor. The instructions, when executed by the at least one processor, may instruct the electronic device to: establish a wireless communication connection with an external audio device using the communication circuit; determine a relative position between the electronic device and the external audio device on the basis of signals transmitted and received through the wireless communication connection; check the arrangement of the sub-housings; determine a display region of at least a part of the display on which an image is to be displayed, on the basis of the relative position between the electronic device and the external audio device and the arrangement of the sub-housings; and display an image through the determined display region of at least a part of the display.

Description

Method for controlling video playback based on relative positions with electronic and audio devices

[0001] This document relates to an electronic device, and, for example, to a method for controlling video playback through an electronic device based on the relative position between an external audio device worn by a user and the electronic device.

[0002] A portable electronic device (hereinafter referred to as an electronic device) may include a display capable of displaying various image information to provide a diverse user experience. Since the electronic device requires portability, there are size constraints; to satisfy these size constraints and user demands for larger screens, electronic devices of various form factors are being developed.

[0003] Foldable electronic devices can be folded completely by utilizing the flexible properties of flexible displays. Accordingly, users can carry the electronic device in a small size or unfold the flexible display to view images on a larger screen. Recently, electronic devices with a multi-foldable structure that includes three or more display areas separated by two or more folding axes are being developed.

[0004] Electronic devices with a multi-foldable structure can utilize multi-screens in various forms depending on the folding state of multiple folding axes and the mounting method of the device. Accordingly, it may be required to provide multi-screen functionality in a form more suitable for the user to view among the display areas provided through the electronic device's display.

[0005] An electronic device according to various embodiments of the present disclosure (or specification, invention) may include a housing comprising a plurality of sub-housings, a display disposed on the housing and having a display area that can change to display an image in correspondence with the arrangement of the sub-housings, a communication circuit, a memory, and at least one processor.

[0006] According to one embodiment, the memory may be executed by at least one processor, and at the time of execution, the electronic device may use the communication circuit to establish a wireless communication connection with an external audio device, determine a relative position between the electronic device and the external audio device based on a signal transmitted and received through the wireless communication connection, verify the arrangement of the sub-housings, determine at least a portion of the display area to display an image based on the relative position between the electronic device and the external audio device and the arrangement of the sub-housings, and store instructions to display an image through the determined at least portion of the display area.

[0007] An electronic device according to various embodiments of the present document may include a housing comprising a plurality of sub-housings, a display disposed on the housing and comprising a plurality of display areas, wherein the directions in which the plurality of display areas face each other may differ based on the arrangement of the sub-housings, a communication circuit, a memory, and at least one processor.

[0008] According to one embodiment, the memory may be executed by at least one processor, and at the time of execution, the electronic device may use the communication circuit to establish a wireless communication connection with an external audio device, determine the direction in which the external audio device is located relative to the electronic device based on a signal transmitted and received through the wireless communication connection, determine the direction in which each of the plurality of display areas faces based on the arrangement of the sub-housings, determine at least a portion of the display areas facing the direction in which the external audio device is located based on the direction in which each of the plurality of display areas faces, and store instructions to display the image through the determined at least a portion of the display areas.

[0009] According to various embodiments of the present document, in an electronic device with a multi-foldable structure, a method for controlling video playback based on the relative position of an electronic device and an audio device can be provided, which controls the display of video through a display and the output of audio through an external audio device by utilizing the relative position of the electronic device and the external audio device without separate sensors such as a camera and a microphone, thereby providing a new multimedia experience to the user.

[0010] FIG. 1 is a block diagram of an electronic device in a network environment according to various embodiments.

[0011] FIGS. 2a, FIGS. 2b, and FIGS. 2c illustrate various examples of electronic devices with a multi-foldable structure according to various embodiments.

[0012] FIG. 3 illustrates an electronic device with a multi-foldable structure according to one embodiment.

[0013] FIG. 4 illustrates various mounting methods of an electronic device according to one embodiment.

[0014] FIG. 5 is a block diagram of an electronic device according to various embodiments.

[0015] FIG. 6 is a block diagram of software modules of an electronic device according to one embodiment.

[0016] FIG. 7 is a flowchart of a method for controlling video playback based on the relative position of an electronic device with respect to an audio device according to various embodiments.

[0017] FIG. 8 illustrates a method for measuring the distance between an electronic device and an external audio device through signals transmitted and received with an external audio device according to one embodiment.

[0018] FIG. 9 illustrates a method for measuring the direction between an electronic device and an external audio device through signals transmitted and received with an external audio device according to one embodiment.

[0019] FIG. 10 is a flowchart of a method for an electronic device according to one embodiment to pause and resume playback of an image.

[0020] FIG. 11 illustrates a field of view according to a mounting method of an electronic device according to one embodiment.

[0021] FIG. 12 illustrates a method for pausing and resuming video playback according to the movement of a user according to one embodiment.

[0022] FIG. 13 is a flowchart of a method for determining a display area where an electronic device displays an image according to one embodiment.

[0023] FIG. 14 illustrates a method for determining a display area to display an image according to the movement of a user according to one embodiment.

[0024] FIG. 15 is a flowchart of a method for an electronic device to control an audio signal according to one embodiment.

[0025] FIG. 16 illustrates a method for controlling an audio signal according to the movement of a user according to one embodiment.

[0026] FIG. 17 is a flowchart of a method for determining a display area in which an electronic device according to one embodiment displays images of a plurality of external audio devices.

[0027] FIG. 18 illustrates a method for determining a display area based on the location of external audio devices according to one embodiment.

[0028] Hereinafter, embodiments of this document are described in detail with reference to the drawings so that those skilled in the art can easily implement them. However, this document may be implemented in various different forms and is not limited to the embodiments described herein. In relation to the description of the drawings, identical or similar reference numerals may be used for identical or similar components. Additionally, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and brevity.

[0029] FIG. 1 is a block diagram of an electronic device in a network environment according to various embodiments.

[0030] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or with at least one of an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) through a server (108). According to one embodiment, the electronic device (101) may include a processor (120), memory (130), input module (150), sound output module (155), display module (160), audio module (170), sensor module (176), interface (177), connection terminal (178), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some embodiments, at least one of these components (e.g., connection terminal (178)) may be omitted from the electronic device (101), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (176), camera module (180), or antenna module (197)) may be integrated into a single component (e.g., display module (160)).

[0031] The processor (120) can control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) by executing software (e.g., a program (140)), and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in volatile memory (132), process the commands or data stored in volatile memory (132), and store the resulting data in non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) that can operate independently or together with it (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device (101) includes a main processor (121) and an auxiliary processor (123), the auxiliary processor (123) may be configured to use lower power than the main processor (121) or to be specialized for a designated function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as part thereof.

[0032] The auxiliary processor (123) may control at least some of the functions or states associated with at least one component of the electronic device (101) (e.g., display module (160), sensor module (176), or communication module (190)) on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (123) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (180) or communication module (190)). According to one embodiment, the auxiliary processor (123) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.

[0033] The memory (130) can store various data used by at least one component of the electronic device (101) (e.g., processor (120) or sensor module (176)). The data may include, for example, input data or output data for software (e.g., program (140)) and related commands. The memory (130) may include volatile memory (132) or non-volatile memory (134).

[0034] The program (140) may be stored as software in memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0035] The input module (150) can receive commands or data to be used for a component of the electronic device (101) (e.g., processor (120)) from outside the electronic device (101) (e.g., user). The input module (150) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0036] The sound output module (155) can output a sound signal to the outside of the electronic device (101). The sound output module (155) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.

[0037] The display module (160) can visually provide information to an external (e.g., user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.

[0038] The audio module (170) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150) or output sound through the sound output module (155) or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (101).

[0039] The sensor module (176) can detect the operating state of the electronic device (101) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0040] The interface (177) may support one or more specified protocols that can be used for the electronic device (101) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (102)). According to one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0041] The connection terminal (178) may include a connector through which the electronic device (101) can be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0042] The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that can be perceived by the user through tactile or kinesthetic senses. According to one embodiment, the haptic module (179) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.

[0043] The camera module (180) can capture still images and video. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0044] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).

[0045] The battery (189) can supply power to at least one component of the electronic device (101). According to one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0046] The communication module (190) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may include one or more communication processors that operate independently of the processor (120) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (104) through a first network (198) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can identify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (196).

[0047] The wireless communication module (192) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (192) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (192) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), external electronic device (e.g., electronic device (104)), or network system (e.g., second network (199)). According to one embodiment, the wireless communication module (192) may support a Peak data rate (e.g., 20 Gbps or more) for eMBB realization, loss coverage (e.g., 164 dB or less) for mMTC realization, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for URLLC realization.

[0048] An antenna module (197) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (198) or a second network (199), may be selected from the plurality of antennas, for example, by a communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (197).

[0049] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.

[0050] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.

[0051] According to one embodiment, commands or data may be transmitted or received between an electronic device (101) and an external electronic device (104) through a server (108) connected to a second network (199). Each of the external electronic devices (102, or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations performed on the electronic device (101) may be performed on one or more of the external electronic devices (102, 104, or 108). For example, if the electronic device (101) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (101) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (101) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In one embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or neural networks. According to one embodiment, the external electronic device (104) or the server (108) may be included within a second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0052] FIGS. 2a, FIGS. 2b, and FIGS. 2c illustrate various examples of electronic devices with a multi-foldable structure according to various embodiments.

[0053] According to one embodiment, an electronic device (e.g., the electronic device (101) of FIG. 1) may be an electronic device having a multi-foldable structure. Here, the multi-foldable structure may be a structure having three or more display areas distinguishable by two or more folding axes. Although the electronic device is described in this document as having a multi-foldable structure, it is not limited thereto, and at least some of the various embodiments of this document may also be applied to an electronic device having a foldable structure having two display areas distinguishable by one folding axis.

[0054] According to one embodiment, the electronic device may include a housing comprising a plurality of sub-housings that are rotatably coupled to each other. For example, each sub-housing may be connected to an adjacent sub-housing through a hinge structure, so that the angle between two sub-housings may be adjusted within a predetermined range (e.g., a predetermined range between 0 and 180 degrees).

[0055] According to one embodiment, an electronic device may include a flexible display in which at least some regions may be flexible, foldable, and / or bendable. The display may be disposed on a housing and may be disposed across a plurality of sub-housings. In this case, each region formed in each sub-housing of the display and separated by a folding axis between the sub-housings may be defined as a respective display region.

[0056] According to one embodiment, the electronic device may further include at least one sub-display disposed only on a specific sub-housing in addition to the display.

[0057] FIG. 2a illustrates examples of electronic devices with a multi-foldable structure having three display areas separated by two folding axes.

[0058] The electronic device (201) of (a) in Fig. 2a can be referred to as a G-type multi-foldable structure.

[0059] Referring to (a) of FIG. 2a, the electronic device (201) includes a first sub-housing (291a), a second sub-housing (292a), and a third sub-housing (293a), and a display (or flexible display) may be placed across a first surface of the first sub-housing (291a), the second sub-housing (292a), and the third sub-housing (293a). According to one embodiment, the first sub-housing (291a) and the second sub-housing (292a) may be folded with respect to a first folding axis (A) in a direction in which the second surface where the display is not placed faces each other, and the second sub-housing (292a) and the third sub-housing (293a) may be folded with respect to a second folding axis (B) in a direction in which the second surface faces each other.

[0060] According to one embodiment, an electronic device (201) having a multi-foldable structure such as (a) of FIG. 2a can display an image through a substantial entire area including a first display area (211a), a second display area (212a), and a third display area (213a) of the display in an unfolded state. When the electronic device (201) is folded into a fully folded state, the third sub-housing (293a) is received between the second sub-housing (292a) and the first sub-housing (291a), and the electronic device (201) can display an image through the first display area (211a) and / or the second display area (212a) exposed to the outside.

[0061] According to another embodiment, the display may be positioned across a second side in the inner direction where the sub-housings (291a, 292a, 293a) are folded. Alternatively, the first display and the second display may be positioned across the first and second sides, respectively, of the first sub-housing (291a), the second sub-housing (292a), and the third sub-housing (293a).

[0062] The more detailed structure of the electronic device (201) of the G-type multi-foldable structure of FIG. 2 (a) will be explained in more detail through FIG. 3, and various mounting methods will be explained in more detail through FIG. 4.

[0063] Figure 2a (b) can be referred to as a Z-type multi-foldable structure.

[0064] Referring to FIG. 2a(b), the electronic device (202) includes a first sub-housing (291b), a second sub-housing (292b), and a third sub-housing (293b), and a display (or flexible display) may be placed across the first surface of the first sub-housing (291b), the second sub-housing (292b), and the third sub-housing (293b). According to one embodiment, the first sub-housing (291b) and the second sub-housing (292b) may be folded with respect to a first folding axis (A) in a direction in which the second surface where the display is not placed faces each other, and the second sub-housing (292b) and the third sub-housing (293b) may be folded with respect to a second folding axis (B) in a direction in which the first surface faces each other.

[0065] According to one embodiment, when the electronic device (202) is folded into a fully folded state, the second display area and the third display area are not exposed to the outside, and the electronic device can display an image through the first display area exposed to the outside.

[0066] FIG. 2b illustrates examples of electronic devices with a multi-foldable structure in which the display can be folded along three or more folding axes.

[0067] Referring to (c) of FIG. 2b, the electronic device (203) may include a first sub-housing (291c), a second sub-housing (292c), a third sub-housing (293c), and a fourth sub-housing (294c). According to one embodiment, the first sub-housing (291c) and the second sub-housing (292c) of the electronic device (203) may be folded with the second surfaces facing each other with respect to the first folding axis (A), the second sub-housing (292c) and the third sub-housing (293c) may be folded with the second surfaces facing each other with respect to the second folding axis (B), and the third sub-housing (293c) and the fourth sub-housing (294c) may be folded with the first surfaces facing each other with respect to the third folding axis (C).

[0068] Referring to (d) of FIG. 2b, the electronic device (204) may include a first sub-housing (291d), a second sub-housing (292d), a third sub-housing (293d), and a fourth sub-housing (294d). According to one embodiment, the first sub-housing (291d) and the second sub-housing (292d) of the electronic device (204) may be folded with their first surfaces facing each other with respect to a first folding axis (A), the second sub-housing (292d) and the third sub-housing (293d) may be folded with their first surfaces facing each other with respect to a second folding axis (B), and the third sub-housing (293d) and the fourth sub-housing (294d) may be folded with their first surfaces facing each other with respect to a third folding axis (C).

[0069] Referring to (e) of FIG. 2b, the electronic device (205) may include a first sub-housing (291e), a second sub-housing (292e), a third sub-housing (293e), and a fourth sub-housing (294e). According to one embodiment, the first sub-housing (291e) and the second sub-housing (292e) of the electronic device (205) may be folded with their second surfaces facing each other with respect to a first folding axis (A), the second sub-housing (292e) and the third sub-housing (293e) may be folded with their first surfaces facing each other with respect to a second folding axis (B), and the third sub-housing (293e) and the fourth sub-housing (294e) may be folded with their second surfaces facing each other with respect to a third folding axis (C).

[0070] Referring to (f) of FIG. 2b, the electronic device (206) may include a first sub-housing (291f), a second sub-housing (292f), a third sub-housing (293f), and a fourth sub-housing (294f). According to one embodiment, the first sub-housing (291f) and the second sub-housing (292f) of the electronic device (206), which are arranged parallel to each other, and the third sub-housing (293f) and the fourth sub-housing (294f), which are arranged parallel to each other, may be folded first with respect to a first folding axis (A), and after being folded first, the third sub-housing (293f) and the fourth sub-housing (294f) may be folded secondly in a direction facing each other with respect to a second folding axis (B).

[0071] Referring to (g) of FIG. 2b, the electronic device (207) may include a first sub-housing (291g), a second sub-housing (292g), a third sub-housing (293g), a fourth sub-housing (294g), a fifth sub-housing (295g), and a sixth sub-housing (296g). According to one embodiment, the first sub-housing (291g), the second sub-housing (292g), and the third sub-housing (293g) of the electronic device (207) arranged parallel to each other, and the fourth sub-housing (294g), the fifth sub-housing (295g), and the sixth sub-housing (296g) arranged parallel to each other, may be folded first with respect to a first folding axis (A), and after being folded first, may be folded second with respect to a second folding axis (B) and a third folding axis (C).

[0072] The multi-foldable structures described in FIGS. 2a and 2b are merely one embodiment, and the various embodiments of this document are not limited thereto. Additionally, in each embodiment, the placement position of the display, the size (or length) of each sub-housing, and / or the folding direction may be configured differently from those depicted.

[0073] According to one embodiment, the electronic device (208) (e.g., the electronic device (101) of FIG. 1) may be an electronic device having a rollable structure (or a slideable structure). For example, the electronic device (208) may include a first sub-housing (291h) and a second sub-housing (292h), and the second sub-housing (292h) may be configured to be movable from the first sub-housing (291h). According to one embodiment, the size of the display area visible from the front of the housing may change as the second sub-housing (292h) moves. The display may be a flexible display in which at least some area may be flexible, foldable, and / or bendable.

[0074] (h) of FIG. 2c indicates the inlet state (or slide-in state) of the electronic device (208), and (i) of FIG. 2c indicates the outlet state (or slide-out state) of the electronic device (208).

[0075] Referring to (h) and (i) of FIG. 2c, the electronic device (208) may include a first sub-housing (291h) (or base housing) and a second sub-housing (292h) (or slide housing). According to one embodiment, the first sub-housing (291h) and the second sub-housing (292h) may be combined so as to be movable within a specified direction and a specified distance.

[0076] Referring to (h) of FIG. 2c, the electronic device (208) is positioned so that the first area (211h) of the display is visible from the front and the second area is received within the housing and faces the rear of the electronic device (208). According to one embodiment, the rear cover may be formed of a transparent or translucent material, and accordingly, when viewed from the rear of the electronic device (208), the second area of ​​the display may be visible through the rear cover.

[0077] According to one embodiment, the first sub-housing (291h) may be movable in the x direction from the second sub-housing (292h). For example, the first sub-housing (291h) may be moved in the x direction from the second sub-housing (292h) depending on the physical force of the user or the force provided by a motor.

[0078] Referring to (i) of FIG. 2c, the electronic device (208) may be positioned so that a third area (212i and 211i) of the display is visible from the front when the device is pulled out. The third area (212i and 211i) may include a first area (212i) exposed to the outside when the device is pulled in, and at least a portion (211i) of a second area that was contained within the housing when the device is pulled in. In the pulled-out state, as at least a portion of the second area is placed on the front of the display, the area exposed through the front of the electronic device (208) becomes wider, and when viewed from the rear of the electronic device (208), there may be no area visible through the rear cover, or only an area narrower than in the pulled-in state may be visible.

[0079] FIG. 2c illustrates a rollable structure in which the display expands or contracts in the horizontal direction (e.g., x direction), but the various embodiments of this document are not limited thereto, and the various embodiments of this document may also be applied to a rollable structure in which it expands or contracts in the vertical direction (e.g., y direction).

[0080] FIG. 3 illustrates an electronic device with a multi-foldable structure according to one embodiment.

[0081] The electronic device (300) of FIG. 3 may represent an electronic device with a G-type foldable structure (e.g., the electronic device (201) of FIG. 2a (a)).

[0082] According to one embodiment, when the electronic device (300) is in a folding state (or a fully folding state), at least a portion of the second display area (320) and the third display area (330) of the display (340) may come into contact with each other based on a second point (or second folding axis) (e.g., B axis) that is folded (e.g., in-folding), and at least a portion of the first display area (310) of the display (340) and the third portion (e.g., third housing (335)) of the housing (e.g., cover) may come into contact with each other based on a first point (or first folding axis) (e.g., A axis).

[0083] According to one embodiment, when the electronic device (300) is in an unfolded state (or fully unfolded state), all display areas (e.g., first display area (310), second display area (320), third display area (330)) of the display (340) are provided as one side (or the entire side), so that the display (340) can be used with a relatively large size.

[0084] According to one embodiment, the electronic device (300) may provide at least one of the plurality of display areas (310, 320, 330) of the display (340) as an area for displaying visual information (or a screen) in an intermediate state (or partially unfolded state). FIG. 3(a) may show a folding state corresponding to a partially folded state (e.g., intermediate state) where the display (340) of the electronic device (300) is less than a certain angle (e.g., about 180 degrees) with respect to a folding axis (or hinge axis or hinge structure) (e.g., a first folding axis (A-axis) and a second folding axis (B-axis)).

[0085] The electronic device (300) may include a housing (350) (or multi-foldable housing) that fixes a display (340) including a first display area (310), a second display area (320), and a third display area (330). The housing (350) may include a first sub-housing (315), a second sub-housing (325), and a third sub-housing (335) that are joined to be rotatable to each other through a hinge structure with respect to a folding axis (e.g., A axis, B axis).

[0086] According to one embodiment, when the electronic device (300) is in a folded state, the first part (301) and the third part (305) may face in opposite directions to the second part (303), and the first part (301) and the third part (305) may face in the same direction. According to one embodiment, when the electronic device (300) is in an unfolded state, the first part (301), the second part (303), and the third part (305) may be formed to face in the same direction.

[0087] According to one embodiment, two folding axes (A-axis, B-axis) of the electronic device (300) may be employed to substantially divide the display (340) into three parts. The electronic device (300) may be folded, unfolded, or bent along the folding axes (A-axis, B-axis).

[0088] According to one embodiment, in the form of the electronic device (300), the electronic device (300) being completely folded (e.g., in a folding state) may mean that any two parts included in the display (340) of the electronic device (300) (e.g., a second display area (320) and a third display area (330)) are facing each other so that the two parts are completely parallel or nearly parallel, and any part of the display (340) (e.g., a first display area (310)) and any part included in the housing (350) (e.g., a third housing (335)) are facing each other so that the two parts are completely parallel or nearly parallel. For example, the electronic device (300) being completely folded may mean that the two parts of the electronic device (300) do not necessarily have to be in contact but are positioned in close proximity.

[0089] According to one embodiment, in the form of the electronic device (300), the electronic device (300) being fully unfolded (e.g., unfolding state) may indicate a state in which the first display area (310), the second display area (320) of the display (340), and the third display area (330) of the display (340) of the electronic device (300) are visually exposed to the outside and form a flat plane like a single display (340), and the area of ​​the display (340) exposed to the outside is the largest or approaches the largest area.

[0090] According to one embodiment, the electronic device (300) may have different directions of folding or bending with respect to each folding axis (A axis, B axis). Accordingly, the electronic device (300) may be folded such that the first display area (310) and the second display area (320) of the display (340) face each other, and the second display area (320) and the third display area (330) face each other.

[0091] According to another embodiment, the electronic device (300) may have the same direction of folding or bending with respect to each folding axis (A axis, B axis).

[0092] According to one embodiment, depending on the position where two folding axes (A-axis, B-axis) are employed on the electronic device (300), the electronic device (300) may be folded or bent asymmetrically with respect to each folding axis (A-axis, B-axis), and even when the electronic device (300) is completely folded with respect to the folding axis (A-axis, B-axis), each display area (310, 320, 330) of the electronic device (300) separated by the folding axes (A-axis, B-axis) may not completely overlap. According to one embodiment, even when the electronic device (300) is equipped with folding axes (A-axis, B-axis), a display (340) may be employed on the front and / or rear of the electronic device (300), and the display (340) may be activated or deactivated.

[0093] According to one embodiment, the electronic device (300) can detect the folding state (or degree of folding) of the electronic device (300) (e.g., folding state, intermediate state, or unfolded state). According to one embodiment, the electronic device (300) can detect the folding state based on a first folding angle based on a folding axis of a first hinge structure (e.g., a first folding axis or an A-axis) and a second folding angle based on a folding axis of a second hinge structure (e.g., a second folding axis or a B-axis). According to one embodiment, the electronic device (300) can detect the folding state and enable or disable at least some display area of ​​the display (340).

[0094] According to one embodiment, when the electronic device (300) detects a folding state, it may disable all display areas of the display (340) (e.g., a first display area (310), a second display area (320), and a third display area (330)). According to one embodiment, when the electronic device (300) detects a folding state, it may enable the display area used by the electronic device (300) (e.g., a first display area (310)) and disable the display area not used (e.g., a second display area (320) and a third display area (330)). According to one embodiment, when the electronic device (300) detects an intermediate state, it may enable / disable at least one display area of ​​the display (340) (e.g., a first display area (310), a second display area (320), and / or a third display area (330)) according to the folding state of the electronic device (300).

[0095] According to one embodiment, the electronic device (300) can determine at least one display area to display an image based on the folding state and the relative position between the electronic device and the external audio device.

[0096] FIG. 4 illustrates various mounting methods of an electronic device according to one embodiment.

[0097] According to one embodiment, the electronic device may be a G-type multi-foldable electronic device (e.g., the electronic device (201) of FIG. 2a (a), the electronic device (300) of FIG. 3).

[0098] According to one embodiment, the electronic device comprises a first sub-housing, a second sub-housing, and a third sub-housing, and according to one embodiment, the first sub-housing and the second sub-housing can be folded in a direction in which the second surfaces face each other with respect to a first folding axis, and the second sub-housing and the third sub-housing can be folded in a direction in which the second surfaces face each other with respect to a second folding axis. A display (or flexible display) may be disposed across the first surface of the first sub-housing, the second sub-housing, and the third sub-housing, and / or across the second surface.

[0099] According to one embodiment, the electronic device can be mounted in various forms in an intermediate state (or partially unfolded state).

[0100] Referring to FIG. 4(a), the electronic device (401) may be in a state where the first sub-housing (491a) and the second sub-housing (492a) are partially folded with respect to the first folding axis (A), and the second sub-housing (492a) and the third sub-housing (493a) are partially folded with respect to the second folding axis (B), and the bottom surface of the electronic device (401) may be mounted on the floor. The display may be positioned on the second surface so that the first display area (411a), the second display area (412a), and the third display area (413a) face each other at a predetermined angle. In this case, the electronic device (401) may display an image through at least a portion of the first display area (411a), the second display area (412a), and the third display area (413a) of the display exposed to the outside.

[0101] Referring to FIG. 4(b), the electronic device (402) is shown in a state where the first sub-housing (491b) and the second sub-housing (492b) are partially folded with respect to the first folding axis (A), and the second sub-housing (492b) and the third sub-housing (493b) are fully folded with respect to the second folding axis (B), with the side of the first sub-housing (491b) and the surface between the second sub-housing (492b) and the third sub-housing (493b) mounted on the floor. A display may be placed on the first surface, in which case the electronic device (402) can display an image through at least a portion of the first display area (491b) and the second display area (492b) of the display exposed to the outside.

[0102] Referring to FIG. 4(c), the electronic device (403) is shown in a state where the first sub-housing (491c) and the second sub-housing (492c) are partially folded with respect to the first folding axis (A), and the second sub-housing (492c) and the third sub-housing (493c) are partially folded with respect to the second folding axis (B), so that the side of the first sub-housing (491c) and the side of the third sub-housing (493c) are adjacent to each other, and the bottom surface of the electronic device (403) is mounted on the floor. A display may be placed on the first surface, and in this case, the electronic device may display an image through at least a portion of the first display area (491c), the second display area (492c), and the third display area (493c) of the display exposed to the outside.

[0103] FIG. 5 is a block diagram of an electronic device according to various embodiments.

[0104] Referring to FIG. 5, an electronic device (500) according to various embodiments may include a display (510), a communication circuit (540), a processor (550), and a memory (560). Various embodiments of this document may be implemented even if some of the illustrated configurations are omitted or replaced with other configurations. In addition to the illustrated configurations, the electronic device (500) may further include at least some of the configurations and / or functions of the electronic device (101) of FIG. 1. At least some of each of the illustrated (or unillustrated) components of the electronic device (500) may be operatively, functionally, and / or electrically connected.

[0105] According to one embodiment, some of the components of the electronic device (500) (e.g., processor (550), memory (560), communication circuit (540)) may be placed inside the housing of the electronic device (500), and some other components (e.g., display (510)) may have at least some of their parts exposed outside the housing.

[0106] According to one embodiment, the electronic device (500) may be an electronic device (500) having a multi-foldable structure (or foldable structure). Here, the multi-foldable structure may be a structure having three or more display areas distinguishable by two or more folding axes. According to one embodiment, the housing of the electronic device (500) includes a plurality of sub-housings that are rotatably coupled to each other, and a display (510) may be disposed across the sub-housings. The electronic device (500) may be configured as a multi-foldable structure having three display areas distinguished by two folding axes (e.g., a G-type multi-foldable structure of (a) in FIG. 2a, a Z-type multi-foldable structure of (b) in FIG. 2a), but is not limited thereto, and may be configured as a multi-foldable structure described through FIG. 2a and FIG. 2b or various other forms of multi-foldable structures.

[0107] According to another embodiment, the electronic device (500) may be composed of an electronic device (500) having a foldable structure having two display areas separated by a single folding axis.

[0108] According to another embodiment, the electronic device (500) may be an electronic device having a rollable structure (or a slideable structure) (e.g., the electronic device (208) of FIG. 2c).

[0109] According to one embodiment, the display (510) can display various images provided by the processor (550). For example, the display (510) may be implemented as any one of a liquid crystal display (LCD), a light-emitting diode (LED) display, an organic light-emitting diode (OLED) display, a micro electro mechanical systems (MEMS) display, or an electronic paper display, but is not limited thereto. The display (510) may be configured as a touch screen that detects touch and / or proximity touch (or hovering) input using a part of the user's body (e.g., a finger) or an input device (e.g., a stylus pen). The display (510) may include at least some of the configurations and / or functions of the display module (160) of FIG. 1.

[0110] According to one embodiment, the display (510) may be composed of a flexible display in which at least some area may be flexible, foldable, and / or bendable. When the electronic device (500) is composed of a multi-foldable structure, the display (510) may be displayed across a plurality of sub-housings (e.g., a first sub-housing (291a), a second sub-housing (292a), and a third sub-housing (293a) of FIG. 2a (a)), and may include a plurality of display areas formed on each sub-housing and separated by a folding axis. According to one embodiment, the display (510) may include a first display area disposed on a first sub-housing, a second display area disposed on a second sub-housing rotatably coupled to the first sub-housing through a first folding axis, and a third display area disposed on a third sub-housing rotatably coupled to the second sub-housing through a second folding axis.

[0111] According to one embodiment, the communication circuit (540) may include various configurations to support wireless communication with an external device. For example, the electronic device (500) may perform cellular wireless communication (e.g., 4G LTE (long term evolution), 5G NR (new radio)) and / or short-range wireless communication (e.g., Wi-Fi, Bluetooth) through the communication circuit (540), and there is no fixed type of wireless communication supported by the electronic device (500). The communication circuit (540) may include at least some of the configurations and / or functions of the communication module (190) of FIG. 1.

[0112] According to one embodiment, the memory (560) may include volatile memory and non-volatile memory and may store various data temporarily or permanently. The memory (560) may include at least some of the configuration and / or functions of the memory (130) of FIG. 1 and may store the program (140) of FIG. 1.

[0113] According to one embodiment, the memory (560) can store various instructions that can be executed by the processor (550). Such instructions may include control commands such as arithmetic and logical operations, data movement, and / or input / output that can be recognized by the processor (550).

[0114] According to one embodiment, the processor (550) may be configured to perform operations or data processing regarding the control and / or communication of each component of the electronic device (500), and may be composed of one or more processors. The processor (550) may include at least some of the configuration and / or functions of the processor (120) of FIG. 1.

[0115] According to one embodiment, there are no limitations on the computational and data processing functions that the processor (550) can implement on the electronic device (500); however, this document describes various embodiments for determining the relative position of the electronic device (500) and an external audio device, and controlling video playback through display areas of the display (510) based on the relative position and the folding angle of the electronic device (500). The operations of the processor (550) described below can be performed by loading instructions stored in the memory (560).

[0116] In this document, the description that a processor (550) can perform a certain operation (or function, task, or operation) may be interpreted substantially as meaning that an instruction (or command, computer program) causing the electronic device (500) (or processor (550)) to perform said operation is stored in memory (560) (e.g., non-volatile memory, storage). Additionally, the description that a processor (550) can perform a certain operation may be interpreted substantially as meaning that at least one processor, without a fixed number, can perform said operation.

[0117] According to one embodiment, the processor (550) can establish a short-range wireless communication connection with an external audio device using a communication circuit (540). The processor (550) can establish a short-range wireless communication connection with an external audio device through a defined pairing and authentication process. The external audio device is a device capable of providing audio information to the user by outputting an audio signal when worn by the user, and may be earbuds, but is not limited thereto. Various types of devices that can be worn on the user's ears or head and provide audio output and short-range wireless communication functions, such as headphones, hearing aids, earrings, headbands, smart glasses, or HMD (head mounted display) devices, may be implemented as the external audio device of this document.

[0118] According to one embodiment, an electronic device (500) can transmit an audio signal to an external audio device using short-range wireless communication through a communication circuit (540). The audio signal may include audio information of an L (left) channel and audio information of an R (right) channel. In addition, the electronic device (500) and the external audio device may transmit and receive various signals (or information, data), such as microphone signals of the external audio device, audio playback control signals, wireless communication connection status and pairing-related information, synchronization information of EQ (equalizer) settings and audio settings, battery status, and / or sensor information of the external audio device, in addition to the audio signal. In this document, short-range wireless communication between the electronic device (500) and the external audio device will be described as Bluetooth, but is not limited thereto. For example, standard technologies such as Wi-Fi Direct and UWB (ultra-wide band) or various non-standard technologies may be utilized.

[0119] According to one embodiment, the processor (550) can determine at least one display area capable of displaying an image among a plurality of display areas of the display (510). Depending on the folding state or mounting state of the electronic device (500), there may be a display area among the display areas of the display (510) that is not exposed for viewing by a user. For example, when the electronic device (500) is fully folded, a display area placed inside is not exposed to the outside, and when a user mounts a specific display area on the floor, that display area may not be exposed to the outside. Depending on the folding state and / or mounting state, the processor (550) can determine at least one display area among the display areas capable of displaying an image.

[0120] According to one embodiment, the processor (550) can determine the relative position between the electronic device (500) and the external audio device based on a signal (e.g., Bluetooth signal) transmitted and received with the external audio device via a short-range wireless communication connection (e.g., Bluetooth connection). Here, the relative position may include at least one of the distance or direction between the electronic device (500) and the external audio device. The processor (550) can determine the direction in which the external audio device is located relative to the electronic device based on the short-range wireless communication signal.

[0121] According to one embodiment, the processor (550) can obtain angle of direction information between the electronic device (500) and an external audio device based on an angle of arrival (AoA) method or an angle of departure (AoD) method based on a short-range wireless communication signal (e.g., a Bluetooth signal). A method for obtaining angle of direction information based on a short-range wireless communication signal will be described in more detail with reference to FIG. 9.

[0122] According to one embodiment, the processor (550) can obtain distance information from an external audio device using phase-based ranging (PBR) and / or round-trip time (RTT) based on a short-range wireless communication signal. A method for obtaining distance information based on a short-range wireless communication signal will be described in more detail with reference to FIG. 8.

[0123] According to one embodiment, the processor (550) can determine the arrangement of a plurality of sub-housings. Here, in the case of an electronic device with a foldable or multi-foldable structure (e.g., the electronic devices of FIG. 2a or FIG. 2b), the arrangement of the sub-housings may be determined according to the folding angle between adjacent sub-housings. Also, in the case of an electronic device with a rollable structure (e.g., the electronic device of FIG. 2c), it may be determined according to the distance at which one sub-housing is spaced from the inside to the outside of another sub-housing.

[0124] According to one embodiment, the processor (550) can determine at least a portion of the display area to display an image based on the relative position between the electronic device (500) and the external audio device, and the arrangement of the sub-housings.

[0125] According to one embodiment, if the electronic device (500) is an electronic device with a multi-foldable structure, the processor (550) can determine the folding angle between adjacent sub-housings among a plurality of sub-housings. The electronic device (500) may include a sensor (e.g., Hall sensor, gyroscope) capable of sensing the folding angle for each folding axis. The processor (550) can determine the current folding state of the electronic device (500) based on the folding angle of each folding axis.

[0126] According to one embodiment, the processor (550) can determine the mounting form of the electronic device (500). Here, the mounting form may be determined by the display area exposed to the outside when the electronic device (500) is mounted on the floor, the direction in which each display area faces, and / or the folding angle of each folding axis. Various mounting forms of the electronic device (500) have been described through FIG. 4.

[0127] According to one embodiment, the processor (550) can display an image through at least one of a plurality of display areas of the display (510) based on the relative position between the electronic device (500) and the external audio device, and the folding angle (or folding state) between the sub-housings. Additionally, the processor (550) can adjust or control an audio signal transmitted to the external audio device based on the relative position between the electronic device (500) and the folding angle (or folding state) between the sub-housings.

[0128] According to one embodiment, the processor (550) may pause or resume the playback of the video based on the relative position and / or folding angle between the electronic device (500) and the external audio device while displaying the video through at least one display area. For example, the processor (550) may pause the playback of the video and audio if it determines that the user's position, determined by the relative position and folding angle, has moved to a position where the user cannot view the video being displayed, and may resume the playback of the video and audio if it determines that the user has moved to a position where the video can be viewed again.

[0129] According to one embodiment, the processor (550) determines a viewing range for at least one display area among a plurality of display areas that is currently displaying an image based on a folding state, determines whether the external audio device is located within the determined viewing range based on the direction between the electronic device (500) and the external audio device, and can pause the playback of the image through the at least one display area if the electronic device (500) is not located within the determined viewing range. The electronic device (500) can pause the playback of the image through the at least one display area if the distance between the electronic device (500) and the external audio device is greater than or equal to a reference distance. For example, the electronic device (500) checks whether the relative position of the external audio device falls within the viewing range for at least one display area that is currently displaying an image, and can pause the playback of the image if it does not fall within the viewing range. Afterward, if the external audio device moves and enters the viewing range for the display area, the electronic device (500) can resume the playback of the image.

[0130] The present embodiment will be described in more detail through FIGS. 10 to 12.

[0131] According to one embodiment, the processor (550) may determine at least one display area among the display areas of the display (510) to display an image based on the relative position and / or folding angle between the electronic device (500) and the external audio device. For example, while the processor (550) is displaying an image through a specific display area, if a user wearing the external audio device moves to the field of view of another display area, the processor (550) may display an image through that display area.

[0132] According to one embodiment, the processor (550) determines the mounting form of the electronic device (500) and, based on the mounting form and folding angle, can determine at least one display area among a plurality of display areas to display an image. The processor (550) determines the field of view of each of the plurality of display areas and, based on the relative position between the electronic device (500) and the external audio device, determines at least one display area having a field of view to which the external audio device belongs, and can display an image through the determined at least one display area.

[0133] According to one embodiment, the processor (550) can disable the display of an image through the first display area and display the image through the second display area when the external audio device is within the field of view of the first display area among the display areas of the display (510) and the external audio device moves out of the field of view of the first display area and is within the field of view of the second display area among the display areas.

[0134] This embodiment will be described in more detail through FIGS. 13 and FIGS. 14.

[0135] According to one embodiment, the processor (550) can adjust the audio signal based on the relative position between the electronic device (500) and the external audio device. For example, the processor (550) can determine at least one of the directionality or perspective of the audio signal to be transmitted to the external audio device. The processor (550) can impart directionality and / or perspective to the audio signal by adjusting the volume of the audio signal of the L channel and / or the audio signal of the R channel based on the direction angle and distance at which the electronic device (500) is located from the external audio device.

[0136] This embodiment will be described in more detail with reference to FIGS. 15 and FIGS. 16.

[0137] According to one embodiment, the processor (550) can establish a wireless communication connection (e.g., Bluetooth connection) with a plurality of external audio devices using a communication circuit (540) and determine the relative position between the electronic device (500) and each of the plurality of external audio devices. Based on the relative position of each of the plurality of external audio devices, the electronic device (500) can determine a display area for displaying an image corresponding to each of the plurality of external audio devices.

[0138] This embodiment will be described in more detail through FIGS. 17 and FIGS. 18.

[0139] According to one embodiment, if the electronic device (500) is a rollable electronic device, the processor (550) can determine the degree to which the sub-housing is slid out. For example, when the first sub-housing is fully retracted into the second sub-housing, a relatively narrow display area of ​​the display (510) is exposed through the front, and the remaining display area may face the rear of the electronic device (500). The rear cover of the electronic device (500) may be transparent or translucent, so that the user can view the respective display areas through the front and rear when retracted. As the first sub-housing is withdrawn from the second sub-housing, the display area of ​​the display (510) exposed through the front may become wider, and the display area facing the rear may become narrower.

[0140] According to one embodiment, the processor (550) may determine at least a portion of the display area for displaying an image based on the relative position between external audio devices and / or the arrangement of sub-housings (e.g., the length of the slide-out). For example, when the user is positioned at the front of the electronic device (500) in the retracted state, the processor (550) may display an image through a display area facing the front of the display (510), and when the user is positioned at the rear of the electronic device (500), the processor (550) may display an image through a display area facing the rear of the display (510).

[0141] Instructions for performing the operation of the electronic device (500) (or processor (550)) described above may be stored in a computer-readable recording medium. The recording medium may be tangible and non-transitory. The recording medium may store one or more computer programs containing the instructions.

[0142] FIG. 6 is a block diagram of software modules of an electronic device according to one embodiment.

[0143] Each of the illustrated blocks (610, 620, 630, 640, 650, 660) may be software modules that can be executed by a processor of an electronic device (e.g., processor (550) of FIG. 5). Each software module (610, 620, 630, 640, 650, 660) may include an independent program unit that performs a specific function and may perform a defined function within the system by interacting with the hardware of the electronic device or interacting with other software modules.

[0144] According to one embodiment, a wireless communication unit (640) can control operations related to short-range wireless communication (e.g., Bluetooth) with an external audio device. For example, the wireless communication unit (640) can perform various operations related to establishing a connection with an external audio device, transmitting and receiving wireless signals, and processing the transmitted and received wireless signals.

[0145] According to one embodiment, a distance and direction angle processing unit (650) can measure distance information and direction angle with respect to an external audio device. For example, the distance and direction angle processing unit (650) can obtain distance information and direction angle information between an electronic device and an external audio device based on signals transmitted and received with the external audio device via a short-range wireless communication connection. For example, the distance and direction angle processing unit (650) can obtain direction angle information between the electronic device and the external audio device based on an angle of arrival (AoA) method or an angle of departure (AoD) method based on a short-range wireless communication signal (e.g., a Bluetooth signal), and can obtain distance information with respect to the external audio device using phase-based ranging (PBR) and / or round-trip time (RTT).

[0146] According to one embodiment, a folding detection unit (660) can determine the folding angle between adjacent sub-housings among a plurality of sub-housings of an electronic device. The electronic device may include a sensor (e.g., Hall sensor, gyroscope) capable of sensing the folding angle for each folding axis, and the folding detection unit (660) can detect the folding angle of each folding axis based on sensing data received from said sensor.

[0147] According to one embodiment, a display selection unit (610) can determine at least one display area among a plurality of display areas of a display to display an image. The display selection unit (610) can determine at least one display area to display an image based on the relative position and / or folding angle between an electronic device and an external audio device. For example, while an image is being displayed through a specific display area, if a user wearing an external audio device moves to a different display area's field of view, the display selection unit (610) can select a display area that belongs to the field of view after the move.

[0148] According to one embodiment, the display selection unit (610) determines the mounting form of the electronic device and, based on the mounting form and folding angle, can determine at least one display area among a plurality of display areas to display an image.

[0149] According to one embodiment, a video replay control unit (620) may control the playback of video to pause or resume based on the relative position and / or folding angle between an electronic device and an external audio device. The video replay control unit (620) may pause the playback of video and audio if it is determined that the user's position, determined by the relative position and folding angle, has moved to a position where the user cannot view the video being displayed, and may resume the playback of video and audio if it is determined that the user has moved to a position where the user can view the video again.

[0150] According to one embodiment, an audio control unit (630) can perform control operations on an audio signal, such as sound localization control, volume control, and / or pause / resume of the audio signal, based on the relative position between the electronic device and the external audio device. For example, the audio control unit (630) can impart directionality and / or perspective to the audio signal by adjusting the volume of the audio signal of the L channel and / or the audio signal of the R channel based on the directional angle and distance from the external audio device to which the electronic device is located.

[0151] FIG. 7 is a flowchart of a method for controlling video playback based on the relative position of an electronic device with respect to an audio device according to various embodiments.

[0152] According to one embodiment, the illustrated method may be performed by an electronic device (e.g., the electronic device (500) of FIG. 5), and the technical features described above may be omitted from the description below.

[0153] According to one embodiment, in operation 710, the electronic device can establish a short-range wireless communication connection with an external audio device. For example, the electronic device can establish a short-range wireless communication connection (e.g., Bluetooth) with an external audio device (e.g., earbuds) using a communication circuit (e.g., communication circuit (540) of FIG. 5).

[0154] According to one embodiment, in operation 720, the electronic device can determine the relative position between the electronic device and the external audio device. Here, the relative position between the electronic device and the external audio device may include at least one of the distance or direction between the electronic device and the external audio device.

[0155] According to one embodiment, an electronic device can determine the relative position (e.g., direction and distance) between the electronic device and an external audio device based on a short-range wireless communication signal (e.g., Bluetooth signal) transmitted and received between the electronic device and the external audio device. For example, the electronic device can obtain direction angle information between the electronic device and the external audio device based on an angle of arrival (AoA) method or an angle of departure (AoD) method based on the short-range wireless communication signal. Additionally, the electronic device can obtain distance information to the external audio device using phase-based ranging (PBR) and / or round-trip time (RTT) based on the short-range wireless communication signal.

[0156] According to one embodiment, the electronic device can determine the arrangement of sub-housings. For example, in an electronic device of a multi-foldable structure, the folding angle between adjacent sub-housings can be determined with respect to each folding axis.

[0157] According to one embodiment, the electronic device can be controlled to display an image through at least one of a plurality of display areas based on a confirmed relative position and a folding angle between adjacent sub-housings among a plurality of sub-housings of the electronic device's housing.

[0158] According to one embodiment, in operation 730, the electronic device can control the pause or resume of video and / or audio based on a identified relative position.

[0159] According to one embodiment, the electronic device determines a viewing range for at least one display area among a plurality of display areas that is currently displaying an image based on a folding state, determines whether the external audio device is located within the determined viewing range based on the direction between the electronic device and the external audio device, and may pause the playback of the image through the at least one display area if the electronic device is not located within the determined viewing range. The electronic device may pause the playback of the image through the at least one display area if the distance between the electronic device and the external audio device is greater than or equal to a reference distance. For example, the electronic device may check whether the relative position of the external audio device falls within the viewing range of the at least one display area currently displaying an image, and may pause the playback of the image if it does not fall within the viewing range. Subsequently, if the external audio device moves and enters the viewing range of the display area, the electronic device may resume the playback of the image. The present embodiment will be described in more detail with reference to FIGS. 10 to 12.

[0160] According to one embodiment, in operation 740, the electronic device can determine a display area of ​​a display to display a video based on a confirmed relative position.

[0161] According to one embodiment, the electronic device determines the mounting form of the electronic device and, based on the mounting form and folding angle, determines at least one display area among a plurality of display areas to display an image. The electronic device determines the field of view of each of the plurality of display areas and, based on the relative position between the electronic device and an external audio device, determines at least one display area having a field of view to which the external audio device belongs, and can display an image through the determined at least one display area. The present embodiment will be described in more detail with reference to FIGS. 13 and 14.

[0162] According to one embodiment, in operation 750, the electronic device can adjust the audio signal based on the identified relative position.

[0163] According to one embodiment, the electronic device may determine at least one of the directionality or perspective of an audio signal to be transmitted to an external audio device based on the relative position between the electronic device and the external audio device. For example, the electronic device may correct the audio signal of the L channel and / or the audio signal of the R channel based on the directional angle and distance from the external audio device to which the electronic device is located. The present embodiment will be described in more detail with reference to FIGS. 15 and 16.

[0164] According to one embodiment, instructions for performing each operation constituting the method may be stored on a computer-readable recording medium. The recording medium may be tangible and non-transitory. The recording medium may store one or more computer programs containing said instructions.

[0165] FIG. 8 illustrates a method for measuring the distance between an electronic device and an external audio device through signals transmitted and received with an external audio device according to one embodiment.

[0166] According to one embodiment, an electronic device (e.g., the electronic device (500) of FIG. 5) may be connected to an external audio device via short-range wireless communication. The electronic device transmits an audio signal to the external audio device via short-range wireless communication, and the external audio device may output the received audio signal.

[0167] According to one embodiment, the external audio device may be earbuds, but is not limited thereto, and various types of devices that can be worn on a user's ear or head and provide audio output and short-range wireless communication functions, such as headphones, hearing aids, earrings, headbands, smart glasses, or HMD (head mounted display) devices, may be implemented as the external audio device of this document.

[0168] In this document, short-range wireless communication between an electronic device and an external audio device is described as Bluetooth, but is not limited thereto. For example, standard technologies such as Wi-Fi Direct and UWB (ultra-wide band), or various non-standard technologies, may be utilized.

[0169] Bluetooth 6.0 introduced channel sounding technology to calculate the distance between two devices. Channel sounding is a technology that measures the distance between transmitting and receiving devices by analyzing frequency changes that occur during the transmission of wireless signals. Through channel sounding, electronic devices can measure the distance between an external audio device connected via Bluetooth and the electronic device by utilizing phase-based ranging (PBR) and round-trip time (RTT).

[0170] FIG. 8(a) illustrates two frequency band signals transmitted from a first device (810) (or initiator) (e.g., electronic device (500)) to a second device (820) (or reflector) (e.g., external audio device) for phase-based range designation (PBR).

[0171] According to the PBR method, when the first device (810) transmits two or more signals with different frequencies to the second device (820), the second device (820) returns the signals to the first device (810), and the first device (810) can calculate the difference in phase between the two signals using the returned signals. When a wireless signal is transmitted at a specific frequency, the phase of the signal is related to the distance between the two devices, and when using signals of multiple frequency bands, it is possible to calculate the distance precisely by comparing the phase changes of the signals.

[0172] Mathematical formula 1 is a mathematical formula for calculating the distance between two devices in the PBR method.

[0173] [Mathematical Formula 1]

[0174]

[0175] Here, f1 and f2 are the frequency bands of the two signals, c is the speed of light, (P f2 -P f1 ) can be the phase difference between the two signals, and (f2-f1) can be the frequency difference between the two signals.

[0176] Figure 8(b) illustrates a method using round-trip time (RTT).

[0177] The RTT method may be a method for calculating the distance between two devices using the time it takes for a packet to be returned from the second device (820) after the first device (810) transmits the packet to the second device (820). When transmitting a wireless signal, it may move according to the speed of light, which is a known constant, and the distance between the two devices can be calculated by calculating the time it takes for the packet to travel between the two devices.

[0178] Mathematical formula 2 is a mathematical formula for calculating the distance between two devices in the RTT method.

[0179] [Mathematical Formula 2]

[0180]

[0181] Here, c is the speed of light, and ToF can be the bidirectional time of flight of the packet.

[0182] According to one embodiment, the electronic device can calculate the distance between the electronic device and an external audio device based on at least one of a PBR method or an RTT method using a short-range wireless communication signal (e.g., a Bluetooth signal). The distance calculation method is not limited thereto, and various distance measurement methods may be utilized, such as distance measurement based on the received signal strength indicator (RSSI) of the wireless signal, distance measurement based on an inertial sensor, or distance measurement based on a camera image.

[0183] FIG. 9 illustrates a method for measuring the direction between an electronic device and an external audio device through signals transmitted and received with an external audio device according to one embodiment.

[0184] Bluetooth 5.1 provides direction finding technology to calculate the direction between two devices. Direction finding is a technology that can obtain information on the direction of arrival by calculating the phase difference of signals between different antenna array elements through an antenna array and using a signal angle estimation algorithm.

[0185] Figure 9 (a) illustrates the angle of arrival (AoA), a method for calculating the direction angle of a signal, and Figure 9 (b) illustrates the angle of departure (AoD).

[0186] Referring to FIG. 9(a), the first device (910) (or transmitter) can transmit a direction finding signal using a single antenna, and the second device (920) (or receiver) can receive the direction finding signal using a plurality of antenna arrays. The second device (920) can calculate the phase difference of the signal received from each antenna array through a location engine, and can calculate the direction angle of the distance between the first device (910) and the second device (920) using the phase difference. For example, when the signal received by the second device (920) passes through the antenna array, a phase difference may occur due to the difference in physical position between the antennas, and the second device (920) can analyze this phase difference to calculate the direction in which the signal arrives (e.g., azimuth angle, elevation angle).

[0187] Referring to FIG. 9(b), the first device (910) (or transmitter) can transmit a wireless signal through antenna arrays at fixed positions and receive the wireless signal at the second device (920) (or receiver) which has a single antenna. The second device (920) can determine the direction of the first device (910) that transmitted the wireless signal by calculating the direction of the outgoing wave of the wireless signal based on the received wireless signal. For example, the antenna array of the first device (910) can form a specific radiation pattern by emitting signals at different time intervals from each antenna element when transmitting the wireless signal, and the second device (920) can estimate the direction from which the wireless signal originated by comparing and analyzing the characteristics of the received wireless signal with the transmitted pattern.

[0188] According to one embodiment, the electronic device can determine the direction of an external audio device to the electronic device using an AoD and / or AoA method using a short-range wireless communication signal (e.g., Bluetooth signal).

[0189] FIG. 10 is a flowchart of a method for an electronic device according to one embodiment to pause and resume playback of an image.

[0190] According to one embodiment, the illustrated method may be performed by an electronic device (e.g., the electronic device (500) of FIG. 5), and the technical features described above may be omitted from the description below.

[0191] According to one embodiment, in operation 1010, the electronic device can establish a wireless connection with an external audio device. For example, the electronic device can establish a short-range wireless communication connection (e.g., Bluetooth) with an external audio device (e.g., earbuds) using a communication circuit (e.g., communication circuit (540) of FIG. 5).

[0192] According to one embodiment, in operation 1020, the electronic device can check the folding state of the electronic device and / or a change in its relative position with respect to an external audio device. Here, the relative position between the electronic device and the external audio device may include direction and distance. For example, when a user wearing an external audio device moves while the electronic device is mounted in a specific position, the relative position (e.g., direction, distance) between the electronic device and the external audio device may change. Additionally, the folding state of the electronic device may change when the user folds or unfolds adjacent sub-housings with respect to at least one of the folding axes of the electronic device.

[0193] According to one embodiment, in operation 1030, the electronic device can acquire direction angle information (θ) between the electronic device and the external audio device. According to one embodiment, the electronic device can determine the direction angle between the electronic device and the external audio device based on signals transmitted and received through a wireless communication connection with the external audio device. For example, the electronic device can acquire direction angle information between the electronic device and the external audio device based on an angle of arrival (AoA) method or an angle of departure (AoD) method based on a short-range wireless communication signal. A method for acquiring direction angle information based on a short-range wireless communication signal has been described above through FIG. 9.

[0194] According to one embodiment, in operation 1040, the electronic device can obtain distance information (d) between the electronic device and an external audio device. According to one embodiment, the electronic device can determine the distance between the electronic device and the external audio device based on signals transmitted and received through a wireless communication connection with the external audio device. For example, the electronic device can obtain distance information with the external audio device using phase-based ranging (PBR) and / or round-trip time (RTT) based on a short-range wireless communication signal. A method for obtaining distance information based on a short-range wireless communication signal has been described above through FIG. 9.

[0195] According to one embodiment, in operation 1050, the electronic device can determine whether the relative position of an external audio device falls within a field of view for at least one display area currently displaying an image. Here, the field of view may include a range of orientation angles at which a user can view the screen of at least one display area displaying an image, and a range of distances at which the user can perceive the content of the screen. For example, the electronic device can determine whether the orientation angle information (θ) obtained in operation 1030 is outside the orientation angle threshold of the display area displaying the image, and / or whether the distance information (d) obtained in operation 1040 is greater than the distance threshold from the display area displaying the image.

[0196] According to one embodiment, the viewing range for at least one display area among a plurality of display areas of a display that is displaying an image can be determined by the folding state and mounting form of the electronic device. For example, when the electronic device is in an unfolded state and is displaying an image using the entire display area of ​​the display, the orientation angle threshold may be relatively large because the image can be viewed from the side as well; conversely, when the device is partially folded with respect to at least one folding axis, the orientation angle threshold may be relatively small because the angle at which a user can view a specific display area is reduced by the folding. Additionally, if the mounting form of the electronic device changes, the range of the orientation angle that the user can view may change.

[0197] According to one embodiment, if, as a result of checking operation 1050, the direction angle information (θ) deviates from the viewing angle threshold of the display area displaying the image, and / or the distance information (d) is greater than the distance threshold from the display area displaying the image, in operation 1060, the electronic device may pause the playback of the image being displayed through the display area. Additionally, the electronic device may pause the playback of the audio signal being output through an external audio device.

[0198] According to one embodiment, the electronic device may pause the output of the image, disable the display, or display a screen in a paused state. Additionally, the electronic device may transmit an audio notification instructing the pause of the image to an external audio device.

[0199] According to one embodiment, if, as a result of checking operation 1050, the electronic device finds that the direction angle information (θ) is within the viewing angle threshold of the display area displaying the image, and the distance information (d) is within the distance threshold from the display area displaying the image, the electronic device can resume playback of the image and audio signals.

[0200] According to one embodiment, in operation 1070, the electronic device can check whether the current state is a paused state. If the current state is a paused state, in operation 1080, the electronic device can resume playback of an image through the display area of ​​the display and playback of an audio signal through an external audio device. If the current state is not a paused state, the electronic device can maintain the playback of an image and playback of an audio signal through an external audio device.

[0201] According to one embodiment, instructions for performing each operation constituting the method may be stored on a computer-readable recording medium. The recording medium may be tangible and non-transitory. The recording medium may store one or more computer programs containing said instructions.

[0202] FIG. 11 illustrates a field of view according to a mounting method of an electronic device according to one embodiment.

[0203] According to one embodiment, an electronic device (e.g., the electronic device (500) of FIG. 5) can determine a viewing range for at least one display area displaying an image based on the mounting form of the electronic device and the folding angle of at least one folding axis of the electronic device. Here, the viewing range may include a range of directional angles at which a user can view the screen of at least one display area displaying an image and a range of distances at which the user can perceive the content of the screen.

[0204] FIG. 11 illustrates the field of view determined according to each mounting type and folding state.

[0205] According to one embodiment, the field of view (or direction angle threshold) corresponding to the reference range in which a user wearing an external audio device can view an image may change depending on the change in the folding state of the electronic device.

[0206] Referring to FIG. 11 (a), the electronic device (110) includes a first sub-housing (1191a), a second sub-housing (1192a), and a third sub-housing (1193a), and the display may be positioned across the first sub-housing (1191a), the second sub-housing (1192a), and the third sub-housing (1193a) in the a-axis direction. The first sub-housing (1191a) and the second sub-housing (1192a) may be coupled to be rotatable relative to each other in the a-axis direction with respect to the first folding axis (A), and the second sub-housing (1192a) and the third sub-housing (1193a) may be coupled to be rotatable relative to each other in the a-axis direction with respect to the second folding axis (B).

[0207] The electronic device (110) of FIG. 11 (a) may be in a state where the first sub-housing (1191a) and the second sub-housing (1192a) are partially folded (e.g., intermediate state) with respect to the first folding axis (A), and the second sub-housing (1192a) and the third sub-housing (1193a) are partially folded with respect to the second folding axis (B), with the bottom surfaces of each sub-housing mounted on the floor. In this case, the electronic device (110) can display images through the first display area (1111a), the second display area (1112a), and the third display area (1113a).

[0208] In a mounting form and folding state such as (a) of FIG. 11, the field of view (or directional angle threshold) may be determined to be -60 degrees to +60 degrees relative to the a-axis. In such a mounting form and folding state, if a user wearing an external audio device (e.g., earbuds) is located outside of -60 degrees, it may be difficult to see the first display area (1111a), and if the user is located outside of +60 degrees, it may be difficult to see the third display area (1113a).

[0209] According to one embodiment, the field of view (or direction angle threshold) may change depending on the change in the folding state. For example, if the folding angle between the first sub-housing (1191a) and the second sub-housing (1192a) with respect to the first folding axis (A) becomes narrower, the field of view may have an upper limit of a value lower than +60 degrees, and if the folding angle between the second sub-housing (1192a) and the third sub-housing (1193a) with respect to the second folding axis (B) becomes narrower, the field of view may have a lower limit of a value higher than -60 degrees.

[0210] According to one embodiment, the electronic device (110) may pause the playback of video and / or audio signals when the user moves out of the field of view range of -60 degrees to +60 degrees in a mounted form and folded state such as (a) of FIG. 11, and / or may display the video only through a portion of the display areas that the user's field of view can reach.

[0211] Referring to FIG. 11 (b), the display of the electronic device (1102) may be arranged across the first sub-housing (1191b), the second sub-housing (1192b), and the third sub-housing (1193b) in the b-axis direction. The first sub-housing (1191b) and the second sub-housing (1192b) may be joined so as to be rotatable with respect to the first folding axis (A) in the direction opposite to the b-axis, and the second sub-housing (1192b) and the third sub-housing (1193b) may be joined so as to be rotatable with respect to the second folding axis (B) in the direction opposite to the b-axis.

[0212] In a mounting form and folding state such as (b) of Fig. 11, the field of view range (or direction angle threshold) can be determined to be -110 degrees to +110 degrees relative to the b-axis.

[0213] Comparing (a) and (b) of Fig. 11, when the folding state of the electronic device changes, the field of view may change, and the electronic device can control the playback of video and / or audio based on the field of view determined according to the folding state.

[0214] According to one embodiment, the field of view (or direction angle threshold) corresponding to the reference range in which a user wearing an external audio device can view an image may change depending on changes in the mounting state of the electronic device.

[0215] Referring to Fig. 11 (c), the electronic device (1103) may be in a state where the first sub-housing (1191c) and the second sub-housing (1192c) are partially folded with respect to the first folding axis (A), and the second sub-housing (1192c) and the third sub-housing (1193c) are partially folded with respect to the second folding axis (B), so that the side of the first sub-housing (1191c) and the side of the third sub-housing (1193c) are adjacent to each other, and the bottom surface of the electronic device (1103) is mounted on the floor.

[0216] In a mounting state such as (c) of FIG. 11, the viewing range (or direction angle threshold) of the first display area (1111c) can be determined to be 0 to 120 degrees with respect to the c-axis, the viewing range of the second display area (1112c) can be determined to be 120 to 240 degrees, and the viewing range of the third display area (1113c) can be determined to be 240 to 360 degrees.

[0217] According to one embodiment, when the relative position of an external audio device changes according to the movement of a user while the electronic device is displaying an image through a specific display area, the changed position can display the image through a display area that falls within the field of view.

[0218] When the third display area of ​​the display is mounted on the floor by changing the mounting state as in (d) of FIG. 11, the third display area becomes invisible to the user, and the viewing range of the first display area (1111d) and the second display area (1112d) may differ. For example, the viewing range of the first display area (1111d) may be 0 to 180 degrees based on the d-axis, and the viewing range of the second display area (1112d) may be determined to be 180 to 360 degrees based on the d-axis.

[0219] Comparing (c) and (d) of Fig. 11, the field of view may change when the mounting state of the electronic device changes, and the electronic device can control the playback of video and / or audio based on the field of view determined according to the mounting state.

[0220] FIG. 12 illustrates a method for pausing and resuming video playback according to the movement of a user according to one embodiment.

[0221] According to one embodiment, an electronic device (1200) (e.g., the electronic device (500) of FIG. 5) can determine a field of view for at least one display area among a plurality of display areas that is playing an image based on the folding angle of the electronic device (1200). Here, the field of view may include a direction angle and a distance based on the display area of ​​the electronic device (1200). The electronic device (1200) can determine whether the external audio device is located within the determined field of view based on the direction between the electronic device (1200) and the external audio device. If the electronic device (1200) is not located within the determined field of view, the electronic device (1200) can pause the playback of the image through at least one display area.

[0222] Referring to FIG. 12, the electronic device (1200) may be in a state where each sub-housing is partially folded inward (e.g., the folded state of FIG. 11 (a)) with its bottom surface mounted on the floor. The electronic device (1200) may be in a state where it is displaying an image through display areas of a display positioned on the front. The viewing range of the display may include a range of directional angles in which a user can view the screen of at least one display area displaying the image, and a range of distances sufficient for the user to recognize the content of the screen.

[0223] According to one embodiment, the electronic device (1200) can determine the relative position (e.g., direction and distance) between the electronic device (1200) and the external audio device based on a short-range wireless communication signal (e.g., Bluetooth signal) transmitted and received between the electronic device (1200) and the external audio device.

[0224] According to one embodiment, when a user wearing an external audio device moves to the side and the direction of the external audio device is detected outside the field of view of the display (1), the electronic device (1200) may pause the display of an image through the display area of ​​the display and / or the output of an audio signal through the external audio device. In this case, the electronic device (1200) may pause the output of the image, disable the display, or display a screen in a paused state.

[0225] According to one embodiment, when the user moves to the center and the direction of the external audio device is detected again within the field of view of the display (2), the electronic device (1200) can resume the display of an image through the display area of ​​the display and / or the output of an audio signal through the external audio device.

[0226] According to one embodiment, when a user moves away from the electronic device (1200) and the distance to the external audio device is detected to be greater than a distance threshold (3), the electronic device (1200) may pause the display of an image through the display area of ​​the display and / or the output of an audio signal through the external audio device.

[0227] FIG. 13 is a flowchart of a method for determining a display area where an electronic device displays an image according to one embodiment.

[0228] According to one embodiment, the illustrated method may be performed by an electronic device (e.g., the electronic device (500) of FIG. 5), and the technical features described above may be omitted from the description below.

[0229] According to one embodiment, in operation 1320, the electronic device can determine at least one display area available depending on the folding state and / or mounting state of the electronic device. For example, the electronic device can determine at least one display area that can be seen by a user from the outside, excluding a display area that is not exposed to the outside by folding or is mounted on a floor and is not exposed to the outside among a plurality of display areas of the display.

[0230] According to one embodiment, in operation 1330, the electronic device can determine a viewing range for each display area. For example, as described through FIG. 11, the electronic device can determine a range of directional angles at which a user can view the screen of at least one display area displaying an image and a range of distances at which the user can recognize the screen content, depending on the folding state and / or mounting state of the electronic device.

[0231] According to one embodiment, in operation 1340, the electronic device can obtain direction angle information between the electronic device and the audio device. For example, the electronic device can obtain direction angle information between the electronic device and the external audio device based on an angle of arrival (AoA) method or an angle of departure (AoD) method based on a short-range wireless communication signal.

[0232] According to one embodiment, in operation 1350, the electronic device can determine whether the directional angle between the electronic device and the external audio device is within the viewing angle of any of the multiple display areas of the display. According to one embodiment, some of the viewing ranges of the multiple display areas that are adjacent to each other may overlap each other, and if the external audio device is located in the overlapping area, it can be determined that two or more display areas are within the user's viewing range.

[0233] According to one embodiment, in operation 1360, the electronic device can determine whether the display area where the external audio device is located changes. For example, when a user wearing the external audio device moves, the electronic device can obtain directional angle information between the electronic device and the external audio device based on a short-range wireless communication signal and determine whether the user has moved from the field of view of a specific display area to the field of view of another display area.

[0234] According to one embodiment, when the display area is changed, in operation 1370, the electronic device may display an image through the identified display area. For example, the electronic device may stop displaying an image through the display area that was within the field of view before the external audio device moved, and display an image through the display area that is within the field of view after the movement.

[0235] According to one embodiment, if the display area is not changed, in operation 1380, the electronic device can maintain the current display area.

[0236] According to one embodiment, instructions for performing each operation constituting the method may be stored on a computer-readable recording medium. The recording medium may be tangible and non-transitory. The recording medium may store one or more computer programs containing said instructions.

[0237] FIG. 14 illustrates a method for determining a display area to display an image according to the movement of a user according to one embodiment.

[0238] According to one embodiment, an electronic device (e.g., the electronic device (500) of FIG. 5) can determine the viewing range of each of a plurality of display areas of a display. Based on the relative position (e.g., direction angle, distance) between the electronic device and an external audio device, the electronic device can determine at least one display area having a viewing range to which the external audio device belongs, and can display an image through the determined display area.

[0239] According to one embodiment, in the case of an electronic device with a multi-foldable structure, depending on the folding state and / or mounting form, the display areas of the display may be integrated to display an image, or each display area may be used independently. When multiple display areas are used independently, the direction angle information of the electronic device and the external audio device is used to check whether a user wearing the external audio device moves out of the field of view of the display area currently displaying the image and enters the field of view of another display area, and the display area to play the image may be changed to that display area.

[0240] Referring to FIG. 14 (a), the electronic device (1400) may be in a state where the first sub-housing and the second sub-housing are partially folded with respect to the first folding axis (A), and the second sub-housing and the third sub-housing are partially folded with respect to the second folding axis (B), so that the side of the first sub-housing and the side of the third sub-housing are adjacent to each other, and the bottom surface of the electronic device (1400) may be mounted on the floor. In this case, the first display area (1411a), the second display area (1412a), and the third display area (1413a) are all exposed to the outside, and the field of view in which a user can see each display area may be determined.

[0241] According to one embodiment, if the user is located within the field of view of the first display area (1411a) as a result of confirming using a short-range wireless communication signal transmitted and received with an external audio device (1) (1), the electronic device (1400) can play an image through the first display area (1411a). Afterward, if the user moves and is located within the field of view of the second display area (1412a) (2), the electronic device can stop displaying the image through the first display area (1411a) and continue displaying the image through the second display area (1412a). In this case, the electronic device (1400) can disable the remaining display areas excluding the display area within the user's field of view.

[0242] Figure 14 (b) shows the third display area of ​​the display mounted on the floor, so that the third display area is not visible to the user, and the user can view the image through the first display area (1411b) and the second display area (1412b).

[0243] According to one embodiment, when a user is located within the field of view of a first display area (1411b) as a result of confirming using a short-range wireless communication signal transmitted and received with an external audio device (1411b) (1), the electronic device (1400) can play an image through the first display area (1411b). Afterwards, when the user moves and is located within the field of view of a second display area (1412b) (2), the electronic device (1400) can stop displaying the image through the first display area (1411b) and continue displaying the image through the second display area (1412b).

[0244] FIG. 15 is a flowchart of a method for an electronic device to control an audio signal according to one embodiment.

[0245] According to one embodiment, the illustrated method may be performed by an electronic device (e.g., the electronic device (500) of FIG. 5), and the technical features described above may be omitted from the description below.

[0246] According to one embodiment, in operation 1510, the electronic device can obtain direction angle information between the electronic device and an external audio device. For example, the electronic device can obtain direction angle information between the electronic device and an external audio device based on an angle of arrival (AoA) method or an angle of departure (AoD) method based on a short-range wireless communication signal (e.g., Bluetooth signal).

[0247] According to one embodiment, in operation 1520, the electronic device can obtain distance information between the electronic device and an external audio device. For example, the electronic device can obtain distance information with the external audio device using phase-based ranging (PBR) and / or round-trip time (RTT) based on a short-range wireless communication signal.

[0248] According to one embodiment, in operation 1530, the electronic device can determine the location of an external audio device. Based on the direction angle information obtained in operation 1510 and the distance information obtained in operation 1520, the electronic device can determine the relative location of the external audio device to the electronic device.

[0249] According to one embodiment, in operation 1540, the electronic device may change the position and / or volume information of each audio channel according to the identified position. For example, the audio signal may include an audio signal of the L (left) channel and an audio signal of the R (right) channel output through the user's left ear from an external audio device.

[0250] According to one embodiment, the electronic device can correct the audio signal of the L channel and / or the audio signal of the R channel based on the directional angle and distance at which the electronic device is located from an external audio device. For example, if the electronic device is located to the left of the external audio device, the volume of the audio signal of the L channel can be increased, and if the electronic device is located to the right of the external audio device, the volume of the audio signal of the R channel can be increased. Additionally, if the electronic device is located close to the external audio device, the volume of the audio signals of the L channel and the R channel can be increased, and if the electronic device is located far from the external audio device, the volume of the audio signals of the L channel and the R channel can be decreased.

[0251] According to one embodiment, in operation 1550, the electronic device may transmit the modified audio signal to an external audio device for output. In this way, by adjusting the audio signals of the L channel and R channel and outputting them through the external audio device, the user may feel a sense of direction and / or perspective regarding the audio signal.

[0252] According to one embodiment, instructions for performing each operation constituting the method may be stored on a computer-readable recording medium. The recording medium may be tangible and non-transitory. The recording medium may store one or more computer programs containing said instructions.

[0253] FIG. 16 illustrates a method for controlling an audio signal according to the movement of a user according to one embodiment.

[0254] According to one embodiment, an electronic device (e.g., the electronic device (500) of FIG. 5) can determine at least one of the directionality or perspective of an audio signal to be transmitted to an external audio device based on the relative position between the electronic device and the external audio device. The electronic device can adjust the size of at least one of the L channel or R channel of the audio signal based on at least one of the determined directionality or perspective.

[0255] According to one embodiment, the electronic device (1600) can obtain direction angle information and distance information between the electronic device (1600) and the external audio device based on a short-range wireless communication signal (e.g., Bluetooth signal) transmitted and received with the external audio device.

[0256] According to one embodiment, the electronic device (1600) can increase the volume of audio signals of the L channel and R channel when the distance between the electronic device (1600) and an external audio device connected via short-range wireless communication becomes shorter, and decrease the volume of audio signals of the L channel and R channel when the distance becomes longer. Accordingly, a sense of perspective can be provided based on the distance between the electronic device (1600) and the external audio device.

[0257] According to one embodiment, the electronic device (1600) can process an audio signal such that the direction in which the sound is heard changes according to the directional angle in which the external audio device is located relative to the display. For example, the electronic device (1600) can increase the volume of the audio signal of the L channel when the electronic device is located to the left of the external audio device, and increase the volume of the audio signal of the R channel when the electronic device (1600) is located to the right of the external audio device.

[0258] Referring to FIG. 16, the electronic device (1600) can display images through a first display area, a second display area, and a third display area while mounted on the floor, and transmit audio signals to an external audio device.

[0259] As shown in FIG. 16 (a), when an external audio device is located close to the electronic device (1600), the electronic device can increase the volume of the audio signals of the L channel and R channel and transmit them to the external audio device.

[0260] As shown in FIG. 16 (b), when an external audio device is far away from the electronic device (1600), the electronic device (1600) can reduce the volume of the audio signals of the L channel and R channel and transmit them to the external audio device. The electronic device (1600) can stop transmitting the audio signals when the external audio device is farther away than a critical distance.

[0261] As shown in Fig. 16 (c), when an external audio device is located to the right of the electronic device (1600), the electronic device (1600) can amplify the audio signal of the R channel and transmit it to the external audio device. Accordingly, the user of the external audio device can sense direction from the sound coming from the right.

[0262] As shown in Fig. 16 (d), when an external audio device is located to the left of the electronic device (1600), the audio signal of the L channel can be amplified and transmitted to the external audio device. Accordingly, the user of the external audio device can sense direction from the sound coming from the left.

[0263] FIG. 17 is a flowchart of a method for determining a display area in which an electronic device according to one embodiment displays images of a plurality of external audio devices.

[0264] According to one embodiment, the illustrated method may be performed by an electronic device (e.g., the electronic device (500) of FIG. 5), and the technical features described above may be omitted from the description below.

[0265] According to one embodiment, in operation 1710, the electronic device can determine a display area corresponding to each user's location depending on the folding state of the electronic device.

[0266] According to one embodiment, an electronic device can establish a short-range wireless communication connection (e.g., Bluetooth connection) with each of a plurality of audio devices worn by different users, and can determine the relative position (e.g., direction and distance) between the electronic device and each of the audio devices based on short-range wireless signals (e.g., Bluetooth signals) transmitted and received with each of the audio devices.

[0267] According to one embodiment, the electronic device may determine at least one display area that can be seen by a user from the outside, excluding a display area among a plurality of display areas of the display that is not exposed to the outside by folding or is mounted on a floor and is not exposed to the outside. The electronic device may determine a viewing range for each display area. For example, depending on the folding state and / or mounting state of the electronic device, the range of the directional angle at which a user can view the screen of at least one display area displaying an image and the range of distance at which the user can perceive the screen content may be determined.

[0268] According to one embodiment, the electronic device can determine a display area of ​​a display corresponding to the user's position of each audio device based on the relative position of the audio device worn by each user.

[0269] According to one embodiment, in operation 1720, the electronic device may display an image corresponding to each user in each display area. For example, for a user of a first audio device located in the direction facing the first display area, an image of the first content selected by the user may be displayed through the first display area so that the user can watch the first content selected by the user, and for a user of a second audio device located in the direction facing the second display area, an image of the second content selected by the user may be displayed through the second display area so that the user can watch the second content selected by the user.

[0270] According to one embodiment, in operation 1730, the electronic device can transmit audio corresponding to an image displayed on each user's audio device. For example, if the first audio device is located within the field of view of the first display area, the electronic device can transmit an audio signal of the first content to the first audio device at least partially simultaneously with displaying an image of the first content through the first display area. Additionally, if the second audio device is located within the field of view of the second display area, the electronic device can transmit an audio signal of the second content to the second audio device at least partially simultaneously with displaying an image of the second content through the second display area.

[0271] According to one embodiment, the electronic device may stop displaying an image through a corresponding display area when the position of at least one of a plurality of audio devices moves out of the field of view of the currently corresponding display area.

[0272] According to one embodiment, when the position of at least one of a plurality of audio devices is moved to be located within the field of view of another display area, the electronic device can display an image corresponding to the user of the audio device through a display area corresponding to the position after the move. For example, when a first audio device and a second audio device are located within the field of view of a first display area and a second display area, respectively, and users move so that the first audio device is located within the field of view of the second display area and the second audio device is located within the field of view of the first display area, the electronic device can display an image of the first content that was displayed in the first display area through the second display area and display an image of the second content that was displayed in the second display area through the first display area.

[0273] According to one embodiment, instructions for performing each operation constituting the method may be stored on a computer-readable recording medium. The recording medium may be tangible and non-transitory. The recording medium may store one or more computer programs containing said instructions.

[0274] FIG. 18 illustrates a method for determining a display area based on the location of external audio devices according to one embodiment.

[0275] According to one embodiment, an electronic device (1800) (e.g., the electronic device (500) of FIG. 5) can establish a wireless communication connection (e.g., Bluetooth connection) with a plurality of external audio devices using a communication circuit and determine the relative position between the electronic device (1800) and each of the plurality of external audio devices. Based on the relative position of each of the plurality of external audio devices, the electronic device (1800) can determine a display area to display an image corresponding to each of the plurality of external audio devices.

[0276] According to one embodiment, in the case of an electronic device (1800) with a multi-foldable structure, depending on the folding state and / or mounting form, the display areas of the display may be integrated to display an image, or each display area may be used independently. When multiple display areas are used independently, the direction angle information of the electronic device (1800) and the external audio device is used to check whether a user wearing the external audio device moves out of the field of view of the display area currently displaying the image and enters the field of view of another display area, and the display area to play the image may be changed to the corresponding display area.

[0277] According to one embodiment, when a plurality of audio devices worn by a plurality of users are connected to an electronic device (1800) having a multi-foldable structure, the electronic device (1800) can determine a display area to display an image corresponding to each user based on the position (or direction) of each user.

[0278] Referring to FIG. 18, the electronic device (1800) may be in a state where the first sub-housing and the second sub-housing are partially folded with respect to the first folding axis (A), and the second sub-housing and the third sub-housing are partially folded with respect to the second folding axis (B), so that the side of the first sub-housing and the side of the third sub-housing are adjacent to each other, and the bottom surface of the electronic device (1800) (1400) is mounted on the floor. In this case, the first display area (1411a), the second display area (1412a), and the third display area (1413a) are all exposed to the outside, and the field of view in which a user can see each display area can be determined.

[0279] According to one embodiment, if the electronic device (1800) determines, using a short-range wireless communication signal transmitted and received with the first audio device, that the first user is located within the field of view of the first display area (1811a), the electronic device (1800) can play an image of the first content selected by the first user through the first display area (1811a). Additionally, the electronic device (1800) can transmit an audio signal of the first content to the first audio device.

[0280] According to one embodiment, if the electronic device (1800) determines, using a short-range wireless communication signal transmitted and received with the second audio device, that the second user is located within the field of view of the second display area (1812a), the electronic device (1800) can play an image of the second content selected by the second user through the second display area (1812a). Additionally, the electronic device (1800) can transmit an audio signal of the second content to the second audio device.

[0281] According to one embodiment, the electronic device (1800) may change the display area displaying the image of the user when the first user or the second user moves and is located within the field of view of a display area other than the display area currently displaying the image. For example, when the first user moves and is located within the field of view of the second display area (1812a) and the second user moves and is located within the field of view of the first display area (1811a), the electronic device (1800) may display the image of the first content that was displayed in the first display area (1811a) through the second display area (1812a) and display the image of the second content that was displayed in the second display area (1812a) through the first display area (1811a).

[0282] An electronic device according to various embodiments of the present document may include a housing comprising a plurality of sub-housings, a display disposed on the housing and having a display area that can change to display an image in correspondence with the arrangement of the sub-housings, a communication circuit, a memory, and at least one processor.

[0283] According to one embodiment, the memory may be executed by at least one processor, and at the time of execution, the electronic device may use the communication circuit to establish a wireless communication connection with an external audio device, determine a relative position between the electronic device and the external audio device based on a signal transmitted and received through the wireless communication connection, verify the arrangement of the sub-housings, determine at least a portion of the display area to display an image based on the relative position between the electronic device and the external audio device and the arrangement of the sub-housings, and store instructions to display an image through the determined at least portion of the display area.

[0284] According to one embodiment, the sub-housings are joined so as to be rotatable relative to each other with respect to each folding axis, and the display is formed on each sub-housing and may include a plurality of display areas separated relative to each folding axis.

[0285] According to one embodiment, the memory may store instructions that allow the electronic device to determine the folding angle between adjacent sub-housings among the sub-housings, and determine at least one display area among the plurality of display areas to display the image based on the relative position between the electronic device and the external audio device and the folding angle between the sub-housings.

[0286] According to one embodiment, the memory may store instructions for the electronic device to determine a viewing range for at least one display area among the plurality of display areas that is playing an image based on the folding angle, to determine whether the external audio device is located within the determined viewing range based on the direction between the electronic device and the external audio device, and to pause the playback of the image through the at least one display area if the electronic device is not located within the determined viewing range.

[0287] According to one embodiment, the memory may store instructions for the electronic device to determine a mounting form of the electronic device and, based on the mounting form and the folding angle, determine at least one display area among the plurality of display areas to display an image.

[0288] According to one embodiment, the memory may store instructions for the electronic device to determine a field of view for each of the plurality of display areas, determine at least one display area having a field of view to which the external audio device belongs based on a relative position between the electronic device and the external audio device, and display an image through the determined at least one display area.

[0289] According to one embodiment, the memory may store instructions for the electronic device to disable the display of an image through the first display area and display the image through the second display area when, while the external audio device is in the field of view of the first display area among the display areas, the external audio device moves out of the field of view of the first display area and is in the field of view of the second display area among the display areas.

[0290] According to one embodiment, the display may include a first display area disposed on a first sub-housing, a second display area disposed on a second sub-housing rotatably coupled to the first sub-housing through a first folding axis, and a third display area disposed on a third sub-housing rotatably coupled to the second sub-housing through a second folding axis.

[0291] According to one embodiment, the housing includes a first sub-housing and a second sub-housing configured to be movable from the first sub-housing, and the display may change the size of the display area visible from the front of the housing as the second sub-housing moves.

[0292] According to one embodiment, the memory may store instructions that cause the electronic device to pause the playback of an image through at least a portion of the display area of ​​the display when the distance between the electronic device and the external audio device is greater than or equal to a reference distance.

[0293] According to one embodiment, the memory may store instructions that cause the electronic device to temporarily suspend the transmission of an audio signal to the external audio device when the distance between the electronic device and the external audio device is greater than or equal to a reference distance.

[0294] According to one embodiment, the memory may store instructions that allow the electronic device to determine at least one of the directionality or perspective of an audio signal to be transmitted to the external audio device based on the relative position between the electronic device and the external audio device.

[0295] According to one embodiment, the memory may store instructions that cause the electronic device to adjust the size of at least one of the L channel or R channel of the audio signal based on at least one of the determined directionality or perspective.

[0296] According to one embodiment, the memory may store instructions for the electronic device to establish a wireless communication connection with a plurality of external audio devices using the communication circuit, to determine a relative position between the electronic device and each of the plurality of external audio devices, and to determine a display area for displaying an image corresponding to each of the plurality of external audio devices based on the relative position of each of the plurality of external audio devices.

[0297] According to one embodiment, the relative position between the electronic device and the external audio device may include at least one of the distance or direction between the electronic device and the external audio device.

[0298] An electronic device according to various embodiments of the present document may include a housing comprising a plurality of sub-housings, a display disposed on the housing and comprising a plurality of display areas, wherein the directions in which the plurality of display areas face each other may differ based on the arrangement of the sub-housings, a communication circuit, a memory, and at least one processor.

[0299] According to one embodiment, the memory may be executed by at least one processor, and at the time of execution, the electronic device may use the communication circuit to establish a wireless communication connection with an external audio device, determine the direction in which the external audio device is located relative to the electronic device based on a signal transmitted and received through the wireless communication connection, determine the direction in which each of the plurality of display areas faces based on the arrangement of the sub-housings, determine at least a portion of the display areas facing the direction in which the external audio device is located based on the direction in which each of the plurality of display areas faces, and store instructions to display the image through the determined at least a portion of the display areas.

[0300] According to one embodiment, the sub-housings are coupled to be rotatable relative to each other with respect to each folding axis, the display is formed on each of the sub-housings and includes a plurality of display areas separated relative to each of the folding axis, and the memory can store instructions that allow the electronic device to check the folding angle between adjacent sub-housings among the sub-housings and determine the direction in which each of the plurality of display areas faces based on the folding angle between the sub-housings.

[0301] According to one embodiment, the memory may store instructions for the electronic device to determine a viewing range for at least one display area among the plurality of display areas that is playing an image based on the direction in which each of the plurality of display areas is facing, to determine whether the external audio device is located within the determined viewing range based on the direction in which the external audio device is located, and to pause the playback of the image through the at least one display area if the electronic device is not located within the determined viewing range.

[0302] According to one embodiment, the memory may store instructions for the electronic device to determine a field of view for each of the plurality of display areas, determine at least one display area having a field of view to which the external audio device belongs based on the direction in which the external audio device is located, and display an image through the determined at least one display area.

[0303] According to one embodiment, the memory may store instructions that allow the electronic device to establish a Bluetooth connection with the external audio device using the communication circuit, and determine the direction in which the external audio device is located based on Bluetooth signals transmitted and received between the external audio device and the electronic device.

[0304] In a method performed by an electronic device according to various embodiments of the present document, the electronic device may include a housing comprising a plurality of sub-housings and a display disposed on the housing, wherein a display area for displaying an image may be changed in correspondence with the arrangement of the sub-housings.

[0305] According to one embodiment, the method may include: establishing a wireless communication connection with an external audio device; determining a relative position between the electronic device and the external audio device based on a signal transmitted and received through the wireless communication connection; confirming the arrangement of the sub-housings; determining at least a portion of the display area for displaying an image based on the relative position between the electronic device and the external audio device and the arrangement of the sub-housings; and displaying the image through the determined at least portion of the display area.

[0306] The electronic device according to the various embodiments disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this document is not limited to the devices described above.

[0307] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as “coupled” or “connected” to another (e.g., 2nd) component, with or without the terms “functionally” or “communicationly,” it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.

[0308] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0309] Various embodiments of the present document may be implemented as software (e.g., program (140)) comprising one or more instructions stored in a storage medium (e.g., internal memory (136) or external memory (138)) readable by a machine (e.g., electronic device (101)). For example, a processor (e.g., processor (120)) of the machine (e.g., electronic device (101)) may call at least one of the one or more instructions stored in the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.

[0310] According to one embodiment, the method according to the various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or an application store (e.g., Play Store). TM It can be distributed online (e.g., downloaded or uploaded) through ) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0311] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In an electronic device, Housing including multiple sub-housings; A display disposed on the above housing, wherein the display area for displaying an image can be changed in correspondence with the arrangement of the above sub-housings; Communication circuit; Memory for storing multiple instructions; and It includes at least one processor, When the above instructions are executed by the at least one processor, the electronic device, Using the above communication circuit, a wireless communication connection is established with an external audio device, and Based on signals transmitted and received through the above wireless communication connection, the relative position between the electronic device and the external audio device is determined, and Check the arrangement of the above sub-housings, and Based on the relative position between the electronic device and the external audio device, and the arrangement of the sub-housings, at least a portion of the display area for displaying an image is determined, and An electronic device that displays an image through at least a portion of the display area determined above.

2. In Paragraph 1, The above sub-housings are joined so as to be rotatable relative to each other with respect to their respective folding axes, and The above display is formed on each of the sub-housings and includes a plurality of display areas separated based on each of the folding axes, and When the above instructions are executed by the at least one processor, the electronic device, Check the folding angle between adjacent sub-housings among the above sub-housings, and An electronic device for determining at least one display area among a plurality of display areas to display an image based on the relative position between the electronic device and the external audio device, and the folding angle between the sub-housings.

3. In Paragraph 2, When the above instructions are executed by the at least one processor, the electronic device, Based on the above folding angle, a viewing range for at least one display area among the plurality of display areas that is playing an image is determined, and Based on the orientation between the electronic device and the external audio device, determine whether the external audio device is located within the determined field of view, and An electronic device that pauses playback of an image through at least one display area when the electronic device is not located within the determined field of view.

4. In Paragraph 2, When the above instructions are executed by the at least one processor, the electronic device, Determining the mounting form of the above electronic device, and An electronic device that determines at least one display area among the plurality of display areas to display an image based on the above mounting form and the above folding angle.

5. In Paragraph 4, When the above instructions are executed by the at least one processor, the electronic device, Determining the viewing range of each of the above plurality of display areas, and Based on the relative position between the electronic device and the external audio device, at least one display area having a field of view to which the external audio device belongs is determined, and Displaying an image through at least one display area determined above, and An electronic device that, when the external audio device is within the field of view of a first display area among the display areas, and the external audio device moves out of the field of view of the first display area and falls within the field of view of a second display area among the display areas, disables the display of an image through the first display area and displays the image through the second display area.

6. In Paragraph 1, The above housing is, It includes a first sub-housing and a second sub-housing configured to be movable from the first sub-housing, and The above display is, A first display area disposed on a first sub-housing, A second display area disposed on a second sub-housing rotatably coupled to the first sub-housing and the first folding axis, and It includes a third display area disposed on a third sub-housing that is rotatably coupled to the second sub-housing and the second folding axis, and As the second sub-housing moves, the size of the display area visible from the front of the housing changes, and An electronic device in which the relative position between the electronic device and the external audio device includes at least one of the distance or direction between the electronic device and the external audio device.

7. In Paragraph 1, When the above instructions are executed by the at least one processor, the electronic device, An electronic device that pauses playback of an image through at least a portion of the display area when the distance between the electronic device and the external audio device is greater than or equal to a reference distance.

8. In Paragraph 1, When the above instructions are executed by the at least one processor, the electronic device, An electronic device that temporarily suspends the transmission of an audio signal to an external audio device when the distance between the electronic device and the external audio device is greater than or equal to a reference distance.

9. In Paragraph 1, When the above instructions are executed by the at least one processor, the electronic device, Based on the relative position between the electronic device and the external audio device, at least one of the directionality or perspective of the audio signal to be transmitted to the external audio device is determined, and An electronic device for adjusting the magnitude of at least one of the L channel or R channel of the audio signal based on at least one of the directionality or perspective determined above.

10. In Paragraph 1, When the above instructions are executed by the at least one processor, the electronic device, Using the above communication circuit, a wireless communication connection is established with a plurality of external audio devices, and Determining the relative position between the electronic device and each of the plurality of external audio devices, and An electronic device that determines a display area for displaying an image corresponding to each of the plurality of external audio devices based on the relative position of each of the plurality of external audio devices.

11. In an electronic device, Housing including multiple sub-housings; A display disposed on the above housing and including a plurality of display areas, wherein the directions in which the plurality of display areas face each other may differ based on the arrangement of the sub-housings; Communication circuit; Memory for storing multiple instructions; and It includes at least one processor, When the above instructions are executed by the at least one processor, the electronic device, Using the above communication circuit, a wireless communication connection is established with an external audio device, and Based on signals transmitted and received through the above wireless communication connection, the direction in which the external audio device is located relative to the electronic device is determined, and Based on the arrangement of the above sub-housings, the direction in which each of the plurality of display areas faces is determined, and Based on the direction in which each of the above plurality of display areas faces, at least a portion of the display area facing the direction in which the external audio device is located is determined, and An electronic device that displays an image through at least a portion of the display area determined above.

12. In Paragraph 11, The above sub-housings are joined so as to be rotatable relative to each other with respect to their respective folding axes, and The above display is formed on each of the sub-housings and includes a plurality of display areas separated based on each of the folding axes, and When the above instructions are executed by the at least one processor, the electronic device, Check the folding angle between adjacent sub-housings among the above sub-housings, and The direction in which each of the plurality of display areas faces is determined based on the folding angle between the sub-housings, and Based on the direction in which each of the plurality of display areas faces, a field of view is determined for at least one display area among the plurality of display areas that is playing an image, and Based on the direction in which the above external audio device is located, Determining whether the above external audio device is located within the determined field of view, and An electronic device that pauses playback of an image through at least one display area when the electronic device is not located within the determined field of view. An electronic device that pauses playback of an image through at least one display area when the electronic device is not located within the determined field of view.

13. In Paragraph 11, When the above instructions are executed by the at least one processor, the electronic device, Determining the viewing range of each of the above plurality of display areas, and Based on the direction in which the external audio device is located, at least one display area having a field of view to which the external audio device belongs is determined, and An electronic device that displays an image through at least one display area determined above.

14. In Paragraph 11, When the above instructions are executed by the at least one processor, the electronic device, Using the above communication circuit, a Bluetooth connection is established with the above external audio device, and An electronic device that determines the direction in which the external audio device is located based on a Bluetooth signal transmitted and received between the external audio device and the electronic device.

15. In a method performed by an electronic device, The above electronic device is, A housing comprising a plurality of sub-housings and a display disposed on the housing, wherein a display area for displaying an image can be changed in correspondence with the arrangement of the sub-housings, and The above method is, The operation of establishing a wireless communication connection with an external audio device; An operation to determine the relative position between the electronic device and the external audio device based on signals transmitted and received through the wireless communication connection; An operation to verify the arrangement of the above sub-housings; An operation to determine at least a portion of the display area for displaying an image based on the relative position between the electronic device and the external audio device and the arrangement of the sub-housings; and A method comprising the operation of displaying the image through at least a portion of the display area determined above.

Images