Electronic device supporting pairing and control method thereof
Patent Information
- Application Number
- PCT/KR2024/013031
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-11-07
- Filing Date
- 2024-08-30
- Publication Date
- 2025-03-06
Smart Images

Figure KR2024013031_06032025_PF_FP_ABST
Abstract
Description
Electronic device supporting pairing and method for controlling the same
[0001] Embodiments of the present disclosure relate to an electronic device supporting pairing and a method for controlling the same.
[0002] The variety of services and additional features offered through electronic devices such as smartphones and portable electronic devices is steadily increasing. To improve the utility of these devices and satisfy the diverse needs of users, telecommunications service providers and electronic device manufacturers are striving to develop electronic devices that offer diverse features and differentiate themselves from competitors. Consequently, the various functions offered through electronic devices are also becoming increasingly sophisticated.
[0003] As electronic devices become more integrated and ultra-high-speed, high-capacity wireless communications become more widespread, electronic devices like mobile terminals can now be equipped with a variety of functions. For example, in addition to communication functions, entertainment features like gaming, multimedia features like music and video playback, communication and security functions for mobile banking, and even functions like schedule management and electronic wallets are being integrated into a single electronic device. These electronic devices are also becoming smaller and more portable for users.
[0004] As mobile communication services expand into the realm of multimedia services, the display size of electronic devices may increase to accommodate users' full use of multimedia services, beyond just voice calls and text messages. Accordingly, a foldable, flexible display may be positioned across the entire housing structure to enable the device to fold, and this foldable, flexible display may have a large display area.
[0005] According to one embodiment, an electronic device may include a display, a communication circuit, at least one sensor, at least one processor electrically connected to the display, the communication circuit, and the at least one sensor, and a memory storing instructions. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to receive information related to an external electronic device from an external electronic device connected to a network via the communication circuit. The instructions, when executed by the at least one processor, may cause the electronic device to determine a folding state of the external electronic device based on the information related to the external electronic device. The instructions, when executed by the at least one processor, may cause the electronic device to determine a folding state of the electronic device via the at least one sensor. The instructions, when executed by the at least one processor, may cause the electronic device to determine a first screen to be displayed on a display of the electronic device and a second screen to be displayed on the external electronic device based on a folding state of the electronic device and a folding state of the external electronic device.
[0006] According to one embodiment, a method for operating an electronic device may include an operation of receiving information related to an external electronic device from an external electronic device connected to a network through a communication circuit of the electronic device. The method for operating the electronic device may include an operation of checking a folding state of the external electronic device based on the information related to the external electronic device. The method for operating the electronic device may include an operation of checking a folding state of the electronic device through at least one sensor of the electronic device. The method for operating the electronic device may include an operation of determining a first screen to be displayed on a display of the electronic device and a second screen to be displayed on the external electronic device based on the folding state of the electronic device and the folding state of the external electronic device.
[0007] According to one embodiment, a non-transitory computer-readable recording medium storing one or more programs may include instructions for causing an electronic device including a display, a communication circuit, at least one sensor, and at least one processor electrically connected to the display, the communication circuit, and the at least one sensor to receive information related to the external electronic device from the external electronic device connected to the network through the communication circuit. The one or more programs may include instructions for causing the electronic device to determine a folding state of the external electronic device based on information related to the external electronic device. The one or more programs may include instructions for causing the electronic device to determine a folding state of the electronic device through at least one sensor of the electronic device. The one or more programs may include instructions for causing the electronic device to determine a first screen to be displayed on a display of the electronic device and a second screen to be displayed on the external electronic device based on the folding state of the electronic device and the folding state of the external electronic device. Advantageously, a user can extend the display of the electronic device to both the electronic device and the external electronic device in a simple and intuitive manner. This improves user convenience and speeds up the speed at which the user can access the extended display. Furthermore, the user does not need to manually align the displays of the two devices, as the electronic device can determine the first screen (for the electronic device) and the second screen (for the external electronic device) based on received or identified distance information and angle / status information related to the two devices. Furthermore, the user does not need to navigate the user interface to manually select the mirroring or extended pairing mode.Instead, users can easily set up pairing mode by adjusting the folding status of one or both of the electronic device and the external electronic device. Pairing mode can be automatically set and provided based on one or more of the following factors: proximity of the two devices, their positions, the angle between them, the angle between them, and the state of the two devices. This allows the pairing mode to be optimized for each situation. Therefore, users can easily set up two devices within an extended display area.
[0008] FIG. 1 is a block diagram of an electronic device within a network environment according to one embodiment.
[0009] FIG. 2 is a block diagram illustrating an electronic device according to one embodiment of the present disclosure.
[0010] FIG. 3A is a flowchart illustrating a pairing operation of an electronic device according to an embodiment of the present disclosure.
[0011] FIG. 3b is a flowchart illustrating a pairing operation of an electronic device according to an embodiment of the present disclosure.
[0012] FIG. 4A is an exemplary drawing showing an unfolded state of an electronic device according to one embodiment of the present disclosure.
[0013] FIG. 4b is an exemplary diagram illustrating a portrait mode and a landscape mode of an electronic device according to an embodiment of the present disclosure.
[0014] FIG. 4c is an exemplary drawing illustrating a standing mode of an electronic device according to one embodiment of the present disclosure.
[0015] FIG. 5A is a diagram for explaining a communication connection establishment operation of an electronic device according to an embodiment of the present disclosure.
[0016] FIG. 5b is a diagram for explaining a pairing operation of an electronic device according to an embodiment of the present disclosure.
[0017] FIG. 5c is a flowchart for explaining a pairing operation of an electronic device according to an embodiment of the present disclosure.
[0018] FIG. 6A is a diagram for explaining a communication connection establishment operation of an electronic device according to an embodiment of the present disclosure.
[0019] FIG. 6b is a diagram for explaining a pairing operation of an electronic device according to an embodiment of the present disclosure.
[0020] FIG. 7A is a flowchart illustrating a pairing operation of an electronic device according to an embodiment of the present disclosure.
[0021] FIG. 7b is a flowchart illustrating a pairing operation of an electronic device according to an embodiment of the present disclosure.
[0022] FIG. 7c is a flowchart for explaining a pairing operation of an electronic device according to an embodiment of the present disclosure.
[0023] FIG. 8 is an exemplary drawing illustrating an input interface displayed through a display of an electronic device according to one embodiment of the present disclosure.
[0024] FIG. 9A is a diagram for explaining a communication connection establishment operation of an electronic device according to an embodiment of the present disclosure.
[0025] FIG. 9b is a diagram for explaining a pairing operation of an electronic device according to an embodiment of the present disclosure.
[0026] FIG. 10 is a drawing for explaining a pairing operation of an electronic device according to an embodiment of the present disclosure.
[0027] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100), according to one embodiment. Referring to FIG. 1 , in the network environment (100), the electronic device (101) may communicate with the electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (104) or the server (108) via a second network (199) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).
[0028] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.
[0029] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.
[0030] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).
[0031] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).
[0032] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
[0033] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.
[0034] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.
[0035] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).
[0036] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
[0037] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
[0038] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0039] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.
[0040] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.
[0041] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).
[0042] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0043] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).
[0044] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.
[0045] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197). In one embodiment, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.
[0046] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).
[0047] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.
[0048] FIG. 2 is a block diagram illustrating an electronic device according to one embodiment of the present disclosure.
[0049] In one embodiment, referring to FIG. 2, an electronic device (101) (e.g., the electronic device (101) of FIG. 1) may include a processor (120) (e.g., the processor (120) of FIG. 1), a display module (160) (e.g., the display module (160) of FIG. 1), a sensor module (e.g., the sensor module (176) of FIG. 1), and a communication module (190) (e.g., the communication module (190) of FIG. 1).
[0050] In one embodiment, the display module (160) may display a screen associated with an application executed by the electronic device (101). The display module (160) may display a different screen associated with the application depending on the folding state of the electronic device (101). That is, since the application screen may be displayed depending on the folding state of the electronic device (101), the use of the visible portion of the display module (160) may be optimized. The folding state of the electronic device (101) may include an open state or a closed state. The open state may include various angles indicating that the electronic device (101) is at least partially unfolded. The operating mode of the electronic device (101) in the open state may include a horizontal mode, a vertical mode, or a standing mode. The display module (160) may be, for example, a touch screen that changes the displayed screen in response to a user input (e.g., a touch event or a voice command).
[0051] In one embodiment, the sensor module (176) may estimate the posture of the electronic device (101). The posture of the electronic device (101) is related to one or more of a position, orientation, or folding angle of the electronic device (101), and indicates how the electronic device (101) is held or supported. The posture of the electronic device (101) may include a posture angle of the electronic device (101). The posture angle of the electronic device (101) may include an angle of a direction of a center of gravity of the electronic device (101) with respect to a direction of gravity. The posture angle of the electronic device (101) may include a plane vector or a line vector corresponding to a folding line of a housing of the electronic device (101). The posture angle of the electronic device (101) may also include a normal vector in a direction perpendicular to at least a portion of a surface of the display module (160).
[0052] In one embodiment, the communication module (190) can establish a communication connection (e.g., a short-range wireless communication connection) with an external electronic device (e.g., at least one of the electronic device (102), the electronic device (104), or the server (108) of FIG. 1). The communication module (190) can include a UWB module that supports positioning of the external electronic device. The communication module (190) can also include a Wi-Fi module that transmits or receives information associated with pairing with the external electronic device via an access point associated with Wi-Fi. The communication module (190) can also include a Bluetooth module (e.g., a BLE module) that supports pairing with the external electronic device.
[0053] In one embodiment, the processor (120) may perform overall operations to provide a multi-view function based on pairing with an external electronic device. The processor (120) may provide an extended view by controlling the external electronic device. The processor (120) may control the display module (160) to display at least a portion of the extended screen associated with an application executed by the electronic device (101). The processor (120) may control the external electronic device to display the remaining portion of the extended screen associated with the application executed by the electronic device (101). The processor (120) may transmit a control message to the external electronic device via the communication module (190) to display the remaining portion of the extended screen through the display module of the external electronic device. The processor (120) may also provide a mirror view by controlling the external electronic device. The processor (120) can control the display module (160) to display a screen associated with an application executed by the electronic device (101). The processor (120) can control an external electronic device to display a screen at least partially identical to the screen associated with the application executed by the electronic device (101). The processor (120) can, for example, transmit a control message to the external electronic device through the display module of the external electronic device via the communication module (190) to display a screen at least partially identical to the screen associated with the application executed by the electronic device (101). The electronic device (101) can determine whether information received from the sensor module (176) and / or the external electronic device satisfies a condition associated with providing an expanded view. The electronic device (101) can improve user convenience by providing an expanded view via the display module (160) and the display module of the external electronic device.That is, the display of the electronic device (101) and the display of the external electronic device can effectively form one large display to improve the user experience.
[0054] In one embodiment, in FIG. 2, for convenience of explanation, the electronic device (101) is illustrated as including only a processor (120), a display module (160), a sensor module (176), and a communication module (190), but those skilled in the art will readily understand that the electronic device (101) of FIG. 2 may further include the components illustrated in FIG. 1.
[0055] FIG. 3A is a flowchart illustrating a pairing operation of an electronic device to an external electronic device according to one embodiment of the present disclosure.
[0056] Referring to FIG. 3A, in operation 301, an electronic device (e.g., at least one of the electronic device (101) of FIG. 1, the electronic device (101) of FIG. 2, the processor (120) of FIG. 1, or the processor (120) of FIG. 2) may transmit a request associated with pairing to an external electronic device (e.g., at least one of the electronic device (102), the electronic device (104), or the server (108) of FIG. 1). That is, the electronic device (101) may transmit a pairing request signal to the external electronic device. The electronic device (101) may be configured to determine whether to provide an expanded view when performing pairing based on a user input. The electronic device (101) may also be configured to provide a mirror view when performing pairing based on a user input. When the electronic device (101) is set to provide a mirror view during pairing, the mirror view can be provided based on establishing a communication connection with the external electronic device without operations 305 and 307. That is, when the electronic device (101) is paired with the external electronic device and operates in mirror view mode, operations 305 and 307 may not be performed. The electronic device (101) can identify a user input for activating the multi-view function. That is, the electronic device (101) can receive a user input through an input means, wherein the user input indicates the user's intention to activate the multi-view function. In response to receiving a user input for activating the multi-view function, the electronic device (101) can identify at least one external electronic device whose physical distance from the electronic device (101) is less than or equal to a threshold value. That is, when a user input for activating the multi-view function is received by the electronic device (101), the electronic device (101) can search for at least one external electronic device that is near the electronic device (101) or within a set distance. The electronic device (101) searches for an external electronic device with which the electronic device (101) can be paired.The electronic device (101) can identify at least one external electronic device, for example, through a short-range wireless communication module (for example, at least one of a Wi-Fi module, a Bluetooth module, and / or a UWB module). The electronic device (101) can provide a user with a list associated with the identified at least one external electronic device. That is, the electronic device (101) can provide a user with a list including one or more external electronic devices identified during the external electronic device search. The list can be limited to external electronic devices with which the electronic device (101) can be paired. For example, the list may not include external electronic devices with which the electronic device (101) cannot be paired. The electronic device (101) can provide a user with a list associated with the identified at least one external electronic device, for example, through at least one of the display module (160), the audio output module (155), or the haptic module (179). That is, the electronic device (101) can identify or detect a user input for selecting one or more external electronic devices from a list of external electronic devices, wherein the selection of one or more external electronic devices indicates the user's intention to pair the electronic device (101) with the selected external electronic devices. The user input can be received by an input means. The input means can be the same input means that received the initial input for activating the multi-view function, or can be a different input means. The electronic device (101) can identify a user input associated with the selection of an external electronic device to perform pairing. Based on (or in response to) the user input associated with the selection of the external electronic device, the electronic device (101) can identify identification information of the external electronic device corresponding to the user input. That is, in response to a user input for selecting one or more external electronic devices from a list of external electronic devices, the electronic device (101) can obtain identification information associated with the selected external device.The electronic device (101) may obtain identification information by using a database, receiving an identification information signal from a selected external electronic device, or receiving an identification information signal from another external electronic device (e.g., a server). The identification information signal from the selected external electronic device or another external electronic device may be received in response to the electronic device (101) transmitting an identification information request signal to the selected external electronic device or another external electronic device. The electronic device (101) may transmit a request associated with pairing to the identified external electronic device via (or using) a communication module (e.g., the communication module (190) of FIG. 1). That is, the electronic device may transmit a pairing request signal to the identified (or selected) external electronic device.
[0057] According to one embodiment, in operation 303, the electronic device (101) may receive a response from an external electronic device. The electronic device (101) may establish a communication connection with the external electronic device based on (or in response to) receiving the response (or response signal) from the external electronic device. That is, the response signal received by the electronic device (101) from the external electronic device may include information related to the state of the external electronic device, and the electronic device may identify such information. The electronic device (101) may determine information related to the state of the external electronic device from the response. The electronic device (101) may determine the distance between the electronic device (101) and the external electronic device. In one embodiment, after establishing a communication connection with the external electronic device, the electronic device (101) may determine (or determine, calculate, obtain, or receive) the distance between the electronic device (101) and the external electronic device. The electronic device (101) can determine the distance between the electronic device (101) and the external electronic device through a positioning function supported by, for example, a UWB module included in the communication module (190). The UWB module can exchange positioning information with the UWB module of the external electronic device through a plurality of antennas included in the electronic device (101). The UWB module can determine the distance between the electronic device (101) and the external electronic device based on a PDoA (phase difference of arrival) algorithm, but those skilled in the art will readily understand that the present invention is not limited thereto. In one embodiment, the electronic device (101) can determine the angular difference between the electronic device (101) and the external electronic device based on the information included in the response. The electronic device (101) can determine the angular difference between the attitude angle of the electronic device (101) and the attitude angle of the external electronic device. The electronic device (101) can determine the attitude angle of the electronic device (101) based on information determined by the sensor module (176).The electronic device (101) can determine the attitude angle of the external electronic device based on information included in a response signal received from the external electronic device. In one embodiment, the electronic device (101) can determine the folding state of the external electronic device based on the information included in the response. For example, the electronic device (101) can determine whether the folding state of the external electronic device is open or closed based on the information included in the response. The electronic device (101) can determine the range of the open or closed state of the external electronic device based on the information included in the response. That is, the electronic device (101) can determine the folding angle of the external electronic device based on the information included in the response. The electronic device (101) can determine whether the folding state of the external electronic device is in any one of a landscape mode, a portrait mode, or a standing mode among the open states. In one embodiment, the electronic device (101) can determine information associated with at least one type of an input interface of the external electronic device. Information associated with the type of an input interface corresponding to an external electronic device may include integer label information. The integer label information may be a binary code indicating the type of the input interface of the external electronic device. Based on the label information, the electronic device (101) may determine whether the type of the input interface corresponding to an application executed by the electronic device (101) matches the type of the input interface displayed by the external electronic device. The information associated with the type of the input interface corresponding to the external electronic device is not limited to the examples described above. For example, the information associated with the type of the input interface corresponding to the external electronic device may be transmitted to the electronic device (101) in the form of a binary code.In one embodiment, after operation 303, the electronic device (101) may transmit information associated with a state of the electronic device (101) to an external electronic device, and may also receive information associated with a state of the external electronic device from the external electronic device. The electronic device (101) may perform a positioning operation using a UWB module, and transmit information associated with a state of the electronic device (101) including one or more of distance data, sensor data, attitude information, or input interface information to the external electronic device. The electronic device (101) may use a short-range communication module (for example, at least one of a UWB module, a Wi-Fi module, or a Bluetooth module) to transmit the information associated with the state to the external electronic device. The electronic device (101) may transmit and receive (or exchange) information related to the state of the electronic device (101) and information related to the state of the external electronic device, thereby checking information related to at least one of the distance between the electronic device (101) and the external electronic device, the angular difference between the electronic device (101) and the external electronic device, the folding state of the external electronic device, or the type of the input interface of the external electronic device.
[0058] According to one embodiment, in operation 305, the electronic device may determine whether the first folding state and the second folding state satisfy the first condition. The electronic device may determine whether the first folding state of the electronic device (101) and the second folding state of the external electronic device satisfy the first condition for displaying an expanded screen, for example, based on information included in the response and information confirmed by the sensor module (176). The electronic device (101) may determine that the first condition is satisfied, for example, based on determining that the folding states of both the electronic device (101) and the external electronic device are in a standing mode. The electronic device (101) may determine that the first condition is not satisfied, for example, based on determining that the folding state of either the electronic device (101) or the external electronic device is not in a standing mode.
[0059] According to one embodiment, based on the confirmation that the first condition is satisfied (operation 305 - Yes), in operation 307, the display module (160) may be controlled to display at least a portion of the expanded screen, and the external electronic device may be controlled to display the remaining portion of the expanded screen. The electronic device (101) may improve user convenience by providing an expanded view through the display module (160) and the display module of the external electronic device.
[0060] In one embodiment, based on determining that the first condition is not satisfied (Operation 305 - No), in operation 309, the external electronic device can be controlled to display a screen that is at least partially identical to the screen displayed on the display module (160). The electronic device (101) can provide a mirror view based on determining that the condition for providing an expanded view is not satisfied.
[0061] FIG. 3b is a flowchart illustrating a pairing operation of an electronic device according to an embodiment of the present disclosure.
[0062] Referring to FIG. 3B, in operation 321, an electronic device (e.g., at least one of the electronic device 101 of FIG. 1, the electronic device 101 of FIG. 2, the processor 120 of FIG. 1, or the processor 120 of FIG. 2) may receive information related to an external electronic device from an external electronic device. The electronic device may receive information related to the external electronic device from the external electronic device connected to the network through a communication circuit (e.g., the communication module 190 of FIG. 1 or 2). The electronic device may receive information related to the external electronic device from the external electronic device connected through a short-range wireless communication network. Short-range wireless communication methods supported by the short-range wireless communication network may include, but are not limited to, Wi-Fi communication, Bluetooth, and / or UWB communication. The electronic device may receive information related to the external electronic device based on (i.e., utilizing) a communication connection connected to the external electronic device through the communication circuit. Information associated with the external electronic device may include, but is not limited to, at least one of information for measuring a distance between the electronic device and the external electronic device, information associated with a posture angle of the external electronic device, information associated with a posture angle between external electronic devices, information associated with a folding state of the external electronic device, or information associated with a type of input interface corresponding to the external electronic device.
[0063] According to one embodiment, in operation 323, the electronic device can determine the folding state of the external electronic device. The electronic device can determine the folding state of the external electronic device based on the received information related to the external electronic device. The folding state of the electronic device may include an open state or a closed state. The operating mode of the electronic device in the open state may include a landscape mode, a portrait mode, or a standing mode. The folding state of the electronic device may further include a semi-open state.
[0064] According to one embodiment, the electronic device may check the folding state of the electronic device in operation 325. The electronic device may check the folding state of the electronic device through at least one sensor of the electronic device. In one embodiment, the folding state of the electronic device may be determined based on whether a folding angle checked through at least one sensor (e.g., the sensor module (176) of FIG. 1 or 2) is within a set range. The electronic device may check whether the folding state of the electronic device is closed or open based on sensor data acquired by the at least one sensor. The electronic device may also check whether the folding state of the electronic device is closed, open, or semi-open based on sensor data acquired by the at least one sensor. The electronic device may determine an operation mode of the electronic device in the semi-open or open state as one of a landscape mode, a portrait mode, or a standing mode based on sensor data acquired by the at least one sensor. In one embodiment, an application processor (e.g., the main processor (121) of FIG. 1) can determine whether the folding state of the electronic device is closed, open, or semi-open by receiving information associated with the folding state of the electronic device from at least one sensor of the electronic device.
[0065] According to one embodiment, in operation 327, the electronic device may determine a first screen and a second screen. The electronic device may determine a first screen to be displayed on a display of the electronic device and a second screen to be displayed on an external electronic device based on a folding state of the electronic device and a folding state of the external electronic device. The electronic device may, for example, determine whether the folding state of the electronic device and the folding state of the external electronic device satisfy a condition for displaying an expanded screen. The condition for displaying an expanded screen may include that both an operation mode corresponding to the folding state of the electronic device and an operation mode corresponding to the folding state of the external electronic device are standing modes.
[0066] In one embodiment, the electronic device can determine that the above condition is satisfied based on determining that the operation mode corresponding to the folding state of the electronic device and the operation mode corresponding to the folding state of both the external electronic device are in a standing mode. Based on the satisfaction of the above condition, the electronic device can determine a first screen to be displayed on the display of the electronic device (e.g., the display module (160) of FIG. 1 or 2) and a second screen to be displayed on the external electronic device (e.g., the display of the external electronic device). The electronic device can, for example, control the display module of the electronic device to display at least a portion of the expanded screen and control the external electronic device to display the remaining portion of the expanded screen. The remaining portion of the expanded screen is a portion of the screen that is not displayed on the electronic device. When both the electronic device and the external electronic device are operating in a standing mode, the electronic device can improve user convenience by providing an expanded view through the display module and the display module of the external electronic device. Furthermore, the user experience is further improved because the user does not need to manually align the display modules of the electronic device and the external electronic device to ensure that the expanded screen is properly displayed.
[0067] In one embodiment, the electronic device can determine that the above condition is not satisfied based on determining that the operation mode corresponding to the folding state of the electronic device or the operation mode corresponding to the folding state of both the external electronic device is not a standing mode. Based on determining that the above condition is not satisfied, the electronic device can determine a first screen to be displayed on the display of the electronic device and a second screen to be displayed on the external electronic device. The electronic device can control the external electronic device to display a screen that is at least partially identical to the screen displayed on the display module of the electronic device. Based on determining that the condition for providing an expanded view is not satisfied, the electronic device can provide a mirror view.
[0068] In one embodiment, the electronic device can change the screen displayed on electronic devices with which a communication connection has been established based on the determination of the folding state of the electronic device and / or the folding state of an external electronic device. The electronic device can enhance user convenience by providing an expanded screen through the electronic device and the external electronic device based on the satisfaction of conditions for displaying an expanded screen.
[0069] FIG. 4A is an exemplary drawing illustrating an unfolded (or open) state of an electronic device according to one embodiment of the present disclosure.
[0070] In one embodiment, the housing (400) of the electronic device (101) can be folded based on the folding line A. The housing (400) of the electronic device (101) can include a first housing (401) and a second housing (403) based on the folding line A. In one embodiment, when a length of the display module (160) in the +y direction is longer than a length in the +x direction while a user is looking at the electronic device (101), the folding state of the electronic device (101) can be referred to as a “portrait mode”. In one embodiment, when a length of the display module (160) in the +y direction is shorter than a length in the +x direction while a user is looking at the electronic device (101), the folding state of the electronic device (101) can be referred to as a “landscape mode”. In one embodiment, a plurality of antennas for positioning an external electronic device may be disposed on the housing (400) of the electronic device (101) or within the housing (400), and there is no limitation on the placement location thereof. For example, the plurality of antennas may be implemented as metal antennas on the housing (400) or as LDS (laser direct structuring) antennas within the housing (400). Although the housing (400) of the electronic device (101) is illustrated in FIG. 4 as including only one folding line (A), the housing (400) of the electronic device (101) may be implemented as a housing including two or more folding lines, and there is no limitation thereto.
[0071] In one embodiment, the electronic device (101) may be a foldable device including a first housing (401) and a second housing (403). A folding state may be determined based on a folding angle formed by the first housing (401) and the second housing (403).
[0072] FIG. 4b is an exemplary diagram illustrating a portrait mode and a landscape mode of an electronic device according to an embodiment of the present disclosure.
[0073] In one embodiment, referring to FIG. 4B, the electronic device (101) can change the orientation of a screen displayed on the display module (160) depending on the folding state of the electronic device (101). The screen can include at least one of text, an image, or a video.
[0074] In one embodiment, referring to reference numeral 410, when the electronic device (101) determines that the folding state of the electronic device (101) is a portrait mode, the electronic device (101) can set the direction of the screen displayed through the display module (160) to correspond to the portrait mode (or portrait mode). The electronic device (101) can determine (411) that the housing of the electronic device (101) is rotated based on information determined by the sensor module (176). The electronic device (101) can determine that the folding state of the electronic device (101) is changed from the portrait mode to the landscape mode, for example, due to the rotation of the housing of the electronic device (101). When the electronic device (101) determines that the folding state of the electronic device (101) is a landscape mode, the electronic device (101) can change the direction of the screen displayed through the display module (160) to correspond to the landscape mode (or landscape mode).
[0075] FIG. 4c is an exemplary drawing illustrating a standing mode of an electronic device according to one embodiment of the present disclosure.
[0076] In one embodiment, the electronic device (101) (or the application processor) can determine that the folding state of the electronic device (101) is a standing mode based on information confirmed (or acquired) by the sensor module (176). Referring to reference numeral 430, when the folding state of the electronic device (101) is a standing mode, the electronic device (101) can display different screens on a display area corresponding to the first housing (401) of the electronic device (101) and a display area corresponding to the second housing (403) with respect to the folding line A. For example, when an application executed by the electronic device (101) is an application associated with a video stream, the electronic device (101) can display a screen (433) associated with the video stream on at least a portion of an area corresponding to the first housing (401). The electronic device (101) may display a screen (435) associated with real-time chatting on the remaining portion of the area corresponding to the first housing (401), for example, if an application running on the electronic device (101) supports a real-time chatting function. The electronic device (101) may display an input interface (431) associated with a media controller for controlling playback of a video stream on the area corresponding to the second housing (403).
[0077] In one embodiment, referring to reference numeral 440, the electronic device (101) in standing mode as viewed from the side (B) of the electronic device (101) is illustrated. The electronic device (101) can determine whether the folding state of the electronic device (101) is the standing mode by, for example, checking whether the folding angle (441) of the electronic device (101) as determined by the sensor module (176) is within a set range. The electronic device (101) can determine that the folding state of the electronic device (101) is the standing mode, for example, when the folding angle (441) of the electronic device (101) is within the set range. The electronic device (101) can determine that the folding state of the electronic device (101) is not the standing mode, for example, when the folding angle of the electronic device (101) is outside the set range. The electronic device (101) can, for example, determine that the folding state of the electronic device (101) is closed when the folding angle of the electronic device (101) is outside the set range. The electronic device (101) can further determine that the folding state of the electronic device (101) is open and whether the electronic device is in portrait mode or landscape mode, for example, when the folding angle of the electronic device (101) is outside the set range.
[0078] FIG. 5A is a diagram for explaining a communication connection establishment operation of an electronic device according to an embodiment of the present disclosure.
[0079] In one embodiment, referring to FIG. 5A, the electronic device (101) may establish a communication connection (510) (e.g., a short-range wireless communication connection) with an external electronic device (501). The electronic device (101) may display a screen (433) associated with the video stream on at least a portion of an area corresponding to the first housing (401), for example, if the application executed by the electronic device (101) is an application associated with a video stream. The electronic device (101) may display a screen (435) associated with the real-time chat on the remaining portion of the area corresponding to the first housing (401), for example, if the application executed by the electronic device (101) supports a real-time chat function. The electronic device (101) may display an input interface (431) associated with a media controller for controlling playback of the video stream on an area corresponding to the second housing (403). The external electronic device (501) may display a screen (523) associated with a sketch on an area corresponding to a first housing (511) of the external electronic device (501), for example, when an application executed by the external electronic device (501) is an application associated with a drawing function. The external electronic device (501) may display a screen (521) associated with a drawing pad on an area corresponding to a second housing (513) of the external electronic device (501). The external electronic device (501) may be an electronic device that can be folded based on a folding line A', and the specifications of the external electronic device (501) are not limited to those illustrated in FIG. 5A. For example, the external electronic device may be a foldable electronic device that includes a plurality of folding lines.
[0080] FIG. 5b is a diagram for explaining a pairing operation of an electronic device according to an embodiment of the present disclosure.
[0081] In one embodiment, referring to FIG. 5B, the electronic device (101) can provide an expanded view through the display module of the electronic device and the display module of the external electronic device. The electronic device (101) can provide the expanded view based on determining that both the folded state of the electronic device (101) and the folded state of the external electronic device (501) are in a standing mode. The electronic device (101) can display a screen (433) associated with a video stream on an area corresponding to the first housing (401). The electronic device (101) can display an input interface (431) associated with a media controller for controlling playback of the video stream on an area corresponding to the second housing (403). The electronic device (101) can control the external electronic device (501) to display a screen (435) associated with real-time chatting on an area corresponding to the first housing (511) of the external electronic device (501). The electronic device (101) can control the external electronic device (501) to display a screen (531) associated with a touchscreen keyboard on an area corresponding to, for example, the second housing (513) of the external electronic device (501). The electronic device (101) can provide an expanded user experience by providing an expanded view through the display module of the electronic device and the display module of the external electronic device.
[0082] FIG. 5c is a flowchart for explaining a pairing operation of an electronic device according to an embodiment of the present disclosure.
[0083] Referring to FIG. 5C, in operation 541, an electronic device (e.g., at least one of the electronic device (101) of FIG. 1, the electronic device (101) of FIG. 2, the processor (120) of FIG. 1, or the processor (120) of FIG. 2) may receive a user input to expand a screen displayed on a display of the electronic device (e.g., the display module (160) of FIG. 1 or FIG. 2) using an external electronic device (e.g., at least one of the electronic device (102) of FIG. 1, the electronic device (104), or the server (108) of FIG. 1). In one embodiment, the external electronic device may be an electronic device with which a communication connection has been established with the electronic device. The user input may include, but is not limited to, a touch input or a voice input that causes the electronic device to perform pairing with the external electronic device.
[0084] According to one embodiment, in response to a user input, in operation 543, the electronic device may control the display of the electronic device to display a first screen and transmit information related to a second screen to an external electronic device. In one embodiment, the first screen may correspond to at least a portion of an expanded screen that was displayed on the display of the electronic device before receiving the user input. The second screen may correspond to the remaining portion of the expanded screen. In one embodiment, the electronic device may determine the first screen to be displayed on the display of the electronic device and the second screen to be displayed on the external electronic device based on receiving information related to the external electronic device from the external electronic device. The electronic device can check the folding state (or the operation mode corresponding to the folding state) of the electronic device through at least one sensor (e.g., the sensor module (176) of FIG. 1 or 2). The electronic device can check the folding state (or the operation mode corresponding to the folding state) of the external electronic device based on information associated with the external electronic device. The electronic device can control the display module of the electronic device to display at least a portion of the extended screen based on confirmation that both the operation mode corresponding to the electronic device and the operation mode corresponding to the external electronic device are standing modes, and transmit screen-related information to the external electronic device to display the remaining portion of the extended screen. In one embodiment, the screen displayed on the external electronic device may be a portion different from at least a portion of the extended screen displayed through the display module of the electronic device. When both the electronic device and the external electronic device operate in standing mode, the electronic device can improve user convenience by providing an extended view through the display module and the display module of the external electronic device.
[0085] In one embodiment, the first screen and the second screen may be the same screen. The electronic device may control the external electronic device to display a screen that is at least partially identical to a screen displayed on the display module of the electronic device, based on determining that the operating mode corresponding to the folding state of the electronic device or the operating mode corresponding to the folding state of the external electronic device is not a standing mode. The electronic device may, for example, control the display of the electronic device to display a screen that is at least partially identical to a screen displayed prior to pairing with the external electronic device, and transmit information related to a screen that is at least partially identical to a screen displayed on the display of the electronic device to the external electronic device.
[0086] In one embodiment, the electronic device can determine a screen to be displayed on electronic devices with which a communication connection has been established based on the folding state of the electronic device and / or the folding state of the external electronic device. The electronic device can improve user convenience by providing an extended screen through the electronic device and the external electronic device based on receiving a user input for displaying an expanded screen displayed on the display of the electronic device using the external electronic device. Advantageously, the user can determine whether the electronic device and the external electronic device display different screens or the same screen depending on the folding state of one or both of the electronic device and the external electronic device. This improves user control over the electronic device and the external electronic device, as the user does not need to navigate through various menus or setting options to control the content displayed on the two electronic devices.
[0087] FIG. 6A is a diagram for explaining a communication connection establishment operation of an electronic device according to an embodiment of the present disclosure.
[0088] In one embodiment, referring to FIG. 6A, the electronic device (101) may establish a communication connection (610) (e.g., a short-range wireless communication connection) with an external electronic device (501). The electronic device (101) may display a screen (433) associated with the video stream on an area corresponding to the first housing (401), for example, when an application executed by the electronic device (101) is an application associated with a video stream. The electronic device (101) may display an input interface (431) associated with a media controller for controlling playback of the video stream on an area corresponding to the second housing (403). The external electronic device (501) may display a screen (611) associated with a sketch and a screen (613) associated with a drawing pad on the display of the external electronic device (501), for example, when an application executed by the external electronic device (501) is an application associated with a drawing function.
[0089] FIG. 6b is a diagram for explaining a pairing operation of an electronic device according to an embodiment of the present disclosure.
[0090] In one embodiment, referring to FIG. 6B, the electronic device (101) can provide a mirror view through the display module of the electronic device and the display module of the external electronic device. The electronic device (101) can provide the mirror view based on determining that the folding state of the electronic device (101) or the folding state of the external electronic device (501) is not in a standing mode. The electronic device (101) can display a screen (433) associated with a video stream on an area corresponding to the first housing (401). The electronic device (101) can display an input interface (431) associated with a media controller for controlling playback of the video stream on an area corresponding to the second housing (403). The electronic device (101) can display a screen (621) associated with a video stream on the display of the external electronic device (501). The electronic device (101) can provide a mirror view based on determining that the first condition for providing an expanded view is not satisfied.
[0091] FIG. 7 is a flowchart illustrating a pairing operation of an electronic device according to an embodiment of the present disclosure.
[0092] Referring to FIG. 7A, in operation 701, an electronic device (e.g., at least one of the electronic device (101) of FIG. 1, the electronic device (101) of FIG. 2, the processor (120) of FIG. 1, or the processor (120) of FIG. 2) may transmit a request associated with pairing to an external electronic device (e.g., at least one of the electronic device (102) of FIG. 1, the electronic device (104), or the server (108) of FIG. 1). The electronic device (101) may be configured to determine whether to provide an expanded view when performing pairing based on a user input. The electronic device (101) may determine a user input to activate a multi-view function. Based on (or in response to) receiving a user input to activate the multi-view function, the electronic device (101) may determine at least one external electronic device whose physical distance from the electronic device (101) is less than or equal to a threshold value. The electronic device (101) can identify at least one external electronic device through a short-range wireless communication module (e.g., at least one of a Wi-Fi module, a Bluetooth module, and / or a UWB module). That is, the electronic device can provide a user with a list including at least one identified external electronic device discovered by the electronic device. The electronic device (101) can provide a user with a list associated with the at least one identified external electronic device. The electronic device (101) can provide the user with a list associated with the at least one identified external electronic device through, for example, at least one of a display module (160), an audio output module (155), or a haptic module (179). The electronic device (101) can identify a user input associated with selection of an external electronic device with which to perform pairing. Based on (or in response to) the user input associated with selection of the external electronic device, the electronic device (101) can identify identification information of the external electronic device corresponding to the user input.The electronic device (101) can transmit a request related to pairing to the identified external electronic device through a communication module (e.g., the communication module (190) of FIG. 1).
[0093] According to one embodiment, in operation 703, the electronic device (101) may receive a response from an external electronic device. Based on receiving the response from the external electronic device, the electronic device (101) may establish a communication connection with the external electronic device. The electronic device (101) may check information related to the status of the external electronic device included in the response. The electronic device (101) may check the distance between the electronic device (101) and the external electronic device. In one embodiment, after establishing a communication connection with the external electronic device, the electronic device (101) may check the distance between the electronic device (101) and the external electronic device. The electronic device (101) may check the distance between the electronic device (101) and the external electronic device, for example, through a positioning function supported by a UWB module included in the communication module (190). The UWB module may exchange positioning information with the UWB module of the external electronic device through a plurality of antennas included in the electronic device (101). A person skilled in the art will readily understand that the UWB module can determine the distance between the electronic device (101) and the external electronic device, for example, based on a PDoA algorithm, but is not limited thereto. In one embodiment, the electronic device (101) can determine the angular difference between the electronic device (101) and the external electronic device based on the information included in the response. The electronic device (101) can determine the angular difference between the attitude angle of the electronic device (101) and the attitude angle of the external electronic device. The electronic device (101) can determine the attitude angle of the electronic device (101) based on the information identified by the sensor module (176). The electronic device (101) can determine the attitude angle of the external electronic device based on the information included in the response. The electronic device (101) can determine the folding state of the external electronic device based on the information included in the response, in one embodiment.The electronic device (101) can, for example, determine whether the folding state of the external electronic device is open or closed based on information included in the response. The electronic device (101) can determine whether the folding state of the external electronic device is in any one of a landscape mode, a portrait mode, or a standing mode among the open states. In one embodiment, after operation 703, the electronic device (101) can transmit information associated with the state of the electronic device (101) to the external electronic device, and can also receive information associated with the state of the external electronic device from the external electronic device. The electronic device (101) can perform positioning using, for example, a UWB module, and transmit information associated with the state of the electronic device (101), including distance data, sensor data, attitude information, or input interface information, to the external electronic device. The electronic device (101) can use a short-range communication module (for example, at least one of a UWB module, a Wi-Fi module, or a Bluetooth module) to transmit information associated with the state to the external electronic device. The electronic device (101) may transmit and receive (or exchange) information related to the state of the electronic device (101) and information related to the state of the external electronic device, thereby checking information related to at least one of the distance between the electronic device (101) and the external electronic device, the angular difference between the electronic device (101) and the external electronic device, the folding state of the external electronic device, or the type of the input interface of the external electronic device.
[0094] According to one embodiment, in operation 705, the electronic device may determine whether the first folding state and the second folding state satisfy the first condition. The electronic device may determine whether the first folding state of the electronic device (101) and the second folding state of the external electronic device satisfy the first condition for displaying an expanded screen, for example, based on information included in the response and information confirmed by the sensor module (176). The electronic device (101) may determine that the first condition is satisfied, for example, based on determining that the folding states of both the electronic device (101) and the external electronic device are in a standing mode. The electronic device (101) may determine that the first condition is not satisfied, for example, based on determining that the folding state of either the electronic device (101) or the external electronic device is not in a standing mode. The electronic device (101) can control the external electronic device to display a screen that is at least partially identical to the screen displayed on the display based on determining that the first condition is not satisfied (action 705 - No). The electronic device (101) can provide a mirror view based on determining that the first condition is not satisfied.
[0095] According to one embodiment, based on the confirmation that the first condition is satisfied (operation 705 - Yes), in operation 707, it can be confirmed whether the first input interface and the second input interface satisfy the second condition. In one embodiment, the second condition may include that the identification information of the first input interface and the identification information of the second input interface are the same. The electronic device (101) may, in one embodiment, confirm information associated with at least one type of input interface of the external electronic device. The information associated with the type of the input interface corresponding to the external electronic device may include, for example, integer label information. The electronic device (101) may, based on the label information, confirm whether the type of the input interface corresponding to the application executed by the electronic device (101) matches the type of the input interface displayed by the external electronic device. The information associated with the type of the input interface corresponding to the external electronic device is not limited to the examples described above. For example, information associated with the type of input interface corresponding to an external electronic device may be transmitted to the electronic device (101) in the form of binary code.
[0096] In one embodiment, the electronic device (101) controls the display module (160) to display at least a portion of the expanded screen and controls the external electronic device to display the remaining portion of the expanded screen based on the confirmation that the first input interface and the second input interface satisfy the second condition (operation 707 - No), in operation 709. The electronic device (101) can improve user convenience by providing an expanded view through the display module (160) and the display module of the external electronic device.
[0097] FIG. 7b is a flowchart illustrating a pairing operation of an electronic device according to an embodiment of the present disclosure.
[0098] Referring to FIG. 7B, in operation 721, an electronic device (e.g., at least one of the electronic device (101) of FIG. 1, the electronic device (101) of FIG. 2, the processor (120) of FIG. 1, or the processor (120) of FIG. 2) may receive a user input to display an expanded screen displayed on a display of the electronic device (e.g., the display module (160) of FIG. 1 or FIG. 2) using an external electronic device (e.g., at least one of the electronic device (102), the electronic device (104), or the server (108) of FIG. 1). In one embodiment, the external electronic device may be an electronic device with which a communication connection has been established with the electronic device. The user input may include, but is not limited to, a touch input or a voice input that causes the electronic device to perform pairing with the external electronic device.
[0099] According to one embodiment, in response to a user input, in operation 723, the electronic device may determine, based on a folding state of the electronic device and a folding state of an external electronic device, whether to display an input interface displayed through a display of the electronic device on a first screen, or whether to display at least a portion of the expanded input interface on the first screen and display the remaining portion of the expanded input interface on a second screen. If a screen displayed on the display of the electronic device prior to the user input includes an input interface, the electronic device may determine, based on the folding state of the electronic device and the folding state of the external electronic device, whether to display the input interface displayed through the display of the electronic device on the first screen, or whether to display the expanded input interface separately on the first screen and the second screen. The expanded input interface may be, for example, an input interface that extends an input interface in a horizontal and / or vertical direction. In one embodiment, the electronic device can divide the extended input interface based on determining that both an operation mode corresponding to a folding state of the electronic device and an operation mode corresponding to a folding state of the external electronic device are standing modes, and display at least a portion of the extended input interface on the first screen and a remaining portion of the extended input interface on the second screen. The electronic device can, for example, divide and display the extended input interface on the first screen corresponding to the electronic device and the second screen corresponding to the external electronic device. The electronic device can improve user convenience by displaying the extended input interface through a display of the electronic device operating in a standing mode and a display of the external electronic device.In one embodiment, the electronic device can display an input interface displayed through a display of the electronic device on a first screen corresponding to the electronic device based on determining that the operation mode corresponding to the folding state of the electronic device or the operation mode corresponding to the folding state of the external electronic device is not a standing mode.
[0100] FIG. 7c is a flowchart for explaining a pairing operation of an electronic device according to an embodiment of the present disclosure.
[0101] Referring to FIG. 7C, in operation 741, an electronic device (e.g., at least one of the electronic device (101) of FIG. 1, the electronic device (101) of FIG. 2, the processor (120) of FIG. 1, or the processor (120) of FIG. 2) may receive, from an external electronic device, identification information of an input interface displayed on the external electronic device. The identification information of the input interface displayed on the external electronic device may include, for example, integer-type label information. The identification information of the input interface corresponding to the external electronic device is not limited to the examples described above. For example, the identification information of the input interface displayed on the external electronic device may be transmitted to the electronic device in the form of a binary code.
[0102] According to one embodiment, in operation 743, based on the received identification information, the electronic device may determine whether to divide the extended input interface and display at least a portion of the extended input interface on a first screen and display the remaining portion of the extended input interface on a second screen. In one embodiment, the electronic device may determine whether identification information of the input interface displayed through the display of the electronic device corresponds to identification information received from an external electronic device. Based on determining that the identification information of the input interface displayed through the display of the electronic device corresponds to the identification information received from the external electronic device, the electronic device may divide and display the extended input interface on a first screen corresponding to the electronic device and a second screen corresponding to the external electronic device. The extended input interface may be an interface that expands an input interface displayed through the display of the electronic device before confirming a user input for expanding and displaying a screen displayed on the display of the electronic device using the external electronic device. The electronic device may improve user convenience by providing the expanded interface through the display of the electronic device and the display of the external electronic device. The electronic device can display, on the first screen, the input interface displayed through the display of the electronic device prior to confirmation of the user input, based on confirmation that the identification information of the input interface displayed through the display of the electronic device does not correspond to the identification information received from the external electronic device.
[0103] FIG. 8 is an exemplary drawing illustrating an input interface displayed through a display of an electronic device according to one embodiment of the present disclosure.
[0104] In one embodiment, referring to reference numeral 810, the input interface may include an input interface (811) associated with a media controller for controlling playback of a video stream. Referring to reference numeral 820, the input interface may include an input interface (821) associated with a touchscreen keyboard. Referring to reference numeral 830, the input interface may include an input interface (831) associated with a drawing pad. Examples of input interfaces are not limited to the examples described above. For example, the input interface may include an input interface associated with a camera controller or an input interface associated with a gaming pad. Each input interface may be labeled with integer identification information.
[0105] FIG. 9A is a diagram for explaining a communication connection establishment operation of an electronic device according to an embodiment of the present disclosure.
[0106] In one embodiment, referring to FIG. 9A, the electronic device (101) may establish a communication connection (910) (e.g., a short-range wireless communication connection) with an external electronic device (501). The electronic device (101) may display a screen (433) associated with the video stream on at least a portion of an area corresponding to the first housing (401), for example, if the application executed by the electronic device (101) is an application associated with a video stream. The electronic device (101) may display a screen (435) associated with real-time chat on the remaining portion of the area corresponding to the first housing (401), for example, if the application executed by the electronic device (101) supports a real-time chat function. The electronic device (101) may display an input interface (901) associated with a touch screen keyboard for real-time chat on an area corresponding to the second housing (403). The external electronic device (501) may display a screen (913) associated with a note on an area corresponding to the first housing (511) of the external electronic device (501), for example, when the application executed by the external electronic device (501) is an application associated with a note function. The external electronic device (501) may display a screen (911) associated with a touch screen keyboard on an area corresponding to the second housing (513) of the external electronic device (501).
[0107] FIG. 9b is a diagram for explaining a pairing operation of an electronic device according to an embodiment of the present disclosure.
[0108] In one embodiment, referring to FIG. 9B, the electronic device (101) can provide an expanded view through the display module of the electronic device and the display module of the external electronic device. The electronic device (101) can provide an expanded input interface based on confirming that both the folding state of the electronic device (101) and the folding state of the external electronic device (501) are in a standing mode and confirming that the input interfaces are the same. The electronic device (101) can display a screen (433) associated with a video stream on an area corresponding to the first housing (401). The electronic device (101) can display at least a portion (921) of an input interface associated with a touch screen keyboard on an area corresponding to the second housing (403). The electronic device (101) can control the external electronic device (501) to display a screen (435) associated with real-time chatting on an area corresponding to the first housing (511) of the external electronic device (501) (or provided on the first housing (511). The electronic device (101) can control the external electronic device (501) to display, for example, a remaining part (931) of the screen associated with the touchscreen keyboard on an area corresponding to the second housing (513) of the external electronic device (501). The electronic device (101) can provide an expanded user experience by providing an expanded input interface through the display module of the electronic device and the display module of the external electronic device.
[0109] FIG. 10 is a diagram illustrating a pairing operation of an electronic device according to an embodiment of the present disclosure. In FIG. 10, portions of explanation that overlap with FIG. 3 and / or FIG. 7 may not be repeated.
[0110] In one embodiment, the electronic device can determine a first screen to be displayed on a display of the electronic device and a second screen to be displayed on the external electronic device based on at least one of information associated with a distance between the electronic device and the external electronic device or information associated with an angle.
[0111] Referring to FIG. 10, in operation 1001, an electronic device (e.g., at least one of the electronic device (101) of FIG. 1, the electronic device (101) of FIG. 2, the processor (120) of FIG. 1, or the processor (120) of FIG. 2) may transmit a request associated with pairing to an external electronic device (e.g., at least one of the electronic device (102), the electronic device (104), or the server (108) of FIG. 1).
[0112] In one embodiment, in operation 1003, the electronic device (101) may receive a response from an external electronic device.
[0113] According to one embodiment, in operation 1005, the electronic device (101) can check the angular difference and distance between the electronic device and the external electronic device. In one embodiment, after operation 1003, the electronic device (101) can transmit information associated with the state of the electronic device (101) to the external electronic device, and can also receive information associated with the state of the external electronic device from the external electronic device. The electronic device (101) can perform positioning using, for example, a UWB module, and transmit information associated with the state of the electronic device (101), including distance data, sensor data, attitude information, or input interface information, to the external electronic device. The electronic device (101) can use a short-range communication module (for example, at least one of a UWB module, a Wi-Fi module, or a Bluetooth module) to transmit the information associated with the state to the external electronic device. The electronic device (101) may transmit and receive (or exchange) information related to the state of the electronic device (101) and information related to the state of the external electronic device, thereby checking information related to at least one of the distance between the electronic device (101) and the external electronic device, the angular difference between the electronic device (101) and the external electronic device, the folding state of the external electronic device, or the type of the input interface of the external electronic device.
[0114] According to one embodiment, in operation 1007, the electronic device may determine whether each of the angular difference and the distance satisfies the first condition. The electronic device may determine, for example, whether each of the angular difference and the distance is within a set range based on information included in the response and information confirmed by the sensor module (176).
[0115] According to one embodiment, based on the confirmation that the first condition is satisfied (operation 1007 - Yes), in operation 1009, the electronic device (101) can provide an expanded view. The electronic device (101) can control the display module (160) to display at least a portion of the expanded screen, and can control the external electronic device to display the remaining portion of the expanded screen. The electronic device (101) can improve user convenience by providing the expanded view through the display module (160) and the display module of the external electronic device.
[0116] In one embodiment, based on determining that the first condition is not satisfied (operation 1007 - No), in operation 1011, the electronic device (101) may provide a mirror view.
[0117] According to one embodiment, an electronic device (e.g., an electronic device (101) of FIG. 1) may include a display (e.g., a display module (160) of FIG. 1), a communication circuit (e.g., a communication module (190) of FIG. 1), at least one sensor (e.g., a sensor module (176) of FIG. 1), at least one processor (e.g., a processor (120) of FIG. 1) electrically connected to the display (160), the communication circuit (190), and the at least one sensor (176), and a memory (e.g., a memory (130) of FIG. 1) for storing instructions. The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to receive, via the communication circuit (190), information related to an external electronic device (e.g., at least one of the electronic device (102), the electronic device (104), the server (108) of FIG. 1 , or the external electronic device (501) of FIG. 5 ) connected to the network. The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to determine a folding state of the external electronic device (102; 104; 108; 501) based on the information related to the external electronic device (102; 104; 108; 501). The above instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to check the folding state of the electronic device (101) through the at least one sensor (176).The above instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to determine a first screen to be displayed on the display of the electronic device and a second screen to be displayed on the external electronic device based on a folding state of the electronic device and a folding state of the external electronic device (102; 104; 108; 501).
[0118] In one embodiment, the instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to receive a user input for expanding a screen displayed on a display of the electronic device using the external electronic device. The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to control the display of the electronic device to display the first screen in response to the input and to transmit information related to the second screen to the external electronic device.
[0119] In one embodiment, the first screen may correspond to at least a portion of an extended screen that was displayed on the display of the electronic device prior to receiving the user input, and the second screen may correspond to the remaining portion of the extended screen.
[0120] In one embodiment, the first screen and the second screen may be the same screen.
[0121] In one embodiment, the state of the electronic device (101) may be determined based on whether the folding angle of the electronic device (101), as confirmed through the at least one sensor (176), is within a set range.
[0122] In one embodiment, the instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to, prior to receiving the user input, determine whether to display the input interface on the first screen, or whether to display at least a portion of an expanded input interface that extends the input interface on the first screen and display the remaining portion of the expanded input interface on the second screen, based on receiving a user input for expanding a screen displayed on the display of the electronic device (101) using the external electronic device (102; 104; 108; 501), if the screen displayed on the display of the electronic device (101) includes an input interface, depending on a folding state of the electronic device and a folding state of the external electronic device.
[0123] In one embodiment, the instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to receive, from the external electronic device, identification information of an input interface displayed on the external electronic device. The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to divide the extended input interface extended from the input interface according to the received identification information, and to determine whether to display at least a portion of the extended input interface on the first screen and a remaining portion of the extended input interface on the second screen.
[0124] In one embodiment, the electronic device (101) may be a foldable device including a first housing (401) and a second housing (403). The folding state may be determined based on a folding angle formed by the first housing (401) and the second housing (403).
[0125] In one embodiment, the instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to, upon receiving a user input for expanding a screen displayed on the display of the electronic device using the external electronic device, if the screen displayed on the display (160) includes an input interface before receiving the user input, check a folding state of the electronic device and a folding state of the external electronic device (102; 104; 108; 501). The instructions, when executed by the at least one processor (120), may cause the electronic device (101) to divide an extended input interface, which is an interface that extends the input interface, based on checking that both an operation mode corresponding to the folding state of the electronic device and an operation mode corresponding to the folding state of the external electronic device are standing modes, and to display at least a portion of the extended input interface on the first screen and a remaining portion of the extended input interface on the second screen.
[0126] In one embodiment, the instructions, when executed by the at least one processor (120), may cause the electronic device (101) to determine a first screen to be displayed on a display of the electronic device and a second screen to be displayed on the external electronic device based on at least one of information associated with a distance between the electronic device (101) and the external electronic device (102; 104; 108; 501) or information associated with an angular difference between the electronic device (101) and the external electronic device (102; 104; 108; 501).
[0127] According to one embodiment, the operating method of the electronic device (101) may include an operation of receiving information related to the external electronic device (102; 104; 108; 501) from the external electronic device (102; 104; 108; 501) through the communication circuit (190) of the electronic device (101). The operating method of the electronic device (101) may include an operation of checking a folding state of the external electronic device (102; 104; 108; 501) based on the information related to the external electronic device (102; 104; 108; 501). The operating method of the electronic device (101) may include an operation of checking a folding state of the electronic device (101) through at least one sensor (176) of the electronic device (101). The operating method of the electronic device (101) may include an operation of determining a first screen to be displayed on the display of the electronic device (101) and a second screen to be displayed on the external electronic device (102; 104; 108; 501) based on a folding state of the electronic device (101) and a folding state of the external electronic device (102; 104; 108; 501).
[0128] In one embodiment, the method of operating the electronic device (101) may further include an operation of receiving a user input for expanding a screen displayed on a display of the electronic device (101) using the external electronic device (102; 104; 108; 501). The method of operating the electronic device (101) may further include an operation of controlling the display of the electronic device (101) to display the first screen in response to the input, and transmitting information related to the second screen to the external electronic device (102; 104; 108; 501).
[0129] In one embodiment, the first screen may correspond to at least a portion of an extended screen displayed on the display of the electronic device (101) prior to receiving the user input, and the second screen may correspond to the remaining portion of the extended screen.
[0130] In one embodiment, the first screen and the second screen may be the same screen.
[0131] In one embodiment, the folding state of the electronic device (101) may be determined based on whether the folding angle of the electronic device (101) confirmed through the at least one sensor (176) is within a set range.
[0132] In one embodiment, the operating method of the electronic device (101) may further include, prior to receiving the user input, if a screen displayed on a display of the electronic device (101) includes an input interface, receiving a user input for expanding a screen displayed on the display of the electronic device using the external electronic device (102; 104; 108; 501), and, based on a folding state of the electronic device and a folding state of the external electronic device, determining whether to display the input interface on the first screen, or whether to display at least a part of an expanded input interface that expands the input interface on the first screen and display the remaining part of the expanded input interface on the second screen.
[0133] In one embodiment, the operating method of the electronic device (101) may further include an operation of receiving, from the external electronic device, identification information of an input interface displayed on the external electronic device. The operating method of the electronic device (101) may further include an operation of dividing the extended input interface extended from the input interface according to the received identification information and determining whether to display at least a portion of the extended input interface on the first screen and the remaining portion of the extended input interface on the second screen.
[0134] In one embodiment, the electronic device (101) may be a foldable device including a first housing (401) and a second housing (403). The folding state may be determined based on a folding angle formed by the first housing (401) and the second housing (403).
[0135] In one embodiment, the operating method of the electronic device (101) may further include an operation of confirming a folding state of the electronic device and a folding state of the external electronic device (102; 104; 108; 501) upon receiving a user input for expanding a screen displayed on the display of the electronic device using the external electronic device when the screen displayed on the display (160) includes an input interface before receiving the user input. The operating method of the electronic device (101) may further include an operation of dividing an expanded input interface, which is an interface that extends the input interface, based on confirming that both an operating mode corresponding to the folding state of the electronic device and an operating mode corresponding to the folding state of the external electronic device are standing modes, and displaying at least a part of the expanded input interface on the first screen and a remaining part of the expanded input interface on the second screen.
[0136] In one embodiment, the method of operating the electronic device (101) may further include an operation of determining a first screen to be displayed on a display of the electronic device and a second screen to be displayed on the external electronic device based on at least one of information related to a distance between the electronic device (101) and the external electronic device (102; 104; 108; 501) or information related to an angular difference between the electronic device (101) and the external electronic device (102; 104; 108; 501).
[0137] Electronic devices according to the embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments disclosed in this document are not limited to the aforementioned devices.
[0138] The embodiments of this document and the terminology used herein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.
[0139] The term "module" used in the embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0140] One embodiment of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.
[0141] According to one embodiment, the method according to one embodiment disclosed in this document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.
[0142] According to one embodiment, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and arranged in other components. According to one embodiment, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to one embodiment, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
Claims
1. In an electronic device (101), display (160); Communication circuit (190); At least one sensor (176); At least one processor (120) electrically connected to the display (160), the communication circuit (190), and the at least one sensor (176); and Includes a memory (130) for storing instructions, The above instructions, when executed by the at least one processor (120), cause the electronic device (101) to: Through the above communication circuit (190), information related to the external electronic device (102; 104; 108; 501) connected to the network is received, Based on the information related to the received external electronic device, the folding state of the external electronic device (102;104;108;501) is checked, Using at least one sensor, the folding state of the electronic device is checked, An electronic device (101) that causes a first screen to be displayed on a display of the electronic device and a second screen to be displayed on a display of the external electronic device to be determined based on the folding state of the verified electronic device and the folding state of the verified external electronic device.
2. In paragraph 1, The above instructions, when executed by the at least one processor (120), cause the electronic device (101) to: By means of an input unit, a user input is received for extending the screen displayed on the display (160) of the electronic device (101) to the display of the external electronic device, An electronic device (101) that controls a display (160) of the electronic device (101) to display the first screen on the electronic device (101) in response to the input, and causes information related to the second screen to be transmitted to the external electronic device.
3. In paragraph 1 or 2, An electronic device (101), wherein the first screen corresponds to at least a portion of an extended screen that was displayed on the display (160) of the electronic device (101) prior to receiving the user input, and the second screen corresponds to the remaining portion of the extended screen.
4. In paragraph 1 or 2, An electronic device (101) wherein the first screen and the second screen are the same screen.
5. In any one of paragraphs 1 to 4, The folding state of the electronic device (101) is determined based on whether the folding angle of the electronic device (101) confirmed through the at least one sensor (176) is within a set range section.
6. In any one of paragraphs 2 to 5, The above instructions, when executed by the at least one processor (120), cause the electronic device (101) to: An electronic device (101), which, in response to receiving a user input for expanding a screen displayed on a display (160) of the electronic device (101) using the external electronic device (102;104;108;501), if a screen displayed on the display (160) of the electronic device (101) includes an input interface prior to receiving the user input, causes the electronic device (101) to determine whether to display the input interface on the first screen, or whether to display at least a part of the expanded input interface that expands the input interface on the first screen, and to display the remaining part of the expanded input interface on the second screen, based on the identified folding state of the electronic device (101) and the identified folding state of the external electronic device.
7. In any one of paragraphs 1 to 6, The above instructions, when executed by the at least one processor (120), cause the electronic device (101) to: From the external electronic device, receiving identification information of an input interface displayed on the external electronic device, An electronic device (101) that causes the extended input interface to be divided based on the received identification information from the input interface and to determine whether to display at least a portion of the extended input interface on the first screen and the remaining portion of the extended input interface on the second screen.
8. In any one of paragraphs 1 to 7, The electronic device (101) is a foldable device including a first housing (401) and a second housing (403), and the electronic device (101) has a folding state determined based on a folding angle formed by the first housing (401) and the second housing (403).
9. In any one of paragraphs 1 to 8, The above instructions, when executed by the at least one processor (120), cause the electronic device (101) to: When the screen displayed on the display (160) includes an input interface before receiving the user input, upon receiving a user input for expanding the screen displayed on the display (160) of the electronic device (101) using the external electronic device, the folding state of the electronic device (101) and the folding state of the external electronic device are checked, An electronic device (101) that divides an extended input interface, which is an interface that extends the input interface, based on confirmation that both an operation mode corresponding to a folding state of the electronic device (101) and an operation mode corresponding to a folding state of the external electronic device are standing modes, and causes at least a part of the extended input interface to be displayed on the first screen and the remaining part of the extended input interface to be displayed on the second screen.
10. In any one of paragraphs 1 to 9, The above instructions, when executed by the at least one processor (120), cause the electronic device (101) to: An electronic device (101) that causes a first screen to be displayed on a display (160) of the electronic device (101) and a second screen to be displayed on the external electronic device to be determined based on at least one of information associated with a distance between the electronic device (101) and the external electronic device or information associated with an angular difference between the electronic device (101) and the external electronic device.
11. In the operating method of an electronic device (101), An operation of receiving information related to an external electronic device (102;104;108;501) from an external electronic device (102;104;108;501) connected to a network through a communication circuit (190) of the electronic device (101); An operation of checking a folding state of an external electronic device (102;104;108;501) based on information related to the received external electronic device (102;104;108;501); An operation of checking the folding state of the electronic device (101) by using at least one sensor (176) of the electronic device (101); and An operation of determining a first screen to be displayed on the display of the electronic device (101) and a second screen to be displayed on the display of the external electronic device (102;104;108;501) based on the folding state of the verified electronic device (101) and the folding state of the verified external electronic device (102;104;108;501). A method of operating an electronic device (101), comprising:
12. In paragraph 11, An operation of receiving a user input for expanding a screen displayed on a display (160) of the electronic device (101) by using a display of the external electronic device (102;104;108;501) by an input unit; and A method of operating an electronic device (101), further comprising: controlling a display (160) of the electronic device (101) to display the first screen on the electronic device (101) in response to the input; and transmitting information related to the second screen to the external electronic device (102; 104; 108; 501).
13. In clause 11 or 12, A method of operating an electronic device (101), wherein the first screen corresponds to at least a portion of an extended screen displayed on the display (160) of the electronic device (101) prior to receiving the user input, and the second screen corresponds to the remaining portion of the extended screen.
14. In clause 11 or 12, A method of operating an electronic device (101), wherein the first screen and the second screen are the same screen.
15. In any one of paragraphs 11 to 14, A method of operating an electronic device (101), wherein the folding state of the electronic device (101) is determined based on whether the folding angle of the electronic device (101) confirmed through the at least one sensor (176) is within a set range.
Citation Information
Patent Citations
Information process device and image process method
JP2014160144A
Mobile terminal, image display device and user interface providing method using the same
KR101890626B1
Method and apparatus for detecting object based on multichannel infrared video
KR102457576B1
Method and apparatus for training models in machine translation, electronic device and storage medium
KR102554758B1
Assembly type stair for waterway
KR102633717B1