Electronic device and screen control method using input device
The electronic device automatically configures display order using location information from connected input devices, addressing the challenge of manual setup and ensuring smooth screen transitions in multi-device environments.
Patent Information
- Application Number
- PCT/KR2024/009737
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-08-29
- Filing Date
- 2024-07-09
- Publication Date
- 2025-01-30
Smart Images

Figure KR2024009737_30012025_PF_FP_ABST
Abstract
Description
Method of controlling a screen using an electronic device and an input device
[0001] Embodiments of the present disclosure relate to a method for controlling a screen using an electronic device and an input device.
[0002] With the advancement of digital technology, various types of electronic devices, such as mobile terminals, personal digital assistants (PDAs), electronic notebooks, smart phones, tablet PCs (PCs), wearable devices, and / or laptop PCs, are becoming widely used. The hardware and / or software components of these electronic devices are continuously being developed to support and enhance their functionality.
[0003] Meanwhile, when using one or more electronic devices, various applications can be executed on one or more of the electronic devices. For example, a user can connect two electronic devices via wired or wireless connection, allowing the screen of an application displayed on one electronic device to be displayed on another electronic device, also connected via wired or wireless connection.
[0004] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above is applicable as prior art related to the present disclosure.
[0005] When displaying the screen of an application running on an electronic device on a display of an external electronic device connected wirelessly (e.g., an extended display), there is a hassle in that the user must manually set (e.g., arrange) the order in which the screens are displayed. That is, for example, the user may have to manually configure the display arrangement of the screens displayed on the connected electronic devices. In addition, when the position of the external electronic device is changed (or moved) with respect to the electronic device, there is a hassle in that the user must manually set the order in which the screens are displayed on the displays.
[0006] An electronic device according to one embodiment of the present disclosure may provide a method for setting the order of displays in which screens are displayed using an input device. For example, the electronic device may obtain first location information related to the position of a communication-connected input device, receive second location information related to the position of the input device from a second electronic device having a communication-connected display, and set the order of displays in which screens are displayed based on the position of the second electronic device identified based on the first location information and the second location information.
[0007] According to one embodiment of the present disclosure, an electronic device may include a communication circuit, a display, and a processor operatively connected to the communication circuit and the display. According to one embodiment, the processor may obtain first location information related to a location of an input device communicatively connected through the communication circuit. According to one embodiment, the processor may receive, from a second electronic device communicatively connected through the communication circuit, second location information related to a location of the input device acquired from the second electronic device. According to one embodiment, the processor may determine a relative location of the second electronic device with respect to the electronic device based on the obtained first location information related to the location of the input device and the received second location information related to the location of the input device. According to one embodiment, the processor may set an arrangement of the display and a second display of the second electronic device based on the determined relative location of the second electronic device.
[0008] According to one embodiment of the present disclosure, a method for controlling a screen using an input device of an electronic device may include an operation of acquiring first location information related to a location of an input device that is communicatively connected through a communication circuit. According to one embodiment, the method for controlling a screen using an input device of an electronic device may include an operation of receiving, from a second electronic device that is communicatively connected through the communication circuit, second location information related to a location of the input device acquired from the second electronic device. According to one embodiment, the method for controlling a screen using an input device of an electronic device may include an operation of confirming a relative location of the second electronic device with respect to the electronic device based on the acquired first location information related to the location of the input device and the received second location information related to the location of the input device. According to one embodiment, the method for controlling a screen using an input device of an electronic device may include an operation of setting an arrangement of a display of the electronic device and a second display of the second electronic device based on the confirmed relative location of the second electronic device.
[0009] According to one embodiment of the present disclosure, a non-transitory computer-readable storage medium (or, a computer program product) storing one or more programs may be described. The one or more programs according to one embodiment may include instructions, when executed by a processor of an electronic device, to obtain first location information related to a location of an input device communicatively connected via a communication circuit. The one or more programs according to one embodiment may include instructions, when executed by the processor of the electronic device, to receive, from a second electronic device communicatively connected via the communication circuit, second location information related to a location of the input device acquired from the second electronic device. The one or more programs according to one embodiment may include instructions, when executed by the processor of the electronic device, to determine a relative location of the second electronic device with respect to the electronic device based on the first location information related to the location of the input device acquired and the second location information related to the location of the input device received. One or more programs according to one embodiment may include instructions that, when executed by a processor of an electronic device, set an arrangement of a display of the electronic device and a second display of the second electronic device based on the identified relative position of the second electronic device.
[0010] An electronic device according to one embodiment of the present disclosure sets the order of displays in which screens are displayed based on the position of a second electronic device confirmed based on first location information related to the position of an input device acquired by the electronic device and second location information related to the position of an input device acquired by the second electronic device, thereby eliminating the inconvenience of a user having to directly set the order of displays in which screens are displayed each time.
[0011] An electronic device according to one embodiment of the present disclosure can provide natural continuity between a display of the electronic device and a screen to be displayed on a second display of the second electronic device by setting display properties of a screen to be displayed on each of the display of the electronic device and the second display of the second electronic device based on the location of the second electronic device.
[0012] FIG. 1 is a block diagram of an electronic device within a network environment according to one embodiment of the present disclosure.
[0013] FIG. 2 is a diagram illustrating a communication connection between a first electronic device, a second electronic device, and an input device according to one embodiment of the present disclosure.
[0014] FIG. 3 is a block diagram illustrating a first electronic device according to one embodiment of the present disclosure.
[0015] FIG. 4 is a block diagram illustrating an input device according to one embodiment of the present disclosure.
[0016] FIG. 5 is a cross-sectional view of an input device according to one embodiment of the present disclosure.
[0017] FIG. 6A is a diagram for explaining a method for setting levels of a display of a first electronic device and a second display of a second electronic device according to one embodiment of the present disclosure.
[0018] FIG. 6b is a flowchart illustrating a method of controlling a screen using an input device of a first electronic device according to one embodiment of the present disclosure.
[0019] FIG. 7 is a drawing for explaining a method of controlling a screen using an input device of a first electronic device according to one embodiment of the present disclosure.
[0020] FIG. 8 is a diagram for explaining a method for setting levels of a display of a first electronic device and a second display of a second electronic device according to one embodiment of the present disclosure.
[0021] FIG. 9 is a drawing for explaining a method of controlling a screen using an input device of a first electronic device according to one embodiment of the present disclosure.
[0022] FIG. 10 is a diagram illustrating signal flow between a first electronic device, an input device, and a second electronic device according to one embodiment of the present disclosure.
[0023] FIG. 11 is a drawing for explaining a method for determining a relative position of a second electronic device with respect to a first electronic device according to one embodiment of the present disclosure.
[0024] FIG. 12 is a drawing for explaining a method for determining the relative position of a second electronic device with respect to a first electronic device according to one embodiment of the present disclosure.
[0025] FIG. 13 is a drawing for explaining a method of controlling a screen using an input device of a first electronic device according to one embodiment of the present disclosure.
[0026] FIG. 14 is a diagram illustrating signal flow between a first electronic device, an input device, and a second electronic device according to one embodiment of the present disclosure.
[0027] FIG. 15 is a diagram illustrating signal flow between a first electronic device, an input device, and a second electronic device according to one embodiment of the present disclosure.
[0028] FIG. 16 is a diagram illustrating a method for resetting levels of a display of a first electronic device and a second display of a second electronic device according to one embodiment of the present disclosure.
[0029] FIG. 17 is a diagram illustrating signal flow between a first electronic device, an input device, and a second electronic device according to one embodiment of the present disclosure.
[0030] FIG. 18 is a diagram for explaining a method for setting levels of a display of a first electronic device and a second display of a second electronic device according to one embodiment of the present disclosure.
[0031] FIG. 19 is a drawing for explaining a method of controlling a screen using an input device of a first electronic device according to one embodiment of the present disclosure.
[0032] FIG. 20 is a diagram for explaining a user interface for levels of a display of a first electronic device and a second display of a second electronic device, and a user interface for indicating a relative position of the second electronic device with respect to the first electronic device, according to one embodiment of the present disclosure.
[0033] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings so that those skilled in the art can easily implement the present disclosure. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein. In connection with the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Furthermore, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and conciseness.
[0034] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to one embodiment of the present disclosure.
[0035] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).
[0036] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or calculations. According to one embodiment, as at least a part of the data processing or calculations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or a secondary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor)) that can operate independently or together therewith. For example, if the electronic device (101) includes a main processor (121) and a secondary processor (123), the secondary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a specified function. The secondary processor (123) may be implemented separately from the main processor (121) or as a part thereof.
[0037] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.
[0038] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).
[0039] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).
[0040] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
[0041] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.
[0042] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. In one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.
[0043] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).
[0044] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
[0045] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
[0046] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0047] A haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. In one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.
[0048] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.
[0049] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least a part of a power management integrated circuit (PMIC).
[0050] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0051] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).
[0052] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.
[0053] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a printed circuit board (PCB)). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas by, for example, the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).
[0054] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.
[0055] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).
[0056] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.
[0057] FIG. 2 is a diagram illustrating a communication connection between a first electronic device (210), a second electronic device (220), and an input device (230) according to one embodiment of the present disclosure.
[0058] Referring to FIG. 2, the first electronic device (210), the second electronic device (220), and the input device (230) may be connected to each other through a designated communication. For example, the designated communication may include short-range communication (e.g., Bluetooth, BLE (Bluetooth low energy), WiFi, WiFi direct, WiFi aware, or UWB (ultra wide band)).
[0059] In one embodiment, the first electronic device (210) and the second electronic device (220) may be devices having displays (211, 221).
[0060] In one embodiment, the input device (230) may include a smart ring (230) that can be worn on a body part (e.g., a finger). However, the input device (230) is not limited thereto, and may be any type of input device, and may include, for example, an electronic pen.
[0061] In one embodiment, the first electronic device (210) may perform an operation to establish an initial communication connection with the second electronic device (220) and / or the input device (230) if there is no history of communication connection between the first electronic device (210) and the second electronic device (220) and / or the input device (230). For example, an input device (230) in proximity to a first electronic device (210) can broadcast a signal including information of a second electronic device (220) (e.g., identification information of the second electronic device (220) (e.g., a name of the second electronic device (220)), a type of the second electronic device (220), information related to a second display (221) (e.g., resolution information and / or refresh rate), and / or MAC address information) and / or information of an input device (230) (e.g., identification information of the input device (230) (e.g., a name of the input device (230)), a type of the input device (230), and / or MAC address information). The first electronic device (210) can scan for a certain period of time (or at certain time intervals) to receive the signal broadcast by the second electronic device (220) and / or the input device (230). The first electronic device (210) may communicate with the second electronic device (220) and / or the input device (230) by transmitting a response signal including information of the first electronic device (210) (e.g., identification information of the first electronic device (210) (e.g., a name of the first electronic device (210)), a type of the first electronic device (210), information related to the display (211) (e.g., resolution information and / or refresh rate), and / or MAC address information) in response to receiving a signal broadcast by the second electronic device (220) and / or the input device (230).
[0062] In one embodiment, if there is a history of communication connection between the second electronic device (220) and / or the input device (230) and the first electronic device (210), the first electronic device (210) may compare information of the second electronic device (220) and / or the input device (230) included in a signal broadcast by the second electronic device (220) and / or the input device (230) with information of the second electronic device (220) and / or the input device (230) stored in a memory, and establish a communication connection with the second electronic device (220) and / or the input device (230) based on at least some matching information.
[0063] In one embodiment, the input device (230) may include a light emitting unit (not shown). In one embodiment, the light emitting unit may emit a light signal of a specified pattern. The light signal of the specified pattern may mean a light signal of a specific pattern, a specific period, and / or a specific length, but is not limited thereto.
[0064] In one embodiment, the first electronic device (210) may receive a light signal of a specified pattern emitted from a light emitting unit of the input device (230). The first electronic device (210) may obtain first location information of the input device (230) based on the light signal of the specified pattern emitted from the light emitting unit of the input device (230). For example, the first electronic device (210) may obtain first location information related to a location of the input device (230) based on a timeline in which the light signal of the specified pattern was received from the input device (230). For example, the timeline may indicate time information (e.g., one or more aligned points in time, time periods) related to (e.g., related to a location of) a signal or information received from the input device (e.g., related to the location of the input device). For example, the timeline may indicate time information (e.g., including related location information) related to receiving a light signal from the input device. That is, in some examples, the timeline may represent time information (one or more aligned points in time, or a period) regarding the time at which an optical signal (containing location information) is received. The first electronic device (210) may obtain first location information based on the time information corresponding to the optical signal received from the input device (230).
[0065] In one embodiment, the second electronic device (220) can receive a light signal of a specified pattern emitted from a light emitting unit of the input device (230). The second electronic device (220) can obtain second location information of the input device (230) based on the light signal of the specified pattern emitted from the light emitting unit of the input device (230). For example, the second electronic device (220) can obtain second location information related to the location of the input device (230) based on a timeline in which the light signal of the specified pattern was received from the input device (230). For example, the second electronic device (220) can obtain second location information based on time information in which the light signal was received from the input device (230). The second electronic device (220) can transmit the obtained second location information related to the location of the input device (230) to the first electronic device (210).
[0066] In one embodiment, the first electronic device (210) can compare the first location information of the input device (230) with the second location information of the input device (230) received from the second electronic device (220) in a timeline. Based on the result of comparing the first location information of the input device (230) acquired by the first electronic device (210) with the second location information of the input device (230) received from the second electronic device (220) in a timeline, the first electronic device (210) can estimate the location and / or movement (e.g., movement direction) of the input device (230) and determine the relative location of the second electronic device (220) with respect to the first electronic device (210). For example, comparing the first location information and the second location may be based on time information associated with the first location information (e.g., the time at which the first electronic device (210) received information of an optical signal associated with the first location information) and time information associated with the second location information (e.g., the time at which the second electronic device (220) received information of an optical signal associated with the second location information). The first electronic device (210) may set the levels (e.g., arrangement) of the display (211) of the first electronic device (210) and the second display (221) of the second electronic device (220) based on the identified relative position of the second electronic device (220).
[0067] In examples related to the present disclosure, setting the levels of the display (211) and the second display (221) may mean configuring (or determining) the arrangement, alignment, or positioning (e.g., display arrangement, display configuration, relative display levels) of the display (211) and the second display (221) based on the identified relative positions of the second electronic device (220). For example, configuring the arrangement (e.g., levels) of the displays may mean configuring or setting the arrangement of the displays (e.g., in relation to setting the relative order, relative height, and / or position of the displays). This may relate to devices used as extended screens, such as when an application running on one device can be at least partially displayed on the display screen of a connected device. In examples described herein, the display devices may be configured or arranged based on the identified relative positions to provide continuity across the display (e.g., extended display).
[0068] For example, the first electronic device (210) can set the display properties of the first screen to be displayed on the display (211) and the display properties of the second screen to be displayed on the second display (221) based on the display (211) of the first electronic device (210) and the second display (221) of the second electronic device (220) that are set. For example, the display properties may include the resolution, refresh rate, brightness, and / or the size of at least one object constituting the screen of the display. However, the present invention is not limited thereto. The first electronic device (210) can display the first screen on the display (211) based on the set first display properties, and can display the second screen on the second display (221) of the second electronic device (220) based on the set second display properties.
[0069] In connection with the above, various embodiments will be described below.
[0070] FIG. 3 is a block diagram illustrating a first electronic device (210) according to one embodiment of the present disclosure.
[0071] Referring to FIG. 3, a first electronic device (210) (e.g., the electronic device (101) of FIG. 1 and the first electronic device (210) of FIG. 2) may include a communication circuit (310) (e.g., the communication module (190) of FIG. 1), a memory (320) (e.g., the memory (130) of FIG. 1), a camera (330) (e.g., the camera module (180) of FIG. 1), a sensor circuit (340) (e.g., the sensor module (176) of FIG. 1), a touchscreen display (350) (e.g., the display module (160) of FIG. 1), and / or a processor (360) (e.g., the processor (120) of FIG. 1).
[0072] According to one embodiment of the present disclosure, a communication circuit (310) (e.g., a communication module (190) of FIG. 1) may control a communication connection between a first electronic device (210) and at least one external electronic device (e.g., an electronic device (102) of FIG. 1, an electronic device (104) of FIG. 1, a second electronic device (220) of FIG. 2, an input device (230)) (and / or a server (e.g., a server (108) of FIG. 1)) under the control of a processor (360).
[0073] According to one embodiment of the present disclosure, the memory (320) (e.g., the memory (130) of FIG. 1) performs a function of storing a program (e.g., the program (140) of FIG. 1) for processing and controlling the processor (360) of the first electronic device (210), an operating system (OS) (e.g., the operating system (142) of FIG. 1), various applications, and / or input / output data, and may store a program for controlling the overall operation of the first electronic device (210). The memory (320) may store various setting information required when processing functions related to various embodiments of the present disclosure in the first electronic device (210).
[0074] In one embodiment, the memory (320) may store instructions for obtaining first location information related to the location of the input device (230) via the camera (330), the sensor circuit (340), and / or UWB communication. The memory (320) may store instructions for determining a relative location of the second electronic device (220) with respect to the first electronic device (210) based on the first location information related to the location of the input device (230) and the second location information related to the location of the input device (230) received from the second electronic device (230). The memory (320) may store instructions for setting levels of the display (351) and the second display (221) based on the determined relative location of the second electronic device (220). The memory (320) can store instructions for setting display properties of a first screen to be displayed on the display (351) and display properties of a second screen to be displayed on the second display (221) based on the levels of the set display (351) and the second display (221).
[0075] In one embodiment, the memory (320) may store instructions for obtaining information related to movement of the first electronic device (210) via the sensor circuit (340).
[0076] The memory (320) may store instructions for executing a mode for resetting the level of the display (351) and the second display (221) of the second electronic device (220) based on detecting a specific gesture of the input device (230).
[0077] According to one embodiment of the present disclosure, a camera (330) (e.g., the camera module (180) of FIG. 1) may transmit collected images to a display (351) as a preview screen, allowing a user to check the images projected through the camera (330). In response to an input requesting a photograph, the camera (330) may capture the collected images at the time the input requesting a photograph occurs, thereby generating image data. In one embodiment, one or more cameras (330) may be provided.
[0078] In one embodiment, the camera (330) can track an optical signal output from a light emitting unit of the input device (230).
[0079] According to one embodiment of the present disclosure, a sensor circuit (340) (e.g., sensor module (176) of FIG. 1) may measure a physical quantity or detect a state of a first electronic device (210) and generate an electrical signal or data value corresponding thereto.
[0080] In one embodiment, the sensor circuit (340) may include a distance measurement sensor (341), a light sensor (343), and / or an inertial sensor (345).
[0081] In one embodiment, the distance measuring sensor (341) may include a ToF (time of flight) sensor. The ToF sensor may include a light emitting unit (e.g., an emitter) for radiating a laser light source to the outside, and a light receiving unit (e.g., a receiver) for detecting light that is reflected by an external object after being radiated from the emitter. For example, the ToF sensor may obtain (or calculate) distance information and / or depth information with respect to an external object by utilizing a time difference (or phase difference) between the time that light radiated from the emitter is reflected by an external object and received by the light receiving unit (e.g., a receiver).
[0082] In one embodiment, the light sensor (343) can receive a light signal output from a light emitting unit of the input device (230).
[0083] In one embodiment, the inertial sensor (345) may include a motion sensor and / or a nine-axis sensor (e.g., a geomagnetic sensor, an acceleration sensor, and / or a gyro sensor). For example, the acceleration sensor may measure acceleration acting in three axes (e.g., the x-axis, the y-axis, and the z-axis) and may use the measured acceleration to measure, estimate, and / or detect a force being applied to the first electronic device (210). The gyro sensor may be located within the first electronic device (210) and configured to measure rotation associated with the first electronic device (210). The gyro sensor may be configured to measure rotation about three axes (e.g., the x-axis, the y-axis, and the z-axis). The geomagnetic sensor may measure a geomagnetic vector about three axes (e.g., the x-axis, the y-axis, and the z-axis) and may use the magnitude and direction of the geomagnetic vector to measure an azimuth of the first electronic device (210). An acceleration sensor, a gyro sensor, and a geomagnetic sensor may be implemented by being integrated into a single sensor (e.g., a 9-axis sensor). The sensor circuit (340) (e.g., a motion sensor, an acceleration sensor, a geomagnetic sensor, and / or a gyro sensor) may obtain information related to the movement of the first electronic device (210) (e.g., movement speed information, movement direction information, movement distance information, and / or inclination information of the first electronic device (210). The sensor circuit (340) may transmit the obtained information related to the movement of the first electronic device (210) to the processor (360).
[0084] According to one embodiment of the present disclosure, a touchscreen display (350) (e.g., display module (160) of FIG. 1) may be configured as an integrated unit including a display (351) (e.g., display (211) of FIG. 2) and a touch panel (353).
[0085] In one embodiment, the touchscreen display (350) displays an image under the control of the processor (360) and may be implemented as any one of a liquid crystal display (LCD), a light-emitting diode (LED) display, a micro LED (μLED) display, an organic light-emitting diode (OLED) display, an active matrix organic light-emitting diode (AMOLED) display, a micro electro mechanical systems (MEMS) display, an electronic paper display, a flexible display, a foldable display, or a rollable display, but is not limited thereto.
[0086] In one embodiment, the touch panel (353) may be a composite touch panel comprising a hand touch panel for detecting hand gestures and a pen touch panel for detecting pen gestures.
[0087] In one embodiment, the touchscreen display (350) can display a first screen including at least one object under the control of the processor (360). The touchscreen display (350) can display the first screen including at least one object based on set display properties under the control of the processor (360). The touchscreen display (350) can display an indicator indicating a level of the display (351) under the control of the processor (360). The touchscreen display (350) can display an indicator indicating a relative position of the second electronic device (220) with respect to the first electronic device (210) under the control of the processor (360).
[0088] According to one embodiment of the present disclosure, the processor (360) may include, for example, a micro controller unit (MCU), and may control a plurality of hardware components connected to the processor (360) by running an operating system (OS) or an embedded software program. The processor (360) may control a plurality of hardware components according to, for example, instructions stored in a memory (320) (e.g., a program (140) of FIG. 1).
[0089] In one embodiment, the processor (360) may obtain first location information related to the location of the input device (230) connected to the communication. For example, the processor (360) may receive an optical signal of a specified pattern emitted from a light emitting unit of the input device (230) through a receiving unit of the distance measuring sensor (341). The processor (360) may obtain first location information related to the location of the input device (230) based on receiving the optical signal of the specified pattern emitted from the light emitting unit of the input device (230) through the receiving unit of the distance measuring sensor (341). For example, the processor (360) may obtain first location information related to the location of the input device (230) based on a timeline in which the optical signal of the specified pattern was received from the input device (230). For example, the processor (360) may also obtain first location information related to the location of the input device (230) through the camera (330). For example, the processor (360) can obtain first time information related to the position of the input device (230) based on time information at which a light signal of a specified pattern is received (e.g., detected) by the receiving unit of the distance measuring sensor (341). For example, the processor (360) can track a light signal of a specified pattern emitted from a light emitting unit of the input device (230) using the camera (330), and, based on this, obtain first position information related to the position of the input device (230) (e.g., information related to movement of the input device (230) (e.g., movement in a specific direction)).
[0090] For example, the processor (360) may obtain first location information related to the location of the input device (230) through UWB communication. For example, the UWB communication may include communication for measuring the distance (or location) between the first electronic device (210) and the input device (230) in a two way ranging (TWR) manner between the first electronic device (210) and the input device (230). For example, the processor (360) may obtain first location information related to the location of the input device (230) based on information related to the movement of the input device (230) received from the input device (230).
[0091] In one embodiment, the processor (360) may receive, from a second electronic device (220) connected to the communication, second location information related to the location of the input device (230) acquired by the second electronic device (220). The processor (360) may determine the relative location of the second electronic device (220) with respect to the first electronic device (210) based on the first location information related to the location of the input device (230) and the second location information related to the location of the input device (230). For example, the processor (360) may compare the first location information of the input device (230) acquired by the first electronic device (210) and the second location information of the input device (230) received from the second electronic device (220) using a timeline. The processor (360) can estimate (e.g., determine) the position and / or movement (e.g., direction of movement) of the input device (230) based on a result of comparing the first position information of the input device (230) obtained from the first electronic device (210) and the second position information of the input device (230) received from the second electronic device (220) in a timeline. For example, the processor (360) can compare the first position information and the second position information based on time information (e.g., timelines of the two pieces of information) of the first position information and the second position information received from the devices. The processor (360) can determine the relative position of the second electronic device (220) with respect to the first electronic device (210) based on the movement direction according to the estimated movement of the input device (230). The processor (360) can set the level of the display (351) of the first electronic device (210) and the second display (e.g., the second display (221) of FIG. 2) of the second electronic device (220) based on the relative position of the identified second electronic device (220).
[0092] In one embodiment, the processor (360) may determine distance information and / or depth information with respect to the second electronic device (220) based on the relative position of the second electronic device (220). The processor (360) may set a first display property on a first screen to be displayed on the display (351) based on the distance information and / or depth information with respect to the second electronic device (220), and may set a second display property on a second screen to be displayed on the second display (221) of the second electronic device (220). For example, the display property may include the resolution, refresh rate, brightness, and / or the size of at least one object constituting the screen of the display. However, the present invention is not limited thereto. The processor (360) may display a first screen on the display (351) based on the first display property, and may display a second screen on the second display (221) of the second electronic device (220) based on the second display property.
[0093] In various embodiments, although not shown, the second electronic device (220) illustrated in FIG. 2 may include the same components as the components of the first electronic device (210) described above. For example, the second electronic device (220) may include a communication circuit (e.g., a communication module (190) of FIG. 1), a memory (e.g., a memory (130) of FIG. 1), a camera (e.g., a camera module (180) of FIG. 1), a sensor circuit (e.g., a sensor module (176) of FIG. 1), a touchscreen display (e.g., a display module (160) of FIG. 1, a second display (221) of FIG. 2), and / or a processor (e.g., a processor (120) of FIG. 1).
[0094] In one embodiment, the second electronic device (220) can obtain second location information related to the location of the input device (230) to which it is communicatively connected. For example, the second electronic device (220) can receive an optical signal of a specified pattern emitted from a light emitting unit of the input device (230) through a receiving unit of a sensor circuit (e.g., a distance measuring sensor). The second electronic device (220) can obtain second location information related to the location of the input device (230) based on receiving the optical signal of a specified pattern emitted from the light emitting unit of the input device (230) through the receiving unit of the sensor circuit (e.g., a distance measuring sensor). The second electronic device (220) can transmit the obtained second location information related to the location of the input device (230) to the first electronic device (210) to which it is communicatively connected. A second screen based on the second display property set by the first electronic device (210) can be displayed on the display (221) of the second electronic device (220).
[0095] FIG. 4 is a block diagram illustrating an input device (230) according to one embodiment of the present disclosure.
[0096] Referring to FIG. 4, the input device (230) may include a communication circuit (410) (e.g., the communication module (190) of FIG. 1), a memory (420) (e.g., the memory (130) of FIG. 1), a sensor circuit (430) (e.g., the sensor module (176) of FIG. 1), a battery (440) (e.g., the battery (189) of FIG. 1), and / or a processor (450) (e.g., the processor (120) of FIG. 1).
[0097] According to one embodiment of the present disclosure, a communication circuit (410) (e.g., a communication module (190) of FIG. 1) may control a communication connection between an input device (230) and a first electronic device (210) and / or a second electronic device (220) under the control of a processor (450).
[0098] According to one embodiment of the present disclosure, the memory (420) (e.g., the memory (130) of FIG. 1) performs a function of storing a program (e.g., the program (140) of FIG. 1) for processing and controlling the processor (450) of the input device (230), an operating system (OS) (e.g., the operating system (142) of FIG. 1), various applications, and / or input / output data, and may store a program for controlling the overall operation of the input device (230). The memory (420) may store various setting information required when processing functions related to various embodiments of the present disclosure in the input device (230).
[0099] In one embodiment, the memory (420) can store instructions for emitting a light signal of a specified pattern through the light emitting portion of the optical sensor (433).
[0100] In one embodiment, the memory (420) may store instructions for obtaining information related to movement of the input device (230) via the sensor circuit (430).
[0101] According to one embodiment of the present disclosure, a sensor circuit (430) (e.g., sensor module (176) of FIG. 1) can measure a physical quantity or detect a state of an input device (230) and generate an electrical signal or data value corresponding thereto.
[0102] In one embodiment, the sensor circuit (430) may include an inertial sensor (431) and / or an optical sensor (433).
[0103] In one embodiment, the inertial sensor (431) may include a motion sensor, and / or a 9-axis sensor (e.g., a magnetometer, an acceleration sensor, and / or a gyro sensor). For example, the acceleration sensor may measure acceleration acting in three axes (e.g., the x-axis, the y-axis, and the z-axis) and may use the measured acceleration to measure, estimate, and / or detect a force being applied to the input device (230). The gyro sensor may be configured to measure rotation associated with the input device (230). The gyro sensor may be configured to measure rotation about three axes (e.g., the x-axis, the y-axis, and the z-axis). The magnetometer sensor may measure a geomagnetic vector about three axes (e.g., the x-axis, the y-axis, and the z-axis) and may use the magnitude and direction of the geomagnetic vector to measure the azimuth of the input device (230). An acceleration sensor, a gyro sensor, and a geomagnetic sensor can be implemented by integrating them into a single sensor (e.g., a 9-axis sensor). The sensor circuit (340) (e.g., a motion sensor, an acceleration sensor, a geomagnetic sensor, and / or a gyro sensor) can obtain information related to the movement of the input device (230) (e.g., movement speed information, movement direction information, movement distance information, and / or inclination information of the input device (230). The sensor circuit (340) can transmit the obtained information related to the movement of the input device (230) to the processor (360).
[0104] In one embodiment, the optical sensor (433) may include a light emitter and a light receiver. For example, the light emitter of the optical sensor (433) may be implemented to output light of various wavelength bands and / or various intensities, respectively. For example, the light emitter may include a plurality of light emitting elements (e.g., LEDs) capable of outputting at least one of red light, green light, blue light, and / or infrared (IR) light. For example, the light emitter may include at least one of a light emitting diode (LED), an organic light emitting diode (OLED), a semiconductor laser (LD), a solid laser, or an infrared (IR) diode. The light receiver of the optical sensor (433) may include various elements capable of detecting an optical signal, converting it into an electrical signal, and outputting it. For example, the light receiver may include at least one of a photodiode (PD), an avalanche photodiode (APD), a phototransistor, or an image sensor.
[0105] According to one embodiment of the present disclosure, a battery (440) (e.g., battery (189) of FIG. 1) may power at least one component of the input device (230). According to one embodiment, the battery (440) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0106] According to one embodiment of the present disclosure, the processor (450) may include, for example, a microcontroller unit (MCU), and may control a plurality of hardware components connected to the processor (450) by running an operating system (OS) or an embedded software program. The processor (450) may control a plurality of hardware components according to, for example, instructions stored in a memory (420) (e.g., a program (140) of FIG. 1).
[0107] In one embodiment, the processor (450) may emit an optical signal of a specified pattern through the light emitting unit of the optical sensor (433). For example, the optical signal of the specified pattern may mean an optical signal of a specific pattern, a specific cycle, and / or a specific length. However, the present invention is not limited thereto. The processor (450) may obtain information related to the movement of the input device (230) through the sensor circuit (430) and transmit the information to the first electronic device (210) and / or the second electronic device (220).
[0108] An electronic device (210) according to one embodiment of the present disclosure may include a communication circuit (310), a display (351), and a processor (360) operatively connected to the communication circuit (310) and the display (351). The processor (360) according to one embodiment may obtain first location information related to a location of an input device (230) communicatively connected through the communication circuit (310). The processor (360) according to one embodiment may receive second location information related to a location of the input device (230) obtained by the second electronic device (220) from a second electronic device (220) communicatively connected through the communication circuit (310). According to one embodiment, the processor (360) can determine the relative position of the second electronic device (220) with respect to the electronic device (210) based on first position information related to the position of the acquired input device (230) and second position information related to the position of the input device (230) received from the second electronic device (220). According to one embodiment, the processor (360) can set the arrangement of the display (351) and the second display (221) of the second electronic device (220) based on the determined relative position of the second electronic device (210).
[0109] An electronic device (210) according to one embodiment may include a distance measurement sensor (341). A processor (360) according to one embodiment may receive, through a receiving unit of the distance measurement sensor (341), an optical signal emitted in a specified pattern from a light emitting unit of an input device (230). The processor (360) according to one embodiment may obtain first location information related to a location of the input device (230) based on at least one piece of time information about a time point at which the optical signal of the specified pattern is received from the input device (230).
[0110] The processor (360) according to one embodiment may receive information related to movement of the input device (230) from the input device (230). The processor (360) according to one embodiment may obtain first position information related to the position of the input device (230) based on at least one of time information about a time point at which a light signal of a specified pattern is received from the input device (230) and at least one time information about a time point at which information related to movement of the input device (230) is received.
[0111] An electronic device (210) according to one embodiment may include a memory (320). A processor (360) according to one embodiment may store in the memory (320) at least one piece of time information regarding a time point at which an optical signal of a specified pattern is received from an input device (230) and at least one piece of time information regarding a time point at which information related to movement of the input device (230) is received. For example, the processor (360) may store time information (e.g., a timeline) related to a received optical signal in the memory (320). In one embodiment, the processor (360) may store information related to movement of the input device (230) (e.g., information related to time information for a received optical signal) for each timeline.
[0112] The processor (360) according to one embodiment can check the shape of the optical signal received through the receiving unit of the distance measuring sensor (341). The processor (360) according to one embodiment can obtain first position information related to the position of the input device (230) based on the shape of the optical signal received by timeline (e.g., related to time information that can include one or more points in time for the received optical signal).
[0113] According to one embodiment, the processor (360) may compare at least one piece of time information related to a time point at which first location information related to the location of the input device (230) is acquired with at least one piece of time information related to a time point at which second location information is received. Based on the comparison result, the processor (360) according to one embodiment may estimate at least one of the location and movement of the input device (230). Based on at least one of the estimated location and movement of the input device (230), the processor (360) according to one embodiment may determine the relative location of the second electronic device (220) with respect to the electronic device (210).
[0114] According to one embodiment, the processor (360) may check at least one of distance information and depth information with respect to the second electronic device (220) based on the confirmed relative position of the second electronic device (220). According to one embodiment, the processor (360) may set a first display property on a first screen to be displayed on the display (351) and set a second display property on a second screen to be displayed on the second display (221) of the second electronic device (220) based on at least one of distance information and depth information with respect to the second electronic device (220). According to one embodiment, the processor (360) may display the first screen on the display (351) based on the set first display property, and display the second screen on the second display (221) of the second electronic device (220) based on the set second display property.
[0115] According to one embodiment, the processor (360) may receive information related to the movement of the second electronic device (220) from the second electronic device (220). According to one embodiment, the processor (360) may receive, through the receiving unit of the distance measuring sensor (341), an optical signal emitted in a second designated pattern from the light emitting unit of the input device (230). According to one embodiment, the processor (360) may obtain third location information related to the location of the input device (230) based on the received optical signal of the second designated pattern. According to one embodiment, the processor (360) may receive, from the second electronic device (220), fourth location information related to the location of the input device (230) obtained from the second electronic device (220). According to one embodiment, the processor (360) can determine the second relative position of the second electronic device (220) with respect to the electronic device (210) based on the third position information and the fourth position information related to the position of the input device (230). According to one embodiment, the processor (360) can reset the arrangement of the display (351) of the electronic device (210) and the second display (221) of the second electronic device (220) based on the second relative position of the second electronic device (220).
[0116] According to one embodiment, the processor (360) may receive information related to movement of the input device (230) from the input device (230). According to one embodiment, the processor (360) may detect a specific gesture based on the information related to movement of the input device (230) received from the input device (230). According to one embodiment, the processor (360) may determine, based on the detection of the specific gesture, a mode for reconfiguring the arrangement of the display (351) and the second display (221) of the second electronic device (220). For example, based on the received information related to movement of the input device (230), the processor (360) may determine (or determine) that a specific gesture has been performed, and the specific gesture may be a gesture corresponding to (e.g., starting or entering) a mode for reconfiguring the display levels (e.g., display arrangement) of the display (351) and the second display (221).
[0117] According to one embodiment, the processor (360) may display an indicator indicating a relative position (e.g., a confirmed relative position) of the second electronic device (220) with respect to the electronic device (210) on at least a portion of the display (351).
[0118] FIG. 5 is a cross-sectional view of an input device (230) according to one embodiment of the present disclosure.
[0119] Referring to FIG. 5, the input device (230) may be formed in a circular shape. Although the drawing illustrates an example in which the input device (230) is formed in a ring-type circular shape, the input device (230) may be formed in various shapes such as a square or polygon.
[0120] In one embodiment, the device may include a battery (520) disposed inside a housing (510) and a substrate (530) including a plurality of electrical elements. In one embodiment, the battery (520) and the substrate (530) may be disposed in opposite directions to each other.
[0121] In one embodiment, the substrate (530) may be positioned so as to be attached to the inner surface of the housing (510). For example, the substrate (530) may include a flexible printed circuit board (FPCB).
[0122] For example, the inner circumference of the housing (510) may refer to a surface (e.g., the inner side) that comes into contact with a finger when a user wears the ring-type input device (230) on the finger. The outer circumference of the housing (510) may refer to a surface (e.g., the outer side) that does not come into contact with a finger when a user wears the ring-type input device (230) on the finger. For example, the outer circumference of the housing (510) may correspond to a large circumference of a circle, and the inner circumference may have a small circumference of a circle.
[0123] In one embodiment, the plurality of electrical components disposed on the substrate (530) may include a power management integrated circuit (PMIC) (535), a communication circuit (540), a memory (550), an inertial sensor (555), a sensor receiver (560), a sensor emitter (565), a sensor control circuit (570), a temperature sensor (575), and / or a processor (545).
[0124] In one embodiment, the input device (230) may further include a charging interface (525) and an antenna (580) that are arranged to be attached to the inner surface of the housing (510) and electrically connect the battery (520) and the substrate (530).
[0125] Among the plurality of electrical elements arranged on the substrate (530) according to one embodiment, the communication circuit (540), the memory (550), the inertial sensor (555), the sensor receiver (560), the sensor light-emitting unit (565), and the processor (545) are substantially the same as the communication circuit (410), the memory (420), the inertial sensor (431), the receiver and light-emitting unit of the optical sensor (433), and the processor (450) of the input device (230) described in FIG. 4, and thus, a detailed description thereof may be replaced with the description of FIG. 4.
[0126] In one embodiment, the PMIC (535) can manage power supplied to the input device (230). The sensor control circuit (570) can control the operation of the sensor receiver (560) and the sensor light emitter (565). For example, the sensor control circuit (570) can control the sensor light emitter (565) to emit an optical signal in a specified pattern. The sensor control circuit (570) can measure the time for the sensor light emitter (565) to emit an optical signal. The sensor control circuit (570) can measure the time difference (or phase difference) for an optical signal emitted from the sensor light emitter (565) to be reflected by an external object and received by the sensor light receiver (560). However, the present invention is not limited thereto.
[0127] In one embodiment, the temperature sensor (575) can measure a body temperature. However, the temperature sensor (575) may also measure the temperature of at least one of a plurality of electrical elements included in the input device (230).
[0128] FIG. 6A is a drawing for explaining a method of setting the levels of a display (351) of a first electronic device (210) and a second display (221) of a second electronic device (220) according to one embodiment of the present disclosure.
[0129] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.
[0130] According to one embodiment, operations 605 to 620 may be understood to be performed in a processor (e.g., processor (360) of FIG. 3) of a first electronic device (e.g., first electronic device (210) of FIG. 2).
[0131] In various embodiments, a first electronic device (210), a second electronic device (e.g., the second electronic device (220) of FIG. 2), and an input device (e.g., the input device (230) of FIG. 2) may be communicatively connected via a designated communication. The designated communication may include short-range wireless communication such as UWB, Bluetooth, or low-power Bluetooth.
[0132] Referring to FIG. 6A, the processor (360) can obtain first location information related to the location of the input device (230) connected to the communication in operation 605.
[0133] In one embodiment, the input device (230) may include a wearable electronic device (e.g., a smart ring) that can be worn on a body part (e.g., a finger). However, the input device (230) may also include an electronic pen or other input device. The input device (230) may include a light emitting unit (e.g., the light emitting unit of the optical sensor (433) of FIG. 4). In one embodiment, the light emitting unit may emit an optical signal of a specified pattern. The optical signal of the specified pattern may mean an optical signal of a specific pattern, a specific cycle, and / or a specific length. However, the present invention is not limited thereto.
[0134] In one embodiment, the input device (230) may emit a light signal of a specified pattern through a light emitting unit under specified conditions. For example, the specified condition may include a case where the input device (230) receives a signal related to setting a level of a display (e.g., display (351) of FIG. 3 ) from the first electronic device (210). However, the specified condition may also include a case where the input device (230) is in communication with the first electronic device (210) and / or the second electronic device (220).
[0135] In one embodiment, the processor (360) may obtain first location information related to the location of the input device (230) through a distance measurement sensor (e.g., the distance measurement sensor (341) of FIG. 3), a camera (e.g., the camera (330) of FIG. 3), UWB communication, and / or information related to the movement of the input device (230) received from the input device (230). In this regard, this will be discussed in detail below.
[0136] In one embodiment, the processor (360) may receive an optical signal of a specified pattern emitted from the light emitting unit of the input device (230) through the receiving unit of the distance measuring sensor (341). Based on receiving the optical signal of the specified pattern emitted from the light emitting unit of the input device (230) through the receiving unit of the distance measuring sensor (341), the processor (360) may obtain first location information related to the location of the input device (230). For example, the processor (360) may obtain first location information related to the location of the input device (230) based on a timeline in which the optical signal of the specified pattern emitted from the input device (230) was received. The processor (360) may store a timeline (e.g., time information) for the time point in which the optical signal of the specified pattern emitted from the light emitting unit of the input device (230) was received in a memory (e.g., the memory (320) of FIG. 3).
[0137] In one embodiment, the processor (360) may obtain first location information related to the location of the input device (230) through a camera (e.g., the camera (330) of FIG. 3). For example, the processor (360) may track a light signal of a specified pattern emitted from a light emitting unit of the input device (230) using the camera (330). Based on tracking the light signal of the specified pattern, the processor (360) may obtain first location information related to the location of the input device (230). For example, the first location information related to the location of the input device (230) obtained by tracking the light signal through the camera (330) may include information related to a movement of the input device (230) (e.g., a movement in a specific direction). The processor (360) may map a timeline at a time point when the light signal is received and location information of the input device (230) for each timeline and store the mapped information in the memory (320). For example, the processor (360) may map time information (e.g., point in time) at which an optical signal is received to position information of an input device (230) received during the time information (timeline), and store the mapped information in the memory (320).
[0138] In one embodiment, the processor (360) may obtain first location information related to the location of the input device (230) via UWB communication. For example, the processor (360) may broadcast a first message (e.g., a poll message) for distance measurement via UWB communication. The UWB communication may include communication for measuring the distance (or location) between the first electronic device (210) and the input device (230) in a two-way ranging (TWR) manner between the first electronic device (210) and the input device (230). In one embodiment, the TWR manner may include a single-side TWR (SS-TWR) manner or a double-side TWR (DS-TWR) manner.
[0139] In one embodiment, the SS-TWR method may be a method in which the first electronic device (210) transmits a first message (e.g., a poll message) to the input device (230), and the input device (230) transmits a second message (e.g., a response message) to the first electronic device (210). In SS-TWR, the first electronic device (210) may measure (or calculate) a distance to the input device (230) based on a difference between the time at which the first message (e.g., the poll message) is transmitted and the time at which the second message (e.g., the response message) is received from the input device (230). In one embodiment, the processor (360) may store the time at which the first message (e.g., the poll message) is transmitted, the time at which the second message (e.g., the response message) is received from the input device (230), and / or the measured distance to the input device (230) in the memory (320).
[0140] In one embodiment, the DS-TWR method may cause the input device (230) to transmit a second message (e.g., a response message) to the first electronic device (210) when the first electronic device (210) transmits a first message (e.g., a poll message). In response to the second message (e.g., a response message), the first electronic device (210) may transmit a third message (e.g., a final message) to the input device (230) that includes a response time calculated based on a difference between the time at which the first message (e.g., the poll message) was transmitted and the time at which the second message (e.g., the response message) was received from the input device (230). The first electronic device (210) may measure (or calculate) a distance to the input device (230) based on the first message, the second message, and the third message. In one embodiment, the processor (360) may store in the memory (320) the time at which a first message (e.g., a poll message) was transmitted, the time at which a second message (e.g., a response message) was received from the input device (230), the time at which a third message (e.g., a final message) was transmitted, and / or the measured distance from the input device (230).
[0141] In one embodiment, the processor (360) may obtain first position information related to the location of the input device (230) based on information related to the movement of the input device (230) received from the input device (230). For example, the input device (230) may obtain information related to the movement of the input device (230) using an inertial sensor (e.g., the inertial sensor (431) of FIG. 4). For example, the information related to the movement of the input device (230) may include movement speed information, movement direction information, movement distance information, and / or inclination information of the input device (230). However, the present invention is not limited thereto. The input device (230) may transmit information related to the movement of the input device (230) obtained through the inertial sensor (431) to a first electronic device (210) connected to the communication. The processor (360) can obtain first location information related to the location of the input device (230) based on information related to the movement of the input device (230) received from the input device (230). The processor (360) can map information related to the movement of the input device (230) and time information at the time of receiving the information related to the movement from the input device (230) and store the mapped information in the memory (320).
[0142] In one embodiment, the first location information related to the position of the input device (230) is described as being obtained based on each of the reception of an optical signal of a specified pattern, tracking of the optical signal using the camera (330), UWB communication, and information related to the movement of the input device (230), but is not limited thereto. For example, the processor (360) may obtain the first location information related to the position of the input device (230) based on a combination of at least two of the reception of an optical signal of a specified pattern, tracking of the optical signal using the camera (330), UWB communication, and information related to the movement of the input device (230).
[0143] In one embodiment, the processor (360) may, in operation 610, receive second location information related to the location of the input device (230) obtained from a second electronic device (e.g., the second electronic device (220) of FIG. 2) connected to the communication device.
[0144] In one embodiment, the second electronic device (220) may obtain second location information related to the location of the input device (230) in the same manner as the first electronic device (210) described above obtains first location information related to the location of the input device (230).
[0145] For example, the second electronic device (220) can receive an optical signal of a specified pattern emitted from the light emitting unit of the input device (230) through the receiving unit of the distance measuring sensor. The second electronic device (220) can obtain second location information related to the location of the input device (230) based on receiving the optical signal of a specified pattern emitted from the light emitting unit of the input device (230) through the receiving unit of the distance measuring sensor. For example, the second electronic device (220) can obtain second location information related to the location of the input device (230) based on a timeline in which the optical signal of a specified pattern emitted from the input device (230) was received. The second electronic device (220) can store a timeline (e.g., time information) for the time point in which the optical signal of a specified pattern emitted from the light emitting unit of the input device (230) was received in the memory.
[0146] For example, the second electronic device (220) can track a light signal of a specified pattern emitted from a light emitting unit of the input device (230) using a camera. Based on tracking the light signal of the specified pattern, the second electronic device (220) can obtain second location information related to the location of the input device (230) (e.g., information related to the movement of the input device (230) (e.g., movement in a specific direction)). The second electronic device (220) can map the timeline at the time of receiving the light signal and the location information of the input device (230) for each timeline and store them in memory.
[0147] For example, the second electronic device (220) can obtain second location information related to the location of the input device (230) via UWB communication. For example, the second electronic device (220) can measure (or calculate) the distance to the input device (230) based on the difference between the time at which the first message (e.g., poll message) is transmitted to the input device (230) and the time at which the second message (e.g., response message) is received from the input device (230) via the SS-TWR method. The second electronic device (220) can store the time at which the first message (e.g., poll message) is transmitted, the time at which the second message (e.g., response message) is received from the input device (230), and / or the measured distance to the input device (230) in a memory. Alternatively, the second electronic device (220) may transmit a first message (e.g., a poll message) to the input device (230) via the DS-TWR method, and the second electronic device (220) may transmit a second message (e.g., a response message) to the second electronic device (220). In response to the second message, the second electronic device (220) may transmit a third message (e.g., a final message) to the input device (230) that includes a response time calculated based on the difference between the time at which the first message was transmitted and the time at which the second message was received from the input device (230). The second electronic device (220) may measure (or calculate) the distance to the input device (230) based on the first message, the second message, and the third message. The second electronic device (220) may store in memory the time at which the first message (e.g., poll message) was transmitted, the time at which the second message (e.g., response message) was received from the input device (230), the time at which the third message (e.g., final message) was transmitted, and / or the measured distance from the input device (230).
[0148] For example, the second electronic device (220) may obtain second location information related to the location of the input device (230) based on information related to the movement of the input device (230) received from the input device (230) (e.g., movement speed information, movement direction information, movement distance information, and / or inclination information of the input device (230). The second electronic device (220) may map information related to the movement of the input device (230) and time information at which the information related to the movement is received from the input device (230) and store the mapped information in memory.
[0149] In one embodiment, the second electronic device (220) may transmit second location information related to the location of the input device (230), which is obtained based on at least one of the reception of the optical signal of the aforementioned specified pattern, tracking of the optical signal, UWB communication, and information related to the movement of the input device (230), to the first electronic device (210) with which it is connected for communication.
[0150] In one embodiment, the processor (360) may, in operation 615, determine the relative position of the second electronic device (220) with respect to the first electronic device (210) based on first position information related to the position of the input device (230) and second position information related to the position of the input device (230).
[0151] In one embodiment, the processor (360) may estimate the position and / or movement of the input device (230) based on first position information related to the position of the input device (230) obtained from the first electronic device (210) and second position information related to the position of the input device (230) received from the second electronic device (220). The first position information of the input device (230) obtained from the first electronic device (210) at a specific time and the second position information of the input device (230) obtained from the second electronic device (220) may be different. For example, when movement of the input device (230) occurs (e.g., movement in a specific direction occurs), the first position information of the input device (230) obtained from the first electronic device (210) at the specific time and the second position information of the input device (230) obtained from the second electronic device (220) at the specific time may be different. For example, when movement of the input device (230) occurs (e.g., movement in a specific direction occurs), at a specific point in time, the first electronic device (210) may acquire first location information of the input device (230), but the second electronic device (220) may not acquire second location information of the input device (230). Alternatively, when movement of the input device (230) occurs (e.g., movement in a specific direction occurs), at a specific point in time, the first electronic device (210) may receive an optical signal of a specified pattern in a first form (or first shape), while the second electronic device (220) may receive an optical signal of a specified pattern in a second form (or second shape) (e.g., a second form different from the first form).
[0152] In one embodiment, the processor (360) may compare the first location information of the input device (230) acquired from the first electronic device (210) and the second location information of the input device (230) received from the second electronic device (220) in a timeline. For example, the processor (360) may compare the first location information and the second location information at a first time point to an n-th time point in chronological order. The processor (360) may estimate the location and / or movement of the input device (230) based on the result of comparing the first location information of the input device (230) acquired from the first electronic device (210) and the second location information of the input device (230) received from the second electronic device (220) in a timeline. For example, the movement of the input device (230) may include a movement direction, but is not limited thereto.
[0153] In one embodiment, the processor (360) may estimate a direction of movement according to the movement of the input device (230), for example, movement in the direction in which the second electronic device (220) is located when the input device (230) is positioned in front of the first electronic device (210), or movement in the direction in which the first electronic device (210) is located when the input device (230) is positioned in front of the second electronic device (220). Based on the estimated direction of movement according to the movement of the input device (230), the processor (360) may determine the relative position of the second electronic device (220) with respect to the first electronic device (210).
[0154] In one embodiment, the processor (360) may, in operation 620, set levels, e.g., display arrangements, of a display of a first electronic device (210) (e.g., display (351) of FIG. 3) and a second display of a second electronic device (220) (e.g., second display (221) of FIG. 2) based on the relative position of the identified second electronic device (220).
[0155] For example, if the direction of movement according to the movement of the input device (230) is estimated to be the direction in which the second electronic device (220) is located while the first electronic device (210) is located in front of the first electronic device (210), the processor (360) may set the display (351) of the first electronic device (210) as the primary display and set the second display (221) of the second electronic device (220) as the secondary display. For example, if the direction of movement according to the movement of the input device (230) is estimated to be the direction in which the first electronic device (210) is located while the first electronic device (210) is located in front of the second electronic device (220), the processor (360) may set the second display (221) of the second electronic device (220) as the primary display and set the display (351) of the first electronic device (210) as the secondary display.
[0156] FIG. 6b is a flowchart for explaining a method of controlling a screen using an input device (230) of a first electronic device (210) according to one embodiment of the present disclosure.
[0157] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.
[0158] According to one embodiment, operations 655 to 665 may be understood to be performed by a processor (e.g., processor (360) of FIG. 3) of a first electronic device (e.g., electronic device (210) of FIG. 2).
[0159] FIG. 6b according to one embodiment may be an additional operation of the aforementioned FIG. 6a.
[0160] Referring to FIG. 6B, in operation 655, the processor (360) may determine distance information and / or depth information with respect to the second electronic device (220) based on the relative position of the second electronic device (e.g., the second electronic device (220) of FIG. 2). For example, the processor (360) may determine distance information and / or depth information with respect to the second electronic device (220) based on first location information related to the position of the input device (e.g., the input device (230) of FIG. 2) obtained from the first electronic device (210) and second location information related to the position of the input device (230) received from the second electronic device (220). The present invention is not limited thereto, and the processor (360) may also determine distance information and / or depth information with respect to the second electronic device (220) through UWB communication.
[0161] In one embodiment, the processor (360) may, in operation 660, set a first display property on a first screen to be displayed on a display (e.g., the display (351) of FIG. 3) based on distance information and / or depth information with respect to the second electronic device (220), and may set a second display property on a second screen to be displayed on a second display of the second electronic device (220) (e.g., the second display (221) of FIG. 2). For example, the processor (360) may, based on distance information and / or depth information with respect to the second electronic device (220), set the display properties of the first screen to be displayed on the display (351) of the first electronic device (210) and the second screen to be displayed on the second display (221) of the second electronic device (220) to be different or identical. For example, the display properties may include a resolution, a refresh rate, brightness, and / or a size of at least one object constituting the screen of the display. However, the present invention is not limited thereto.
[0162] The size of at least one object constituting a screen according to one embodiment is described as one example of a display property.
[0163] For example, based on distance information and / or depth information with respect to the second electronic device (220), if it is determined that the second electronic device (220) is located to the right and in front of the first electronic device (210) based on the first electronic device (210) while the user is looking at the first electronic device (210), the processor (360) may set the display properties to display the size of at least one object constituting the first screen to be displayed on the display (351) of the first electronic device (210) as the first size, and may set the display properties to display the size of at least one object constituting the second screen to be displayed on the second display (221) of the second electronic device (220) as the second size smaller than the first size.
[0164] For example, based on distance information and / or depth information, if it is determined that the second electronic device (220) is located to the right and behind the first electronic device (210) with respect to the first electronic device (210) while the user is looking at the electronic device (210), the processor (360) may set the display properties to display the size of at least one object constituting the first screen to be displayed on the display (351) of the first electronic device (210) at a second size (e.g., a second size smaller than the first size), and may set the display properties to display the size of at least one object constituting the second screen to be displayed on the second display (221) of the second electronic device (220) at the first size.
[0165] For example, the first electronic device (210) can check distance information and / or depth information with respect to the second electronic device (220) at specified time intervals. Based on the distance information and / or depth information checked at specified time intervals, the first electronic device (210) can set the display properties of the first screen to be displayed on the display (351) and the display properties of the second screen to be displayed on the second display (221) of the second electronic device (220) to correspond to the movement of the second electronic device (220) (or the first electronic device (210)). For example, when a user is looking at a first electronic device (210), and the second electronic device (220) is located on the right side and behind the first electronic device (210) based on distance information and / or depth information confirmed at a specified time interval, and is confirmed (e.g., changed or moved) to a state in which it is located on the right side and in front of the first electronic device (210), a visual effect in which the size of at least one object constituting the second screen to be displayed on the second display (221) of the second electronic device (220) is gradually reduced can be applied and displayed. Alternatively, when the user is looking at the first electronic device (210), and the second electronic device (220) is confirmed (e.g., changed or moved) from being located in front of the first electronic device (210) and to being located behind the first electronic device (210) and to the right of the first electronic device (210), based on distance information and / or depth information confirmed at a specified time interval, a visual effect of gradually increasing the size of at least one object constituting the second screen to be displayed on the second display (221) of the second electronic device (220) can be applied and displayed. Accordingly, natural continuity between the first screen and the second screen can be provided on each of the display (351) of the first electronic device (210) and the second display (221) of the second electronic device (220).
[0166] In one embodiment, the processor (360) may, in operation 665, display a first screen on the display (351) based on the first display property, and display a second screen on the second display (221) of the second electronic device (220) based on the second display property. For example, the processor (360) may control the display (351) to display a first screen to which the first display property is applied, and the second display (221) to display a second screen to which the second display property is applied.
[0167] In FIGS. 6A and 6B according to various embodiments, the first electronic device (210) can estimate the position and / or movement (e.g., movement direction) of the input device (230) based on first position information related to the position of the input device (230) acquired by the first electronic device (210) and second position information related to the position of the input device (230) acquired by the second electronic device (220), and can confirm the relative position of the second electronic device (220) with respect to the first electronic device (210). Since the levels of the display (351) and the second display (221) can be set according to the confirmed relative position of the second electronic device (220), the first electronic device (210) can provide a user with the ability to easily set the level of the display. In addition, the first electronic device (210) can provide natural continuity between the screens to be displayed on the display (351) of the first electronic device (210) and the second display (221) of the second electronic device (220) by setting the display properties of the screens to be displayed on the display (351) of the first electronic device (210) and the second display (221) of the second electronic device (220) based on distance information and / or depth information with respect to the second electronic device (220).
[0168] FIG. 7 is a drawing for explaining a method of controlling a screen using an input device (230) of a first electronic device (210) according to one embodiment of the present disclosure.
[0169] Referring to FIG. 7, a first electronic device (e.g., the first electronic device (210) of FIG. 2), a second electronic device (e.g., the second electronic device (220) of FIG. 2), and an input device (e.g., the input device (230) of FIG. 2) may be in a state of communication connection through a designated communication (e.g., short-range communication).
[0170] FIG. 7 according to various embodiments is a drawing for explaining a method of obtaining location information of an input device (230) through a distance measurement sensor (e.g., distance measurement sensor (341) of FIG. 3) and / or UWB communication.
[0171] In one embodiment, the input device (230) can emit (710) a light signal of a specified pattern through a light emitting unit. The first electronic device (210) can receive the light signal of the specified pattern emitted from the light emitting unit of the input device (230) through a receiving unit of a distance measuring sensor (e.g., the distance measuring sensor (341) of FIG. 3). Based on receiving the light signal of the specified pattern emitted from the light emitting unit of the input device (230) through the receiving unit of the distance measuring sensor (341), the first electronic device (210) can obtain first location information of the input device (230). For example, the first electronic device (210) can obtain first location information related to the location of the input device (230) based on a timeline (e.g., time information of the received light signal) in which the light signal of the specified pattern was received from the input device (230).
[0172] In one embodiment, the second electronic device (220) may also receive a light signal of a specified pattern emitted from a light emitting unit of the input device (230) through a receiving unit of a distance measuring sensor, and based thereon, obtain second location information of the input device (230). For example, the second electronic device (220) may obtain second location information related to the location of the input device (230) based on a timeline (e.g., time information of the received light signal) in which the light signal of the specified pattern was received from the input device (230).
[0173] The first electronic device (210) and the second electronic device (220) according to various embodiments have been described as receiving a light signal of a specified pattern emitted from the light emitting unit of the input device (230) through the receiving unit of the distance measuring sensor, but are not limited thereto. For example, the first electronic device (210) and the second electronic device (220) may also receive a light signal of a specified pattern emitted from the light emitting unit of the input device (230) through a proximity sensor or an illuminance sensor.
[0174] As an example of a method for obtaining location information of an input device (230) according to various embodiments, the method is not limited to the above-described method, and the first electronic device (210) may obtain first location information related to the location of the input device (230) by using the time difference (or phase difference) between the light (730) emitted from the light emitting unit of the distance measuring sensor (341) being reflected by the input device (230) and received by the light receiving unit. The second electronic device (220) may also obtain second location information related to the location of the input device (230) by using the time difference (or phase difference) between the light (720) emitted from the light emitting unit of the distance measuring sensor being reflected by the input device (230) and received by the light receiving unit.
[0175] Not limited thereto, the first electronic device (210) can obtain first location information of the input device (230) through UWB communication. For example, the first electronic device (210) can measure (or calculate) the distance to the input device (230) based on the difference between the time at which the first message (e.g., poll message) is transmitted to the input device (230) and the time at which the second message (e.g., response message) is received from the input device (230) through the SS-TWR method. The first electronic device (210) can also obtain first location information related to the location of the input device (230) based on the measured (or calculated) distance to the input device (230). For example, when the first electronic device (210) transmits a first message (e.g., a poll message) through the DS-TWR method, the input device (230) can transmit a second message (e.g., a response message) to the first electronic device (210). In response to the second message, the first electronic device (210) can transmit a third message (e.g., a final message) to the input device (230) that includes a response time calculated based on the difference between the time at which the first message was transmitted and the time at which the second message was received from the input device (230). The first electronic device (210) can measure (or calculate) the distance to the input device (230) based on the first message, the second message, and the third message. The first electronic device (210) may also obtain first location information related to the location of the input device (230) based on the measured (or calculated) distance to the input device (230).
[0176] In one embodiment, the second electronic device (220) may also obtain second location information of the input device (230) via UWB communication. For example, the second electronic device (220) may measure (or calculate) a distance to the input device (230) based on a difference between the time at which a first message (e.g., a poll message) is transmitted to the input device (230) and the time at which a second message (e.g., a response message) is received from the input device (230) via the SS-TWR method. The second electronic device (220) may also obtain second location information related to the location of the input device (230) based on the measured (or calculated) distance to the input device (230). For example, when the second electronic device (220) transmits a first message (e.g., a poll message) through the DS-TWR method, the input device (230) can transmit a second message (e.g., a response message) to the second electronic device (220). In response to the second message, the second electronic device (220) can transmit a third message (e.g., a final message) to the input device (230) that includes a response time calculated based on the difference between the time at which the first message was transmitted and the time at which the second message was received from the input device (230). The second electronic device (220) can measure (or calculate) the distance to the input device (230) based on the first message, the second message, and the third message. The second electronic device (220) may also obtain second location information related to the location of the input device (230) based on the measured (or calculated) distance to the input device (230).
[0177] In one embodiment, the second electronic device (220) can transmit the second location information of the acquired input device (230) to the first electronic device (210). The first electronic device (210) can also transmit the first location information of the acquired input device (230) to the second electronic device (220). The first electronic device (210) can determine the relative location of the second electronic device (220) with respect to the first electronic device (210) based on the first location information of the input device (230) and the second location information of the input device (230). The first electronic device (210) can set the levels (e.g., display arrangement) of the display of the first electronic device (210) (e.g., display (351) of FIG. 3) and the second display of the second electronic device (220) (e.g., second display (221) of FIG. 2) based on the confirmed relative position of the second electronic device (220).
[0178] In one embodiment, the first electronic device (210) may set display properties on a screen to be displayed on the display (351) and the second display (221) of the second electronic device (220) based on distance information and / or depth information with respect to the second electronic device (220). For example, the display properties may include a resolution, a refresh rate, brightness, and / or a size of at least one object constituting the screen of the displays (e.g., the display (351) and the second display (221)). The first electronic device (210) may display a screen on each of the display (351) and the second display (221) of the second electronic device (220) based on the set display properties.
[0179] In one embodiment, the first electronic device (210) is described as checking the relative position of the second electronic device (220), but is not limited thereto. For example, the second electronic device (220) may check the relative position of the first electronic device (210) with respect to the second electronic device (220) based on the first position information of the input device (230) received from the first electronic device (210) and the second position information of the input device (230) acquired by the second electronic device (220).
[0180] FIG. 8 is a drawing for explaining a method of setting the level of a display (351) of a first electronic device (210) and a second display (221) of a second electronic device (220) according to one embodiment of the present disclosure.
[0181] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.
[0182] FIG. 8, described below, is a drawing for explaining a method of obtaining position information of an input device (230) based on a light signal of a specified pattern emitted from a light emitting unit of the input device (230) and movement information of the input device (230).
[0183] Referring to FIG. 8, the first electronic device (210) may be communicatively connected to the second electronic device (220) in operation 805. The first electronic device (210) may be communicatively connected to the input device (230) in operation 810. The second electronic device (220) may be communicatively connected to the input device (230) in operation 815. For example, the first electronic device (210), the second electronic device (220), and the input device (230) may be communicatively connected via a designated communication (e.g., short-range communication such as UWB, Bluetooth, or low-power Bluetooth).
[0184] In one embodiment, the input device (230) may emit an optical signal of a specified pattern in operation 820. For example, the input device (230) may emit an optical signal of a specified pattern through a light-emitting unit (e.g., a light-emitting unit of the optical sensor (433) of FIG. 4). In one embodiment, the optical signal of a specified pattern may mean an optical signal of a specific pattern, a specific cycle, and / or a specific length. However, the present invention is not limited thereto.
[0185] In one embodiment, the first electronic device (210) may receive an optical signal emitted in a specified pattern from the light emitting unit of the input device (230) in operation 825. Although not shown, the first electronic device (210) may store time information about the time at which the optical signal emitted in a specified pattern from the light emitting unit of the input device (230) was received in a memory (e.g., the memory (320) of FIG. 3). The second electronic device (220) may receive an optical signal emitted in a specified pattern from the light emitting unit of the input device (230) in operation 830. Although not shown, the second electronic device (220) may store time information about the time at which the optical signal emitted in a specified pattern from the light emitting unit of the input device (230) was received in a memory.
[0186] In one embodiment, the input device (230) may obtain movement information of the input device (230) through a sensor circuit (e.g., the sensor circuit (430) of FIG. 4) (e.g., the inertial sensor 431 of FIG. 4)) in operation 835. For example, the movement information of the input device (230) may include movement speed information, movement direction information, movement distance information, and / or inclination information of the input device (230). However, the present invention is not limited thereto.
[0187] In one embodiment, the input device (230) may transmit the acquired movement information (e.g., movement speed information, movement direction information, movement distance information, and / or slope information) to the first electronic device (210) in operation 840. The input device (230) may transmit the acquired movement information (e.g., movement speed information, movement direction information, movement distance information, and / or slope information) to the second electronic device (220) in operation 845.
[0188] In one embodiment, the first electronic device (210) may obtain first location information of the input device (230) based on the received optical signal of the specified pattern and / or movement information of the input device (230) in operation 850. For example, the first electronic device (210) may obtain first location information of the input device (230) based on a timeline in which the optical signal of the specified pattern is received from the input device (230) and / or movement information per timeline. Although not shown, the first electronic device (210) may transmit the obtained first location information of the input device (230) to the second electronic device (220).
[0189] In one embodiment, the second electronic device (220) may obtain second location information of the input device (230) based on the received specified pattern and / or movement information of the input device (230) in operation 855. For example, the second electronic device (220) may obtain second location information of the input device (230) based on a timeline and / or movement information per timeline in which an optical signal of the specified pattern is received from the input device (230). The second electronic device (220) may transmit the obtained second location information of the input device (230) to the first electronic device (210) in operation 860.
[0190] In one embodiment, the first electronic device (210) may, in operation 865, determine the relative position of the second electronic device (220) with respect to the first electronic device (210) based on the first location information and the second location information of the input device (230). For example, the first electronic device (210) may compare the first location information and the second location information of the input device (230) in a timeline, and estimate the position and / or movement of the input device (230) based on the comparison result. For example, the first electronic device (210) may estimate the movement direction according to the movement of the input device (230), for example, movement in the direction in which the second electronic device (220) is located when the input device (230) is positioned in front of the first electronic device (210), or movement in the direction in which the first electronic device (210) is located when the second electronic device (220) is positioned in front of the second electronic device (220).
[0191] In one embodiment, the first electronic device (210) may, in operation 870, set the levels (e.g., display arrangement) of the display (e.g., display 351 of FIG. 3) of the first electronic device (210) and the second display (e.g., second display 221 of FIG. 2) of the second electronic device (220) based on the relative positions of the second electronic device (220). For example, if the direction of movement according to the movement of the input device (230) is estimated to be the direction in which the second electronic device (220) is located while being located in front of the first electronic device (210), the processor (360) may set the display (351) of the first electronic device (210) as the primary display and set the second display (221) of the second electronic device (220) as the secondary display. For example, if the direction of movement according to the movement of the input device (230) is estimated to be the direction in which the first electronic device (210) is located while the second electronic device (220) is located in front of the second electronic device (220), the processor (360) can set the second display (221) of the second electronic device (220) as the primary display and set the display (351) of the first electronic device (210) as the secondary display.
[0192] FIG. 9 is a drawing for explaining a method of controlling a screen using an input device (230) of a first electronic device (210) according to one embodiment of the present disclosure.
[0193] In one embodiment, the light emitting portion of an optical sensor (e.g., optical sensor (433) of FIG. 4) of an input device (e.g., input device (230) of FIG. 2) may include a vertical cavity surface emitting laser (VCSEL).
[0194] FIG. 9, described below, is a drawing for explaining a method in which an input device (230) emits an optical signal of a specific waveform at a specified angle (e.g., about 10 to 20 degrees) using a VCSEL, and a first electronic device (e.g., the first electronic device (210) of FIG. 2) or a second electronic device (e.g., the second electronic device (220) of FIG. 2) receives the optical signal and sets the level of a display (e.g., the display (351) of FIG. 3) and a second display of the second electronic device (220) (e.g., the second display (221) of FIG. 2).
[0195] In one embodiment, the input device (230) can emit an optical signal at a specified angle using a VCSEL. For example, the specified angle can be about 10 to 20 degrees. As the optical signal is emitted at an angle of about 10 to 20 degrees through the VCSEL, the optical signal can be received by the first electronic device (210) and / or the second electronic device (e.g., the second electronic device (220) of FIG. 2). When the first electronic device (210) or the second electronic device (220) receives the optical signal, the sensitivity of the received optical signal can be determined. The first electronic device (210) and the second electronic device (220) can process the determined optical signal as a valid optical signal if the sensitivity of the optical signal exceeds a specified sensitivity. In other words, the first electronic device (210) and the second electronic device (220) can use the optical signal exceeding a specified sensitivity to obtain position information of the input device (230).
[0196] Referring to FIG. 9, the input device (230) can emit (910) an optical signal at a specified angle (e.g., about 10 to 20 degrees) (920) using a VCSEL at a first position (e.g., located in front of the first electronic device (210). The first electronic device (210) can receive the optical signal emitted at the specified angle (920). In this case, the second electronic device (220) cannot receive the optical signal. The present invention is not limited thereto, and even if the second electronic device (220) receives the optical signal, the optical signal may be below a specific sensitivity, in which case the second electronic device (220) may process the optical signal as an invalid signal. In other words, the second electronic device (220) may not use an optical signal below a specific sensitivity to obtain position information of the input device (230).
[0197] In one embodiment, the input device (230) can move (930) from a first position (e.g., located in front of the first electronic device (210)) to a second position (e.g., located in front of the second electronic device (220). The input device (230) can emit (940) an optical signal at a specified angle (e.g., about 10 to 20 degrees) (950) using a VCSEL at the second position (e.g., located in front of the second electronic device (220). The second electronic device (220) can receive the optical signal emitted at the specified angle (950). In this case, the first electronic device (210) cannot receive the optical signal. However, the present invention is not limited thereto, and even if the first electronic device (210) receives the optical signal, the optical signal may be below a specific sensitivity, in which case the first electronic device (210) may process the optical signal as an invalid signal. In other words, the first electronic device (210) may not use an optical signal below a certain sensitivity to obtain position information of the input device (230).
[0198] In one embodiment, the input device (230) may obtain movement information of the input device (230) through a sensor circuit (e.g., the sensor circuit (430) of FIG. 4) (e.g., the inertial sensor 431 of FIG. 4)). For example, the movement information of the input device (230) may include movement speed information, movement direction information, movement distance information, and / or inclination information of the input device (230). For example, the input device (230) may transmit movement direction information obtained through the sensor circuit (430) (e.g., information indicating that the input device (230) has moved from a first location (e.g., located in front of the first electronic device (210)) to a second location (e.g., located in front of the second electronic device (220)) to the first electronic device (210) (and / or the second electronic device (220)).
[0199] In one embodiment, the first electronic device (210) can determine the relative position of the second electronic device (220) with respect to the first electronic device (210) based on an optical signal received from the input device (230) and / or movement direction information of the input device (230), and set the levels (e.g., display arrangement) of the display (351) of the first electronic device (210) and the second display (221) of the second electronic device (220). For example, if the direction of movement according to the movement of the input device (230) is estimated to have moved (930) from a state in which the second electronic device (220) is located in front of the electronic device (210), the first electronic device (210) may set the display (351) of the first electronic device (210) as the primary display (e.g., set the display arrangement) and set the second display (221) of the second electronic device (220) as the secondary display.
[0200] In one embodiment, the first electronic device (210) may set display properties on a screen to be displayed on the display (351) and the second display (221) of the second electronic device (220) based on distance information and / or depth information with respect to the second electronic device (220). For example, the display properties may include a resolution, a refresh rate, brightness, and / or a size of at least one object constituting the screen of the displays (e.g., the display (351) and the second display (221)). The first electronic device (210) may display a screen on each of the display (351) and the second display (221) of the second electronic device (220) based on the set display properties.
[0201] FIG. 10 is a diagram showing signal flow between a first electronic device (210), an input device (230), and a second electronic device (220) according to one embodiment of the present disclosure.
[0202] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.
[0203] FIG. 10 according to one embodiment is a diagram showing signal flow between a first electronic device (210), an input device (230), and a second electronic device (220) according to the aforementioned FIG. 9.
[0204] Referring to FIG. 10, a first electronic device (210) may be communicatively connected to a second electronic device (220) in operation 1011. The first electronic device (210) may be communicatively connected to an input device (230) in operation 1013. The second electronic device (220) may be communicatively connected to an input device (230) in operation 1015. For example, the first electronic device (210), the second electronic device (220), and the input device (230) may be communicatively connected via a designated communication (e.g., short-range communication such as UWB, Bluetooth, or low-power Bluetooth).
[0205] In one embodiment, the input device (230) can emit an optical signal of a specified pattern in operation 1017. For example, the input device (230) can emit an optical signal of a specified pattern at a specified angle (e.g., about 10 to 20 degrees) using a light emitting unit (e.g., a light emitting unit of the optical sensor (433) of FIG. 4), for example, a VCSEL.
[0206] In one embodiment, the first electronic device (210) may receive an optical signal emitted in a specified pattern from a light emitting unit of the input device (230) in operation 1019. In operation 1021, the first electronic device (210) may transmit information related to the reception of the optical signal emitted in the specified pattern to the second electronic device (220). For example, the information related to the reception of the optical signal emitted in the specified pattern may include time information about the time at which the first electronic device (210) received the optical signal. However, the present invention is not limited thereto. In one embodiment, the first electronic device (210) and the second electronic device (220) may store information related to the reception of the optical signal emitted in the specified pattern (e.g., time information about the time at which the first electronic device (210) received the optical signal) in memory.
[0207] In one embodiment, as the input device (230) emits an optical signal at a specified angle (e.g., about 10 to 20) as shown in FIG. 9, the first electronic device (210) may receive the optical signal, but the second electronic device (220) may not receive the optical signal.
[0208] In one embodiment, the first electronic device (210) may obtain first location information of the input device (230) based on the received optical signal of the specified pattern in operation 1023. For example, the first electronic device (210) may obtain (or estimate) first location information related to the location of the input device (230) based on a timeline in which the optical signal of the specified pattern is received from the input device (230).
[0209] In one embodiment, the input device (230) may obtain movement information through a sensor circuit (e.g., the sensor circuit (430) of FIG. 4) in operation 1025. For example, the movement information of the input device (230) may include movement speed information, movement direction information, movement distance information, and / or slope information of the input device (230). In operation 1027, the input device (230) may transmit the movement information obtained through the sensor circuit (430) to the first electronic device (210). In operation 1029, the input device (230) may transmit the movement information obtained through the sensor circuit (430) to the second electronic device (220).
[0210] In one embodiment, as illustrated in FIG. 9, the input device (230) may move from a first position (e.g., located in front of the first electronic device (210)) to a second position (e.g., located in front of the second electronic device (220). In this case, the input device (230) may transmit movement direction information indicating the movement from the first position (e.g., located in front of the first electronic device (210)) to the second position (e.g., located in front of the second electronic device (220)) to the first electronic device (210) and the second electronic device (220).
[0211] In one embodiment, the input device (230) may emit a light signal of a specified pattern in operation 1035. In operations 1017 and 1035 of FIG. 10 according to one embodiment, the light signal of the specified pattern may be a substantially identical light signal, and the light signal may be continuously emitted from the light emitting unit of the input device (230) at a specified time interval.
[0212] In one embodiment, the second electronic device (220) may receive an optical signal emitted in a specified pattern from a light emitting unit of the input device (230) in operation 1037. In operation 1039, the second electronic device (220) may transmit information related to the reception of the optical signal emitted in the specified pattern to the first electronic device (210). For example, the information related to the reception of the optical signal emitted in the specified pattern may include time information at which the second electronic device (220) received the optical signal. However, the present invention is not limited thereto. In one embodiment, the first electronic device (210) and the second electronic device (220) may store information related to the reception of the optical signal emitted in the specified pattern (e.g., time information at which the second electronic device (220) received the optical signal) in memory.
[0213] In one embodiment, as shown in FIG. 9, when the input device (230) is moved from the first position to the second position, the second electronic device (220) may receive the optical signal as the input device (230) emits an optical signal at a specified angle (e.g., about 10 to 20), but the first electronic device (210) may not receive the optical signal.
[0214] In one embodiment, the second electronic device (220) may obtain second location information of the input device (230) based on motion information and / or a light signal of a specified pattern received from the input device (230) in operation 1041. For example, the second electronic device (220) may obtain (or estimate) second location information related to the location of the input device (230) based on a timeline in which the light signal of a specified pattern and / or the motion information is received from the input device (230).
[0215] In one embodiment, the second electronic device (220) may transmit second location information of the input device (230) to the first electronic device (210) in operation 1043. Although not shown, the first electronic device (210) may store the second location information of the input device (230) received from the second electronic device (220) in the memory (320).
[0216] In one embodiment, in operation 1045, the first electronic device (210) can determine the relative position of the second electronic device (220) with respect to the first electronic device (210) based on the first position information and the second position information of the input device (230). For example, the first electronic device (210) can compare the first position information of the input device (230) acquired by the first electronic device (210) and the second position information of the input device (230) received from the second electronic device (220) in a timeline. Based on the comparison result, the first electronic device (210) can estimate the position and / or movement of the input device (230). The first electronic device (210) can determine the relative position of the second electronic device (220) with respect to the first electronic device (210) based on the movement direction according to the estimated movement of the input device (230).
[0217] In one embodiment, the first electronic device (210) may, in operation 1047, set the levels of the display of the first electronic device (210) (e.g., the display (351) of FIG. 3) and the second display of the second electronic device (220) (e.g., the second display (221) of FIG. 2) based on the relative position of the second electronic device (220).
[0218] FIG. 11 is a drawing for explaining a method for confirming the relative position of a second electronic device (220) based on a first electronic device (210) according to one embodiment of the present disclosure.
[0219] In various embodiments, a first electronic device (e.g., the first electronic device (210) of FIG. 2), a second electronic device (e.g., the second electronic device (220) of FIG. 2), and an input device (e.g., the input device (230) of FIG. 2) may be communicatively connected through a designated communication. For example, the designated communication may include short-range communication. The first electronic device (210), the second electronic device (220), and the input device (230) may be communicatively connected through the designated communication when they are brought into proximity to each other. The present invention is not limited thereto, and the first electronic device (210) may execute a function related to setting a level of a display (e.g., the display (351) of FIG. 3). In this case, the first electronic device (210) may broadcast a signal requesting a communication connection. In response to a signal requesting a first communication connection, when a response signal is received from each of the second electronic device (220) and the input device (230), the first electronic device (210) can establish a communication connection with the second electronic device (220) and the input device (230) through a designated communication.
[0220] Referring to Fig. 11, the input device (230) is indicated by reference number <1110> As shown in , a plurality of light emitting units (1115) may be provided. The input device (230) may emit a light signal (e.g., an IR light signal) of a specified pattern through the plurality of light emitting units (1115).
[0221] Reference number according to one embodiment <1150> Referring to , the first electronic device (210) and the second electronic device (220) can receive (or track, sense) an optical signal emitted through a plurality of light-emitting units (1115) of the input device (230) based on being connected to the input device (230).
[0222] For example, the first electronic device (210) can activate a sensor circuit (1155) (e.g., a camera (e.g., a camera (330) of FIG. 3) and / or a distance measurement sensor (e.g., a distance measurement sensor (341) of FIG. 3)) (or an illumination sensor (e.g., an illumination sensor (343) of FIG. 3))) for receiving an optical signal emitted through a plurality of light-emitting units (1115) of the input device (230). The first electronic device (210) can use the activated sensor circuit (1155) to receive an optical signal emitted through a plurality of light-emitting units (1115) of the input device (230). The second electronic device (220) can also activate a sensor circuit (1160) (e.g., a camera and / or a distance measurement sensor (or an illumination sensor)) for receiving an optical signal emitted through a plurality of light-emitting units (1115) of the input device (230). The device (220) can receive an optical signal emitted through a plurality of light emitting units (1115) of the input device (230) using an activated sensor circuit (1160).
[0223] An optical signal (e.g., an IR signal) according to one embodiment may have a unique field of view (FOV). Accordingly, when the input device (230) is positioned perpendicularly to the sensor circuits (1155, 1160) provided in the first electronic device (210) and the second electronic device (220), the amount of light may be greater than a specified amount of light. This is not limited thereto, and the form (or shape) of the optical signal received by the sensor circuits (1155, 1160) provided in the first electronic device (210) and the second electronic device (220) may vary depending on the arrangement between the sensor circuits (1155, 1160) provided in the first electronic device (210) and the second electronic device (220) and the input device (230).
[0224] For example, the input device (230) may be moved (1165) from a first position (e.g., located in front of the first electronic device (210)) to a second position (e.g., located in front of the second electronic device (220). As the input device (230) is moved (1165), the form (or shape) of the optical signal received by the sensor circuits (1155, 1160) provided in the first electronic device (210) and the second electronic device (220) may change. For example, based on the input device (230) moving (1165) from a first position (e.g., located in front of the first electronic device (210)) to a second position (e.g., located in front of the second electronic device (220), the first electronic device (210) can receive an optical signal having a first shape (1170) at a first time point and can receive an optical signal having a second shape (1175) at a second time point. Furthermore, based on the input device (230) moving (1165) from a first position (e.g., located in front of the first electronic device (210)) to a second position (e.g., located in front of the second electronic device (220), the second electronic device (220) can receive an optical signal having a third shape (1180) at a third time point and can receive an optical signal having a fourth shape (1185) at a fourth time point.
[0225] In one embodiment, the first electronic device (210) can transmit information including a first type (1170) of an optical signal received at a first time point and a second type (1175) of an optical signal received at a second time point to the second electronic device (220). The second electronic device (220) can transmit a third type (1180) of an optical signal received at a third time point and a fourth type (1185) of an optical signal received at a fourth time point to the first electronic device (210).
[0226] In one embodiment, the first electronic device (210) can estimate the movement (e.g., the direction of movement) of the input device (230) based on the first type (1170) of the optical signal received at the first time point, the second type (1175) of the optical signal received at the second time point, the third type (1180) of the optical signal received at the third time point, and the fourth type (1185) of the optical signal received at the fourth time point. The first electronic device (210) can estimate that the input device (230) has moved (1165) from a first position (e.g., located in front of the first electronic device (210)) to a second position (e.g., located in front of the second electronic device (220), and can confirm that the second electronic device (220) is positioned to the right (e.g., located in direction ①) with respect to the first electronic device (210).
[0227] FIG. 12 is a drawing for explaining a method for confirming the relative position of a second electronic device (220) with respect to a first electronic device (210) according to one embodiment of the present disclosure.
[0228] In various embodiments, a first electronic device (e.g., the first electronic device (210) of FIG. 2), a second electronic device (e.g., the second electronic device (220) of FIG. 2), and an input device (e.g., the input device (230) of FIG. 2) may be communicatively connected via a designated communication (e.g., short-range communication).
[0229] Reference number of Fig. 12 <1210> Referring to FIG. 11 , the first electronic device (210) and the second electronic device (220) can detect (or track, receive) an optical signal emitted through a plurality of light-emitting units (e.g., a plurality of light-emitting units (1115) of FIG. 11) of the input device (230) based on being connected to the input device (230) for communication.
[0230] In one embodiment, the first electronic device (210) and the second electronic device (220) may activate sensor circuits (1155, 1160) (e.g., a camera, a distance measurement sensor, and / or an illuminance sensor) to detect an optical signal emitted through the plurality of light-emitting units (1115) of the input device (230). For example, the sensor circuit (1155) of the first electronic device (210) may detect an optical signal emitted through the plurality of light-emitting units (1115) of the input device (230) in a first measurement area (1225) (e.g., a first FOV). The sensor circuit (1160) of the second electronic device (220) may detect an optical signal emitted through the plurality of light-emitting units (1115) of the input device (230) in a second measurement area (1230) (e.g., a second FOV).
[0231] As described above, the first electronic device (210) and the second electronic device (220) may have measurement areas (e.g., first measurement area (1225) (e.g., first FOV) and second measurement area (1230) (e.g., second FOV) signals) that detect optical signals through sensor circuits (1155, 1160). Depending on the arrangement of the sensor circuits (1155, 1160) of the first electronic device (210) and the second electronic device (220) with the input device (230), the form (or shape) of the optical signal received by the sensor circuits (1155, 1160) provided in the first electronic device (210) and the second electronic device (220) may vary. Based on this, the first electronic device (210) may check the arrangement angle with the second electronic device (220).
[0232] In one embodiment, the input device (230) can move (1215, 1220) from a first position (e.g., located in front of the first electronic device (210)) to a second position (e.g., located in front of the second electronic device (220). The first electronic device (210) can detect (1235) an optical signal emitted when the input device (230) is located at the 1-1 position at a first time point, and based on the movement (1215) of the input device (230), can detect (1240) an optical signal emitted when the input device (230) is located at the 1-2 position at a second time point. Based on the movement (1220) of the input device (230), the second electronic device (220) can detect (1245) an optical signal emitted when the input device (230) is located at the 2-1 position at a third time point.
[0233] In one embodiment, the first electronic device (210) can transmit information about the 1-1 position of the input device (230) that detected the light signal at a first time point and information about the 1-2 position of the input device (230) that detected the light signal at a second time point to the second electronic device (220). The second electronic device (220) can transmit information about the 2-1 position of the input device (230) that detected the light signal at a third time point to the first electronic device (210).
[0234] In one embodiment, the first electronic device (210) may compare information about the 1-1 position of the input device (230) that detected the light signal at the first time point, information about the 1-2 position of the input device (230) that detected the light signal at the second time point, and information about the 2-1 position of the input device (230) that detected the light signal at the third time point in a timeline. Based on the result of the comparison in the timeline, the processor (360) may estimate that the input device (230) has moved (1215, 1220) from the first position (e.g., located in front of the first electronic device (210)) to the second position (e.g., located in front of the second electronic device (220), and may confirm that the second electronic device (220) is substantially arranged parallel to the right (e.g., direction ①) with respect to the first electronic device (210).
[0235] Reference number of Fig. 12 <1250> Referring to FIG. 2 , the input device (230) can move (1255, 1260) from a first position (e.g., located in front of the first electronic device (210)) to a second position (e.g., located in front of the second electronic device (220). The first electronic device (210) can detect (1265) an optical signal emitted when the input device (230) is located at the 1-3 position at a fourth time point. Based on the movement (1255) of the input device (230), the first electronic device (210) and the second electronic device (220) can detect (1270, 1275) an optical signal emitted when the input device (230) is located at the 1-4 position at a fifth time point. Based on the movement (1260) of the input device (230), the second electronic device (220) can detect (1280) an optical signal emitted when the input device (230) is located at the 2-2 position at the sixth point in time.
[0236] In one embodiment, the first electronic device (210) can transmit information about the 1-3 positions of the input device (230) that detected the light signal at a fourth time point and information about the 1-4 positions of the input device (230) that detected the light signal at a fifth time point to the second electronic device (220). The second electronic device (220) can transmit information about the 1-4 positions of the input device (230) that detected the light signal at a fifth time point and information about the 2-2 positions of the input device (230) that detected the light signal at a sixth time point to the first electronic device (210).
[0237] In one embodiment, the first electronic device (210) can compare information about the 1-3 positions of the input device (230) that detected the light signal at the 4th time point, information about the 1-4 positions of the input device (230) that detected the light signal at the 5th time point, and information about the 2-2 positions of the input device (230) that detected the light signal at the 6th time point in a timeline. Based on the result of the comparison in the timeline, the processor (360) can estimate that the input device (230) has moved (1255, 1260) from the first position (e.g., located in front of the first electronic device (210)) to the second position (e.g., located in front of the second electronic device (220), and can confirm that the second electronic device (220) is arranged at an angle of about 90 degrees with respect to the first electronic device (210).
[0238] By estimating the angle (or position) at which the second electronic device (220) is positioned relative to the first electronic device (210) in FIGS. 11 and 12 according to various embodiments, a connection can be naturally made between the first screen to be displayed on the display of the first electronic device (210) (e.g., the display (351) of FIG. 3) and the second screen to be displayed on the second display of the second electronic device (220) (e.g., the second display (221) of FIG. 2).
[0239] FIG. 13 is a drawing for explaining a method of controlling a screen using an input device (230) of a first electronic device (210) according to one embodiment of the present disclosure.
[0240] Referring to FIG. 13, when the second electronic device (220) is positioned to the right (e.g., positioned in direction ①) with respect to the first electronic device (210), the second electronic device (220) may be moved (1310) to the left (e.g., positioned in direction ②) with respect to the first electronic device (210). In one embodiment, the second electronic device (220) may obtain movement information (e.g., movement speed information, movement direction information, movement distance information, and / or slope information) through a sensor circuit. The second electronic device (220) may transmit the movement information of the second electronic device (220) obtained through the sensor circuit to the first electronic device (210) and / or the input device (230).
[0241] In one embodiment, the input device (230) may emit an optical signal of a second specified pattern through a light emitting unit of an optical sensor (e.g., the optical sensor (433) of FIG. 4) based on receiving movement information of the second electronic device (220) from the second electronic device (220). For example, the optical signal of the second specified pattern may be different from the optical signal of the specified pattern described in FIGS. 6A to 12 (e.g., an optical signal of a specific pattern, a specific period, and / or a specific length).
[0242] In one embodiment, when the input device (230) receives movement information of the second electronic device (220) from the second electronic device (220), the input device (230) may determine to reset the level (or arrangement) of the display (e.g., the display (351) of FIG. 3). Based on this, the input device (230) may notify the first electronic device (210) and / or the second electronic device (220) to reset the level of the display (351) and the second display (e.g., the second display (221) of FIG. 2) by emitting a light signal of a second designated pattern through the light emitting unit.
[0243] For example, the input device (230) can emit an optical signal of a second specified pattern at a specified angle (e.g., about 10 to 20 degrees) (1330) using a VCSEL at a first position (e.g., located in front of the second electronic device (220). The second electronic device (220) can receive the optical signal of the second specified pattern emitted at the specified angle (1330). In this case, the first electronic device (210) cannot receive the optical signal of the second specified pattern. The present invention is not limited thereto, and even if the first electronic device (210) receives the optical signal of the second specified pattern, the optical signal may be below a specific sensitivity, in which case the first electronic device (210) may process the optical signal as an invalid signal. In other words, the first electronic device (210) may not use an optical signal below a specific sensitivity to obtain position information of the input device (230).
[0244] In one embodiment, the first electronic device (210) may obtain third location information of the input device (230) based on the received second designated pattern of light signals. For example, the first electronic device (210) may obtain third location information related to the location of the input device (230) based on a timeline in which the second designated pattern of light signals was received from the input device (230).
[0245] In one embodiment, the input device (230) can move (1320) from a first position (e.g., located in front of the second electronic device (220)) to a second position (e.g., located in front of the first electronic device (210). In the second position (e.g., located in front of the first electronic device (210), the input device (230) can emit an optical signal of a second specified pattern at a specified angle (e.g., about 10 to 20 degrees) (1340) using a VCSEL. The first electronic device (210) can receive the optical signal of the second specified pattern emitted at the specified angle (1340). In this case, the second electronic device (220) cannot receive the optical signal of the second specified pattern. However, this is not limited thereto, and even if the second electronic device (220) receives an optical signal of a second designated pattern, the optical signal may be below a certain sensitivity, in which case the second electronic device (220) may process the optical signal as an invalid signal. In other words, the second electronic device (220) may not use an optical signal below a certain sensitivity to obtain position information of the input device (230).
[0246] In one embodiment, the second electronic device (220) may obtain fourth location information of the input device (230) based on the received optical signal of the second specified pattern. For example, the second electronic device (220) may obtain fourth location information related to the location of the input device (230) based on a timeline in which the optical signal of the second specified pattern was received from the input device (230). The second electronic device (220) may transmit the fourth location information of the input device (230) to the first electronic device (210). For example, the second electronic device (220) may transmit information related to a timeline in which the second electronic device (220) received the optical signal from the input device (230) to the first electronic device (210).
[0247] In one embodiment, the first electronic device (210) can compare the third location information of the input device (230) and the fourth location information of the input device (230) received from the second electronic device (220) in a timeline to determine the relative location of the second electronic device (220) with respect to the first electronic device (210). For example, the first electronic device (210) can estimate that the input device (230) has moved (1320) from a first location (e.g., located in front of the second electronic device (220)) to a second location (e.g., located in front of the first electronic device (210)) and determine that the second electronic device (220) is positioned to the left (e.g., positioned in the direction ②) with respect to the first electronic device (210).
[0248] In one embodiment, the first electronic device (210) may reset the levels (e.g., reset the display arrangement) of the display (351) of the first electronic device (210) and the second display (221) of the second electronic device (220) based on the identified relative positions of the second electronic device (220). For example, the first electronic device (210) may set the second display (221) of the second electronic device (220) as the primary display and set the display (351) of the first electronic device (210) as the secondary display based on an estimate that the input device (230) has moved (1320) from a first position (e.g., located in front of the second electronic device (220)) to a second position (e.g., located in front of the first electronic device (210).
[0249] In one embodiment, based on the reset of the levels of the display (351) of the first electronic device (210) and the second display (221) of the second electronic device (220), the first electronic device (210) can check distance information and / or depth information with respect to the second electronic device (220). The first electronic device (210) can reset display properties on a screen to be displayed on the display (351) and the second display (221) of the second electronic device (220) based on the checked distance information and / or depth information with respect to the second electronic device (220). For example, the display properties can include the resolution, refresh rate, brightness, and / or the size of at least one object constituting the screen of the displays (e.g., the display (351) and the second display (221)). The first electronic device (210) can display a screen on each of the display (351) and the second display (221) of the second electronic device (220) based on the reset display properties.
[0250] FIG. 14 is a diagram showing signal flow between a first electronic device (210), an input device (230), and a second electronic device (220) according to one embodiment of the present disclosure.
[0251] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.
[0252] FIG. 14 according to various embodiments may be an additional operation of FIG. 10 described above.
[0253] Referring to FIG. 14, the second electronic device (220) may obtain movement information through a sensor circuit in operation 1405. The sensor circuit may include a motion sensor and / or a 9-axis sensor (e.g., a geomagnetic sensor, an acceleration sensor, and / or a gyro sensor). The second electronic device (220) may obtain movement speed information, movement direction information, movement distance information, and / or inclination information of the second electronic device (220) through the sensor circuit. However, the present invention is not limited thereto.
[0254] In one embodiment, the second electronic device (220) may transmit movement information of the second electronic device (220) acquired through the sensor circuit to the first electronic device (210) in operation 1410. The second electronic device (220) may transmit movement information of the second electronic device (220) acquired through the sensor circuit to the input device (230) in operation 1415.
[0255] In one embodiment, based on receiving movement information of the second electronic device (220) from the second electronic device (220), the input device (230) may, in operation 1420, emit an optical signal of a second specified pattern through a light-emitting unit of an optical sensor (e.g., the optical sensor (433) of FIG. 4). For example, when the input device (230) receives movement information of the second electronic device (220) from the second electronic device (220), the input device (230) may determine to reset the level of the display (e.g., the display (351) of FIG. 3) (and the second display (e.g., the second display (221) of FIG. 2)). Based on this, the input device (230) may cause the first electronic device (210) (or the second electronic device (220)) to reset the level of the display (351) (and the second display (221)) by emitting an optical signal of a second specified pattern through the light-emitting unit.
[0256] In one embodiment, the first electronic device (210) may receive an optical signal emitted in a second designated pattern from the input device (230) in operation 1425. Although not shown, the first electronic device (210) may store time information regarding the time at which the optical signal emitted in the second designated pattern from the input device (230) was received in a memory (e.g., the memory (320) of FIG. 3). In operation 1430, the first electronic device (210) may obtain third location information of the input device (230) based on the received optical signal of the second designated pattern. For example, the first electronic device (210) may obtain third location information related to the location of the input device (230) based on a timeline at which the optical signal of the second designated pattern was received from the input device (230).
[0257] In one embodiment, the second electronic device (220) may receive an optical signal emitted in a second designated pattern from the input device (230) in operation 1435. Although not shown, the second electronic device (220) may store time information regarding the time at which the optical signal emitted in the second designated pattern is received from the input device (230) in a memory. In operation 1440, the second electronic device (220) may obtain fourth location information of the input device (230) based on the received optical signal of the second designated pattern. For example, the second electronic device (220) may obtain fourth location information related to the location of the input device (230) based on a timeline at which the optical signal of the second designated pattern is received from the input device (230). In operation 1445, the second electronic device (220) may transmit the fourth location information of the input device (230) to the first electronic device (210).
[0258] In one embodiment, in operation 1450, the first electronic device (210) can determine the relative second position of the second electronic device (220) with respect to the first electronic device (210) based on the third position information and the fourth position information of the input device (230). For example, the first electronic device (210) can compare the third position information and the fourth position information of the input device (230) in a timeline and estimate the position and / or movement of the input device (230) based on the comparison result. In operation 1455, the first electronic device (210) can reset the levels of the display (351) of the first electronic device (210) and the second display (221) of the second electronic device (220) based on the relative second position of the second electronic device (220).
[0259] FIG. 15 is a diagram showing signal flow between a first electronic device (210), an input device (230), and a second electronic device (220) according to one embodiment of the present disclosure.
[0260] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.
[0261] Referring to FIG. 15, the second electronic device (220) may obtain movement information through a sensor circuit in operation 1151. The sensor circuit may include a motion sensor and / or a 9-axis sensor (e.g., a geomagnetic sensor, an acceleration sensor, and / or a gyro sensor). The second electronic device (220) may obtain movement speed information, movement direction information, movement distance information, and / or inclination information of the second electronic device (220) through the sensor circuit.
[0262] In one embodiment, the second electronic device (220) may transmit movement information of the second electronic device (220) acquired through the sensor circuit to the first electronic device (210) in operation 1513. The second electronic device (220) may transmit movement information of the second electronic device (220) acquired through the sensor circuit to the input device (230) in operation 1515.
[0263] In one embodiment, based on receiving movement information of the second electronic device (220) from the second electronic device (220), the input device (230) may emit an optical signal of a second specified pattern through a light emitting unit of an optical sensor (e.g., the optical sensor (433) of FIG. 4) in operation 1517. The first electronic device (210) may receive an optical signal emitted in the second specified pattern from the input device (230) in operation 1519. Although not shown, the first electronic device (210) may store time information at which the first electronic device (210) receives the optical signal emitted in the second specified pattern from the input device (230) in a memory (e.g., the memory (320) of FIG. 3). The second electronic device (220) may receive an optical signal emitted in the second specified pattern from the input device (230) in operation 1521. Although not shown, the second electronic device (220) can store in memory time information at the time of receiving an optical signal emitted in a second designated pattern from the input device (230).
[0264] In one embodiment, the input device (230) may acquire second movement information of the input device (230) through a sensor circuit (e.g., the sensor circuit (430) of FIG. 4) (e.g., the inertial sensor 431 of FIG. 4)) in operation 1523. For example, the second movement information of the input device (230) may include movement speed information, movement direction information, movement distance information, and / or inclination information of the input device (230). However, the present invention is not limited thereto. In operation 1525, the input device (230) may transmit the acquired second movement information (e.g., movement speed information, movement direction information, movement distance information, and / or inclination information) to the first electronic device (210). In operation 1527, the input device (230) can transmit the acquired second movement information (e.g., movement speed information, movement direction information, movement distance information, and / or slope information) to the second electronic device (220).
[0265] In one embodiment, the first electronic device (210) may obtain third location information of the input device (230) based on the second motion information and / or the optical signal of the second designated pattern received from the input device (230) in operation 1529. For example, the first electronic device (210) may obtain third location information of the input device (230) based on the timeline in which the optical signal of the second designated pattern was received from the input device (230) and / or the second motion information per timeline. The second electronic device (220) may obtain fourth location information of the input device (230) based on the second motion information and / or the optical signal of the second designated pattern received from the input device (230) in operation 1531. For example, the second electronic device (220) may obtain fourth location information of the input device (230) based on the timeline and / or second movement information per timeline in which the second designated pattern of light signal is received from the input device (230). In operation 1533, the second electronic device (220) may transmit the fourth location information of the input device (230) to the first electronic device (210).
[0266] In one embodiment, the first electronic device (210) may, in operation 1535, determine a second relative position of the second electronic device (220) with respect to the first electronic device (210) based on the third position information and the fourth position information of the input device (230). For example, the first electronic device (210) may compare the third position information and the fourth position information of the input device (230) in a timeline, and estimate the position and / or movement of the input device (230) based on the comparison result. For example, the first electronic device (210) may estimate a movement direction according to the movement of the input device (230), for example, a direction in which the input device (230) moved from a state in front of the first electronic device (210) to a state in which the second electronic device (220) was positioned, or a direction in which the input device (230) moved from a state in front of the second electronic device (220) to a state in which the first electronic device (210) was positioned.
[0267] In one embodiment, the first electronic device (210) may reset the levels of a display of the first electronic device (210) (e.g., display (351) of FIG. 3) and a second display of the second electronic device (220) (e.g., second display (221) of FIG. 2) based on a relative second position of the second electronic device (220) in operation 1537.
[0268] FIG. 16 is a drawing for explaining a method of resetting the levels of a display (351) of a first electronic device (210) and a second display (221) of a second electronic device (220) according to one embodiment of the present disclosure.
[0269] Referring to FIG. 16, when the second electronic device (220) is positioned to the right (e.g., in the direction ①) with respect to the first electronic device (210), the second electronic device (220) may be moved (1610) to the left (e.g., in the direction ②) with respect to the first electronic device (210). The first electronic device (210) (or the second electronic device (220)) may receive a specific gesture from the input device (230). In one embodiment, the specific gesture may be a trigger gesture for resetting the level of a display (e.g., the display (351) of FIG. 3). For example, the specific gesture may include a gesture for drawing a circle (1620) and / or a gesture for drawing a triangle (1630).
[0270] Not limited thereto, the input device (230) may obtain movement information (e.g., movement speed information, movement direction information, movement distance information, and / or inclination information) of the input device (230) through an inertial sensor (e.g., the inertial sensor (431) of FIG. 4). For example, the input device (230) may transmit movement information of the input device (230) obtained through the inertial sensor (431) to the first electronic device (210) and / or the second electronic device (220).
[0271] In one embodiment, the first electronic device (210) and / or the second electronic device (220) may detect a specific gesture based on movement information of the input device (230) received from the input device (230). The first electronic device (210) and / or the second electronic device (220) may determine a mode to reset the level of the display (e.g., the display (351) of FIG. 3) (and / or the second display (e.g., the second display (221) of FIG. 2)) based on detecting the specific gesture.
[0272] In one embodiment, the input device (230) may emit an optical signal of a second specified pattern at a specified angle (e.g., about 10 to 20 degrees) (1330) using a VCSEL at a first location (e.g., located in front of the second electronic device (220). The second electronic device (220) may receive the optical signal of the second specified pattern emitted at the specified angle (1330). The first electronic device (210) may obtain third location information of the input device (230) based on the received optical signal of the second specified pattern. For example, the first electronic device (210) may obtain third location information related to the location of the input device (230) based on a timeline in which the optical signal of the second specified pattern was received from the input device (230).
[0273] In one embodiment, the input device (230) can move (1320) from a first position (e.g., located in front of the second electronic device (220)) to a second position (e.g., located in front of the first electronic device (210). In the second position (e.g., located in front of the first electronic device (210), the input device (230) can emit an optical signal of a second specified pattern at a specified angle (e.g., about 10 to 20 degrees) (1340) using a VCSEL. The second electronic device (220) can receive the optical signal of the second specified pattern emitted at the specified angle (1340). The second electronic device (220) can obtain fourth position information of the input device (230) based on the received optical signal of the second specified pattern. For example, the second electronic device (220) can obtain fourth location information related to the location of the input device (230) based on a timeline in which the second designated pattern of light signals is received from the input device (230). The second electronic device (220) can transmit the fourth location information of the input device (230) to the first electronic device (210). For example, the second electronic device (220) can transmit information related to a timeline in which the second electronic device (220) receives light signals from the input device (230) to the first electronic device (210).
[0274] In one embodiment, the first electronic device (210) can compare the third location information of the input device (230) and the fourth location information of the input device (230) received from the second electronic device (220) in a timeline to determine the relative location of the second electronic device (230) with respect to the first electronic device (210). For example, the first electronic device (210) can estimate that the input device (230) has moved (1320) from a first location (e.g., located in front of the second electronic device (220)) to a second location (e.g., located in front of the first electronic device (210)) and determine that the second electronic device (220) is positioned to the left (e.g., positioned in the direction ②) with respect to the first electronic device (210).
[0275] In one embodiment, the first electronic device (210) can reset the levels of the display (351) of the first electronic device (210) and the second display (221) of the second electronic device (220) based on the identified relative position of the second electronic device (220).
[0276] For example, after a specific gesture (1620 or 1630) is detected, based on the estimation that the input device (230) has moved (1320) from a first position (e.g., located in front of the second electronic device (220)) to a second position (e.g., located in front of the first electronic device (210)), the first electronic device (210) may reset the second display (221) of the second electronic device (220) as the primary display and reset the display (351) of the first electronic device (210) as the secondary display.
[0277] In one embodiment, based on the reset of the levels of the display (351) of the first electronic device (210) and the second display (221) of the second electronic device (220), the first electronic device (210) can check distance information and / or depth information with respect to the second electronic device (220). The first electronic device (210) can reset display properties on the screens to be displayed on the display (351) and the second display (221) of the second electronic device (220) based on the checked distance information and / or depth information with respect to the second electronic device (220). The first electronic device (210) can display screens on each of the display (351) and the second display (221) of the second electronic device (220) based on the reset display properties.
[0278] FIG. 17 is a diagram showing signal flow between a first electronic device (210), an input device (230), and a second electronic device (220) according to one embodiment of the present disclosure.
[0279] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.
[0280] Referring to FIG. 17, in operation 1711, the input device (230) may obtain information related to the movement of the input device (230) by using an inertial sensor (e.g., an inertial sensor (431) of FIG. 4) of a sensor circuit (e.g., a sensor circuit (430) of FIG. 4). For example, the information related to the movement of the input device (230) may include movement speed information, movement direction information, movement distance information, and / or inclination information of the input device (230). In operation 1713, the input device (230) may transmit the information related to the movement of the input device (230) obtained through the sensor circuit (430) to the first electronic device (210). In operation 1715, the input device (230) may transmit the information related to the movement of the input device (230) obtained through the sensor circuit (430) to the second electronic device (220).
[0281] In one embodiment, the first electronic device (210) may detect a specific gesture (e.g., a gesture of drawing a circle (1620) and / or a gesture of drawing a triangle (1630) of FIG. 16) based on movement information received from the input device (230) in operation 1717. The first electronic device (210) may transmit information related to the detection of the specific gesture to the second electronic device (220) in operation 1719. The first electronic device (210) may recognize, in operation 1721, that the first electronic device (210) is in a mode of resetting the level of a display (e.g., a display (351) of FIG. 3) and / or a second display of the second electronic device (220) (e.g., a second display (221) of FIG. 2). The second electronic device (220) may also receive information related to detection of a specific gesture from the first electronic device (210), thereby recognizing the mode for resetting the level of the display (351) and / or the second display (221) of the second electronic device (220).
[0282] In one embodiment, although not shown, the second electronic device (220) may also detect a specific gesture based on movement information received from the input device (230). In this case, the operation 1719 described above may be omitted.
[0283] In one embodiment, the input device (230) may emit a signal of a second designated pattern in operation 1723. For example, the input device (230) may emit an optical signal of a second designated pattern through a light emitting unit of an optical sensor (e.g., the optical sensor (433) of FIG. 4).
[0284] In one embodiment, the first electronic device (210) may receive an optical signal emitted in a second designated pattern from the input device (230) in operation 1725. Although not shown, the first electronic device (210) may store time information at which the optical signal emitted in the second designated pattern from the input device (230) is received in a memory (e.g., the memory (320) of FIG. 3). In operation 1727, the first electronic device (210) may obtain third location information of the input device (230) based on the received optical signal of the second designated pattern.
[0285] In one embodiment, the second electronic device (220) may receive an optical signal emitted in a second designated pattern from the input device (230) in operation 1729. Although not shown, the second electronic device (220) may store time information at the time of receiving the optical signal emitted in the second designated pattern from the input device (230) in memory. The second electronic device (220) may obtain fourth location information of the input device (230) based on the received optical signal of the second designated pattern in operation 1731. The second electronic device (220) may transmit the fourth location information of the input device (230) to the first electronic device (210) in operation 1733.
[0286] In one embodiment, in operation 1735, the first electronic device (210) can determine a second relative position of the second electronic device (220) with respect to the first electronic device (210) based on the third position information and the fourth position information of the input device (230). For example, the first electronic device (210) can compare the third position information and the fourth position information in a timeline and estimate the position and / or movement of the input device (230) based on the comparison result. In operation 1737, the first electronic device (210) can reset the levels of the display (351) of the first electronic device (210) and the second display (221) of the second electronic device (220) based on the second relative position of the second electronic device (220).
[0287] In FIGS. 13 to 17 according to various embodiments, the first electronic device (210) can recognize a mode for resetting the level of the display (351) and the second display (221) of the second electronic device (220) based on movement information of the second electronic device (220) and / or a specific gesture input by the input device (230). Accordingly, the first electronic device (210) can also provide the user with an easy way to reset the level of the display (351) and the second display (221).
[0288] In FIGS. 2 through 17 according to various embodiments, the input device (230) is described as a smart ring that can be worn on a body part (e.g., a finger), but is not limited thereto. For example, the input device (230) may also include an electronic pen. In this regard, various embodiments will be described in FIG. 18, which will be described later.
[0289] FIG. 18 is a drawing for explaining a method of setting the level of a display (351) of a first electronic device (210) and a second display (221) of a second electronic device (220) according to one embodiment of the present disclosure.
[0290] In various embodiments, a first electronic device (e.g., the first electronic device (210) of FIG. 2), a second electronic device (e.g., the second electronic device (220) of FIG. 2), and an electronic pen (1801) may be communicatively connected via a designated communication (e.g., short-range communication).
[0291] Referring to FIG. 18, the electronic pen (1801) can touch (1830) the display (e.g., the display (351) of FIG. 3) of the first electronic device (210), move to the right (1840), and then touch (1850) the second display (e.g., the second display (221) of FIG. 2) of the second electronic device (220). For example, the first electronic device (210) can detect a first touch input (1830) by the electronic pen (1801) on the display (351). The first electronic device (210) can store the first touch input (1830) and first time information about the time at which the first touch input (1830) was detected in a memory (e.g., the memory (320) of FIG. 3). The second electronic device (220) can detect a second touch input (1850) by an electronic pen (1801) on the second display (221). The second electronic device (220) can store the second touch input (1850) and second time information about the time at which the second touch input (1850) was detected in a memory.
[0292] In one embodiment, the first electronic device (210) and the second electronic device (220) may exchange information related to a touch input detected by the electronic pen (1801) (e.g., exchange of first time information about the first touch input (1830) and the time at which the first touch input (1830) was detected, and second time information about the second touch input (1850) and the time at which the second touch input (1850) was detected).
[0293] In one embodiment, the first electronic device (210) can estimate the movement, for example, the direction of movement, of the electronic pen (1801) based on the first touch input (1830) and first time information for the first point in time at which the first touch input (1830) is detected, and the second touch input (1850) and second time information for the second point in time at which the second touch input (1850) is detected. For example, the first electronic device (210) can estimate that the electronic pen (1801) has moved in the right direction (e.g., direction ①) based on the first touch input (1830) detected at the first point in time and the second touch input (1850) detected at the second point in time. The first electronic device (210) can determine that the second electronic device (220) is positioned in the right direction (e.g., direction ①) based on the first electronic device (210) assuming that the electronic pen (1801) has moved in the right direction (e.g., direction ①).
[0294] In one embodiment, the first electronic device (210) may set the display (351) of the first electronic device (210) as the primary display and the second display (221) of the second electronic device (220) as the secondary display based on the fact that the second electronic device (220) is positioned in the right direction (e.g., direction ①) with respect to the first electronic device (210).
[0295] In one embodiment, the electronic pen (1801) may obtain movement information of the electronic pen (1801) through a sensor circuit and transmit the same to the first electronic device (210) and / or the second electronic device (220). The first electronic device (210) and / or the second electronic device (220) may detect a specific gesture based on the movement information of the electronic pen (1801) received from the input device (230). For example, in one embodiment, the specific gesture may include, for example, a gesture of drawing a circle (1810) and / or a gesture of drawing a triangle (1820), which is a trigger gesture for resetting the level of the display (351).
[0296] In one embodiment, the first electronic device (210) and / or the second electronic device (220) may determine a mode to reset the level of the display (351) (and / or the second display (221)) based on detecting a specific gesture. Then, as described above, based on the touch input of the touch pen (1801) detected on the display (351) of the first electronic device (210) and the second display (221) of the second electronic device (220), the first electronic device (210) may estimate the movement of the electronic pen (1801), for example, the direction of movement. The first electronic device (210) may reset the level of the display (351) of the first electronic device (210) and the second display (221) of the second electronic device (220) based on the estimated movement of the electronic pen (1801), for example, the direction of movement.
[0297] In FIG. 18 according to various embodiments, the relative position of the second electronic device (220) is described as being determined based on the touch input of the electronic pen (1801) detected on the display (351) of the first electronic device (210) and the display (221) of the second electronic device (220), but is not limited thereto. For example, the electronic pen (1801) may include a light-emitting unit. For example, the light-emitting unit may be arranged in an area where a pen tip is formed, and may output a light signal of a specified pattern. However, the present invention is not limited thereto. The first electronic device (210) and the second electronic device (220) may receive a light signal output from the light-emitting unit of the electronic pen (1801), and determine the relative position of the second electronic device (220). The method in which the first electronic device (210) receives light output from the pen tip and determines the relative position of the second electronic device (220) may be substantially the same as the method in which the first electronic device (210) receives a light signal of a specified pattern output from a light-emitting unit of an input device (230) (e.g., a wearable electronic device) and determines the relative position of the second electronic device (220), as described in FIGS. 2 to 17 above.
[0298] FIG. 19 is a drawing for explaining a method of controlling a screen using an input device (230) of a first electronic device (210) according to one embodiment of the present disclosure.
[0299] Referring to FIG. 19, a first display (e.g., display (351) of FIG. 3) of a first electronic device (210) may be set as a primary display, and a second display (e.g., second display (221) of FIG. 2) of a second electronic device (220) may be set as a secondary display. In this state, the first electronic device (210) may detect an input for moving (1920) a specific object (1910) displayed on the first display (351) of the first electronic device (210) to the second display (221) of the second electronic device (220). For example, based on movement information of the input device (230), an input for moving (1920) a specific object (1910) to the second display (221) of the second electronic device (220) may be detected. However, the present invention is not limited thereto.
[0300] In one embodiment, based on detecting an input for moving (1920) a specific object (1910) displayed on a first display (351) of a first electronic device (210) to a second display (221) of a second electronic device (220), a visual effect (e.g., an animation effect) of moving (1920) a specific object (1910) from the first display (351) of the first electronic device (210) to the second display (221) of the second electronic device (220) can be provided. Accordingly, a visual effect of a specific object (1910) flying in a rightward direction (1920) can be applied to intuitively express that the specific object (1910) is moving to the second display (221) of the second electronic device (220).
[0301] FIG. 20 is a drawing for explaining a user interface for the level of a display (351) of a first electronic device (210) and a second display (221) of a second electronic device (220), and a user interface indicating a relative position of the second electronic device (220) with respect to the first electronic device (210), according to one embodiment of the present disclosure.
[0302] In one embodiment, when a first electronic device (e.g., the first electronic device (210) of FIG. 2) determines that a second electronic device (e.g., the second electronic device (220) of FIG. 2) is positioned in the right direction (e.g., direction ①) with respect to the first electronic device (210), the display of the first electronic device (210) (e.g., the display (351) of FIG. 3) may be set as a primary display, and the second display of the second electronic device (220) (e.g., the second display (221) of FIG. 2) may be set as a secondary display.
[0303] Referring to Fig. 20, reference number <2010> As illustrated, the first electronic device (210) can be controlled to display a first indicator (2011) indicating that the display (351) is set as a primary display on at least a portion of the display (351), and to display a second indicator (2013) indicating that the second display (221) is set as a secondary display on at least a portion of the second display (221).
[0304] It is not limited to this, and the reference number <2030> As illustrated, the first electronic device (210) can display a third indicator (2031) indicating a direction (e.g., direction ①) in which the second electronic device (220) is placed relative to the first electronic device (210), on at least a portion of the display (351). The second electronic device (220) can display a fourth indicator (2033) indicating a direction (e.g., direction ②) in which the first electronic device (210) is placed relative to the second electronic device (220), on at least a portion of the second display (221).
[0305] In various embodiments, although not shown, when an optical signal emitted from a light emitting unit of an input device (230) is detected on a display (351) of a first electronic device (210) or a second display (221) of a second electronic device (220), the first electronic device (210) may display a pointing object corresponding to the optical signal on the display (351) or the second display (221).
[0306] In FIGS. 2 to 20 according to various embodiments, it has been described that the first electronic device (210) is the subject, the first electronic device (210) determines the relative position of the second electronic device (220) with respect to the first electronic device (210), and sets the levels of the display (351) of the first electronic device (210) and the second display (221) of the second electronic device (220) based on the relative position, but the present invention is not limited thereto. For example, the second electronic device (220) may be the subject, the second electronic device (220) determines the relative position of the first electronic device (210) with respect to the second electronic device (220), and sets the levels of the display (351) of the first electronic device (210) and the second display (221) of the second electronic device (220) based on the relative position. In this case, the operations of the first electronic device (210) described above can be performed in the second electronic device (220), and the operations of the second electronic device (220) can be performed in the first electronic device (210).
[0307] A method for controlling a screen using an input device (230) of an electronic device (210) according to one embodiment of the present disclosure may include an operation of obtaining first location information related to a location of an input device (230) that is communicatively connected via a communication circuit (310). A method for controlling a screen using an input device (230) of an electronic device (210) according to one embodiment may include an operation of receiving, from a second electronic device (220) that is communicatively connected via a communication circuit (310), second location information related to a location of the input device (230) obtained by the second electronic device (220). A method for controlling a screen using an input device (230) of an electronic device (210) according to one embodiment may include an operation of confirming a relative location of the second electronic device (220) with respect to the electronic device (210) based on the first location information related to the location of the input device (230) obtained and the second location information related to the location of the input device (230) received from the second electronic device (220). A method for controlling a screen using an input device (230) of an electronic device (210) according to one embodiment may include an operation of setting an arrangement of a display (351) of the electronic device (210) and a second display (221) of the second electronic device (220) based on a confirmed relative position of the second electronic device (220).
[0308] An operation of obtaining first location information related to a location of an input device (230) according to one embodiment may include an operation of receiving, through a receiving unit of a distance measuring sensor (341), an optical signal emitted in a specified pattern from a light emitting unit of the input device (230). An operation of obtaining first location information related to a location of an input device (230) according to one embodiment may include an operation of obtaining first location information related to a location of the input device (230) based on at least one piece of time information about a time point at which an optical signal of a specified pattern is received from the input device (230).
[0309] An operation of obtaining first location information related to a location of an input device (230) according to one embodiment may include an operation of receiving information related to movement of the input device (230) from the input device (230). An operation of obtaining first location information related to a location of an input device (230) according to one embodiment may include an operation of obtaining first location information related to a location of the input device (230) based on at least one of at least one piece of time information about a time point at which an optical signal of a specified pattern is received from the input device (230) and at least one piece of time information about a time point at which information related to movement of the input device (230) is received.
[0310] A method for controlling a screen using an input device (230) of an electronic device (210) according to one embodiment may include an operation of storing, in a memory (320), at least one piece of time information regarding a time point at which a light signal of a specified pattern is received from the input device (230) and at least one piece of time information regarding a time point at which information related to movement of the input device (230) is received.
[0311] An operation of obtaining first location information related to the location of the input device (230) according to one embodiment may include an operation of confirming the shape of an optical signal received through a receiving unit of a distance measuring sensor (341). An operation of obtaining first location information related to the location of the input device (230) according to one embodiment may include an operation of obtaining first location information related to the location of the input device (230) based on the shape of the optical signal received for each timeline.
[0312] An operation of confirming the relative position of the second electronic device (220) with respect to the electronic device (210) according to one embodiment may include an operation of comparing at least one piece of time information related to a time point at which first position information related to the position of the input device (230) is acquired with at least one piece of time information related to a time point at which second position information is received. An operation of confirming the relative position of the second electronic device (220) with respect to the electronic device (210) according to one embodiment may include an operation of estimating at least one of a position and a movement of the input device (230) based on a comparison result. An operation of confirming the relative position of the second electronic device (220) with respect to the electronic device (210) according to one embodiment may include an operation of confirming the relative position of the second electronic device (220) with respect to the electronic device (210) based on at least one of the estimated position and movement of the input device (230).
[0313] A method for controlling a screen using an input device (230) of an electronic device (210) according to one embodiment may include an operation of confirming at least one of distance information and depth information with respect to a second electronic device (220) based on the confirmed relative position of the second electronic device (220). A method for controlling a screen using an input device (230) of an electronic device (210) according to one embodiment may include an operation of setting a first display property on a first screen to be displayed on a display (351) and setting a second display property on a second screen to be displayed on a second display (221) of the second electronic device (220) based on at least one of distance information and depth information with respect to the second electronic device (220). A method for controlling a screen using an input device (230) of an electronic device (210) according to one embodiment may include an operation of displaying a first screen on a display (351) based on a set first display property, and displaying a second screen on a second display (221) of a second electronic device (220) based on a set second display property.
[0314] A method for controlling a screen using an input device (230) of an electronic device (210) according to one embodiment may include an operation of receiving information related to movement of a second electronic device (220) from a second electronic device (220). A method for controlling a screen using an input device (230) of an electronic device (210) according to one embodiment may include an operation of receiving an optical signal emitted in a second specified pattern from a light emitting unit of the input device (230) through a receiving unit of a distance measuring sensor (341). A method for controlling a screen using an input device (230) of an electronic device (210) according to one embodiment may include an operation of obtaining third position information related to a position of the input device (230) based on the received optical signal of the second specified pattern. A method for controlling a screen using an input device (230) of an electronic device (210) according to one embodiment may include an operation of receiving, from a second electronic device (220), fourth location information related to a location of the input device (230) acquired by the second electronic device (220). A method for controlling a screen using an input device (230) of an electronic device (210) according to one embodiment may include an operation of confirming a second relative location of the second electronic device (220) with respect to the electronic device (210) based on third location information and fourth location information related to the location of the input device (230). A method for controlling a screen using an input device (230) of an electronic device (210) according to one embodiment may include an operation of re-arranging a second display (221) of a second electronic device (220) of a display (351) of the electronic device (210) based on the second relative location of the second electronic device (220).
[0315] A method for controlling a screen using an input device (230) of an electronic device (210) according to one embodiment may include an operation of receiving information related to movement of the input device (230) from the input device (230). A method for controlling a screen using an input device (230) of an electronic device (210) according to one embodiment may include an operation of detecting a specific gesture based on the received information related to movement of the input device (230). A method for controlling a screen using an input device (230) of an electronic device (210) according to one embodiment may include an operation of checking a mode for resetting levels of a display (351) and a second display (221) of a second electronic device (220) based on detection of a specific gesture.
[0316] A method for controlling a screen using an input device (230) of an electronic device (210) according to one embodiment may include an operation of displaying an indicator indicating a relative position of a second electronic device (220) with respect to the electronic device (210) on at least a portion of a display (351).
[0317] Examples related to the present disclosure are presented in the paragraphs below:
[0318] According to a first example, the electronic device (210) may include a communication circuit (310), a display (351), and a processor (360) operatively connected to the communication circuit (310) and the display (351). The processor (360) according to one embodiment may obtain first location information related to a location of an input device (230) communicatively connected through the communication circuit (310). The processor (360) according to one embodiment may receive second location information related to a location of the input device (230) obtained by the second electronic device (220) from a second electronic device (220) communicatively connected through the communication circuit (310). According to one embodiment, the processor (360) can determine the relative position of the second electronic device (220) with respect to the electronic device (210) based on first position information related to the position of the acquired input device (230) and second position information related to the position of the input device (230) received from the second electronic device (220). According to one embodiment, the processor (360) can set the arrangement of the display (351) and the second display (221) of the second electronic device (220) based on the determined relative position of the second electronic device (210).
[0319] According to a second example, the electronic device (210) may include a distance measurement sensor (341). The processor (360) according to one embodiment may receive, through the receiving unit of the distance measurement sensor (341), an optical signal emitted in a specified pattern from the light emitting unit of the input device (230). The processor (360) according to one embodiment may obtain first location information related to the location of the input device (230) based on at least one piece of time information about the time point at which the optical signal of the specified pattern is received from the input device (230).
[0320] According to a third example, the processor (360) may receive information related to movement of the input device (230) from the input device (230). According to one embodiment, the processor (360) may obtain first position information related to the position of the input device (230) based on at least one of time information about a time point at which a light signal of a specified pattern is received from the input device (230) and at least one time information about a time point at which information related to movement of the input device (230) is received.
[0321] According to a fourth example, the electronic device (210) may include a memory (320). The processor (360) according to one embodiment may store in the memory (320) at least one piece of time information regarding a time point at which an optical signal of a specified pattern is received from the input device (230) and at least one piece of time information regarding a time point at which information related to movement of the input device (230) is received. For example, the processor (360) may store time information (e.g., a timeline) related to the received optical signal in the memory (320). In one embodiment, the processor (360) may store information related to the movement of the input device (230) (e.g., information related to time information for the received optical signal) for each timeline.
[0322] According to the fifth example, the processor (360) can check the shape of the optical signal received through the receiving unit of the distance measuring sensor (341). According to one embodiment, the processor (360) can obtain first position information related to the position of the input device (230) based on the shape of the optical signal received by timeline (e.g., related to time information that may include one or more points in time for the received optical signal).
[0323] According to a sixth example, the processor (360) may compare at least one piece of time information related to a time point at which the first location information related to the location of the input device (230) is acquired with at least one piece of time information related to a time point at which the second location information is received. According to one embodiment, the processor (360) may estimate at least one of the location and movement of the input device (230) based on the comparison result. According to one embodiment, the processor (360) may determine the relative location of the second electronic device (220) with respect to the electronic device (210) based on at least one of the estimated location and movement of the input device (230).
[0324] According to the seventh example, the processor (360) may check at least one of distance information and depth information with respect to the second electronic device (220) based on the confirmed relative position of the second electronic device (220). The processor (360) according to one embodiment may set a first display property on a first screen to be displayed on the display (351) and set a second display property on a second screen to be displayed on the second display (221) of the second electronic device (220) based on at least one of distance information and depth information with respect to the second electronic device (220). The processor (360) according to one embodiment may display the first screen on the display (351) based on the set first display property, and display the second screen on the second display (221) of the second electronic device (220) based on the set second display property.
[0325] According to the eighth example, the processor (360) may receive information related to the movement of the second electronic device (220) from the second electronic device (220). The processor (360) according to one embodiment may receive, through the receiving unit of the distance measuring sensor (341), an optical signal emitted in a second designated pattern from the light emitting unit of the input device (230). The processor (360) according to one embodiment may obtain third location information related to the location of the input device (230) based on the received optical signal of the second designated pattern. The processor (360) according to one embodiment may receive, from the second electronic device (220), fourth location information related to the location of the input device (230) obtained from the second electronic device (220). According to one embodiment, the processor (360) can determine the second relative position of the second electronic device (220) with respect to the electronic device (210) based on the third position information and the fourth position information related to the position of the input device (230). According to one embodiment, the processor (360) can reset the arrangement of the display (351) of the electronic device (210) and the second display (221) of the second electronic device (220) based on the second relative position of the second electronic device (220).
[0326] According to the ninth example, the processor (360) may receive information related to the movement of the input device (230) from the input device (230). According to one embodiment, the processor (360) may detect a specific gesture based on the information related to the movement of the input device (230) received from the input device (230). According to one embodiment, the processor (360) may determine, based on the detection of the specific gesture, a mode for reconfiguring the arrangement of the display (351) and the second display (221) of the second electronic device (220). For example, based on the received information related to the movement of the input device (230), the processor (360) may determine (or determine) that a specific gesture has been performed, and the specific gesture may be a gesture corresponding to (e.g., starting or entering) a mode for reconfiguring the display levels (e.g., display arrangement) of the display (351) and the second display (221).
[0327] According to the tenth example, the processor (360) may display an indicator indicating a relative position (e.g., a confirmed relative position) of the second electronic device (220) with respect to the electronic device (210) on at least a portion of the display (351).
[0328] According to the eleventh example, the method for controlling a screen using an input device (230) of an electronic device (210) may include an operation of acquiring first location information related to a location of an input device (230) that is communicatively connected via a communication circuit (310). The method for controlling a screen using an input device (230) of an electronic device (210) according to one embodiment may include an operation of receiving, from a second electronic device (220) that is communicatively connected via a communication circuit (310), second location information related to a location of an input device (230) acquired by a second electronic device (220). The method for controlling a screen using an input device (230) of an electronic device (210) according to one embodiment may include an operation of confirming a relative location of a second electronic device (220) with respect to the electronic device (210) based on the acquired first location information related to the location of the input device (230) and the second location information related to the location of the input device (230) received from the second electronic device (220). A method for controlling a screen using an input device (230) of an electronic device (210) according to one embodiment may include an operation of setting an arrangement of a display (351) of the electronic device (210) and a second display (221) of the second electronic device (220) based on a confirmed relative position of the second electronic device (220).
[0329] According to the 12th example, the operation of obtaining the first location information related to the position of the input device (230) may include an operation of receiving, through the receiving unit of the distance measuring sensor (341), an optical signal emitted in a specified pattern from the light emitting unit of the input device (230). The operation of obtaining the first location information related to the position of the input device (230) according to one embodiment may include an operation of obtaining the first location information related to the position of the input device (230) based on at least one piece of time information about the time point at which the optical signal of the specified pattern is received from the input device (230).
[0330] According to the 13th example, the operation of obtaining the first location information related to the position of the input device (230) may include the operation of receiving information related to the movement of the input device (230) from the input device (230). The operation of obtaining the first location information related to the position of the input device (230) according to one embodiment may include the operation of obtaining the first location information related to the position of the input device (230) based on at least one of at least one piece of time information about a time point at which an optical signal of a specified pattern is received from the input device (230) and at least one piece of time information about a time point at which information related to the movement of the input device (230) is received.
[0331] According to the 14th example, a method for controlling a screen using an input device (230) of an electronic device (210) may include an operation of storing in a memory (320) at least one piece of time information regarding a time point at which a light signal of a specified pattern is received from the input device (230) and at least one piece of time information regarding a time point at which information related to movement of the input device (230) is received.
[0332] According to the 15th example, the operation of obtaining the first location information related to the position of the input device (230) may include the operation of confirming the shape of the optical signal received through the receiving unit of the distance measuring sensor (341). The operation of obtaining the first location information related to the position of the input device (230) according to one embodiment may include the operation of obtaining the first location information related to the position of the input device (230) based on the shape of the optical signal received for each timeline.
[0333] According to the 16th example, the operation of confirming the relative position of the second electronic device (220) with respect to the electronic device (210) may include an operation of comparing at least one piece of time information related to a time point at which first position information related to the position of the input device (230) is acquired with at least one piece of time information related to a time point at which second position information is received. The operation of confirming the relative position of the second electronic device (220) with respect to the electronic device (210) according to one embodiment may include an operation of estimating at least one of a position and a movement of the input device (230) based on a comparison result. The operation of confirming the relative position of the second electronic device (220) with respect to the electronic device (210) according to one embodiment may include an operation of confirming the relative position of the second electronic device (220) with respect to the electronic device (210) based on at least one of the estimated position and movement of the input device (230).
[0334] According to the 17th example, the screen control method using the input device (230) of the electronic device (210) may include an operation of confirming at least one of distance information and depth information with respect to the second electronic device (220) based on the confirmed relative position of the second electronic device (220). The screen control method using the input device (230) of the electronic device (210) according to one embodiment may include an operation of setting a first display property on a first screen to be displayed on the display (351) and setting a second display property on a second screen to be displayed on the second display (221) of the second electronic device (220) based on at least one of distance information and depth information with respect to the second electronic device (220). A method for controlling a screen using an input device (230) of an electronic device (210) according to one embodiment may include an operation of displaying a first screen on a display (351) based on a set first display property, and displaying a second screen on a second display (221) of a second electronic device (220) based on a set second display property.
[0335] According to the 18th example, the method for controlling a screen using the input device (230) of the electronic device (210) may include an operation of receiving information related to the movement of the second electronic device (220) from the second electronic device (220). The method for controlling a screen using the input device (230) of the electronic device (210) according to one embodiment may include an operation of receiving an optical signal emitted in a second specified pattern from the light emitting unit of the input device (230) through the receiving unit of the distance measuring sensor (341). The method for controlling a screen using the input device (230) of the electronic device (210) according to one embodiment may include an operation of obtaining third position information related to the position of the input device (230) based on the received optical signal of the second specified pattern. A method for controlling a screen using an input device (230) of an electronic device (210) according to one embodiment may include an operation of receiving, from a second electronic device (220), fourth location information related to a location of the input device (230) acquired by the second electronic device (220). A method for controlling a screen using an input device (230) of an electronic device (210) according to one embodiment may include an operation of confirming a second relative location of the second electronic device (220) with respect to the electronic device (210) based on third location information and fourth location information related to the location of the input device (230). A method for controlling a screen using an input device (230) of an electronic device (210) according to one embodiment may include an operation of re-arranging a second display (221) of a second electronic device (220) of a display (351) of the electronic device (210) based on the second relative location of the second electronic device (220).
[0336] According to the 19th example, the method for controlling a screen using an input device (230) of an electronic device (210) may include an operation of receiving information related to movement of the input device (230) from the input device (230). The method for controlling a screen using an input device (230) of an electronic device (210) according to one embodiment may include an operation of detecting a specific gesture based on the received information related to movement of the input device (230). The method for controlling a screen using an input device (230) of an electronic device (210) according to one embodiment may include an operation of confirming a mode for resetting the level of a display (351) and a second display (221) of a second electronic device (220) based on the detection of a specific gesture.
[0337] According to the 20th example, a method for controlling a screen using an input device (230) of an electronic device (210) may include an operation of displaying an indicator indicating a relative position of a second electronic device (220) with respect to the electronic device (210) on at least a portion of a display (351).
[0338] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.
[0339] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases “A or B,” “at least one of A and B,” “at least one of A or B,” “A, B, or C,” “at least one of A, B, and C,” and “at least one of A, B, or C” can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as “first,” “second,” or “first” or “second” may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as “coupled” or “connected” to another component (e.g., a second component), with or without the terms “functionally” or “communicatively,” it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.
[0340] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0341] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.
[0342] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smart phones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.
[0343] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and arranged in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
Claims
1. In an electronic device (210), Communication circuit (310); display (351); and It includes a processor (360) operatively connected to the above communication circuit (310) and the above display (351), The above processor (360) Obtain first location information related to the location of an input device (230) connected to communication through the above communication circuit (310), Receive second location information related to the location of the input device (230) obtained from the second electronic device (220) through the communication circuit (310), Based on the first location information related to the position of the input device (230) acquired above and the second location information related to the position of the input device (230) received above, the relative position of the second electronic device (220) is confirmed with respect to the electronic device (210), and An electronic device configured to set the arrangement of the display (351) and the second display (221) of the second electronic device (220) based on the relative position of the second electronic device (220) confirmed above.
2. In paragraph 1, Further comprising a distance measuring sensor (341), The above processor (360) Through the receiving unit of the above distance measuring sensor (341), a light signal emitted in a specified pattern from the light emitting unit of the input device (230) is received, and An electronic device set to obtain first location information related to the location of the input device (230) based on at least one piece of time information regarding the time at which an optical signal of a specified pattern is received from the input device (230).
3. In paragraph 2, Including additional memory (320), The above processor (360) Receive information related to the movement of the input device (230) from the input device (230), Based on at least one piece of time information about the time at which information related to the movement of the input device (230) is received, first location information related to the location of the input device (230) is acquired, An electronic device set to store in the memory (320) at least one piece of time information regarding a time at which an optical signal of a specified pattern is received from the input device (230) and at least one piece of time information regarding a time at which information related to movement of the input device (230) is received.
4. In paragraph 2 or 3, The above processor (360) Check the shape of the optical signal received through the receiving unit of the above distance measuring sensor (341), and An electronic device set to obtain first location information related to the location of the input device (230) based on the shape of the received optical signal.
5. In any one of paragraphs 1 to 4, The above processor (360) Compare at least one time information related to the time at which the first location information was acquired and at least one time information related to the time at which the second location information was received, Based on the above comparison results, at least one of the position and movement of the input device (230) is estimated, and An electronic device set to determine the relative position of the second electronic device (220) with respect to the electronic device (210) based on at least one of the estimated position and movement of the input device (230).
6. In any one of paragraphs 1 to 5, The above processor (360) Based on the relative position of the second electronic device (220) confirmed above, at least one of distance information and depth information with respect to the second electronic device (220) is confirmed, Based on at least one of the distance information and depth information with respect to the second electronic device (220), a first display property is set on a first screen to be displayed on the display (351), and a second display property is set on a second screen to be displayed on a second display (221) of the second electronic device (220), and An electronic device set to display the first screen on the display (351) based on the set first display property, and to display the second screen on the second display (221) of the second electronic device (220) based on the set second display property.
7. In paragraph 2, The above processor (360) Receive information related to the movement of the second electronic device (220) from the second electronic device (220), Through the receiving unit of the above distance measuring sensor (341), an optical signal emitted in a second designated pattern is received from the light emitting unit of the above input device (230), Based on the received second designated pattern of optical signal, third position information related to the position of the input device (230) is obtained, Receive fourth location information related to the location of the input device (230) obtained from the second electronic device (220), Based on the third location information and the fourth location information, the second relative location of the second electronic device (220) is confirmed with respect to the electronic device (210), and An electronic device configured to reset the arrangement of the display (351) of the electronic device (210) and the second display (221) of the second electronic device (220) based on the relative second position of the second electronic device (220).
8. In any one of paragraphs 1 to 6, The above processor (360) Receive information related to the movement of the input device (230) from the input device (230), Based on the information related to the movement of the input device (230) received above, a specific gesture is detected, and An electronic device set to determine a mode for resetting the arrangement of the display (351) and the second display (221) of the second electronic device (220) based on detecting the specific gesture.
9. In any one of paragraphs 1 to 8, The above processor (360) An electronic device set to display an indicator indicating a relative position of the second electronic device (220) based on the electronic device (210) on at least a portion of the display (351).
10. In a screen control method using an input device (230) of an electronic device (210), An operation of obtaining first position information related to the position of an input device (230) connected to communication through a communication circuit (310); An operation of receiving second location information related to the location of the input device (230) obtained from a second electronic device (220) that is connected to the communication circuit (310); An operation of confirming the relative position of the second electronic device (220) with respect to the electronic device (210) based on the first position information related to the position of the input device (230) acquired above and the second position information related to the position of the input device (230) received above; and A method including an action of setting an arrangement of a display (351) of the electronic device (210) and a second display (221) of the second electronic device (220) based on the relative position of the second electronic device (220) confirmed above.
11. In Article 10, The operation of obtaining first location information related to the location of the above input device (230) is as follows: An operation of receiving a light signal emitted in a specified pattern from the light emitting unit of the input device (230) through the receiving unit of the distance measuring sensor (341); and An operation of obtaining first position information related to the position of the input device (230) based on at least one piece of time information about the time at which an optical signal of a specified pattern is received from the input device (230), The operation of obtaining first location information related to the location of the above input device (230) is as follows: An operation of receiving information related to movement of the input device (230) from the input device (230); An operation of obtaining first location information related to the location of the input device (230) based on at least one piece of time information about the time at which information related to the movement of the input device (230) is received; and A method further comprising an operation of storing in a memory (320) at least one piece of time information regarding a time at which an optical signal of a specified pattern is received from the input device (230) and at least one piece of time information regarding a time at which information related to movement of the input device (230) is received.
12. In paragraph 11, The operation of obtaining first location information related to the location of the above input device (230) is as follows: An operation for confirming the shape of the optical signal received through the receiving unit of the distance measuring sensor (341); A method including an operation of obtaining first position information related to a position of the input device (230) based on a shape of the received optical signal.
13. In any one of paragraphs 10 to 12, The operation of checking the relative position of the second electronic device (220) based on the electronic device (210) is as follows: An operation of comparing at least one time information related to a time at which the first location information is acquired and at least one time information related to a time at which the second location information is received; An operation of estimating at least one of the position and movement of the input device (230) based on the above comparison result; and A method including an operation of determining a relative position of the second electronic device (220) with respect to the electronic device (210) based on at least one of the estimated position and movement of the input device (230).
14. In any one of paragraphs 10 to 13, An operation of checking at least one of distance information and depth information with respect to the second electronic device (220) based on the relative position of the second electronic device (220) confirmed above; An operation of setting a first display property on a first screen to be displayed on the display (351) and setting a second display property on a second screen to be displayed on a second display (221) of the second electronic device (220) based on at least one of distance information and depth information with respect to the second electronic device (220); and A method further comprising an action of displaying the first screen on the display (351) based on the set first display property, and displaying the second screen on the second display (221) of the second electronic device (220) based on the set second display property.
15. In paragraph 11, An operation of receiving information related to movement of the second electronic device (220) from the second electronic device (220); An operation of receiving a light signal emitted in a second designated pattern from the light emitting unit of the input device (230) through the receiving unit of the distance measuring sensor (341); An operation of obtaining third position information related to the position of the input device (230) based on the optical signal of the second designated pattern received above; An operation of receiving fourth location information related to the location of the input device (230) obtained from the second electronic device (220); An operation of confirming a relative second position of the second electronic device (220) based on the third location information and the fourth location information with respect to the electronic device (210); and A method further comprising the action of resetting the arrangement of the display (351) of the electronic device (210) and the second display (221) of the second electronic device (220) based on the relative second position of the second electronic device (220).
Citation Information
Patent Citations
Electronic device and contents sharing method for electronic device
KR1020110125724A
Remote controller capable of remotely controlling a plurality of device
KR1020170038530A
Algae control system for overhead distribution lines and its construction method
KR102605912B1
Natural adhesive with improved water resistance and stain resistance and its manufacturing method
KR102813749B1
KR20230106473A