Device connection method and related apparatus
Automatically establishing connections through device position relationships, the problem of poor experience when smart devices switch scenarios is solved, and rapid switching and collaborative work between devices is realized.
Patent Information
- Application Number
- PCT/CN2024/093016
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-30
- Filing Date
- 2024-05-14
- Publication Date
- 2024-12-05
AI Technical Summary
When switching different scenarios, users need to manually select and connect multiple smart devices, resulting in poor experience and it is difficult to quickly switch between multi-device scenarios.
By obtaining the positional relationship between devices, automatically establishing a connection relationship, displaying device identification and association information, and realizing file transfer and media content transfer, users can automatically connect by just approaching the target device.
It improves the user experience, reduces manual operations, and realizes rapid switching and collaborative work between devices.
Smart Images

Figure CN2024093016_05122024_PF_FP_ABST
Abstract
Description
Device connection method and related device
[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office on May 30, 2023, with application number 202310627480.3 and invention name “A device connection method and related equipment”, the entire contents of which are incorporated by reference into this application. Technical Field
[0002] The present application relates to the field of terminals, and in particular to a device connection method and related devices. Background Art
[0003] Users are increasingly using smart devices, and they often use multiple devices in a single scenario. These scenarios can often be divided geographically, with the living room and bedroom being two different scenarios. Users often carry their smart devices with them to switch between scenarios, and when switching between scenarios, portable smart devices (such as mobile phones) may need to connect to different scenarios to facilitate tasks like file transfers and collaborative work. When switching between scenarios, how to enable portable devices to quickly switch between different multi-device scenarios is a pressing technical challenge.
[0004] Summary of the Invention
[0005] This application provides a device connection method that can improve user experience.
[0006] In the first aspect, the present application provides a device connection method, which is applied to a first device, and the method includes: obtaining the positional relationship between the first device and each of a plurality of devices in the scene; when the positional relationship between the first device and a second device among the plurality of devices meets a preset condition, establishing a connection relationship with the second device; the connection relationship is used for file transfer or transferring the media content presented by itself to the connected device for presentation; after the connection relationship is established, displaying the first identifier of the first device, the second identifier of the second device, and the association information between the first identifier and the second identifier.
[0007] Through the above method, the terminal can determine the terminal that meets the preset conditions based on the positional relationship between itself and other devices in the scene, and automatically establish a connection relationship with the terminal that meets the preset conditions, so that the user does not need to manually select the terminal every time the scene changes, and the user does not need to judge which device is the device that needs to be connected. The user only needs to approach the device that needs to be connected in the physical world to automatically establish a connection with the device, thereby improving the user experience.
[0008] In a possible implementation, the first identifier, the second identifier, and the associated information are displayed through one of a status bar, a desktop wallpaper, and a floating window.
[0009] In a possible implementation, the association information includes a process of changing the first identifier and the second identifier from an unassociated state to an associated state.
[0010] In a possible implementation, the change process is displayed through an adsorption effect.
[0011] In one possible implementation, the display style of the first identifier is related to the device type of the first device; or, the display style of the second identifier is related to the device type of the second device; or, the positional relationship includes a distance, and the display style of the first identifier is related to the distance; or, the display style of the second identifier is related to the distance; wherein, the display style includes at least one of display size, display shape, and display color.
[0012] In a possible implementation, the positional relationship includes at least one of a distance, a change in distance, a relative direction, and a change in relative direction.
[0013] In a possible implementation, the position relationship includes a distance, and the preset condition includes that the distance is less than a distance threshold, wherein at least two different types of devices correspond to different distance thresholds.
[0014] In one possible implementation, the positional relationship is a positional relationship in three-dimensional space, and the method further includes: displaying a first device distribution map based on the positional relationship; the first device distribution map includes an identifier corresponding to each of the devices, and the display position of the identifier in the first device distribution map in the first device distribution map matches the positional relationship under the first perspective; receiving a perspective switching instruction, and displaying a second device distribution map; the second device distribution map includes an identifier corresponding to each of the devices, and the display position of the identifier in the second device distribution map in the second device distribution map matches the positional relationship under the second perspective.
[0015] In a possible implementation, the method further includes: triggering establishment of a connection relationship between other devices among the multiple devices except the second device and the second device when a positional relationship between the second device and the at least one device satisfies a preset condition.
[0016] In one possible implementation, the display of the first identifier of the first device, the second identifier of the second device, and the association information between the first identifier and the second identifier includes: receiving a first operation, switching the currently displayed application interface to a connection interface, and displaying the first identifier of the first device, the second identifier of the second device, and the association information between the first identifier and the second identifier in the connection interface; the method also includes: floatingly displaying a card corresponding to the application interface on the connection interface; receiving a second operation, the second operation instructing to move the card to the second identifier; and transferring the media content presented on the application interface to the second device for presentation.
[0017] In a second aspect, the present application provides a device connection apparatus, applied to a first device, the apparatus comprising:
[0018] an acquisition module, configured to acquire a positional relationship between the first device and each of a plurality of devices in the scene;
[0019] a processing module, configured to establish a connection relationship with a second device among the plurality of devices when a positional relationship between the second device and the second device satisfies a preset condition; the connection relationship being used to transfer files or transfer the media content presented by the device to the connected device for presentation;
[0020] After the connection relationship is established, the first identifier of the first device, the second identifier of the second device, and association information between the first identifier and the second identifier are displayed.
[0021] In a possible implementation, the first identifier, the second identifier, and the associated information are displayed through one of a status bar, a desktop wallpaper, and a floating window.
[0022] In a possible implementation, the association information includes a process of changing the first identifier and the second identifier from an unassociated state to an associated state.
[0023] In a possible implementation, the change process is displayed through an adsorption effect.
[0024] In one possible implementation,
[0025] The display style of the first identifier is related to the device type of the first device; or,
[0026] The display style of the second identifier is related to the device type of the second device; or,
[0027] The positional relationship includes a distance, and the display style of the first identifier is related to the distance; or,
[0028] The display style of the second mark is related to the distance; wherein,
[0029] The display style includes at least one of display size, display shape, and display color.
[0030] In a possible implementation, the positional relationship includes at least one of a distance, a change in distance, a relative direction, and a change in relative direction.
[0031] In a possible implementation, the position relationship includes a distance, and the preset condition includes that the distance is less than a distance threshold, wherein at least two different types of devices correspond to different distance thresholds.
[0032] In a possible implementation, the positional relationship is a positional relationship in a three-dimensional space, and the processing module is further configured to:
[0033] Displaying a first device distribution map according to the positional relationship; the first device distribution map includes an identifier corresponding to each of the devices, and a display position of the identifier in the first device distribution map matches the positional relationship under the first viewing angle;
[0034] A perspective switching instruction is received, and a second device distribution map is displayed; the second device distribution map includes an identifier corresponding to each of the devices, and the display position of the identifier in the second device distribution map matches the position relationship under the second perspective.
[0035] In a possible implementation, the processing module is further configured to:
[0036] When the position relationship between the second device and the at least one device satisfies a preset condition, it is triggered to establish a connection relationship between the second device and other devices in the multiple devices except the second device.
[0037] In a possible implementation, the processing module is specifically configured to:
[0038] receiving a first operation, switching a currently displayed application interface to a connection interface, and displaying a first identifier of the first device, a second identifier of the second device, and association information between the first identifier and the second identifier in the connection interface;
[0039] The processing module is further configured to: suspend and display a card corresponding to the application interface on the connection interface;
[0040] receiving a second operation, wherein the second operation instructs to move the card to the second mark;
[0041] The media content presented on the application interface is transferred to the second device for presentation.
[0042] In a third aspect, an embodiment of the present application provides a device connection device, which may include a memory, a processor, and a bus system, wherein the memory is used to store programs, and the processor is used to execute the programs in the memory to perform the first aspect and any optional method thereof.
[0043] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, in which a computer program is stored. When the computer-readable storage medium is run on a computer, the computer executes the above-mentioned first aspect and any optional method thereof.
[0044] In a fifth aspect, an embodiment of the present application provides a computer program product comprising instructions, which, when executed on a computer, enables the computer to execute the above-mentioned first aspect and any optional method thereof.
[0045] In a sixth aspect, the present application provides a chip system comprising a processor configured to support a device connection apparatus in implementing some or all of the functions described in the aforementioned aspects, such as transmitting or processing data or information described in the aforementioned methods. In one possible design, the chip system further comprises a memory configured to store program instructions and data necessary to execute the device or train the device. The chip system may consist of a single chip or may include a chip and other discrete components. BRIEF DESCRIPTION OF THE DRAWINGS
[0046] Figure 1 is a schematic diagram of an application architecture;
[0047] Figure 2 is a schematic diagram of an application architecture;
[0048] Figure 3 is a schematic diagram of an application architecture;
[0049] Figure 4 is a schematic diagram of an application scenario;
[0050] FIG5 is a schematic diagram of an embodiment of a device connection method provided in an embodiment of the present application;
[0051] FIG6 is a schematic diagram of an interface in an embodiment of the present application;
[0052] FIG7 is a schematic diagram of an interface in an embodiment of the present application;
[0053] FIG8 is a schematic diagram of an interface in an embodiment of the present application;
[0054] FIG9 is a schematic diagram of an interface in an embodiment of the present application;
[0055] FIG10 is a schematic diagram of an interface in an embodiment of the present application;
[0056] FIG11 is a schematic diagram of an interface in an embodiment of the present application;
[0057] FIG12 is a schematic diagram of an interface in an embodiment of the present application;
[0058] FIG13 is a schematic diagram of an embodiment of a device connection device provided in an embodiment of the present application;
[0059] FIG14 is a schematic diagram of the structure of an execution device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0060] The following describes the embodiments of the present invention in conjunction with the accompanying drawings. The terms used in the embodiments of the present invention are only used to explain the specific embodiments of the present invention, and are not intended to limit the present invention.
[0061] The embodiments of the present application are described below in conjunction with the accompanying drawings. Those skilled in the art will appreciate that, with the development of technology and the emergence of new scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.
[0062] The terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequential order. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances, and this is merely a way of distinguishing the objects of the same attributes when describing them in the embodiments of the present application. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, so that the process, method, system, product or equipment comprising a series of units need not be limited to those units, but may include other units that are not clearly listed or inherent to these processes, methods, products or equipment.
[0063] It should be understood that when an element or layer is referred to as being “on,” “connected to,” or “coupled to” another element or layer, the element or layer can be directly on, directly connected to, or directly coupled to the other element or layer, or one or more intervening elements or layers may be present. It should also be understood that when an element or layer is referred to as being “between” two elements or layers, the element or layer can be the only element or layer between the two elements or layers, or one or more intervening elements or layers may also be present.
[0064] As used herein, the terms "substantially," "about," and similar terms are used as terms of approximation, not as terms of degree, and are intended to take into account the inherent variations in measurements or calculations that one of ordinary skill in the art would recognize. Furthermore, the use of "may" when describing embodiments of the present invention refers to "one or more possible embodiments." As used herein, the terms "use," "using," and "used" may be considered synonymous with the terms "utilize," "utilizing," and "utilized," respectively. Additionally, the term "exemplary" is intended to refer to an example or illustration.
[0065] FIG1 is a schematic diagram of a system 10 according to some exemplary embodiments. The system 10 may include multiple devices, and the devices in FIG1 may communicate with each other. In a non-limiting embodiment, as shown in FIG1 , the system 10 may include multiple smart devices such as a mobile phone 11, a tablet 12, smart glasses 13, a watch 14, a speaker 15, a smart screen 16, and a laptop computer 17. In addition, the devices in the system 10 may also include a media player (e.g., an MP3 player, an MP4 player, etc.), an ultra-mobile personal computer (UMPC), a personal digital assistant (PDA), a wireless headset, a smart bracelet, a wireless car, an augmented reality (AR) / virtual reality (VR) device, or a television, etc.
[0066] In a non-limiting embodiment, when the environment in which the system 10 is located is a home environment, multiple devices can be located in the same local area network. As shown in Figure 1, the system 10 can also include a router 101. The router 101 in the system 10 can be set as an access point (AP) to provide a signal source for the network. Furthermore, each device in the system 10 can access the router 101 as a station (STA). The router 101 can communicate with each device separately through a wired network or a wireless network. Exemplarily, a Wi-Fi link is established between each device through a wireless fidelity (Wi-Fi) protocol to achieve communication between each device. The specific implementation can be to establish a peer-to-peer (P2P) connection (or Wi-Fi Direct) between each device, or each device accesses the same router 101 to achieve communication between each device. In some other embodiments, the devices may also establish a Bluetooth link using the Bluetooth protocol, and implement communication between the devices based on the Bluetooth link; or, the devices may also communicate through a mobile network or the Internet.
[0067] The first device and the second device in the embodiment of the present application can be any device in the above system.
[0068] Please refer to Figure 2, which is a schematic diagram of the structure of an electronic device 100 provided in an embodiment of the present application. The structures of the above devices (including the first device and the second device) can all be shown in Figure 2.
[0069] The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
[0070] It should be understood that the structure illustrated in the embodiments of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0071] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.
[0072] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.
[0073] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.
[0074] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface.
[0075] The I2C interface is a bidirectional synchronous serial bus that includes a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple I2C bus lines. The processor 110 may be coupled to the touch sensor 180K, the charger, the flash, the camera 193, and the like via different I2C bus interfaces. For example, the processor 110 may be coupled to the touch sensor 180K via the I2C interface, enabling communication between the processor 110 and the touch sensor 180K via the I2C bus interface, thereby implementing the touch function of the electronic device 100.
[0076] The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the I2S interface, enabling the function of answering calls through a Bluetooth headset.
[0077] The PCM interface can also be used for audio communication, sampling, quantizing, and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface, enabling the function of answering calls via a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.
[0078] The UART interface is a universal serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is typically used to connect the processor 120 and the wireless communication module 160. For example, the processor 120 communicates with the Bluetooth module in the wireless communication module 160 via the UART interface to implement Bluetooth functionality. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the UART interface, enabling the function of playing music through Bluetooth headphones.
[0079] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display 194 and the camera 193. MIPI interfaces include the camera serial interface (CSI) and the display serial interface (DSI). In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to implement the camera function of the electronic device 100. The processor 120 and the display 194 communicate via the DSI interface to implement the display function of the electronic device 100.
[0080] The GPIO interface can be configured via software. The GPIO interface can be configured as either a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to the camera 193, display 194, wireless communication module 160, audio module 170, sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.
[0081] The USB interface 130 is an interface that complies with USB standards and may be a Mini USB interface, a Micro USB interface, a USB Type-C interface, or the like. The USB interface 130 can be used to connect a charger to charge the electronic device 100, or to transfer data between the electronic device 100 and peripheral devices. It can also be used to connect headphones to play audio. This interface can also be used to connect other electronic devices, such as augmented reality devices.
[0082] It is understood that the interface connection relationship between the modules illustrated in the embodiment of the present invention is merely an illustrative illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods from the above embodiments, or a combination of multiple interface connection methods.
[0083] The charging management module 140 is configured to receive charging input from a charger. The charger can be either a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 can receive wireless charging input via the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also provide power to the electronic device via the power management module 141.
[0084] The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and provides power to the processor 110, the internal memory 121, the display 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage, impedance). In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.
[0085] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.
[0086] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.
[0087] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.
[0088] The modem processor may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.) or displays an image or video through the display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.
[0089] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.
[0090] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with a network and other devices through wireless communication technologies. The wireless communication technologies may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).
[0091] Electronic device 100 implements display functionality through a GPU, display screen 194, and an application processor. A GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.
[0092] Display screen 194 is used to display images, videos, and the like. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-oLed, or a quantum dot light-emitting diode (QLED). In some embodiments, electronic device 100 may include one or N display screens 194, where N is a positive integer greater than one.
[0093] The electronic device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.
[0094] The ISP processes data fed back by camera 193. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, which is then passed to the ISP for processing and converted into a visible image. The ISP can also perform algorithmic optimization on image noise, brightness, and skin tone. It can also optimize parameters such as exposure and color temperature of the captured scene. In some embodiments, the ISP can be located within camera 193.
[0095] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.
[0096] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.
[0097] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. This allows electronic device 100 to play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, and MPEG4.
[0098] The NPU is a neural network (NN) computing processor. Drawing on the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it rapidly processes input information and can continuously self-learn. The NPU can enable intelligent cognitive applications in electronic device 100, such as image recognition, face recognition, speech recognition, and text comprehension.
[0099] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 via the external memory interface 120 to implement data storage functions. For example, files such as music and videos can be stored on the external memory card.
[0100] The internal memory 121 can be used to store computer executable program codes, which include instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the electronic device 100 by running instructions stored in the internal memory 121 and / or instructions stored in a memory provided in the processor.
[0101] The electronic device 100 can implement audio functions such as music playback and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.
[0102] The buttons 190 include a power button, a volume button, and the like. The buttons 190 may be mechanical buttons or touch buttons. The electronic device 100 may receive key inputs and generate key signal inputs related to user settings and function control of the electronic device 100.
[0103] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. For touch operations acting on different areas of the display screen 194, motor 191 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.
[0104] The indicator 192 may be an indicator light, which may be used to indicate the charging status, power level changes, messages, missed calls, notifications, etc.
[0105] The SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to or disconnected from the electronic device 100 by inserting it into or removing it from the SIM card interface 195. The electronic device 100 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, and the like. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of the multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to implement functions such as calls and data communications. In some embodiments, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.
[0106] The software system of the electronic device 100 can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. In the embodiment of the present invention, the Android system with a layered architecture is used as an example to illustrate the software structure of the electronic device 100.
[0107] FIG3 is a block diagram of the software structure of the electronic device 100 according to an embodiment of the present invention.
[0108] A layered architecture divides software into several layers, each with distinct roles and responsibilities. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer.
[0109] The application layer can include a series of application packages.
[0110] As shown in FIG3 , the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and short message.
[0111] The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer includes some predefined functions.
[0112] As shown in FIG3 , the application framework layer may include a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and the like.
[0113] The window manager is used to manage window programs. The window manager can obtain the display size, determine whether there is a status bar, lock the screen, take screenshots, etc.
[0114] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.
[0115] The view system includes visual controls, such as those for displaying text and images. The view system is used to build applications. A display interface can consist of one or more views. For example, a display interface containing a text notification icon might include a view for displaying text and a view for displaying images.
[0116] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including answering, hanging up, etc.).
[0117] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.
[0118] The Notification Manager allows applications to display notifications in the status bar. These messages can be displayed briefly and then disappear automatically without user interaction. For example, the Notification Manager is used to notify users of completed downloads and message reminders. The Notification Manager can also display notifications in the top status bar of the system as icons or scrolling text, such as notifications from background applications, or as dialog windows on the screen. Examples include text messages in the status bar, beeps, vibrations on electronic devices, and flashing indicator lights.
[0119] Android Runtime includes core libraries and a virtual machine. Android runtime is responsible for scheduling and management of the Android system.
[0120] The core library consists of two parts: one is the function that needs to be called by the Java language, and the other is the Android core library.
[0121] The application layer and application framework layer run in a virtual machine. The virtual machine executes Java files in the application layer and application framework layer as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.
[0122] The system library can include multiple functional modules, such as the surface manager, media libraries, and 3D graphics processing libraries (such as OpenGL ES).
[0123] The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.
[0124] The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
[0125] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
[0126] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, and sensor driver.
[0127] In a non-limiting embodiment, as shown in FIG3 , the system library may further include a networking manager, which is used to discover devices in the system 10. The discovered devices may be selected as prompt devices and / or connection devices. In some embodiments, when the devices in the system 10 are connected to the same AP to form a local area network, the devices in the system 10 are peripheral devices to each other, or in other words, the devices in the system 10 are devices near the user. The networking manager of a device in the system 10 can discover all other online devices under the same AP, and all online devices under the same AP (including a device in the system 10 and other devices) complete the networking. In some embodiments, the networking manager of a device in the system 10 discovers that among the other devices online in the local area network of the same AP, the account logged in by one or some other devices is the account of the device, or the account logged in by one or some other devices is an associated account of the account logged in by the device, then the other devices logged in to the account or associated account are devices trusted by the device, or in other words, all devices logged in to the account or associated account are mutually trusted devices. The networking is completed between devices logged in to accounts or associated accounts under the same AP, which can ensure the security and privacy of notifications. In some embodiments, when the devices in the system 10 communicate through a mobile network or the Internet, the network manager can discover through the mobile network or the Internet that the accounts logged in by some devices in the system 10 are the same account or associated accounts, and when these devices are located near the user, these devices complete the networking, which can ensure the security and privacy of notifications. Among them, the associated accounts can be accounts authorized by the same account. Specifically, Bluetooth RSSI (Received Signal Strength Indication) ranging or satellite positioning can be used to determine the distance between each device and the distance between the user and each device. The network manager can discover devices in the system 10 near the user, and can increase the interaction and collaboration capabilities between devices to avoid users manually searching and filtering devices in the system 10, reduce user operations, and improve efficiency.
[0128] Referring to FIG. 4 , FIG. 4 is a schematic diagram of an application scenario of the present application, which includes:
[0129] Local device A01: This is typically a user's handheld mobile device, which the user uses to switch between different scenarios. It is equipped with an operating system, which has system-level accounts, and the user uses their account to log in to the operating system.
[0130] Scenario A02: A small area in the physical world, such as a living room or bedroom. Multiple smart devices are configured in the scene. The smart devices are equipped with an operating system with a system-level account. At least one smart device in the scene is logged in with the same account as the system-level account of the mobile phone.
[0131] Users are increasingly using smart devices, and they often use multiple devices in a single scenario. These scenarios can often be divided geographically, with the living room and bedroom being two different scenarios. Users often carry their smart devices with them to switch between scenarios, and when switching between scenarios, portable smart devices (such as mobile phones) may need to connect to different scenarios to facilitate tasks like file transfers and collaborative work. When switching between scenarios, how to enable portable devices to quickly switch between different multi-device scenarios is a pressing technical challenge.
[0132] To solve the above problem, refer to FIG5 , which is a schematic diagram of a process of a device connection method provided in an embodiment of the present application. As shown in FIG5 , a device connection method provided in an embodiment of the present application includes:
[0133] 501. Obtain a positional relationship between the first device and each of multiple devices in the scene.
[0134] The embodiments of the present application can be applied to a first device.
[0135] In one possible implementation, the first device may be located indoors, and the scene in which the first device is located may be a physical scene or a usage scene. The physical scene may be the same room as or a nearby room where the first device is located. The usage scene may be a scene related to the function used by the user when using the first device. For example, when the user is using the first device for work, the scene in which the first device is located may be a work scene, and the devices in the scene in which the first device is located may be other devices in the same office.
[0136] For example, each scene can correspond to a 3D space, for example, a living room and a study can each correspond to a 3D space. Alternatively, multiple scenes can correspond to a single 3D space, for example, multiple scenes within a home can share a single 3D space. Typically, due to the distance between locations, multiple closely spaced scenes can share a single 3D space, allowing the portable device to switch scenes without switching 3D spaces. Separate 3D spaces can be used for scenes farther apart, for example, a home and an office can be separated into two separate 3D spaces.
[0137] Regarding the construction of a three-dimensional space: Each terminal can determine the relative position relationship, device type, and other information between devices through real-time communication, and then construct the three-dimensional space in real time based on the determined relative position relationship, device type, and other information. It can also be constructed in advance by fixed devices in the scene. For example, when a mobile device joins, the fixed device builds a three-dimensional space model and transmits it to the mobile terminal. The mobile terminal then adjusts the three-dimensional space model in real time based on this model and the newly added device. Optionally, the fixed device is a smart device with a fixed position, such as a TV or lamp.
[0138] In one possible implementation, the first device can obtain the positional relationship between each of the multiple devices in the scene. For example, the first device can calculate the positional relationship between each of the multiple devices in the scene by itself, or the first device can receive the positional relationship between each of the multiple devices in the scene sent by other devices (such as the central control device in the system, or other terminal devices), or the first device can calculate the positional relationship between a part of the multiple devices in the scene by itself, and receive the positional relationship between another part of the multiple devices in the scene sent by other devices (such as the central control device in the system, or other terminal devices).
[0139] In a possible implementation, the positional relationship may be at least one of a relative distance, a change in a relative distance, a relative direction, and a change in a relative direction.
[0140] Next, we describe how to determine the positional relationship between the first device and the other device. In one implementation, the positional relationship between the first device and the other device can be determined using existing technologies such as ultra-wideband (UWB), ultrasound, laser, and vision. For example, relative distance and direction can be established through a bidirectional connection between the first device and the other device (requiring both the first device and the other device to have hardware capable of transmitting / receiving wireless positioning signals), and the distance and angle between the handheld first device and the other device can be calculated. In one implementation, triangulation can be performed between multiple devices (a handheld device with hardware capable of transmitting / receiving wireless positioning signals, and three or more fixed devices in space with hardware capable of transmitting / receiving wireless positioning signals, which can exist independently or rely on other devices in the space equipped with the hardware). The absolute position of each device can be determined using time difference of arrival (TODA). When sufficient hardware capable of transmitting / receiving wireless positioning signals is available, the six-degree-of-freedom (6DoF) posture of the devices can be determined, and the devices can share their postures. Consequently, the posture of the first device itself and the postures of other devices can be obtained.
[0141] In one possible implementation, when a user uses a first device, there is a need to establish a connection relationship between the first device and other devices in the scene. After the connection relationship is established, files can be transferred or data can be transferred between the devices (the so-called data flow can be understood as: transferring the media content presented by itself to the connected device for presentation, for example, the currently playing video or music can be transferred to other devices for continued playback).
[0142] Optionally, in order to enable the user to easily know which other devices with which a connection relationship can be established are located in the scene where the device being used (that is, the first device) is located and where they are located, an interface can be displayed on the first device, which can present the other devices in the scene where the first device is located and the positional relationship between other devices and the first device.
[0143] Optionally, in order to enable users to accurately know the location of other devices, the position relationship presented on the interface can be the position relationship between devices in three-dimensional space (three-dimensional position relationship can more accurately represent the position of the device in some scenarios (compared with two-dimensional position relationship). For example, if two devices are close in horizontal position, the representation based on two-dimensional space position will make it difficult for users to distinguish between their respective devices).
[0144] Optionally, the positional relationship in the three-dimensional space may be represented by the distance and direction between the two devices, or by the three-dimensional coordinates of the two devices.
[0145] In one possible implementation, the first device may display a first device distribution map based on the positional relationships. The first device distribution map includes an identifier corresponding to each device, and the display positions of the identifiers in the first device distribution map match the positional relationships. Based on the first device distribution map presented by the first device, a user can understand the positions of other devices in three-dimensional space.
[0146] In one possible implementation, the first device distribution map may include the identification of the first device and other devices. Since the location of the first device is the current location of the user, the user can know the location of other devices in three-dimensional space through the positional relationship between the identification of other devices and the identification of the first device.
[0147] Alternatively, the logo may be a geometric figure, a simulacrum figure, or any other figure with referential meaning. For example, a mobile phone icon (simulacrum figure) may be placed inside a sphere (geometric figure) to serve as the logo of the mobile device.
[0148] Optionally, the size of the identifier may indicate the distance relationship between the other device and the first device. For example, the closer the distance, the larger the size of the identifier, and the farther the distance, the smaller the size of the identifier.
[0149] Optionally, the display position and size of the logo may indicate the directional relationship between the other device and the first device.
[0150] Optionally, the identifier of the first device may be displayed in a central area of the first device distribution map.
[0151] In addition, the display position of the identifier in the first device distribution map can match the positional relationship under the first viewing angle. In other words, the first device distribution map can restore the position of the first device and other devices in three-dimensional space under a certain viewing angle. The device identifier has specified coordinates in three-dimensional space, and the coordinates correspond to the physical location of the device corresponding to the identifier. In other words, the relative positional relationship of the identifier can reflect the relative positional relationship between the devices in the physical world.
[0152] Optionally, when the first device distribution map is presented in the first device, it is presented at a preset viewing angle. For example, the logo representing the first device (ie, the device currently being operated by the user) may be centered and displayed in an appropriate size on the interface.
[0153] In one possible implementation, a user can switch the display perspective of the device distribution map by performing certain operations on the interface. Specifically, a perspective switching instruction can be received to display a second device distribution map; the second device distribution map includes an identifier corresponding to each device, and the display position of the identifier in the second device distribution map matches the positional relationship under the second perspective.
[0154] The second viewing angle may be a viewing angle obtained by adjusting the first viewing angle in the horizontal direction and / or the pitch direction, or the second viewing angle may be a viewing angle obtained by reducing or enlarging the first viewing angle.
[0155] For example, the viewing angle switching instruction may be an instruction corresponding to a sliding operation, whereby sliding left and right adjusts the viewing angle in the horizontal direction to observe the logos of other devices in the horizontal direction, and sliding up and down adjusts the viewing angle in the pitch direction to observe other visual logos in the vertical direction.
[0156] For example, the perspective switching instruction can be an instruction corresponding to a pinch or spread operation. By pinching with two fingers, the perspective can be enlarged, and the device logo can be correspondingly reduced. By spreading with two fingers, the perspective can be reduced, and the terminal logo can be correspondingly enlarged. The above-mentioned perspective switching operation can also be other operation types, not limited to the ones listed above.
[0157] For example, refer to Figure 7, which shows a left-swipe operation to change the horizontal viewing angle. By rotating, sphere a, representing the smart speaker, is positioned in the center of the screen. Sphere b, representing the TV on the right, disappears completely as the viewing angle changes, while sphere c, representing another device, enters the screen. This allows you to view more devices in the current scene by adjusting the viewing angle.
[0158] In one possible implementation, the position relationship can indicate the relative position relationship between other devices and the first device. In order to enable the user to know the absolute position of other devices in space, the first device distribution interface can also display indication information of the environment, such as other objects in the environment (such as some fixed objects, exemplified by tables, etc.).
[0159] In one possible implementation, the above-mentioned first device distribution map and second device distribution map can be called 3D spatial distribution maps. In addition to the 3D spatial distribution map, the first device can also display a 2D plane distribution map, and the user can switch between the 2D plane distribution map and the 3D spatial distribution map based on certain operations.
[0160] For example, a switch control is provided on the connection interface to switch between a 2D plane distribution map and a 3D space distribution map. The 2D plane distribution map can be the same as or similar to the existing technology. For example, the logo of the first device is displayed in the center area of the 2D plane distribution map, and the remaining devices are displayed around the currently operated device according to certain rules.
[0161] Refer to Figure 6, which shows a 3D spatial distribution diagram corresponding to the physical environment. Figure 6 (a) is a schematic diagram of the physical environment, and Figure 6 (b) is the 3D spatial distribution diagram. By communicating with each other, the mobile phone, speakers, and TV can determine the relative positions of each device, creating a position distribution map in real time. By adding markers to the corresponding device locations (such as the sphere in Figure 6 (a)), the 3D spatial distribution map is generated.
[0162] When the 3D spatial distribution diagram is displayed on the currently operated device, it is presented at a pre-set perspective. For example, the sphere representing the first device (the device currently operated by the user, such as the mobile phone in Figure 6 (a)) is centered and displayed on the screen at an appropriate size.
[0163] Optionally, the identifiers corresponding to different types of devices may have different sizes (e.g., spheres of different sizes), and the correspondence between the sphere size and the device type may be pre-set. For example, in Figure 6 (a), the radius of the sphere for a TV is larger than that for a mobile phone, and the radius of the sphere for a mobile phone is larger than that for a smart speaker.
[0164] Optionally, the size of the marker may also change as the distance between the device and the first device changes to enhance the stereoscopic visual effect of the space. For example, as the distance decreases, the size of the marker increases, and as the distance increases, the size of the marker decreases.
[0165] In one possible implementation, the devices displayed in the first device distribution map may not be all the devices in the environment where the first device is located, but rather some of the devices in the environment, such as devices logged in to the same account (also referred to as collaborative devices in the embodiment of this application), and the first device and the collaborative devices have the authority to transmit data to each other.
[0166] Next, we will introduce how to identify a coordinated device from multiple devices:
[0167] The first device is the device currently being operated by the user. The first device is logged into a system-level account. Account information can be transmitted to the cloud via the network or data from collaborative devices can be downloaded from the cloud, enabling cloud synchronization of account data with the collaborative devices. Collaborative devices are devices logged into the same account as the first device. Account information can be transmitted to the cloud via the network or data from the local device / other collaborative devices can be downloaded from the cloud, enabling cloud synchronization of account data with the first device and other collaborative devices. The identities of the first device and collaborative devices are not unique and can be switched between them based on user operations.
[0168] When the first device carried by the user moves within the scene, the first device can communicate with all smart devices in the current scene through broadcasting or Bluetooth communication to obtain the account information currently logged in to the smart device. Then, based on the received feedback information, the device logged in with the same account as the mobile terminal is identified as a collaborative device.
[0169] Of course, collaborative devices can also be identified through other communication methods. For example, a mobile terminal can obtain the identification information (such as MAC address) of all smart devices currently logged into the same account from the cloud, and then add representation information to the broadcast so that only specific objects (devices logged into the same account) can receive the broadcast and send feedback information to the mobile terminal. The mobile terminal then identifies the collaborative device based on the feedback information.
[0170] The embodiments of the present application do not limit the communication means used to identify the collaborative device.
[0171] It is understandable that the above collaborative device can also detect the local device and other collaborative devices through a similar communication method.
[0172] It should be understood that the identified collaborative device, in addition to being used as a device displayed on the first device distribution interface, can also be used as a condition for subsequently establishing a connection relationship with the device. That is, the device with which the first device establishes a connection relationship is selected from the collaborative device.
[0173] 502. When the positional relationship between the second device and the plurality of devices satisfies a preset condition, establish a connection relationship with the second device; the connection relationship is used for transferring files or transferring the media content presented by the device to the connected device for presentation.
[0174] In a possible implementation, the aforementioned multiple devices may be collaborative devices.
[0175] In a possible implementation, the first device may establish a connection relationship with a device (eg, the second device) among the multiple devices whose positional relationship satisfies a preset condition.
[0176] In the prior art, when a user establishes a connection relationship between the currently used device and other devices, he needs to open a device selection interface, which can display other terminals in the scene where the terminal is located. The user can manually select the terminal to be connected in the interface. Therefore, whenever the scene where the terminal is located changes, the user needs to re-select the terminal to be connected from the updated interface. The operation is cumbersome and results in a poor user experience.
[0177] In an embodiment of the present application, the terminal can determine the terminal that meets the preset conditions based on the positional relationship between itself and other devices in the scene, and automatically establish a connection relationship with the terminal that meets the preset conditions, so that the user does not need to manually select the terminal every time the scene changes, thereby improving the user experience.
[0178] Next, we introduce the preset conditions satisfied by the relative position:
[0179] This application uses relative position as a condition for establishing a device connection relationship. Specifically, whether the relative position meets a preset condition is used as a condition for establishing a device connection relationship. When a user wants to establish a connection between the currently used device and another device, he or she will usually move closer to the device he or she wants to connect. Therefore, in order to ensure that the device connected to the first device meets the user's wishes, the preset condition can be set to: the relative position indicates the device that is close to the first device in the scene, or the device that is closest to the first device (or has the greatest tendency to approach) among multiple devices in the scene. Furthermore, the device whose relative position meets the preset condition can be a device that is close to the first device, or the device that is closest to the first device (or has the greatest tendency to approach) among multiple devices.
[0180] For example, the environment where the first device is located includes device 1, device 2 and device 3. In one case, the first device gradually approaches device 1 and gradually moves away from device 2 and device 3. The relative position of the first device and device 1 can indicate that the first device and device 1 are approaching each other. In this case, device 1 can be considered as the device that the user most wants to connect to, because it can be determined that the relative position between the first device and device 1 meets the preset conditions.
[0181] In one possible implementation, the positional relationship may include a distance, and the preset condition includes the distance being less than a distance threshold, or the device being the closest to the device in the scene (or the device that satisfies both the minimum distance and the distance being less than the distance threshold). The distance threshold may be related to the device type of the terminal, for example, the distance threshold for a smart speaker is greater than the distance threshold for a smart TV.
[0182] The above distance thresholds can also be presented in the 3D spatial distribution map (i.e., the first device distribution map and the second device distribution map described above). For example, the distance thresholds for establishing a connection between different devices can be determined based on the size of the markers in the 3D spatial distribution map. Different types of devices have different distance judgments when establishing a connection with the first device.
[0183] For example, if a device is identified as a sphere, different device sizes correspond to different spheres. A gravitational function (similar to planetary gravity) can be defined for each sphere, with the gravitational force decreasing with distance. When another device enters the gravitational range of the first device, the gravitational force of the sphere on the first device is calculated. If the gravitational force is greater than a preset value, the first device is considered able to establish a connection with the other device.
[0184] The distance may include at least one of a straight-line distance, a horizontal distance, or a vertical distance. The straight-line distance is the distance between the geometric centers or centers of gravity of two communication devices; the horizontal distance is the straight-line distance between the geometric centers or centers of gravity of two devices when projected onto the same horizontal plane; and the vertical distance is the straight-line distance between the geometric centers or centers of gravity of two devices when projected onto a vertical plane.
[0185] In a possible implementation, the positional relationship may include a change in distance, and the preset condition includes that the change in distance gradually decreases, or the device with the fastest distance reduction rate among the devices in the scene.
[0186] In one possible implementation, the positional relationship may include direction or a change in direction, and the direction or change in direction may indicate that the device is close to the first device or is the device closest to the first device (or has the greatest tendency to approach) among multiple devices in the scene, as a preset condition.
[0187] In a possible implementation, when the relative position between the first device and a second device among multiple devices in the scene meets a preset condition, a connection relationship between the first device and the second device can be established.
[0188] In addition, when the positional relationship between the second device and the at least one device meets a preset condition, the second device can be used as the central device and trigger the establishment of a connection relationship between the second device and other devices in the multiple devices except the second device.
[0189] 503. After the connection relationship is established, display the first identifier of the first device, the second identifier of the second device, and association information between the first identifier and the second identifier.
[0190] In order to enable the user to easily know the device that is currently connected to the first device, the first identifier of the first device, the second identifier of the second device, and the association information between the first identifier and the second identifier can be displayed after the connection relationship is established. The association information can indicate that a connection has been established between the first device and the second device.
[0191] Among them, the first identifier and the second identifier displayed in step 503 can be similar to the identifiers in the 3D device distribution map introduced above or directly reused. For example, in step 503, the first identifier, the second identifier and related information can be displayed in a different display position or different interface from the 3D device distribution map.
[0192] In one possible implementation, the association information may include the process of changing the first identifier and the second identifier from an unassociated state to an associated state, thereby allowing the user to intuitively understand the establishment of a connection between the second device and the first device and the timing of the establishment of the connection relationship. Optionally, the change process may be displayed using an adsorption effect. For example, a light effect may be displayed on the adhered portion of the identifier.
[0193] Next, we will introduce the display styles of the first and second logos:
[0194] In one possible implementation, the first identifier of the first device and the second identifier of the second device can be displayed on the interface; the display style of the first identifier is related to the device type of the first device; or, the display style of the second identifier is related to the device type of the second device.
[0195] That is to say, different device types can correspond to different display styles, so that users can easily know which device is in the scene. Optionally, the display sample may include the size of the display (for example, a larger device may correspond to a larger logo), the shape of the display (for example, a polygon such as a sphere, a triangle, or a more realistic shape) and the color of the display.
[0196] In a possible implementation, the positional relationship includes a distance, and the display style of the first identifier is related to the distance; or, the display style of the second identifier is related to the distance.
[0197] For example, the closer the distance, the larger the size of the marker, and the farther the distance, the smaller the size of the marker.
[0198] In a possible implementation, the first identifier, the second identifier, and the associated information may be displayed via a status bar, a desktop wallpaper, or a floating window, which are described below with reference to the accompanying drawings.
[0199] 1) Floating window:
[0200] That is, through traditional bubbles, pop-up windows and text information prompts, the user is prompted that the first device has established a connection with the second device. Figure 8 shows an example interface of the information window prompt.
[0201] Figure 8 (a) shows a traditional pop-up window prompt, which prompts the user by displaying a window, card, or bubble in the interface and then displaying text information within the window, card, or bubble. Alternatively, a design similar to the Smart Island shown in Figure 8 (b) can be used, with an animation process culminating in the presentation of a card that uses icons, text, and other information to notify the user that the first device has established a connection with the second device.
[0202] 2) Status bar:
[0203] That is, by adding an indicator icon in the top status bar, bottom status bar, drop-down status bar or desktop, the icon indicates that the current device has established a collaborative connection with another device. Figure 9 shows an example of adding an indicator icon in the top status bar.
[0204] 3) Desktop wallpaper changes:
[0205] That is, the change in wallpaper indicates that the two devices have established a connection. Optionally, the 2D plane distribution map or 3D space distribution map introduced above can be directly used as the desktop wallpaper, that is, the 2D plane distribution map or 3D space distribution map of the connection interface (such as the first device distribution map or the second device distribution map introduced in the above embodiment) can be set as the desktop wallpaper during the connection establishment process or after the collaborative connection is established. Refer to Figure 10, which is a schematic interface for setting the 3D space distribution map as the desktop wallpaper.
[0206] When setting the spatial distribution map as wallpaper, the same animation model is used for both the wallpaper and the spatial distribution map, so the interface graphics the user sees before and after the action are unchanged. Notifying the user through wallpaper changes not only serves the purpose of notification, but also reduces the artificiality of traditional notification methods like message windows, resulting in a more natural notification method.
[0207] Exemplarily, Figure 10 shows a schematic diagram of the effect of setting a 3D spatial distribution map as a wallpaper. In Figure 10, the two devices have not yet established a collaborative connection. When the two devices establish a connection, the two spheres approach each other, and stick together after collision, which means that the connection between the two devices has been established. Figure 11 shows the desktop wallpaper after the collaborative connection is established. In Figure 11, after the connection is established, the two spheres stick to each other, indicating that the two devices have established a collaborative connection, and multi-device collaborative capabilities such as data flow and file transfer can be achieved between the two devices. Since the 2D or 3D device distribution map can fully present the process of establishing a connection between the two devices, when the device distribution map is set as wallpaper, the user can intuitively "see" the process of the two devices establishing a collaborative connection from the wallpaper.
[0208] In order to identify the establishment relationship of the cooperative connection, a corresponding light effect may be displayed at the intersection of the spheres, for example, a glowing effect may be displayed at the intersection of the two spheres.
[0209] Optionally, after the connection is established, in order to maintain this adhesion, the coordinates of the device (especially the mobile terminal) in the physical world and the position of the device in the three-dimensional space no longer correspond one-to-one. This one-to-one correspondence can be restored after the connection is disconnected.
[0210] Optionally, the desktop wallpaper including the first identifier, the second identifier and associated information may be displayed for a preset time, for example, only for 10 seconds, to serve as a notification; for another example, it may continue until the user operates the identifier on the desktop or disconnects the connection, and then the original wallpaper is restored.
[0211] As described in the above embodiment, the second device can be used as the central device to trigger the establishment of a connection relationship between the second device and other devices in the multiple devices except the second device. In this case, in addition to displaying the association relationship between the identifiers of the first device and the second device, the identifiers corresponding to other devices in the scene and the association relationship between other devices and the second device can also be displayed. For example, the identifiers of the remaining devices can be attached to the identifier of the second device.
[0212] After establishing a connection between the first device and the second device, the first device can implement data transmission and data flow between the second device. The following is a specific diagram of the data flow process:
[0213] In one possible implementation, the first device may receive a first operation from the user and switch the currently displayed application interface to a connection interface. The connection interface may be the interface corresponding to the desktop wallpaper described above. As described above, the first identifier of the first device, the second identifier of the second device, and the association information between the first identifier and the second identifier may be displayed through the desktop wallpaper. Exemplarily, the first operation may be: after displaying the open application interface in full screen, perform a swipe up gesture from the bottom. When performing this operation, the operating system will respond to the operation and enter the connection interface.
[0214] In one possible implementation, after receiving the first operation, in addition to switching the currently displayed application interface to the connection interface, a card corresponding to the application interface may be displayed suspended on the connection interface. For example, during the execution of the first operation, the application interface may be gradually reduced in size, ultimately shrinking to a window card and suspended at the first identifier corresponding to the first device.
[0215] In one possible implementation, a second operation may be received, wherein the second operation indicates that the card is moved to the second identifier; and the media content presented on the application interface is transferred to the second device for presentation. The first operation may be a drag operation on the card. In an embodiment of the present application, the card may be dragged between different identifiers to achieve the flow of application data. The specific execution process of data flow can refer to the existing data flow between multiple devices and will not be repeated here.
[0216] For example, Figure 12 shows the interface changes of the complete data flow. In (a) of Figure 12, the mobile phone establishes a collaborative connection with another device (such as the living room TV), and the spheres representing the two devices attract and adhere to each other, which can be directly observed through the wallpaper. When it is expected to stream music on the mobile phone to the living room TV, first enter the music interface (as shown in (b) of Figure 12), and then perform a bottom swipe gesture. As the bottom gesture swipes up, the music application window gradually shrinks, and part of the wallpaper can be observed (as shown in (c) of Figure 12). When swiping up to a predetermined position / area (such as the middle of the screen), the window shrinks to the form of a window card ((d) of Figure 12). Drag the window card to move between different spheres, and release the card in the sphere corresponding to the living room TV, which triggers the flow of music data (as shown in (e) of Figure 12), and transmits the music data being played to the living room TV through the data channel.
[0217] With this method of entering the connection interface, when the 3D spatial distribution map is set as wallpaper, since the wallpaper and the 3D spatial distribution map of the connection interface use the same animation model, the interface graphics seen by the user before and after performing the preset operation do not change. This allows the user to perceive that data flow is being performed directly on the desktop rather than jumping to another interface for data flow, making the entire data flow process smoother and more natural, thereby enhancing the user's subjective perception experience.
[0218] An embodiment of the present application provides a device connection method, the method comprising: obtaining a positional relationship between the first device and each of a plurality of devices in the scene in which the first device is located; establishing a connection relationship with the second device when the positional relationship with the second device in the plurality of devices meets a preset condition; the connection relationship is used to transfer files or transfer the media content presented by the first device to the connected device for presentation; after the connection relationship is established, the first identifier of the first device, the second identifier of the second device, and the association information between the first identifier and the second identifier are displayed. In the above manner, the terminal can determine the terminal that meets the preset conditions based on the positional relationship between itself and other devices in the scene in which the terminal is located, and automatically establish a connection relationship with the terminal that meets the preset conditions, so that the user does not need to manually select the terminal every time the scene changes, and the user does not need to judge which device is the device that needs to be connected. The user only needs to approach the device that needs to be connected in the physical world to automatically establish a connection with the device, thereby improving the user experience.
[0219] In addition, when the user switches from one scene to another scene that is closer, the terminal device can disconnect from the device in the original scene and automatically establish a connection with the terminal that meets the conditions in the new scene.
[0220] For example, for the two scenarios of living room and study, the terminal device is initially in the living room. When the user brings the terminal device into the study, the connection with the device in the living room will be disconnected and the device in the space of the study (device that meets the preset conditions) will be automatically connected.
[0221] 13 , which is a schematic diagram of the structure of a device connection apparatus provided in an embodiment of the present application, wherein the apparatus 1300 includes:
[0222] An acquisition module 1301 is configured to acquire a positional relationship between the first device and each of a plurality of devices in the scene;
[0223] The specific description of the acquisition module 1301 can refer to the description of step 501 in the above embodiment, which will not be repeated here.
[0224] Processing module 1302, configured to establish a connection relationship with a second device among the multiple devices when a positional relationship between the second device and the second device satisfies a preset condition; the connection relationship is used to transfer files or transfer the media content presented by the device to the connected device for presentation;
[0225] After the connection relationship is established, the first identifier of the first device, the second identifier of the second device, and association information between the first identifier and the second identifier are displayed.
[0226] For a detailed description of the processing module 1302 , reference may be made to the description of steps 502 and 503 in the above embodiment, which will not be repeated here.
[0227] In a possible implementation, the first identifier, the second identifier, and the associated information are displayed through one of a status bar, a desktop wallpaper, and a floating window.
[0228] In a possible implementation, the association information includes a process of changing the first identifier and the second identifier from an unassociated state to an associated state.
[0229] In a possible implementation, the change process is displayed through an adsorption effect.
[0230] In one possible implementation,
[0231] The display style of the first identifier is related to the device type of the first device; or,
[0232] The display style of the second identifier is related to the device type of the second device; or,
[0233] The positional relationship includes a distance, and the display style of the first identifier is related to the distance; or,
[0234] The display style of the second mark is related to the distance; wherein,
[0235] The display style includes at least one of display size, display shape, and display color.
[0236] In a possible implementation, the positional relationship includes at least one of a distance, a change in distance, a relative direction, and a change in relative direction.
[0237] In a possible implementation, the position relationship includes a distance, and the preset condition includes that the distance is less than a distance threshold, wherein at least two different types of devices correspond to different distance thresholds.
[0238] In a possible implementation, the positional relationship is a positional relationship in a three-dimensional space, and the processing module 1302 is further configured to:
[0239] Displaying a first device distribution map according to the positional relationship; the first device distribution map includes an identifier corresponding to each of the devices, and a display position of the identifier in the first device distribution map matches the positional relationship under the first viewing angle;
[0240] A perspective switching instruction is received, and a second device distribution map is displayed; the second device distribution map includes an identifier corresponding to each of the devices, and the display position of the identifier in the second device distribution map matches the position relationship under the second perspective.
[0241] In a possible implementation, the processing module 1302 is further configured to:
[0242] When the position relationship between the second device and the at least one device satisfies a preset condition, it is triggered to establish a connection relationship between the second device and other devices in the multiple devices except the second device.
[0243] In a possible implementation, the processing module 1302 is specifically configured to:
[0244] receiving a first operation, switching a currently displayed application interface to a connection interface, and displaying a first identifier of the first device, a second identifier of the second device, and association information between the first identifier and the second identifier in the connection interface;
[0245] The processing module 1302 is further configured to: suspend and display a card corresponding to the application interface on the connection interface;
[0246] receiving a second operation, wherein the second operation instructs to move the card to the second mark;
[0247] The media content presented on the application interface is transferred to the second device for presentation.
[0248] Next, an execution device provided in an embodiment of the present application is introduced. Please refer to Figure 14. Figure 14 is a structural schematic diagram of an execution device provided in an embodiment of the present application. The execution device 1400 can be specifically manifested as a mobile phone, a tablet, a laptop computer, a smart wearable device, etc., which is not limited here. Specifically, the execution device 1400 includes: a receiver 1401, a transmitter 1402, a processor 1403 and a memory 1404 (wherein the number of processors 1403 in the execution device 1400 can be one or more, and Figure 14 takes one processor as an example), wherein the processor 1403 may include an application processor 14031 and a communication processor 14032. In some embodiments of the present application, the receiver 1401, the transmitter 1402, the processor 1403 and the memory 1404 may be connected via a bus or other means.
[0249] Memory 1404 may include read-only memory and random access memory, and provides instructions and data to processor 1403. A portion of memory 1404 may also include non-volatile random access memory (NVRAM). Memory 1404 stores processor and operation instructions, executable modules, or data structures, or subsets or extended sets thereof. The operation instructions may include various operation instructions for implementing various operations.
[0250] Processor 1403 controls the operation of the execution device. In specific applications, the various components of the execution device are coupled together via a bus system. In addition to a data bus, the bus system may also include a power bus, a control bus, and a status signal bus. However, for clarity, all bus systems are referred to as a bus system in the figure.
[0251] The methods disclosed in the above embodiments of the present application can be applied to or implemented by processor 1403. Processor 1403 can be an integrated circuit chip with signal processing capabilities. During implementation, each step of the above method can be completed by hardware integrated logic circuits or software instructions in processor 1403. The above processor 1403 can be a general-purpose processor, a digital signal processor (DSP), a microprocessor, or a microcontroller, and can further include an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. The processor 1403 can implement or execute the various methods, steps, and logic block diagrams disclosed in the embodiments of the present application. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the methods disclosed in conjunction with the embodiments of the present application can be directly implemented as being executed by a hardware decoding processor, or can be executed by a combination of hardware and software modules in the decoding processor. The software module can be located in a storage medium well-known in the art, such as random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, etc. The storage medium is located in memory 1404, and processor 1403 reads the information in memory 1404 and, in conjunction with its hardware, completes the steps of the above method.
[0252] Receiver 1401 can be used to receive input digital or character information and generate signal input related to executing relevant settings and function control of the device. Transmitter 1402 can be used to output digital or character information; transmitter 1402 can also be used to send instructions to the disk group to modify the data in the disk group.
[0253] In an embodiment of the present application, in one case, the processor 1403 is configured to execute the steps of the device connection method in the embodiment corresponding to FIG5 .
[0254] An embodiment of the present application also provides a computer program product including computer-readable instructions, which, when executed on a computer, enables the computer to execute the steps executed by the aforementioned execution device, or enables the computer to execute the steps executed by the aforementioned training device.
[0255] A computer-readable storage medium is also provided in an embodiment of the present application, which stores a program for signal processing. When the computer-readable storage medium is run on a computer, it enables the computer to execute the steps executed by the aforementioned execution device, or enables the computer to execute the steps executed by the aforementioned training device.
[0256] It should also be noted that the device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed across multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the present embodiment. In addition, in the drawings of the device embodiments provided in this application, the connection relationship between the modules indicates that there is a communication connection between them, which can be specifically implemented as one or more communication buses or signal lines.
[0257] Through the description of the above embodiments, those skilled in the art can clearly understand that the present application can be implemented by means of software plus necessary general-purpose hardware, and of course can also be implemented by means of dedicated hardware including application-specific integrated circuits, dedicated CPUs, dedicated memories, dedicated components, etc. In general, any function performed by a computer program can be easily implemented by means of corresponding hardware, and the specific hardware structures used to implement the same function can also be diverse, such as analog circuits, digital circuits, or dedicated circuits. However, for the present application, software program implementation is often the preferred embodiment. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a readable storage medium, such as a computer floppy disk, USB flash drive, mobile hard disk, ROM, RAM, magnetic disk, or optical disk, etc., and includes a number of instructions for causing a computer device (which can be a personal computer, training equipment, or network equipment, etc.) to execute the methods described in each embodiment of the present application.
[0258] In the above embodiments, all or part of the embodiments may be implemented by software, hardware, firmware, or any combination thereof. When implemented by software, all or part of the embodiments may be implemented in the form of a computer program product.
[0259] The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website, a computer, a training device or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website, a computer, a training device or a data center. The computer-readable storage medium can be any available medium that a computer can store or a data storage device such as a training device, a data center, etc. that includes one or more available media integrations. The available medium can be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive (SSD)).
Claims
1. A device connection method, characterized in that: Applied to a first device, the method includes: Acquire a positional relationship between the first device and each of the multiple devices in the scene; When the position relationship between the second device and the second device among the multiple devices meets a preset condition, a connection relationship is established between the second device; the connection relationship is used to transfer files or transfer the media content presented by itself to the connected device for presentation; After the connection relationship is established, the first identifier of the first device, the second identifier of the second device, and association information between the first identifier and the second identifier are displayed.
2. The method according to claim 1, characterized in that The first identifier, the second identifier, and the associated information are displayed through one of a status bar, a desktop wallpaper, and a floating window.
3. The method according to claim 1 or 2, characterized in that: The association information includes a process of changing the first identifier and the second identifier from an unassociated state to an associated state.
4. The method according to claim 3, characterized in that The changing process is displayed by adsorption special effects.
5. The method according to any one of claims 1 to 4, characterized in that: The display style of the first identifier is related to the device type of the first device; or, The display style of the second identifier is related to the device type of the second device; or, The positional relationship includes a distance, and the display style of the first identifier is related to the distance; or, The display style of the second mark is related to the distance; wherein, The display style includes at least one of display size, display shape and display color.
6. The method according to any one of claims 1 to 5, characterized in that: The positional relationship includes at least one of a distance, a change in distance, a relative direction, and a change in relative direction.
7. The method according to any one of claims 1 to 6, characterized in that: The position relationship includes a distance, and the preset condition includes that the distance is less than a distance threshold, wherein at least two different types of devices correspond to different distance thresholds.
8. The method according to any one of claims 1 to 7, characterized in that: The positional relationship is a positional relationship in a three-dimensional space, and the method further includes: According to the positional relationship, a first device distribution map is displayed; the first device distribution map includes an identifier corresponding to each of the devices, and a display position of the identifier in the first device distribution map in the first device distribution map matches the positional relationship under the first viewing angle; A view switching instruction is received, and a second device distribution map is displayed; the second device distribution map includes an identifier corresponding to each of the devices, and a display position of the identifier in the second device distribution map matches the position relationship under the second view.
9. The method according to any one of claims 1 to 8, characterized in that: The method further comprises: When the position relationship between the second device and the at least one device satisfies a preset condition, it is triggered to establish a connection relationship between other devices among the multiple devices except the second device and the second device.
10. The method according to any one of claims 1 to 9, characterized in that: The displaying of the first identifier of the first device, the second identifier of the second device, and the association information between the first identifier and the second identifier includes: receiving a first operation, switching a currently displayed application interface to a connection interface, and displaying a first identifier of the first device, a second identifier of the second device, and association information between the first identifier and the second identifier in the connection interface; The method further comprises: Floating and displaying a card corresponding to the application interface on the connection interface; receiving a second operation, wherein the second operation indicates moving the card to the second mark; The media content presented on the application interface is transferred to the second device for presentation.
11. A device connection device, characterized in that: Applied to a first device, the apparatus comprises: An acquisition module, used to acquire a positional relationship between the first device and each of a plurality of devices in the scene; A processing module, configured to establish a connection relationship with a second device among the plurality of devices when the position relationship between the second device and the second device satisfies a preset condition; the connection relationship is used to transfer files or transfer the media content presented by the device to the connected device for presentation; After the connection relationship is established, the first identifier of the first device, the second identifier of the second device, and association information between the first identifier and the second identifier are displayed.
12. The device according to claim 11, characterized in that The first identifier, the second identifier, and the associated information are displayed through one of a status bar, a desktop wallpaper, and a floating window.
13. The device according to claim 11 or 12, characterized in that The association information includes a process of changing the first identifier and the second identifier from an unassociated state to an associated state.
14. The device according to claim 13, characterized in that The changing process is displayed by adsorption special effects.
15. The device according to any one of claims 11 to 14, characterized in that: The display style of the first identifier is related to the device type of the first device; or, The display style of the second identifier is related to the device type of the second device; or, The positional relationship includes a distance, and the display style of the first identifier is related to the distance; or, The display style of the second mark is related to the distance; wherein, The display style includes at least one of display size, display shape and display color.
16. The device according to any one of claims 11 to 15, characterized in that The positional relationship includes at least one of a distance, a change in distance, a relative direction, and a change in relative direction.
17. The device according to any one of claims 11 to 16, characterized in that The position relationship includes a distance, and the preset condition includes that the distance is less than a distance threshold, wherein at least two different types of devices correspond to different distance thresholds.
18. The device according to any one of claims 11 to 17, characterized in that The positional relationship is a positional relationship in a three-dimensional space, and the processing module is further used for: According to the positional relationship, a first device distribution map is displayed; the first device distribution map includes an identifier corresponding to each of the devices, and a display position of the identifier in the first device distribution map in the first device distribution map matches the positional relationship under the first viewing angle; A view switching instruction is received, and a second device distribution map is displayed; the second device distribution map includes an identifier corresponding to each of the devices, and a display position of the identifier in the second device distribution map matches the position relationship under the second view.
19. The device according to any one of claims 11 to 18, characterized in that The processing module is further used for: When the position relationship between the second device and the at least one device satisfies a preset condition, it is triggered to establish a connection relationship between other devices among the multiple devices except the second device and the second device.
20. The device according to any one of claims 11 to 19, characterized in that The processing module is specifically used for: Receive a first operation, switch the currently displayed application interface to a connection interface, and display the first device's first identifier, a second identifier of the second device, and association information between the first identifier and the second identifier; The processing module is further used to: suspend and display a card corresponding to the application interface on the connection interface; receiving a second operation, wherein the second operation indicates moving the card to the second mark; The media content presented on the application interface is transferred to the second device for presentation.
21. A device connection device, characterized in that: The device includes a memory and a processor; the memory stores codes, and the processor is configured to obtain the codes and execute the method according to any one of claims 1 to 10.
22. A computer-readable storage medium, characterized in that: The method comprises computer-readable instructions, which, when executed on a computer device, cause the computer device to execute the method according to any one of claims 1 to 10.
23. A computer program product, characterized in that The method comprises computer-readable instructions, and when the computer-readable instructions are executed on a computer device, the computer device is caused to execute the method according to any one of claims 1 to 10.
Citation Information
Patent Citations
Screen display method and apparatus
CN105094732A
Multi-screen interaction method, system and device
CN110191452A
Content transmission method, equipment, and medium
CN111522438A
Display control method and electronic equipment
CN114095542A
Equipment collaboration method and related device
CN116156044A
