Multi-device cooperation method and electronic device

By combining the near-field and far-field device discovery functions in electronic devices, establishing a far-field network channel and establishing a near-field data transmission channel based on the channel, the problem of collaborative interruption caused by the longer distance between devices in the prior art is solved, and more flexible and reliable multi-device collaboration is achieved.

CN119729422APending Publication Date: 2025-03-28HUAWEI TECH CO LTD

Patent Information

Application Number
CN202311259757.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-09-26
Publication Date
2025-03-28

Smart Images

  • Figure CN119729422A_ABST
    Figure CN119729422A_ABST
Patent Text Reader

Abstract

The invention provides a multi-device cooperation method and an electronic device. The multi-device cooperation method and the electronic device are used for improving flexibility and reliability of multi-device cooperation. In the method, in response to a first operation triggered by a user, at least one candidate device is searched through a near-field device discovery function and a far-field device discovery function; in response to a second operation triggered by the user, determining a target device from the at least one candidate device; establishing a far field network channel with the target device; establishing a near-field data transmission channel based on the far-field network channel; and after the near-field data transmission channel is successfully established, carrying out equipment cooperation with the target equipment through the near-field data transmission channel. Through the scheme, the electronic equipment can establish the near-field data transmission channel with the target equipment based on the far-field network channel, so that the near-field data transmission channel between the electronic equipment and the target equipment is flexibly established, and the reliability of multi-equipment collaboration is provided.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to a multi-device collaboration method and an electronic device. Background Art

[0002] With the increase in personal distributed devices, the demand for cross-screen collaboration of multiple devices is becoming more and more vigorous. The multi-device collaboration function is a cross-screen management function that provides applications, content, data, and hardware. For example, if a user has a smartphone, a tablet computer, and a laptop computer, multiple devices can transmit data based on near-field communication technology. When the user uses one of the devices, the device can receive data sent by other devices that are connected to the device, so that the user can control or operate other devices through the device being used. In addition, the multi-device collaboration function can also realize resource sharing between multiple devices, such as quick transmission of documents, images and other multimedia resources between multiple devices.

[0003] However, near-field communication technologies such as Bluetooth and wireless fidelity (Wi-Fi) only support communication within the near-field connection range. If the distance between devices increases, the communication link between devices may be disconnected, causing the collaboration to be interrupted. Therefore, there are limitations to the current multi-device collaboration based on near-field communication technology. Summary of the invention

[0004] The present application provides a multi-device collaboration method and an electronic device for improving the flexibility and reliability of multi-device collaboration.

[0005] In the first aspect, the present application provides a multi-device collaboration method, which can be performed by an electronic device. In the method, in response to a first operation triggered by a user, at least one candidate device is searched through a near-field device discovery function and a far-field device discovery function; in response to a second operation triggered by a user, a target device is determined from the at least one candidate device; a far-field network channel is established with the target device, and the far-field network channel is used to transmit control information and / or data between the electronic device and the target device through a server; a near-field data transmission channel is established based on the far-field network channel; after the near-field data transmission channel is successfully established, device collaboration is performed with the target device through the near-field data transmission channel.

[0006] In the above method, when the user triggers the first operation to start multi-device collaboration, the electronic device can search for at least one candidate device through near-field device discovery and far-field device discovery, and establish a far-field network channel with the target device selected by the user. The electronic device can establish a near-field data transmission channel with the target device based on the far-field network channel, thereby flexibly establishing a near-field data transmission channel between the electronic device and the target device, thereby improving the reliability of multi-device collaboration.

[0007] In one possible design, before establishing a near-field data transmission channel based on the far-field network channel, the method includes: establishing a near-field negotiation channel with the target device, the near-field negotiation channel being used to transmit control information related to the near-field network; performing signaling negotiation corresponding to the near-field data transmission channel with the target device based on the near-field network negotiation channel, and the signaling negotiation fails.

[0008] Through this design, after the electronic device establishes a near-field negotiation channel with the target device, it can first perform signaling negotiation for the near-field data transmission channel based on the near-field negotiation channel. When the signaling negotiation fails, the electronic device can perform signaling negotiation for the near-field data transmission channel based on the far-field network channel, thereby providing multiple ways to establish near-field data transmission channels and improving the success rate of multi-device collaboration.

[0009] In one possible design, the method further includes: when the near-field data transmission channel fails to be established, performing device collaboration with the target device through the far-field network channel.

[0010] Through this design, when the near-field data transmission channel fails to be established, the electronic device can reuse the far-field network channel to collaborate with the target device, provide data transmission channels for collaboration among multiple devices, and improve the reliability of multi-device collaboration.

[0011] In one possible design, the device collaboration with the target device through the near-field data transmission channel includes: using a first resolution and a first frame rate transmission method to send the device collaboration-related data to the target device through the near-field data transmission channel; the device collaboration with the target device through the far-field network channel includes: using a second resolution and a second frame rate transmission method to send the device collaboration-related data to the target device through the far-field network channel; the second resolution is smaller than the first resolution, and the second frame rate is smaller than the first frame rate.

[0012] Through this design, when an electronic device transmits data related to device collaboration with a target device, if the data is transmitted through a near-field data transmission channel, a higher resolution and frame rate can be used; if the data is transmitted through a far-field network channel, a lower resolution and frame rate can be used, thereby ensuring the stability of data transmission in multi-device collaboration.

[0013] In one possible design, establishing a near-field data transmission channel based on the far-field network channel includes: performing signaling negotiation corresponding to the near-field data transmission channel on the far-field network channel; after the signaling negotiation is completed, establishing the near-field data transmission channel.

[0014] In one possible design, the signaling negotiation corresponding to the near-field data transmission channel on the far-field network channel includes: receiving the address and port number sent by the target device through the far-field network channel; and establishing the near-field data transmission channel according to the address and port number sent by the target device.

[0015] In a second aspect, the present application provides an electronic device, the electronic device comprising a plurality of functional modules; the plurality of functional modules interact with each other to implement the method performed by the electronic device in the first aspect and its respective embodiments. The plurality of functional modules may be implemented based on software, hardware, or a combination of software and hardware, and the plurality of functional modules may be arbitrarily combined or divided based on specific implementation.

[0016] In a third aspect, the present application provides an electronic device comprising at least one processor and at least one memory, wherein the at least one memory stores computer program instructions, and when the electronic device is running, the at least one processor executes the method executed by the electronic device in the above-mentioned first aspect and each embodiment thereof.

[0017] In a fourth aspect, the present application further provides a computer program product comprising instructions, which, when executed on a computer, enables the computer to execute the method executed by the electronic device in any of the above aspects and each embodiment thereof.

[0018] In a fifth aspect, the present application also provides a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a computer, the computer executes the method executed by the electronic device in any of the above aspects and its various embodiments.

[0019] In a sixth aspect, the present application also provides a chip, which is used to read a computer program stored in a memory and execute the method executed by the electronic device in any of the above aspects and its various embodiments.

[0020] In a seventh aspect, the present application further provides a chip system, which includes a processor for supporting a computer device to implement the method executed by an electronic device in any of the above aspects and its various embodiments. In a possible design, the chip system also includes a memory, which is used to store the necessary programs and data of the computer device. The chip system can be composed of a chip, or it can include a chip and other discrete devices. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 A schematic diagram of a scenario applicable to an embodiment of the present application;

[0022] Figure 2A schematic diagram of the structure of an electronic device provided in an embodiment of the present application;

[0023] Figure 3 A software structure block diagram of an electronic device provided in an embodiment of the present application;

[0024] Figure 4 A schematic diagram of a multi-device collaborative system provided in an embodiment of the present application;

[0025] Figure 5 A flowchart of a method for multi-device collaboration provided in an embodiment of the present application;

[0026] Figure 6 A flowchart of a method for multi-device collaboration provided in an embodiment of the present application;

[0027] Figure 7 A flowchart of a method for multi-device collaboration provided in an embodiment of the present application. DETAILED DESCRIPTION

[0028] In order to make the purpose, technical scheme and advantages of the embodiments of the present application clearer, the embodiments of the present application will be further described in detail below in conjunction with the accompanying drawings. Among them, in the description of the embodiments of the present application, the terms "first" and "second" are used only for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features.

[0029] It should be understood that in the embodiments of the present application, "at least one" refers to one or more, and "plurality" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the associated objects before and after are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b or c can represent: a, b, c, a and b, a and c, b and c, or a, b and c, where a, b, c can be single or multiple.

[0030] With the increase in personal distributed devices, the demand for cross-screen collaboration of multiple devices is becoming more and more vigorous. The multi-device collaboration function is a cross-screen management function that provides applications, content, data, and hardware. For example, if a user has a smartphone, a tablet computer, and a laptop computer, multiple devices can transmit data based on near-field communication technology. When the user uses one of the devices, the device can receive data sent by other devices that are connected to the device, so that the user can control or operate other devices through the device being used. In addition, the multi-device collaboration function can also realize resource sharing between multiple devices, such as quick transmission of documents, images and other multimedia resources between multiple devices.

[0031] As mentioned above, the current multi-device collaboration functions are mostly implemented based on near-field communication technology, such as Bluetooth, Wi-Fi, and other communication technologies that support near-field connection range. However, the location of devices commonly used by general users may change at any time. If the distance between devices becomes longer and exceeds the maximum distance supported by near-field communication, the communication link between the devices will be disconnected, causing collaboration interruption. It can be seen that the current multi-device collaboration based on near-field communication technology has limitations.

[0032] Based on the above problems, an embodiment of the present application provides a multi-device collaboration method, which can be executed by an electronic device. Figure 1 This is a schematic diagram of a scenario applicable to the embodiment of the present application. Figure 1 , the scenario may include at least two electronic devices and at least one server, Figure 1 Two electronic devices (electronic device 1 and electronic device 2) and a server are used as an example. At least one server is used to provide cloud services for establishing a far-field network channel for at least two electronic devices. Figure 1In the example of multi-device collaboration between electronic device 1 and electronic device 2, in the multi-device collaboration method provided in the embodiment of the present application, electronic device 1 can start far-field device discovery and near-field device discovery. Electronic device 1 determines at least one candidate device that can establish a communication connection through far-field device discovery and near-field device discovery. The user selects a device from at least one candidate device for multi-device collaboration, such as the user selects electronic device 2 from at least one candidate device. Electronic device 1 establishes a near-field network negotiation channel with electronic device 2 based on near-field communication technology, and electronic device 1 establishes a far-field network channel with electronic device 2 based on far-field communication technology. Electronic device 1 can establish a near-field data transmission channel based on the near-field network negotiation channel or the far-field network channel. If the near-field data transmission channel is successfully established, electronic device 1 and electronic device 2 can transmit data through the near-field data transmission channel. If the near-field data transmission channel fails to be established, electronic device 1 can reuse the far-field network channel as a data transmission channel, and transmit data with electronic device 2 through the data transmission channel. Through this scheme, when multi-device collaboration is performed between electronic devices, the scope of multi-device collaboration between electronic devices can be expanded through far-field communication technology, without the need to perform multi-device collaboration within the scope supported by near-field communication. In addition, electronic devices can flexibly establish data transmission channels based on near-field communication technology or far-field communication technology to improve the efficiency of multi-device collaboration.

[0033] The following describes electronic devices and embodiments for using such electronic devices. The electronic devices of the embodiments of the present application may be tablet computers, mobile phones, vehicle-mounted devices, augmented reality (AR) / virtual reality (VR) devices, notebook computers, ultra-mobile personal computers (UMPCs), netbooks, personal digital assistants (PDAs), wearable devices, etc. The embodiments of the present application do not impose any restrictions on the specific types of electronic devices.

[0034] In some embodiments of the present application, the electronic device may also be a portable terminal device that also includes other functions such as a personal digital assistant and / or a music player. Exemplary embodiments of the portable terminal device include but are not limited to: Or other portable terminal devices with operating systems.

[0035] Figure 2 FIG. 1 is a schematic diagram of the structure of an electronic device 100 provided in an embodiment of the present application. Figure 2As shown, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.

[0036] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). Among them, different processing units may be independent devices or integrated into one or more processors. Among them, the controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction opcode and the timing signal to complete the control of fetching and executing instructions. A memory may also be set in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a high-speed cache memory. The memory may store instructions or data that the processor 110 has just used or circulated. If the processor 110 needs to use the instruction or data again, it can be directly called from the memory. Repeated access is avoided, the waiting time of the processor 110 is reduced, and the efficiency of the system is improved.

[0037] The USB interface 130 is an interface that complies with the USB standard specification, and specifically can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transmit data between the electronic device 100 and peripheral devices. The charging management module 140 is used to receive charging input from the charger. The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and provides power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160.

[0038] The wireless communication function of the electronic device 100 can be implemented by antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modulation and demodulation processor and baseband processor. Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antenna. For example, antenna 1 can be reused as a diversity antenna of a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0039] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0040] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0041] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0042] The display screen 194 is used to display the display interface of the application, such as displaying the display page of the application installed on the electronic device 100. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

[0043] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0044] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, and software code of at least one application, etc. The data storage area can store data generated during the use of the electronic device 100 (such as captured images, recorded videos, etc.). In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0045] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as pictures and videos are stored in the external memory card.

[0046] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0047] Among them, the sensor module 180 may include a pressure sensor 180A, an acceleration sensor 180B, a touch sensor 180C, etc.

[0048] The pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be disposed on the display screen 194 .

[0049] The touch sensor 180C is also called a "touch panel". The touch sensor 180C can be set on the display screen 194, and the touch sensor 180C and the display screen 194 form a touch screen, also called a "touch screen". The touch sensor 180C is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180C can also be set on the surface of the electronic device 100, which is different from the position of the display screen 194.

[0050] The button 190 includes a power button, a volume button, etc. The button 190 can be a mechanical button. It can also be a touch button. The electronic device 100 can receive the button input and generate a key signal input related to the user settings and function control of the electronic device 100. The motor 191 can generate a vibration prompt. The motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization. The indicator 192 can be an indicator light, which can be used to indicate the charging status, power changes, and can also be used to indicate messages, missed calls, notifications, etc. The SIM card interface 195 is used to connect the SIM card. The SIM card can be inserted into the SIM card interface 195, or pulled out from the SIM card interface 195 to achieve contact and separation with the electronic device 100.

[0051] Understandably, Figure 2The components shown do not constitute a specific limitation on the electronic device 100. The electronic device may also include more or fewer components than shown, or combine some components, or separate some components, or arrange the components differently. Figure 2 The combination / connection relationship between the components can also be adjusted and modified.

[0052] Figure 3 The software structure block diagram of an electronic device provided in an embodiment of the present application is shown in FIG. Figure 3 As shown, the software structure of the electronic device can be a layered architecture, for example, the software can be divided into several layers, each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the operating system is divided into four layers, from top to bottom, namely, the application layer, the application framework layer (framework, FWK), the runtime (runtime) and the system library, and the kernel layer.

[0053] The application layer can include a series of application packages. Figure 3 As shown, the application layer may include camera, settings, skin module, user interface (UI), third-party applications, etc. Among them, the third-party applications may include gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc. In the embodiment of the present application, the application layer may include a target installation package of a target application that the electronic device requests to download from a server, and the function files and layout files in the target installation package are adapted to the electronic device.

[0054] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer may include some predefined functions. Figure 3 As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, and a notification manager.

[0055] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc. The content provider is used to store and obtain data and make the data accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0056] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.

[0057] The phone manager is used to provide communication functions for electronic devices, such as the management of call status (including answering, hanging up, etc.).

[0058] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0059] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.

[0060] The runtime includes the core library and the virtual machine. The runtime is responsible for the scheduling and management of the operating system.

[0061] The core library consists of two parts: one is the function that the Java language needs to call, and the other is the core library of the operating system. The application layer and the application framework layer run in the virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0062] The system library may include multiple functional modules, such as surface manager, media libraries, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), image processing library, etc.

[0063] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0064] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0065] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0066] A 2D graphics engine is a drawing engine for 2D drawings.

[0067] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

[0068] The hardware layer can include various types of sensors, such as accelerometers, gyroscopes, touch sensors, etc.

[0069] It should be noted that Figure 2 and Figure 3 The structure shown is only an example of the electronic device provided by the embodiment of the present application, and cannot be used to limit the electronic device provided by the embodiment of the present application. In specific implementation, the electronic device may have more Figure 2 or Figure 3 More or fewer devices or modules may be included in the structures shown.

[0070] The following is an introduction to the multi-device collaboration method provided in an embodiment of the present application.

[0071] First, the near-field communication technology and the far-field communication technology involved in the embodiments of the present application are introduced respectively. Figure 4 A schematic diagram of a framework of a multi-device collaborative system provided in an embodiment of the present application. Figure 4 In the figure, the multi-device collaboration between electronic device 1 and electronic device 2 is taken as an example. Figure 2 , electronic device 1 may include a device discovery module, a connection channel management module, and a collaboration module, and electronic device 2 may also include a device discovery module, a connection channel management module, and a collaboration module. The server may include a device cloud, a far-field communication cloud, and a PUSH cloud. Among them, the device discovery module in the electronic device is used to discover connectable near-field devices and / or far-field devices, and deduplicate the discovered near-field devices and far-field devices, and retain at least one non-repetitive connectable candidate device. The connection channel management module is used to establish and manage near-field network negotiation channels, far-field network channels, and near-field data transmission channels. The collaboration module is used to adaptively adjust parameters such as collaborative frame rate and resolution according to the type and bandwidth of the data transmission channel. The device cloud in the server is used to register and query far-field devices, the far-field communication cloud is used to establish a far-field network channel and transmit data based on the far-field network channel, and the PUSH cloud is used to pull up applications for far-field devices.

[0072] It should be noted that the embodiments of the present application do not limit the specific implementation method of the server function. For example, the server may be a distributed computing cluster, which may include at least one computing device. Different computing devices are used to implement different functions of the server in the above embodiments. For example, multiple computing devices can be used to implement the functions of the device cloud, far-field communication cloud and PUSH cloud respectively.

[0073] refer to Figure 4 , the near field communication technology in the embodiment of the present application includes but is not limited to Bluetooth and Wi-Fi. The following takes Bluetooth as an example to illustrate the establishment method of the near field network channel. The user can operate the electronic device 1 to turn on the Bluetooth function of the electronic device 1. When the user triggers the electronic device 1 to turn on multi-device collaboration, the electronic device 1 can turn on the device discovery based on Bluetooth to find the device that can establish a Bluetooth connection with the electronic device 1 within the Bluetooth support range. The electronic device 1 can display at least one candidate device found, and the user can select a device from at least one candidate device to establish a Bluetooth connection with the device. For example, the user can select electronic device 2 from at least one candidate device. Electronic device 1 can establish a near field Bluetooth negotiation channel with electronic device 2. The near field Bluetooth negotiation channel is a control channel for transmitting control information, such as specifically for electronic device 1 and electronic device 2 to perform signaling negotiation. Electronic device 1 and electronic device 2 can perform signaling negotiation on the near field Bluetooth negotiation channel. After the signaling negotiation is completed, electronic device 1 can establish a near field data transmission channel based on the near field Bluetooth negotiation channel. The near field data transmission channel is a data channel for transmitting data between electronic device 1 and electronic device 2.

[0074] The far-field communication technology in the embodiment of the present application can be a communication method established between electronic devices through a server, refer to Figure 4, the user can operate the electronic device 1 to turn on the Wi-Fi switch of the electronic device 1. When the user triggers the electronic device 1 to turn on multi-device collaboration, the electronic device 1 can communicate with the far-field device cloud to search for the far-field device. The electronic device 1 can display at least one candidate device found, and the user can select a device from at least one candidate device to establish a far-field network channel with the device. The far-field network channel between electronic devices in the embodiment of the present application can be used as a control channel or as a data channel, that is, the far-field network channel can be used to transmit control information or data. In addition, in the embodiment of the present application, the electronic device can also perform signaling negotiation in the far-field network channel to establish a near-field data transmission channel. For example, the user selects electronic device 2 from at least one candidate device. When the terminal communication service of the far-field device is not turned on, the electronic device 1 pulls up the communication service of the electronic device 2 through the PUSH cloud, and then establishes a far-field network channel with the electronic device 2 through the far-field communication cloud, and performs signaling negotiation on the far-field network channel. After the signaling negotiation is completed, the electronic device 1 can establish a near-field data transmission channel based on the far-field network channel. If the signaling negotiation fails, the establishment of the near-field data transmission channel fails, and the electronic device 1 can use the far-field network channel as a data transmission channel.

[0075] The following is a further introduction to the multi-device collaboration method provided in the embodiment of the present application:

[0076] Figure 5 This is a flowchart of a method for multi-device collaboration provided by an embodiment of the present application, which can be executed by an electronic device. Figure 5 , the method comprises the following steps:

[0077] S501: In response to a first operation triggered by a user, the electronic device starts a multi-device collaboration function.

[0078] Optionally, the first operation may be an operation triggered by a user to enable the multi-device collaboration function, such as the first operation may be a click operation triggered by a user on a multi-device collaboration control.

[0079] In an embodiment of the present application, electronic devices can perform multi-device collaboration based on near-field communication technology and / or far-field communication, and electronic devices can pre-configure the electronic devices to use near-field communication technology and far-field communication for multi-device collaboration by default; the multi-device collaboration function setting of the electronic device may include near-field communication technology such as Bluetooth, Wi-Fi and other options, and may also include far-field communication options. Users can also customize the communication technology used for multi-device collaboration in the setting interface of the multi-device collaboration function, and the embodiment of the present application does not limit this.

[0080] Optionally, multi-device collaboration may include functions such as multi-screen collaboration between electronic devices, document transmission between electronic devices, and multimedia resource transmission between electronic devices.

[0081] S502: The electronic device starts near-field device discovery, and the electronic device starts far-field device discovery, and the electronic device searches for at least one candidate device.

[0082] In the embodiment of the present application, after the electronic device turns on the multi-device collaboration function, the near-field device discovery and far-field device discovery can be turned on to find at least one candidate device that can establish a connection with the electronic device. For example, after the electronic device turns on the near-field Bluetooth device discovery, it can search for Bluetooth broadcast signals sent by other electronic devices, and after receiving the Bluetooth broadcast signal, the electronic device that sends the Bluetooth broadcast signal is used as a candidate device.

[0083] In some embodiments, when an electronic device finds the same other electronic device through near-field device discovery and far-field device discovery, the other electronic device is also only used as a candidate device. When the electronic device displays at least one found candidate device on the interface, an identifier of the candidate device can be displayed.

[0084] S503: In response to a second operation of the user, the electronic device determines a target device from at least one candidate device.

[0085] Optionally, the second operation may be an operation of selecting a target device triggered by a user. For example, the electronic device may display the identifier of at least one candidate device found on an interface, and the user may click the identifier of the target device to select the target device.

[0086] S504: The electronic device establishes a negotiation channel with the target device according to the communication mode of the target device.

[0087] In some embodiments, when the electronic device finds the target device through near-field device discovery, the electronic device can establish a near-field negotiation channel with the target device. For example, when the electronic device finds the target device through Bluetooth device discovery, the electronic device can establish a Bluetooth negotiation channel with the target device.

[0088] In some other embodiments, when the electronic device finds the target device through far-field device discovery, the electronic device can establish a far-field network channel with the target device, and the far-field network channel can be used as a negotiation channel.

[0089] In some other embodiments, if the electronic device finds the target device through both near-field device discovery and far-field device discovery, the electronic device can establish a near-field network negotiation channel and a far-field network channel with the target device.

[0090] S505: The electronic device establishes a data transmission channel based on the established negotiation channel.

[0091] According to the above introduction to the near-field communication technology and far-field communication technology involved in the embodiments of the present application, when the electronic device establishes a near-field data transmission channel, it is necessary to perform signaling negotiation on the negotiation channel, and establish the near-field data transmission channel after the signaling negotiation is completed. Therefore, according to the different types of negotiated communications established by the electronic device in S504 of the embodiment of the present application, the methods for establishing a data transmission channel between the electronic device and the target device are also different. The following introduces different methods for establishing a data transmission channel between the electronic device and the target device in several cases:

[0092] Method 1:

[0093] When there is a near-field network negotiation channel and no far-field network channel, the electronic device performs signaling negotiation based on the near-field network negotiation channel. After the signaling negotiation is completed, the electronic device can establish a near-field data transmission channel. If the signaling negotiation fails in the near-field network negotiation channel, the electronic device fails to cooperate with the target device.

[0094] Method 2:

[0095] When there is a far-field network channel and no near-field network negotiation channel, the electronic device can first perform signaling negotiation corresponding to the near-field data transmission channel based on the far-field network channel. After the signaling negotiation is completed, the electronic device can establish the near-field data transmission channel. If the electronic device fails to perform signaling negotiation based on the far-field network channel, the electronic device can use the far-field network channel as a data transmission channel.

[0096] Method 3:

[0097] When there is a far-field network channel and a near-field network negotiation channel, the electronic device can perform signaling negotiation based on the near-field network negotiation channel. After the signaling negotiation is completed, a near-field data transmission channel is established. At this time, data transmission can be performed between the electronic device and the target device through the near-field data transmission channel and / or the far-field network channel. If the electronic device fails to perform signaling negotiation on the near-field network negotiation channel, the electronic device can perform signaling negotiation corresponding to the near-field data transmission channel again on the far-field network channel. If the signaling negotiation is completed, a near-field data transmission channel is established. If the signaling negotiation fails, the electronic device can use the far-field network channel as a data transmission channel.

[0098] In some embodiments, the near-field data transmission channel may be a Wi-Fi peer-to-peer (P2P) channel. When the electronic device performs signaling negotiation of the near-field data transmission channel with the target device, the electronic device may receive the Internet Protocol (IP) address of the target device and the port number corresponding to the Wi-Fi P2P channel sent by the target device through the near-field network negotiation channel. The electronic device may establish a Wi-Fi P2P channel with the target device based on the IP address of the target device and the port number corresponding to the Wi-Fi P2P channel.

[0099] S506: The electronic device performs data transmission with the target device through the established data transmission channel.

[0100] In an embodiment of the present application, when the electronic device sends data to the target device through an established data transmission channel, the data transmission mode can be determined according to the type of data transmission channel established between the electronic device and the target device. Optionally, if there is a near-field data transmission channel between the electronic device and the target device, the electronic device can use a data transmission mode with a first resolution and a first frame rate for data transmission. If there is no near-field data transmission channel between the electronic device and the target device, and there is a far-field network channel, the electronic device can use a data transmission mode with a second resolution and a second frame rate for data transmission, wherein the second resolution is less than the first resolution, and the second frame rate is less than the first frame rate. If there is a near-field data transmission channel and a far-field network channel between the electronic device and the target device, the electronic device can use a data transmission mode with a first resolution and a first frame rate to transmit data on the near-field data transmission channel.

[0101] It should be noted that the first resolution, the first frame rate, the second resolution and the second frame rate in the above embodiments may be preset values, or may be user-defined values, and the embodiments of the present application are not limited to this.

[0102] In some embodiments, the time required for an electronic device to establish a near-field data transmission channel and a far-field network channel is different. The electronic device can perform data transmission on the data transmission channel that has been established first. If other data transmission channels are successfully established later, the electronic device can adjust the data transmission method. For example, after the electronic device successfully establishes the far-field network channel, it can use the second resolution and the second frame rate data transmission method to perform data transmission on the far-field network channel; after the electronic device completes the signaling negotiation on the near-field Bluetooth negotiation channel, it establishes the near-field data transmission channel, and the electronic device can adjust to use the first resolution and the first frame rate data transmission method to perform data transmission on the near-field data transmission channel.

[0103] It can be understood that the near-field communication technology and far-field communication technology in the above embodiments are only examples and not limitations. The multi-device collaboration method provided in the embodiments of the present application can also be applied to new communication technologies that emerge in future communication developments, and the embodiments of the present application do not limit this.

[0104] The following is an example to introduce the multi-device collaboration method provided in the embodiment of the present application. Figure 6 A schematic diagram of a multi-device collaboration method provided in an embodiment of the present application, referring to Figure 6 , the method comprises the following steps:

[0105] S601: The electronic device detects a first operation triggered by a user for starting a multi-device collaboration function.

[0106] For example, the first operation is a click operation performed by a user on a multi-device collaborative control.

[0107] S602: The electronic device starts far-field device discovery.

[0108] S603: The electronic device searches for and reports at least one candidate far-field device.

[0109] In an optional implementation, far-field device discovery is to search for a device that can establish a far-field communication connection with the electronic device based on far-field communication technology. The far-field communication technology may be, for example, a communication technology for electronic devices to exchange data through a server. The electronic device may search for at least one candidate far-field device based on far-field device discovery, and the electronic device may establish a far-field network channel with any candidate far-field device.

[0110] S604: The electronic device initiates near-field device discovery.

[0111] S605: The electronic device searches for and reports at least one candidate near-field device.

[0112] In an optional implementation, near-field device discovery is to search for devices within the support range of the near-field communication technology that can establish a near-field communication connection with the electronic device based on the near-field communication technology. For example, the near-field communication technology may be Bluetooth technology. After the electronic device turns on the Bluetooth function, it can search for other devices within the Bluetooth support range that turn on the Bluetooth function, and it can also be searched by other devices within the Bluetooth support range that turn on the Bluetooth function. The electronic device can search for at least one candidate near-field device based on near-field device discovery, and the electronic device can establish a near-field network negotiation channel with any candidate near-field device.

[0113] It should be noted that S602-S603 and S604-S605 can be executed synchronously.

[0114] S606: The electronic device performs device fusion on the found at least one candidate far-field device and the found at least one candidate near-field device to obtain at least one candidate device.

[0115] In some implementations, at least one candidate far-field device and at least one candidate near-field device found by the electronic device may have overlapping devices. For example, if the electronic device finds device A through near-field device discovery, and the electronic device also finds device A through far-field device discovery, then when the electronic device displays at least one candidate device that can perform device collaboration to the user, it only needs to display one device A, without repeatedly displaying two devices A. Therefore, the electronic device can perform device fusion on the at least one candidate far-field device and the at least one candidate near-field device found to obtain at least one candidate device.

[0116] S607: In response to the second operation of the user selecting a target device from at least one candidate device, the electronic device starts device collaboration with the target device.

[0117] The electronic device may display at least one candidate device found on a display screen, and the user may select a target device from the at least one candidate device, thereby triggering the second operation. After the user selects the target device, the electronic device may start to establish a communication channel with the target device to achieve device collaboration.

[0118] S608: The electronic device determines that at least one candidate near-field device reported during near-field device discovery includes the target device.

[0119] S609: The electronic device establishes a Bluetooth negotiation channel with the target device.

[0120] In one implementation, when the electronic device determines that the target device is a candidate near-field device, it may establish a Bluetooth negotiation channel with the target device, and the Bluetooth negotiation channel may be used to transmit control information.

[0121] S610: The electronic device determines that at least one candidate far-field device reported during far-field device discovery includes a target device.

[0122] S611: The electronic device establishes a far-field P2P channel with the target device.

[0123] In one implementation, when the electronic device determines that the target device is a candidate far-field device, it may establish a far-field network channel with the target device, such as a far-field P2P channel. The far-field P2P channel may be used to transmit control information and / or data.

[0124] S612: The electronic device determines whether the Bluetooth negotiation channel is available. If yes, proceed to S614; otherwise, proceed to S613.

[0125] Optionally, the near-field P2P channel is a near-field data transmission channel, for example, the near-field P2P channel may be a Wi-Fi P2P channel.

[0126] S613: The electronic device determines whether the far-field P2P channel is available. If yes, proceed to S614; otherwise, it is determined that the multi-device collaboration fails.

[0127] S614: The electronic device performs signaling negotiation corresponding to the near-field P2P channel.

[0128] Based on the above steps, the electronic device can first determine whether the Bluetooth negotiation channel is available. If available, the electronic device can perform signaling negotiation of the near-field data transmission channel based on the Bluetooth negotiation channel, such as the electronic device can perform signaling negotiation corresponding to the near-field P2P channel based on the Bluetooth negotiation channel. If the Bluetooth negotiation channel is not available, the electronic device can determine whether the far-field P2P channel is available. If available, the electronic device can perform signaling negotiation corresponding to the near-field P2P channel based on the far-field P2P channel. In other words, the embodiments of the present application provide multiple ways to establish near-field P2P channels to reduce the risk of collaboration failure.

[0129] S615: The electronic device determines whether the near-field P2P channel is successfully established. If so, it proceeds to S616; otherwise, it proceeds to S617.

[0130] S616: The electronic device transmits the device collaboration-related data to the target device in a near-field P2P channel in a high-resolution, high-frame-rate transmission manner.

[0131] S617: The electronic device determines whether the far-field P2P channel is available. If so, proceed to S618. Otherwise, it is determined that the multi-device collaboration fails.

[0132] S618: The electronic device transmits the device collaboration-related data to the target device in a far-field P2P channel in a low-resolution, low-frame-rate transmission manner.

[0133] It should be noted that the high resolution and high frame rate in the above S616 and the low resolution and low frame rate in S618 are only relative concepts in the embodiment of the present application. In implementation, the high resolution and high frame rate may be a resolution and frame rate with a higher preset value, and the low resolution and low frame rate may be a resolution and frame rate with a lower preset value.

[0134] Based on the above steps, electronic devices can set different resolutions and frame rates for data transmission according to the type of data transmission channel to ensure the stability of device collaboration.

[0135] Based on the same concept, an embodiment of the present application also provides a multi-device collaboration method, which can be executed by an electronic device. Figure 7A flowchart of a multi-device collaboration method provided in an embodiment of the present application. Figure 7 , the method comprises the following steps:

[0136] S701: In response to a first operation triggered by a user, the electronic device searches for at least one candidate device through a near-field device discovery function and a far-field device discovery function.

[0137] Optionally, the first operation may be an operation triggered by a user to start a multi-device collaboration function, such as the first operation being a click operation performed by a user on a multi-device collaboration control.

[0138] S702: In response to a second operation triggered by a user, the electronic device determines a target device from at least one candidate device.

[0139] Optionally, the second operation may be an operation of the user selecting a target device from at least one candidate device.

[0140] S703: The electronic device establishes a far-field network channel with the target device.

[0141] The far-field network channel is used to transmit control information and / or data between the electronic device and the target device through the server.

[0142] S704: The electronic device establishes a near-field data transmission channel based on the far-field network channel.

[0143] S705: After the near-field data transmission channel is successfully established, the electronic device performs device collaboration with the target device through the near-field data transmission channel.

[0144] pass Figure 7 The multi-device collaboration method provided by the illustrated embodiment, when the user triggers the first operation to start multi-device collaboration, the electronic device can search for at least one candidate device through near-field device discovery and far-field device discovery, and establish a far-field network channel with the target device selected by the user. The electronic device can establish a near-field data transmission channel with the target device based on the far-field network channel, thereby flexibly establishing a near-field data transmission channel between the electronic device and the target device, thereby improving the reliability of multi-device collaboration.

[0145] In an optional implementation, before establishing a near-field data transmission channel based on the far-field network channel in S704, the electronic device may also establish a near-field negotiation channel with the target device, and the near-field negotiation channel is used to transmit control information related to the near-field network; the electronic device performs signaling negotiation corresponding to the near-field data transmission channel with the target device based on the near-field network negotiation channel, and the signaling negotiation fails.

[0146] That is to say, in the embodiment of the present application, the electronic device first performs signaling negotiation corresponding to the near-field data transmission channel based on the near-field negotiation channel. After the signaling negotiation fails, the electronic device can then perform signaling negotiation corresponding to the near-field data transmission channel based on the far-field network channel, thereby providing multiple ways to establish near-field data transmission channels and improving the success rate of multi-device collaboration.

[0147] In an optional implementation, when the electronic device fails to establish a near-field data transmission channel in S705, the electronic device can perform device collaboration with the target device through the far-field network channel, thereby providing a data transmission channel for collaboration of multiple devices and improving the reliability of multi-device collaboration. During implementation, a near-field data transmission channel is established based on the far-field network channel, including: performing signaling negotiation corresponding to the near-field data transmission channel on the far-field network channel; after the signaling negotiation is completed, establishing the near-field data transmission channel. Optionally, signaling negotiation corresponding to the near-field data transmission channel is performed on the far-field network channel, including: receiving the address and port number sent by the target device through the far-field network channel; and establishing a near-field data transmission channel according to the address and port number sent by the target device.

[0148] In an optional implementation, in S705, device collaboration is performed with the target device via a near-field data transmission channel, including: using a transmission method with a first resolution and a first frame rate to send data related to device collaboration to the target device via the near-field data transmission channel; device collaboration is performed with the target device via a far-field network channel, including: using a transmission method with a second resolution and a second frame rate to send data related to device collaboration to the target device via the far-field network channel; the second resolution is smaller than the first resolution, and the second frame rate is smaller than the first frame rate.

[0149] It should be noted that this application Figure 7 The multi-device collaboration method shown may be specifically implemented by referring to the above embodiments of the present application, and the repeated parts will not be repeated here.

[0150] Based on the above embodiments, the present application further provides an electronic device, the electronic device comprising a plurality of functional modules; the plurality of functional modules interact with each other to implement the functions performed by the electronic device in each method described in the embodiments of the present application. Figure 5-Figure 7 The functions performed by the electronic device in the illustrated embodiment. The multiple functional modules can be implemented based on software, hardware, or a combination of software and hardware, and the multiple functional modules can be arbitrarily combined or divided based on specific implementations.

[0151] Based on the above embodiments, the present application further provides an electronic device, which includes at least one processor and at least one memory, wherein the at least one memory stores computer program instructions, and when the electronic device is running, the at least one processor executes the functions executed by the electronic device in each method described in the embodiments of the present application. Figure 5-Figure 7 Functions performed by the electronic device in the illustrated embodiment.

[0152] Based on the above embodiments, the present application further provides a computer program product comprising instructions, and when the computer program product is run on a computer, the computer is enabled to execute the methods described in the embodiments of the present application.

[0153] Based on the above embodiments, the present application further provides a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a computer, the computer executes the methods described in the embodiments of the present application.

[0154] Based on the above embodiments, the present application further provides a chip, which is used to read a computer program stored in a memory to implement the methods described in the embodiments of the present application.

[0155] Based on the above embodiments, the present application provides a chip system, which includes a processor for supporting a computer device to implement the methods described in the embodiments of the present application. In one possible design, the chip system also includes a memory, which is used to store the necessary programs and data for the computer device. The chip system can be composed of a chip, or it can include a chip and other discrete devices.

[0156] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that include computer-usable program code.

[0157] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0158] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0159] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0160] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the scope of protection of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

Claims

1. A multi-device collaboration method, characterized in that: Applied to electronic equipment, the method comprises: In response to a first operation triggered by a user, searching for at least one candidate device through a near-field device discovery function and a far-field device discovery function; In response to a second operation triggered by a user, determining a target device from the at least one candidate device; Establishing a far-field network channel with the target device, wherein the far-field network channel is used to transmit control information and / or data between the electronic device and the target device through a server; Establishing a near-field data transmission channel based on the far-field network channel; After the near-field data transmission channel is successfully established, device collaboration is performed with the target device through the near-field data transmission channel.

2. The method according to claim 1, characterized in that Before establishing a near-field data transmission channel based on the far-field network channel, the method includes: Establishing a near field negotiation channel with the target device, wherein the near field negotiation channel is used to transmit control information related to the near field network; A signaling negotiation corresponding to the near field data transmission channel is performed with the target device based on the near field network negotiation channel, and the signaling negotiation fails.

3. The method according to claim 1 or 2, characterized in that The method further comprises: When the near-field data transmission channel fails to be established, device collaboration is performed with the target device through the far-field network channel.

4. The method according to claim 3, characterized in that The performing device collaboration with the target device through the near-field data transmission channel includes: Sending the device collaboration-related data to the target device through the near-field data transmission channel in a transmission mode of a first resolution and a first frame rate; The performing device collaboration with the target device through the far-field network channel includes: The data related to the device collaboration is sent to the target device through the far-field network channel using a transmission method with a second resolution and a second frame rate; the second resolution is smaller than the first resolution, and the second frame rate is smaller than the first frame rate.

5. The method according to any one of claims 1 to 4, characterized in that: The establishing of a near-field data transmission channel based on the far-field network channel comprises: Performing signaling negotiation corresponding to the near-field data transmission channel on the far-field network channel; After the signaling negotiation is completed, the near-field data transmission channel is established.

6. The method according to claim 5, characterized in that The performing signaling negotiation corresponding to the near-field data transmission channel on the far-field network channel includes: Receiving the address and port number sent by the target device through the remote network channel; The near field data transmission channel is established according to the address and the port number sent by the target device.

7. An electronic device, characterized in that: It comprises a plurality of functional modules; the plurality of functional modules interact with each other to implement the method as claimed in any one of claims 1 to 6.

8. An electronic device, characterized in that: The system comprises at least one processor, wherein the at least one processor is coupled to at least one memory, and the at least one processor is configured to read a computer program stored in the at least one memory to execute the method according to any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores instructions, which, when executed on a computer, enable the computer to execute the method according to any one of claims 1 to 6.

10. A computer program product comprising instructions, characterized in that When the computer program product is executed on a computer, the computer is enabled to execute the method according to any one of claims 1 to 6.

Citation Information

Patent Citations

  • Establishing and controlling audio and voice back channels of a wi-fi display connection

    CN105230029A

  • Robot-based remote control instruction transmitting method

    CN106647309A

  • Electronic equipment, data transmission method between electronic equipment and other electronic equipment and medium

    CN114827514A

  • Equipment control method and electronic equipment

    CN115550391A

  • Data interaction method, electronic equipment and computer readable storage medium

    CN115914983A

Cited By

  • Multi-device cooperation system and method

    CN120528960A