Cross-device resource sharing method and electronic device
By detecting gestures and communication connections that do not touch the screen, cross-device resource sharing is achieved, solving the problems of insufficient convenience and intelligence in existing technologies, improving user experience and security, and supporting multi-device resource transmission.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- HUAWEI TECH CO LTD
- Filing Date
- 2024-11-15
- Publication Date
- 2026-05-15
AI Technical Summary
In existing technologies, cross-device resource sharing is less convenient and less intelligent, especially when users cannot touch the screen or the devices are not logged into the same system account, making the resource sharing process lengthy and inconvenient.
By detecting resource sending and receiving gestures that are not in contact with the device screen, cross-device resource sharing is achieved through communication connections. It supports screenshots and air gestures, provides light and shadow effects to enhance the interactive experience, and optimizes security when trust relationships are established.
It improves the convenience and intelligence of cross-device resource sharing, reduces user-perceived latency, enhances user experience and security, and supports simultaneous sharing across multiple devices and resource transfer between different system accounts.
Smart Images

Figure CN122044341A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of electronic device technology, and in particular to cross-device resource sharing methods and electronic devices. Background Technology
[0002] With the rapid development of electronic device technology, electronic devices are becoming increasingly feature-rich, and users' needs for them are becoming more diverse. Currently, when using electronic devices, users may want to share resources (including but not limited to pictures, videos, news, and other resources) with friends so that they can have a better browsing experience. Therefore, improving the convenience and intelligence of cross-device resource sharing is crucial. Summary of the Invention
[0003] This application provides a cross-device resource sharing method and electronic device, which can improve the convenience and intelligence of cross-device resource sharing.
[0004] To achieve the above objectives, this application adopts the following technical solution:
[0005] In a first aspect, a cross-device resource sharing method is provided, applied to a first electronic device having a display screen. The method includes: when displaying a first interface of a first application, in response to a detected resource sending gesture, sending an instruction message to at least one electronic device, wherein the first interface displays first content, the resource sending gesture is used to instruct the first electronic device to share resources with other electronic devices, the resource sending gesture is a gesture that does not touch the display screen of the first electronic device, and the instruction message is used to instruct the first electronic device to share resources; and sending the first content to the second electronic device based on a communication connection with a second electronic device among the at least one electronic device.
[0006] Based on the above technical solution, when an electronic device displays an interface of an application, upon detecting a resource-sharing gesture that is not in contact with the screen, it can send an instruction message to other electronic devices indicating that it is about to share resources. Then, based on the communication connection with another electronic device, it can share content from the displayed interface with that device. Users do not need to perform any touch operations on the electronic device screen, and cross-device resource sharing can still be achieved even if the user's fingers are wet or otherwise unable to touch the screen. Furthermore, the resource sender and receiver do not need to be in contact, improving the convenience and intelligence of cross-device resource sharing.
[0007] In one possible design, the method further includes: when displaying a second interface of the first application, in response to a detected resource sending gesture, sending an instruction message to at least one electronic device, wherein the second interface is different from the first interface; and sending a screenshot of the second interface to the second electronic device based on a communication connection with the second electronic device among the at least one electronic device.
[0008] In this way, when a certain interface of an application does not support cross-device resource sharing, if the user performs a resource sending gesture on the resource sending end, the resource sending end can send an indication message to the outside world to indicate that it is about to send resources. The resource sending end can then send a screenshot of the resource from that interface of the application to the resource receiving end. This not only makes cross-device resource sharing more convenient and intelligent, but also ensures that even if a certain interface of an application does not support AirShare, cross-device resource sharing can still be achieved through screenshots, thus guaranteeing a good user experience.
[0009] In one possible design, the method further includes: when displaying the interface of a second application, in response to a detected resource sending gesture, sending an instruction message to at least one electronic device, the second application being different from the first application; and sending a screenshot of the interface to the second electronic device based on a communication connection with the second electronic device among the at least one electronic device.
[0010] In this way, even if an application doesn't support cross-device resource sharing, if the user performs a resource-sending gesture on the resource sender, the sender can send an indication message to the outside world to indicate that it is about to send the resource. The resource sender can then send a screenshot of the application's resource to the resource receiver. This not only makes cross-device resource sharing more convenient and intelligent, but also ensures that even if an application doesn't support cross-device resource sharing, it can still be achieved through screenshots, thus guaranteeing a good user experience.
[0011] In one possible design, sending the first content to the second electronic device based on the communication connection with the second electronic device among the at least one electronic device includes: sending the first content to the second electronic device based on the communication connection with the second electronic device among the at least one electronic device, and sending the first content to the third electronic device based on the communication connection with the third electronic device among the at least one electronic device. In this way, the resources of one electronic device can be received by multiple other electronic devices simultaneously, realizing the simultaneous sharing of resources with multiple other electronic devices.
[0012] In one possible design, sending the first content to the second electronic device based on the communication connection with the second electronic device among the at least one electronic device includes: establishing a communication connection with the second electronic device based on the indication message; and sending the first content to the second electronic device based on the communication connection. In this way, after sending the indication message, the resource sending end can establish a communication connection with the second electronic device based on the indication message, thereby determining which specific electronic device to share resources with when multiple other electronic devices are present.
[0013] In one possible design, the resource sending gesture includes a start gesture and an end gesture. The start gesture indicates the beginning of the resource sending gesture execution, and the end gesture indicates the end of the resource sending gesture execution. Before sending the first content to the second electronic device based on the communication connection, the method further includes: generating preview data of the first content when the start gesture is detected; and sending the preview data of the first content to the second electronic device based on the communication connection. In this way, the resource sending end generates preview data of the first content when it detects the start gesture in the resource sending gesture. Subsequently, after the first electronic device establishes a communication connection with the second electronic device, it is not necessary to perform the operation of generating preview data of the first content again; the preview data of the first content can be sent directly, which can reduce the perceived latency for the user and improve the user experience.
[0014] In one possible design, sending an indication message to at least one electronic device in response to a detected resource sending gesture includes: sending the indication message to the at least one electronic device in response to detecting the start gesture and the end gesture.
[0015] In one possible design, the method further includes: displaying a gesture icon corresponding to the start gesture when the start gesture is detected; or, displaying a gesture movement animation effect when the end gesture is detected to have moved out of front of the first electronic device, the gesture movement animation effect including a light and shadow movement animation effect on the display screen. Displaying a gesture icon corresponding to the start gesture when the start gesture is detected allows the user to confirm that the electronic device has begun to recognize the resource sending gesture based on the gesture icon. When the end gesture moves out of front of the electronic device, the electronic device can also display a light and shadow movement animation effect on the display screen; that is, the light and shadow can change according to the position of the end gesture in front of the electronic device, enhancing the technological feel of human-computer interaction.
[0016] The positions of the light and shadow 711 and 720 displayed on the screen of the electronic device 10 can change in real time according to the real-time changes in the position of the fist in the air-grabbing gesture in front of the electronic device 10. Thus, the electronic device 10 can give users the experience of the light and shadow 711 and 720 being controlled by the user's fist in the air, enhancing the technological feel of human-computer interaction and improving the user experience when using electronic devices to share resources across devices.
[0017] In one possible design, the direction in which the light and shadow move on the display screen is the same as the direction in which the ending gesture moves out in front of the first electronic device. In this way, the light and shadow in the gesture animation can move along the direction of the ending gesture, giving the user the experience of having the light and shadow manipulated remotely by the user's ending gesture, enhancing the technological feel of human-computer interaction and improving the user experience when sharing resources across devices.
[0018] In one possible design, after detecting a resource sending gesture, the method further includes: displaying a first pending animation effect, wherein the first pending animation effect includes at least one of a card generated based on the first content and light and shadow. In this way, after detecting a resource sending gesture, the electronic device displays the pending animation effect, making it easy for the user to know that the electronic device has responded to the user's request to share resources across devices.
[0019] In one possible design, during the process of sending the first content to the second electronic device, the method further includes: displaying a sending animation, the sending animation including at least one of preview data of the first content and lighting effects; and / or, displaying a target control, the target control being used to indicate the sending progress of the first content. In this way, when an electronic device shares resources with other electronic devices, it can also display sending animations including preview data of the shared resources and lighting effects, making it easier for users to know which resources are currently being shared. Presenting a target control to indicate the resource sending progress to the user can enhance the technological feel of human-computer interaction.
[0020] In one possible design, after detecting a resource sending gesture, the method further includes: displaying a second animation to be sent, the second animation including at least one of a screenshot of the second interface and light and shadow.
[0021] In one possible design, the first electronic device and the second electronic device are logged into different system accounts. Before sending the first content to the second electronic device, the method further includes: if the first electronic device and the second electronic device have not established a trust relationship, displaying a reminder message, the reminder message being used to confirm with the user whether to send the first content to the second electronic device or whether to establish a trust relationship with the second electronic device; or, if the first electronic device and the second electronic device have established a trust relationship, not displaying a reminder message, the reminder message being used to confirm with the user whether to send the first content to the second electronic device or whether to establish a trust relationship with the second electronic device. Thus, when the first electronic device and the second electronic device are logged into different system accounts, if they have not established a trust relationship, the system account can confirm with the user whether to send resources to the second electronic device or whether to establish a trust relationship with the second electronic device. This can improve the security of cross-device resource sharing. When they have established a trust relationship, the first electronic device no longer needs to output the aforementioned reminder message, and they can directly share resources across devices. This ensures the security of cross-device resource sharing without disturbing the user, providing a seamless sharing experience.
[0022] In one possible design, the first electronic device includes a AirShare service. This service provides an application registered with the AirShare service within the first electronic device with the ability to share its resources with other electronic devices. The first application is registered with the AirShare service, and its first interface is a preset interface that allows the use of the AirShare service, while its second interface is a preset interface that does not allow the use of the AirShare service. Alternatively, the second application may be an application not registered with the AirShare service. Thus, when an application is registered with the AirShare service, it can directly share resources across devices via the service, and the application can also specify which interface can use the service. Conversely, when an application is not registered with the AirShare service, it cannot directly share resources across devices via the service.
[0023] In one possible design, the resource sending gesture includes a gesture that changes from a palm to a fist.
[0024] In a second aspect, a cross-device resource sharing method is provided, applied to a second electronic device having a display screen. The method includes: receiving an indication message from a first electronic device, the indication message from the first electronic device indicating that the first electronic device is about to share resources; responding to the indication message from the first electronic device and a detected resource receiving gesture, receiving first content from the first electronic device based on a communication connection with the first electronic device, wherein the resource receiving gesture is a gesture that does not touch the display screen of the second electronic device, and the first content is content in a first interface of a first application displayed on the first electronic device.
[0025] In one possible design, the method further includes: in response to an instruction message from the first electronic device and the detected resource receiving gesture, receiving a screenshot of a second interface from the first electronic device based on a communication connection with the first electronic device, wherein the screenshot of the second interface is a screenshot of the second interface of the first application displayed on the first electronic device, and the second interface is different from the first interface.
[0026] In one possible design, the method further includes: in response to an instruction message from the first electronic device and the detected resource receiving gesture, receiving a screenshot of an interface from the first electronic device based on a communication connection with the first electronic device, wherein the screenshot is a screenshot of the interface of a second application displayed on the first electronic device, and the second application is different from the first application.
[0027] In one possible design, before receiving the first content from the first electronic device, the method further includes: receiving an indication message from a third electronic device, the indication message from the third electronic device indicating that the third electronic device is about to share resources; the step of receiving the first content from the first electronic device in response to the indication message from the first electronic device and a detected resource receiving gesture, based on the communication connection with the first electronic device, includes: in response to the indication message from the first electronic device, the indication message from the third electronic device, and the detected resource receiving gesture, receiving the first content from the first electronic device based on the communication connection with the first electronic device, wherein the system account logged in by the first electronic device and the second electronic device is the same; or, the system accounts logged in by the first electronic device and the second electronic device are different, and the first electronic device is an electronic device selected by the user.
[0028] In this way, when multiple resource senders exist, the resource receiver can choose to receive resources from the same system account, which can improve the security and privacy of cross-device resource sharing. Alternatively, the resource receiver can also receive resources from a specific resource sender based on user selection, thus meeting the user's actual needs.
[0029] In one possible design, before receiving the first content from the first electronic device, the method further includes: detecting the resource receiving gesture at a first frequency if no indication message is received from the first electronic device; and detecting the resource receiving gesture at a second frequency if the indication message is received from the first electronic device, wherein the second frequency is higher than the first frequency. In this way, the frequency at which the resource receiving gesture is detected before the indication from the resource receiving end to the resource sending end is lower than the frequency after receiving the indication message. That is, after receiving the indication message, the resource receiving end can increase the frequency of detecting the resource receiving gesture, enabling faster and more accurate identification of the gesture, improving the efficiency of cross-device resource sharing, and thus enhancing the intelligence of cross-device resource sharing.
[0030] In one possible design, the resource receiving gesture includes a start gesture and an end gesture. The start gesture indicates the beginning of the execution of the resource receiving gesture, and the end gesture indicates the end of the execution of the resource receiving gesture. Before receiving the first content from the first electronic device based on the communication connection with the first electronic device, the method further includes: establishing the communication connection with the first electronic device in response to the detected start gesture. In this way, the resource receiving end establishes a communication connection with the resource sending end when it detects the start gesture in the resource receiving gesture, i.e., establishing the connection in advance. Compared to the method of establishing a communication connection after receiving the end gesture, this can reduce the perceived latency for the user and improve the user experience.
[0031] In one possible design, the resource receiving gesture includes a start gesture and an end gesture, wherein the start gesture indicates the beginning of the execution of the resource receiving gesture, and the end gesture indicates the end of the execution of the resource receiving gesture; the method further includes: when the start gesture is detected, displaying a gesture icon corresponding to the start gesture; or, when the start gesture is detected to have moved in front of the second electronic device, displaying a gesture movement animation, wherein the gesture movement animation includes an animation of light and shadow moving on the display screen.
[0032] In one possible design, the direction in which the light and shadow move on the display screen is the same as the direction in which the start gesture moves in front of the second electronic device.
[0033] In one possible design, before receiving the first content from the first electronic device, the method further includes: in response to an instruction message from the first electronic device, upon detecting the end gesture, receiving preview data of the first content from the first electronic device based on the communication connection with the first electronic device;
[0034] In one possible design, the method further includes: displaying a receiving animation during the process of receiving the first content, the receiving animation including at least one of the preview data of the first content and lighting effects.
[0035] In one possible design, the system accounts logged into the first electronic device and the second electronic device are different. Before receiving the first content from the first electronic device, the method further includes: if the first electronic device and the second electronic device have not established a trust relationship, displaying a reminder message, the reminder message being used to confirm with the user whether to receive the first content from the first electronic device or whether to establish a trust relationship with the first electronic device; or, if the first electronic device and the second electronic device have established a trust relationship, not displaying a reminder message, the reminder message being used to confirm with the user whether to receive the first content from the first electronic device or whether to establish a trust relationship with the first electronic device.
[0036] In one possible design, the resource receiving gesture includes a gesture that changes from a clenched fist to a palm.
[0037] Thirdly, an electronic device is provided that has the function of implementing the method described in any of the designs of any of the preceding aspects. This function can be implemented by hardware or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the described function.
[0038] Fourthly, an electronic device is provided, comprising: a processor, a memory, a display screen, and a communication interface. The memory, the display screen, and the communication interface are coupled to the processor. The communication interface is used for communicating with other devices. The memory stores program code, including instructions. The processor reads the instructions from the memory to cause the electronic device to perform the method described in any of the designs of any of the preceding aspects. Optionally, the memory may be coupled to the processor or independent of the memory. Exemplarily, the communication interface may be a transceiver, an input / output interface, an interface circuit, an output circuit, an input circuit, a pin, or related circuitry, etc. The display screen can be used by the electronic device to perform display operations.
[0039] Fifthly, a computer-readable storage medium is provided, the computer-readable storage medium including a computer program that, when run on an electronic device, causes the electronic device to perform the method as described in any of the preceding aspects.
[0040] A sixth aspect provides a computer program product comprising: a computer program or instructions that, when executed on a computer, cause the computer to perform the method as designed in any of the preceding aspects.
[0041] A seventh aspect provides a chip system including at least one processor and at least one interface circuit, the at least one interface circuit being used to perform transceiver functions and send instructions to at least one processor, wherein when at least one processor executes instructions, at least one processor performs the method as described in any of the designs in any of the preceding aspects.
[0042] Eighthly, a communication system is provided, including a first electronic device and a second electronic device, wherein the first electronic device is configured to perform a method performed by the first electronic device as described in any of the preceding aspects, and the second electronic device is configured to perform a method performed by the second electronic device as described in any of the preceding aspects and any of the preceding aspects.
[0043] The technical effects of the aforementioned aspects can be referenced from each other, and will not be elaborated further here. Attached Figure Description
[0044] Figure 1 A schematic diagram illustrating a cross-device resource sharing scenario provided in an embodiment of this application;
[0045] Figure 2 A schematic diagram illustrating a scenario for a remotely operated electronic device provided in an embodiment of this application;
[0046] Figure 3 A schematic diagram illustrating yet another cross-device resource sharing scenario provided in this application embodiment;
[0047] Figure 4 This application provides a schematic diagram of the architecture of a communication system.
[0048] Figure 5 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application;
[0049] Figure 6 This is a schematic diagram of the structure of another electronic device provided in an embodiment of this application;
[0050] Figure 7 Interface illustration provided for embodiments of this application Figure 1 ;
[0051] Figure 8 Interface illustration provided for embodiments of this application Figure 2 ;
[0052] Figure 9 Interface illustration provided for embodiments of this application Figure 3 ;
[0053] Figure 10 Interface illustration provided for embodiments of this application Figure 4 ;
[0054] Figure 11 Interface illustration provided for embodiments of this application Figure 5 ;
[0055] Figure 12 Interface illustration provided for embodiments of this application Figure 6 ;
[0056] Figure 13 Interface illustration provided for embodiments of this application Figure 7 ;
[0057] Figure 14 Interface illustration provided for embodiments of this application Figure 8 ;
[0058] Figure 15 A timing diagram of receiving information by an electronic device provided in an embodiment of this application;
[0059] Figure 16 Interface illustration provided for embodiments of this application Figure 9 ;
[0060] Figure 17 A flowchart illustrating a cross-device resource sharing method provided in an embodiment of this application;
[0061] Figure 18 A schematic diagram illustrating the execution order of the steps included in a cross-device resource sharing method provided in this application embodiment;
[0062] Figure 19 A flowchart illustrating yet another cross-device resource sharing method provided in this application embodiment;
[0063] Figure 20 This is a schematic diagram of the structure of another electronic device provided in an embodiment of this application;
[0064] Figure 21 This is a schematic diagram of a chip system provided in an embodiment of this application. Detailed Implementation
[0065] In the description of this application, unless otherwise stated, " / " indicates that the objects before and after are in an "or" relationship. For example, A / B can mean A or B. "And / or" in this application is merely a description of the relationship between the related objects, indicating that there can be three relationships. For example, A and / or B can mean: A exists alone, A and B exist simultaneously, and B exists alone. A and B can be singular or plural.
[0066] In the description of this application, unless otherwise stated, "multiple" means two or more. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or multiple items. For example, at least one of a, b, or c can mean: a, b, c, a and b, a and c, b and c, a and b and c, where a, b, and c can be single or multiple.
[0067] Furthermore, to facilitate a clear description of the technical solutions in the embodiments of this application, the terms "first" and "second" are used in the embodiments of this application to distinguish identical or similar items with substantially the same function and effect. Those skilled in the art will understand that the terms "first" and "second" do not limit the quantity or execution order, and the terms "first" and "second" are not necessarily different.
[0068] Cross-device resource sharing (also known as cross-platform resource sharing) refers to sharing resources from one electronic device to another. One possible approach is, for example... Figure 1 As shown in (1), electronic device 10 displays image 100. A user can perform a three-finger touch and pinch operation on image 100 to share image 100 with other electronic devices. Electronic device 10 responds to this operation as follows: Figure 1 As shown in (2), the electronic device 10 can display a copy button 110. Meanwhile, as... Figure 1 As shown in (3), electronic device 20 displays desktop 120. Then, the user can perform a three-finger touch and release operation on desktop 120, in response to this operation and the aforementioned three-finger touch and pinch operation performed on electronic device 10. Electronic device 10 can send image 100 to electronic device 20, and correspondingly, electronic device 20 can receive images from electronic device 10. Subsequently, as... Figure 1 As shown in (4), electronic device 20 can display image 100, thereby enabling the sharing of resources in electronic device 10 with electronic device 20.
[0069] This solution requires users to use three fingers to touch the screen of the electronic device to share resources. However, in some scenarios, such as when users are working in the kitchen with wet fingers, they may not be able to perform the three-finger touch operation, thus preventing cross-device resource sharing. Furthermore, when electronic device 20 displays an interface other than the desktop (such as a video interface), users need to perform various touch operations first for electronic device 20 to display the desktop, making the resource sharing process lengthy. Therefore, this solution currently only supports electronic devices 10 and 20 when logged into the same system account, resulting in low convenience and intelligence in cross-device resource sharing.
[0070] In another possible approach, the electronic device can support user gestures, such as swiping or grabbing the screen with air gestures. For example, such as... Figure 2 As shown in (1), the electronic device can display the interface 200 of a gallery application. The user can hold their palm facing the electronic device with fingertips pointing upwards, and then flick their wrist downwards; in response to this action, the electronic device can swipe down on the screen. Alternatively, as... Figure 2 As shown in (2), the electronic device can display the gallery application interface 210. The user can place the back of their hand facing the electronic device, fingertips pointing downwards, and then flick their wrist upwards. In response to this action, the electronic device can swipe the screen upwards. Alternatively, as... Figure 2 As shown in (3), the electronic device can display the gallery application interface 220. The user can hold their palm facing the screen and then make a fist; in response to this operation, the electronic device can generate a screenshot of interface 220. While this solution enables air gestures on the electronic device, it cannot achieve cross-device resource sharing.
[0071] In another possible scenario, two electronic devices can share contact information by using near-field communication (NFC) technology to identify each other upon proximity. For example... Figure 3 As shown, contact information can be shared by touching the heads of electronic devices 10 and 20 together. However, this solution requires different electronic devices to touch their heads to share resources. In other words, resource sharing is impossible when electronic devices are a certain distance apart, resulting in limited convenience and intelligence.
[0072] Based on this, embodiments of this application provide a cross-device resource sharing method, which can improve the convenience and intelligence of cross-device resource sharing. The technical solution provided by embodiments of this application can be applied to various resource sharing scenarios. For example, the resource may include, but is not limited to, various resources such as pictures, videos, and news information.
[0073] For example, Figure 4 This illustration shows a schematic diagram of the architecture of a communication system for an application of a cross-device resource sharing method provided in an embodiment of this application. Figure 4 As shown, the communication system 400 may include a first electronic device 401 and a second electronic device 402.
[0074] In some embodiments, the first electronic device 401 can act as a resource sender, sending resources to the second electronic device 402. The second electronic device 402 can act as a resource receiver, receiving resources from the first electronic device 401. In other embodiments, the second electronic device 402 can act as a resource sender, sending resources to the first electronic device 401. The first electronic device 401 can act as a resource receiver, receiving resources from the second electronic device 402. That is, the first electronic device 401 and the second electronic device 402 can act as both resource senders and resource receivers.
[0075] For example, the first electronic device 401 or the second electronic device 402 may include, but is not limited to, mobile phones, tablets, desktop computers, laptops, handheld computers, notebook computers, ultra-mobile personal computers (UMPCs), netbooks, and various electronic devices such as personal digital assistants (PDAs), augmented reality (AR) devices, virtual reality (VR) devices, artificial intelligence (AI) devices, wearable devices, in-vehicle devices, smart home devices, and / or smart city devices. Optionally, the first electronic device 401 and the second electronic device 402 may be fixed devices or portable devices. The first electronic device 401 and the second electronic device 402 may be the same type of electronic device or different types of electronic devices.
[0076] Optionally, the operating system installed on the first electronic device 401 or the second electronic device 402 may include, but is not limited to, the following: Or other operating systems.
[0077] Optionally, the first electronic device 401 and the second electronic device 402 may establish a connection via wireless communication technology. For example, wireless communication technology may include, but is not limited to, Bluetooth (BT) (e.g., classic Bluetooth or Bluetooth Low Energy (BLE) Bluetooth), Spark (e.g., classic Spark or Spark Low Energy (SLE)), and wireless local area networks (WLAN) (e.g., wireless fidelity (Wi-Fi) networks).
[0078] For example, Figure 5 A schematic diagram of the structure of an electronic device provided in an embodiment of this application is shown. This electronic device can be either the first electronic device 401 or the second electronic device 402 described above. Figure 5 As shown, the electronic device 500 may include a processor 110, a memory 120, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a sensor module 180, buttons 190, a camera 191, a display screen 192, etc.
[0079] Processor 110 may include one or more processing units, such as application processors (APs), modem processors, graphics processing units (GPUs), image signal processors (ISPs), controllers, video codecs, digital signal processors (DSPs), baseband processors, and / or neural network processing units (NPUs). These different processing units may be independent devices or integrated into one or more processors.
[0080] The controller can generate operation control signals based on the instruction opcode and timing signals to complete the control of instruction fetching and execution.
[0081] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.
[0082] In some embodiments, processor 110 may include one or more interfaces, such as USB interface 130.
[0083] The charging management module 140 receives charging input from the charger. While charging the battery 142, the charging management module 140 can also supply power to the electronic device through the power management module 141.
[0084] The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to power the processor 110, memory 120, display 192, and wireless communication module 160, etc.
[0085] The wireless communication function of electronic device 500 can be implemented through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor, and baseband processor.
[0086] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 500 can be used to cover one or more communication frequency bands. Different antennas can also be reused to improve antenna utilization.
[0087] The mobile communication module 150 can provide wireless communication solutions, including 2G / 3G / 4G / 5G, for use in electronic devices 500.
[0088] The wireless communication module 160 can provide solutions for wireless communication applications on electronic devices 500, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), Starflash, global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies.
[0089] In some embodiments, antenna 1 of electronic device 500 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling electronic device 500 to communicate with networks and other devices via wireless communication technology. The wireless communication technology may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time-Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, Starflash, GNSS, WLAN, NFC, FM, and / or IR technologies, etc.
[0090] In some embodiments of this application, taking electronic device 500 as a first electronic device 401 as an example, when the first electronic device 401 is a resource sender, the wireless communication module 160 can be used by electronic device 500 to send resources to second electronic device 402. When the first electronic device 401 is a resource receiver, the wireless communication module 160 can be used by electronic device 500 to receive resources shared by the second electronic device 402. Similarly, taking electronic device 500 as a second electronic device 402 as an example, when the second electronic device 402 is a resource sender, the wireless communication module 160 can be used by electronic device 500 to send resources to first electronic device 401. When the second electronic device 402 is a resource receiver, the wireless communication module 160 can be used by electronic device 500 to receive resources shared by first electronic device 401.
[0091] Electronic device 500 implements display functions through a GPU, display screen 192, and application processor. The GPU is a microprocessor for image processing, connected to the display screen 192 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.
[0092] Display screen 192 is used to display images, videos, etc. Display screen 192 includes a display panel. In some embodiments, electronic device 500 may include one or N displays screens 192, where N is a positive integer greater than 1. In some embodiments of this application, the display screen 192 can be used to present at least one of the following: resources to be shared, various animations during cross-device resource sharing, etc. A description of the various animations presented during cross-device resource sharing can be found below.
[0093] Electronic device 500 can achieve shooting function through ISP, camera 191, video codec, GPU, display 192 and application processor.
[0094] Camera 191 is used to capture still images or videos. In some embodiments, electronic device 500 may include one or N cameras 191, where N is a positive integer greater than 1. In some embodiments of this application, camera 191 can be used to acquire images of the surroundings of electronic device 500. These images may or may not contain specific gestures for triggering cross-device resource sharing. If present, these gestures may be resource sending or receiving gestures, as described later. Camera 191 can identify the content in the image to detect the presence of specific gestures for triggering cross-device resource sharing, such as resource sending or receiving gestures, as described later. In some implementations, camera 191 can run in the background in real time to acquire images of the surroundings of electronic device 500 in real time to detect the presence of specific gestures for triggering cross-device resource sharing, so that electronic device 500 can promptly send resources to other electronic devices and respond to users' resource sharing requests. For an introduction to broadcast messages, please refer to the relevant descriptions below.
[0095] In this embodiment, an electronic device can function as both a resource sender and a resource receiver. Therefore, the electronic device can perform operations required when acting as a resource sender, and also operations required when acting as a resource receiver, such as, but not limited to, the aforementioned operation of activating the camera in real-time for specific gesture recognition.
[0096] In some embodiments, to reduce the power consumption of electronic devices performing real-time gesture recognition based on cameras, low-power cameras can be used. The gesture recognition module can be recessed into the lower layers of the operating system or into hardware (such as a SensorHub) within the system architecture. The recognition result is only reported when a specific gesture is recognized, thus waking up higher-level operating system modules for cross-device resource sharing. This way, only the low-power operating system or hardware modules need to remain operational in real-time to trigger the corresponding cross-device resource sharing function upon detecting a specific gesture.
[0097] The memory 120 can be used to store computer executable program code, which includes instructions. The memory 120 may include a program storage area and a data storage area. The program storage area may store the operating system, applications required for at least one function, etc. The data storage area may store data created during the use of the electronic device 500, etc. Furthermore, the memory 120 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the electronic device 500 by running instructions stored in the memory 120 and / or instructions stored in memory disposed within the processor.
[0098] Electronic device 500 can implement audio functions through audio module 170 and application processor, such as music playback and recording.
[0099] The sensor module 180 may include one or more sensors.
[0100] Buttons 190 include a power button, volume buttons, etc. Buttons 190 can be mechanical buttons or touch-sensitive buttons. Electronic device 500 can receive button input and generate key signal inputs related to user settings and function control of electronic device 500.
[0101] In some embodiments, such as Figure 5 The system architecture of the electronic device 500 shown can also adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture, etc. Taking a layered architecture as an example... Figure 6 This diagram illustrates the structure of another electronic device 500 provided in an embodiment of this application. The layered architecture can be divided into several layers, each with a clear role and division of labor, and the layers communicate with each other through interfaces. For example... Figure 6 As shown, electronic device 500 may include an application layer, a system service layer, and a hardware layer.
[0102] The application layer can include a series of application packages, such as system applications and third-party applications. For example, system applications may include, but are not limited to, gallery applications, file management applications, and screenshot applications, while third-party applications may include, but are not limited to, video applications, social applications, and shopping applications. It is understood that the applications included in the application layer can be programs with visual icons displayed on the electronic device's screen, such as gallery applications. They can also be programs or functions that run internally on the electronic device and are not visible to the user, such as screenshot applications.
[0103] In some embodiments of this application, one or more applications located at the application layer may integrate a sharing tool (ShareKit), such as gallery applications, screenshot applications, and video applications that integrate ShareKit. Alternatively, one or more applications located at the application layer may not integrate ShareKit, such as file manager applications, social applications, and shopping applications that do not integrate ShareKit. It is understood that... Figure 6 The applications shown, with and without ShareKit integrated, are merely illustrative examples. ShareKit is a library that provides an application programming interface (API) for sharing, enabling applications to share resources across devices.
[0104] When an application integrates ShareKit, it can register with the remote sharing service provided by the system service layer by accessing the sharing API provided by the integrated ShareKit, thereby realizing the cross-device resource sharing scheme described in the following embodiments.
[0105] When an application does not integrate ShareKit, in some implementations, it may be unable to implement the cross-device resource sharing scheme described in the following embodiments because it cannot register with the AirShare service provided by the system service layer. In other implementations, other applications that integrate ShareKit can assist in implementing the cross-device resource sharing scheme described in the following embodiments. For example, taking a screenshot application as an example, the screenshot application can register with the AirShare service provided by the system service layer by accessing the sharing API provided by the integrated ShareKit, and then share the resources of other applications with other electronic devices through the AirShare service via screenshots.
[0106] The system service layer can include a series of system services, such as the AirShare service and a distributed architecture foundation. The AirShare service provides applications registered with it on electronic devices with the ability to share their resources with other electronic devices. The AirShare service can support one or more of the following functions: for example, it can acquire and manage application registration events at the application layer and perform cross-device resource sharing processing based on these events. It is understood that when an application registers with the AirShare service, its registration event exists. Conversely, when an application is not registered with the AirShare service, its registration event does not exist.
[0107] The AirShare service can also interface with a distributed architecture platform to perform operations such as discovering electronic devices and storing communication messages between electronic devices (including but not limited to Bluetooth broadcast messages described below). This allows for the rapid transmission of data frames to other electronic devices. For example, in the case of Wi-Fi communication between electronic devices, this data frame can be an action frame. Action frames can be used to establish peer-to-peer connections between electronic devices. The AirShare service can also parse the sharing service identifier carried in communication messages between electronic devices (including but not limited to broadcast messages and action frames). This sharing service identifier can be used to identify whether the message is for cross-device resource sharing, enabling rapid connections between electronic devices.
[0108] The air sharing service can also have connection scheduling capabilities, such as supporting connection to the hardware layer recognition module to play various animations during cross-device resource sharing. It supports notifying the hardware layer recognition module after receiving a broadcast message (also known as a broadcast packet or broadcast frame) from the resource sender, thereby increasing the frequency or frame rate of recognizing specific gestures used to trigger cross-device resource sharing.
[0109] The remote sharing service also features development and feedback exchange (DFX) capabilities and performance tuning. DFX capabilities provide a range of tools and functions for developing, testing, and maintaining applications.
[0110] A distributed architecture platform provides communication capabilities for interconnectivity between electronic devices, enabling them to quickly discover and connect to other electronic devices and achieve connectivity adaptation between different electronic devices.
[0111] The hardware layer may include an identification module, Bluetooth, and Wi-Fi. The identification module can be used to identify specific gestures used to trigger cross-device resource sharing. In some embodiments, the identification module may be specifically implemented as a camera, which can periodically capture images of the surroundings of the electronic device 500 to detect the presence of specific gestures that trigger cross-device resource sharing. Optionally, in some implementations, the identification module can also identify specific gestures that trigger cross-device resource sharing when it detects that the electronic device 500 has enabled the cross-device resource sharing function.
[0112] Understandable, Figure 6 The structure of the electronic device 500 shown is merely illustrative. In practical applications, it may include more or fewer modules, and the hierarchy of each module may also differ. Other hierarchical divisions are also possible, and this application does not impose any limitations on them.
[0113] It is also understandable that Figure 5 , Figure 6 The illustrated structures do not constitute a specific limitation on the first electronic device 401 or the second electronic device 402. In other embodiments of this application, the first electronic device 401 or the second electronic device 402 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The processing steps or functional characteristics of the illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0114] The technical solutions involved in the following embodiments can all be applied to applications with, for example, Figure 5 , Figure 6 The device with the structure shown, and Figure 4 The system is implemented using the architecture shown. The following description uses a first electronic device 401 as the first electronic device and a second electronic device 402 as the second electronic device. Taking the first electronic device as the resource sender and the second electronic device as the resource receiver as an example, the technical solution of the embodiment of this application is introduced.
[0115] This application provides a cross-device resource sharing method. After recognizing a gesture to trigger resource sending (hereinafter referred to as a resource sending gesture), a first electronic device can send an indication message to at least one other electronic device, indicating that the first electronic device is about to send its own resources. Correspondingly, the at least one electronic device can receive the indication message from the first electronic device. Then, after recognizing a gesture to trigger resource receiving (hereinafter referred to as a resource receiving gesture), a second electronic device among the at least one electronic device triggers a connection with the first electronic device. Based on this connection, the first electronic device can send its own resources to the second electronic device, and correspondingly, the second electronic device can receive the resources from the first electronic device, thereby realizing cross-device resource sharing.
[0116] Optionally, in this embodiment, the resource sending and receiving gestures can be gestures that do not touch the electronic device's display screen, i.e., air gestures. This allows users to share resources across devices without touching the screen. Even in scenarios where users' fingers are wet or unable to touch the screen, cross-device resource sharing is still possible. This improves the convenience and intelligence of cross-device resource sharing.
[0117] The cross-device resource sharing method provided in this application will be described below in conjunction with different cross-device resource sharing scenarios. In all the following scenarios, the resources shared by the first electronic device to the second electronic device are those displayed on the display screen of the first electronic device. These resources can be resources from any application installed on the first electronic device. Of course, in other scenarios, the resources shared by the first electronic device to the second electronic device can also be resources not displayed on the display screen of the first electronic device.
[0118] In some scenarios, the resources sent from the first electronic device to the second electronic device can be resources registered with, such as... Figure 6 The resources of the applications shown in the AirShare service are those of applications that can use the AirShare service to achieve cross-device resource sharing. Taking the application registered with the AirShare service as the Gallery application, and the resources sent from the first electronic device to the second electronic device as images from the Gallery application, with the first electronic device being electronic device 10 and the second electronic device being electronic device 20, the process of the first electronic device sharing images with the second electronic device is described.
[0119] For example, such as Figure 7 As shown in Figure (1), the electronic device 10 can present an interface 700 of a gallery application (which can be used as an example of a first interface of a first application), and the interface 700 is an interface that displays images in a large image format. An image 701 (which can be used as an example of first content) is displayed in the interface 700. In some embodiments, when the gallery application presents any interface on the electronic device 10, it can use the AirShare service to share the resources in the current interface. That is, when the electronic device 10 presents any interface of the gallery application, it can perform the operation of sending the resources included in that interface to other electronic devices. In other embodiments, the gallery application only presents a specific interface on the electronic device 10, such as including but not limited to… Figure 7Only when interface 700, as shown in (1), is the AirShare service available for sharing resources within the current interface. In other words, electronic device 10 can only send resources included in a specific interface of the gallery application to other electronic devices when that interface is displayed. Optionally, the interface on which the gallery application can use the AirShare service can be pre-defined by the gallery application. For implementations of other applications, refer to the similar implementation of the gallery application described here.
[0120] Next, the user can display on the electronic device 10, such as Figure 7 In the case of interface 700 shown in (1), the electronic device 10 is triggered to send an image 701 to the electronic device 20 by performing a resource sending gesture. If the electronic device 10 detects that the user has performed various resource sending gestures such as a palm-to-fist grab gesture, in response to the operation performed by the user, it begins to perform the operation of sending the image 701 to other electronic devices.
[0121] In some embodiments, the electronic device 10 can be via, for example, Figure 6 The recognition module shown performs gesture recognition periodically in the background. Taking a camera as an example, the electronic device 10 can periodically acquire images of its surroundings through the camera to identify whether a specific gesture used to trigger cross-device resource sharing exists based on the acquired images. This enables rapid recognition of specific gestures used to trigger cross-device resource sharing.
[0122] In some embodiments, since the sharing process of cross-device resources takes a certain amount of time, in order to avoid the user mistakenly believing that the electronic device 10 is not responding after performing a resource sending gesture, the electronic device 10 can display some cross-device resource sharing animations when it detects the resource sending gesture, so as to give the user a more intelligent perception experience of cross-device resource sharing.
[0123] For example, such as Figure 7 As shown in (2), when the electronic device 10 detects a palm in the air grab gesture (which can be an example of a start gesture included in a resource sending gesture, used to indicate the start of the execution of the resource sending gesture), the electronic device 10 can display a palm icon 702 on the interface 700 (i.e., display the gesture icon corresponding to the start gesture included in the resource sending gesture), so that the user can confirm that the electronic device 10 has recognized the resource sending gesture based on the displayed palm icon 702. Then, when the electronic device 10 continues to detect a fist in the air grab gesture, the electronic device 10 can display as shown in (2). Figure 7The motion effect to be sent shown in (3) can be used as an example of a first motion effect to be sent. Optionally, the motion effect to be sent can be composed of light and shadow 711 and card 712 obtained based on image 701. For example, light and shadow 711 can be a ring with light and shadow display effect, and card 712 includes image 701 in a reduced size.
[0124] In some implementations, when the electronic device 10 detects a fist in a gesture of air grabbing, it can also display a fist icon on interface 700, other interfaces of the gallery application, or other applications. This fist icon can be displayed in the same position as the palm icon 702 and have the same UI style as the palm icon 702 (e.g., it can be displayed in the same position as the palm icon 702). Figure 9 The fist icon 901 shown in (2) is used to allow the user to confirm that the electronic device 10 has recognized the resource sending gesture based on the presented fist icon. For example, the electronic device 10 can present a palm icon 702 when it detects a palm in the air grab gesture; if the electronic device 10 detects a fist in the air grab gesture again in the following period of time, it can change to presenting a fist icon. The fist icon can be displayed simultaneously with the light and shadow 711 and the card 712 on the same interface of the gallery application, or it can be displayed sequentially on different interfaces of the gallery application or on the interface of different applications.
[0125] Optionally, when electronic device 10 detects that the fist in the air grab gesture (which can be an example of an end gesture included in a resource sending gesture, used to indicate the end of the execution of the resource sending gesture) has moved away from in front of electronic device 10, electronic device 10 may also display as follows: Figure 7 The gesture movement animation shown in (4) is optional. This gesture movement animation can be composed of light and shadow 720 and a card 712 obtained based on image 701, etc. Figure 7 The animation to be sent shown in (3) and such Figure 7 The difference between the gesture movement effects shown in (4) lies in the different positions of the light and shadow displayed on the electronic device 10. Optionally, the light and shadow in the animation effect to be sent can move in the direction that the fist in the air grab gesture moves away from the front of the electronic device 10, thereby generating the gesture movement effect. Figure 7 Example (4) is taken as an example where the fist in the air grab gesture moves away from the right side of the screen of the electronic device 10. Optionally, when the fist in the air grab gesture moves completely away from the front of the electronic device 10, that is, when the electronic device 10 can no longer detect the fist in the air grab gesture, the light and shadow in the animation to be sent can be completely removed from the display screen of the electronic device 10, such as the electronic device 10 can display as follows. Figure 7The gesture movement animation shown in (5) can omit the light and shadow 720. The positions of the light and shadow 711 and 720 on the display screen of the electronic device 10 can change in real time with the real-time changes in the position of the fist in the air grab gesture in front of the electronic device 10. Thus, the electronic device 10 can give the user the experience of the light and shadow 711 and 720 being controlled by the user's fist in the air, enhancing the technological feel of human-computer interaction and improving the user experience when the user uses the electronic device to share resources across devices.
[0126] In some embodiments, the electronic device 10 can present, for example, Figure 7 In (2) to Ru Figure 7 During the process shown in the interface (4), the operation of sending pictures to other electronic devices is performed. Specifically, when electronic device 10 recognizes a palm-to-fist air grab gesture (i.e., detects the start and end gestures), it can send an instruction message to at least one other electronic device to indicate that electronic device 10 is about to send its own resources. Correspondingly, this at least one other electronic device can receive the instruction message from electronic device 10. Then, electronic device 20 of this at least one other electronic device performs the operation of recognizing resource receiving gestures to determine whether to receive resources from electronic device 10. For example, when electronic device 20 detects that the user has performed various resource receiving gestures such as a fist-to-palm air release gesture, in response to the operation performed by the user, electronic device 20 begins to perform the operation of receiving pictures from electronic device 10.
[0127] It is understood that in this embodiment of the application, the resource sending gesture is a grasping gesture from palm to fist and the resource receiving gesture is a release gesture from fist to palm. In other embodiments, the resource sending gesture and the resource receiving gesture can also be other air gestures, such as a gesture of waving the palm to the right side of the screen and a gesture of waving the fist to the left side of the screen. This embodiment of the application does not limit this.
[0128] Similarly, in some embodiments, to facilitate timely recognition that a user has performed a specific gesture to trigger cross-device resource sharing, the electronic device 20 may also use methods such as... Figure 6 The recognition module shown performs gesture recognition periodically in the background. Taking a camera as an example, the electronic device 20 can periodically acquire images of its surroundings through the camera to identify whether a specific gesture used to trigger cross-device resource sharing exists based on the acquired images. In this way, rapid recognition of specific gestures used to trigger cross-device resource sharing can be achieved.
[0129] In this embodiment, in some implementations, to facilitate faster recognition of resource receiving gestures by electronic device 20 and to expedite resource sharing with electronic device 10, electronic device 20 can increase the frequency at which its recognition module recognizes resource receiving gestures after receiving an instruction message from electronic device 10. That is, the recognition frequency used by electronic device 20's recognition module before receiving the instruction message from electronic device 10 (which can be described as a first frequency) is lower than the recognition frequency used after receiving the instruction message from electronic device 10 (which can be described as a second frequency). For example, taking a camera as the recognition module, the frequency at which electronic device 20's camera captures surrounding images before receiving the instruction message from electronic device 10 can be lower than the frequency after receiving the instruction message from electronic device 10. In other words, the frame rate of the surrounding images captured by electronic device 20's camera before receiving the instruction message from electronic device 10 can be lower than the frame rate of the surrounding images captured after receiving the instruction message from electronic device 10. This allows for faster and more accurate recognition of resource receiving gestures, improving the efficiency of cross-device resource sharing and thus enhancing the intelligence of cross-device resource sharing.
[0130] In some embodiments, an electronic device can function as both a resource sender and a resource receiver. Therefore, if electronic device 20 can function as both a resource sender and a resource receiver, its recognition module can continuously perform gesture recognition operations in the background to facilitate timely recognition of both resource sending and receiving gestures. In other words, the purpose of electronic device 20 recognizing gestures through its recognition module before receiving an instruction message from electronic device 10 is to enable timely identification of both resource sending and receiving gestures.
[0131] In some embodiments, after an electronic device (such as electronic device 10, electronic device 20, etc.) enables the cross-device resource sharing function, in response to the activation of the cross-device resource sharing function, the electronic device can perform gesture recognition operations in the background in real time through the recognition module, so as to be able to promptly recognize resource sending gestures and / or resource receiving gestures. As one possible implementation, the cross-device resource sharing function may be enabled by default after the electronic device leaves the factory. As another possible implementation, the cross-device resource sharing function may be manually enabled, such as by a user enabling the cross-device resource sharing function of the electronic device through various button operations, gesture operations, voice operations, etc. For example, if a user enables the cross-device resource sharing function through a settings application installed on the electronic device... Figure 8As shown in (1), the electronic device can present an interface 800 for setting applications. The interface 800 displays a remote control button 801, through which the user can enable or disable the cross-device resource sharing function of the electronic device.
[0132] Similarly, in some embodiments, to avoid the user mistakenly believing that the electronic device 20 is not responding after performing a resource receiving gesture, the electronic device 20 may also display some cross-device resource sharing animations when it detects a resource receiving gesture, so as to give the user a more intelligent perception experience of cross-device resource sharing.
[0133] For example, such as Figure 9 As shown in (1), the electronic device 20 can display a main interface 900 (or desktop 900). Then, when the electronic device 20 detects a fist gesture in a gesture release (which can be used as an example of a start gesture included in a resource receiving gesture, indicating the start of execution of the resource receiving gesture), as... Figure 9 As shown in (2), the electronic device 20 can display a fist icon 901 on the main interface 900, that is, display a gesture icon corresponding to the start gesture included in the resource receiving gesture, so that the user can confirm that the electronic device 20 has recognized the resource receiving gesture based on the displayed fist icon 901. Optionally, when the electronic device 20 detects that the fist in the air release gesture has moved from the front of the electronic device 20, it can also display as shown in (2). Figure 9 The gesture movement animation shown in (2) is an example. Optionally, in this example, the gesture movement animation can be generated by, for example... Figure 9 The light and shadow 902 shown in (2) constitutes the structure. For example, the light and shadow 902 can be a ring with a light and shadow display effect. It is understood that the effects of light and shadow are not limited in the embodiments of this application. Optionally, such as... Figure 9 The light and shadow 902 shown in (2) can move in the direction that the fist in the air release gesture moves from in front of the electronic device 20, thereby generating a light and shadow effect. Figure 9 The gesture movement animation shown in (2) is as follows: Figure 9 Example (2) is taken as an example where the fist in the air release gesture moves into the screen of the electronic device 20 from the left side. Optionally, when the fist in the air release gesture moves completely into the front of the electronic device 20, that is, when the electronic device 20 can detect the complete fist in the air release gesture, the light and shadow 902 can be fully displayed on the electronic device 20, such as... Figure 9 The presentation effect shown in (3) is as follows. The position of the light and shadow 902 displayed on the screen of the electronic device 20 can change in real time according to the real-time change of the position of the fist in the air release gesture in front of the electronic device 20. Thus, the electronic device 20 can give the user the experience of the light and shadow 902 being controlled by the user's fist in the air, enhancing the technological feel of human-computer interaction and improving the user experience when the user uses the electronic device to share resources across devices.
[0134] In some embodiments, when the electronic device 20 further detects the palm in the air release gesture (which can be an example of an end gesture included in a resource receiving gesture, which can be used to indicate the end of the execution of the resource receiving gesture), the electronic device 20 can also display a light and shadow animation on the main interface 900. The light and shadow animation can be a light and shadow that gradually increases and then disappears. For example... Figure 9 The light and shadow 902 shown in (3) can gradually increase in size on the display screen until it disappears from the display screen. Figure 9 (4) shows a schematic diagram of the effect after the light and shadow 902 is enlarged.
[0135] In some implementations, the electronic device 20 may also display a palm icon on the main interface 900 or the interface of other applications when it detects a palm in the air release gesture. This palm icon may be displayed in the same position as the fist icon 901 and have the same UI style as the fist icon 901 (e.g., it may be displayed in the same position as the fist icon 901). Figure 7 The hand icon 702 shown in (2) is used to allow the user to confirm that the electronic device 20 has recognized the resource receiving gesture based on the presented hand icon. For example, the electronic device 20 can present a fist icon 902 when it detects a fist in the air release gesture. If the electronic device 20 detects a palm in the air release gesture again after a period of time, it can change to presenting a hand icon. The above hand icon can be displayed simultaneously with the light and shadow 902 on the same interface of the desktop application, or it can be displayed sequentially on different interfaces of the desktop application (such as the main screen, secondary screen, etc.) or on the interface of different applications.
[0136] In some embodiments, during the process of sending image 701 to electronic device 20, electronic device 10 may also display a sending animation effect and / or electronic device 20 may also display a receiving animation effect. For example, the sending animation effect displayed by electronic device 10 may be as follows: Figure 10 As shown in (1), the sending animation can be composed of preview image 1002 (which can serve as an example of preview data for the first content) and light and shadow 1001. The receiving animation presented by the electronic device 20 can be as follows: Figure 11As shown in (1), the receiving animation effect can be composed of preview image 1102 (which can be used as an example of preview data for the first content) and light and shadow 1101. Among them, the aforementioned preview image 1002 and preview image 1102 can be preview images of image 701. Optionally, preview image 1102 can be sent by electronic device 10 to electronic device 20. Light and shadow 1001 and light and shadow 1101 can be circular; preview image 1002 and preview image 1102 can be circular, or can be shapes that match the shapes of light and shadow 1001 and light and shadow 1101 respectively; preview image 1002 and preview image 1102 can be displayed within light and shadow 1001 and light and shadow 1101 respectively; preview image 1002 and preview image 1102 can be obtained by cropping image 701 according to the shapes of light and shadow 1001 and light and shadow 1101 respectively. It is understandable that this example uses the same sending animation displayed by electronic device 10 and the same receiving animation displayed by electronic device 20. In other examples, the sending animation displayed by electronic device 10 and the receiving animation displayed by electronic device 20 may be different.
[0137] Optional, such as Figure 10 In the sending animation shown in (1), the black area outside the light and shadow 1001 can be transparent, and the area outside the light and shadow 1001 displays the interface content (such as the gallery interface) displayed by the electronic device 10 before the sending animation. Similarly, as Figure 11 In the receiving animation shown in (1), the black area outside the light and shadow 1101 can be transparent, and the electronic device 20 displays the interface content (such as the desktop) before the receiving animation.
[0138] Optionally, the electronic device 10 externally displayed by light and shadow 1001 displays the interface content before the sending animation, which can be presented in a blurred form; the electronic device 20 externally displayed by light and shadow 1101 displays the interface content before the receiving animation, which can also be presented in a blurred form. In contrast, preview images 1002 and 1102 are not blurred. This allows the user's attention to focus on preview images 1002 and 1102, making the user aware that data transmission is in progress and preventing the user from interrupting the process by performing other operations.
[0139] Optionally, preview images 1002 and 1102 can be presented in a blurred form; while the interface content displayed on electronic device 10 outside of light and shadow 1001 before the sending animation effect and the interface content displayed on electronic device 20 outside of light and shadow 1101 before the receiving animation effect are not blurred. Thus, the blurred preview images 1002 and 1102 allow the user to perceive that their corresponding image 701 is being transmitted, without affecting the user's ability to continue viewing other parts of the display interface of electronic devices 10 and 20.
[0140] Optionally, during the process of electronic device 10 sending images to electronic device 20, to facilitate the user's awareness of the resource sharing progress and to allow the user to perform other operations on electronic device 10, electronic device 10 can also use a live capsule (which can serve as an example of a target control presented by the first electronic device) to display the sending progress. For example, electronic device 10 can use a live capsule to display the progress. Figure 10 The sending animation shown in (1) automatically jumps to the presentation shown in (1). Figure 10 The live capsule 1010 shown in (2) is similar. Similarly, to facilitate other operations performed by the user on the electronic device 20, the electronic device 20 can also use a live capsule to present the reception progress. For example, the electronic device 20 can present a live capsule as shown in (2). Figure 11 The receiving animation shown in (1) automatically jumps to the presentation as shown in (1). Figure 11 The live capsule 1110 shown in (2) is shown in the middle. Of course, electronic devices 10 and / or 20 may also not present the aforementioned sending and receiving animations, but directly present the live capsule.
[0141] Optionally, in other embodiments, electronic device 10 and / or electronic device 20 may also use other controls (such as a floating ball) to display the sending progress and receiving progress respectively.
[0142] Optional, the sending animation includes light and shadow 1001 and preview image 1002, and can also be like... Figure 7 (3) Figure 7 As shown in (4), the animation changes in real time with the position of the fist in the air-grabbing gesture in front of the electronic device 10; the receiving animation, which includes light and shadow 1101 and preview image 1102, can also be shown in the image. Figure 9 (2) Figure 9 As shown in (3), it changes in real time with the real-time change of the position of the palm in front of the electronic device 10 during the air release gesture.
[0143] Optionally, after the sharing of image 701 is completed between electronic device 10 and electronic device 20, electronic device 10 can return as follows: Figure 7The interface 700 shown in (1) is the interface that can be returned to when the receiving resource sending gesture is displayed. Optionally, the electronic device 20 can display the received image 701. For example, taking the electronic device 20 saving the received image to the gallery application as an example, such as Figure 11 As shown in (3), the electronic device 20 can present as follows Figure 11 The image library application interface 1120 shown in (3) displays the received image 701. Alternatively, the electronic device 20 may display the received image as a floating window, allowing the user to drag the floating window to a specified application. Alternatively, the electronic device 20 may pop up a prompt window asking the user whether to save the received image to the electronic device 20, and the user can choose to save the received image to a specified application or directory of the electronic device 20; and / or, ask the user which application to view the received image, and the user can view the received image in the specified application.
[0144] Figure 9 The example shown illustrates an electronic device 20 receiving an image shared by electronic device 10 while its desktop is displayed. Optionally, when electronic device 20 displays different interfaces before receiving the image shared by electronic device 10, electronic device 20 can perform different processing on the received image, such as saving the image. Figure 11 (This is an example in the scenario shown). Alternatively, the image can be sent to others. For instance, if electronic device 20 displays a chat interface with a friend before receiving an image shared by electronic device 10, then electronic device 20 can directly send the received image to that chat interface to send it to the friend.
[0145] Based on the solution described above, after a user performs a gesture to grab a resource from the sending device, the sending device can send an indication message to the outside world to indicate that it is about to send resources. Then, upon receiving this indication message and a gesture to release the resource from the receiving device, the receiving device can receive the resources. Users do not need to touch the screen of their electronic devices, and there is no need for physical contact between the devices, making cross-device resource sharing more convenient and intelligent.
[0146] In other scenarios, the resources sent from the first electronic device to the second electronic device may be unregistered resources, such as... Figure 6 The resources of the applications shown in the AirShare service are those of applications that cannot use AirShare to share resources across devices. Taking an application not registered with AirShare as a desktop application, and electronic device 10 as the first electronic device and electronic device 20 as the second electronic device, the process of sharing resources from the first electronic device to the second electronic device is described. It is understood that this is based on an application not registered with AirShare. Figure 6 The application shown in the example of the air sharing service is a desktop application. In actual use, the application that is not registered with... Figure 6 The applications shown in the air sharing service can also be used for various system applications (such as...) Figure 6 The examples shown include file management applications and third-party applications (such as social applications and shopping applications).
[0147] It is understandable that the solution described in this scenario is also applicable to situations where an application that has registered with the AirShare service presents an interface that does not support AirShare (such as the second interface of the first application), but still receives a resource sending gesture executed by the user.
[0148] For example, such as Figure 12 As shown in Figure (1), the electronic device 10 can display a desktop 1200 (which can serve as an example of the interface for a second application), on which various UI elements such as icons of one or more applications, time controls, etc., are displayed. Then, the user can display on the electronic device 10... Figure 12 In the case of desktop 1200 shown in (1), when a resource sending gesture such as a palm-to-fist grab gesture is executed, electronic device 10 can generate a screenshot of desktop 1200 in response to the user's operation. At the same time, electronic device 10 begins to perform the operation of sending the screenshot to other electronic devices. Specifically, electronic device 10 can send an instruction message to at least one other electronic device to indicate that electronic device 10 is about to send its own resources. Correspondingly, at least one other electronic device can receive the instruction message from electronic device 10. Then, electronic device 20 of at least one other electronic device performs the operation of recognizing resource receiving gestures to determine whether to receive resources from electronic device 10. For example, when electronic device 20 detects that the user has performed various resource receiving gestures such as a fist-to-palm release gesture, electronic device 20 begins to perform the operation of receiving screenshots from electronic device 10 in response to the user's operation.
[0149] In this scenario, the implementation of the electronic device 10 recognizing resource sending gestures and the electronic device 20 recognizing resource receiving gestures can refer to the implementation in the previous scenario.
[0150] Similarly, in this scenario, when electronic device 10 detects a resource sending gesture, and / or when electronic device 20 detects a resource receiving gesture, it can also present animations of cross-device resource sharing, so as to bring users a more intelligent perception experience of cross-device resource sharing.
[0151] For example: Figure 12As shown in (2), when the electronic device 10 detects a palm in the air grab gesture, the electronic device 10 can display a palm icon 1211 on the desktop 1200. When the electronic device 10 continues to detect a fist in the air grab gesture, the electronic device 10 can display as shown in (2). Figure 12 The animation to be sent shown in (3) can be an example of a second animation to be sent. Optionally, the animation to be sent can be an animation that generates and renders a screenshot 1220 of the desktop 1200. Optionally, the animation to be sent can also include, for example, Figure 7 The light and shadow shown in (3) Figure 12 (not shown in (3)).
[0152] In some implementations, the electronic device 10 may also display a fist icon on the desktop 1200 or other interface when it detects a fist in a hand gesture. This fist icon may be displayed in the same position as the palm icon 1211 and have the same UI style as the palm icon 1211 (e.g., it may be like...). Figure 9 The fist icon 901 shown in (2) is used to allow the user to confirm that the electronic device 10 has recognized the resource sending gesture based on the presented fist icon. For example, the electronic device 10 can present a palm icon 1211 when it detects a palm in a gesture; if the electronic device 10 detects a fist in a gesture later, it can change to presenting a fist icon. The fist icon can be combined with... Figure 12 The screenshot 1220 shown in (3) can be displayed on the same interface of the desktop application at the same time, or it can be displayed on different interfaces of the desktop application or different applications at different times.
[0153] For example, when electronic device 10 detects that the fist in the air grab gesture has moved away from in front of electronic device 10, electronic device 10 can also display something like this: Figure 12 The gesture movement effect shown in (4) is optional. The gesture movement effect can be composed of light and shadow 1230. Figure 12 Example (4) is an example of a fist moving away from the right side of the screen of an electronic device 10 in a gesture of air grabbing. For an introduction to Light and Shadow 1230, please refer to [link / reference needed]. Figure 7 The description of the light and shadow in the gesture movement animation shown in (4). The position of the light and shadow 1230 on the display screen of the electronic device 10 can change in real time according to the real-time change of the position of the fist in the air grab gesture in front of the electronic device 10. Thus, the electronic device 10 can give the user the experience of the light and shadow 1230 being controlled by the user's fist in the air, enhancing the technological feel of human-computer interaction and improving the user experience when the user uses the electronic device to share resources across devices.
[0154] For example: Electronic device 20 can display such as Figure 9The main interface 900 is shown in (1). Next, when the electronic device 20 detects the fist gesture in the air release gesture, as shown... Figure 9 As shown in (2), the electronic device 20 can display a fist icon 901 on the main interface 900.
[0155] For example, when electronic device 20 detects that the fist in the air release gesture has moved from in front of electronic device 20, it can also display something like this. Figure 9 The gesture movement effect shown in (2) is another example. For example, when the electronic device 20 further detects the palm in the air release gesture, the electronic device 20 can also display light and shadow effects on the main interface 900.
[0156] Similarly, in this scenario, during the process of electronic device 10 sending screenshot 1220 to electronic device 20, electronic device 10 can also display a sending animation and / or electronic device 20 can also display a receiving animation. For example, the sending animation displayed by electronic device 10 can be as follows: Figure 13 As shown in (1). The sending animation can be composed of preview image 1302 and light and shadow 1301. The receiving animation presented by electronic device 20 is as follows. Figure 13 As shown in (2), the receiving animation can be composed of preview image 1312 and light and shadow 1311. Preview image 1312 and preview image 1302 can be preview images of screenshot 1220. Regarding... Figure 13 The sending animation shown in (1) and Figure 13 The motion effects for receiving motion effects described in (2) can be referred to Figure 10 The sending animation shown and Figure 11 The corresponding descriptions of the receiving animations are shown below.
[0157] Similarly, in this scenario, during the process of electronic device 10 sending screenshot 1220 to electronic device 20, electronic device 10 can also display as follows: Figure 13 The sending animation shown in (1) automatically jumps to a live capsule presentation, such as the electronic device 10 can present such as Figure 11 The interface shown in (2) is also available on the electronic device 20. Figure 13 The receiving motion effect shown in (2) automatically jumps to the presentation of a live capsule, such as the electronic device 20 can also present such as Figure 11 The interface shown in (2) is shown in the middle.
[0158] Similarly, in this scenario, after sharing screenshot 1220 between electronic device 10 and electronic device 20, electronic device 10 can return a response such as... Figure 12 Desktop 1200 is shown in (1). Optionally, electronic device 20 can display the received screenshot 1220. For example: Figure 13As shown in (3), the electronic device 20 can present the interface 1320 of the gallery application to display the received screenshot 1220.
[0159] Based on the solution described in this scenario, when an application (including but not limited to system applications and third-party applications) lacks the capability to share resources across devices using the AirShare service, cross-device resource sharing can be achieved through screenshots. After a user performs an AirShare gesture on the resource sender, the resource sender can send an indication message to the outside world to indicate that it is about to send the resource. When the resource receiver receives the indication message and the AirShare gesture, the resource sender can send a screenshot of the resource (such as the application's interface) to the resource receiver. This not only makes cross-device resource sharing more convenient and intelligent, but also ensures a good user experience even when the application does not use the AirShare service provided in this solution.
[0160] Optionally, in the above scenario, the system accounts (such as Huawei accounts) logged into by electronic device 10 and electronic device 20 can be the same or different. In some embodiments, when the system accounts logged into by electronic device 10 and electronic device 20 are different, a trust relationship can also be established between electronic device 10 and electronic device 20 to improve the security of cross-device resource sharing.
[0161] For example, when electronic device 20 receives a resource receiving gesture such as a fist-to-palm release gesture, in response to this operation, before receiving the shared resources from electronic device 10, electronic device 20 may remind the user whether they want to receive resources from electronic device 10 or whether they want to establish a trust relationship with electronic device 10. Optionally, electronic device 20 may remind the user whether they want to receive resources from electronic device 10 or whether they want to establish a trust relationship with electronic device 10 before, after, or simultaneously with the aforementioned cross-device resource sharing animation. For example, in combination with Figure 9 In the scenario shown, electronic device 20 can present, as follows Figure 14 The reminder message 1400 shown in Figure (1) displays a Trust and Receive button 1401, a Receive button 1402, and a Reject button 1403. The Trust and Receive button 1401 allows the electronic device 20 to receive shared resources from the electronic device 10 and establish a trust relationship with the electronic device 10. The Receive button 1402 allows the electronic device 20 to receive the shared resources from the electronic device 10 without establishing a trust relationship with the electronic device 10. The Reject button 1403 allows the electronic device 20 to refuse to receive shared resources from the electronic device 10.
[0162] For example, suppose the user has the following... Figure 14 If the trust and receive button 1401 shown in (1) performs an operation such as clicking, then in response to that operation, the electronic device 10 can remind the user whether to send resources to the electronic device 20 or whether to establish a trust relationship with the electronic device 20. For example, in combination with Figure 7 In the scenario shown, electronic device 10 can present as follows: Figure 14 The reminder message 1410 shown in (2) displays a Trust and Send button 1411, a Send button 1412, and a Cancel button 1413. The Trust and Send button 1411 can be used by electronic device 10 to send resources to electronic device 20 and establish a trust relationship with electronic device 20. The Send button 1412 can be used by electronic device 10 to send resources but not establish a trust relationship with electronic device 20. The Cancel button 1413 can be used by electronic device 10 to cancel sending resources. It is understood that electronic device 10, when presenting such a message... Figure 14 The reminder message 1410 shown in (2) indicates that a resource sending gesture has been received. In this way, the electronic device 10 presents the reminder message 1410, which facilitates the establishment of a trust relationship with the electronic device 20.
[0163] In this example, the user can... Figure 14 When the Trust and Send button 1411 shown in (2) performs an operation such as clicking, a trust relationship is established between electronic device 10 and electronic device 20 in response to the operation. Subsequently, when electronic device 10 and electronic device 20 share resources across devices, they can share resources directly, and electronic device 10 no longer needs to display a message such as... Figure 14 The reminder message shown in (2) can also be removed from the electronic device 20. Figure 14 The reminder message shown in (1) indicates this. This makes cross-device resource sharing faster and more convenient. Conversely, when the user does not respond to such reminders... Figure 14 The Trust and Send button 1411 shown in (2) performs an operation such as clicking, but instead... Figure 14 If the send button 1412 shown in (2) performs an operation such as clicking, then in response to this operation, electronic device 10 and electronic device 20 will only share the resource for this specific time, and will not establish a trust relationship. Subsequently, when electronic device 10 and electronic device 20 perform cross-device resource sharing, electronic device 20 will still display as shown in (2). Figure 14 The reminder message shown in (1) will still be displayed on the electronic device 20. Figure 14 The reminder message shown in (2) or presented as follows Figure 14 The reminder message shown in (3) further ensures the security of cross-device resource sharing.
[0164] For another example, suppose the user has the following... Figure 14 If the receive button 1402 shown in (1) performs an operation such as clicking, then in response to that operation, the electronic device 10 can prompt the user whether to send resources to the electronic device 20. For example, the electronic device 10 can display as follows: Figure 14 The reminder message 1420 shown in (3) no longer displays the "Trust and Send" button, but only displays the "Send" button 1421 and the "Cancel" button 1422. For details on the "Send" button 1421 and the "Cancel" button 1422, please refer to [link to relevant documentation]. Figure 14 The corresponding descriptions of the send button 1412 and cancel button 1413 shown in (2) are as follows. In this example, the user can select the send button 1412 and cancel button 1413 as shown in (2). Figure 14 The send button 1421 shown in (3) performs operations such as clicking to realize the sharing of resources between electronic device 10 and electronic device 20, but no trust relationship is established between electronic device 10 and electronic device 20. Subsequently, when electronic device 10 and electronic device 20 perform cross-device resource sharing, electronic device 20 will still display as shown in (3). Figure 14 The reminder message shown in (1) will still be displayed on the electronic device 10. Figure 14 The reminder message shown in (2) or presented as follows Figure 14 The reminder message shown in (3) is shown in the middle.
[0165] In some embodiments, after an electronic device establishes a trust relationship with other electronic devices in the manner described above, the electronic device may also notify the user of the electronic devices with which it has established a trust relationship. As a possible example, such as... Figure 8 As shown in (1), the electronic device can simultaneously display the identifiers of electronic devices that have established a trust relationship with it on the interface 800, such as device 1, device 2, etc. Of course, the electronic device can also display the identifiers of electronic devices that have established a trust relationship with it on other interfaces, and this application embodiment does not limit this.
[0166] In some embodiments, users can also change the trust relationship between electronic devices, such as dissolving the trust relationship between them. It is understood that when the trust relationship between electronic devices is dissolved, subsequent resource sharing between the electronic devices may result in the following: Figure 14 The reminder message shown. Figure 8As shown in Figure (1), when the electronic device displays the identifier of an electronic device with which it has established a trust relationship, it can also display a delete button 802 to allow the user to modify the established trust relationship. If the user performs an operation such as clicking the delete button 802 corresponding to device 1, the electronic device can revoke the trust relationship established with device 1 in response to the operation. Optionally, before successfully revoking the trust relationship established with device 1, the electronic device can also prompt the user to confirm whether to revoke the trust relationship with device 1. For example, the electronic device can display as follows Figure 8 The reminder message 810 shown in (2) may display a delete button 811 and a cancel button 812. If the electronic device detects an operation such as a user clicking the delete button 811, it determines to terminate the trust relationship established with device 1 in response to the operation. Conversely, if the electronic device detects an operation such as a user clicking the cancel button 812, it does not terminate the trust relationship established with device 1 in response to the operation.
[0167] Of course, when electronic devices 10 and 20 are logged into different system accounts, electronic device 10 can directly remind the user whether to send the resource before sending it, and / or electronic device 20 can directly remind the user whether to receive the resource before receiving it. In other words, electronic devices 10 and 20 can choose not to execute the aforementioned reminder to establish a trust relationship, thus ensuring the security of cross-device resource sharing.
[0168] The above describes the process of cross-device resource sharing in different scenarios. The above description assumes that there is one resource sender and one resource receiver.
[0169] In other embodiments, there may be one resource sender and multiple resource receivers. That is, resources sent by one electronic device can be simultaneously received by multiple other electronic devices (such as a first electronic device and a third electronic device). In this embodiment, each resource receiver can receive resources from the resource sender using the scheme described above, and the resource sender can send resources using the scheme described above.
[0170] In some embodiments, there can be multiple resource transmitters and only one resource receiver. Taking electronic device 10 and electronic device 30 as resource transmitters and electronic device 20 as the resource receiver, in this embodiment, resource receiver 20 may receive an indication message from electronic device 10 and an indication message from electronic device 30 (which can be considered an example of an indication message from a third electronic device). It is understood that the indication messages from electronic device 10 and electronic device 30 may be received simultaneously by electronic device 20, or they may be received sequentially by electronic device 20. Regardless of the order in which they are received, these indication messages are received before the resource receiving gesture. For example, taking the sequential receipt of the indication messages from electronic device 10 and electronic device 30 by electronic device 20 as an example... Figure 15 This illustration shows a timing diagram of an electronic device 20 receiving information according to an embodiment of this application, as shown below. Figure 15 As shown, the instruction message from electronic device 10 is received at time t1, meaning that electronic device 10 receives the resource sending gesture at time t1. The instruction message from electronic device 30 is received at time t2, meaning that electronic device 30 receives the resource sending gesture at time t2. The resource receiving gesture is received at time t3. Among these, the instruction message from electronic device 10 is received earliest, and the resource receiving gesture is received latest.
[0171] When electronic device 20 receives a resource receiving gesture from the user, in response to the gesture, electronic device 20 can determine which electronic device to receive the resource from based on preset rules. As one possible implementation, the preset rules may include: by default, only receiving resources from electronic devices with the same system account as electronic device 20. For example, assuming that the system account of electronic device 10 is the same as that of electronic device 20, while the system account of electronic device 30 is different from that of electronic device 20, then electronic device 20 can determine to receive resources from electronic device 10, but not from electronic device 30. Optionally, in this implementation, there may be one or more electronic devices with the same system account as electronic device 20. When multiple electronic devices exist, electronic device 20 can simultaneously receive resources from these electronic devices with the same system account.
[0172] As another possible implementation, the preset rule may include determining which electronic device's resources to receive based on the user's selection. For example, the electronic device may remind the user that multiple electronic devices are currently sending resources, and ask them to select which specific electronic device's resources to receive. For instance, electronic device 20 may display... Figure 16The reminder message 1600 shown is provided for the user to make a selection. If the user chooses to receive resources from electronic device 10, they can perform a selection operation on the selection button 1601 of electronic device 10. In response to this operation, electronic device 20 can determine that it will receive resources from electronic device 10. If the user chooses to receive resources from electronic device 30, they can perform a selection operation on the selection button 1602 of electronic device 30. In response to this operation, electronic device 20 can determine that it will receive resources from electronic device 30. Optionally, in this implementation, the user can select one or more electronic devices; this embodiment of the application does not limit this. Optionally, in this implementation, there may be an electronic device with the same system account as electronic device 20, or there may be no electronic device with the same system account as electronic device 20.
[0173] Optionally, the two implementations described above can be used individually or in combination. As one possible combination, if an electronic device with the same system account as electronic device 20 exists, electronic device 20 can use the first implementation to receive resources. If only electronic devices with different system accounts exist, electronic device 20 can use the second implementation to receive resources.
[0174] Of course, the preset rules can also be implemented as other rules, such as determining which electronic device's resources to receive based on the order in which the instruction messages are received. For example, the electronic device that receives the earliest instruction message can receive the resources, or the electronic device that receives the latest instruction message can receive the resources.
[0175] For other implementations of this embodiment, please refer to the implementations in the above scenario.
[0176] The above embodiments describe the implementation of an electronic device sending and receiving resources. In other embodiments, an electronic device can simultaneously send and receive resources. This allows for resource sharing between electronic devices. Taking electronic devices 10 and 20 as examples, both may simultaneously recognize resource sending and receiving gestures. For instance, a user can simultaneously perform a hand gesture (like a palm-to-fist grab) on both devices, and both devices can recognize this gesture. The user can then choose to perform a resource receiving gesture on one of the devices first, such as releasing the fist from the hand gesture. For example, if the user releases the fist from the hand gesture on device 10, device 10 can recognize the resource receiving gesture first. In response to the resource sending gesture received by device 20 and the resource receiving gesture received by device 10, device 20 sends resources to device 10, and device 10 receives resources from device 20. Optionally, during this process, the electronic device 10 can present, as... Figure 7 While displaying the pending delivery animation shown in (3), the user is notified that the resource has been received. For example, the electronic device 10 can also display a resource receiving animation, such as... Figure 7 The card 712 shown in (3) is compressed downwards and then bounces back, and various resource receiving animations are used to remind the user that the electronic device 10 has received resources.
[0177] Furthermore, after electronic device 20 continues to receive resource receiving gestures from the user, it can continue to recognize resource receiving gestures. In response to the resource sending gesture received by electronic device 10 and the resource receiving gesture received by electronic device 20, electronic device 10 sends resources to electronic device 20, and electronic device 20 receives the resources from electronic device 10. Optionally, in this example, after electronic device 10 finishes sending resources to electronic device 20, the electronic device can display the resources received from electronic device 20 without returning to the interface before sending the resources. The implementation is similar when the user first performs a resource receiving gesture on electronic device 20.
[0178] Of course, the user can also simultaneously perform a fist-to-palm resource receiving gesture on both electronic devices, and both electronic devices 10 and 20 can simultaneously recognize this gesture. In response to the aforementioned resource sending and receiving gestures, electronic device 10 sends resources to electronic device 20 and simultaneously receives resources sent by electronic device 20. Electronic device 20 receives resources sent by electronic device 10 and simultaneously sends resources to electronic device 10. Alternatively, in other embodiments, the user can perform resource sending gestures sequentially on both electronic devices, but simultaneously perform resource receiving gestures on both devices, thus also enabling mutual resource transfer between the two electronic devices.
[0179] In some embodiments, the indication message sent by the first electronic device can be a broadcast message, which can be a Bluetooth broadcast message, a Wi-Fi broadcast message, or a Starlight broadcast message. Of course, other message types can also be used, such as Wi-Fi, NFC, Zigbee, Universal Serial Bus (USB), and cellular messages. When the first electronic device sends resources to the second electronic device, it can do so based on the established connection between the two. That is, after receiving the indication message from the first electronic device, the second electronic device can establish a connection with the first electronic device. For example, this connection can be a Wi-Fi connection; however, when using other communication protocols, other connections can also be used, such as Bluetooth or cellular connections.
[0180] The following embodiments use an indication message sent by a first electronic device as a Bluetooth broadcast message and a Wi-Fi connection established between a second electronic device and the first electronic device as an example to introduce the cross-device resource sharing method provided in this application. For example, Figure 17 A flowchart illustrating a cross-device resource sharing method provided in an embodiment of this application is shown. Figure 17 As shown, the method includes the following steps:
[0181] S1701, The first electronic device detects a grasping gesture from palm to fist.
[0182] In some embodiments, before performing step S1701, the first electronic device may display an application interface, which may be as follows: Figure 12 Desktop 1200 as shown Figure 7 The image gallery application interface 700 is shown. This air grab gesture can be used to share resources included in the application interface with other electronic devices.
[0183] Optionally, the first electronic device may also execute step S1701a during the execution of step S1701.
[0184] S1701a, The first electronic device displays at least one of a hand icon, a gesture movement animation, and a pending sending animation.
[0185] For details on the presentation of the hand icon, gesture movement animation, and pending animation in step S1701a, please refer to [reference needed]. Figure 7 The electronic device 10 shown is presented with relevant information.
[0186] S1702, In response to the air grab gesture, the first electronic device sends a Bluetooth broadcast message. Correspondingly, the second electronic device can receive the Bluetooth broadcast message from the first electronic device.
[0187] Understandably, other electronic devices besides the second electronic device can also receive Bluetooth broadcast messages from the first electronic device.
[0188] The Bluetooth broadcast message includes an indication message that can be used to indicate that the first electronic device is about to send its own resources.
[0189] In some embodiments, since other electronic devices may be simultaneously sending Bluetooth broadcast messages, and these different Bluetooth broadcast messages may have different purposes—for example, the Bluetooth broadcast message from the first electronic device may be for cross-device resource sharing, while the Bluetooth broadcast messages from other electronic devices may be for audio connection or other purposes—to facilitate the identification of Bluetooth broadcast messages with different purposes, the Bluetooth broadcast message may also carry a cross-device resource sharing service identifier. This service identifier can be used to characterize that the Bluetooth broadcast message is a broadcast message used to achieve cross-device resource sharing.
[0190] Optionally, in the embodiments of this application, the first electronic device may adopt a low-power mode, such as low-power Bluetooth mode or low-power star flash mode, when sending broadcast messages to the outside world, so as to reduce the power consumption of the first electronic device.
[0191] Optionally, the presentation of gesture movement animation and the animation to be sent can be executed simultaneously or sequentially with step S1702.
[0192] S1703, The second electronic device detects a release gesture from fist to palm.
[0193] Optionally, the second electronic device may display any application interface before executing step S1703, or it may display a screen-off interface, a screen-locked interface, etc.
[0194] Optionally, the second electronic device may also execute step S1703a during the execution of step S1703.
[0195] S1703a, The second electronic device displays at least one of the following: a fist icon, a gesture movement effect, and a light and shadow effect.
[0196] For details on the presentation of the fist icon, gesture movement animation, and lighting animation in step S1703a, please refer to [reference needed]. Figure 9 The electronic device 20 shown is presented with relevant information.
[0197] S1704. In response to the air release gesture, the second electronic device sends a Wi-Fi action frame to the first electronic device based on a Bluetooth broadcast message.
[0198] The Wi-Fi action frame can be used to establish a Wi-Fi connection between the first electronic device and the second electronic device.
[0199] Similarly, in some embodiments, since different Wi-Fi action frames may have different purposes, in order to facilitate the identification of Wi-Fi action frames with different purposes, the Wi-Fi action frames may also carry the aforementioned cross-end resource sharing service identifier.
[0200] S1705, The first electronic device establishes a connection with the second electronic device based on the Wi-Fi action frame.
[0201] It is understood that in this embodiment of the application, the broadcast message sent by the first electronic device and the connection established between the first electronic device and the second electronic device are implemented based on different communication protocols. In other embodiments, the broadcast message sent by the first electronic device and the connection established between the first electronic device and the second electronic device can also be implemented based on the same communication protocol, such as Wi-Fi.
[0202] It is also understandable that steps S1704 and S1705 are based on the example of the second electronic device first sending a Wi-Fi action frame to the first electronic device, and then the first electronic device establishing a connection with the second electronic device based on the Wi-Fi action frame. In other implementations, the second electronic device can directly establish a connection with the first electronic device in response to a gesture, that is, it is not necessary to send a Wi-Fi action frame to the first electronic device again, so step S1704 can be an optional step. Accordingly, S1705 is changed to: the first electronic device establishes a connection with the second electronic device based on an instruction message.
[0203] S1706, The first electronic device sends resources to the second electronic device based on the established connection. Correspondingly, the second electronic device receives resources from the first electronic device based on the established connection.
[0204] Optionally, the resource can be a resource included in the application interface presented by the first electronic device before executing step S1701, such as... Figure 7 Images of the scene shown, such as Figure 12 Screenshots of the scene shown.
[0205] In some embodiments, during the execution of step S1706, the first electronic device may also display a sending animation, and the second electronic device may also display a receiving animation. Optionally, the receiving animation can be generated based on preview data of the resources sent by the first electronic device to the second electronic device. This preview data can be a preview image as described in the above scenario; of course, the preview data can also be other types of data. In this implementation, in order for the second electronic device to display the receiving animation, the first electronic device also needs to perform the operation of generating preview data and sending the preview data to the second electronic device.
[0206] In this embodiment, as one possible implementation, such as Figure 18 As shown in (1), the first electronic device can perform the operation of generating preview data after step S1704, and then perform step S1705. Optionally, as Figure 18 As shown in (1), the connection establishment process in step S1705 may include establishing a physical connection and establishing a session connection. Next, after executing step S1705, the first electronic device may send preview data to the second electronic device, and then execute step S1706. Correspondingly, the second electronic device may execute step S1705 after executing step S1704. After executing step S1705, it may receive preview data, and then execute step S1706. Optionally, the first electronic device may also present the aforementioned live capsule during the execution of step S1706. Similarly, the second electronic device may also present the aforementioned live capsule during the execution of step S1706.
[0207] In the above implementation, after the second electronic device receives the air release gesture, it sends a Wi-Fi action frame (i.e., step S1704), while the first electronic device performs operations such as generating preview data, establishing a connection (i.e., step S1705), and sending preview data. Specifically, sending the Wi-Fi action frame to the first electronic device takes approximately 50 milliseconds (ms), generating the preview data takes approximately 510 ms, establishing the connection takes approximately 950 ms, and sending the preview data takes approximately 40 ms. Therefore, before receiving resources from the first electronic device, the second electronic device, such as... Figure 18 As shown in (1), the user-perceived latency is approximately 1.7 seconds (s). This latency is relatively long and is detrimental to the user experience.
[0208] Therefore, to address the aforementioned issue of user-perceived time delay, as another possible implementation, such as Figure 18 As shown in (2), the first electronic device can perform the operation of generating preview data during the execution of step S1701, such as when detecting the start gesture in the resource sending gesture, that is, perform the operation of generating preview data in advance. And / or, the second electronic device can also perform the process of establishing a connection with the first electronic device during the process of recognizing the air release gesture, that is, perform the operation of establishing a connection in advance. Figure 18 As shown in (2), the second electronic device can execute steps S1704 and S1705 upon receiving a fist gesture in a gesture release, i.e., upon detecting a start gesture in a resource receiving gesture, to establish a communication connection with the first electronic device. After executing step S1705, and when the second electronic device receives a palm gesture in a gesture release, the first electronic device can send preview data to the second electronic device, and then execute step S1706. Correspondingly, the second electronic device can execute the operation of receiving preview data based on the communication connection with the first electronic device after executing step S1705, and upon receiving a palm gesture in a gesture release, and then execute step S1706. Similarly, in this implementation, the first electronic device can also present the aforementioned live capsule during the execution of step S1706. Similarly, the second electronic device can also present the aforementioned live capsule during the execution of step S1706.
[0209] In this implementation, after receiving the air release gesture, the second electronic device only needs to perform the operation of sending preview data. Therefore, before the second electronic device receives the resources from the first electronic device, there is only a perceived delay in transmitting preview data, which can greatly reduce the perceived delay for users and improve the user experience.
[0210] Optionally, in this implementation, the operations of generating preview data in advance and establishing connections in advance can be used separately or simultaneously. However, regardless of which method is used, compared to the previous implementation, both can reduce the perceived latency for users and improve the user experience.
[0211] Understandably, regarding Figure 18 The descriptions of each step shown can be found here. Figure 17 The corresponding steps are described below.
[0212] For example, in combination Figure 6 The architecture shown and Figure 7 The scenario shown, where images are shared in a gallery application, is illustrated using electronic device 10 as the resource sender and electronic device 20 as the resource receiver. Figure 19This illustration shows a flowchart of yet another cross-device resource sharing method provided in an embodiment of this application. It is understood that, for ease of distinction, Figure 19 The Chinese military uses different serial numbers to represent modules with the same function in different electronic devices, such as AirShare Service 1, AirShare Service 2, etc. It can also be understood that User 1 and User 2 can be users of electronic device 10 and electronic device 20, respectively. Figure 19 As shown, the method includes the following steps:
[0213] S1901, the gallery application 1 in the electronic device 10 senses the interface 700.
[0214] Among them, interface 700, etc. Figure 7 The interface shown in (1) is shown in the middle.
[0215] S1902, Gallery Application 1 is connected to the sharing API of the sharing tool.
[0216] S1903, Gallery application 1 is registered to the remote sharing service 1 of electronic device 10.
[0217] In this case, Gallery Application 1 can perform the registration using the sharing API in step S1902.
[0218] It is understandable that steps S1901 to S1903 involve presenting a specific interface using the gallery application 1 (here, ). Figure 7 For example, steps S1902 to S1903 will only be executed when the interface 700 shown in (1) is displayed. In other words, when the gallery application 1 presents a non-specific interface, steps S1902 to S1903 may not be executed.
[0219] Based on steps S1901 to S1903, when the gallery application presents a certain interface, it performs the operation of registering with the AirShare service, that is, registering with the AirShare service in real time. This makes it easy for the gallery application to unregister from the AirShare service when it exits the presentation of the interface, so as to support cross-device sharing of resources in certain specific interfaces supported by the gallery application.
[0220] S1904. The remote sharing service 1 refreshes the registration status of the gallery application 1 in the recognition module 1.
[0221] Step S1904 can also be described as storing the registration event of the gallery application 1 to indicate that the gallery application 1 has registered with the AirShare service 1. Optionally, the registration event of the gallery application 1 can be stored in the AirShare service 1 or in the recognition module 1.
[0222] S1905, The recognition module 1 recognizes the palm and displays a palm icon.
[0223] For example, a hand icon can be like... Figure 7 The hand icon 702 shown in (2) is shown in the middle.
[0224] S1906. The remote sharing service 1 receives the event reported by the identification module 1 and generates at least one of the following: a motion effect to be sent and a sending motion effect.
[0225] This event can be used to notify the AirShare service 1 that a palm has been detected.
[0226] Based on step S1906, when a hand is detected, at least one of the following is generated: a motion effect to be sent and a motion effect to be sent. This data is prepared in advance, which makes it easier to play these motion effects in a timely manner and reduces the perceived latency for the user.
[0227] S1907, Recognition module 1 recognizes that the palm has become a fist.
[0228] In step S1907, the recognition module 1 can also report an event to the AirShare service 1. This event can be used to notify the AirShare service 1 that a palm has been recognized.
[0229] S1908, Remote sharing service 1 determines whether the gallery application 1 has been registered.
[0230] If not registered, proceed to steps S1909 to S1912. If already registered, proceed to step S1913.
[0231] S1909, Remote sharing service 1 reports information to screenshot application 1.
[0232] The reported information can be used to indicate that the gallery application 1 is not registered with the AirShare service 1. Optionally, the reported information can also be used to indicate whether the electronic device 10 has enabled cross-device resource sharing functionality.
[0233] S1910, Screenshot application 1 is integrated into the sharing API of the sharing tool.
[0234] S1911, Screenshot application 1 registers with AirShare service 1.
[0235] In this case, the screenshot application 1 can use the sharing API in step S1911 to perform the registration.
[0236] S1912. The remote sharing service 1 obtains and stores a uniform resource identifier (URI) from the screenshot application 1.
[0237] Here, the URI can be the URI of the resource to be shared by screenshot application 1, such as the URI of the screenshot generated by screenshot application 1, such as... Figure 12The URI in screenshot 1220 shown in the scenario is illustrated. Of course, in this embodiment of the application, the URI can also be implemented as other identifiers or information to facilitate the remote sharing service 1 in obtaining the resource to be shared.
[0238] It is understood that steps S1908 to S1911 are executed when the gallery application 1 is not registered with the air sharing service 1. In other embodiments, steps S1908 to S1911 can always be executed, that is, steps S1908 to S1911 can be executed regardless of whether the gallery application 1 is registered with the air sharing service 1. In this embodiment, the reporting information in step S1909 can also be used to indicate whether the gallery application 1 is registered with the air sharing service 1. Subsequently, the air sharing service 1 can determine where to obtain the URI based on whether the gallery application 1 has been registered. For example, if the air sharing service 1 determines that the gallery application 1 has been registered, the air sharing service 1 can execute step S1913. Conversely, if the air sharing service 1 determines that the gallery application 1 is not registered, the air sharing service 1 can execute step S1912.
[0239] S1913, Remote sharing service 1 obtains and stores the URI from gallery application 1.
[0240] Here, the URI can be the URI of the resource to be shared by Gallery Application 1. For example, in conjunction with step S1901, the URI can be as follows: Figure 7 The URI of image 701 shown in (1).
[0241] S1914, Remote sharing service 1 presents a pending animation to user 1.
[0242] For example, when the screenshot application 1 has registered with the AirShare service, the animation to be sent can be as follows: Figure 7 The animation to be sent shown in (3) is as follows. When the screenshot application 1 is not registered with the AirShare service, this animation can be as follows: Figure 12 The animation to be sent is shown in (3).
[0243] Optionally, before displaying the animation to be sent, the remote sharing service 1 can also display something like... Figure 7 The gesture movement animation shown in (4), or as shown in the middle (4), Figure 12 The gesture movement effects shown in (4) are examples of such effects.
[0244] S1915, AirShare service 1 obtains the Wi-Fi listening channel through the distributed architecture base 1, starts listening based on the Wi-Fi listening channel, and sends Bluetooth broadcast messages. Correspondingly, AirShare service 2 in electronic device 20 can receive Bluetooth broadcast messages based on the distributed architecture base 2.
[0245] The Wi-Fi listening channel can be used to listen for Wi-Fi action frames. For an introduction to this Bluetooth broadcast message, please refer to [link / reference needed]. Figure 17 The description in step S1704 is shown.
[0246] S1916. AirShare Service 2 stores Bluetooth broadcast messages and notifies Identification Module 2 that it has received Bluetooth broadcast messages.
[0247] Optionally, since electronic device 2 may receive multiple Bluetooth broadcast messages at the same time, that is, there may be multiple resource senders at the same time, AirShare service 2 stores the Bluetooth broadcast messages to facilitate subsequent determination of which resource sender the resource was received from.
[0248] S1917, Identification module 2 increases the frequency of identifying resource receiving gestures.
[0249] For an introduction on how the recognition module 2 increases the frequency of receiving gestures for recognition resources, please refer to the above description.
[0250] S1918, the recognition module 2 recognizes the fist and presents at least one of the fist icon and gesture movement animation through the air sharing service 2.
[0251] In this step, the fist icon can Figure 9 The fist icon 901 shown in (2) and the gesture movement animation can be as follows: Figure 9 The gesture movement animation shown in (1) is shown.
[0252] S1919, the recognition module 2 recognizes that the fist has turned into a palm, and presents light and shadow effects through the air sharing service 2.
[0253] The lighting and shadow effects can be referenced from the lighting and shadow effects described above.
[0254] S1920, AirShare Service 2 sends a Wi-Fi action frame to AirShare Service 1 through Distributed Architecture Base 2. Correspondingly, AirShare Service 1 receives the Wi-Fi action frame through Distributed Architecture Base 1.
[0255] Optionally, AirShare service 2 can immediately reply with a Wi-Fiaction frame after receiving a Bluetooth broadcast message, so as to quickly establish a connection with electronic device 10.
[0256] In some scenarios, the Wi-Fi action frame sent by AirShare Service 2 to AirShare Service 1 via the distributed architecture base 2 may fail to be sent. In order to ensure the probability of a successful reply, AirShare Service 2 can reply with a Wi-Fi action frame again after receiving the next Bluetooth broadcast message so as to establish a connection with the electronic device 10.
[0257] S1921. AirShare Service 1 and AirShare Service 2 establish a Wi-Fi connection.
[0258] S1922, AirShare Service 1 sends resources to AirShare Service 2 based on the URI of the Wi-Fi connection and storage. Correspondingly, AirShare Service 2 receives resources from AirShare Service 1.
[0259] Optional, combined Figure 11 The scene shown, Figure 19 The method shown may also include step S1923.
[0260] S1923, Remote sharing service 2 presents resources through gallery application 2.
[0261] S1924, Gallery Application 1 detects exit interface 700.
[0262] S1925, Gallery app 1 is deregistered from AirShare service 1.
[0263] Understandable, Figure 19 The process shown is based on the example of not establishing a connection in advance. Figure 17 The pre-established connection scheme shown also applies to, for Figure 17 The same applies to the presentation of the various animation effects shown. Figure 19 The process shown and Figure 17 The processes shown can be used interchangeably for reference. To avoid redundancy, for Figure 17 The solutions already described in the illustrated process, such as generating preview data in advance, are... Figure 19 The process shown will not be described further.
[0264] It is understood that the solution described in this application embodiment is based on a resource sharing scenario, and the solution provided in this application embodiment can be applied to various scenarios such as screen projection, cross-device copying, and cross-device collaboration.
[0265] The above primarily describes the solutions provided by the embodiments of this application from a methodological perspective. It is understood that, in order to achieve the above functions, the electronic device includes hardware structures and / or software modules corresponding to the execution of each function. Based on the units and algorithm steps of the various examples described in the embodiments disclosed in this application, the embodiments of this application can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed in hardware or by a computer driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the technical solutions of the embodiments of this application.
[0266] This application provides embodiments for dividing an electronic device into functional modules based on the above method examples. For example, each function can be divided into its own functional modules, or two or more functions can be integrated into a single processing unit. The integrated unit can be implemented in hardware or as a software functional module. It should be noted that the unit division in this application embodiment is illustrative and represents only one logical functional division; in actual implementation, other division methods may be used.
[0267] like Figure 20 The diagram shown is a structural schematic of an electronic device provided in an embodiment of this application. This electronic device 2000 can be used to implement the methods executed by the electronic devices described in the above method embodiments. For example, the electronic device 2000 may include a processing unit 2001, a communication unit 2002, and a display unit 2003.
[0268] As a possible example, taking electronic device 2000 as the first electronic device, the processing unit 2001 is used to support electronic device 2000 in performing... Figures 1 to 19 The first electronic device as described in any one of the following statements, the communication unit 2002, is used to support the electronic device 2000 in performing processing functions. Figures 1 to 19 The communication function of the first electronic device as described in any one of the following. The display unit 2003 is used to support the electronic device 2000 in performing... Figures 1 to 19 The display function of the first electronic device as described in any one of the following statements.
[0269] As another possible example, taking electronic device 2000 as a second electronic device, processing unit 2001 is used to support electronic device 2000 in performing... Figures 1 to 19 The second electronic device described in any one of the following statements has a processing function, and the communication unit 2002 is used to support the electronic device 2000 in performing [its functions]. Figures 1 to 19 The communication function of the second electronic device as described in any one of the following. Display unit 2003, for supporting the electronic device 2000 in performing... Figures 1 to 19The display function of the second electronic device as described in any one of the above.
[0270] Optional, Figure 20 The illustrated electronic device 2000 may also include a storage unit ( Figure 20 (not shown in the image), this storage unit stores a program or instruction. When the processing unit 2001 executes the program or instruction, it causes... Figure 20 The electronic device 2000 shown can perform the method described in the above-described method embodiments.
[0271] Figure 20 The technical effects of the electronic device 2000 shown can be referred to the technical effects described in the above method embodiments, and will not be repeated here. Figure 20 The processing unit 2001 involved in the illustrated electronic device 2000 can be implemented by a processor or processor-related circuit components, and can be a processor or processing module. The communication unit 2002 can be implemented by a transceiver or transceiver-related circuit components, and can be a transceiver or transceiver module. The display unit 2003 can be implemented by display screen-related components.
[0272] This application also provides a chip system, such as... Figure 21 As shown, the chip system includes at least one processor 2101 and at least one interface circuit 2102. The processor 2101 and the interface circuit 2102 are interconnected via lines. For example, the interface circuit 2102 can be used to receive signals from other devices. As another example, the interface circuit 2102 can be used to send signals to other devices (e.g., the processor 2101). Exemplarily, the interface circuit 2102 can read instructions stored in memory and send those instructions to the processor 2101. When the instructions are executed by the processor 2101, the electronic device can perform the various steps performed by the electronic device in the above embodiments. Of course, the chip system may also include other discrete devices, and this application embodiment does not specifically limit this.
[0273] Optionally, the chip system may contain one or more processors. These processors can be implemented in hardware or software. When implemented in hardware, the processor can be a logic circuit, an integrated circuit, etc. When implemented in software, the processor can be a general-purpose processor, implemented by reading software code stored in memory.
[0274] Optionally, the chip system may contain one or more memories. The memory may be integrated with the processor or disposed separately from it; this application does not limit this. For example, the memory may be a non-transient processor, such as a read-only memory (ROM), which may be integrated with the processor on the same chip or disposed separately on different chips. This application does not specifically limit the type of memory or the arrangement of the memory and processor.
[0275] For example, the chip system may be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on chip (SoC), a central processor unit (CPU), a network processor (NP), a digital signal processor (DSP), a micro controller unit (MCU), a programmable logic device (PLD), or other integrated chips.
[0276] It should be understood that each step in the above method embodiments can be completed by integrated logic circuits in the processor hardware or by instructions in software form. The method steps disclosed in the embodiments of this application can be directly manifested as being executed by a hardware processor, or being executed by a combination of hardware and software modules in the processor.
[0277] This application also provides a computer storage medium storing computer instructions, which, when executed on an electronic device, cause the electronic device to perform the methods described in the above-described method embodiments.
[0278] This application provides a computer program product, which includes a computer program or instructions that, when run on a computer, cause the computer to perform the methods described in the above-described method embodiments.
[0279] In addition, this application also provides an apparatus, which may specifically be a chip, component or module. The apparatus may include a connected processor and a memory. The memory is used to store computer execution instructions. When the apparatus is running, the processor can execute the computer execution instructions stored in the memory to cause the apparatus to perform the methods in the above-described method embodiments.
[0280] In this embodiment, the electronic device, computer storage medium, computer program product or chip are all used to execute the corresponding method provided above. Therefore, the beneficial effects that can be achieved can be referred to the beneficial effects of the corresponding method provided above, and will not be repeated here.
[0281] Through the above description of the embodiments, those skilled in the art will understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.
[0282] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. The embodiments can be combined with or referenced to each other without conflict. The apparatus embodiments described above are merely illustrative; for example, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another device, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.
[0283] The units described as separate components may or may not be physically separate. A component shown as a unit can be one or more physical units; that is, it can be located in one place or distributed in multiple different locations. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.
[0284] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.
[0285] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solutions of the embodiments of this application, in essence, or the parts that contribute to the prior art, or all or part of the technical solutions, can be embodied in the form of a software product. This software product is stored in a storage medium and includes several instructions to cause a device (which may be a microcontroller, chip, etc.) or processor to execute all or part of the steps of the methods of the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.
[0286] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.
Claims
1. A method for sharing resources across devices, characterized in that, Applied to a first electronic device having a display screen, the method includes: When displaying the first interface of the first application, in response to a detected resource sending gesture, an instruction message is sent to at least one electronic device, wherein the first interface displays first content, the resource sending gesture is used to instruct the first electronic device to share resources with other electronic devices, the resource sending gesture is a gesture that does not touch the display screen of the first electronic device, and the instruction message is used to instruct the first electronic device to share resources. Based on the communication connection with the second electronic device in the at least one electronic device, the first content is sent to the second electronic device.
2. The method according to claim 1, characterized in that, The method further includes: When displaying the second interface of the first application, in response to the detected resource sending gesture, the instruction message is sent to at least one electronic device, wherein the second interface is different from the first interface; Based on the communication connection with the second electronic device in the at least one electronic device, a screenshot of the second interface is sent to the second electronic device.
3. The method according to claim 1 or 2, characterized in that, The method further includes: When displaying the interface of the second application, in response to the detected resource sending gesture, the instruction message is sent to at least one electronic device, the second application being different from the first application; Based on the communication connection with the second electronic device in the at least one electronic device, a screenshot of the interface is sent to the second electronic device.
4. The method according to any one of claims 1-3, characterized in that, The step of sending the first content to the second electronic device based on the communication connection with the second electronic device in the at least one electronic device includes: Based on the communication connection with the second electronic device among the at least one electronic device, the first content is sent to the second electronic device, and based on the communication connection with the third electronic device among the at least one electronic device, the first content is sent to the third electronic device.
5. The method according to any one of claims 1-4, characterized in that, The step of sending the first content to the second electronic device based on the communication connection with the second electronic device in the at least one electronic device includes: Based on the instruction message, a communication connection is established with the second electronic device; The first content is sent to the second electronic device based on the communication connection.
6. The method according to claim 5, characterized in that, The resource sending gesture includes a start gesture and an end gesture. The start gesture indicates the beginning of the execution of the resource sending gesture, and the end gesture indicates the end of the execution of the resource sending gesture. Before sending the first content to the second electronic device based on the communication connection, the method further includes: Upon detecting the start gesture, preview data of the first content is generated; Based on the communication connection, preview data of the first content is sent to the second electronic device.
7. The method according to claim 6, characterized in that, The step of sending an indication message to at least one electronic device in response to a detected resource sending gesture includes: In response to detecting the start gesture and the end gesture, an instruction message is sent to the at least one electronic device.
8. The method according to claim 6 or 7, characterized in that, The method further includes: When the start gesture is detected, a gesture icon corresponding to the start gesture is displayed; Alternatively, when the end gesture is detected to have moved out of front of the first electronic device, a gesture movement animation is displayed, which includes an animation of light and shadow moving on the display screen.
9. The method according to claim 8, characterized in that, The direction in which the light and shadow move on the display screen is the same as the direction in which the ending gesture moves out in front of the first electronic device.
10. The method according to any one of claims 1-9, characterized in that, After detecting a resource sending gesture, the method further includes: Display a first animation to be sent, which includes at least one of a card generated based on the first content and light and shadow.
11. The method according to any one of claims 1-10, characterized in that, During the process of sending the first content to the second electronic device, the method further includes: Display sending animation, the sending animation including at least one of the preview data of the first content and light and shadow; And / or, display a target control, which is used to indicate the sending progress of the first content.
12. The method according to any one of claims 2-11, characterized in that, After detecting a resource sending gesture, the method further includes: Display a second animation effect to be sent, which includes at least one of the following: a screenshot of the second interface and light and shadow.
13. The method according to any one of claims 1-12, characterized in that, The first electronic device and the second electronic device are logged into different system accounts. Before sending the first content to the second electronic device, the method further includes: If the first electronic device and the second electronic device have not established a trust relationship, a reminder message is displayed. The reminder message is used to confirm with the user whether to send the first content to the second electronic device or whether to establish a trust relationship with the second electronic device. Alternatively, if the first electronic device and the second electronic device have established a trust relationship, no reminder message will be displayed. The reminder message is used to confirm with the user whether to send the first content to the second electronic device or whether to establish a trust relationship with the second electronic device.
14. The method according to claim 2 or 3, characterized in that, The first electronic device includes a remote sharing service, which provides an application registered with the remote sharing service in the first electronic device with the function of sharing the application's resources with other electronic devices. The first application is an application that has been registered with the AirShare service. The first interface of the first application is a preset interface that allows the use of the AirShare service, and the second interface of the first application is a preset interface that does not allow the use of the AirShare service; or, the second application is an application that has not been registered with the AirShare service.
15. The method according to any one of claims 1-14, characterized in that, The resource sending gesture includes a gesture that changes from a palm to a fist.
16. A method for sharing resources across devices, characterized in that, Applied to a second electronic device having a display screen, the method includes: Receive an indication message from a first electronic device, the indication message from the first electronic device indicating that the first electronic device is about to share resources; In response to an instruction message from the first electronic device and a detected resource receiving gesture, based on the communication connection with the first electronic device, first content is received from the first electronic device, wherein the resource receiving gesture is a gesture that does not touch the display screen of the second electronic device, and the first content is the content in the first interface of the first application displayed by the first electronic device.
17. The method according to claim 16, characterized in that, The method further includes: In response to the instruction message from the first electronic device and the detected resource receiving gesture, based on the communication connection with the first electronic device, a screenshot of a second interface from the first electronic device is received. The screenshot of the second interface is a screenshot of the second interface of the first application displayed on the first electronic device, and the second interface is different from the first interface.
18. The method according to claim 16 or 17, characterized in that, The method further includes: In response to the instruction message from the first electronic device and the detected resource receiving gesture, based on the communication connection with the first electronic device, a screenshot of the interface of the first electronic device is received, wherein the screenshot is a screenshot of the interface of a second application displayed by the first electronic device, and the second application is different from the first application.
19. The method according to any one of claims 16-18, characterized in that, Prior to receiving the first content from the first electronic device, the method further includes: Receive an instruction message from a third electronic device, the instruction message of which indicates that the third electronic device is about to share resources; In response to the instruction message from the first electronic device and the detected resource receiving gesture, based on the communication connection with the first electronic device, the first content received from the first electronic device includes: In response to the instruction message from the first electronic device, the instruction message from the third electronic device, and the detected resource receiving gesture, based on the communication connection with the first electronic device, first content is received from the first electronic device, wherein the system account logged in by the first electronic device and the second electronic device is the same; or, the system account logged in by the first electronic device and the second electronic device is different, and the first electronic device is an electronic device selected by the user.
20. The method according to any one of claims 16-19, characterized in that, Prior to receiving the first content from the first electronic device, the method further includes: If no instruction message is received from the first electronic device, the resource receiving gesture is detected at a first frequency; Upon receiving an instruction message from the first electronic device, the resource receiving gesture is detected at a second frequency, wherein the second frequency is higher than the first frequency.
21. The method according to any one of claims 16-20, characterized in that, The resource receiving gesture includes a start gesture and an end gesture. The start gesture indicates the start of the execution of the resource receiving gesture, and the end gesture indicates the end of the execution of the resource receiving gesture. Before receiving the first content from the first electronic device based on the communication connection with the first electronic device, the method further includes: In response to the detected start gesture, a communication connection is established with the first electronic device.
22. The method according to any one of claims 16-21, characterized in that, The resource receiving gesture includes a start gesture and an end gesture, wherein the start gesture indicates the beginning of the execution of the resource receiving gesture, and the end gesture indicates the end of the execution of the resource receiving gesture; the method further includes: When the start gesture is detected, a gesture icon corresponding to the start gesture is displayed; Alternatively, when the start gesture is detected moving in from in front of the second electronic device, a gesture movement animation is displayed, which includes an animation of light and shadow moving on the display screen.
23. The method according to claim 22, characterized in that, The direction in which the light and shadow move on the display screen is the same as the direction in which the start gesture moves in front of the second electronic device.
24. The method according to any one of claims 21-23, characterized in that, Before receiving the first content from the first electronic device, the method further includes: In response to the instruction message from the first electronic device, upon detecting the end gesture, preview data of the first content from the first electronic device is received based on the communication connection with the first electronic device.
25. The method according to claim 24, characterized in that, The method further includes: During the process of receiving the first content, a receiving animation is displayed, which includes at least one of the preview data of the first content and lighting effects.
26. The method according to any one of claims 16-25, characterized in that, The first electronic device and the second electronic device are logged into different system accounts. Before receiving the first content from the first electronic device, the method further includes: If the first electronic device and the second electronic device have not established a trust relationship, a reminder message is displayed. The reminder message is used to confirm with the user whether they have received first content from the first electronic device or whether they have established a trust relationship with the first electronic device. Alternatively, if the first electronic device and the second electronic device have established a trust relationship, no reminder message will be displayed. The reminder message is used to confirm with the user whether they have received the first content from the first electronic device or whether they have established a trust relationship with the first electronic device.
27. The method according to any one of claims 16-26, characterized in that, The resource receiving gestures include a gesture that changes from a clenched fist to a palm.
28. An electronic device, characterized in that, include: The electronic device includes a processor, a memory, a communication interface, and a display screen, wherein the memory, the display screen, and the communication interface are coupled to the processor, the communication interface is used to communicate with other devices, the memory is used to store program code including instructions, and the processor reads the instructions from the memory to cause the electronic device to perform the method as claimed in any one of claims 1-15, or to cause the electronic device to perform the method as claimed in any one of claims 16-27.
29. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes a computer program that, when run on an electronic device, causes the electronic device to perform the method as claimed in any one of claims 1-15, or causes the electronic device to perform the method as claimed in any one of claims 16-27.
30. A computer program product, characterized in that, The computer program product includes: a computer program or instructions that, when executed on a computer, cause the computer to perform the method as described in any one of claims 1-15, or cause the computer to perform the method as described in any one of claims 16-27.
31. A communication system, characterized in that, It includes a first electronic device and a second electronic device, the first electronic device being used to perform the method as described in any one of claims 1-15, and the second electronic device being used to perform the method as described in any one of claims 16-27.