Data communication methods between devices, electronic devices and readable storage media
By detecting user actions on the target device, determining device information, and controlling data communication between devices, the problem of data synchronization between unconnected devices is solved, and convenient screen synchronization is achieved.
Patent Information
- Application Number
- CN202211127899.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-08-20
- Publication Date
- 2026-11-17
- Estimated Expiration
- 2041-08-20
AI Technical Summary
When multiple electronic devices have not established a communication connection, how can data communication be achieved, especially in a conference scenario where users on different devices want to view each other's displays simultaneously, which presents an inconvenience in operation?
By detecting user actions within the screen display area of the target device, information about the first and second devices is determined, and data communication between them is controlled based on this information. This allows users to establish communication connections and achieve data synchronization through line drawing or window movement operations.
It improves the ease of operation for data communication between devices, allowing users to easily control the first device and the second device to communicate data on the target device, and solves the operational difficulties when users synchronize the display of images on different devices.
Smart Images

Figure CN115708059B_ABST
Abstract
Description
[0001] This application is a divisional application of Chinese patent application filed on August 20, 2021, with application number 202110966346.7 and title "Data Communication Method, Device and Readable Storage Medium between Devices". Technical Field
[0002] This application relates to the field of terminal technology, and in particular to a data communication method between devices, an electronic device, and a readable storage medium. Background Technology
[0003] With the rapid development of terminal technology, electronic devices such as tablets and mobile phones support increasingly rich functions. For example, multiple electronic devices A can be connected to the same electronic device B, and electronic device B can display the window display data of each of the multiple electronic devices A. For example, the screens of multiple mobile phones can be projected onto a tablet to facilitate information sharing among users.
[0004] In some scenarios, multiple electronic devices A may not have a communication connection, but there may be a need for data communication between them. For example, in a meeting scenario, mobile phone 1 and mobile phone 2 are projected onto a tablet computer, and the user of mobile phone 2 wants to view the display screen of mobile phone 1 on mobile phone 2. In this case, how to enable data communication between electronic devices A becomes a pressing problem to be solved. Summary of the Invention
[0005] This application provides a data communication method between devices, an electronic device, and a readable storage medium, which solves the problem in the prior art of how to enable data communication between electronic devices connected to the same electronic device.
[0006] To achieve the above objectives, this application adopts the following technical solution:
[0007] In a first aspect, a data communication method between devices is provided, applied to a target device, wherein the target device's screen display area includes at least a first display window and a second display window, the first display window and the second display window respectively displaying window display data of different devices, the method comprising:
[0008] The detection first operation determines the first device information of the first device corresponding to the first display window and the second device information of the second device corresponding to the second display window. The first operation includes moving the first display window to the display area of the second display window or drawing a line from the first display window to the end of the second display window.
[0009] Based on the first device information and the second device information, control the first device and the second device to conduct data communication, so that the window display data of the first device is displayed on the second device through the data communication.
[0010] In this embodiment, the screen display area of the target device includes at least a first display window and a second display window, which respectively display window display data of different devices. If a first operation is detected, it can be confirmed that the user wants to display the window display data of the first device in the first display window on the second device corresponding to the second display window. To this end, the first device information corresponding to the first display window and the second device information corresponding to the second display window are determined. Based on the first device information and the second device information, the first device and the second device are controlled to communicate data, so that the window display data of the first device can be displayed on the second device through this data communication. Thus, when both the first device and the second device are connected to the target device, the user can perform a first operation on the target device to make the target device control the first device to communicate data with the second device, so as to display the window display data of the first device on the second device, thereby improving the convenience of operation.
[0011] As an example of this application, the detection of the first operation includes:
[0012] The system detects that the first display window has been moved into the display area of the second display window and then released, provided that the overlap area between the first and second display windows is greater than an area threshold; or...
[0013] The detection process involves drawing a line with the first display window as the starting point, the endpoint of the line being located within the display area of the second display window, and the straight-line distance between the starting point and the endpoint being within a preset distance range.
[0014] This allows users to operate the first display window using different methods, facilitating the establishment of direct or indirect data communication connections between the first and second devices based on user actions, thereby displaying the window data from the first device on the second device. This increases the number of user operation methods.
[0015] As an example of this application, controlling data communication between the first device and the second device based on the first device information and the second device information includes:
[0016] Based on the second device information, a first instruction message carrying the first device information is sent to the second device, and a second instruction message is sent to the first device based on the first device information;
[0017] The first instruction message is used to instruct the second device to establish a communication connection with the first device based on the first device information, and the second instruction message is used to instruct the first device to send the window display data of the first device to the second device for display after establishing a communication connection with the second device.
[0018] In other words, the target device detects the first operation and instructs both the first and second devices to establish a communication connection, thereby enabling data communication between the devices. Thus, by operating on the target device to establish a direct communication connection between the first and second devices, this solves the problem in a meeting scenario where user A on the first device and user B on the second device are presenting their phones. User A's phone is displaying an interface, and user B wants to simultaneously view A's phone's interface on their own phone, but A and B are geographically distant (though this doesn't affect establishing a data communication connection), making face-to-face interaction inconvenient.
[0019] As an example of this application, controlling data communication between the first device and the second device based on the first device information and the second device information includes:
[0020] Based on the first device information, a third instruction message carrying the second device information is sent to the first device;
[0021] The third instruction message is used to instruct the first device to establish a communication connection with the second device based on the second device information, and to send the window display data of the first device to the second device for display after establishing a communication connection with the second device.
[0022] Thus, the target device detects the first operation and controls the establishment of a communication connection between the first device and the second device by sending a third instruction message to the first device, enabling data communication between the devices.
[0023] As an example of this application, controlling data communication between the first device and the second device based on the first device information and the second device information includes:
[0024] Based on the first device information and the second device information, the window display data of the first device is forwarded to the second device in real time.
[0025] The window display data of the first or second device is forwarded through the target device. There is no need to establish a direct data connection between the first and second devices. It is sufficient that the first and second devices are connected to the target device respectively, thereby reducing the interaction between the first and second devices.
[0026] As an example of this application, before controlling data communication between the first device and the second device based on the first device information and the second device information, the method further includes:
[0027] A query window is displayed, the query window including query information, the query information being used to indicate whether to confirm, based on the query window, whether to display the window display data of the first device in the second device;
[0028] The step of controlling data communication between the first device and the second device based on the first device information and the second device information includes:
[0029] Based on the confirmation command received through the query window, the operation of controlling data communication between the first device and the second device based on the first device information and the second device information is executed.
[0030] Thus, by displaying a prompt window on the first device to request the user of the first device to confirm whether they agree to control the first device to communicate with the second device, the user's consent is given, and the window displayed on the first device is displayed on the second device, thereby improving the user experience.
[0031] As an example of this application, after controlling data communication between the first device and the second device based on the first device information and the second device information, the method further includes:
[0032] If it is determined that the first device has successfully sent the window display data of the first device to the second device for display, the first display window is overlaid in the second display window.
[0033] In this way, the target device overlays the first display window in the second display window, which not only makes it convenient for other users to continue to view the display screen of the first device and / or the display screen of the second device in the target device, but also allows other users to know which two devices have communicated data and which device's display screen is displayed on which device's screen based on the overlay display effect.
[0034] As an example of this application, the method further includes:
[0035] Detect the first operation, obtain a snapshot of the first display window, and obtain the first snapshot;
[0036] The first snapshot is made transparent to obtain the second snapshot;
[0037] The second snapshot is displayed at the original position of the first display window, where the original position refers to the display position of the first display window before the first operation was performed.
[0038] In this way, by displaying the second snapshot in the original position of the first display window, users can easily and intuitively know which display window has been operated.
[0039] As an example of this application, after overlaying the first display window in the second display window, the method further includes:
[0040] The detection of the second operation controls the termination of data communication between the first device and the second device. The second operation includes moving the first display window out of the display area of the second display window and then releasing it, or drawing a line from the first display window to a specified area. The specified area does not include the area where the first display window is located and the area where the second display window is located.
[0041] Thus, during data communication between the first and second devices, if the user wants to disconnect the data communication, they can perform a second operation based on the target device's screen display area to drag the first display window corresponding to the first device out of the second display window corresponding to the second device. Correspondingly, upon detecting the second operation, the target device controls the first and second devices to terminate data communication. In other words, the user can directly operate on the target device to control the termination of data communication between the first and second devices.
[0042] As an example of this application, controlling the first device to terminate data communication with the second device includes:
[0043] A termination indication message is sent to the first device, the termination indication message being used to indicate the termination of sending the window display data of the first device to the second device.
[0044] In other words, the target device can control the termination of data communication between the first device and the second device by instructing the first device.
[0045] As an example of this application, after controlling the first device to terminate data communication with the second device, the method further includes:
[0046] If it is determined that the first device and the second device have terminated data communication, the first display window is restored to its original position, where the original position refers to the display position of the first display window before the first operation was performed.
[0047] In other words, when the first device and the second device terminate data communication, restoring the first display window to its original position preserves the display state before the data communication between the two devices. Thus, if multiple display windows exist within the screen display area, restoring the display in this manner allows users to quickly locate the first display window from among the other windows.
[0048] Secondly, a data communication method between devices is provided, applied to a first device, wherein the window display data of the first device is displayed in a first display window within a screen display area of a target device, and the screen display area of the target device further includes a second display window displaying the window display data of the second device. The method includes:
[0049] In response to a target indication message, a direct or indirect data communication connection is established with the second device, and the window display data of the first device is displayed on the second device through the data communication.
[0050] The target indication message includes an indication message sent by the target device after detecting the first operation, and / or an indication message sent by the target device to the second device after detecting the first operation. The first operation includes moving the first display window to the display area of the second display window or drawing a line from the first display window to the end of the second display window.
[0051] As an example of this application, the target indication message includes a second indication message and a request indication message from the second device for establishing a communication connection. The second indication message is used to instruct the first device to send the window display data of the first device to the second device for display after establishing a communication connection with the second device.
[0052] Specifically, after detecting the first operation, the target device sends a second instruction message to the first device and a first instruction message carrying information about the first device to the second device. The first instruction message instructs the second device to establish a communication connection with the first device based on the first device information. Upon receiving the first instruction message, the second device requests to establish a communication connection with the first device. Correspondingly, the first device establishes a communication connection with the second device according to the second device's request instruction message. Then, based on the second instruction message, the window display data of the first device is sent to the second device for display.
[0053] As another example of this application, the target indication message includes a third indication message carrying second device information, the third indication message being used to instruct the first device to establish a communication connection with the second device based on the second device information, and to send the window display data of the first device to the second device for display after establishing a communication connection with the second device.
[0054] As another example of this application, the target instruction message includes a fourth instruction message, which is sent by the second device after receiving an instruction from the target device. This fourth instruction message requests to establish a communication connection with the first device and requests that the window display data of the first device be sent to the second device. For example, after detecting the first operation, the target device sends its first device information to the second device and instructs the second device. Correspondingly, the second device sends the fourth instruction message to the first device.
[0055] In this embodiment of the application, establishing an indirect data communication connection between the first device and the second device means forwarding the window display data of the first device to the second device through the target device.
[0056] In this embodiment, if the target device detects the first operation, it can confirm that the user wants to display the window display data of the first device in the first display window on the second device corresponding to the second display window. To this end, the target device instructs the first device and the second device to establish a direct or indirect data communication connection, enabling the first device to display its window display data on the second device via data communication. Thus, when both the first and second devices are connected to the target device, the user can perform the first operation on the target device to control the first device to communicate with the second device, thereby displaying the window display data of the first device on the second device, improving operational convenience.
[0057] Thirdly, a data communication device between devices is provided, configured in a target device, wherein the target device's screen display area includes at least a first display window and a second display window, the first display window and the second display window respectively displaying window display data of different devices, the device comprising:
[0058] The detection module is used to detect a first operation and determine the first device information of the first device corresponding to the first display window and the second device information of the second device corresponding to the second display window. The first operation includes moving the first display window to the display area of the second display window or drawing a line from the first display window to the end of the second display window.
[0059] The control module is used to control data communication between the first device and the second device based on the first device information and the second device information, so that the window display data of the first device is displayed on the second device through the data communication.
[0060] As an example of this application, the detection module is used for:
[0061] The system detects that the first display window has been moved into the display area of the second display window and then released, provided that the overlap area between the first and second display windows is greater than an area threshold; or...
[0062] The detection process involves drawing a line with the first display window as the starting point, the endpoint of the line being located within the display area of the second display window, and the straight-line distance between the starting point and the endpoint being within a preset distance range.
[0063] As an example of this application, the control module is used for:
[0064] Based on the second device information, a first instruction message carrying the first device information is sent to the second device, and a second instruction message is sent to the first device based on the first device information;
[0065] The first instruction message is used to instruct the second device to establish a communication connection with the first device based on the first device information, and the second instruction message is used to instruct the first device to send the window display data of the first device to the second device for display after establishing a communication connection with the second device.
[0066] As an example of this application, the control module is used for:
[0067] Based on the first device information, a third instruction message carrying the second device information is sent to the first device;
[0068] The third instruction message is used to instruct the first device to establish a communication connection with the second device based on the second device information, and to send the window display data of the first device to the second device for display after establishing a communication connection with the second device.
[0069] As an example of this application, the control module is used for:
[0070] Based on the first device information and the second device information, the window display data of the first device is forwarded to the second device in real time.
[0071] As an example of this application, the control module is also used for:
[0072] A query window is displayed, the query window including query information, the query information being used to indicate whether to confirm, based on the query window, whether to display the window display data of the first device in the second device;
[0073] Based on the confirmation command received through the query window, the operation of controlling data communication between the first device and the second device based on the first device information and the second device information is executed.
[0074] As an example of this application, the control module is also used for:
[0075] If it is determined that the first device has successfully sent the window display data of the first device to the second device for display, the first display window is overlaid in the second display window.
[0076] As an example of this application, the detection module is also used for:
[0077] Detect the first operation, obtain a snapshot of the first display window, and obtain the first snapshot;
[0078] The first snapshot is made transparent to obtain the second snapshot;
[0079] The second snapshot is displayed at the original position of the first display window, where the original position refers to the display position of the first display window before the first operation was performed.
[0080] As an example of this application, the detection module is also used for:
[0081] The detection of the second operation controls the termination of data communication between the first device and the second device. The second operation includes moving the first display window out of the display area of the second display window and then releasing it, or drawing a line from the first display window to a specified area. The specified area does not include the area where the first display window is located and the area where the second display window is located.
[0082] As an example of this application, the control module is used for:
[0083] A termination indication message is sent to the first device, the termination indication message being used to indicate the termination of sending the window display data of the first device to the second device.
[0084] As an example of this application, the control module is also used for:
[0085] If it is determined that the first device and the second device have terminated data communication, the first display window is restored to its original position, where the original position refers to the display position of the first display window before the first operation was performed.
[0086] Fourthly, a data communication device between devices is provided, configured in a first device, wherein the window display data of the first device is displayed in a first display window within a screen display area of a target device, and the screen display area of the target device further includes a second display window displaying window display data of a second device, the device comprising:
[0087] A response module is used to respond to a target indication message, establish a direct or indirect data communication connection with the second device, and display the window display data of the first device on the second device through the data communication.
[0088] The target indication message includes an indication message sent by the target device after detecting the first operation, and / or an indication message sent by the target device to the second device after detecting the first operation. The first operation includes moving the first display window to the display area of the second display window or drawing a line from the first display window to the end of the second display window.
[0089] Fifthly, an electronic device is provided, including a touch screen, a memory, one or more processors, a plurality of applications, and one or more programs; wherein the one or more programs are stored in the memory; and the one or more processors, when executing the one or more programs, cause the electronic device to implement the method described in any one of the first aspects above, or to implement the method described in the second aspect above.
[0090] In a sixth aspect, a computer-readable storage medium is provided, wherein instructions are stored therein, which, when executed on a computer, cause the computer to perform the method described in any one of the first aspects, or to implement the method described in the second aspect.
[0091] In a seventh aspect, a computer program product comprising instructions is provided, which, when run on a computer, causes the computer to perform the method described in any one of the first aspects, or to implement the method described in the second aspect.
[0092] The technical effects achieved by the second, third, fourth, fifth, sixth, and seventh aspects mentioned above are similar to the technical effects achieved by the corresponding technical means in the first or second aspects mentioned above, and will not be repeated here. Attached Figure Description
[0093] Figure 1 A system architecture diagram of an electronic device 100 provided in this application embodiment;
[0094] Figure 2 A schematic diagram of the software architecture of an electronic device provided in an embodiment of this application;
[0095] Figure 3 This is a schematic diagram of the screen display area of a target device provided in an embodiment of this application;
[0096] Figure 4 This application provides an embodiment of an operation diagram based on the screen display area of a target device.
[0097] Figure 5 This is a schematic diagram of the interface display of a second device provided in an embodiment of this application;
[0098] Figure 6 This is a schematic diagram of the screen display area of a target device provided in an embodiment of this application;
[0099] Figure 7 A schematic diagram of the screen display area of another target device provided in an embodiment of this application;
[0100] Figure 8 A schematic diagram of the screen display area of another target device provided in an embodiment of this application;
[0101] Figure 9 A schematic diagram of the screen display area of another target device provided in an embodiment of this application;
[0102] Figure 10 A schematic diagram of the screen display area of another target device provided in an embodiment of this application;
[0103] Figure 11 This application provides an embodiment of an operation diagram based on the screen display area of a target device.
[0104] Figure 12 This application provides an embodiment of an operation diagram based on the screen display area of a target device.
[0105] Figure 13 This application provides an embodiment of an operation diagram based on the screen display area of a target device.
[0106] Figure 14 A schematic diagram of the screen display area of another target device provided in an embodiment of this application;
[0107] Figure 15A schematic diagram of the screen display area of another target device provided in an embodiment of this application;
[0108] Figure 16 A schematic diagram of the internal structure of another target device provided in an embodiment of this application;
[0109] Figure 17 A flowchart illustrating a data communication method between devices provided in an embodiment of this application;
[0110] Figure 18 This application provides an embodiment of an operation diagram based on the screen display area of a target device.
[0111] Figure 19 A flowchart illustrating a data communication method between devices provided in an embodiment of this application;
[0112] Figure 20 A flowchart illustrating a data communication method between devices provided in an embodiment of this application;
[0113] Figure 21 A flowchart illustrating a data communication method between devices provided in an embodiment of this application;
[0114] Figure 22 A flowchart illustrating a data communication method between devices provided in an embodiment of this application;
[0115] Figure 23 A flowchart illustrating a data communication method between devices provided in an embodiment of this application;
[0116] Figure 24 A flowchart illustrating a data communication method between devices provided in an embodiment of this application;
[0117] Figure 25 A schematic diagram of a device for data communication between devices provided in an embodiment of this application;
[0118] Figure 26 This is a schematic diagram of another device for data communication between devices provided in an embodiment of this application. Detailed Implementation
[0119] To make the objectives, technical solutions, and advantages of this application clearer, the embodiments of this application will be described in further detail below with reference to the accompanying drawings.
[0120] It should be understood that "multiple" as mentioned in this application refers to two or more. In the description of this application, unless otherwise stated, " / " indicates "or," for example, A / B can mean A or B; "and / or" in this document is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Furthermore, to facilitate a clear description of the technical solutions of this application, the terms "first," "second," etc., are used to distinguish identical or similar items with essentially the same function and effect. Those skilled in the art will understand that the terms "first," "second," etc., do not limit the quantity or execution order, and that "first," "second," etc., do not necessarily imply differences.
[0121] Before detailing the data communication method between devices provided in the embodiments of this application, the execution subject involved in the embodiments of this application will be introduced first. The method provided in the embodiments of this application can be executed by an electronic device. As an example of this application, the electronic device may include, but is not limited to, terminal devices, televisions, etc. Exemplarily, the terminal device may include, but is not limited to, mobile phones, tablet computers, augmented reality (AR) / virtual reality (VR) devices, laptops, ultra-mobile personal computers (UMPCs), netbooks, and personal digital assistants (PDAs).
[0122] Please see Figure 1 , Figure 1 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application.
[0123] Electronic device 100 may include processor 110, external memory interface 120, internal memory 121, universal serial bus (USB) interface 130, charging management module 140, power management module 141, battery 142, antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193, display screen 194, and subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
[0124] It is understood that the structures illustrated in the embodiments of the present invention do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0125] Processor 110 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.
[0126] The controller can be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to the instruction opcode and timing signals to complete the control of fetching and executing instructions.
[0127] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.
[0128] In some embodiments, the processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.
[0129] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple I2C buses. The processor 110 can couple to the touch sensor 180K, charger, flash, camera 193, etc., through different I2C bus interfaces. For example, the processor 110 can couple to the touch sensor 180K through the I2C interface, enabling the processor 110 and the touch sensor 180K to communicate through the I2C bus interface, thereby realizing the touch function of the electronic device 100.
[0130] The I2S interface can be used for audio communication. In some embodiments, the processor 110 may include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the I2S interface to enable the function of answering phone calls through a Bluetooth headset.
[0131] The PCM interface can also be used for audio communication, sampling, quantizing, and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via the PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface, enabling the function of answering phone calls through a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.
[0132] The UART interface is a universal serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial and parallel communication. In some embodiments, the UART interface is typically used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 via the UART interface to implement Bluetooth functionality. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the UART interface to enable music playback through Bluetooth headphones.
[0133] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI) and a display serial interface (DSI). In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to enable the electronic device 100 to capture images. The processor 110 and the display screen 194 communicate via the DSI interface to enable the electronic device 100 to display images.
[0134] The GPIO interface can be configured via software. It can be configured as a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to a camera 193, a display screen 194, a wireless communication module 160, an audio module 170, a sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.
[0135] USB port 130 is a USB standard compliant interface, specifically a Mini USB port, Micro USB port, USB Type-C port, etc. USB port 130 can be used to connect a charger to charge electronic device 100, and can also be used for data transfer between electronic device 100 and peripheral devices. It can also be used to connect headphones for audio playback. This interface can also be used to connect other electronic devices, such as AR devices.
[0136] It is understood that the interface connection relationships between the modules illustrated in the embodiments of the present invention are merely illustrative and do not constitute a structural limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.
[0137] The charging management module 140 receives charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 receives charging input from the wired charger via a USB interface 130. In some wireless charging embodiments, the charging management module 140 receives wireless charging input via the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also supply power to the electronic device 100 via the power management module 141.
[0138] The power management module 141 connects the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, providing power to the processor 110, internal memory 121, external memory, display screen 194, camera 193, and wireless communication module 160, etc. The power management module 141 can also monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage current, impedance). In some other embodiments, the power management module 141 may also be located within the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may be located in the same device.
[0139] The wireless communication function of electronic device 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.
[0140] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with tuning switches.
[0141] The mobile communication module 150 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1. In some embodiments, at least some functional modules of the mobile communication module 150 may be housed in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be housed in the same device.
[0142] The modem processor may include a modulator and a demodulator. The modulator modulates the low-frequency baseband signal to be transmitted into a mid-to-high frequency signal. The demodulator demodulates the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After processing by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs sound signals through an audio device (not limited to speaker 170A, receiver 170B, etc.) or displays images or videos through the display screen 194. In some embodiments, the modem processor may be a separate device. In other embodiments, the modem processor may be independent of the processor 110 and may be housed in the same device as the mobile communication module 150 or other functional modules.
[0143] The wireless communication module 160 can provide solutions for wireless communication applications on the electronic device 100, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.
[0144] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling electronic device 100 to communicate with networks and other devices via wireless communication technology. The wireless communication technology may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. The GNSS may include the Global Positioning System (GPS), the Global Navigation Satellite System (GLONASS), the BeiDou Navigation Satellite System (BDS), the Quasi-Zenith Satellite System (QZSS), and / or satellite-based augmentation systems (SBAS).
[0145] Electronic device 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.
[0146] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include one or N displays 194, where N is a positive integer greater than 1.
[0147] Electronic device 100 can perform shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.
[0148] The ISP (Image Signal Processor) is used to process data fed back from the camera 193. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, transforming it into an image visible to the naked eye. The ISP can also perform algorithmic optimization of image noise, brightness, and skin tone. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.
[0149] Camera 193 is used to capture still images or videos. An object is projected onto a photosensitive element by generating an optical image through the lens. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then passed to an ISP for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into image signals in standard RGB, YUV, or other formats. In some embodiments, the electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1.
[0150] Digital signal processors (DSPs) are used to process digital signals. Besides digital image signals, they can also process other digital signals. For example, when electronic device 100 selects a frequency, the DSP can perform Fourier transforms on the frequency energy.
[0151] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. Thus, electronic device 100 can play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.
[0152] An NPU (Neural Processing Unit) is a computational processor for neural networks (NNs). By borrowing the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it can rapidly process input information and continuously learn on its own. NPUs enable intelligent cognitive applications in electronic devices, such as image recognition, facial recognition, speech recognition, and text understanding.
[0153] The external storage interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, music, video, and other files can be saved on the external memory card.
[0154] Internal memory 121 can be used to store computer executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of electronic device 100 by running the instructions stored in internal memory 121. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.), etc. The data storage area may store data created during the use of electronic device 100 (such as audio data, phonebook, etc.). Furthermore, internal memory 121 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.
[0155] Electronic device 100 can implement audio functions, such as music playback and recording, through audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.
[0156] The audio module 170 is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. The audio module 170 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 170 may be located in the processor 110, or some functional modules of the audio module 170 may be located in the processor 110.
[0157] The speaker 170A, also known as a "loudspeaker," is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or make hands-free calls through the speaker 170A.
[0158] The receiver 170B, also known as the "earpiece," is used to convert audio electrical signals into sound signals. When the electronic device 100 answers a telephone call or voice message, the receiver 170B can be brought close to the ear to listen to the voice.
[0159] Microphone 170C, also known as a "microphone" or "voice transducer," is used to convert sound signals into electrical signals. When making a phone call or sending a voice message, the user can speak by bringing their mouth close to microphone 170C, inputting the sound signal into microphone 170C. Electronic device 100 may have at least one microphone 170C. In some embodiments, electronic device 100 may have two microphones 170C, which, in addition to collecting sound signals, can also perform noise reduction. In other embodiments, electronic device 100 may also have three, four, or more microphones 170C, which can collect sound signals, reduce noise, identify the sound source, and perform directional recording, etc.
[0160] The 170D headphone jack is used to connect wired headphones. The 170D headphone jack can be a USB 130 interface or a 3.5mm Open Mobile Terminal Platform (OMTP) standard interface, a CTIA (Cellular Telecommunications Industry Association of the USA) standard interface.
[0161] Pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In some embodiments, pressure sensor 180A can be disposed on display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors. A capacitive pressure sensor may include at least two parallel plates with conductive material. When force is applied to pressure sensor 180A, the capacitance between the electrodes changes. Electronic device 100 determines the pressure intensity based on the change in capacitance. When a touch operation is applied to display screen 194, electronic device 100 detects the intensity of the touch operation based on pressure sensor 180A. Electronic device 100 can also calculate the touch position based on the detection signal from pressure sensor 180A. In some embodiments, touch operations applied to the same touch position but with different touch operation intensities can correspond to different operation commands.
[0162] The gyroscope sensor 180B can be used to determine the motion attitude of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 about three axes (i.e., the x, y, and z axes) can be determined by the gyroscope sensor 180B. The gyroscope sensor 180B can be used for image stabilization.
[0163] The barometric pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device 100 calculates altitude using the air pressure value measured by the barometric pressure sensor 180C to assist in positioning and navigation.
[0164] The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip cover. In some embodiments, when the electronic device 100 is a flip phone, the electronic device 100 can detect the opening and closing of the flip cover based on the magnetic sensor 180D.
[0165] The accelerometer 180E can detect the magnitude of acceleration of electronic device 100 in various directions (generally three axes). When electronic device 100 is stationary, it can detect the magnitude and direction of gravity. It can also be used to identify the posture of electronic device 100, and can be applied to applications such as screen orientation switching and pedometers.
[0166] A distance sensor 180F is used to measure distance. Electronic device 100 can measure distance via infrared or laser. In some embodiments, during a shooting scene, electronic device 100 can utilize the distance sensor 180F to measure distance for rapid focusing.
[0167] The proximity sensor 180G may include, for example, a light-emitting diode (LED) and a light detector, such as a photodiode. The LED may be an infrared LED. The electronic device 100 emits infrared light outward through the LED. The electronic device 100 uses the photodiode to detect infrared reflected light from a nearby object. When sufficient reflected light is detected, it can be determined that an object is near the electronic device 100.
[0168] The ambient light sensor 180L is used to sense the brightness of ambient light. The electronic device 100 can adaptively adjust the brightness of the display screen 194 based on the sensed ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also work with the proximity sensor 180G to detect whether the electronic device 100 is in a pocket to prevent accidental touches.
[0169] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can utilize the characteristics of the collected fingerprints to achieve fingerprint unlocking, accessing application locks, taking photos with fingerprints, answering calls with fingerprints, etc.
[0170] Temperature sensor 180J is used to detect temperature. In some embodiments, electronic device 100 uses the temperature detected by temperature sensor 180J to execute a temperature processing strategy.
[0171] Touch sensor 180K, also known as a "touch panel," can be located on display screen 194. The touch sensor 180K and display screen 194 together form a touchscreen, also known as a "touch screen." Touch sensor 180K is used to detect touch operations applied to or near it. The touch sensor can then transmit the detected touch operation to the application processor to determine the type of touch event.
[0172] The bone conduction sensor 180M can acquire vibration signals. In some embodiments, the bone conduction sensor 180M can acquire vibration signals from vibrating bone fragments in the human vocal cords. The bone conduction sensor 180M can also contact the human pulse to receive blood pressure signals.
[0173] Buttons 190 include a power button, volume buttons, etc. Buttons 190 can be mechanical buttons or touch-sensitive buttons. Electronic device 100 can receive button input and generate key signal inputs related to user settings and function control of electronic device 100.
[0174] Motor 191 can generate vibration alerts. Motor 191 can be used for incoming call vibration alerts or for touch vibration feedback. For example, different vibration feedback effects can correspond to touch operations performed on different applications (such as taking photos, playing audio, etc.). Motor 191 can also correspond to different vibration feedback effects for touch operations performed on different areas of the display screen 194. Different application scenarios (such as time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also be customized.
[0175] Indicator 192 can be an indicator light, used to indicate charging status, power changes, or to indicate messages, missed calls, notifications, etc.
[0176] The SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to make contact with and separate from the electronic device 100. The electronic device 100 can support one or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. Multiple cards can be inserted into the same SIM card interface 195 simultaneously. The multiple cards can be of the same or different types. The SIM card interface 195 is also compatible with different types of SIM cards. The SIM card interface 195 is also compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to realize functions such as calls and data communication. In some embodiments, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.
[0177] The software system of device 100 can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This embodiment of the invention uses a layered Android system as an example to exemplify the software structure of device 100.
[0178] Figure 2 This is a software structure block diagram of the electrical device 100 according to an embodiment of this application.
[0179] A layered architecture divides software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer.
[0180] The application layer can include a series of application packages.
[0181] like Figure 2 As shown, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and SMS.
[0182] The application framework layer provides application programming interfaces (APIs) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.
[0183] like Figure 2 As shown, the application framework layer may include a window manager, content provider, view system, phone manager, resource manager, notification manager, etc.
[0184] The window manager is used to manage windowed applications. It can retrieve screen size, determine the presence of a status bar, lock the screen, and capture screenshots, among other things.
[0185] Content providers store and retrieve data, making that data accessible to applications. This data may include videos, images, audio, made and received phone calls, browsing history and bookmarks, phone books, etc.
[0186] A view system includes visual controls, such as controls for displaying text and controls for displaying images. View systems can be used to build applications. A display interface can consist of one or more views. For example, a display interface including a text notification icon could include views for displaying text and views for displaying images.
[0187] The phone manager is used to provide communication functions for device 100. For example, it manages call status (including connection, hang-up, etc.).
[0188] The file explorer provides applications with various resources, such as localized strings, icons, images, layout files, video files, and more.
[0189] The notification manager allows applications to display notifications in the status bar. These notifications can be used to convey informational messages and can disappear automatically after a short pause, requiring no user interaction. The notification manager can also display notifications as icons or scrolling text in the top status bar, such as notifications from background applications, or as dialog boxes on the screen. Examples include displaying text messages in the status bar, emitting alert sounds, vibrating devices, and flashing indicator lights.
[0190] The Android Runtime consists of core libraries and a virtual machine. The Android runtime is responsible for the scheduling and management of the Android system.
[0191] The core library consists of two parts: one part is the functionalities that need to be called by the Java language, and the other part is the Android core library.
[0192] The application layer and application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.
[0193] System libraries can include multiple functional modules. For example: surface manager, media libraries, 3D graphics processing libraries (e.g., OpenGL ES), 2D graphics engines (e.g., SGL), etc.
[0194] The Surface Manager is used to manage the display system and provides the blending of 2D and 3D layers for multiple applications.
[0195] The media library supports playback and recording of various common audio and video formats, as well as still image files. It supports multiple audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, and PNG.
[0196] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
[0197] A 2D graphics engine is a graphics engine for 2D drawing.
[0198] The kernel layer is the layer between hardware and software. The kernel layer contains at least the display driver, camera driver, audio driver, and sensor driver.
[0199] The application scenarios involved in the embodiments of this application will be introduced next.
[0200] Suppose that phone A and phone B are projected onto tablet C. Tablet C displays a first display window and a second display window in different locations on its screen. The first display window shows the screen of phone A, and the second display window shows the screen of phone B. For example, please refer to... Figure 3 , Figure 3 This is a schematic diagram illustrating an application scenario according to an exemplary embodiment, wherein the screen display area of the tablet computer C is as follows: Figure 3 The area shown in Figure 30 has a first display window as shown. Figure 3 As shown in 31, 31 displays the current screen of mobile phone A, and the second display window is as follows. Figure 3 As shown in 32, 32 displays the current screen of mobile phone B.
[0201] In one embodiment, to distinguish which display window is used to display the screen of phone A and which display window is used to display the screen of phone B, tablet computer C can use various methods to differentiate the display when displaying the first and second display windows. For example, tablet computer C can label the first display window with information about phone A and the second display window with information about phone B. This information may include, but is not limited to, at least one of the following: phone model, phone brand, and phone address information. Alternatively, tablet computer C can set the first and second display windows to different sizes. Furthermore, tablet computer C can set the first and second display windows to different shapes, etc.
[0202] As an example of this application, when a user of mobile phone B wants to view the display screen of mobile phone A on mobile phone B, they can operate on the screen display area of tablet computer C. In one embodiment, please refer to... Figure 4 , Figure 4 This is an operational schematic diagram according to an exemplary embodiment, showing a finger selecting a first display window on the screen display area, and then dragging the first display window to a second display window. In one embodiment, after the finger selects the first display window on the screen display area, the tablet computer C can display operation guidance information on the screen display area, such as... Figure 4 As shown, it displays indicator symbols such as arrows to guide user operations.
[0203] In one embodiment, in response to a drag operation on the first display window, if tablet C detects that the first display window has been dragged into the second display window and then released, it controls mobile phone A and mobile phone B to communicate data, so that mobile phone A sends the window display data corresponding to the current display screen to mobile phone B for display. Correspondingly, mobile phone B receives the window display data sent by mobile phone A and then displays the display screen of mobile phone A. As an example, mobile phone B can display a target display window within its own screen display area, and then display data of mobile phone A within the target display window based on the received window display data. The size of the target display window can be set according to actual needs. For example, please refer to... Figure 5 The display effect in phone B can be as follows Figure 5 As shown in Figure (a), the original display screen of phone B is replaced by a window on phone A displaying data; or it can be done as follows: Figure 5 As shown in Figure (b), the display window of phone A is shrunk, and only a portion of the display window of phone B is displayed. As another example, phone B can also close its initial display interface and then switch to displaying the display screen of phone A; this embodiment of the application does not limit this.
[0204] As an example of this application, after tablet C controls mobile phone A to conduct data communication with mobile phone B, if it is determined that mobile phone A has successfully sent the window display data to mobile phone B for display, for example, if tablet C receives a data communication success notification from mobile phone A and / or mobile phone B, then tablet C overlays the first display window onto the second display window. In implementation, since the size and / or shape of the first display window and the second display window are somewhat different, the size and / or shape of the first display window can be adjusted before overlaying the first display window onto the second display window, so that the first display window can be overlaid on the second display window.
[0205] In one embodiment, the tablet C overlays the first display window onto the second display window as shown in the following example. Figure 6 As shown. That is, the tablet computer C overlays the first display window onto the second display window, and continues to display the first display window in its original position, which refers to the display position of the first display window before it was dragged.
[0206] In another embodiment, the effect of tablet computer C overlaying the first display window onto the second display window is as follows: Figure 7 As shown. That is, after the tablet computer C overlays the first display window onto the second display window, it may also choose not to continue displaying the first display window in its original position.
[0207] As an example of this application, during the dragging of the first display window, the tablet computer C can set a display prompt for the first display window at its original position. For example, please refer to... Figure 8 The tablet C can display a semi-transparent snapshot of the first display window in its original position. If the first display window is detected as being dragged to the second display window and then released, the tablet C overlays the first display window onto the second display window and deletes the semi-transparent snapshot. The final display effect can be as follows: Figure 7 As shown. In one case, if it is detected that the dragging of the first display window is insufficient, that is, the first display window is released before it is fully dragged into the second display window, then the tablet C will re-display the first display window in the position of the semi-transparent snapshot in a bounce manner and delete the semi-transparent snapshot.
[0208] As an example of this application, before controlling data communication between mobile phone A and mobile phone B, tablet computer C may also display a prompt window to request the user's confirmation of whether to consent to data communication between mobile phone A and mobile phone B. For an example, please refer to... Figure 9 , Figure 9This is a schematic diagram illustrating an inquiry window display according to an exemplary embodiment. If a tablet computer C releases the first display window after detecting that it has been dragged to a second display window, the inquiry window pops up. The inquiry window includes inquiry information, exemplarily, "Establish a communication connection?". Additionally, the inquiry window includes a confirmation option and a cancellation option. The confirmation option triggers the tablet computer C to control data communication between mobile phone A and mobile phone B, and the cancellation option triggers the tablet computer C to cancel the data communication between mobile phone A and mobile phone B. Figure 9 As shown, the confirmation option is a "Yes" touch control, and the cancellation option is a "No" touch control. When the user agrees to display the screen of phone A on phone B, the "Yes" touch control can be triggered. In response to the user's triggering of the "Yes" touch control, tablet C controls data communication between phone A and phone B, so that the screen of phone A is displayed on phone B through this data communication. Conversely, when the user does not agree to display the screen of phone A on phone B, the "No" touch control can be triggered. In response to the user's triggering of the "No" touch control, tablet C cancels the data communication between phone A and phone B, that is, the screen of phone A is not displayed on phone B.
[0209] In another example, please refer to Figure 10 , Figure 10 This is a schematic diagram illustrating an inquiry window display according to another exemplary embodiment. Tablet C overlays a first display window onto a second display window, and displays a semi-transparent snapshot of the first display window in its original position. Additionally, tablet C pops up the inquiry window. If the user agrees to display the screen of phone A on phone B, a "Yes" touch control can be triggered. In response to the user's triggering of the "Yes" touch control, tablet C controls data communication between phone A and phone B, and the tablet continues to overlay the first display window onto the second display window. If the user does not agree to display the screen of phone A on phone B, a "No" touch control can be triggered. In response to the user's triggering of the "No" touch control, tablet C does not control data communication between phone A and phone B. Furthermore, the tablet restores the first display window to its original position, and the second display window continues to display the screen of phone B.
[0210] As an example rather than a limitation, based on Figure 10 The provided technical solution allows the first display window to be overlaid in the second display window. Before communication is established, the first display window can display a screenshot of the current display screen of mobile phone A. In other words, even if the display screen of mobile phone A is dynamic, before a connection is established, the content displayed in the first display window can be a screenshot of the moment when the first display window is dragged to the second display window.
[0211] As an example rather than a limitation, based on Figure 10 The provided technical solution allows the first display window to be overlaid on the second display window. Before communication is established, the first display window overlaid on the second display window can also be the current display screen of mobile phone A. For example, if the display screen of mobile phone A is dynamic, the content displayed in the first display window can change in real time as the display screen of mobile phone A changes before a connection is established.
[0212] As an example of this application, suppose a third display window is also displayed on tablet C, showing the screen of mobile phone D. Then, when it is detected that the user drags the first display window to the second display window, the second display window can be highlighted. For example, please refer to... Figure 11 The second display window is enlarged to distinguish it from the third display window 33, making it easier for users to know from the display effect that the first display window is currently located in the second display window.
[0213] based on Figure 6 or Figure 7 The technical solution provided will now be described, detailing the process by which tablet C controls mobile phones A and B to disconnect from data communication.
[0214] After phone A sends the window display data to phone B for display, tablet C overlays the first display window onto the second display window. Later, if the user wants to disconnect the data communication between phone A and phone B, they can drag the first display window out of the second display window. For an example, please refer to... Figure 12 , Figure 12 This is a schematic diagram illustrating a screen display area according to an exemplary embodiment. A user can select a first display window and then drag it out of a second display window. For example, please refer to... Figure 13 When the user selects the first display window, the tablet computer C can display operation guidance information in the screen display area, such as arrows or other indicator symbols, to guide the user on how to operate.
[0215] The user drags the first display window according to the operation guidance information, for example, dragging it back to its original position or to another position. In response to the user's dragging operation of the first display window, tablet C controls phone A to terminate data communication with phone B. In this case, phone A no longer sends window display data to phone B, and correspondingly, phone B no longer displays the display screen of phone A. As one example, phone B displays the main interface; as another example, phone B continues to display the screen before receiving window display data from phone A.
[0216] As an example of this application, when it is detected that the user drags the first display window out of the second display window, a disconnection prompt window may also be displayed before controlling mobile phone A to terminate data communication with mobile phone B. The disconnection prompt window is used to prompt the user to confirm whether they agree to disconnect the data communication between mobile phone A and mobile phone B. As an example, the disconnection prompt window includes a disconnection prompt message. In addition, the disconnection prompt window also includes a confirmation option and a cancellation option. The confirmation option is used to trigger tablet computer C to control mobile phone A to terminate data communication with mobile phone B, and the cancellation option is used to trigger tablet computer C to cancel the control of mobile phone A to terminate data communication with mobile phone B.
[0217] For example, please refer to Figure 14 , Figure 14 This is a schematic diagram of a disconnection prompt window according to an exemplary embodiment. The disconnection prompt window includes the disconnection prompt message "Disconnect communication connection?", with a "Yes" touch control for the confirmation option and a "No" touch control for the cancellation option. If the user confirms that the display screen of phone A will no longer be displayed on phone B, the "Yes" touch control is triggered. In response to the user's triggering operation of the "Yes" touch control, tablet computer C controls phone A to disconnect communication with phone B. If the user wants to continue displaying the display screen of phone A on phone B, they can trigger the "No" touch control. In response to the user's triggering operation of the "No" touch control, tablet computer C will not disconnect data communication between phone A and phone B.
[0218] As an example of this application, after tablet C controls mobile phone A and mobile phone B to terminate data communication, the first display window can be restored to its original position or the position where the user's dragging operation stopped. For example, please refer to [reference needed]. Figure 15 , Figure 15 This is a schematic diagram illustrating the screen display area of a tablet computer according to an exemplary embodiment.
[0219] It should be noted that the above description is based on the example of a user terminating data communication between mobile phone A and mobile phone B by dragging the first display window out of the second display window on the tablet C. In another embodiment, the user can also drag the second display window to separate it from the first display window, thereby enabling the tablet C to control mobile phone A and mobile phone B to terminate data communication.
[0220] It should also be noted that the above explanation uses the example of disconnecting data communication between mobile phone A and mobile phone B by triggering the action on tablet C. In another embodiment, the action can also be triggered on either mobile phone A or mobile phone B to disconnect the data communication between them. For example, taking the action on mobile phone B as an example, mobile phone B can provide a disconnect communication option. When the user no longer wants to display the screen of mobile phone A on mobile phone B, they can trigger the disconnect communication option. In response to the user's triggering of the disconnect communication option, mobile phone B will no longer display the screen of mobile phone A.
[0221] It should be noted that, in addition to tablets, other large-screen devices such as PCs and conference screens can also be used to display the windows of phone A and phone B.
[0222] The internal structure of the electronic device involved in the embodiments of this application will be described below. This is for illustrative purposes only and not as a limitation; please refer to [the relevant documentation]. Figure 16 , Figure 16 This is a schematic diagram illustrating the internal structure of an electronic device according to an exemplary embodiment. The electronic device includes a communication module, a control module, a storage module, and a user interface (UI) module.
[0223] As an example, the control module, upon receiving a connection establishment request from another electronic device, parses the request to extract data for establishing a communication connection. This data may include device information of the other electronic device, such as device address information, device name, and device ID. The parsed data is then transmitted to the communication module.
[0224] The communication module is used to control the electronic device to establish a communication connection with other electronic devices. For example, taking the above application scenario as an example, assuming that the electronic device is a tablet computer C and the other electronic devices include mobile phone A and mobile phone B, the communication module is used to control the tablet computer C to establish a communication connection with mobile phone A, and to control the tablet computer C to establish a communication connection with mobile phone B.
[0225] The caching module is used to store window display data received by the electronic device from other electronic devices.
[0226] The control module is also used to retrieve window display data from the cache module, and then hand the window display data over to the UI module.
[0227] The UI module is used to generate display windows and display the acquired window display data through these windows, such as displaying the display screens of other electronic devices in the screen display area of an electronic device. In one embodiment, when the cache module stores window display data of multiple other electronic devices, the UI module acquires the window display data of the multiple other electronic devices and displays the window display data of each other electronic device through a different display window.
[0228] As an example of this application, the control module is further configured to, after detecting a user's trigger operation on any display window displayed by the UI module, determine the end position of the trigger operation, so as to determine which two devices need to be controlled to communicate data based on the end position. As an example, after detecting that the first display window has been moved to and released from the second display window, the control module notifies the first device corresponding to the first display window to establish a communication connection with the second device corresponding to the second display window, and notifies the first device to send window display data to the second device through this communication connection, so as to display the display screen of the first device on the second device. As another example, after detecting that the first display window has been moved to and released from the second display window, the control module forwards the window display data of the first device to the second device, so that the display screen of the first device can be displayed on the second device.
[0229] As an example of this application, after the control module controls the first device and the second device to establish data communication, it can also notify the UI module so that the UI module can overlay the first display window onto the second display window, so that the user can know which devices have established data communication and the current display status of other electronic devices based on the screen display effect of the electronic device.
[0230] In one embodiment, when the UI module detects that a user has moved the first display window out of the second display window, the UI module controls the first display window to remain in its original position or at the position where the movement stopped, and continues to display the initial display screen in the second display window. Additionally, when the UI module detects a trigger operation that moves the first display window out of the second display window, it notifies the control module.
[0231] After receiving a notification from the UI module, the control module disconnects the communication between the two devices currently communicating. For example, it notifies the first device to disconnect from the second device. At this point, the first and second devices are disconnected, and the first device stops sending window display data to the second device. Alternatively, the electronic device stops forwarding the first device's window display data to the second device. It's easy to understand that the second device will then no longer display the first device's window display data.
[0232] In one embodiment, if the electronic device controls data communication between the first device and the second device by forwarding window display data from the first device, then in one possible implementation, the disconnection is triggered by another electronic device, such as a user on either the first or second device. In this case, the control module receives a disconnection request from the other electronic device; it is easy to understand that the disconnection request could be sent by the first device or by the second device. Subsequently, the control module stops forwarding the window display data from the first device to the second device, thereby disconnecting the data communication between the first and second devices.
[0233] The following section provides a detailed description of the data communication method between devices provided in the embodiments of this application, with reference to the accompanying drawings.
[0234] Please refer to Figure 17 , Figure 17 This is a schematic flowchart illustrating a method for data communication between devices according to an exemplary embodiment. The method can be applied to a target device, whose screen display area includes at least a first display window and a second display window. The first and second display windows respectively display window display data from different devices. The target device can be the aforementioned electronic device. The method may include some or all of the following:
[0235] Step 1701: Detect the first operation, determine the first device information of the first device corresponding to the first display window and the second device information of the second device corresponding to the second display window. The first operation includes moving the first display window into the second display window or drawing a line from the first display window to the end of the second display window.
[0236] Both the first device information and the second device information are device information capable of being used for data communication. As an example, the first device information may include, but is not limited to, one or more of the device ID, device name, and device address information of the first device. The second device information may include, but is not limited to, one or more of the device ID, device name, and device address information of the second device. For example, the device address information may be an Internet Protocol address (IP) or a Media Access Control (MAC) address.
[0237] Both the first and second display windows are operable windows; for example, both the first and second display windows can be floating windows.
[0238] As an example of this application, when the first device and the second device respectively establish communication connections with the target device, the first device projects its screen onto the target device, and the second device projects its screen onto the target device. Thus, the target device displays the window display data of the first device through a first display window, and the window display data of the second device through a second display window. That is, the user can simultaneously view the window display data of the first device and the window display data of the second device on the target device.
[0239] In one embodiment, the first display position of the first display window (i.e., the original position of the first display window) and the second display position of the second display window can be preset. For example, the first display position is located in a first designated area of the screen display area, and the second display position is located in a second designated area of the screen display area. The first and second designated areas can be set according to actual needs, and there is no overlapping area between the first and second designated areas. In another embodiment, the first display position of the first display window and the second display position of the second display window can also be randomly set.
[0240] It should be noted that the screen casting methods described in this application embodiment can be push screen casting or mirror screen casting. Taking the first device as an example, push screen casting by the first device means that the first device pushes resources in the form of streaming media. Under this screen casting method, after the first device completes the screen casting, the user can continue to perform other operations on the first device. Mirror screen casting by the first device means that the first device enables mirroring, and then the first device continuously records the screen while simultaneously sending the recorded screen data to the target device.
[0241] It should also be noted that the above description is based on screen mirroring. In another embodiment, the first device and the second device can also display the window display data on the screen display area of the target device in other ways. For example, taking the first device as an example, the first device can send some fields, parameters or content to the target device so that the target device can display the window display data of the first device based on these fields, parameters or content. This application embodiment does not limit this.
[0242] As an example of this application, the specific implementation of detecting the first operation includes: releasing the first display window after detecting that the first display window has been moved into the display area of the second display window, and the overlapping area of the first display window and the second display window is greater than the area threshold.
[0243] The area threshold can be set according to actual needs, and this application embodiment does not limit it.
[0244] As an example and not a limitation, moving the first display window into the second display window can include dragging the first display window into the second display window. That is, during this process, the first display window moves with the movement of the finger. When the target device detects that the first display window has been dragged while displaying the first and second display windows, it detects the drag endpoint of the first display window. If the drag endpoint is located within the display area of the second display window, it determines the overlap area between the first and second display windows. If this overlap area is greater than an area threshold, it indicates that the first and second display windows overlap significantly, for example, the first and second display windows almost completely overlap. In this case, it can be determined that the first display window has been dragged into the second display window and then released.
[0245] Optionally, the aforementioned dragging operation on the first display window can be triggered by a finger. That is, the user can click on the first display window on the screen, such as... Figure 4 As shown, the target device can display a movement direction guide image, such as an arrow or a finger illustration. Then, the user slides their finger across the screen, and the display window follows the finger's movement. After sliding into a second display window, the user releases their finger to drag the first display window into the second display window.
[0246] Optionally, the aforementioned dragging operation on the first display window can also be triggered by gestures. For example, as shown... Figure 18 As shown, a user can place their hand parallel to the first display window and hold it for a preset duration. If the target device detects this gesture using a sensor such as a camera, it determines that the user has selected the first display window. The target device can then notify the user that the first display window has been selected by highlighting it. After receiving this notification, the user can swipe their hand towards the second display window, holding it for the preset duration again when their hand is parallel to the second display window. The target device, detecting this gesture, determines that the user is dragging the first display window into the second display window. The preset duration can be set according to actual needs.
[0247] As another example of this application, the specific implementation of detecting the first operation includes: detecting a line-drawing operation with the first display window as the starting point of the line, the end point of the line being located within the display area of the second display window, and the straight-line distance between the starting point and the end point of the line being within a preset distance range.
[0248] The preset distance range can be set according to actual needs, and this application embodiment does not limit it.
[0249] As an example, and not a limitation, the line-drawing operation can be triggered by a finger. For instance, the finger slides from a first display window, and the point where the finger lands is within a second display window, while the first display window remains stationary during the operation. The display window does not move with the finger during the line draw. Optionally, the line drawn by the finger can be a straight line or a curve. For example... Figure 4 As shown, the finger draws a line in the direction of the arrow, starting from the first display window. For the target device, after detecting the finger's line drawing operation, if the finger's landing point is detected within the second display window and then released, the straight-line distance between the starting point and ending point of the line is determined. If this distance is within a preset distance range, then a line drawing operation from the first display window to the second display window is detected.
[0250] As an example, and not a limitation, the line-drawing operation can also be triggered by gestures. The target device can detect the user's gesture through sensing devices. For example, when it detects that the user places their hand parallel to the first display window and holds it for a preset duration, it determines the starting point of the line draw. The starting point can be a position within a first area on the display screen parallel to the plane where the hand is currently placed. The target device can prompt the user that the starting point of the line draw has been determined by highlighting the first display window, etc. After receiving the prompt from the target device, the user can swipe their hand, which has selected the first display window, towards the second display window. When the hand is parallel to the second display window, it holds it again for a preset duration. Correspondingly, after the target device detects this gesture from the user, it determines the ending point of the line draw. The ending point can be a position within a second area on the display screen parallel to the plane where the hand is currently placed. Then, it determines the distance between the starting point and the ending point of the line draw. If this distance is within a preset distance range, it is determined that a line draw operation from the first display window to the second display window has been detected.
[0251] It should be noted that the specific implementation of the first detection operation described above is merely exemplary. In another embodiment, the specific implementation of the first detection operation may further include: detecting a line drawing operation with the first display window as the starting point and the end point of the line drawing located within the display area of the second display window.
[0252] If the target device detects the first operation, it determines the first device information of the first device corresponding to the first display window, and the second device information of the second device corresponding to the second display window. This facilitates determining which device's window should display data on which device, and also facilitates subsequent control of data communication between the first and second devices.
[0253] Optionally, the target device detects the first operation, acquires a snapshot of the first display window, and obtains a first snapshot. The first snapshot is then made transparent to obtain a second snapshot. The second snapshot is displayed in the original position of the first display window, where the original position refers to the display position of the first display window before the first operation was performed.
[0254] As an example, when making the first snapshot transparent, a transparency threshold can be applied, which can be set according to actual needs. For instance, the first snapshot can be made semi-transparent.
[0255] That is, when the target device detects the first operation, before the first operation ends, a snapshot of the first display window can be displayed in the original position of the first display window to identify the original display position of the first display window.
[0256] Optionally, if the target device displays the second snapshot in the original position of the first display window, and if the target device detects that the first display window has not been dragged into the second display window and then released, the first display window will be displayed back in its original position in a bounce manner, and the target device will delete the second snapshot.
[0257] Optionally, in addition to the first and second display windows, the target device's screen display area may also include a third display window, which is used to display the window display data of the third device. In one embodiment, the second and third display windows may be relatively close. After the target device detects the first operation, when the first display window is located within the second display window or the end position of the line drawing operation is detected to be within the second display window, in order to distinguish it from the third display window, the target device may also highlight the second display window, for example, by enlarging the second display window, to indicate that the first display window has been moved to the second display window or the end position of the line drawing operation is located within the second display window, thereby facilitating the user's determination of whether to release the first display window.
[0258] Of course, the above description is based on the example that the target device's screen display area also includes a third display window. In another embodiment, the target device's screen display area may also include more display windows, and this application embodiment does not limit this.
[0259] As an example rather than a limitation, the shape, size, and other properties of the first display window remain unchanged as it is moved.
[0260] Taking a movement operation as an example, as an example of this application, the first device displays its own display screen on the target device, meaning the content displayed in the first display window is the same as the content currently displayed on the first device. In this case, the display screen of the first device may be dynamically changing, such as when a PowerPoint presentation is being played. As an example, while the first display window is being moved, the target device can continue to update the display screen in the first display window in real time according to the window display data sent by the first device; that is, the display screen in the first display window changes as the display screen on the first device changes. As another example, when a movement operation on the first display window is detected, the target device can also acquire a screenshot of the first device's display screen. Subsequently, while the first display window is being moved, the screenshot is displayed in the first display window; that is, the display screen in the first display window may also be a screenshot taken at the moment of movement, rather than being updated in real time.
[0261] Step 1702: Based on the first device information and the second device information, control the first device and the second device to conduct data communication, so that the window display data of the first device is displayed on the second device through data communication.
[0262] In one embodiment, a direct or indirect communication connection can be established between the first device and the second device based on the first device information and the second device information, so as to conduct data communication through the communication connection, thereby controlling the first device to send the window display data of the first device to the second device for display, so that the window display data of the first device is displayed on the second device.
[0263] In another embodiment, the target device can also forward the window display data of the first device to the second device in real time based on the first device information and the second device information, so that the window display data of the first device is displayed on the second device. That is, the target device can act as an intermediate forwarding device between the first device and the second device, thereby controlling the data communication between the first device and the second device.
[0264] As an example of this application, before controlling data communication between the first device and the second device based on the first device information and the second device information, the target device may also display a query window. The query window includes query information used to instruct whether to confirm whether to display the window display data of the first device on the second device. In this case, upon receiving a confirmation instruction based on the query window, the operation of controlling data communication between the first device and the second device based on the first device information and the second device information is executed.
[0265] In other words, if the target device detects the first operation, it means that the user may want the window display data of the first device to be displayed on the second device. In order to allow the user to confirm again, the target device can display a prompt window and display prompt information in the prompt window, such as "Please refer to..." Figure 9 The query message can be "Establish a communication connection?". Upon receiving a confirmation command, it indicates that the user has confirmed the establishment of communication. At this point, the target device, based on the first and second device information, controls the first and second devices to conduct data communication. Conversely, if the target device receives a cancellation command through the query window, it cancels the operation of controlling data communication between the first and second devices based on the first and second device information. Thus, by requesting user confirmation via the query window regarding their consent to control data communication between the first and second devices, the system ensures that the window display data from the first device is displayed on the second device when the user agrees, improving the user experience.
[0266] The above description uses the display of an inquiry window on the target device as an example. As another example of this application, before controlling data communication between the first and second devices based on the first device information and the second device information, the target device can also send inquiry information to the first device. After receiving the inquiry information, the first device can display an inquiry window containing the inquiry information. That is, the first device can also display an inquiry window to allow the user of the first device to confirm whether to display the window data of the first device on the second device. When the first device receives a confirmation instruction based on the inquiry window, it sends a confirmation control instruction to the target device. After receiving the confirmation control instruction, the target device executes the operation of controlling data communication between the first and second devices based on the first and second device information. Of course, if the first device receives a cancellation instruction based on the inquiry window, it sends a cancellation control instruction to the target device, causing the target device to cancel the operation of controlling data communication between the first and second devices based on the first and second device information.
[0267] Thus, by displaying a prompt window on the first device to request the user of the first device to confirm whether they agree to control the first device to communicate with the second device, the user's consent is given, and the window displayed on the first device is displayed on the second device, thereby improving the user experience.
[0268] As another example of this application, before controlling data communication between the first and second devices based on the first and second device information, the target device may send an inquiry message to the second device. After receiving the inquiry message, the second device may display an inquiry window containing the inquiry message. That is, the second device may also display the inquiry window to allow the user of the second device to confirm whether they agree to have the window display data of the first device displayed on the second device. When the second device receives a confirmation instruction based on the inquiry window, it sends a confirmation control instruction to the target device. After receiving the confirmation control instruction, the target device executes the operation of controlling data communication between the first and second devices based on the first and second device information. Of course, if the second device receives a cancellation instruction based on the inquiry window, it sends a cancellation control instruction to the target device, causing the target device to cancel the operation of controlling data communication between the first and second devices based on the first and second device information.
[0269] Thus, by displaying a prompt window on the second device to request confirmation from the user of the second device regarding whether they agree to control the data communication between the first and second devices, the user's consent is ensured to display the window data of the first device on the second device, thereby improving the user experience.
[0270] In this embodiment, the screen display area of the target device includes at least a first display window and a second display window, which respectively display window display data of different devices. If a first operation is detected, it can be confirmed that the user wants to display the window display data of the first device in the first display window on the second device corresponding to the second display window. To this end, the first device information corresponding to the first display window and the second device information corresponding to the second display window are determined. Based on the first device information and the second device information, the first device and the second device are controlled to communicate data, so that the window display data of the first device can be displayed on the second device through this data communication. Thus, when both the first device and the second device are connected to the target device, the user can perform a first operation on the target device to make the target device control the first device to communicate data with the second device, so as to display the window display data of the first device on the second device, thereby improving the convenience of operation.
[0271] In addition, users can make the first device communicate with the second device by dragging or by drawing lines, which increases the number of user operation methods and improves the user experience.
[0272] The following section uses the interaction between the first device, the second device, and the target device as an example to describe the data communication method flow between devices provided in this application embodiment. Please refer to... Figure 19 , Figure 19 This is a flowchart illustrating a data communication method between devices according to an exemplary embodiment. The method may include the following:
[0273] Step 1901: The first device projects its display screen onto the target device.
[0274] The first device projects its display screen onto the target device based on a communication connection established with the target device. In other words, a communication connection is established between the first device and the target device before the first device projects its display screen. For example, please refer to... Figure 20 In 2001, the first device can send its own device information to the target device to request the establishment of a communication connection with the target device. Correspondingly, after confirming the establishment of a communication connection with the first device, the target device sends its own device information to the first device to establish the communication connection.
[0275] In practice, the first device projects its screen onto the target device, sending the window display data from the first device to the target device, such as... Figure 20 As shown. After receiving the window display data from the first device, the target device displays the window display data from the first device through the first display window.
[0276] Step 1902: The second device projects its display screen onto the target device.
[0277] Similarly, the second device projects its display screen onto the target device based on the established communication connection with the target device. That is, a communication connection is established between the second device and the target device before the second device projects its display screen. For example, ... Figure 20 As shown in Figure 2002, the second device sends its second device information to the target device to request the establishment of a communication connection with the target device. Correspondingly, after confirming the establishment of a communication connection with the second device, the target device sends its device information to the second device to establish the communication connection.
[0278] In practice, the second device projects its screen onto the target device, sending the window display data from the second device to the target device, such as... Figure 20 As shown in 2003. After receiving the window display data from the second device, the target device displays the window display data from the second device through the second display window.
[0279] It should be noted that the above description uses screen mirroring as an example. In another embodiment, the first device and the second device can also display their own window display data on the target device in other ways. That is, in this embodiment, the screen display area of the target device includes at least a first display window and a second display window, and the first display window and the second display window respectively display window display data of different devices.
[0280] It should be noted that this explanation uses the example of the first device and the second device establishing communication connections with the target device respectively. In one embodiment, more devices can establish communication connections with the target device, such as... Figure 20 As shown, there are n devices that establish communication connections with the target device. In this case, the target device's screen display area can display n display windows, where n is an integer greater than or equal to 3.
[0281] It should be noted that there is no specific execution order between steps 1901 and 1902. Step 1901 can be executed before step 1902, after step 1902, or in parallel with step 1902.
[0282] Based on the scenarios provided in steps 1901 and 1902, the data communication process between devices will be described next.
[0283] Step 1903: Target device detection first operation, determine the first device information of the first device corresponding to the first display window and the second device information of the second device corresponding to the second display window.
[0284] For its specific implementation, please refer to the above. Figure 17 Step 1701 in the illustrated embodiment will not be described in detail here.
[0285] Step 1904: The target device sends a first instruction message carrying the first device information to the second device based on the second device information, and sends a second instruction message to the first device based on the first device information.
[0286] The first instruction message is used to instruct the second device to establish a communication connection with the first device based on the first device information. The second instruction message is used to instruct the first device to send the window display data of the first device to the second device for display after establishing a communication connection with the second device.
[0287] In implementation, the target device generates a first indication message, which carries first device information. Then, the target device determines the communication channel between itself and the second device based on the second device information, and then sends the generated first indication message to the second device through the communication channel between the target device and the second device, i.e., as shown below. Figure 20As shown in Figure 2004, the target device requests the second device to establish a communication connection with the first device. Additionally, the target device generates a second instruction message, determines the communication channel between the target device and the first device based on the first device information, and then sends the second instruction message to the first device through the communication channel between the target device and the first device.
[0288] It should be noted that there is no strict order of execution between the target device sending the first instruction message to the second device and sending the second instruction message to the first device. In one embodiment, the target device may send the first instruction message to the second device first, and then send the second instruction message to the first device. In another embodiment, the target device may also send the second instruction message to the first device first, and then send the first instruction message to the second device. In yet another embodiment, the target device may simultaneously send the first instruction message to the second device and the second instruction message to the first device. In yet another embodiment, the target device may first send the first instruction message to the second device, and then send the second instruction message to the first device upon receiving a successful communication establishment notification. The successful communication establishment notification is used to indicate that the first device and the second device have successfully established a communication connection, and the successful communication establishment notification may be sent by either the first device or the second device.
[0289] It should be noted that step 1904 above is an exemplary implementation of controlling data communication between the first device and the second device based on the first device information and the second device information.
[0290] Step 1905: The second device establishes a communication connection with the first device based on the information request from the first device.
[0291] After receiving the first instruction message sent by the target device, the second device parses the first instruction message to obtain the first device information from it. It also determines the purpose of the first instruction message, such as requesting to establish a direct communication connection with the first device based on the first device information. Then, the second device performs the corresponding operation according to the first instruction message.
[0292] For example, the first device information includes first MAC address information, the second device information includes second MAC address information, and the second device sends a connection establishment request to the first device based on the first MAC address information. The connection establishment request may carry the second MAC address information.
[0293] Step 1906: The first device establishes a communication connection with the second device.
[0294] In one embodiment, after receiving a connection establishment request from the second device, the first device parses the connection establishment request to extract the second device information. Then, the first device establishes a communication connection with the second device based on the second device information, such as... Figure 20 As shown in 2005.
[0295] As an example of this application, the first device and the second device may establish a communication connection through Bluetooth, wireless fidelity (WiFi), WLAN, wireless network, etc., and the embodiments of this application do not limit this.
[0296] It should be noted that the above description is based on the example where no communication connection has been established between the first device and the second device beforehand. In another embodiment, when a communication connection has been established between the first device and the second device, steps 1907 to 1908 can be executed directly.
[0297] Step 1907: The first device sends the window display data of the first device to the second device.
[0298] As mentioned above, since the target device sends a second instruction message to the first device, which instructs the first device to send its window display data to the second device after establishing a communication connection with the second device, the first device sends its window display data to the second device after successfully establishing a communication connection with the second device.
[0299] Step 1908: The second device displays the display screen of the first device based on the window display data of the first device.
[0300] In this way, the screen displayed on the first device can be displayed on the second device.
[0301] As an example of this application, the second device can display the display screen of the first device through a target display window, such as a floating window. That is, the second device continues to display its own display screen, and the first device's display screen is displayed on top of the second device's display screen through the target display window. Thus, the user can not only continue viewing the second device's display screen, but also view the first device's display screen on the second device. For example, assuming the second device was playing multimedia resources before displaying the first device's display screen, when the second device displays the first device's display screen, it can display the first device's display screen on top of the playing multimedia resource screen through the target display window. In this way, the user can not only continue watching the playing multimedia resource on the second device, but also view the first device's display screen on the second device.
[0302] As another example of this application, the second device can switch its display screen to that of the first device. That is, the second device can choose not to display its own display screen, but instead display the first device's display screen, in which case the user can only see the first device's display screen on the second device. For example, assuming the second device was playing multimedia resources before displaying the first device's display screen, the second device can close the currently displayed multimedia resources and switch to displaying the first device's display screen when it starts displaying the first device's display screen. This ensures that the first device's display screen is clearly displayed on the second device, making it easier for the user to view.
[0303] In one embodiment, a user can operate the display screen of the first device from the second device. In response to a user's trigger operation on the display screen of the first device from the second device, the second device generates a screen operation command based on the trigger operation. The second device sends the screen operation command to the first device, and the first device, in response to the screen operation command, executes the corresponding operation. For example, assuming a video is playing on the display screen of the first device, when the user wants to pause playback, they can trigger a pause option on the display screen of the first device from the second device. In response to the user's trigger operation on the pause option, the second device sends a pause playback instruction to the first device, and the first device, upon receiving the pause playback instruction, pauses playback of the video. Of course, playback of the video will also be paused simultaneously on the second device. Optionally, when a first display window is displayed on the target device, playback of the video is also paused on the target device within the first display window.
[0304] In this embodiment, the target device detects a first operation and obtains first device information corresponding to a first display window and second device information corresponding to a second display window. A first instruction message is generated based on the first device information. The target device sends the first instruction message to the second device based on the second device information, and also sends a second instruction message to the first device based on the first device information. This enables the second device to establish a communication connection with the first device based on the first instruction message, and after successfully establishing a communication connection, the first device sends its window display data to the second device for display. Thus, by detecting the first operation and sending the second instruction message to the first device and the first instruction message to the second device respectively, the target device controls the establishment of a communication connection between the first and second devices, thereby enabling data communication between the devices.
[0305] This implementation establishes a direct communication connection between the first device and the second device by operating on the target device. This solves the problem in a meeting scenario where user A on the first device and user B on the second device want to view the interface of user A's phone on their own phone while user A's phone is being displayed, but user B is far away from user A (but this does not affect the establishment of a data communication connection), making it inconvenient to operate face-to-face and connect their phones.
[0306] Please refer to Figure 21 , Figure 21 This is a flowchart illustrating a data communication method between devices according to another exemplary embodiment. The example described here is the interaction of multiple devices. The method may include the following:
[0307] Please refer to the above for steps 2101 to 2103. Figure 19 Steps 1901 to 1903 in the embodiment.
[0308] Step 2104: The target device sends a third instruction message carrying the second device information to the first device based on the first device information.
[0309] The third instruction message is used to instruct the first device to establish a communication connection with the second device based on the second device information, and to send the window display data of the first device to the second device for display after establishing a communication connection with the second device.
[0310] The target device generates a third instruction message based on the second device information and determines the communication channel between the target device and the first device based on the first device information. Then, the third instruction message is sent to the first device through the communication channel between the target device and the first device.
[0311] It should be noted that step 2104 above is another exemplary implementation of controlling data communication between the first device and the second device based on the first device information and the second device information.
[0312] Step 2105: The first device establishes a communication connection with the second device based on the information request from the second device.
[0313] After receiving the third instruction message, the first device parses it to extract the second device information and the purpose of the third instruction message. For example, the third instruction message might have two purposes: firstly, to instruct the first device to establish a communication connection with the second device; and secondly, to instruct the first device to send its window display data to the second device for display after successfully establishing the connection. Therefore, after parsing the third instruction message, the first device first requests to establish a communication connection with the second device. For instance, the first device can send a connection establishment request to the second device based on the second device information. The connection establishment request carries the first device's information.
[0314] Step 2106: The second device establishes a communication connection with the first device.
[0315] After receiving the connection establishment request sent by the first device, the second device parses the connection establishment request and extracts the first device information from it. Then, the second device establishes a communication connection with the first device based on the first device information.
[0316] Step 2107: The first device sends the window display data of the first device to the second device.
[0317] For its specific implementation, please refer to the above. Figure 19 Step 1907 in the illustrated embodiment.
[0318] Step 2108: The second device displays the window display data of the first device.
[0319] For its specific implementation, please refer to the above. Figure 19 Step 1908 in the illustrated embodiment.
[0320] In this embodiment, the target device detects a first operation and obtains first device information corresponding to a first display window and second device information corresponding to a second display window. A third instruction message is generated based on the second device information. The third instruction message is sent to the first device based on the first device information, enabling the first device to establish a communication connection with the second device. After successfully establishing the communication connection, the first device sends its window display data to the second device for display. Thus, by detecting the first operation and sending the third instruction message to the first device, the target device controls the establishment of a communication connection between the first and second devices, enabling data communication between the devices.
[0321] Please refer to Figure 22 , Figure 22 This is a flowchart illustrating a data communication method between devices according to another exemplary embodiment. The example described here is the interaction of multiple devices. The method may include the following:
[0322] Please refer to the above for steps 2201 to 2203. Figure 19 Steps 1901 to 1903 in the embodiment.
[0323] Step 2204: Based on the information of the first device and the information of the second device, the target device forwards the window display data of the first device to the second device in real time.
[0324] In implementation, the target device obtains window display data from the first device based on the first device information from the communication channel between the first device and the target device, and determines the communication channel between the target device and the second device based on the second device information, and sends the obtained window display data from the first device to the second device through the communication channel between the target device and the second device.
[0325] That is, in the embodiments of this application, the target device acts as an intermediate forwarding device between the first device and the second device, or it can be understood as the target device being a proxy of the first device, used to forward the window display data of the first device to the second device in real time.
[0326] It should be noted that step 2204 above is another exemplary implementation of controlling data communication between the first device and the second device based on the first device information and the second device information.
[0327] Step 2205: The second device displays the window display data of the first device.
[0328] For its specific implementation, please refer to Figure 19 Step 1908 in the embodiment will not be described in detail here.
[0329] In this embodiment, the target device detects a first operation and obtains first device information corresponding to the first display window and second device information corresponding to the second display window. Based on the first and second device information, the window display data of the first device is forwarded to the second device in real time. Thus, by detecting the first operation, the target device performs data forwarding, enabling rapid data communication between the devices. Since the window display data of either the first or second device is forwarded via the target device, a direct data connection between the first and second devices is not required; a connection between the first and second devices and the target device is sufficient. However, if the target device loses connection with either the first or second device, the window display data of the first device cannot be displayed on the second device.
[0330] It should be noted that the implementation method described above for controlling data communication between the first device and the second device based on the first device information and the second device information is merely exemplary. In another embodiment, it can also be implemented in other ways. For example, it may include, but is not limited to, the following methods:
[0331] In one example, the target device may also send the first device information to the second device based on the second device information, so as to instruct the second device to establish a communication connection with the first device based on the first device information, and instruct the second device to request the first device to send the window display data of the first device after successfully establishing a communication connection with the first device.
[0332] In one example, the target device can also send second device information to the first device based on the first device information, and send first device information to the second device based on the second device information, so as to establish a communication connection between the first device and the second device. Additionally, it can be instructed that after successfully establishing a communication connection with the second device, the first device sends its window display data to the second device for display, or that after successfully establishing a communication connection with the first device, the second device requests the first device to send and display its window display data.
[0333] As an example rather than a limitation, please refer to the following. Figure 23 , Figure 23 This is a schematic flowchart illustrating another data communication method between devices provided in this application embodiment. The method is described here using the example of multiple devices interacting. The method includes:
[0334] Steps 2301 to 2302 can be found above. Figures 17-22 Any of the embodiments shown in the examples will not be described again here.
[0335] Step 2303: If it is determined that the first device has successfully sent the window display data of the first device to the second device for display, the first display window is overlaid in the second display window.
[0336] In one embodiment, after receiving a data communication success notification from the first device and / or the second device, the target device determines that the first device has successfully sent its window display data to the second device for display. For example, after sending its window display data to the second device, the first device can send a data communication success notification to the target device, and the second device, after receiving the window display data, can also send a data communication success notification to the target device. As an example, after receiving a data communication success notification from either the first device or the second device, the target device determines that the first device has successfully sent its window display data to the second device for display. As another example, after receiving both a data communication success notification from the first device and a data communication success notification from the second device, the target device determines that the first device has successfully sent its window display data to the second device for display.
[0337] In one embodiment, if it is determined that the first device has successfully sent the window display data of the first device to the second device for display, the target device may adjust the size and / or shape of the first display window, for example, shrink the first display window, and adjust the shape of the first display window to be the same as the shape of the second display window, so as to overlay the first display window onto the second display window.
[0338] In this way, the target device overlays the first display window in the second display window, which not only makes it convenient for other users to continue to view the display screen of the first device and / or the display screen of the second device in the target device, but also allows other users to know which two devices have communicated data and which device's display screen is displayed on which device's screen based on the overlay display effect.
[0339] In one embodiment, if it is determined that the first device has successfully sent the window display data of the first device to the second device for display, in addition to overlaying the first display window in the second display window, the first display window continues to be displayed in its original position, such as... Figure 6 As shown. Therefore, since the first display window may be scaled down when overlaid on the second display window, its content may be reduced in size. Thus, continuing to display the first display window in its original position allows the user to continue seeing a clear view of the first device's screen.
[0340] In another embodiment, after determining that the first device has successfully sent its window display data to the second device for display, and after the first display window is overlaid in the second display window, the target device can delete the first display window from its original position; that is, the first display window will no longer be displayed separately within the target device's screen display area. Figure 7 As shown, this can save display space on the screen.
[0341] As an example of this application, based on the overlay display scheme of the display window, the target device can also perform the following operation steps.
[0342] Step 2304: The target device detects the second operation and controls the first device and the second device to terminate data communication. The second operation includes moving the first display window out of the second display window and then releasing it, or drawing a line from the first display window to a specified area. The specified area does not include the area where the first display window is located or the area where the second display window is located.
[0343] As an example, the target device detecting the second operation means that the target device detects that the user drags the first display window out of the second display window and then releases it. Specifically, the target device detects that the user drags the first display window and then releases it. If the overlap area between the first and second display windows is less than an area threshold, for example, if the overlap area between the first and second display windows is 0, then it can be determined that the first display window was dragged out of the second display window and then released.
[0344] It should be noted that the drag operation described here can be triggered by a finger or by a gesture. For details on the implementation, please refer to the above text, which will not be repeated here.
[0345] As another example, the target device detecting a second operation means that the target device detects that the user performs a line-drawing operation starting from the area where the first display window is located, and the endpoint of the line is located within a specified area. For example, if the target device detects that the user starts from the first display window and draws a line towards the original position of the first display window, and the endpoint of the line is located within the original display area of the first display window or in another area outside the second display window, and the straight-line distance between the starting point and the endpoint of the line is greater than a distance threshold, then it can be determined that a second operation has been detected.
[0346] It should be noted that the line drawing operation described here can be triggered by a finger or by a gesture. For details, please refer to the above text, which will not be repeated here.
[0347] As an example of this application, a specific implementation of controlling the termination of data communication between the first device and the second device may include: sending a termination indication message to the first device, the termination indication message being used to indicate the termination of sending window display data of the first device to the second device.
[0348] In one embodiment, the target device may instruct the first device to stop sending the first device's window display data to the second device without disconnecting the communication connection with the second device. In another embodiment, the target device may also instruct the first device to stop sending the first device's window display data to the second device and disconnect the communication connection with the second device.
[0349] It should be noted that the above-described implementation of terminating data communication between the first device and the second device is merely exemplary. In another embodiment, the target device may also instruct the second device to disconnect the communication connection with the first device, thereby terminating data communication between the first device and the second device.
[0350] In another embodiment, if the target device is an intermediate forwarding device between the first device and the second device, the specific implementation of controlling the first device and the second device to terminate data communication is that the target device stops forwarding the window display data of the first device to the second device in real time, that is, the target device no longer forwards the window display data of the first device to the second device.
[0351] As an example of this application, after the target device terminates data communication between the first device and the second device, it may also perform the following operations.
[0352] Step 2305: When the target device determines that the data communication between the first device and the second device has been terminated, it restores the first display window to its original position.
[0353] As an example of this application, the target device receives a data communication termination notification sent by the first device and / or the second device, and determines that the first device and the second device have terminated data communication. For example, after the first device stops sending its window display data to the second device, it sends a data communication termination notification to the target device; similarly, after the second device stops displaying the first device's window display data, it can also send a data communication termination notification to the target device. As an example, the target device determines that the first device and the second device have terminated data communication after receiving a data communication termination notification sent by either the first device or the second device. As another example, the target device determines that the first device and the second device have terminated data communication after receiving both a data communication termination notification sent by the first device and a data communication termination notification sent by the second device.
[0354] When the target device determines that the data communication between the first device and the second device has ended, it will no longer overlay the first display window onto the second display window. Instead, it will restore the first display window to its original position. In other words, the target device's display interface will revert to its state before the data communication between the first and second devices ceased, for example, to a state where... Figure 15 The display effect shown.
[0355] It is worth mentioning that, after confirming that the first device has successfully sent the window display data of the first device to the second device for display, the first display window is overlaid in the second display window, so that other users can continue to view the display screen of the first device on the target device. In addition, it can make other users aware that the display screen of the first device is displayed on the second device, that is, it can make other users aware of the connection status between the first device and the second device.
[0356] It should be noted that the above description uses the example of restoring the first display window to its original position when the target device determines that the data communication between the first and second devices has been terminated. In another embodiment, when it is determined that the data communication between the first and second devices has been terminated, the first display window can also be displayed at the position where the drag stops or at the end of the line.
[0357] For ease of understanding, as an example, the following is based on Figure 24 A brief introduction to the interaction process between the target device, the first device, and the second device is given.
[0358] 2401: The target device detection first display window is dragged to the second display window and then released.
[0359] 2402: The target device displays an inquiry window.
[0360] 2403: The target device requests confirmation via the query window whether it agrees to the establishment of a data communication connection between the first device and the second device.
[0361] If a confirmation instruction is received based on the inquiry window, it means the user agrees to establish a data communication connection between the first device and the second device, and the process proceeds to step 2404. Otherwise, if a cancellation instruction is received based on the inquiry window, it means the user does not agree to establish a data communication connection between the first device and the second device, and the data communication is cancelled.
[0362] 2404: The target device controls the first device and the second device to communicate data.
[0363] In one embodiment, the target device controls the first device to establish a communication connection with the second device so as to facilitate data communication through the communication connection.
[0364] 2405: The first device establishes a communication connection with the second device.
[0365] 2406: The first device sends the window display data of the first device to the second device for display.
[0366] 2407: Feedback from the first device and / or the second device to the target device.
[0367] The purpose of this feedback is to notify the target device that data communication has been achieved. For example, the first or second device sends a notification of successful data communication to the target device.
[0368] 2408: The target device displays the first display window in the second display window.
[0369] It should be noted that in the above implementation process, if the target device receives a cancellation command based on the query window, it indicates that the user does not agree to display the screen data of the first device on the second device, and the target device cancels data communication. In practice, the target device restores the first display window to its original position, and the target device does not control the first device to conduct data communication with the second device.
[0370] It should be understood that the sequence number of each step in the above embodiments does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.
[0371] Corresponding to the data communication method between devices described in the above embodiments, Figure 25 This is a structural block diagram of a data communication device between devices provided in an embodiment of this application, configured in the aforementioned target device. For ease of explanation, only the parts related to the embodiment of this application are shown.
[0372] Reference Figure 25 The device includes:
[0373] The detection module 2510 is used to detect a first operation and determine the first device information of the first device corresponding to the first display window and the second device information of the second device corresponding to the second display window. The first operation includes moving the first display window to the display area of the second display window or drawing a line from the first display window to the end of the second display window.
[0374] The control module 2520 is used to control data communication between the first device and the second device based on the first device information and the second device information, so that the window display data of the first device is displayed on the second device through the data communication.
[0375] As an example of this application, the detection module 2510 is used for:
[0376] The system detects that the first display window has been moved into the display area of the second display window and then released, provided that the overlap area between the first and second display windows is greater than an area threshold; or...
[0377] The detection process involves drawing a line with the first display window as the starting point, the endpoint of the line being located within the display area of the second display window, and the straight-line distance between the starting point and the endpoint being within a preset distance range.
[0378] As an example of this application, the control module 2520 is used for:
[0379] Based on the second device information, a first instruction message carrying the first device information is sent to the second device, and a second instruction message is sent to the first device based on the first device information;
[0380] The first instruction message is used to instruct the second device to establish a communication connection with the first device based on the first device information, and the second instruction message is used to instruct the first device to send the window display data of the first device to the second device for display after establishing a communication connection with the second device.
[0381] As an example of this application, the control module 2520 is used for:
[0382] Based on the first device information, a third instruction message carrying the second device information is sent to the first device;
[0383] The third instruction message is used to instruct the first device to establish a communication connection with the second device based on the second device information, and to send the window display data of the first device to the second device for display after establishing a communication connection with the second device.
[0384] As an example of this application, the control module 2520 is used for:
[0385] Based on the first device information and the second device information, the window display data of the first device is forwarded to the second device in real time.
[0386] As an example of this application, the control module 2520 is further configured to:
[0387] A query window is displayed, the query window including query information, the query information being used to indicate whether to confirm, based on the query window, whether to display the window display data of the first device in the second device;
[0388] Based on the confirmation command received through the query window, the operation of controlling data communication between the first device and the second device based on the first device information and the second device information is executed.
[0389] As an example of this application, the control module 2520 is further configured to:
[0390] If it is determined that the first device has successfully sent the window display data of the first device to the second device for display, the first display window is overlaid in the second display window.
[0391] As an example of this application, the detection module 2510 is further configured to:
[0392] Detect the first operation, obtain a snapshot of the first display window, and obtain the first snapshot;
[0393] The first snapshot is made transparent to obtain the second snapshot;
[0394] The second snapshot is displayed at the original position of the first display window, where the original position refers to the display position of the first display window before the first operation was performed.
[0395] As an example of this application, the detection module 2510 is further configured to:
[0396] The detection of the second operation controls the termination of data communication between the first device and the second device. The second operation includes moving the first display window out of the display area of the second display window and then releasing it, or drawing a line from the first display window to a specified area. The specified area does not include the area where the first display window is located and the area where the second display window is located.
[0397] As an example of this application, the control module 2520 is used for:
[0398] A termination indication message is sent to the first device, the termination indication message being used to indicate the termination of sending the window display data of the first device to the second device.
[0399] As an example of this application, the control module 2520 is further configured to:
[0400] If it is determined that the first device and the second device have terminated data communication, the first display window is restored to its original position, where the original position refers to the display position of the first display window before the first operation was performed.
[0401] In this embodiment, if a first operation is detected, it can be confirmed that the user wants to display the window display data of the first device in the first display window on the second device corresponding to the second display window. To this end, the information of the first device corresponding to the first display window and the information of the second device corresponding to the second display window are determined. Based on the first and second device information, the first and second devices are controlled to communicate data, so that the window display data of the first device can be displayed on the second device. Thus, when both the first and second devices are connected to the target device, the user can perform the first operation on the target device, causing the target device to control the first and second devices to communicate data, thereby displaying the window display data of the first device on the second device, improving operational convenience.
[0402] Figure 26 This is a structural block diagram of a data communication device between devices provided in an embodiment of this application, configured in the first device described above. For ease of explanation, only the parts related to the embodiment of this application are shown.
[0403] Please refer to Figure 26 The device includes:
[0404] The response module 2610 is used to respond to the target indication message, establish a direct or indirect data communication connection with the second device, and display the window display data of the first device on the second device through the data communication.
[0405] The target indication message includes an indication message sent by the target device after detecting the first operation, and / or an indication message sent by the target device to the second device after detecting the first operation. The first operation includes moving the first display window to the display area of the second display window or drawing a line from the first display window to the end of the second display window.
[0406] In this embodiment, if the target device detects the first operation, it can confirm that the user wants to display the window display data of the first device in the first display window on the second device corresponding to the second display window. To this end, the target device instructs the first device and the second device to establish a direct or indirect data communication connection, enabling the first device to display its window display data on the second device via data communication. Thus, when both the first and second devices are connected to the target device, the user can perform the first operation on the target device to control the first device to communicate with the second device, thereby displaying the window display data of the first device on the second device, improving operational convenience.
[0407] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the above-described division of functional units and modules is merely an example. In practical applications, the above functions can be assigned to different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit. Furthermore, the specific names of the functional units and modules are only for easy differentiation and are not intended to limit the scope of protection of this application. The specific working process of the units and modules in the above system can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.
[0408] In the above embodiments, the descriptions of each embodiment have different focuses. For parts that are not described in detail or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.
[0409] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electrical hardware, or a combination of computer software and electrical hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.
[0410] In the embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the system embodiments described above are merely illustrative. For instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection between devices or units through some interfaces, and may be electrical, mechanical, or other forms.
[0411] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.
[0412] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.
[0413] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments of this application can be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed by a processor, it can implement the steps of the various method embodiments described above. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or certain intermediate forms. The computer-readable medium can include at least: any entity or device capable of carrying computer program code to an electronic device, a recording medium, a computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signals, telecommunication signals, and software distribution media. Examples include USB flash drives, portable hard drives, magnetic disks, or optical disks. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electrical carrier signals or telecommunication signals.
[0414] Finally, it should be noted that the above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.
Claims
1. A method of data communication between devices, characterized by, The method is applied to a first device, wherein the window display data of the first device is displayed in a first display window within a screen display area of a target device, and the screen display area of the target device further includes a second display window displaying the window display data of the second device. Receive target indication message; In response to the target indication message, a data communication channel is established with the second device, and the window display data of the first device is displayed on the second device through the data communication channel; The target indication message includes an indication message sent by the target device after detecting the first operation, and / or an indication message sent by the target device to the second device after detecting the first operation; the first operation includes moving the first display window to the display area of the second display window or drawing a line from the first display window to the second display window.
2. The method according to claim 1, characterized in that, The first operation includes dragging the first display window into the display area of the second display window and then releasing it, wherein the overlapping area of the first display window and the second display window is greater than an area threshold; or, The first operation includes a line-drawing operation with the first display window as the starting point, the end point of the line being located within the display area of the second display window, and the straight-line distance between the starting point and the end point of the line being within a preset distance range.
3. The method according to claim 1 or 2, characterized in that, The target indication message includes an indication message sent by the target device after detecting the first operation, and the target indication message includes second device information of the second device; The step of responding to the target indication message and establishing a data communication channel with the second device, and displaying the window display data of the first device on the second device through the data communication channel, includes: In response to the target indication message, based on the second device information, a connection establishment request is sent to the second device, the connection establishment request being used to request the establishment of the data communication channel with the second device; If the data communication channel is successfully established with the second device, the window display data of the first device is sent to the second device for display.
4. The method according to claim 1 or 2, characterized in that, After detecting the first operation, the target device instructs the second device to send an instruction message, the target instruction message including the second device information; The step of responding to the target indication message and establishing a data communication channel with the second device, and displaying the window display data of the first device on the second device through the data communication channel, includes: In response to the target indication message, a data communication channel is established with the second device; If the data communication channel is successfully established with the second device, the window display data of the first device is sent to the second device for display.
5. The method according to any one of claims 1-4, characterized in that, After establishing a data communication channel with the second device in response to the target indication message, and displaying the window display data of the first device on the second device through the data communication channel, the method further includes: Receive termination instruction message; In response to the termination indication message, the transmission of window display data of the first device to the second device is terminated; The termination instruction message is sent by the target device to the first device after detecting the second operation; the second operation includes moving the first display window out of the display area of the second display window and then releasing it, or drawing a line from the first display window to a specified area, wherein the specified area does not include the area where the first display window is located and the area where the second display window is located.
6. The method of claim 5, wherein, The step of terminating the transmission of window display data of the first device to the second device in response to the termination indication message includes: In response to the termination instruction message, the transmission of window display data of the first device to the second device via the data communication channel is stopped.
7. The method of claim 5, wherein, The step of terminating the transmission of window display data of the first device to the second device in response to the termination indication message includes: In response to the termination instruction message, the data communication channel with the second device is disconnected to terminate the transmission of window display data of the first device to the second device.
8. An electronic device comprising a touchscreen, a memory, one or more processors, multiple applications, and one or more programs; wherein the one or more programs are stored in the memory; characterized in that, When the one or more processors execute the one or more programs, they cause the electronic device to implement the method as described in any one of claims 1 to 7.
9. A computer-readable storage medium storing instructions, characterized in that, When it is run on a computer, it causes the computer to perform the method described in any one of claims 1-7.
Citation Information
Patent Citations
Method and device for transmitting data, and method and device for receiving data
CN110134321A
Application sharing method, electronic equipment and computer readable storage medium
CN111049979A
