Information sharing method, electronic device, information sharing system, and storage medium

Abstract

The present disclosure provides an information sharing method, an electronic device, an information sharing system and a storage medium, and belongs to the technical field of electronics. The information sharing method of the present disclosure is applied to a first device end. The information sharing method comprises the following steps: projecting first picture content in a first window to a second device end, so that the second device end displays the first picture content; generating a second window, the second window being different from the first window; receiving target content sent by the second device end, and determining second picture content of the second window according to the target content.

Description

Information sharing methods, electronic devices, information sharing systems, and storage media Technical Field

[0001] This disclosure belongs to the field of electronic technology, and specifically relates to an information sharing method, electronic device, information sharing system, and storage medium. Background Technology

[0002] A common meeting model involves collaboration between a conference all-in-one machine, a local conference terminal, and a remote conference terminal. The local conference terminal projects its first-screen content onto the conference all-in-one machine and shares this content with the remote conference terminal. The conference all-in-one machine displays the content from the local conference terminal for on-site users. The remote conference terminal displays the shared content from the local conference terminal for remote participants.

[0003] Traditional all-in-one conference systems allow on-site users to make real-time adjustments to the screen. However, these adjustments cannot be transmitted to remote conference terminals in real time, thus preventing remote participants from viewing them and hindering three-way collaboration in the overall conference.

[0004] Summary of the Invention

[0005] This disclosure aims to at least solve one of the technical problems existing in the prior art, and to provide an information sharing method, electronic device, information sharing system and storage medium.

[0006] Firstly, the technical solution adopted to solve the technical problem of this disclosure is an information sharing method applied to a first device; wherein, the information sharing method includes:

[0007] The content of the first screen in the first window is projected onto the second device so that the second device displays the content of the first screen.

[0008] Generate a second window, which is different from the first window;

[0009] Receive the target content sent by the second device, and determine the second screen content of the second window based on the target content.

[0010] In some embodiments, after determining the second screen content of the second window based on the target content, the method further includes:

[0011] The content of the second screen in the second window is remotely shared with a remote terminal.

[0012] In some embodiments, receiving the target content sent by the second device includes:

[0013] The first sending module is activated to send the content of the first screen, and at the same time the first sending module is activated, the first receiving module is activated to receive the target content sent by the second device.

[0014] In some embodiments, receiving the target content sent by the second device includes:

[0015] Simultaneously with sending the content of the first screen, the target content is received.

[0016] In some embodiments, projecting the content of the first screen within the first window onto the second device includes:

[0017] The first screen content is sent to the screen projector so that the first screen content can be projected onto the second device.

[0018] In some embodiments, projecting the content of the first screen within the first window onto the second device includes:

[0019] The screen mirroring software deployed on the first device is used to mirror the content of the first screen to the second device.

[0020] In some embodiments, the target content includes annotation information;

[0021] Determining the second screen content of the second window based on the target content includes:

[0022] The annotation information is superimposed on the content of the first screen to generate the content of the second screen.

[0023] In some embodiments, the step of overlaying the annotation information onto the first screen content to generate the second screen content includes:

[0024] Obtain the image conversion ratio; the image conversion ratio is determined based on the display resolution of the first device and the display resolution of the second device.

[0025] Based on the image conversion ratio, determine the target location information of the annotation information mapped onto the content of the first screen;

[0026] Based on the target location information, the annotation information is superimposed onto the first screen content to generate the second screen content.

[0027] In some embodiments, the target content is the screen recording content of the second device.

[0028] In some embodiments, the target content includes first screen content overlaid with annotation information;

[0029] Determining the second screen content of the second window based on the target content includes:

[0030] The content of the first screen, which has annotation information superimposed, is used as the content of the second screen.

[0031] In some embodiments, the target content includes device application content;

[0032] Determining the second screen content of the second window based on the target content includes:

[0033] The content of the device application is used as the content of the second screen.

[0034] In some embodiments, the target content includes third screen content; the third screen content is the screen projected from the third device to the second device.

[0035] In some embodiments, determining the second screen content of the second window based on the target content includes:

[0036] The content of the third screen is used as the content of the second screen.

[0037] In some embodiments, determining the second screen content of the second window based on the target content includes:

[0038] The third screen content is combined with the first screen content to generate the second screen content.

[0039] In some embodiments, after generating the second window and before receiving the target content sent by the second device, the method further includes:

[0040] The content of the first screen is displayed through the second window;

[0041] After receiving the target content sent by the second device, the method further includes:

[0042] In response to receiving the first instruction information sent by the second device, the second window is controlled to switch the currently displayed first screen content to the second screen content.

[0043] In some embodiments, the first instruction information is a control instruction or the target content;

[0044] The control command includes any one of the following: a command generated by the second device when it detects that the screen mirroring function is turned off; a command generated by the second device when it detects that the annotation function is turned on; a command generated by the second device when it detects that the device application function is turned on; a command generated by the second device when it detects that it receives the third screen content from the third device; or a command generated by the second device when it detects that the displayed screen on the current screen mirroring page is inconsistent with the latest received first screen content.

[0045] In some embodiments, the second screen content includes a first sub-content and a second sub-content spliced ​​together, and at least one of the first sub-content and the second sub-content is the target content;

[0046] The information sharing method further includes: adjusting the screen ratio of the first sub-content and / or the second sub-content in the second screen content to obtain the updated second screen content.

[0047] In some embodiments, one of the first sub-content and the second sub-content is the first screen content, and the other is the target content; the target content includes the third screen content projected from the third device to the second device and / or the device application content of the second device.

[0048] In some embodiments, both the first sub-content and the second sub-content are the target content.

[0049] In some embodiments, the first sub-content and the second sub-content are different third screen contents projected from different third devices to the second device; or...

[0050] One of the first sub-content and the second sub-content is the third screen content on the third device, and the other is the device application content on the second device; or...

[0051] One of the first sub-content and the second sub-content is the first screen content overlaid with annotation information, and the other is the device application content on the second device; or...

[0052] One of the first sub-content and the second sub-content is the first screen content with superimposed annotation information, and the other is the third screen content on the third device; or,

[0053] One of the first sub-content and the second sub-content is a first screen content with superimposed annotation information, and the other is multiple different third screen contents spliced ​​together; or,

[0054] One of the first sub-content and the second sub-content is the first screen content with superimposed annotation information, and the other is the third screen content and device application content spliced ​​together.

[0055] In some embodiments, the target content includes a third sub-content and a fourth sub-content that are spliced ​​together.

[0056] Determining the second screen content of the second window based on the target content includes:

[0057] Adjust the size of the third sub-content and / or adjust the size of the fourth sub-content to determine the content of the second screen.

[0058] In some embodiments, after determining the second screen content of the second window based on the target content, the method further includes:

[0059] In response to receiving a focus command for the target sub-content, the target sub-content is enlarged within the second window; or,

[0060] In response to receiving a focus command for the target sub-content, enhance the display of the target sub-content within the second window; or,

[0061] In response to receiving a focus command for the target sub-content, the target sub-content is displayed separately within the second window;

[0062] The target sub-content is either the third sub-content or the fourth sub-content.

[0063] In some embodiments, generating the second window includes:

[0064] In response to receiving the first instruction information sent by the second device, the second window is generated.

[0065] In some embodiments, generating the second window includes:

[0066] Use a screen mirroring application to generate the second window.

[0067] In some embodiments, generating the second window includes:

[0068] In response to receiving the access command sent by the screen mirroring device, the second window is generated.

[0069] In some embodiments, the second window is any one of a virtual display screen, a display window in a virtual display screen, a software window, and an extended display screen.

[0070] In some embodiments, after determining the second screen content of the second window based on the target content, the method further includes:

[0071] In response to the user's first action, the second window is displayed and the first window is hidden;

[0072] In response to the user's page-turning operation on the second window, a page-turning instruction is generated on the first window;

[0073] In response to the page-turning command, control the page-turning of the first screen content on the first window;

[0074] The content of the first screen after page turning is projected onto the second device, and the content of the second screen in the second window is updated.

[0075] In some embodiments, after determining the second screen content of the second window based on the target content, the method further includes:

[0076] In response to the user's first action, the second window is displayed and the first window is hidden;

[0077] In response to a user's first touch operation on the second window, a first touch trajectory is generated on the first screen content within the first window; the first touch trajectory and the first screen content are projected onto the second device; target content containing at least the first touch trajectory is received from the second device, and the second screen content within the second window is updated; or...

[0078] In response to a user's first touch operation on the second window, the second device acquires the first touch trajectory corresponding to the first touch operation; receives target content sent by the second device that includes at least the first touch trajectory, and updates the second screen content within the second window; or...

[0079] In response to a second operation that initiates the annotation function, a first batch of annotation layers is overlaid on the original content layer of the second window; in response to a first touch operation by the user on the second window, a first touch trajectory is generated on the first batch of annotation layers to be transmitted to the second device; upon receiving a first screen content containing at least the first touch trajectory sent by the second device, the second screen content in the second window is updated.

[0080] Secondly, this disclosure also provides an information sharing method applied to a second device; wherein the information sharing method includes:

[0081] Display the content of the first screen sent by the first device;

[0082] The target content is obtained and sent to the first device.

[0083] In some embodiments, obtaining the target content and sending it to the first device includes:

[0084] The second receiving module is activated to receive the content of the first screen, and at the same time the second receiving module is activated, the second sending module is activated to send the target content to the first device.

[0085] In some embodiments, the target content includes annotation information;

[0086] The acquisition of target content includes:

[0087] In response to the third operation of activating the annotation function, a second annotation layer is generated and overlaid on the content of the first screen;

[0088] In response to the user's second touch operation, the second touch trajectory corresponding to the second touch operation is displayed on the second annotation layer;

[0089] Using the screen recording component integrated in the second device, the screen in the second annotation layer is recorded to obtain the annotation information.

[0090] In some embodiments, the target content includes annotation information;

[0091] The acquisition of target content includes:

[0092] In response to the third operation of activating the annotation function, a second annotation layer is generated and overlaid on the content of the first screen;

[0093] In response to the user's second touch operation, extract the touch point sequence from the second annotation layer;

[0094] A second touch trajectory is generated based on the touch point sequence;

[0095] The second touch trajectory is used as the annotation information.

[0096] In some embodiments, obtaining the target content includes:

[0097] The target content is obtained by recording the display screen of the second device using the screen recording component integrated in the second device.

[0098] In some embodiments, the target content includes first screen content overlaid with annotation information;

[0099] The step of recording the display screen of the second device using a screen recording component integrated in the second device to obtain the target content includes:

[0100] The screen recording component is used to record the first screen content with superimposed annotation information, which is then used as the target content.

[0101] In some embodiments, the target content includes device application content;

[0102] The step of recording the display screen of the second device using a screen recording component integrated in the second device to obtain the target content includes:

[0103] When the writing function is detected to be enabled, the screen recording component is used to record the device application content as the target content.

[0104] In some embodiments, the target content includes the third screen content projected from a third device.

[0105] The acquisition of target content includes:

[0106] Receive the content of the third screen projected from the third device;

[0107] The content of the third screen is taken as the target content.

[0108] In some embodiments, the information sharing method further includes:

[0109] A control command is generated and sent to the first device. The control command is any one of the following: a command generated upon detecting that the screen mirroring function is turned off; a command generated upon detecting that the annotation function is turned on; a command generated upon detecting that the device application function is turned on; a command generated upon detecting that the third screen content from the third device is received; or a command generated when the displayed screen on the current screen mirroring page is inconsistent with the latest received first screen content.

[0110] In some embodiments, the second device includes a fifth sub-content and a sixth sub-content that are spliced ​​together.

[0111] The acquisition of target content includes:

[0112] Using the screen recording component integrated in the second device, the fifth sub-content and / or the sixth sub-content are recorded to obtain the target content.

[0113] In some embodiments, the second device includes a fifth sub-content and a sixth sub-content that are spliced ​​together; the fifth sub-content includes a first screen content with superimposed annotation information or the device application content of the second device; the sixth sub-content is the third screen content projected from the third device.

[0114] The acquisition of target content includes:

[0115] Using the screen recording component integrated in the second device, the fifth sub-content is recorded and sent to the first device as the target content;

[0116] The content of the third screen projected from the third device is forwarded to the first device as the target content.

[0117] In some embodiments, the target content includes a third sub-content and a fourth sub-content that are spliced ​​together.

[0118] After obtaining the target content, the following is also included:

[0119] In response to a third trigger operation by the user targeting the target sub-content, a focus instruction for the target sub-content is generated and sent to the first device; the target sub-content is either the third sub-content or the fourth sub-content.

[0120] Thirdly, embodiments of this disclosure also provide an electronic device configured to perform the information sharing method as described in any one of the first aspects.

[0121] Fourthly, this disclosure also provides an information sharing system, including at least one first device and at least one second device; the first device and the second device are communicatively connected.

[0122] The first device is configured to project the content of a first screen in a first window onto a second device so that the second device displays the content of the first screen; generate a second window, which is different from the first window; receive target content sent by the second device and determine the content of the second screen in the second window based on the target content;

[0123] The second device is configured to display the first screen content sent by the first device; acquire the target content and send it to the first device.

[0124] In some embodiments, the information sharing system further includes at least one third device terminal; the third device terminal and the second device terminal are communicatively connected;

[0125] The third device is configured to display third screen content; and to project the third screen content onto the second device.

[0126] In some embodiments, the second device is further configured to send the target content to the third device;

[0127] The third device is also configured to generate a third window; and to determine the fourth screen content of the third window based on the received target content.

[0128] In some embodiments, the first device and the third device are communicatively connected;

[0129] The first device is also configured to send the content of the first screen to the third device;

[0130] The second device is further configured to send the target content to the third device; wherein the target content includes at least one of annotation information, third screen content projected from the third device, and device application content;

[0131] The third device is also configured to generate a third window; based on the received first screen content and the target content, determine the fourth screen content of the third window, so as to share the fourth screen content with the remote terminal.

[0132] In some embodiments, the first device and the third device are communicatively connected;

[0133] The first device is also configured to send the content of the first screen to the second device;

[0134] The second device is further configured to send the target content and the first screen content to the third device; wherein the target content includes at least one of annotation information, third screen content projected from the third device, and device application content;

[0135] The third device is also configured to generate a third window; based on the received first screen content and the target content, determine the fourth screen content of the third window, so as to share the fourth screen content with the remote terminal.

[0136] Fifthly, embodiments of this disclosure also provide a computer non-transient readable storage medium, wherein a computer program is stored on the computer non-transient readable storage medium, and the computer program is executed by a processor to perform the steps of the information sharing method as described in any one of the first aspects or any one of the second aspects. Attached Figure Description

[0137] Figure 1 is a schematic diagram of the existing conference sharing mode under multiple devices;

[0138] Figure 2 is a schematic diagram of the information sharing method provided in an embodiment of this disclosure;

[0139] Figure 3 is a schematic diagram of the conference sharing mode under multiple devices provided in the embodiments of this disclosure;

[0140] Figure 4 is a schematic diagram of a screen projection method provided in an embodiment of this disclosure;

[0141] Figure 5 is a schematic diagram of another screen projection method provided in this embodiment of the present disclosure;

[0142] Figure 6 is a schematic diagram of the window content of a first device under an example provided in an embodiment of this disclosure;

[0143] Figure 7 is a schematic diagram of the window content of the first device under another example provided in the embodiments of this disclosure;

[0144] Figure 8 is a schematic diagram of the window content of the first device under another example provided in the embodiments of this disclosure;

[0145] Figure 9 is a schematic diagram of the window content of the first device under another example provided in the embodiments of this disclosure;

[0146] Figure 10 is a schematic diagram of the window content of the first device under another example provided in the embodiments of this disclosure;

[0147] Figure 11 is a schematic diagram of the window content of the first device under another example provided in the embodiments of this disclosure;

[0148] Figure 12 is a schematic diagram of adjusting the aspect ratio of the second screen content provided in an embodiment of this disclosure;

[0149] Figure 13 is a schematic diagram of the window content of the first device under another example provided in the embodiments of this disclosure;

[0150] Figure 14 is a schematic diagram of the enlarged target sub-content provided in an embodiment of this disclosure;

[0151] Figure 15 is a layer diagram of the annotation function provided in the embodiments of this disclosure;

[0152] Figure 16 is a schematic diagram of another information sharing method provided in an embodiment of this disclosure;

[0153] Figure 17 is a schematic diagram of an information sharing system provided in an embodiment of this disclosure;

[0154] Figure 18 is a schematic diagram of another information sharing system provided in an embodiment of this disclosure. [0154.1] [Correction 06.11.2024 according to Rule 91] Figure 19 is a schematic diagram of the structure of an electronic device provided in an embodiment of this disclosure. Detailed Implementation

[0155] To make the objectives, technical solutions, and advantages of the embodiments of this disclosure clearer, the technical solutions of the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this disclosure, and not all of them. Therefore, the following detailed description of the embodiments of this disclosure provided in the accompanying drawings is not intended to limit the scope of the claimed disclosure, but merely represents selected embodiments of this disclosure. All other embodiments obtained by those skilled in the art based on the embodiments of this disclosure without inventive effort are within the scope of protection of this disclosure.

[0156] Unless otherwise defined, the technical or scientific terms used in this disclosure shall have the ordinary meaning understood by one of ordinary skill in the art to which this disclosure pertains. The terms “first,” “second,” and similar terms used in this disclosure do not indicate any order, quantity, or importance, but are merely used to distinguish different components. Similarly, the terms “an,” “a,” or “the,” and similar terms do not indicate a quantity limitation, but rather indicate the presence of at least one. The terms “including,” “comprising,” or “containing,” and similar terms mean that the information preceding the word encompasses the information listed following the word, but does not exclude additional information.

[0157] The term "and / or" as used in this disclosure describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, or B existing alone. The character " / " generally indicates that the preceding and following related objects have an "or" relationship.

[0158] As shown in Figure 1, this is a schematic diagram of a multi-device conference sharing mode, including a conference all-in-one machine 01, a local conference terminal 02, and a remote conference terminal 03. The local conference terminal 02 projects screen content A onto the conference all-in-one machine 01 and shares screen content A with the remote conference terminal 03. The conference all-in-one machine 01 displays the screen content A from the local conference terminal 02 for on-site users 04 to view. The remote conference terminal 03 displays the shared screen from the local conference terminal 02 for remote participants 05 to view.

[0159] It should be noted that the conference all-in-one machine 01 often cannot pre-install all remote conferencing software, and the integration of any remote conferencing software onto the conference all-in-one machine 01 requires pre-customized development. For example, if the conference all-in-one machine 01 uses the Android operating system, the remote conferencing software integrated into it needs to be customized in advance, which not only increases development costs but also makes it difficult to obtain the right to use third-party remote conferencing software. In addition, while the traditional conference all-in-one machine 01 supports real-time screen adjustments by on-site users 04, such as the built-in annotation function to add annotations to the projected screen content A, or to receive projected screens sent from other devices, the conference all-in-one machine 01 only supports saving the adjustments locally. Currently, it cannot penetrate to the local conference terminal 02, let alone the remote conference terminal 03, which is not conducive to the overall three-party collaboration of the meeting.

[0160] Therefore, this disclosure provides an information sharing method applied to a first device, such as a local conferencing terminal. Optionally, the first device has screen mirroring software installed. The screen mirroring software is the executing entity of the information sharing method provided in this disclosure.

[0161] Figure 2 is a schematic diagram of the information sharing method provided in the embodiments of this disclosure, as shown in Figure 2, including steps S11 to S13.

[0162] S11. Project the content of the first screen in the first window to the second device so that the second device can display the content of the first screen.

[0163] The first window can be the desktop or a view of an application (app) on the first device. Taking an application (app) view as the first window as an example, the creation process of the first window includes: when an application (app) is launched, the first device creates a view as the first window, which is also the projection window. Then, this first window is bound to the application (app). Simultaneously, the underlying operating system of the first device creates a buffer space corresponding to this first window. When the content of the application (app) needs to be displayed in the first window, the screen of the application (app) (i.e., the first screen content) is rendered onto the buffer space to achieve the display of the application (app) screen.

[0164] This first window is used to display the first screen content to be projected. For example, the first screen content includes, but is not limited to, any form of meeting materials, such as images, videos, audio, text (PPT, Word, Excel), etc.

[0165] Optionally, the screen recording function can be activated to record the content of the first screen in the first window and project it to the second device. The projection method can be either using a screen projector or utilizing the projection function within screen projector software.

[0166] Screen mirroring refers to the technology of displaying the screen content of one device on another. It can be achieved wirelessly or via wired transmission, transmitting the screen content of a first device (such as a mobile phone, computer, or tablet) to a second device (such as a TV, large screen display, or projector) in real time. The first and second devices need to communicate using a specific screen mirroring protocol to ensure that the screen content is correctly transmitted from the first device to the second. Screen mirroring protocols include Miracast and DLNA, and different devices may support different protocols. The first and second devices must be on the same local area network (LAN) for screen mirroring. They identify each other by connecting to the same Wi-Fi network and establishing a connection through the screen mirroring protocol. Once the connection is successful, the screen content of the first device will be mirrored on the second device, including applications, images, videos, and audio. Operations and touches on the first device's screen will be reflected in real time on the second device. Wired screen mirroring uses a cable to physically connect the first and second devices. Wired interfaces include, for example, HDMI and VGA. When a user connects the first device to the second device via a cable, the content displayed on the first device's screen is transmitted to the second device and displayed on its screen. Whether wireless or wired transmission, specific protocols and technologies are required for signal transmission and decoding. During screen mirroring, signal stability and transmission speed must be ensured to guarantee smooth and clear visuals.

[0167] Optionally, the second device can be a large-screen display device, such as the all-in-one conference machine mentioned above. The second device communicates with the first device and displays the received content of the first screen, providing a projected image for on-site users.

[0168] S12, Generate a second window.

[0169] The second window is a different window from the first window. For example, the first window is the screen mirroring window, used for screen mirroring; the second window is the sharing window, used for remote sharing.

[0170] Optionally, the first window is the physical window actually displayed on the first device; the second window can be any one of a virtual display screen, a display window in a virtual display screen, a software window, and an extended display screen.

[0171] For example, if the second window is a physical window, it can be a software window. If the first device includes a main display screen and an extended display screen, the second window can be the extended display screen within the physical window. If the first device has only one display screen, the second window can be a virtual display screen or a display window (virtual window) within a virtual display screen. A virtual display screen is a virtual display screen with the same size as the display screen on the first device; a display window (virtual window) within a virtual display screen can be a window that pops up on that virtual display screen, and is also a virtual window.

[0172] Optionally, the second window is a software window, including various states such as focused, obscured, and minimized. In the focused state, taking Windows as an example, multiple windows can run simultaneously, with the focused window on top, directly visible to the user. The obscured state can be understood as the second window being obscured by other physical windows; although the user cannot see the second window, it can still be used for remote sharing. The minimized state refers to the second window running in the background, supporting real-time response to user commands to pop up and be displayed physically.

[0173] If the second window is a physical window, its size can be smaller than or equal to the size of the first window. For example, it can be displayed as a small floating window on top of the first window, making it convenient for users to choose remote sharing options and project their screens to other devices. Alternatively, the second window can be an extended display screen, spliced ​​together with the first window for display.

[0174] Optionally, if the second window is a virtual display screen, its creation process includes: utilizing functions provided by the underlying operating system of the first device for creating virtual screens, such as the Virtual Display interface provided by Android Display Manager, to create a virtual display screen. Virtual display screens can be used for screen recording, split-screen, etc.

[0175] For example, a virtual display screen can also serve as an extended display screen.

[0176] S13. Receive the target content sent by the second device and determine the second screen content of the second window based on the target content.

[0177] The second window is used to open to remote terminals, and the content of the second screen is used to share with remote terminals, so as to share the target content of the second device on site with remote participants.

[0178] The target content includes at least a portion of the content displayed on the second device. For example, the target content is at least one of the following: annotation information, first screen content, first screen content with annotation information overlaid, third screen content projected from the third device, device application content, etc.

[0179] It should be noted that the first window, used for external screen projection, cannot simultaneously serve as the display window for the second screen's content; otherwise, projection to the second device will remain unavailable. The second window, as a virtual window, is used to carry the content of the second screen and does not provide a physical display.

[0180] In steps S11 to S13 above, the information sharing method provided in this embodiment generates a second window simultaneously based on the first window. The content in the first window is used for continuous external projection without affecting the meeting presentation on the second device at the venue; simultaneously, the content of the second screen in the second window is used for remote sharing. The first and second windows are independent of each other and do not affect each other, thus enabling the sharing of the target content from the second device at the venue with remote participants, achieving three-way collaboration for the overall meeting.

[0181] Optionally, a screen mirroring application is installed on the first device. Figure 3 is a schematic diagram of a multi-device meeting sharing mode provided in this embodiment of the present disclosure. As shown in Figure 3, the first device 1 projects the first screen content of the first window 11 to the second device 2 through the screen mirroring application 13. The screen mirroring application 13 can be screen mirroring software; or the screen mirroring application 13 can be an installation-free program sent to the first device 1 by the screen mirroring device. At the same time, the target content sent by the second device 2 is received, and the second screen content of the second window 12 is determined according to the target content. The first window 11 is the main display window, which is displayed in real time and is used to provide the first screen content to the local user 101, so that the local user can adjust the first screen content corresponding to the meeting materials in real time. The second window 12 can be a virtual window, which is hidden and displayed, but the second screen content in the second window 12 is used for remote sharing, so as to share the target content of the second device on site (such as the annotation information of the on-site participant 102) with the remote participant 301 on the remote terminal 3.

[0182] In some embodiments, after S13, the content of the second screen of the second window can be remotely shared with a remote terminal. Optionally, in response to a user initiating a sharing command, a communication connection is established with the remote terminal, and the content of the second screen of the second window is remotely shared with the remote terminal. The user is a user on the first device and can actively start remote conferencing software to achieve a communication connection with the remote terminal.

[0183] For example, as shown in Figure 3, the screen mirroring application 13 also includes remote conferencing software; the remote conferencing software is used to remotely share the content of the second screen of the second window with a remote terminal, so as to realize the remote sharing of the target content on the second device at the scene.

[0184] In some embodiments, regarding steps S11 and S13 above, the first device initiates a first sending module to send first screen content, and simultaneously initiates a first receiving module to receive target content sent by the second device. The first sending module can be software or hardware. Software can be understood as a program for sending information, such as protocols for sending information, including Hypertext Transfer Protocol (HTTP), Transmission Control Protocol (TCP), Internet Protocol (IP), User Datagram Protocol (UDP), etc. Hardware can be understood as a component or interface for sending information. Similarly, the first receiving module can be software or hardware, such as a program for receiving information (e.g., a protocol for receiving information) or a component for receiving information (e.g., a receiving interface). The first device initiates the first sending module to establish a communication connection with the second device, and once the communication connection is established, it can send the first screen content to the second device at any time. Simultaneously, the first receiving module is initiated to receive or wait for the target content sent by the second device.

[0185] Specifically, the first device receives the target content while sending the first screen content; or, sending and receiving are performed alternately, with the first device initiating the process based on changes in the actual displayed content. For example, if the first screen content changes, the first device sends the changed first screen content. After establishing a connection with the second device, the first device receives the target content sent by the second device at any time, regardless of the timing of reception. The key factor is the timing of sending by the second device, such as when the second device detects a change in the target content, it sends the changed target content.

[0186] In this embodiment, screen projection and reception are performed simultaneously, eliminating the impact of delays in remote meetings caused by untimely reception of target content.

[0187] Optionally, as shown in Figure 4, screen mirroring can be performed using a screen mirroring device 4. The screen mirroring device 4, as an external device independent of the first device 1, can receive the first screen content and mirror it to the second device 2. The screen mirroring device 4 can connect to the first device 1 via an interface (HDMI, USB, or TpYE-C). Specifically, the first screen content is sent to the screen mirroring device 4, which then mirrors it to the second device 2.

[0188] Optionally, as shown in Figure 5, screen mirroring can be performed using screen mirroring software 131. The screen mirroring software 131, deployed on the first device 1, projects the content of the first screen onto the second device 2.

[0189] In some embodiments, FIG6 is a schematic diagram of the window content of a first device under an example provided by an embodiment of the present disclosure. As shown in FIG6, the target content includes annotation information. Step S13 specifically includes S13-1.

[0190] S13-1. Overlay the annotation information onto the content of the first screen to generate the content of the second screen.

[0191] Specifically, one optional implementation involves acquiring the locally stored first screen content and directly overlaying the received annotation information onto the first screen content to generate the second screen content. Another optional implementation involves allowing the first and second windows to interpenetrate, meaning the first screen content displayed in the first window can be directly sent to the second window, and then the received annotation information can be directly overlaid onto the first screen content to generate the second screen content within the second window.

[0192] In this embodiment, the target content only includes annotation information and does not include the content of the first screen displayed on the second device. The amount of data in the annotation information is smaller than that in the first screen content. This saves data transmission between the second and first devices, especially in high-definition scenarios, reducing data transmission latency. Furthermore, the first and second devices communicate wirelessly, which is prone to poor network signal and instability. With the same communication quality, a larger data transmission volume leads to greater instability, causing screen stuttering and affecting meeting quality. However, data transmission containing only annotation information has a smaller data volume, minimizing the impact of communication quality on data transmission and ensuring stable data transmission. This does not affect the shared screen and guarantees the quality of the three-way meeting.

[0193] In some embodiments, the display resolution of the second device is typically different from that of the first device. For example, the second device may be a large-screen display with a 4K resolution, while the first device has a 2K resolution. Alternatively, the aspect ratio of the second device may be 16:9, while that of the first device is 4:3. Therefore, the annotation information received from the second device cannot be directly mapped to the first device at a 1:1 ratio for display, resulting in alignment discrepancies. Thus, when overlaying the annotation information onto the first screen content, position mapping is required, as described in steps S13-1-1 to S13-1-3 below.

[0194] S13-1-1, Obtain the image conversion ratio.

[0195] The image conversion ratio is determined based on the display resolution of the first device and the display resolution of the second device.

[0196] For example, given the display resolutions of the first and second devices, the aspect ratio of the second device is determined to be 16:9, and the aspect ratio of the first device is 4:3. Based on the ratio of the length of the second device to the length of the first device (16:4, or 4:1), it can be determined that the annotation information needs to be reduced in length by a factor of 4 before being mapped to the content of the first screen. Similarly, based on the ratio of the width of the second device to the width of the first device (9:3, or 3:1), it can be determined that the annotation information needs to be reduced in width by a factor of 3 before being mapped to the content of the first screen. Therefore, the image conversion ratio is a 4-fold reduction in length and a 3-fold reduction in width.

[0197] S13-1-2. Based on the image conversion ratio, determine the target position information of the annotation information mapped on the content of the first screen.

[0198] Given the coordinates of the annotation information on the second device, the coordinates of the annotation information after being enlarged or reduced can be calculated based on the image conversion ratio. This coordinates are the target position information mapped on the first device.

[0199] Taking a coordinate point (x, y) in the annotation information as an example, given that the image conversion ratio is 4 times the length and 3 times the width, the target position information mapped on the first device is (x / 4, y / 3).

[0200] S13-1-3. Based on the target location information, overlay annotation information onto the first screen content to generate the second screen content.

[0201] The annotation information and the content of the first screen belong to different layers within the second window, and they are set to overlap. The content of the first screen is located on the bottom layer of the second window, and the annotation information is located on the top layer of the second window, and the top layer is a transparent layer.

[0202] Specifically, the annotation information is displayed on a transparent layer according to the coordinates of the target location information, so as to achieve the overlay of the annotation information and the content of the first screen.

[0203] In some embodiments, the target content is the screen recording content of the second device. This screen recording content can be the desktop recording, window recording, or a recording of a specific area of ​​the screen displayed on the second device. Desktop recording, window recording, and partial area recording capture images from different sources, and each type creates a different handle, similar to an identification number (ID). This can be selected when calling Windows API interfaces; for example, which handle is passed to the API determines which recording rule is invoked, allowing for flexible selection of the recording content.

[0204] Desktop recording refers to capturing images on the screen by locking the screen using specific screen recording components (such as software or hardware). Similarly, window recording refers to capturing images within a specific window by locking the window using specific screen recording components (such as software or hardware). Capturing content in a localized area is similar. In some cases, the captured content may include not only images but also sound. It should be noted that if the first device can share the live sound with the remote terminal, there is no need for the second device to capture the sound; if the first device does not share the audio source with the remote terminal, the second device can capture both images and sound using a screen recording component and share it in real-time to a second window on the first device for remote sharing.

[0205] The second device initiates the screen recording component to capture the screen recording content, including at least the content of the first screen. If the second device has annotation functionality enabled, the screen recording content can be the first screen content with overlaid annotation information; if the second device has device application functionality enabled, the screen recording content can be device application content; if the second device also simultaneously receives the third screen content projected from the third device, the screen recording content can further include the third screen content. Device application functionality can be understood as an application (app).

[0206] In one embodiment, FIG7 is a schematic diagram of the window content of the first device under another example provided by the present disclosure embodiment. As shown in FIG7, the target content includes the first screen content with superimposed annotation information. Step S13 specifically includes S13-2.

[0207] S13-2. Use the content of the first screen with superimposed annotation information as the content of the second screen.

[0208] The annotation information refers to the information that the user draws and annotates on the first screen content when the annotation function is enabled on the second device. The annotation information and the first screen content belong to different layers on the second device's display window, and they overlap. The first screen content is located on the bottom layer of the second device's display window, and the annotation information is located on the top layer, which is a transparent layer. The second device records the entire screen content, including the bottom layer of the first screen content and the transparent layer of annotation information, thus the recorded target content is the first screen content with the annotation information superimposed.

[0209] In another embodiment, Figure 8 is a schematic diagram of the window content of the first device under another example provided by the embodiments of this disclosure. As shown in Figure 8, the target content includes device application content. Step S13 specifically includes S13-3.

[0210] S13-3. Use the device application content as the content of the second screen.

[0211] The application content of the device includes, but is not limited to, the content of various applications (apps) installed on the second device. Examples include whiteboard content from handwriting software, meeting content from remote conferencing software, countdown content from countdown software, and message content from message board software. Taking whiteboard content as an example, whiteboard content refers to the content handwritten by the user in the whiteboard area when the handwriting function is enabled on the second device (such as with handwriting software). Typically, enabling the handwriting function on the second device means exiting or closing the screen projection; therefore, the second device can only record whiteboard content during screen recording.

[0212] In another embodiment, FIG9 is a schematic diagram of the window content of the first device under another example provided by the embodiments of this disclosure. As shown in FIG9, the target content includes a first screen content with superimposed annotation information and a third screen content located on at least one side of the first screen content with superimposed annotation information. Step S13 specifically includes S13-4.

[0213] S13-4. The first screen content with superimposed annotation information and the third screen content located on at least one side of the first screen content with superimposed annotation information serve as the second screen content.

[0214] In some embodiments, the target content includes third screen content; the third screen content is the screen projected from the third device to the second device. Therefore, when the second device receives the third screen content, it can directly forward the third screen content to the first device through the video interface, thereby saving the recording process of the third screen content and improving data transmission efficiency.

[0215] In one embodiment, FIG10 is a schematic diagram of the window content of the first device under another example provided by the present disclosure embodiment. As shown in FIG10, step S13 specifically includes S13-5.

[0216] S13-5. Use the content of the third screen as the content of the second screen.

[0217] The content displayed on the third screen, projected from the third device to the second device, can be shared independently with participants on remote terminals. For example, if the third screen contains meeting materials provided by the third device and shared with remote terminals via the first device, it can improve overall collaboration in multi-party meetings. Alternatively, if the third screen contains a live recording from the second device and shared with remote terminals via the first device, it enables real-time interaction between remote and on-site participants, enhancing the immersive experience for remote attendees.

[0218] In another embodiment, FIG11 is a schematic diagram of the window content of the first device under another example provided by the present disclosure. As shown in FIG11, step S13 specifically includes S13-6.

[0219] S13-6. Combine the content of the third screen with the content of the first screen to generate the content of the second screen.

[0220] Optionally, the third-screen content, as the projection content sent by the second device, can be spliced ​​onto at least one side of the first-screen content to avoid conflict with the projection content of the first device, and shared with participants on the remote terminal. Optionally, the third-screen content can be presented as a small area above the first-screen content, spliced ​​in a picture-in-picture format to generate the second-screen content.

[0221] For example, the third screen content might be meeting materials provided by a third device. By splicing the first and third screen content together, the remote terminal can share the meeting materials, enabling multi-party sharing. Alternatively, the third screen content could be a live recording. By splicing the first and third screen content together, the remote terminal can achieve live interaction without affecting the viewing of the meeting materials (first screen content), thus enhancing the immersive experience for remote participants.

[0222] Optionally, the third-screen content serves as the projection content on the third device. Since the size of the third-screen content is similar to that of the first-screen content, splicing them together at a 1:1 ratio would easily exceed the size of the second window. Therefore, the size of the third-screen content needs to be adjusted to fit the size of the second window. Specifically, given the sizes of both the third and first-screen content, only the size of the third-screen content can be adjusted; the adjusted third-screen content can then be spliced ​​onto at least one side of the first-screen content to generate the second-screen content. Alternatively, only the size of the first-screen content can be adjusted; the adjusted first-screen content can then be spliced ​​onto at least one side of the third-screen content to generate the second-screen content. Alternatively, both the sizes of the first and third-screen content can be adjusted simultaneously to generate the second-screen content.

[0223] In some embodiments, the timing of generating the second window in S12 specifically includes: generating the second window in response to receiving first instruction information sent by the second device. The first instruction information is a control instruction or target content. The control instruction includes any one of the following: an instruction generated when the second device detects that the annotation function is enabled; an instruction generated when the second device detects that the handwriting function is enabled; an instruction generated when the second device detects that it has received third screen content from the third device; or an instruction generated when the second device detects that the displayed screen on the current projection page is inconsistent with the latest received first screen content.

[0224] Here, the second window can be generated using a screen mirroring application. Specifically, in response to receiving the first instruction information sent by the second device, the second window is generated using the screen mirroring application.

[0225] In some embodiments, the timing of generating the second window in S12 specifically includes: automatically generating the second window in response to starting the screen mirroring function. Optionally, the second window is generated in response to receiving an access command sent by the screen mirroring device. When using a screen mirroring device, the first device responds to the access command sent by the screen mirroring device and further receives the installation program sent by the screen mirroring device. After the program runs, it creates a window and obtains a window handle by using the CreateWindowEx() function in the API of the first device's internal operating system, such as the Windows operating system, according to the set window style and other parameters. Then, it passes the window handle to the ShowWindow() function to perform the window display operation and generate the second window (software window). Alternatively, if the Windows system already supports the graphics card filtering framework, a virtual display adapter can be generated through the Indirect Display Driver (IDD) driver and reported to the system through IddCxMonitorArrival to realize the insertion of the display device. At this time, the second screen can be seen on the display page of the system settings interface, and the extended mode can be selected, that is, an extended display screen is generated.

[0226] Optionally, in response to the user opening the screen sharing software, a second window can be automatically generated using the screen sharing software. This allows the user to use the second window as remotely shared desktop content when the meeting begins.

[0227] In some embodiments, the timing of generating the second window in S12 specifically includes: automatically generating the second window in response to the initial transmission of the first screen content.

[0228] In some embodiments, while generating the second window, the underlying operating system of the first device also creates a buffer space corresponding to the second window for carrying subsequent screen content.

[0229] In some embodiments, after the second window is generated in S12 and before the target content is received in S13, the content of the first screen is carried in the second window. That is, even if the second window has been generated but the target content has not yet been received, in order to ensure that the remote user can see the content of the first window, the content of the first screen in the first window is copied to the second window.

[0230] It should be noted that the first window and the second window are two different processes within the underlying operating system of the first device. The process of the first window is the screen mirroring process, and the process of the second window is the remote sharing process. They can communicate with each other through inter-process communication, allowing the first window process to send the content displayed on the screen to the second window process for display. Specifically, firstly, the first window process records the content of the first screen and encodes it into video data; then, it sends this video data to the second window process; the second window process obtains the video data, decodes it, and then renders the decoded data into the second window's buffer space to display the content of the first screen.

[0231] The second window is a physical window, such as an extended display screen, which can actually display the content of the first screen. If the second window is a virtual window, it is only used to hold the content of the first screen, similar to a memory, to store the content of the first screen for sharing to a remote terminal.

[0232] Furthermore, after receiving the target content in S13, the second window no longer carries the first screen content, but instead carries the updated screen with the target content. Specifically, in response to receiving the first instruction information sent by the second device, the second window is controlled to switch the currently carried first screen content to the second screen content. Similar to the process of the second window described above, in response to receiving the first instruction information sent by the second device, and after determining the second screen content of the second window based on the target content, the second screen content is decoded, and the decoded second screen content is rendered into the buffer space of the second window to realize the display of the second screen content.

[0233] In one implementation, the first instruction information is a control instruction. In response to receiving the control instruction, the second window switches the currently displayed first screen content to the second screen content. The control instruction includes any one of the following: an instruction generated when the second device detects that the screen mirroring function is turned off; an instruction generated when the second device detects that the annotation function is turned on; an instruction generated when the second device detects that the handwriting function is turned on; an instruction generated when the second device detects that it is receiving third screen content from a third device; or an instruction generated when the second device detects that the displayed screen on the current screen mirroring page is inconsistent with the most recently received first screen content.

[0234] For example, turning off the screen mirroring function means that the second device receives an instruction from the user to click the close button in the screen mirroring screen based on the currently displayed screen mirroring screen, and closes the screen mirroring screen; or, the second device receives an instruction from the user to exit the screen mirroring screen. In this case, exiting does not mean closing (e.g., minimizing), and it is possible to open another application (app) afterwards.

[0235] Optionally, the target content can be used as a control command to control the second window to switch the content of the first screen currently displayed to the content of the second screen.

[0236] In another implementation, the first instruction information is the target content. In response to receiving the target content, the second window is controlled to switch the currently displayed first screen content to the second screen content.

[0237] In some embodiments, after the second window is generated in S12, the screen recording feed continuously returned by the second device can be received.

[0238] In some embodiments, FIG12 is a schematic diagram of adjusting the aspect ratio of the second screen content provided by an embodiment of the present disclosure. As shown in FIG12, the second screen content in the second window 12 includes a first sub-content 121 and a second sub-content 122 spliced ​​together, and at least one of the first sub-content 121 and the second sub-content 122 is target content. After S13, S14 is also included for adjusting the aspect ratio and updating the second screen content.

[0239] S14. Adjust the aspect ratio of the first sub-content 121 and / or the second sub-content 122 in the second screen content to obtain the updated second screen content.

[0240] For example, in certain specific application scenarios, the second device displays a composite screen, such as a split-screen display (2-screen or 4-screen), and the corresponding content of the second screen is also a composite screen. For example, the content of the second screen is a composite screen of the content of the first screen and the content of the device application; the content of the second screen is a composite screen of the content of the first screen and the content of the third screen on the third device; the content of the second screen is a two-panel composite screen of the content of the first screen and the content of the device application and the content of the third screen (here the content of the device application and the content of the third screen are a single screen), etc.

[0241] Since the second device displays the first sub-content 121 and the second sub-content 122 in a large-screen split-screen format, the display resolutions of the second device and the first device are mismatched. Therefore, the screen ratio of the first sub-content 121 and / or the second sub-content 122 in the second screen content can be adjusted so that the updated second screen content occupies as much of the entire second window as possible, eliminating potential issues such as black borders in the second window.

[0242] This embodiment can better support split-screen display, and the screen ratio can be flexibly adjusted during the display process so that the updated second screen content is more suitable for the second window, eliminating the black borders of the second window display.

[0243] In some embodiments, for S14, one of the first sub-content and the second sub-content is the first screen content, and the other is the target content; the target content includes the third screen content projected from the third device to the second device and / or the device application content of the second device.

[0244] Taking the first sub-content as the first screen content and the second sub-content as the target content as an example, the first and second sub-contents are spliced ​​together, and the splicing method can be determined according to the actual screen splitting method of the second device. For example, if the screen splitting method of the second device is the first screen content on the left and the target content (third screen content and / or device application content) on the right, then the splicing relationship of the second screen content is the first sub-content on the left and the second sub-content on the right. Similarly, if the screen splitting method of the second device is vertical splicing, then the corresponding second screen content is also vertical splicing.

[0245] Furthermore, if the target content includes both third-screen content and device application content, the target content is a composite of the third-screen content and the device application content. The composite method is also determined based on the actual composite method used on the second device.

[0246] Optionally, the first sub-content is the content of the first screen, which is copied from the first window to the second window. The second sub-content is the target content, which is the content received from the second device. In specific implementation, in response to receiving the target content sent by the second device, the target content is spliced ​​to at least one side of the first sub-content to obtain the second screen content. Further, the screen ratio of the first sub-content and / or the second sub-content in the second screen content is adjusted to obtain an updated second screen content. Here, only the second sub-content is received from the second device, saving the data transmission volume of the first sub-content and ensuring the stability of wireless transmission. At the same time, when the second sub-content is the content of the third screen, the second device does not need to decode and can directly forward the second sub-content to the first device, which can save the recording on the second device.

[0247] In some embodiments, for S14, both the first sub-content and the second sub-content are target content, but their corresponding target contents are different.

[0248] Optionally, the first sub-content and the second sub-content are different third-screen contents projected from different third-device terminals to the second device terminal. For example, the third-screen content of a third-device terminal A is a live recording of that terminal or meeting materials to be projected; the third-screen content of another third-device terminal B is a live recording of that terminal or meeting materials to be projected. Both third-device terminals A and B project their respective third-screen contents to the second device terminal, which then forwards the different third-screen contents to the first device terminal. The first device terminal uses the different third-screen contents as the first sub-content and the second sub-content, respectively.

[0249] Optionally, one of the first sub-content and the second sub-content is the third screen content on the third device, and the other is the device application content on the second device. For example, the third device projects the third screen content to the second device; the second device forwards the received third screen content to the first device and sends its local device application content to the first device; the first device receives the third screen content sent by the second device as the first sub-content, and receives the device application content sent by the second device as the second sub-content.

[0250] Optionally, one of the first sub-content and the second sub-content is the first screen content with superimposed annotation information, and the other is the device application content of the second device. For example, the first device receives the first screen content with superimposed annotation information sent by the second device as the first sub-content, and receives the device application content sent by the second device as the second sub-content.

[0251] Optionally, one of the first sub-content and the second sub-content is the first screen content with superimposed annotation information, and the other is the third screen content on the third device. For example, the third device projects the third screen content to the second device; the second device forwards the received third screen content to the first device, and also sends the local first screen content with superimposed annotation information to the first device; the first device receives the first screen content with superimposed annotation information sent by the second device as the first sub-content, and receives the third screen content forwarded by the second device as the second sub-content.

[0252] Optionally, one of the first sub-content and the second sub-content is a first screen content overlaid with annotation information, and the other is multiple different third screen contents spliced ​​together. For example, multiple third-party devices project their respective third screen contents to a second-party device; the second-party device forwards all received third screen contents to the first-party device, and also sends its local first screen content overlaid with annotation information to the first-party device; the first-party device receives the first screen content overlaid with annotation information sent by the second-party device as the first sub-content, and receives the multiple third screen contents forwarded by the second-party device, splicing the multiple third screen contents together as the second sub-content. When the meeting includes multiple third-party devices, the first-party device can splice the received third screen contents (meeting materials) projected by multiple third-party devices into a single sub-content for display, facilitating multi-terminal interaction and sharing the interaction results with remote terminals, allowing remote participants to indirectly join the on-site interaction.

[0253] Optionally, one of the first sub-content and the second sub-content is a first screen content overlaid with annotation information, and the other is a third screen content and device application content spliced ​​together. For example, the third device projects the third screen content to the second device; the second device forwards the received third screen content to the first device, and also sends its local device application content and the first screen content overlaid with annotation information to the first device. The first device receives the first screen content overlaid with annotation information sent by the second device as the first sub-content, and receives the third screen content and device application content forwarded by the second device, splicing the third screen content and device application content together as the second sub-content.

[0254] In some embodiments, the second screen content includes a first sub-content and a second sub-content spliced ​​together. The first sub-content may be annotation content received from the second device and then superimposed on the local first screen content. The second sub-content may be third screen content or device application content received from the second device.

[0255] In some embodiments, FIG13 is a schematic diagram of the window content of the first device under another example provided by the present disclosure. As shown in FIG13, the target content includes a third sub-content and a fourth sub-content that are spliced ​​together; wherein, the third sub-content and the fourth sub-content may be different. For S13, the received sub-content can be adjusted to a suitable screen ratio before the screen is displayed, specifically including S13-7.

[0256] S13-7. Adjust the size of the third sub-content and / or adjust the size of the fourth sub-content to determine the content of the second screen.

[0257] For example, in certain application scenarios, the second device displays a combined screen, such as a split-screen display (2-screen or 4-screen). The content to be carried by the corresponding second window must also be a combined screen, such as a spliced ​​screen of the third and fourth sub-contents.

[0258] Because the second device displays the third and fourth sub-contents in a split-screen format on a large screen, the display resolutions of the second device and the first device are mismatched. Therefore, the black borders on the second screen displayed in the second window can be eliminated by adjusting the size of the third sub-content, the size of the fourth sub-content, the size of the third sub-content and the size of the fourth sub-content, or the relative size ratio of the third and fourth sub-contents.

[0259] This embodiment can better support split-screen display, and before the second screen content is displayed, the screen ratio of the third and fourth sub-contents can be flexibly adjusted so that the second screen content shared with the remote terminal is more adapted to the second window, eliminating the black borders of the second window display.

[0260] Optionally, the third sub-content and the fourth sub-content are different third-screen contents projected from different third devices to the second device; or, one of the third sub-content and the fourth sub-content is the third-screen content of the third device and the other is the device application content of the second device; or, one of the third sub-content and the fourth sub-content is the first-screen content with superimposed annotation information and the other is the device application content of the second device; or, one of the third sub-content and the fourth sub-content is the first-screen content with superimposed annotation information and the other is the third-screen content of the third device; or, one of the third sub-content and the fourth sub-content is the first-screen content with superimposed annotation information and the other is multiple different third-screen contents spliced ​​together; or, one of the third sub-content and the fourth sub-content is the first-screen content with superimposed annotation information and the other is a spliced ​​third-screen content and device application content.

[0261] In some embodiments, the second screen content includes multiple sub-contents, some of which may not be important to the presentation or contribution to the meeting, or may be unimportant at a certain time. Therefore, the display of unimportant sub-contents can be ignored, and only the more important focus sub-contents can be displayed.

[0262] In one possible embodiment, FIG14 is a schematic diagram of magnifying the target sub-content provided by the present disclosure embodiment. As shown in FIG14, after S13, S15 is also included, which is used to magnify a certain focal sub-content (i.e. the target sub-content).

[0263] S15. In response to receiving a focus command for the target sub-content, zoom in on the target sub-content within the second window. The target sub-content is either the third or fourth sub-content.

[0264] In one scenario, switching the display of the third and fourth sub-contents, that is, responding to a focus instruction for the target sub-content and displaying only the target sub-content, can achieve magnification of the focus sub-content.

[0265] In another scenario, the target sub-content is enlarged by a certain proportion, while another sub-content is reduced to highlight the focal sub-content.

[0266] Optionally, the focus command is a command sent by the second device. For example, in response to a user's operation on the third (or fourth) sub-content, such as a touch operation, annotation operation, page turning operation, voice instruction, gaze command, etc., the second device generates a focus command for the third (or fourth) sub-content and sends it to the first device. Then, in response to receiving the focus command for the third (or fourth) sub-content, the first device zooms in on the third (or fourth) sub-content within the second window.

[0267] In another possible embodiment, after S13, S16 is also included for enhancing the display of a certain focus sub-content (i.e., target sub-content).

[0268] S16. In response to receiving a focus command for the target sub-content, enhance the display of the target sub-content in the second window. The target sub-content is either the third or fourth sub-content.

[0269] "Enhanced display" refers to improving the display quality of target sub-content, which can be achieved by increasing resolution or improving image clarity. Increasing resolution means increasing the number and density of pixels in the target sub-content; improving image clarity means improving the contrast, color reproduction, and other aspects of sharpness and detail.

[0270] In another possible embodiment, after S13, S17 is included for enhancing the display of a certain focus sub-content (i.e., target sub-content).

[0271] S16. In response to receiving a focus command for the target sub-content, the target sub-content is displayed separately in the second window. The target sub-content is either the third or fourth sub-content.

[0272] "Distinctive display" refers to overlaying filter effects onto target sub-content to enhance its artistic appeal and visual attractiveness. For example, by overlaying shimmering elements onto target sub-content, certain parts of the image will appear to shimmer, creating a sparkling effect that improves artistic appeal and visual appeal.

[0273] In this embodiment of the disclosure, the first window is the main display window, and the second window may be any one of a virtual display screen, a display window in a virtual display screen, a software window, and an extended display screen. In some embodiments, the second window is only used to carry the content of the second screen and does not have the ability to detect user-triggered operations, but the first window can. Therefore, when the first window is hidden and the display is switched to the second window, the focus command can also be a user's trigger command for the target sub-content on the second window. However, this trigger command can be passed through the second window to the first window. The first device responds to the trigger command on the first window and then performs operations such as zooming in, enhancing display, or distinguishing the display of the target sub-content.

[0274] In some embodiments, a first window is displayed and a second window is hidden.

[0275] Of course, the first and second windows can be switched. In some embodiments, the second window is displayed while the first window is hidden.

[0276] Following S13, there are also S2-1-1 to S2-1-4, which are mainly used to realize the interaction between the second device and the first device.

[0277] S2-1-1: In response to the user's first action, display the second window and hide the first window.

[0278] S2-1-2. In response to page turning operations, generate page turning instructions on the first window.

[0279] In one scenario, the page-turning operation is an instruction sent from the second device. In another scenario, the page-turning operation is an action performed by the user on the second window.

[0280] Optionally, the page-turning operation is an action performed by the user on the second window. In this case, the second window is a display window. Since the content displayed on the second window is merely the screen recording from the second device, it does not contain any control buttons and therefore lacks the ability to detect user-triggered actions. This step requires passing the page-turning operation from the second window to the first window and generating a page-turning command on the first window. The specific passing process includes: capturing the page-turning event and coordinates on the second device and sending them to the first device to obtain the page-turning command sent by the second device. The coordinates of this page-turning operation need to be converted according to the size of the first and second windows. For example, the first window is an extended display of the second window; the coordinates of the top-left and bottom-right corners of the second window are (0,0)~(1920,1080), and the coordinates of the top-left and bottom-right corners of the first window are (1920,0)~(3840,1080). The captured touch operation coordinates need to be offset by adding 1920, ultimately achieving a function similar to the second window passing the operation from the first window.

[0281] S2-1-3, responds to page-turning commands and controls the page-turning of the first screen content in the first window.

[0282] For example, you can control the PowerPoint presentation displayed in the first window to switch from page 1 to page 2.

[0283] S2-1-4. Project the content of the first screen after page turning to the second device and update the content of the second screen in the second window.

[0284] Because the content of the first screen is projected to the second device in real time, the second device simultaneously displays the content of the first screen after page turning. The second device then projects the content of the first screen back to the second window, thus enabling page turning updates in the second window and achieving interactive page turning within the second window.

[0285] In some embodiments, a second window is displayed and the first window is hidden.

[0286] Following S13, there are also S2-2-1 to S2-2-4, which are mainly used to realize the interaction between the second device and the first device.

[0287] S2-2-1. In response to the user's first action, display the second window and hide the first window.

[0288] S2-2-2, In response to the user's first touch operation on the second window, a first touch trajectory is generated on the first screen content within the first window.

[0289] The screen mirroring program installed on the first device has an annotation function, which can generate the first touch trajectory on the first screen content. At this time, the second window is the display window. In response to the user's first touch operation on the second window, the first touch trajectory corresponding to the first touch operation is transmitted to the first window and superimposed on the first screen content.

[0290] S2-2-3, Project the content of the first touch trajectory and the first screen onto the second device.

[0291] S2-2-4. Receive target content sent by the second device that contains at least the first touch trajectory, and update the content of the second screen in the second window.

[0292] Since the content in the first window is projected to the second device in real time, the first screen content with the first touch trajectory superimposed is also projected to the second device. The second device displays the first screen content with the first touch trajectory superimposed. By recording the screen, the first screen content with the first touch trajectory superimposed, i.e., the target content, is obtained and projected back to the first device. The first device receives the first screen content with the first touch trajectory superimposed and displays it in the second window for sharing with the remote terminal.

[0293] The above S2-2-1 to S2-2-4 realize information sharing from the first device terminal to the remote terminal under the annotation.

[0294] Following S13, there are also S2-3-1 to S2-3-4, which are mainly used to realize the interaction between the second device and the first device.

[0295] S2-3-1. In response to the user's first action, display the second window and hide the first window.

[0296] S2-3-2, responding to the user's first touch operation on the second window, so that the second device can obtain the first touch trajectory corresponding to the first touch operation.

[0297] S2-3-3: Upon receiving the first screen content, which at least includes the first touch trajectory, sent by the second device, update the second screen content in the second window.

[0298] Following S13, steps S2-4-1 to S2-4-4 are included, primarily for enabling interaction between the second device and the first device. The screen mirroring application deployed on the first device has an annotation function. The annotation function refers to adding an annotation layer on top of the original content layer of the window, as shown in Figure 15.

[0299] S2-4-1. In response to the user's first action, display the second window and hide the first window.

[0300] S2-4-2, In response to the second operation of starting the annotation function, overlay the first annotation layer on the original content layer of the second window.

[0301] The first batch of annotation layers is a shared annotation layer between the second device and the first window. The two annotation layers can exchange annotation tracks (first touch tracks). For example, the first batch of annotation layers is a transparent layer.

[0302] S2-4-3. In response to the user's first touch operation on the second window, generate a first touch trajectory on the first batch of annotation layers to transmit to the second device.

[0303] S2-4-4: Receive target content sent by the second device that contains at least the first touch trajectory, and update the content of the second screen in the second window.

[0304] The above S2-4-1 to S2-4-4 achieve the following of annotation trajectory by adding a shared annotation layer.

[0305] In addition, this disclosure also provides another information sharing method applied to a second device. The second device is communicatively connected to the first device. In one application scenario, the first device acts as a local conferencing terminal, i.e., a screen-sharing output terminal, and the second device acts as a screen-sharing receiver for the first device.

[0306] The information sharing method is implemented by screen mirroring software installed on the second device.

[0307] Figure 16 is a schematic diagram of another information sharing method provided by an embodiment of this disclosure, as shown in Figure 16, including steps S31 to S32.

[0308] S31. Display the content of the first screen sent by the first device.

[0309] S32. Obtain the target content and send it to the first device.

[0310] The methods for obtaining target content include, but are not limited to, recording information from one or more layers, receiving information sent by third-party devices, etc.

[0311] The target content includes at least a portion of the content displayed on the second device. For example, the target content may be at least one of the following: annotation information, first screen content, first screen content with annotation information overlaid, third screen content projected from the third device, or device application content.

[0312] The information sharing method provided in this disclosure can share the target content of the second device on site with the first device, so as to indirectly share it to the remote terminal through the first device, thereby realizing the three-party collaboration of the overall meeting.

[0313] In some embodiments, the second device 2 activates a second receiving module to receive the content of the first screen, and simultaneously activates a second sending module to send the target content to the first device. The second receiving module can be software or hardware, such as a program for receiving information (e.g., a protocol for receiving information) or a component for receiving information (e.g., a receiving interface). Similarly, the second sending module can be software or hardware, such as a program for sending information (e.g., a protocol for sending information) or a component for sending information (e.g., a sending interface). When the first device activates the first sending module and the second device activates the second receiving module, a communication connection is established between the two. Furthermore, the second device activates the second receiving module simultaneously with the second sending module to prepare to send the target content back to the first device at any time.

[0314] Specifically, the second device sends the target content while receiving the content of the first screen; or, receiving and sending are carried out alternately, with the second device initiating based on changes in the actual displayed content, such as sending the changed target content when the target content changes; after the second device establishes a connection with the first device, it can send the changed target content at any time through the second sending module, and receive the changed first screen content sent by the first device at any time, so as to realize synchronous receiving and sending, and eliminate the impact of untimely target content feedback causing delays in remote meetings.

[0315] In some embodiments, the target content includes annotation information. Step S32 specifically includes S32-1-1 to S32-1-3, where annotation information is obtained through screen recording.

[0316] S32-1-1 In response to the third operation of starting the annotation function, a second annotation layer is generated and superimposed on the content of the first screen.

[0317] The second annotation layer is a transparent layer, while the content of the first screen is a non-transparent layer. The transparent layer is overlaid on the non-transparent layer.

[0318] S32-1-2, In response to the user's second touch operation, display the second touch trajectory corresponding to the second touch operation in the second annotation layer.

[0319] S32-1-3. Using the screen recording component integrated in the second device, record the screen in the second annotation layer to obtain annotation information.

[0320] Among them, the screen in the second annotation layer is recorded, that is, the second touch trajectory in the second annotation layer is recorded, so the annotation information includes the second touch trajectory.

[0321] The screen recording component can be a hardware device or a screen recording program in screen mirroring software.

[0322] In some embodiments, the target content includes annotation information. Step S32 specifically includes S32-2-1 to S32-2-3, where annotation information is obtained through touch detection.

[0323] S32-2-1. In response to the third operation of starting the annotation function, a second annotation layer is generated and superimposed on the content of the first screen.

[0324] The second annotation layer is a transparent layer, while the content of the first screen is a non-transparent layer. The transparent layer is overlaid on the non-transparent layer.

[0325] S32-2-2, In response to the user's second touch operation, extract the touch point sequence from the second annotation layer.

[0326] Specifically, the second device can use the Android system. In the second annotation layer, the relevant information of the second touch operation is obtained through the MotionEvent object, including the event (press, move, release) and coordinates (x, y), so as to extract the touch point sequence (such as the continuous coordinates after pressing).

[0327] S32-2-3. Generate the second touch trajectory based on the touch point sequence.

[0328] The second touch trajectory is information representing the sequence of touch points, and it is the image displayed in the second annotation layer.

[0329] S32-2-4. Use the second touch trajectory as annotation information.

[0330] In some embodiments, a screen recording component integrated into the second device is used to record the display screen of the second device to obtain the target content. That is, the target content is the screen recording content. The screen recording content can be the desktop recording, window recording, or a recording of a specific area of ​​the display screen on the second device. Desktop recording, window recording, and partial area recording capture images from different sources, and each type creates a different handle, similar to an identification number (ID). This can be selected when calling the Windows API interface; for example, which handle is passed to the API determines which recording rule is invoked, allowing for flexible selection of the recording content.

[0331] Desktop recording refers to capturing images on the screen by locking the screen using specific screen recording components (such as software or hardware). Similarly, window recording refers to capturing images within a specific window by locking the window using specific screen recording components (such as software or hardware). Capturing content in a localized area is similar. In some cases, the captured content may include not only images but also sound. It should be noted that if the first device can share the live sound with the remote terminal, there is no need for the second device to capture the sound; if the first device does not share the audio source with the remote terminal, the second device can capture both images and sound using a screen recording component and share it in real-time to a second window on the first device for remote sharing.

[0332] The second device initiates the screen recording component to acquire the screen recording content. This screen recording content includes some or all of the information currently displayed on the second device, such as the content of the first screen or the content of the first screen with superimposed annotations, the content of the third screen received by the second device from at least one third device, and the content of device applications, etc.

[0333] In some embodiments, the target content includes first screen content overlaid with annotation information. A second annotation layer is overlaid on the layer containing the first screen content, and the second annotation layer is a transparent layer.

[0334] Step S32 specifically includes S32-3-1 and S32-3-2.

[0335] S32-3. Use the screen recording component to record the first screen content with superimposed annotation information, including the annotation information located in the second annotation layer and the first screen content located in the bottom layer.

[0336] S32-3-2, Use the recorded first screen content with superimposed annotation information as the target content.

[0337] In some embodiments, the target content includes device application content. Step S32 specifically includes S32-4-1 and S32-4-2.

[0338] S32-4-1. In response to the command to enable the writing function, enable the writing function.

[0339] At this point, you can turn off the screen mirroring function, so that the content displayed on the second device will only be the device's application content. Alternatively, you can enable the screen mirroring function and the writing function simultaneously, so that the content displayed on the second device includes the spliced ​​content of the first screen and the device's application content.

[0340] Optionally, if the writing function is detected to be enabled, the screen mirroring function is disabled by default. Then, in step S32-4-2, the device application content is recorded using the screen recording component as the target content.

[0341] Optionally, when the writing function is detected to be enabled, the current focus content is the device application content by default. Therefore, regardless of whether the screen mirroring function is currently disabled, the screen recording component is used to record the device application content as the target content. It should be noted that if the first screen content and the device application content are displayed simultaneously, screen recording components need to be set in their respective display areas to enable separate recording.

[0342] In some embodiments, the target content includes the content of a third screen projected from a third device. Step S32 specifically includes S32-5-1 and S32-5-2.

[0343] S32-5-1 Receive the content of the third screen projected from the third device.

[0344] The third device can be a camera, and the content projected onto the screen can be the live video recorded by the camera. Alternatively, the third device can be a personal PC, and the content projected onto the screen can be meeting materials prepared by the user of that personal PC.

[0345] S32-5-2, Use the content of the third screen as the target content.

[0346] Here, the third device can include one or more. If there are multiple third devices, the spliced ​​content of multiple third-screen images can be used as the target content.

[0347] In some embodiments, a control command is generated and sent to the first device. The control command is any one of the following: a command generated upon detecting that the screen mirroring function is turned off; a command generated upon detecting that the annotation function is turned on; a command generated upon detecting that the handwriting function is turned on; a command generated upon detecting that the content of the third screen from the third device is received; or a command generated when the displayed content on the current screen mirroring page is inconsistent with the content of the latest received first screen.

[0348] For example, turning off the screen mirroring function means that the second device receives an instruction from the user to click the close button in the screen mirroring screen based on the currently displayed screen mirroring screen, and closes the screen mirroring screen; or, the second device receives an instruction from the user to exit the screen mirroring screen. In this case, exiting does not mean closing (e.g., minimizing), and it is possible to open another application (app) afterwards.

[0349] The second device integrates a monitoring module (e.g., a monitoring program), primarily used to monitor whether the second device switches the display content source. Optionally, the monitoring module generates a control command in response to disabling the screen mirroring function. Optionally, the monitoring module generates a control command in response to enabling the annotation function. Optionally, the monitoring module generates a control command in response to enabling the handwriting function. Optionally, the monitoring module generates a control command in response to receiving the third screen content from the third device.

[0350] The second device integrates a screen comparison module (e.g., a screen comparison program), primarily used to detect whether the displayed screen on the current projection page matches the most recently received first screen content. Optionally, if the screen comparison module detects an inconsistency between the displayed screen on the current projection page and the most recently received first screen content, it generates a control command. The current projection page can be a screen recording using a screen recording component. The first screen content is the projection content received from the first device. Reasons for inconsistency between the two screens include: projection function disabled, annotation function enabled, and handwriting function enabled at least one of the following: projection function disabled, annotation function enabled, and handwriting function enabled.

[0351] In some embodiments, the target content includes a fifth sub-content and / or a sixth sub-content. Step S32 specifically includes S32-6-1.

[0352] S32-6-1. Using the screen recording component integrated in the second device, record the fifth sub-content and / or the sixth sub-content to obtain the target content.

[0353] Among them, at least one of the fifth and sixth sub-contents is the target content. The fifth sub-content corresponds to the first sub-content shown in Figure 12; the sixth sub-content corresponds to the second sub-content shown in Figure 12.

[0354] Optionally, one of the fifth and sixth sub-contents is the first screen content, and the other is the target content. The target content includes the third screen content projected from the third device to the second device and / or the device application content of the second device. For example, the fifth sub-content is the first screen content projected from the second device; the sixth sub-content is the device application content of the second device (or the third screen content projected from the third device to the second device, or a combination of the third screen content and the device application content). Taking the sixth sub-content as the device application content as an example, the second device records the device application content as the target content and sends it to the first device. The first device receives the sixth sub-content and combines it with the local first screen content to obtain the second screen content. As shown in Figure 12, the second screen content includes a first sub-content 121 and a second sub-content 122 that are combined with each other. The first sub-content 121 is the local first screen content, and the second sub-content 122 is the device application content (i.e., the sixth sub-content) received from the second device. S14 specifically includes: The first device can adjust the screen ratio of the first screen content and the device application content in the second screen content to obtain the updated second screen content.

[0355] Optionally, both the fifth and sixth sub-contents are target content. Specifically, the screen recording component is used to simultaneously record the fifth and sixth sub-contents as target content. For example, one of the fifth and sixth sub-contents may be the first screen content overlaid with annotation information, and the other may be the device application content on the second device; or, one of the fifth and sixth sub-contents may be the first screen content overlaid with annotation information, and the other may be a combination of third screen content and device application content.

[0356] In some embodiments, the second device includes a fifth sub-content and a sixth sub-content that are spliced ​​together; wherein, the fifth sub-content includes the first screen content with superimposed annotation information and / or the device application content of the second device; the sixth sub-content is the third screen content projected from the third device.

[0357] Step S32 specifically includes S32-7-1 and S32-7-2.

[0358] S32-7-1. Using the screen recording component integrated in the second device, record the fifth sub-content and send it as the target content to the first device.

[0359] In this step, the device application content displayed locally and / or the first screen content with overlaid annotation information is recorded using a screen recording component, and the recorded content is sent as the target content to the first device. The first device can then use this recorded content as the first sub-content in the second screen content.

[0360] S32-7-2. The received content of the third screen projected from the third device is forwarded to the first device as the target content.

[0361] In this step, the screen projection content (third-screen content) from the external third device is used as the target content and directly forwarded to the first device. The first device can then use this recorded content as the second sub-content within the second-screen content.

[0362] Here, if multiple different third-screen content are received from different third-device terminals, all different third-screen content can be forwarded to the first device terminal.

[0363] In some embodiments, the target content includes a third sub-content and a fourth sub-content that are concatenated together. The third and fourth sub-contents may be different. Following S32, S33 is included to determine the focus sub-content. The focus sub-content is the sub-content that the user is particularly interested in; it may be either the third or fourth sub-content.

[0364] S33. In response to the user's third trigger operation on the target sub-content, generate a focus instruction for the target sub-content and send it to the first device.

[0365] The target sub-content is either the third or fourth sub-content. The third triggering operation is any one of the following: button operation, touch operation, annotation operation, page turning operation, voice instruction, gaze command, etc.

[0366] The focus command can be one that instructs the first device to zoom in on the target sub-content within the second window, thereby conveying the currently important content to the first device and displaying it in a larger size. Alternatively, the focus command can be one that instructs the first device to enhance the display of the target sub-content within the second window, thereby conveying the currently important content to the first device and enhancing its display to improve the visual effect. Or, the focus command can be one that instructs the first device to differentiate the display of the target sub-content within the second window, thereby conveying the currently important content to the first device and displaying it differentiated to improve the visual effect.

[0367] Optionally, the second device can first zoom in, enhance the display, or differentiate the target sub-content locally, then record the target sub-content using a screen recording component and send it as the target content to the first device. For example, in manual mode, the second device sets a zoom button below each split-screen interface (e.g., the split-screen interface of the third sub-content and the split-screen interface of the fourth sub-content). When the user clicks it, the corresponding target sub-content is zoomed in, and a focus command is generated and sent to the first device. For example, in automatic mode, the second device determines whether each split-screen interface has been touched. If a third trigger operation is detected, the corresponding target sub-content is zoomed in, and a focus command is generated and sent to the first device. It should be noted that when operating on two or more split-screens, the sub-content where the first touch operation is pressed and not released is used as the target sub-content until the first touch action is released.

[0368] Those skilled in the art will understand that, in the above-described method of the specific implementation, the order in which each step is written does not imply a strict execution order and does not constitute any limitation on the implementation process. The specific execution order of each step should be determined by its function and possible internal logic.

[0369] In some embodiments, the timing of triggering the collection of target content includes any one or more of the following: the second device detects that the screen projection function is turned off, the annotation function is turned on, annotation information is generated, the device application function is turned on, device application content is generated, the third screen content projected from the third device is received, or the displayed screen on the current screen projection page is inconsistent with the latest received first screen content.

[0370] In addition, this disclosure also provides an information sharing system. Figure 17 is a schematic diagram of an information sharing system provided by this disclosure. As shown in Figure 17, the information sharing system includes at least one first device terminal 1 and at least one second device terminal 2; the first device terminal 1 and the second device terminal 2 are communicatively connected.

[0371] The first device 1 is configured to project the content of the first screen in the first window onto the second device 2 so that the second device 2 displays the content of the first screen; generate a second window, which is different from the first window; receive target content sent by the second device 2, and determine the content of the second screen in the second window based on the target content.

[0372] It should be noted that the first device 1 in this embodiment is configured to execute steps S11 to S13 in the above information sharing method, and repeated parts will not be described again.

[0373] The second device 2 is configured to display the first screen content sent by the first device 1; obtain the target content and send it to the first device 1.

[0374] It should be noted that the second device 2 in this embodiment is configured to execute steps S31 to S32 in the above information sharing method, and repeated parts will not be described again.

[0375] The information sharing system provided in this embodiment includes a first device 1 that synchronously generates a second window based on a first window. The content in the first window is used for continuous external projection without affecting the meeting presentation of the second device 2 on-site. At the same time, the content of the second screen in the second window is used for remote sharing. The first and second windows are independent of each other and do not affect each other, thus enabling the sharing of the target content of the second device 2 on-site with remote participants and achieving three-way collaboration in the overall meeting.

[0376] For example, in some application scenarios, multiple smart terminals may be connected, such as an all-in-one conference machine, a personal PC1, a personal PC2, a personal tablet3, a personal mobile phone4, and a smart camera5. These smart terminals can all communicate with each other; for example, they may be connected within the same local area network, connected to the hotspot of the all-in-one conference machine, or multiple terminals may have direct or indirect communication connections. These multiple devices form a super terminal, and the multiple smart terminals can share device capabilities with each other, such as the all-in-one conference machine using the camera capabilities of a mobile phone.

[0377] In this setup, device 1 is designated as the primary local screen-sharing output, and device 2 is designated as the screen-sharing receiver. This configuration can automatically assign a specific device within the network as the screen-sharing output, such as any one of personal PC 1, personal PC 2, personal tablet 3, or personal mobile phone 4, and another device as the screen-sharing receiver, such as an all-in-one conference machine, based on the device type. Alternatively, for super terminals within the same local area network, a self-negotiation algorithm can be used to define the screen-sharing output and receiver. If device A can automatically receive screen-sharing feeds from other devices (B, C, D), then device A is automatically designated as the second device; other devices (B, C, D) are designated as either the first or third device.

[0378] In some embodiments, FIG18 is a schematic diagram of another information sharing system provided by the present disclosure. As shown in FIG18, the information sharing system further includes at least one third device terminal 5; the third device terminal 5 can serve as a projection output terminal for projecting third screen content to the second device terminal 2. Taking the first device terminal 1 as a personal PC 1 as an example, the third device terminal 5 includes multiple devices, such as the remaining personal PC 2, personal pad 3, personal mobile phone 4, and smart camera 5.

[0379] Taking the third device 5 as an example, which is used as a projection output terminal to output the third screen content to the second device 2. Specifically, as shown in Figure 18, the third device 5 and the second device 2 are communicatively connected. The third device 5 is configured to display the third screen content and project the third screen content to the second device 2.

[0380] It should be noted that the specific information regarding the content of the third screen and the screen projection method can be found in the above embodiments, and repeated parts will not be repeated.

[0381] In some embodiments, the third device 5 can function not only as a screen projection output terminal for projecting the third screen content to the second device 2, but also as a screen projection receiving terminal for receiving the first screen content output by the first device 1. Furthermore, the first device 1 serves as a remote sharing terminal primarily for sharing the second window externally. The third device 5 can also serve as a remote sharing terminal primarily or secondarily for sharing the third window externally.

[0382] Specifically, the second device 2 is further configured to send the target content to the third device 5; the third device 5 is further configured to generate a third window; and determine the fourth screen content of the third window based on the received target content. The target content includes at least one of the following: annotation information, first screen content, first screen content overlaid with annotation information, third screen content projected from the third device, and device application content.

[0383] It should be noted that the method by which the third device 5 generates the third window can be found in the embodiment of the first device 5 generating the second window in the above information sharing method, and the repeated parts will not be described again.

[0384] The content of the fourth screen can be shared remotely with a remote terminal or sent to the second window of the first device 1.

[0385] In some embodiments, as shown in FIG18, the first device terminal 1 and the third device terminal 5 are communicatively connected.

[0386] The first device 1 is also configured to send the content of the first screen to the third device 5.

[0387] The second device 2 is also configured to send the target content to the third device 5. The target content includes at least one of the following: annotation information, the content of the third screen projected by the third device 5, and device application content.

[0388] The third device 5 is also configured to generate a fourth window; based on the received first screen content and target content, it determines the fourth screen content of the third window to share the fourth screen content with the remote terminal.

[0389] For example, the third device 5 can act as a different sharing terminal from the first device 1, sharing the fourth screen content with the remote terminals connected to the third device 5 (different from the remote terminals connected to the first device 1). This can reduce the number of remote terminals connected to the first device 1 and distribute the connected remote terminals among the first device 1. The content of the fourth screen is the same as the content of the second screen.

[0390] For example, when the remote sharing function of the first device 1 fails, it communicates with the third device 5 to transmit the screen projection content, i.e. the first screen content, so as to share the fourth screen content with the remote terminal through the third device 5.

[0391] In some embodiments, the first device 1 is further configured to send the first screen content to the second device. The second device 2 is further configured to send the target content and the first screen content to the third device; wherein the target content includes at least one of annotation information, the third screen content projected by the third device, and device application content. The third device 5 is further configured to generate a third window; and determine the fourth screen content of the third window based on the received first screen content and target content, so as to share the fourth screen content with a remote terminal.

[0392] In this embodiment, there is no need to establish a communication connection between the first device 1 and the third device 5. The second device 2 can forward the first screen content sent by the first device to the third device 5. The third device 5 can communicate only with the second device 2, and can also receive the first screen content projected from the first device 1 to the second device, as well as the target content sent by the second device. Based on the received first screen content and target content, the fourth screen content of the third window is determined.

[0393] Additionally, embodiments of this disclosure provide an electronic device configured to perform the information sharing method as described in any of the first aspects. This electronic device is the first device terminal 1 described above.

[0394] It should be noted that the principle of the electronic device in solving the problem in this embodiment is similar to the principle of the information sharing method applied to the first device 1 in solving the technical problem. Therefore, the implementation of the electronic device can refer to the implementation of the information sharing method applied to the first device 1 described above, and the repeated parts will not be described again.

[0395] Figure 19 is a schematic diagram of the structure of an electronic device provided in an embodiment of this disclosure. As shown in Figure 19, the electronic device provided in this embodiment includes: one or more processors 1901, a memory 1902, and one or more I / O interfaces 1903. The memory 1902 stores one or more programs, which, when executed by the one or more processors, enable the one or more processors to implement any of the information sharing methods described in the above embodiments; the one or more I / O interfaces 1903 are connected between the processor and the memory, and configured to enable information interaction between the processor and the memory.

[0396] Among them, processor 1901 is a device with data processing capabilities, including but not limited to central processing unit (CPU); memory 1902 is a device with data storage capabilities, including but not limited to random access memory (RAM, more specifically SDRAM, DDR, etc.), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory (FLASH); I / O interface (read-write interface) 1903 is connected between processor 1901 and memory 1902, enabling information exchange between processor 1901 and memory 1902, including but not limited to data bus (Bus).

[0397] In some embodiments, the processor 1901, memory 1902, and I / O interface 1903 are interconnected via bus 1904, and thus connected to other components of the computing device.

[0398] According to embodiments of this disclosure, a computer non-transient readable storage medium is also provided. This computer non-transient readable storage medium stores a computer program, wherein, when executed by a processor, the program implements the steps of any of the information sharing methods described in the above embodiments.

[0399] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a machine-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication component, and / or installed from a removable medium. When the computer program is executed by a central processing unit (CPU), it performs the functions defined above in the system of this disclosure.

[0400] It should be noted that the computer-readable non-transient readable medium disclosed herein may be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. Computer-readable storage media may be, for example, but not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatuses, or devices, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to: electrical connections having one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disc read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof. In this disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. The transmitted data signal can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. The computer-readable signal medium can also be any non-transient readable computer storage medium other than a computer-readable storage medium, which can transmit, propagate, or transfer a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the non-transient readable computer storage medium can be transmitted using any suitable medium, including but not limited to: wireless, wire, optical fiber, RF, etc., or any suitable combination thereof.

[0401] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order than those shown in the drawings. For example, two adjacent blocks may actually represent substantially parallel execution, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0402] It is understood that the above embodiments are merely exemplary embodiments used to illustrate the principles of this disclosure, and this disclosure is not limited thereto. For those skilled in the art, various modifications and improvements can be made without departing from the spirit and substance of this disclosure, and these modifications and improvements are also considered to be within the scope of protection of this disclosure.

Claims

1. An information sharing method, applied to a first device; wherein, The information sharing method includes: The content of the first screen in the first window is projected onto the second device so that the second device displays the content of the first screen. Generate a second window, which is different from the first window; Receive the target content sent by the second device, and determine the second screen content of the second window based on the target content.

2. The information sharing method according to claim 1, wherein, After determining the second screen content of the second window based on the target content, the method further includes: The content of the second screen in the second window is remotely shared with a remote terminal.

3. The information sharing method according to claim 1, wherein, The receipt of the target content sent by the second device includes: The first sending module is activated to send the content of the first screen, and at the same time the first sending module is activated, the first receiving module is activated to receive the target content sent by the second device.

4. The information sharing method according to claim 1, wherein, The receipt of the target content sent by the second device includes: Simultaneously with sending the content of the first screen, the target content is received.

5. The information sharing method according to claim 1, wherein, The step of projecting the content of the first screen within the first window onto the second device includes: The first screen content is sent to the screen projector so that the first screen content can be projected onto the second device.

6. The information sharing method according to claim 1, wherein, The step of projecting the content of the first screen within the first window onto the second device includes: The screen mirroring software deployed on the first device is used to mirror the content of the first screen to the second device.

7. The information sharing method according to claim 1, wherein, The target content includes annotation information; Determining the second screen content of the second window based on the target content includes: The annotation information is superimposed on the content of the first screen to generate the content of the second screen.

8. The information sharing method according to claim 7, wherein, The step of overlaying the annotation information onto the first screen content to generate the second screen content includes: Obtain the image conversion ratio; the image conversion ratio is determined based on the display resolution of the first device and the display resolution of the second device. Based on the image conversion ratio, determine the target location information of the annotation information mapped onto the content of the first screen; Based on the target location information, the annotation information is superimposed onto the first screen content to generate the second screen content.

9. The information sharing method according to claim 1, wherein, The target content is the screen recording content from the second device.

10. The information sharing method according to claim 9, wherein, The target content includes the content of the first screen with superimposed annotation information; Determining the second screen content of the second window based on the target content includes: The content of the first screen, which has annotation information superimposed, is used as the content of the second screen.

11. The information sharing method according to claim 9, wherein, The target content includes device application content; Determining the second screen content of the second window based on the target content includes: The content of the device application is used as the content of the second screen.

12. The information sharing method according to claim 1, wherein, The target content includes the third screen content; the third screen content is the screen projected from the third device to the second device.

13. The information sharing method according to claim 12, wherein, Determining the second screen content of the second window based on the target content includes: The content of the third screen is used as the content of the second screen.

14. The information sharing method according to claim 12, wherein, Determining the second screen content of the second window based on the target content includes: The third screen content is combined with the first screen content to generate the second screen content.

15. The information sharing method according to claim 1, wherein, After generating the second window and before receiving the target content sent by the second device, the method further includes: The content of the first screen is displayed through the second window; After receiving the target content sent by the second device, the method further includes: In response to receiving the first instruction information sent by the second device, the second window is controlled to switch the currently displayed first screen content to the second screen content.

16. The information sharing method according to claim 15, wherein, The first instruction information is a control instruction or the target content; The control command includes any one of the following: a command generated by the second device when it detects that the screen mirroring function is turned off; a command generated by the second device when it detects that the annotation function is turned on; a command generated by the second device when it detects that the device application function is turned on; a command generated by the second device when it detects that it receives the third screen content from the third device; or a command generated by the second device when it detects that the displayed screen on the current screen mirroring page is inconsistent with the latest received first screen content.

17. The information sharing method according to claim 1, wherein, The second screen content includes a first sub-content and a second sub-content that are spliced ​​together, and at least one of the first sub-content and the second sub-content is the target content; The information sharing method further includes: adjusting the screen ratio of the first sub-content and / or the second sub-content in the second screen content to obtain the updated second screen content.

18. The information sharing method according to claim 17, wherein, One of the first sub-content and the second sub-content is the first screen content, and the other is the target content; the target content includes the third screen content projected from the third device to the second device and / or the device application content of the second device.

19. The information sharing method according to claim 17, wherein, Both the first sub-content and the second sub-content are the target content.

20. The information sharing method according to claim 19, wherein, The first sub-content and the second sub-content are different third-screen contents projected onto the second device from different third-device terminals; or... One of the first sub-content and the second sub-content is the third screen content on the third device, and the other is the device application content on the second device; or... One of the first sub-content and the second sub-content is the first screen content overlaid with annotation information, and the other is the device application content on the second device; or... One of the first sub-content and the second sub-content is the first screen content with superimposed annotation information, and the other is the third screen content on the third device; or, One of the first sub-content and the second sub-content is a first screen content with superimposed annotation information, and the other is multiple different third screen contents spliced ​​together; or, One of the first sub-content and the second sub-content is the first screen content with superimposed annotation information, and the other is the third screen content and device application content spliced ​​together.

21. The information sharing method according to claim 1, wherein, The target content includes a third sub-content and a fourth sub-content that are spliced ​​together; Determining the second screen content of the second window based on the target content includes: Adjust the size of the third sub-content and / or adjust the size of the fourth sub-content to determine the content of the second screen.

22. The information sharing method according to claim 21, wherein, After determining the second screen content of the second window based on the target content, the method further includes: In response to receiving a focus command for the target sub-content, the target sub-content is enlarged within the second window; or, In response to receiving a focus command for the target sub-content, enhance the display of the target sub-content within the second window; or, In response to receiving a focus command for the target sub-content, the target sub-content is displayed separately within the second window; The target sub-content is either the third sub-content or the fourth sub-content.

23. The information sharing method according to claim 1, wherein, The generation of the second window includes: In response to receiving the first instruction information sent by the second device, the second window is generated.

24. The information sharing method according to claim 1, wherein, The generation of the second window includes: Use a screen mirroring application to generate the second window.

25. The information sharing method according to claim 1, wherein, The generation of the second window includes: In response to receiving the access command sent by the screen mirroring device, the second window is generated.

26. The information sharing method according to claim 1, wherein, The second window is any one of a virtual display screen, a display window within a virtual display screen, a software window, and an extended display screen.

27. The information sharing method according to any one of claims 1 to 26, wherein, After determining the second screen content of the second window based on the target content, the method further includes: In response to the user's first action, the second window is displayed and the first window is hidden; In response to the user's page-turning operation on the second window, a page-turning instruction is generated on the first window; In response to the page-turning command, control the page-turning of the first screen content on the first window; The content of the first screen after page turning is projected onto the second device, and the content of the second screen in the second window is updated.

28. The information sharing method according to any one of claims 1 to 26, wherein, After determining the second screen content of the second window based on the target content, the method further includes: In response to the user's first action, the second window is displayed and the first window is hidden; In response to a user's first touch operation on the second window, a first touch trajectory is generated on the first screen content within the first window; the first touch trajectory and the first screen content are projected onto the second device; target content containing at least the first touch trajectory is received from the second device, and the second screen content within the second window is updated; or... In response to a user's first touch operation on the second window, the second device acquires the first touch trajectory corresponding to the first touch operation; receives target content sent by the second device that includes at least the first touch trajectory, and updates the second screen content within the second window; or... In response to a second operation that initiates the annotation function, a first batch of annotation layers is overlaid on the original content layer of the second window; in response to a first touch operation by the user on the second window, a first touch trajectory is generated on the first batch of annotation layers to be transmitted to the second device; upon receiving a first screen content containing at least the first touch trajectory sent by the second device, the second screen content in the second window is updated.

29. An information sharing method applied to a second device; wherein, The information sharing method includes: Display the content of the first screen sent by the first device; The target content is obtained and sent to the first device.

30. The information sharing method according to claim 29, wherein, The step of acquiring the target content and sending it to the first device includes: The second receiving module is activated to receive the content of the first screen, and at the same time the second receiving module is activated, the second sending module is activated to send the target content to the first device.

31. The information sharing method according to claim 29, wherein, The target content includes annotation information; The acquisition of target content includes: In response to the third operation of activating the annotation function, a second annotation layer is generated and overlaid on the content of the first screen; In response to the user's second touch operation, the second touch trajectory corresponding to the second touch operation is displayed on the second annotation layer; Using the screen recording component integrated in the second device, the screen in the second annotation layer is recorded to obtain the annotation information.

32. The information sharing method according to claim 29, wherein, The target content includes annotation information; The acquisition of target content includes: In response to the third operation of activating the annotation function, a second annotation layer is generated and overlaid on the content of the first screen; In response to the user's second touch operation, extract the touch point sequence from the second annotation layer; A second touch trajectory is generated based on the touch point sequence; The second touch trajectory is used as the annotation information.

33. The information sharing method according to claim 29, wherein, The acquisition of target content includes: The target content is obtained by recording the display screen of the second device using the screen recording component integrated in the second device.

34. The information sharing method according to claim 33, wherein, The target content includes the content of the first screen with superimposed annotation information; The step of recording the display screen of the second device using a screen recording component integrated in the second device to obtain the target content includes: The screen recording component is used to record the first screen content with superimposed annotation information, which is then used as the target content.

35. The information sharing method according to claim 33, wherein, The target content includes device application content; The step of recording the display screen of the second device using a screen recording component integrated in the second device to obtain the target content includes: When the writing function is detected to be enabled, the screen recording component is used to record the device application content as the target content.

36. The information sharing method according to claim 29, wherein, The target content includes the content of the third screen projected from the third device. The acquisition of target content includes: Receive the content of the third screen projected from the third device; The content of the third screen is taken as the target content.

37. The information sharing method according to claim 29, wherein, Also includes: Generate control commands and send them to the first device. The control command is any one of the following: a command generated upon detecting that the screen mirroring function is turned off; a command generated upon detecting that the annotation function is turned on; a command generated upon detecting that the device application function is turned on; a command generated upon detecting that the content of the third screen from the third device is received; or a command generated when the displayed screen on the current screen mirroring page is inconsistent with the content of the first screen recently received.

38. The information sharing method according to claim 29, wherein, The second device includes a fifth sub-content and a sixth sub-content that are spliced ​​together; The acquisition of target content includes: Using the screen recording component integrated in the second device, the fifth sub-content and / or the sixth sub-content are recorded to obtain the target content.

39. The information sharing method according to claim 29, wherein, The second device includes a fifth sub-content and a sixth sub-content that are spliced ​​together; the fifth sub-content includes a first screen content with superimposed annotation information or the device application content of the second device; the sixth sub-content is the third screen content projected from the third device. The acquisition of target content includes: Using the screen recording component integrated in the second device, the fifth sub-content is recorded as the... The target content is sent to the first device. The content of the third screen projected from the third device is forwarded to the first device as the target content.

40. The information sharing method according to claim 29, wherein, The target content includes a third sub-content and a fourth sub-content that are spliced ​​together; After obtaining the target content, the following is also included: In response to a third trigger operation by the user targeting the target sub-content, a focus command for the target sub-content is generated and sent to the first device. The target sub-content is either the third sub-content or the fourth sub-content.

41. An electronic device configured to perform the information sharing method as claimed in any one of claims 1 to 28.

42. An information sharing system, comprising at least one first device terminal and at least one second device terminal; the first device terminal and the second device terminal are communicatively connected; The first device is configured to project the content of the first screen in the first window onto the second device so that the second device displays the content of the first screen. Generate a second window, which is different from the first window; Receive the target content sent by the second device, and determine the second screen content of the second window based on the target content; The second device is configured to display the content of the first screen sent by the first device. The target content is obtained and sent to the first device.

43. The information sharing system according to claim 42, wherein, The information sharing system further includes at least one third device terminal; the third device terminal and the second device terminal are communicatively connected. The third device is configured to display third screen content; and to project the third screen content onto the second device.

44. The information sharing system according to claim 43, wherein, The second device is also configured to send the target content to the third device. The third device is also configured to generate a third window; based on the received target content... The content of the fourth screen in the third window is determined.

45. The information sharing system according to claim 43, wherein, The first device and the third device are connected in communication. The first device is also configured to send the content of the first screen to the third device; The second device is further configured to send the target content to the third device; wherein the target content includes at least one of annotation information, third screen content projected from the third device, and device application content; The third device is also configured to generate a third window; based on the received first screen content and the target content, determine the fourth screen content of the third window, so as to share the fourth screen content with the remote terminal.

46. ​​The information sharing system according to claim 43, wherein, The first device and the third device are connected in communication. The first device is also configured to send the content of the first screen to the second device; The second device is further configured to send the target content and the first screen content to the third device; wherein the target content includes at least one of annotation information, third screen content projected from the third device, and device application content; The third device is also configured to generate a third window; based on the received first screen content and the target content, determine the fourth screen content of the third window, so as to share the fourth screen content with the remote terminal.

47. A computer-readable non-transient storage medium, wherein, The computer non-transient readable storage medium stores a computer program that, when executed by a processor, performs the steps of the information sharing method as claimed in any one of claims 1 to 28 or any one of claims 29 to 40.

Images