Content processing method and related device

Abstract

Provided in the present application are a content processing method and a related device. In a conference scenario, a participating device can obtain content provided by a screen device, such that a remote electronic device can promptly learn the content provided by the screen device. The content processing method comprises: a first participating device casting first content to a screen device, and synchronously receiving second content provided by the screen device, wherein the first participating device is in communication connection with the screen device; the first participating device creating a virtual camera; and on the basis of the second content, the first participating device generating target content corresponding to the virtual camera.

Description

Content processing methods and related equipment Technical Field

[0001] This application relates to the field of electronic technology, and in particular to content processing methods and related equipment. Background Technology

[0002] Currently, conferencing technology is widely used in office and meeting settings, where users typically transfer content from one device to a larger screen. As screen devices become more functional, users can display more content, such as explanatory notes or content provided by the target electronic device. Summary of the Invention

[0003] This application provides a content processing method and related equipment, which enables participating devices to obtain content provided by a screen device in a conference scenario, facilitating remote electronic devices to understand the content provided by the screen device in a timely manner.

[0004] In a first aspect, embodiments of this application provide a content processing method, which can be executed by a first participating device, the method comprising:

[0005] The first participating device projects first content onto the screen device and simultaneously receives second content provided by the screen device; the screen device is communicatively connected to the first participating device.

[0006] The first participating device creates a virtual camera;

[0007] The first participating device generates the target content corresponding to the virtual camera based on the second content.

[0008] In one possible implementation, the content processing method provided in this application embodiment, wherein the second content is generated based on the target display content of the screen device.

[0009] In one possible implementation, the content processing method provided in this application embodiment includes a target display content that is either desktop screen recording content or window screen recording content of the screen device.

[0010] In one possible implementation, the content processing method provided in this application embodiment includes a second content format that is video.

[0011] In one possible implementation, the content processing method provided in this application embodiment is wherein the target display content is generated based on the first content.

[0012] In one possible implementation, the content processing method provided in this application embodiment is wherein the second content is generated based on the third content provided by the target electronic device to the screen device.

[0013] In one possible implementation, the content processing method provided in this application embodiment includes a screen device having a shooting function;

[0014] The second content is generated based on the first image captured by the screen device.

[0015] In one possible implementation, the content processing method provided in this application embodiment, wherein the second content is generated based on the target display content displayed by the screen device and the first image captured by the screen device;

[0016] In the second content, the target display content and the first image are arranged in a preset manner.

[0017] In one possible implementation, the content processing method provided in this application embodiment includes any of the following arrangement methods:

[0018] The first image is arranged side by side with the target display content;

[0019] The first image is superimposed on the target display content.

[0020] In one possible implementation, the content processing method provided in this application embodiment, wherein,

[0021] The first image is superimposed on the target display content, and the first image is superimposed on the target display content, wherein the proportion of the first image in the second content is smaller than the proportion of the target display content in the second content;

[0022] Alternatively, the first image and the target display content are superimposed, with the target display content superimposed on the first image, wherein the proportion of the target display content in the second content is less than the proportion of the first image in the second content.

[0023] In one possible implementation, the content processing method provided in this application embodiment, the second content is generated based on the target display content displayed on the screen device and the first image captured by the screen device;

[0024] The first participating device generates target content corresponding to the virtual camera based on the second content, including:

[0025] The first participating device merges the target display content with the first image.

[0026] In one possible implementation, the content processing method provided in this application embodiment, wherein the first participating device generates target content corresponding to the virtual camera based on the second content, further includes:

[0027] The first participating device merges the first content and the second content to obtain the target content.

[0028] In one possible implementation, the content processing method provided in this application embodiment includes a first participating device having a shooting function;

[0029] The first participating device generates target content corresponding to the virtual camera based on the second content, and further includes:

[0030] The first participating device merges the acquired second image with the second content to obtain the target content.

[0031] In one possible implementation, the content processing method provided in this application embodiment includes a first image captured by the screen device;

[0032] The first participating device generates target content corresponding to the virtual camera based on the second content, including:

[0033] The first participating device fuses the first content with the first image to obtain the target content.

[0034] In one possible implementation, the content processing method provided in this application embodiment, wherein the first participating device creates a virtual camera, includes:

[0035] Register a virtual camera in the system;

[0036] Add the information of the virtual camera to the system device list;

[0037] The method further includes:

[0038] The first participating device provides the target content corresponding to the virtual camera to the virtual camera driver.

[0039] In one possible implementation, the content processing method provided in this application further includes:

[0040] The first participating device sends the first content and / or the second content to the second participating device.

[0041] In one possible implementation, the content processing method provided in this application embodiment, wherein the first participating device sends the first content to the second participating device, includes:

[0042] The first participating device sends the first content to the second participating device via window sharing.

[0043] The first participating device sends the second content to the second participating device, including:

[0044] The first participating device sends the second content to the second participating device via camera sharing.

[0045] Secondly, embodiments of this application also provide a content processing method, wherein the method includes:

[0046] The first participating device receives the second content provided by the screen device, and the first participating device is communicatively connected to the screen device.

[0047] The first participating device creates a virtual camera;

[0048] The first participating device generates the target content corresponding to the virtual camera based on the second content.

[0049] In one possible implementation, the content processing method provided in this application embodiment, wherein the second content is generated based on the target display content of the screen device.

[0050] In one possible implementation, the content processing method provided in this application embodiment includes a target display content that is either desktop screen recording content or window screen recording content of the screen device.

[0051] In one possible implementation, the content processing method provided in this application embodiment includes a second content format that is video.

[0052] In one possible implementation, the content processing method provided in this application embodiment is wherein the target display content is generated based on the first content.

[0053] In one possible implementation, the content processing method provided in this application embodiment is wherein the second content is generated based on the third content provided by the target electronic device to the screen device.

[0054] In one possible implementation, the content processing method provided in this application embodiment includes a screen device having a shooting function;

[0055] The second content is generated based on the first image captured by the screen device.

[0056] In one possible implementation, the content processing method provided in this application embodiment, wherein the second content is generated based on the target display content displayed by the screen device and the first image captured by the screen device;

[0057] In the second content, the target display content and the first image are arranged in a preset manner.

[0058] In one possible implementation, the content processing method provided in this application embodiment includes any of the following arrangement methods:

[0059] The first image is arranged side by side with the target display content;

[0060] The first image is superimposed on the target display content.

[0061] In one possible implementation, the content processing method provided in this application embodiment, wherein,

[0062] The first image is superimposed on the target display content, and the first image is superimposed on the target display content, wherein the proportion of the first image in the second content is smaller than the proportion of the target display content in the second content;

[0063] Alternatively, the first image and the target display content are superimposed, with the target display content superimposed on the first image, wherein the proportion of the target display content in the second content is less than the proportion of the first image in the second content.

[0064] In one possible implementation, the content processing method provided in this application embodiment, the second content is generated based on the target display content displayed on the screen device and the first image captured by the screen device;

[0065] The first participating device generates target content corresponding to the virtual camera based on the second content, including:

[0066] The first participating device merges the target display content with the first image.

[0067] In one possible implementation, the content processing method provided in this application embodiment, wherein the first participating device generates target content corresponding to the virtual camera based on the second content, further includes:

[0068] The first participating device merges the first content and the second content to obtain the target content.

[0069] In one possible implementation, the content processing method provided in this application embodiment includes a first participating device having a shooting function;

[0070] The first participating device generates target content corresponding to the virtual camera based on the second content, and further includes:

[0071] The first participating device merges the acquired second image with the second content to obtain the target content.

[0072] In one possible implementation, the content processing method provided in this application embodiment includes a first image captured by the screen device;

[0073] The first participating device generates target content corresponding to the virtual camera based on the second content, including:

[0074] The first participating device fuses the first content with the first image to obtain the target content.

[0075] In one possible implementation, the content processing method provided in this application embodiment, wherein the first participating device creates a virtual camera, includes:

[0076] Register a virtual camera in the system;

[0077] Add the information of the virtual camera to the system device list;

[0078] The method further includes:

[0079] The first participating device provides the target content corresponding to the virtual camera to the virtual camera driver.

[0080] In one possible implementation, the content processing method provided in this application further includes:

[0081] The first participating device sends the first content and / or the second content to the second participating device.

[0082] In one possible implementation, the content processing method provided in this application embodiment, wherein the first participating device sends the first content to the second participating device, includes:

[0083] The first participating device sends the first content to the second participating device via window sharing.

[0084] The first participating device sends the second content to the second participating device, including:

[0085] The first participating device sends the second content to the second participating device via camera sharing.

[0086] Thirdly, embodiments of this application also provide a content processing method, which can be executed by a screen device, the method comprising:

[0087] The screen device determines the second content;

[0088] The screen device sends the second content to the first participating device, and the first participating device is communicatively connected to the screen device.

[0089] In one possible implementation, the content processing method provided in this application embodiment, wherein the screen device determines the second content, including:

[0090] The screen device determines target display content, wherein the second content includes the target display content, or the second content is generated based on the target display content;

[0091] The target display content is either the desktop recording content or the window recording content of the screen device.

[0092] In one possible implementation, the content processing method provided in this application embodiment includes a first content provided by the first participating device and / or a third content provided by the target electronic device to the screen device.

[0093] In one possible implementation, the content processing method provided in this application embodiment includes a screen device having a shooting function;

[0094] The second content is generated based on the first image captured by the screen device.

[0095] In one possible implementation, the content processing method provided in this application embodiment includes a screen device having a shooting function;

[0096] The second content is generated based on the target display content and the first image captured by the screen device, wherein the target display content is the desktop screen recording content or window screen recording content of the screen device.

[0097] Fourthly, embodiments of this application also provide an electronic device, which includes a memory and a processor;

[0098] The memory is used to store computer program instructions;

[0099] The processor executes the computer program instructions to perform the method as described in the first aspect and any possible implementation thereof, or in the second aspect and any possible implementation thereof, or in any of the third aspect and any possible implementation thereof.

[0100] Fifthly, embodiments of this application also provide a computer storage medium, which includes a computer program that, when run on an electronic device, causes the electronic device to perform the method as described in the first aspect and any possible implementation thereof, or in the second aspect and any possible implementation thereof, or in any of the third aspect and any possible implementation thereof.

[0101] In a sixth aspect, a computer program product is also provided, comprising a computer program that, when run on a computer, causes the computer to perform the method as described in the first aspect and any possible implementation thereof, or in the second aspect and any possible implementation thereof, or in any of the third aspect and any possible implementation thereof. Attached Figure Description

[0102] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0103] Figure 1 is a schematic diagram of the application scenario provided in the embodiments of this application;

[0104] Figure 2 is a schematic diagram of the application scenario provided in the embodiments of this application;

[0105] Figure 3 is a schematic flowchart of a content processing method provided in an embodiment of this application;

[0106] Figure 4A is a schematic diagram of the working process of a screen device in an embodiment of this application;

[0107] Figure 4B is a schematic diagram of the working process of a screen device in an embodiment of this application;

[0108] Figure 5A is a schematic diagram of the interaction between the first participating device and the screen device in an embodiment of this application;

[0109] Figure 5B is a schematic diagram of the interaction between the first participating device and the screen device in an embodiment of this application;

[0110] Figure 5C is a schematic diagram of the interaction between the first participating device and the screen device in an embodiment of this application;

[0111] Figure 5D is a schematic diagram of the working process of the screen device according to an embodiment of this application;

[0112] Figure 6A is a schematic diagram showing the relationship between the target content and the first image in an embodiment of this application;

[0113] Figure 6B is a schematic diagram showing the relationship between the target content and the first image in an embodiment of this application;

[0114] Figure 6C is a schematic diagram showing the relationship between the target content and the first image in an embodiment of this application;

[0115] Figure 7A is a schematic diagram showing the relationship between the first content and the second content in an embodiment of this application;

[0116] Figure 7B is a schematic diagram showing the relationship between the first content and the second content in an embodiment of this application;

[0117] Figure 7C is a schematic diagram showing the relationship between the first content and the second content in an embodiment of this application;

[0118] Figure 7D is a schematic diagram showing the relationship between the second image and the second content in an embodiment of this application;

[0119] Figure 7E is a schematic diagram showing the relationship between the second image and the second content in an embodiment of this application;

[0120] Figure 7F is a schematic diagram showing the relationship between the second image and the second content in an embodiment of this application;

[0121] Figure 8 is a schematic flowchart of a content processing method provided in an embodiment of this application;

[0122] Figure 9 is a schematic flowchart of a content processing method provided in an embodiment of this application;

[0123] Figure 10 is a structural schematic diagram of a screen device provided in an embodiment of this application;

[0124] Figure 11A is a schematic diagram of the structure of a first meeting equipment provided in an embodiment of this application;

[0125] Figure 11B is a schematic diagram of the working process of a first participating device provided in an embodiment of this application;

[0126] Figure 12 is a schematic diagram of the working process of each device in the content display system provided in the embodiment of this application;

[0127] Figure 13 is a schematic diagram of the structure of the electronic device provided in the embodiment of this application. Detailed Implementation

[0128] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions of this application will be clearly and completely described below with reference to the accompanying drawings of the embodiments of this application. Obviously, the described embodiments are only some embodiments of the technical solutions of this application, and not all embodiments. Based on the embodiments recorded in this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the technical solutions of this application.

[0129] It should be noted that in the description of this application, "multiple" is understood as "at least two". "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone. A connected to B can represent: A and B directly connected, or A and B connected through C. Furthermore, in the description of this application, terms such as "first" and "second" are used only for descriptive purposes and should not be construed as indicating or implying relative importance or order.

[0130] The technical solutions provided in this application are applicable to meeting scenarios. With the increasing number of meeting scenarios, the types of electronic devices used in these scenarios are also increasing. For example, some participants attend meetings in offline meeting rooms, while others participate remotely. As shown in Figure 1, offline meeting rooms typically have a first electronic device that can join the online meeting and interact with remote electronic devices to view the meeting content displayed by the first electronic device. Since offline meeting rooms are usually convenient for participants to view the meeting content, the first electronic device can project the meeting content onto a larger screen device.

[0131] In some application scenarios, other electronic devices in offline meeting rooms, such as a second electronic device, can also project meeting content onto a screen device. In this case, if the second electronic device fails to interact with the remote electronic device to display the meeting content, the user of the remote electronic device will not be able to understand the meeting content displayed by the second electronic device.

[0132] In some application scenarios, screen devices in offline meeting rooms can have functions such as adding markers, annotations, and drawing, allowing users to add new content to the meeting content displayed on the screen. However, because the screen device cannot interact with the remote electronic device to exchange meeting content, users of the remote electronic device cannot understand the meeting content displayed on the screen.

[0133] This application provides a content processing method and related equipment, which enables remote electronic devices to obtain meeting content in a timely manner.

[0134] As shown in Figure 2, the application scenario of the content processing method provided in this embodiment may include a first participating device and a screen device. The forms of the first participating device and the screen device in Figure 2 are for illustrative purposes only and are not intended to limit the specific devices.

[0135] The first participating device can project content onto a screen device. Remote participating devices are referred to as second participating devices. The first and second participating devices can interact on an online platform. Optionally, there can be one or more second participating devices.

[0136] The primary participating device can act as a content sending terminal, and the screen device can act as a content receiving terminal. The primary participating device can project meeting content onto the screen device, and the screen device can display the projected meeting content. In some possible application scenarios, the primary participating device can be a mobile phone, tablet computer, personal computer, handwriting tablet, television, etc. The screen device can be a monitor, all-in-one computer, tablet computer, personal computer, television, game console, or other large-screen device. It is understood that, in addition to the primary participating device and screen device, the content sending terminal and content receiving terminal can have other names, such as the content sending terminal being an active projection device and the content receiving terminal being a passive projection device; or the content sending terminal being the main device and the content receiving terminal being the auxiliary device; or the content sending terminal being the source device and the content receiving terminal being the target device, etc. This application does not limit these terms.

[0137] The first participating device can be an electronic device such as a computer or portable electronic device. Optionally, the first participating device can be implemented as a mobile phone, tablet computer, portable computer, wearable device with wireless communication function (such as smartwatch, smart glasses, smart bracelet, or smart helmet, etc.), or vehicle-mounted device, etc. Exemplary embodiments of the first participating device include, but are not limited to, carrying... Or other electronic devices with different operating systems. Screen devices can be tablets, personal computers, televisions, business all-in-one machines, interactive all-in-one machines with touch functionality, and other large-screen devices.

[0138] In one possible implementation, the first participating device and the screen device can be communicatively connected.

[0139] In some examples, the first participating device and the screen device can communicate wirelessly. Optionally, the first participating device and the screen device can achieve wireless communication based on any existing wireless communication technology. In some possible ways, the first participating device and the screen device can connect wirelessly based on Wi-Fi technology. Both the first participating device and the screen device are connected within the same local area network. In other possible ways, one of the first participating device or the screen device has a Wi-Fi hotspot function, and the other device can connect to this hotspot to achieve a wireless communication connection between the first participating device and the screen device. Optionally, the first participating device may include a screen projector. Alternatively, the first participating device can connect to a screen projector. The screen projector can communicate with the screen device, such as through a wireless or wired communication connection. The screen projector can be used to pair with the screen device, enabling the device connected to the screen projector (i.e., the first participating device) to project its screen onto the screen device.

[0140] In some examples, a communication connection is established between the first participating device and the screen device, and the projected content can be transmitted between them based on a conference protocol. Conference display protocols may include, but are not limited to: the Miracast wireless display standard protocol, the Digital Living Network Alliance (DLNA) protocol, and proprietary conference protocols. Proprietary conference protocols can be compatible with conferences running one or more operating systems.

[0141] In some examples, the first participating device and the screen device can exchange data based on communication technologies such as UDP, TCP, UDT, and WebSocket.

[0142] In some examples, there is a wired connection between the first participating device and the screen device. Alternatively, the first participating device and the screen device may transmit meeting content via a High Definition Multimedia Interface (HDMI).

[0143] Figure 3 illustrates an exemplary content processing method that can be executed by a first participating device. The method may include the following steps:

[0144] S301, the first participating device projects the first content onto the screen device and simultaneously receives the second content provided by the screen device.

[0145] In some application scenarios, the operation of the first participating device projecting the first content onto the screen device is synchronized with the operation of the first participating device receiving the second content. "Synchronization" can include, but is not limited to, the same moment, the same time period, or the same cycle. Alternatively, "synchronization" can be understood as two operations occurring within a certain period of time, which can be considered synchronous. The length of this period can be pre-configured.

[0146] In some examples, the first participating device projects first content onto the screen device while simultaneously receiving second content from the screen device. In other words, the actions of the first participating device projecting the first content onto the screen device and receiving the second content from the screen device occur simultaneously. Alternatively, the first participating device can receive the second content from the screen device in parallel while projecting the first content.

[0147] In some application scenarios, the first and second content can be synchronized. The first content can be a single frame from a multi-frame sequence, denoted as the first frame. The second content can also be a single frame from a multi-frame sequence, denoted as the second frame. The first and second frames are "synchronized," which can be, but is not limited to, the transmission time of the first frame and the reception time of the second frame being the same moment, or the interval between the transmission time of the first frame and the reception time of the second frame being within a preset interval, or the reception time of the second frame being within the period to which the transmission time of the first frame belongs.

[0148] In some examples, the time when the first frame is sent and the time when the second frame is received may not be the same.

[0149] S302, the first participating device creates a virtual camera.

[0150] S303, the first participating device generates the target content corresponding to the virtual camera based on the second content.

[0151] The first parameter device and the screen device can use, but are not limited to, any of the aforementioned communication methods to interact with each other.

[0152] Optionally, the first participating device can capture the first screen displayed on its screen through screen recording, then encode it into a video stream and provide it to the screen device. The first content can be generated based on the first screen. Alternatively, the first participating device can send the first content as a file to the screen device so that the screen device can display the first content, thus enabling the first participating device to project the first content onto the screen device. Optionally, the file type mentioned above can include, but is not limited to, Word, PPT, image, and video formats.

[0153] Optionally, the screen device can also capture the second screen displayed on the screen device via screen recording, and then encode it into a video stream for the first participating device. The second content can be generated based on the second screen. Alternatively, the screen device can send the second content as a file to the first participating device so that the first participating device can access the screen display. Optionally, the file type of the aforementioned file can include, but is not limited to, Word, PPT, images, and videos.

[0154] In one possible implementation, the first participating device may create a virtual camera using, but is not limited to, any of the following examples.

[0155] In one example, the virtual camera created by the first participating device could be an AVStream-based virtual camera. Alternatively, the virtual camera created by the first participating device could be a UVC-based virtual camera.

[0156] In other examples, the first participating device creates a virtual camera based on the DirectShow framework. The first participating device can register the virtual camera component using the DirectShow framework. The first participating device can provide information about the filters corresponding to the virtual camera. The conferencing application can obtain the filters corresponding to the virtual camera as a data source for acquiring camera data.

[0157] Typically, both virtual and physical cameras are recorded in the system device list. The conferencing application can retrieve information about the virtual camera from this list. The video data from the virtual camera is the target content.

[0158] Generally, when a meeting application selects a physical camera, taking Android as an example, it invokes the underlying camera driver and hardware through the camera HAL layer to start recording video. Based on the location of the camera source data according to the HAL specification, it can obtain the image data captured by the physical camera.

[0159] When a virtual camera is selected in the meeting application, the image data corresponding to the virtual camera can be obtained through the pre-configured virtual camera driver. This image data is the target content obtained by the first participating device based on the second content.

[0160] Optionally, the first participating device can use the received second content as the target content. The second content is in the form of a video stream. In some examples, the first participating device can decode the video stream of the second content and then provide it to the virtual camera driver, allowing the conferencing application to obtain the second content from the storage space corresponding to the virtual camera driver. In some examples, the first participating device can directly provide the second content to the virtual camera driver, which will then decode the video stream of the second content and write it to the corresponding storage space, awaiting retrieval by the conferencing application.

[0161] Alternatively, the first participating device can generate target content based on the second content. The target content can be in the form of a video stream. The first participating device can decode the video stream of the target content and provide it to the virtual camera driver. The conferencing application can then retrieve the target content from the storage space corresponding to the virtual camera driver. In some examples, the first participating device can directly provide the target content to the virtual camera driver, which will then decode the target content video stream and write it to the corresponding storage space, awaiting retrieval by the conferencing application.

[0162] In this embodiment, the conferencing application can obtain target content through information from a virtual camera, including but not limited to directly obtaining the target content and indirectly obtaining the target content. Indirectly obtaining the target content can refer to retrieving the target content from a preset storage space through methods such as address-based interface calls. This embodiment does not specifically limit this method.

[0163] In one possible implementation, the second content that the screen device can provide to the first participating device may include, but is not limited to, one or more forms of text, images, and videos.

[0164] In one example, the screen device can capture YUV data of a mirrored image that is the same as the screen device's current display by creating a virtual display object using the createVirtualDisplay function of the MediaProjection screen recording API provided by the Android system.

[0165] In other examples, the screen device can be displayed through the API interface provided by the native window in the Android system. Using the recording function of a screen mirroring component such as the droidlogic module, the YUV data of the screen device's display can be obtained.

[0166] In other examples, the screen device can display one or more windows. The screen device can record the screen of any one of the windows.

[0167] In this embodiment, the screen displayed on the screen device may include, but is not limited to, meeting content provided by the first participating device, meeting content provided by other participating devices, and markers. Markers can be understood as content added by the user on the screen device, and may include, but is not limited to, text, symbols, punctuation, lines, annotations, graphics, and highlighted elements.

[0168] In one possible implementation, the second content is generated based on the target display content of the screen device.

[0169] In some examples, the target display content of the screen device can be part or all of the content displayed on the screen device. For example, the screen device display screen may include one or more windows. Referring to Figure 4A, the target display content can be the content of any window. The screen display device can record the screen of any window to obtain the target display content. It is evident that the recorded content of a window can be used as the target display content. Referring to Figure 4B, the target display content can be the entire content of the display screen; the screen display device can record the desktop to obtain the target display content. It is evident that the recorded desktop content can be used as the target display content.

[0170] In one possible implementation, the second content is in video format. To ensure that the first participating device can promptly access the content provided by the screen device, the screen device can provide the second content to the first participating device as a video stream. Optionally, the second content may include one or more video streams.

[0171] In one possible implementation, the first participating device projects first content onto the screen device. The screen device can display the first content. This design can meet the user's need to view the first content using the screen device. The target display content can be generated based on the first content. For example, if the screen device's desktop or window displays the first content, the target display content generated by the screen device through desktop or window recording can include the first content. Referring to Figure 5A, the screen device displays the first content. The target display content generated when the screen device performs desktop or window recording includes the first content.

[0172] In one possible design, the second content may be generated based on the third content provided by the target electronic device to the screen device.

[0173] In one possible implementation, the first participating device projects first content onto the screen device. The screen device can display the first content. The target electronic device can project third content onto the screen device. This target electronic device is not necessarily the electronic device participating in the online meeting; in other words, the target electronic device may not be the first participating device, nor may it be the second participating device. The target electronic device can be understood as any electronic device other than the first participating device that projects content onto the screen device.

[0174] The target electronic device can be understood as an electronic device in an offline meeting environment. The screen device can also display third-party content. This design meets the user's need to view third-party content using the screen device. The target display content generated by the screen device through desktop or window recording can include third-party content. Referring to Figure 5B, the screen device displays third-party content. The screen device can also display markers added by the user. The target display content generated when the screen device performs desktop or window recording includes third-party content. Optionally, the target display content can also include first-party content.

[0175] In some examples, the first participating device projects first content onto the screen device, and the target electronic device projects third content onto the screen device. The screen device can display content according to the projection order. Referring to Figure 5C, the first participating device first projects the first content onto the screen device, and the screen device displays the first content in a preset window. Then, the target electronic device projects the third content onto the screen device, and the screen device displays the third content in the preset window.

[0176] In some examples, the first participating device projects first content onto the screen device, while the target electronic device projects third content onto the screen device. The screen device can display the first and third content simultaneously. Referring to Figure 5D, the screen device can perform split-screen display within a preset window.

[0177] In one possible implementation, the first participating device projects first content onto the screen device. The screen device can display the first content. The target electronic device can send third content to the screen device. This target electronic device is not an electronic device participating in the online meeting. In other words, the target electronic device may not be the first participating device, nor the second participating device. The target electronic device can be understood as any electronic device other than the first participating device that projects content onto the screen device. The target electronic device can also be understood as an electronic device in an offline meeting environment. The screen device may also not display the third content. The screen device continues to display the first content and generates second content based on the third content. For example, the screen device can use the third content as the second content, or the screen device can generate second content based on the third content and other content, and send it to the first participating device, so that the first participating device can receive content provided by the target electronic device.

[0178] In this embodiment, the screen device, as the device being projected onto, can establish connections with multiple active projection devices to obtain content provided by each active projection device. However, no connection is established between the active projection devices. To enable the second participating device to obtain content provided by the target electronic device, the screen device can use third content as the second content, or the screen device can generate second content based on the third content and other content, and send it to the first participating device.

[0179] Based on any of the above embodiments, the screen device may also display markers added by the user on the screen device. The target display content may also include markers.

[0180] Based on any of the above embodiments, the screen device may have a camera function. The second content may be determined based on the first image captured by the screen device.

[0181] In some examples, the second content may consist only of the first image. The second content can be implemented as a video format, with each frame of the first image being a video frame captured by the screen device. The bitstream of the video captured by the screen device can be implemented as the second content, and the screen device sends the bitstream of its captured video to the first participating device.

[0182] In other examples, the second content that the screen device can provide may be generated based on the target display content, and the second content may be generated based on the first image. In other words, the second content may be generated based on both the target display content and the first image.

[0183] In one possible design, the second content can include multiple parts. For example, the second content can be implemented as a multi-stream. The screen device can generate a first stream by recording the screen from a desktop or a window, and then generate a second stream of the video it is recording. The target display content can be video frames from the first stream, and the first image can be video frames from the second stream. The second content can include both the first and second streams.

[0184] In one possible design, the second content can be implemented as a single entity. For example, the second content can be implemented as a file, an image, etc. Alternatively, the second content can be implemented as a video stream. The screen device can generate video frames from this stream. The screen device can arrange the target display content and the first image according to a preset method to obtain the second content. The preset method includes any of the following arrangement methods:

[0185] The first image is arranged side by side with the target display content;

[0186] The first image is superimposed on the target display content.

[0187] Referring to Figure 6A, the first image and the target display content can be arranged side by side. Referring to Figure 6B, the first image and the target display content can be superimposed, wherein the first image is superimposed on the target display content, and the proportion of the first image in the second content is smaller than the proportion of the target display content in the second content.

[0188] Referring to Figure 6C, the first image and the target display content can be superimposed, wherein the target display content is superimposed on the first image, and the proportion of the target display content in the second content is less than the proportion of the first image in the second content.

[0189] The second content can be implemented as a video format, where each frame includes the target display content acquired through synchronized screen recording and the first image.

[0190] In one possible implementation, the second content is generated based on the target display content displayed on the screen device and the first image captured by the screen device.

[0191] The target display content and the first image can be transmitted via one or more video streams.

[0192] In one possible implementation, in step S303 above, the first participating device generates target content corresponding to the virtual camera based on the second content, including:

[0193] The first participating device merges the target display content with the first image.

[0194] The first participating device can fuse the target display content in the second content with the first image to obtain the target content corresponding to the virtual camera.

[0195] The first participating device may perform fusion processing on the target display content and the first image in the second content, including but not limited to arranging the target display content and the first image according to a preset method to obtain the target content. The preset method includes any of the following arrangement methods: the first image and the target display content are arranged side by side; the first image and the target display content are arranged superimposed.

[0196] In one possible implementation, during step S303 above, in the operation where the first participating device generates the target content corresponding to the virtual camera based on the second content:

[0197] The first participating device merges the first content and the second content to obtain the target content.

[0198] The first participating device can merge the first content and the second content, which can be arranged in a preset manner to obtain the target content. The preset manner includes any of the following arrangement methods:

[0199] The first content and the second content are arranged side by side;

[0200] The first content and the second content are arranged on top of each other.

[0201] Referring to Figure 7A, the first content and the second content can be arranged side by side. Referring to Figure 7B, the first content and the second content can be superimposed, wherein the first content is superimposed on the second content, and the proportion of the first content in the target content is less than the proportion of the second content in the target content.

[0202] Referring to Figure 7C, the first content and the second content can be superimposed, wherein the second content is superimposed on the first content, and the proportion of the second content in the target content is less than the proportion of the first content in the target content.

[0203] The first participating device can merge the first content with the integrated second content to obtain the target content.

[0204] In one possible implementation, in step S303 above, the first participating device generates target content corresponding to the virtual camera based on the second content, including:

[0205] The first participating device merges the target display content in the second content with the first image; and the first participating device merges the first content with the second content to obtain the target content.

[0206] The first participating device can integrate the second content by fusing the target display content with the first image to obtain the integrated second content. The first participating device can also arrange the target display content and the first image according to a preset method to obtain the integrated second content. The preset method includes any of the following arrangements: the first image and the target display content are arranged side-by-side; the first image and the target display content are arranged superimposed.

[0207] The first participating device can merge the first content with the integrated second content to obtain the target content. The operation of merging the first content with the integrated second content to obtain the target content can be found in the relevant description of the foregoing embodiments, and will not be repeated here.

[0208] In one possible implementation, the first participating device has a shooting function. The first participating device can capture a second image. The first participating device can shoot video, and each frame of the second image is also a video frame captured by the first participating device.

[0209] In step S303 above, the first participating device generates target content corresponding to the virtual camera based on the second content, including:

[0210] The first participating device merges the acquired second image with the second content to obtain the target content.

[0211] The first participating device can capture its own footage, reflecting the offline meeting environment, such as attendees and meeting effectiveness. This footage can then be combined with the content displayed on the screen to create a unified view for the second participating device, allowing them to see both the offline meeting environment and the current screen content.

[0212] The first participating device merges the first content and the second content to obtain the target content.

[0213] The first participating device can fuse the second image and the second content, which can be arranged in a preset manner to obtain the target content, including but not limited to the following arrangements:

[0214] The second image is arranged side by side with the second content;

[0215] The second image is superimposed on the second content.

[0216] Referring to Figure 7D, the second image and the second content can be arranged side by side. Referring to Figure 7E, the second image and the second content can be superimposed, wherein the second image is superimposed on the second content, and the proportion of the second image in the target content is smaller than the proportion of the second content in the target content.

[0217] Referring to Figure 7F, the second image and the second content can be superimposed, wherein the second content is superimposed on the second image, and the proportion of the second content in the target content is less than the proportion of the second image in the target content.

[0218] In one possible implementation, the second content includes a first image captured by the screen device.

[0219] The first participating device generates target content corresponding to the virtual camera based on the second content, including:

[0220] The first participating device fuses the first content with the first image to obtain the target content.

[0221] The first image captured by the screen device can reflect the situation in the offline meeting environment, such as the participants and the meeting's effectiveness. Furthermore, the first image captured by the screen device has a good viewing angle, reflecting more information about the offline meeting environment. The first participating device can fuse the first content with the first image, which can be arranged, but is not limited to, according to a preset method, to obtain the target content. The preset method includes any of the following arrangement methods:

[0222] The first content and the second content are arranged side by side;

[0223] The first content and the second content are arranged on top of each other.

[0224] Based on the content processing method provided in any of the above embodiments, the first participating device can send the target content corresponding to the virtual camera to the second participating device.

[0225] In some examples, the conferencing application in the first participating device can send the content corresponding to the selected camera device to the second participating device in response to the second participating device's selection of a camera device.

[0226] For example, the meeting application in the first participating device can send the target content corresponding to the virtual camera to the second participating device in response to the second participating device selecting the virtual camera.

[0227] In some examples, the conference application in the first participating device can receive camera indication information provided by the second participating device and send the content corresponding to the camera indicated by the camera indication information to the second participating device.

[0228] For example, the conference application in the first participating device can send target content to the second participating device in response to target camera indication information provided by the second participating device. Here, the target camera indication information indicates the virtual camera.

[0229] In some application scenarios, based on the content processing method provided in any of the foregoing embodiments, the first participating device can send the first content and / or the second content to the second participating device.

[0230] The first participating device sends the first content to the second participating device, allowing the user of the second participating device to know the current content projected by the first participating device. The first participating device then sends the second content to the second participating device, allowing the user of the second participating device to know the current content displayed on the screen.

[0231] In some examples, during the operation where the first participating device sends the first content to the second participating device, the first participating device sends the first content to the second participating device via window sharing.

[0232] In some examples, during the operation of the first participating device sending the second content to the second participating device, the first participating device may send the second content to the second participating device via camera sharing.

[0233] Through the conference application on the first participating device, users can select a primary sharing method, such as the screen sharing option. After selecting the screen sharing option, users can select a window on their screen and send the content of the selected window as the primary content to the first participating device, thus achieving window sharing.

[0234] Through the conferencing application on the first participating device, users can choose a second sharing method. If the sharing option is selected, an external video source can be chosen in the shared content selection. The external video source option displays a list of system devices. This list includes information on virtual and physical cameras. Users can select any camera, and the conferencing application can access the corresponding video data to achieve camera sharing. The video data from a physical camera consists of the video frames captured by that camera. The video data from a virtual camera is the target content.

[0235] Figure 8 illustrates an exemplary content processing method that can be executed by a first participating device. The method may include the following steps:

[0236] S801, the first participating device receives the second content provided by the screen device.

[0237] S802, the first participating device creates a virtual camera.

[0238] S803, the first participating device generates the target content corresponding to the virtual camera based on the second content.

[0239] In this embodiment, the first participating device is communicatively connected to the screen device. The first participating device can receive the second content provided by the screen device. The first participating device generates target content based on the second content, which serves as image data for the virtual camera, facilitating the meeting application to access the camera data. In step S801, the first participating device only receives the second content provided by the screen device. Compared to the previous embodiment, in this embodiment, the first participating device may not project the first content onto the screen device. The execution process of steps S802 and S803 in this embodiment can be found in the relevant descriptions in the previous embodiments, and will not be repeated here. In this embodiment, the processing method of the second content can be found in the processing method of the second content in the previous embodiments, and will not be repeated here. Some technical details in this embodiment are the same as those in the previous embodiments, and will not be repeated here, but can be found in the relevant descriptions in the previous embodiments.

[0240] In one possible design, the second content is generated based on the target display content of the screen device.

[0241] In one possible design, the target display content is the desktop screen recording content or the window screen recording content of the screen device.

[0242] In one possible design, the second content is in video format. Optionally, the second content may include one stream or multiple streams.

[0243] In one possible design, the target display content is generated based on the first content.

[0244] In one possible design, the second content is generated based on third content provided by the target electronic device to the screen device.

[0245] In some examples, the third content provided by the target electronic device to the screen device can be implemented as the second content.

[0246] In some examples, the second content may be generated based on the target display content and the third content. Optionally, the second content may include the bitstream corresponding to the target display content and the bitstream corresponding to the third content.

[0247] In some examples, the second content may be generated based on the target display content, the first image, and the third content. Optionally, the second content may include the bitstream corresponding to the target display content, the bitstream corresponding to the first image, and the bitstream corresponding to the third content.

[0248] In one possible design, the screen device has a camera function; the second content is generated based on the first image captured by the screen device.

[0249] In one possible design, the second content is generated based on the target display content displayed on the screen device and the first image captured by the screen device; wherein, in the second content, the target display content and the first image are arranged in a preset manner.

[0250] In one possible design, the preset method includes any of the following arrangements:

[0251] The first image is arranged side by side with the target display content;

[0252] The first image is superimposed on the target display content.

[0253] In one possible design, the first image is superimposed on the target display content, and the first image is superimposed on the target display content, wherein the proportion of the first image in the second content is smaller than the proportion of the target display content in the second content;

[0254] Alternatively, the first image and the target display content are superimposed, with the target display content superimposed on the first image, wherein the proportion of the target display content in the second content is less than the proportion of the first image in the second content.

[0255] In one possible design, the second content is generated based on the target display content displayed on the screen device and the first image captured by the screen device;

[0256] The first participating device generates target content corresponding to the virtual camera based on the second content, including:

[0257] The first participating device merges the target display content with the first image.

[0258] In one possible design, where the first participating device generates the target content corresponding to the virtual camera based on the second content, it further includes:

[0259] The first participating device merges the first content and the second content to obtain the target content.

[0260] In one possible design, the first participating device has a shooting function;

[0261] The first participating device generates target content corresponding to the virtual camera based on the second content, and further includes:

[0262] The first participating device merges the acquired second image with the second content to obtain the target content.

[0263] In one possible design, the second content includes a first image captured by the screen device;

[0264] The first participating device generates target content corresponding to the virtual camera based on the second content, including:

[0265] The first participating device fuses the first content with the first image to obtain the target content.

[0266] In one possible design, the first participating device creates a virtual camera, including:

[0267] Register a virtual camera in the system;

[0268] Add the information of the virtual camera to the system device list;

[0269] The method further includes:

[0270] The target content corresponding to the virtual camera is provided to the virtual camera driver.

[0271] In one possible design, the method further includes:

[0272] The first participating device sends the first content and / or the second content to the second participating device.

[0273] In one possible design, where,

[0274] The first participating device sends the first content to the second participating device, including:

[0275] The first participating device sends the first content to the second participating device via window sharing.

[0276] The first participating device sends the second content to the second participating device, including:

[0277] The first participating device sends the second content to the second participating device via camera sharing.

[0278] In addition, this application also provides a content processing method that can be applied to screen devices.

[0279] As shown in Figure 9, the method may include the following steps:

[0280] S901, the screen device determines the second content.

[0281] S902, the screen device sends the second content to the first participating device.

[0282] In this embodiment, the processing method for the second content is the same as that in the foregoing embodiments, and will not be repeated here. Some technical details in this embodiment are the same as those in the foregoing embodiments, and will not be repeated here, but can be found in the relevant descriptions in the foregoing embodiments.

[0283] In one possible implementation, during step S902, when the screen device determines the second content, the following process may be performed:

[0284] The screen device determines target display content, wherein the second content includes the target display content, or the second content is generated based on the target display content;

[0285] The target display content is either the desktop recording content or the window recording content of the screen device.

[0286] In one possible implementation, the content processing method provided in this application embodiment includes first content provided by the first participating device and / or third content provided by the target electronic device to the screen device. The target electronic device can send the third content to the screen device. This target electronic device is not an electronic device participating in the online meeting. In other words, the target electronic device may not be the first participating device, nor may it be the second participating device. The target electronic device can be understood as any electronic device other than the first participating device that projects content to the screen device.

[0287] In one possible implementation, the content processing method provided in this application embodiment includes a screen device with a shooting function; the second content is generated based on a first image captured by the screen device.

[0288] In one possible implementation, in the content processing method provided in this application embodiment, the screen device has a shooting function; the second content is generated based on the target display content and the first image captured by the screen device, wherein the target display content is the desktop screen recording content or window screen recording content of the screen device.

[0289] Based on the content processing method performed by the first participating device and the content processing method provided by the screen device provided in the foregoing embodiments, this application embodiment describes the working process of the first participating device and the screen device in conjunction with a meeting scenario.

[0290] In some meeting scenarios, the primary participating device can act as a content provider. It can project initial content onto a screen device for display. Users can then add tags to the screen device. Alternatively, the target electronic device can also act as a meeting provider, projecting third-party content onto the screen device for display.

[0291] Both the first and second participating devices are for online meetings. To allow the second participating device to stay informed about the content displayed on the screen or the situation in the offline meeting environment, the screen can send the second content to the first participating device. Optionally, the first participating device can use the second content as image data from a virtual camera, or it can generate target content based on the second content and use that target content as image data from the virtual camera, so that the meeting application in the first participating device can access the virtual camera's image data and provide it to the second participating device.

[0292] The first and second participating devices can transmit data directly or indirectly. For example, the first participating device can directly transmit data to the second participating device, or the first participating device can transmit data to the second participating device through the cloud or a server.

[0293] In some meeting scenarios, the meeting content displayed on the screen device can be provided by the target electronic device. Users can add tags to the screen device. Both the first and second participating devices are online meeting participants. To ensure that the second participating device can be aware of the content displayed on the screen device or the situation in the offline meeting environment, the screen device can send the second content to the first participating device. Optionally, the first participating device can use the second content as image data from a virtual camera, or the first participating device can generate target content based on the second content and use the target content as image data from a virtual camera, so that the meeting application in the first participating device can access the virtual camera's image data and provide it to the second participating device.

[0294] This application provides a screen device, as shown in FIG10, which may include a first communication module and a first processing module.

[0295] The first communication module can communicate with any electronic device for data transmission. Optionally, the communication methods supported by the first communication module may include, but are not limited to, wired networks, wireless networks, Bluetooth, and other communication lines. The first communication module can use, but is not limited to, communication protocols such as UDP, TCP, UDT, and WebSocket to establish a connection with the electronic device and transmit data.

[0296] The first processing module can determine or generate the second content. In one possible design, the operating system of the screen device is Android. The first processing module can use the SurfaceComposerClient component of the Android system to create a display device client to connect to SurfaceFlinger, thereby obtaining a Surface object. As a consumer, it can obtain the data of the currently rendered interface of the screen device, thus obtaining the content being displayed on the screen device. In another possible design, the screen device can create a VirtualDisplay device through the Native layer to obtain Surface display data and obtain the content being displayed on the screen device.

[0297] In one possible design, the screen device may have a camera function. The second content may include a target display content and a first image. The target display content may be the content currently displayed on the screen device. The first image is an image captured by the screen device.

[0298] The first processing module can also have a video stitching function. When video stitching is required, YUV or RGB video data can be merged using FFmpeg's filter methods, including overlay and horizontal stitching. A filter is a software tool that modifies unencoded raw audio and video data frames. FFmpeg has integrated a variety of filters and supports multiple inputs and outputs. The first processing module can also use video stitching to horizontally stitch or overlay the target display content with the first image to obtain the second content.

[0299] The screen device may also include a first encoding / decoding module. This module encodes the second content to obtain video stream data, which is then transmitted to the first participating device via a first communication module. Optionally, the video stream may be an H.264 bitstream.

[0300] This application provides an electronic device, as shown in FIG11A, which may include a second communication module and a second processing module.

[0301] The second communication module can communicate with any electronic device for data transmission. Optionally, the communication methods supported by the second communication module may include, but are not limited to, wired networks, wireless networks, Bluetooth, etc. The second communication module can use, but is not limited to, communication protocols such as UDP, TCP, UDT, WebSocket, etc., to establish a connection with the electronic device and transmit data.

[0302] In some examples, the second communication device can perform device discovery. As shown in Figure 11B, the second communication module can send a discovery broadcast frame 1 via UDP, the frame content including its own IP and MAC information. After the first communication module of the screen device listens for and receives the discovery broadcast frame, it sends a response frame 2 via UDP, including its own IP and ID information. After receiving the response frame 2, the electronic device saves the relevant information of the screen device for subsequent operations. The second communication module can establish a TCP connection with the first communication module of the screen device to exchange control commands. The second communication module can receive the bitstream data of the second content transmitted by the first communication module via the RTP protocol.

[0303] The second processing module has the function of creating a virtual camera. The method for creating a camera can be found in the relevant description in the foregoing embodiments.

[0304] Optionally, the second processing module can use the second content as the target content corresponding to the virtual camera. The second processing module can provide the bitstream of the second content to the virtual camera driver, which decodes it to serve as the virtual camera's image data. Optionally, the second processing module may also include a shared memory module. Since the virtual camera's image data may occupy a large amount of space, the second processing module can use the shared memory module, allowing the virtual camera driver to write the decoded data into the shared memory module for use by the conferencing software.

[0305] Alternatively, the second processing module can generate target content corresponding to the virtual camera based on the second content. The electronic device may include a second encoding / decoding module. This module can decode the video stream of the second content. The electronic device can then generate the target content based on the decoded second content and provide it to the virtual camera driver.

[0306] This application embodiment provides a working process between a first participating device and a screen device, as shown in Figure 12. The first participating device and the screen device establish a connection. The first participating device requests second content from the screen device. The screen device sends the second content to the first participating device. The first participating device can generate target content corresponding to a virtual camera based on the second content, and share the target content with the virtual camera driver as the image data of the virtual camera. The meeting application can then access this virtual camera image data.

[0307] On the other hand, this application also provides an electronic device that can execute the steps or operations performed by the first participating device in any of the foregoing embodiments.

[0308] On the other hand, embodiments of this application also provide an electronic device that can perform the steps or operations performed by the screen device in any of the foregoing embodiments.

[0309] Based on the same concept, Figure 13 is a schematic diagram of the structure of an electronic device 1800 provided in an embodiment of this application. The electronic device 1800 may be the first participating device or screen device mentioned above. As shown in Figure 13, the electronic device 1800 may include: one or more processors 1801; one or more memories 1802; a communication interface 1803; and one or more computer programs 1804. These devices can be connected via one or more communication buses 1805. The one or more computer programs 1804 are stored in the memory 1802 and configured to be executed by the one or more processors 1801. The one or more computer programs 1804 include instructions. For example, these instructions can be used to execute relevant steps of the main device as described in the corresponding embodiments above. The communication interface 1803 is used to enable communication between the main device and other devices (such as target devices); for example, the communication interface may be a transceiver.

[0310] Based on the same concept, this application also provides a conference display system. The conference display system includes a first participating device and a screen device. For example, the first participating device can be a mobile phone, tablet computer, PC, watch, or other device with a display screen. The screen device can be an all-in-one computer, tablet computer, PC, television, or other large-screen device. The structures of the first participating device and the screen device are shown in Figure 13. For instance, when the electronic device 1800 shown in Figure 13 is the first participating device, when the instructions of one or more computer programs 1804 are executed by the processor, the first participating device performs the steps described above. When the electronic device 1800 shown in Figure 13 is the screen device, when the instructions of one or more computer programs 1804 are executed by the processor, the screen device performs the steps described above.

[0311] In the embodiments provided above, the methods provided by this application are described from the perspective of an electronic device (e.g., a first participating device or a screen device) as the executing entity. To implement the functions of the methods provided in the embodiments of this application above, the electronic device may include hardware structures and / or software modules, implementing the above functions in the form of hardware structures, software modules, or a combination of hardware structures and software modules. Whether a particular function is implemented in the form of hardware structures, software modules, or a combination of hardware structures and software modules depends on the specific application and design constraints of the technical solution.

[0312] Additionally, embodiments of this application provide a computer-readable storage medium for storing a computer program that, when run on a computer, causes the computer to perform steps in any of the above-described conference display methods, such as executing a conference display method executed by a first participating device, and / or, such as executing a conference display method executed by a screen device.

[0313] In the above embodiments, the terms "when..." or "after..." can be interpreted, depending on the context, as meaning "if...", "after...", "in response to determining...", or "in response to detecting...". Similarly, the phrases "when..." or "if (the stated condition or event) is detected" can be interpreted, depending on the context, as meaning "if...", "in response to determining...", "when (the stated condition or event) is detected", or "in response to detecting (the stated condition or event)". Furthermore, in the above embodiments, relational terms such as "first" and "second" are used to distinguish one entity from another, without limiting any actual relationship or order between these entities.

[0314] References to "one embodiment" or "some embodiments" as described in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0315] In the above embodiments, the implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented, in whole or in part, in the form of a computer program product.

[0316] This application also provides a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this invention are generated. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium may be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state disk (SSD)). Where there is no conflict, the solutions of the above embodiments can be combined.

Claims

1. A content processing method, wherein, The method includes: The first participating device projects the first content onto the screen device and simultaneously receives the second content provided by the screen device. The first participating device is communicatively connected to the screen device. The first participating device creates a virtual camera; The first participating device generates the target content corresponding to the virtual camera based on the second content.

2. The method as described in claim 1, wherein, The second content is generated based on the target display content of the screen device.

3. The method as described in claim 2, wherein, The target display content is the desktop screen recording content or window screen recording content of the screen device.

4. The method of claim 2, wherein, The second content is in video format.

5. The method of claim 2, wherein, The target display content is generated based on the first content.

6. The method as described in claim 1 or 2, wherein, The second content is generated based on the third content provided by the target electronic device to the screen device.

7. The method as described in claim 1 or 2, wherein, The screen device has a camera function; The second content is generated based on the first image captured by the screen device.

8. The method of claim 1, wherein, The second content is generated based on the target display content displayed on the screen device and the first image captured by the screen device; In the second content, the target display content and the first image are arranged in a preset manner.

9. The method of claim 8, wherein, The preset method includes any of the following arrangements: The first image is arranged side by side with the target display content; The first image is superimposed on the target display content.

10. The method of claim 8 or 9, wherein, The first image is superimposed on the target display content, and the first image is superimposed on the target display content, wherein the proportion of the first image in the second content is smaller than the proportion of the target display content in the second content; Alternatively, the first image and the target display content are superimposed, with the target display content superimposed on the first image, wherein the proportion of the target display content in the second content is less than the proportion of the first image in the second content.

11. The method of claim 1, wherein, The second content is generated based on the target display content displayed on the screen device and the first image captured by the screen device; The first participating device generates target content corresponding to the virtual camera based on the second content, including: The first participating device merges the target display content with the first image.

12. The method as claimed in claim 1 or 11, wherein, The first participating device generates target content corresponding to the virtual camera based on the second content, and further includes: The first participating device merges the first content and the second content to obtain the target content.

13. The method as claimed in claim 1 or 11, wherein, The first participating device has a shooting function; The first participating device generates target content corresponding to the virtual camera based on the second content, and further includes: The first participating device merges the acquired second image with the second content to obtain the target content.

14. The method of claim 1, wherein, The second content includes the first image captured by the screen device; The first participating device generates target content corresponding to the virtual camera based on the second content, including: The first participating device fuses the first content with the first image to obtain the target content.

15. The method of claim 1, wherein, The first participating device creates a virtual camera, including: Register a virtual camera in the system; Add the information of the virtual camera to the system device list; The method further includes: The target content corresponding to the virtual camera is provided to the virtual camera driver.

16. The method of claim 1 or 15, wherein, The method further includes: The first participating device sends the first content and / or the second content to the second participating device.

17. The method of claim 16, wherein, The first participating device sends the first content to the second participating device, including: The first participating device sends the first content to the second participating device via window sharing. The first participating device sends the second content to the second participating device, including: The first participating device sends the second content to the second participating device via camera sharing.

18. A content processing method, wherein, The method includes: The first participating device receives the second content provided by the screen device, and the first participating device is communicatively connected to the screen device. The first participating device creates a virtual camera; The first participating device generates the target content corresponding to the virtual camera based on the second content.

19. A content processing method, wherein, The method includes: The screen device determines the second content; The screen device sends the second content to the first participating device, and the screen device is communicatively connected to the first participating device.

20. The method of claim 19, wherein, The screen device determines the second content, including: The screen device determines target display content, wherein the second content includes the target display content, or the second content is generated based on the target display content; The target display content is either the desktop recording content or the window recording content of the screen device.

21. The method of claim 20, wherein, The target display content includes the first content provided by the first participating device, and / or the third content provided by the target electronic device to the screen device.

22. The method of claim 19, wherein, The screen device has a camera function; The second content is generated based on the first image captured by the screen device.

23. The method of claim 22, wherein, The screen device has a camera function; The second content is generated based on the target display content and the first image captured by the screen device, wherein the target display content is the desktop screen recording content or window screen recording content of the screen device.

24. An electronic device, wherein, Including memory and processor; The memory is used to store computer program instructions; The processor executes the computer program instructions to perform the method as described in any one of claims 1-23.

25. A computer storage medium, wherein, Includes a computer program, which, when run on an electronic device, causes the electronic device to perform the steps of any of the methods described in claims 1-23.

Images