Screen sharing method, system and device, electronic equipment and storage medium

Abstract

The invention relates to a screen sharing method, system and device, electronic equipment and a storage medium. The method comprises the following steps: a first device determines to share screen display content with a second device; the first device obtains the screen display capability of the second device; processing the screen display content according to the screen display capability of the second equipment to obtain a content file; and sending the content file to the second device. According to the invention, the display effect of screen sharing can be improved.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of image processing, and particularly relates to a screen sharing method, system and device, electronic equipment and storage medium. BACKGROUND

[0002] With the development of application of intelligent devices, more and more users realize information exchange by screen sharing between multiple display devices.

[0003] In the screen sharing scenario, the screen sharing content can correspond to different dynamic ranges, and the screen display capabilities of different display devices can be different, which can cause the problem that the display effects on different display devices are different. SUMMARY

[0004] To overcome the problems in the related art, the present disclosure provides a screen sharing method, system, device, electronic equipment and storage medium.

[0005] According to a first aspect of an embodiment of the present disclosure, a screen sharing method is provided, including: a first device determining to share screen display content with a second device; the first device acquiring screen display capability of the second device; processing the screen display content according to the screen display capability of the second device to obtain a content file; and sending the content file to the second device.

[0006] In some embodiments, the screen display content includes high dynamic range (HDR) content and standard dynamic range (SDR) content; and processing the screen display content according to the screen display capability of the second device to obtain a content file includes: synthesizing the HDR content and the SDR content according to the screen display capability of the second device to obtain the content file.

[0007] In some embodiments, synthesizing the HDR content and the SDR content according to the screen display capability of the second device to obtain a content file includes: if the screen display capability of the second device supports HDR, synthesizing the HDR content and the SDR content based on an HDR encapsulation strategy to obtain the content file; and if the screen display capability of the second device does not support HDR, synthesizing the HDR content and the SDR content based on an SDR encapsulation strategy to obtain the content file.

[0008] In some embodiments, synthesizing the HDR content and the SDR content based on the HDR encapsulation strategy to obtain a content file includes: mapping the SDR content to a container of HDR to obtain a mapping result; and synthesizing based on the mapping result and the HDR content to obtain a content file in an HDR format.

[0009] In some embodiments, the second device includes a plurality of second devices; the processing the screen display content according to the screen display capability of the second device to obtain a content file includes: grouping the plurality of second devices according to the screen display capability of each second device in the plurality of second devices to obtain a plurality of device groups; for each device group, processing the screen display content according to the screen display capability of the second devices in the device group to obtain a content file corresponding to the device group; and the sending the content file to the second device includes: for each device group, sending the content file corresponding to the device group to each second device in the device group.

[0010] In some embodiments, the screen display capability is determined according to at least one of a color gamut, a perceptual quantization curve, a peak brightness, a color temperature, an encoder format and a decoder format corresponding to the second device.

[0011] According to a second aspect of the embodiments of the present disclosure, a screen sharing method is provided, including: a second device sending a screen display capability of the second device to a first device; receiving a content file sent by the first device, the content file being generated according to the screen display capability of the second device and screen display content of the first device; and displaying the screen display content based on the content file.

[0012] In some embodiments, the screen display content includes HDR content and SDR content, the content file is obtained based on an HDR encapsulation strategy, and the screen display capability of the second device is to support HDR; and the displaying the screen display content based on the content file includes: decoding processing the content file, and performing color gamut mapping and tone mapping on a processing result to display the screen display content.

[0013] In some embodiments, the performing color gamut mapping and tone mapping on the processing result includes: converting a color space of the processing result to an LUV space, and performing equal-proportion color gamut mapping in the LUV space; performing semantic segmentation on the processing result to obtain a plurality of segmentation maps and a category corresponding to each segmentation map; and performing local tone mapping on the processing result based on each segmentation map and the category corresponding to each segmentation map.

[0014] In some embodiments, the displaying the screen display content based on the content file comprises: detecting a device state of the second device; in a case that the device state of the second device is a non-default mode, setting a mode of the second device to an HDR highlight mode if the content file comprises HDR content; in a case that the device state of the second device is the non-default mode, setting the mode of the second device to an SDR mode if the content file comprises SDR content.

[0015] In some embodiments, the displaying the screen display content based on the content file comprises: in a case that the first device switches from an SDR mode to an HDR mode, setting a mode of the second device to an HDR highlight mode; in a case that the screen display content of the first device does not comprise HDR content, setting the mode of the second device to an SDR mode.

[0016] In some embodiments, the screen display capability is determined according to at least one of a color gamut, a perceptual quantization curve, a peak brightness, a color temperature, an encoder format and a decoder format corresponding to the second device.

[0017] According to a fourth aspect of the present disclosure, a screen sharing system is provided, comprising: a first device and a second device; wherein the first device is configured to determine to share screen display content with the second device; acquire a screen display capability of the second device; process the screen display content according to the screen display capability of the second device to obtain a content file; and send the content file to the second device; and the second device is configured to receive the content file; and display the screen display content based on the content file.

[0018] In some embodiments, the screen display content comprises high dynamic range (HDR) content and standard dynamic range (SDR) content; and the first device is configured to synthesize the HDR content and the SDR content according to the screen display capability of the second device to obtain the content file.

[0019] In some embodiments, in a case that the screen display capability of the second device supports HDR, the first device synthesizes the HDR content and the SDR content based on an HDR packaging strategy to obtain the content file; and in a case that the screen display capability of the second device does not support HDR, the first device synthesizes the HDR content and the SDR content based on an SDR packaging strategy to obtain the content file.

[0020] In some embodiments, the first device maps the SDR content to a container of the HDR content to obtain a mapping result; and performs a synthesis process based on the mapping result and the HDR content to obtain a content file in the HDR format.

[0021] In some embodiments, the second device includes a plurality of second devices; the first device is configured to group the plurality of second devices according to screen display capabilities of each second device in the plurality of second devices to obtain a plurality of device groups; for each device group, process the screen display content according to screen display capabilities of the second devices in the device group to obtain a content file corresponding to the device group; and for each device group, send the content file corresponding to the device group to each second device in the device group.

[0022] In some embodiments, the screen display capability is determined according to at least one of a color gamut, a perceptual quantization curve, a peak brightness, a color temperature, an encoder format, and a decoder format corresponding to the second device.

[0023] In some embodiments, the screen display content includes HDR content and SDR content, the content file is obtained based on an HDR packaging strategy, and the screen display capability of the second device supports HDR; the second device is configured to decode the content file, and perform color gamut mapping and tone mapping on a processing result to display the screen display content.

[0024] In some embodiments, the second device is configured to convert a color space of the processing result to an LUV space, and perform an equal-proportion color gamut mapping in the LUV space; perform semantic segmentation on the processing result to obtain a plurality of segmentation maps and categories corresponding to each segmentation map; and perform local tone mapping on the processing result based on each segmentation map and the category corresponding to each segmentation map.

[0025] In some embodiments, the second device is configured to detect a device state of the second device; in a case where the device state of the second device is a non-default mode, if the content file includes HDR content, set a mode of the second device to an HDR highlight mode; and in a case where the device state of the second device is the non-default mode, if the content file includes SDR content, set the mode of the second device to an SDR mode.

[0026] In some embodiments, in a case where the first device switches from an SDR mode to an HDR mode, the second device sets the mode of the second device to an HDR highlight mode; and in a case where the screen display content of the first device does not include HDR content, the second device sets the mode of the second device to an SDR mode.

[0027] According to a fourth aspect of the present disclosure, a screen sharing apparatus is provided, comprising: an obtaining unit configured to obtain a screen display capability of a second device; a processing unit configured to determine to share screen display content with the second device; process the screen display content according to the screen display capability of the second device to obtain a content file; and a transceiving unit configured to send the content file to the second device.

[0028] In some embodiments, the screen display content comprises high dynamic range (HDR) content and standard dynamic range (SDR) content; and the processing unit is configured to: perform synthesis processing on the HDR content and the SDR content according to the screen display capability of the second device to obtain the content file.

[0029] In some embodiments, the processing unit is configured to: if the screen display capability of the second device supports HDR, perform synthesis processing on the HDR content and the SDR content based on an HDR encapsulation strategy to obtain the content file; and if the screen display capability of the second device does not support HDR, perform synthesis processing on the HDR content and the SDR content based on an SDR encapsulation strategy to obtain the content file.

[0030] In some embodiments, the processing unit is configured to: map the SDR content to a container of the HDR to obtain a mapping result; and perform synthesis processing based on the mapping result and the HDR content to obtain a content file in an HDR format.

[0031] In some embodiments, the second device comprises a plurality of second devices; and the processing unit is configured to: group the plurality of second devices according to the screen display capability of each second device in the plurality of second devices to obtain a plurality of device groups; for each device group, process the screen display content according to the screen display capability of the second devices in the device group to obtain a content file corresponding to the device group; and the transceiving unit is configured to: for each device group, send the content file corresponding to the device group to each second device in the device group.

[0032] In some embodiments, the screen display capability is determined according to at least one of a color gamut, a perceptual quantization curve, a peak brightness, a color temperature, an encoder format and a decoder format corresponding to the second device.

[0033] According to a fifth aspect of the present disclosure, a screen sharing apparatus is provided, comprising: a transceiving unit configured to send a screen display capability of a second device to a first device; receive a content file sent by the first device, the content file being generated according to the screen display capability of the second device and screen display content of the first device; and a display unit configured to display the screen display content based on the content file.

[0034] In some embodiments, the screen display content includes HDR content and SDR content, the content file is obtained based on an HDR packaging strategy, and the screen display capability of the second device is to support HDR; the apparatus further includes a processing unit configured to: perform decoding processing on the content file, and perform gamut mapping and tone mapping on a processing result to display the screen display content.

[0035] In some embodiments, the processing unit is configured to: convert a color space of the processing result to an LUV space, and perform equal-ratio gamut mapping in the LUV space; perform semantic segmentation on the processing result to obtain a plurality of segmentation maps and a category corresponding to each segmentation map; and perform local tone mapping on the processing result based on each segmentation map and the category corresponding to each segmentation map.

[0036] In some embodiments, the display unit is configured to: detect a device state of the second device; in a case where the device state of the second device is a non-default mode, if the content file includes HDR content, set a mode of the second device to an HDR highlight mode; and in a case where the device state of the second device is the non-default mode, if the content file includes SDR content, set the mode of the second device to an SDR mode.

[0037] In some embodiments, the display unit is configured to: in a case where the first device switches from an SDR mode to an HDR mode, set the mode of the second device to the HDR highlight mode; and in a case where the screen display content of the first device does not include HDR content, set the mode of the second device to the SDR mode.

[0038] In some embodiments, the screen display capability is determined according to at least one of a color gamut, a perceptual quantization curve, a peak luminance, a color temperature, an encoder format, and a decoder format corresponding to the second device.

[0039] According to a fifth aspect of the present disclosure, an electronic device is provided, including: a processor; a memory for storing processor-executable instructions; and wherein the processor is configured to execute the screen sharing method in the foregoing first aspect or any one of the implementation manners of the first aspect or the second aspect or any one of the implementation manners of the second aspect.

[0040] According to a sixth aspect of the present disclosure, a storage medium is provided, which stores instructions that, when executed by a processor, perform the screen sharing method in the foregoing first aspect or any one of the implementation manners of the first aspect or the second aspect or any one of the implementation manners of the second aspect.

[0041] The technical scheme provided by the embodiment of the present disclosure can have the following beneficial effects: the first device processes the screen display content of the first device according to the screen display capability of the second device, and obtains a content file adapted to the screen display capability of the second device; the content file is sent to the second device, and the second device displays the screen display content of the first device based on the content file, so that the shared content can be displayed according to the screen display capability of the second device, thereby improving the display effect of screen sharing.

[0042] It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and cannot limit the present disclosure. BRIEF DESCRIPTION OF DRAWINGS

[0043] The accompanying drawings, which are incorporated into the specification and constitute part of it, illustrate embodiments consistent with the present disclosure and, together with the specification, serve to explain the principles of the present disclosure.

[0044] Figure 1 is a flowchart of a screen sharing method according to an exemplary embodiment.

[0045] Figure 2 is a schematic diagram of a shared screen according to an example.

[0046] Figure 3 is a flowchart of another screen sharing method according to an exemplary embodiment.

[0047] Figure 4 is a flowchart of a shared screen according to an example.

[0048] Figure 5 is a schematic diagram of processing screen display content according to an example.

[0049] Figure 6 is a schematic diagram of a screen sharing system according to an example.

[0050] Figure 7 is a block diagram of a screen sharing device according to an exemplary embodiment.

[0051] Figure 8 is a block diagram of a screen sharing device according to an exemplary embodiment.

[0052] Figure 9 is a block diagram of a device for screen sharing according to an exemplary embodiment. DETAILED DESCRIPTION

[0053] The exemplary embodiments will be described in detail herein with reference to the attached drawings. In the following description, the same numbers refer to the same or similar elements throughout the drawings. The implementation described in the following exemplary embodiments is not meant to represent all implementations consistent with the present disclosure.

[0054] The screen sharing method provided by the embodiments of the present disclosure can be executed by an electronic device. The electronic device can be any device that contains display devices and touch devices and uses electronic elements and technologies to perform specific functions or tasks. For example, in the exemplary embodiments described below, the electronic device can be referred to as a terminal, a mobile terminal, a smart terminal, etc. The electronic device can also be referred to as a user equipment (UE), a mobile station (MS), etc. For example, handheld devices with touch display functions, vehicle-mounted devices, etc. Examples of the electronic device can include a mobile phone, a bracelet, a watch, a tablet computer, a notebook computer, a palm computer, a mobile internet device (MID), a wearable device, a virtual reality (VR) device, an augmented reality (AR) device, a smart home device, a wireless terminal in industrial control, a wireless terminal in unmanned driving, etc.

[0055] With the development of communication technology and the application of smart devices, there are more and more high dynamic range (HDR) content on smart terminals, including HDR videos provided by video applications, HDR videos taken by cameras, HDR photos taken by cameras, HDR rendering of games, etc. The smart terminal also includes standard dynamic range (SDR) videos and SDR photos, etc.

[0056] Information exchange through screen sharing is a common scenario. Due to the convenience and continuous improvement of the intelligent performance of smart terminals, the demand for sharing the display screen content of smart terminals between multiple devices is becoming stronger and stronger.

[0057] Screen sharing between multiple devices can be achieved through wired connection or wireless connection. Through wired connection, low-latency multi-screen experience can be obtained; through wireless connection, portable multi-screen experience can be obtained, and when remote assistance is needed, multi-screen experience can be achieved across regions.

[0058] For example, a smart terminal and an XR (a general term for virtual reality related technologies, including virtual reality (VR), augmented reality (AR), mixed reality (MR), etc.) device can be connected, and a better viewing experience can be obtained by projecting a small screen onto a large screen. For example, a mobile phone is connected to an XR device to obtain an immersive giant screen experience; for another example, a mobile phone is connected to a television, a mobile phone is connected to a car display cockpit, a mobile phone is connected to a tablet computer, etc.

[0059] Screen sharing can be between relatives and friends, or between strangers. Among them, screen sharing content can be realized without sharing the original image file between strangers, which can protect privacy and share content.

[0060] However, the hardware differences between different smart terminals are large, and the color gamut, brightness and contrast of the display screen are different in the same product or different products due to different scenes. Moreover, different screen qualities, different color, contrast and brightness display effects will also have large differences.

[0061] In related technologies, each screen is calibrated on the same product, the same batch or different batches to ensure the consistency of the screen. However, the screen content is changing, and the same scene may contain multiple contents, and the display capabilities of different devices are different. In this case, how to ensure the consistency of the screen is a technical problem to be solved.

[0062] For example, the display device initiating sharing displays HDR content and SDR content. If only one SDR content is transmitted when screen sharing between two display devices, the problem of color error and brightness error of HDR content will occur on the receiving display device.

[0063] For example, on the display device initiating sharing, device brightening and end-to-end color gamut management of the display screen are performed for HDR content. However, when screen sharing is performed on another device, HDR color management is not performed, and the problem of not being able to see the HDR effect occurs.

[0064] For example, the display device initiating sharing displays HDR content and SDR content, such as full-screen viewing of HDR video, and the SDR content is overlaid on the HDR content. If the different display content is not processed on the receiving device, display errors or large differences in display effects will occur in different display areas of different contents.

[0065] In addition, due to the difference in the selection of environmental color temperature and display mode, color differences will also occur.

[0066] Therefore, the embodiment of the present disclosure provides a screen sharing method. The first device processes the screen display content of the first device according to the screen display capability of the second device, and obtains a content file adapted to the screen display capability of the second device; and the content file is sent to the second device, and the second device displays the screen display content of the first device based on the content file, so that the shared content can be displayed according to the screen display capability of the second device, thereby improving the display effect of screen sharing.

[0067] Figure 1 FIG. 1 is a flowchart of a screen sharing method according to an example embodiment. Figure 1 The screen sharing method can be performed by the first device, but the present disclosure is not limited thereto.

[0068] As shown in FIG. 1, the method can include steps S11-S14. Figure 1

[0069] In step S11, the first device determines to share the screen display content with the second device.

[0070] In the embodiment of the present disclosure, the first device can be a device initiating screen sharing, and the first device can be a device providing shared content; the first device can also be referred to as a sending device, a sharing device, etc. The second device can be a device receiving shared content, and the second device can also be referred to as a receiving device. The second device can be one or more, that is, the first device can share the screen with one or more second devices; the screen display capability of each second device can be the same or different.

[0071] In the embodiment of the present disclosure, the first device and the second device can each be a terminal device, such as a smart phone, a tablet, a computer, a television, a vehicle-mounted display device, etc. In the following example, a phone and a television are taken as examples to illustrate the sharing of the screen, but the present disclosure is not limited thereto.

[0072] In the embodiment of the present disclosure, the first device determines to share the screen display content with the second device, which can be in response to the first device receiving a sharing instruction, or in response to the first device receiving a sharing instruction initiated by the second device.

[0073] In the embodiment of the present disclosure, the screen display content of the first device can include HDR content and SDR content. The HDR content can include HDR video and / or HDR picture, and the SDR content can include SDR video and / or SDR picture and / or SDR text. For example, the screen display content of the first device can include HDR video, and SDR content (such as a barrage, a menu, etc.) overlaid on the HDR video.

[0074] ​Figure 2 is a schematic diagram of sharing a screen according to an example.

[0075] With reference to Figure 2 , the display system 1 can be a system providing shared content in a shared screen, and the display system 2 can be a system receiving the shared content. The display system 1 can be the first device described above, and the display system 2 can be the second device described above. The display system 1 includes a plurality of different display content layers, including HDR video content displayed in display area 1 and SDR picture content displayed in display area 2. The display system 2 includes display area 4 and display area 5, wherein display area 4 includes a screen picture of the display system 1, which can be a mirror image of the screen picture of the display system 1, and display area 5 is other display area of the display system 2.

[0076] It can be understood that the screen picture of the display system 1 can be displayed only in a partial area of the screen of the display system 2, and the screen picture of the display system 1 can also be displayed full screen on the screen of the display system 2.

[0077] In step S12, the first device obtains the screen display capability of the second device.

[0078] In the embodiments of the present disclosure, the first device can determine the screen display capability of the first device according to the display parameters of the first device, and the second device can determine the screen display capability of the second device according to the display parameters of the second device.

[0079] In the embodiments of the present disclosure, the second device can send the screen display capability of the second device to the first device.

[0080] In the embodiments of the present disclosure, the display parameters can include but are not limited to color gamut, perceptual quantization curve, peak brightness, color temperature, encoder format and decoder format.

[0081] In the embodiments of the present disclosure, the screen display capability can include but is not limited to high dynamic video (HDR Video), high dynamic photo (HDR photo), wide color gamut content (SDR-P3), standard definition content (SDR-sRGB). Among them, HDR Video and HDR photo support HDR, and SDR-P3 and SDR-sRGB do not support HDR.

[0082] It should be noted that the display device supporting HDR also supports SDR, and the display device not supporting HDR only supports SDR.

[0083] In the exemplary embodiments, the screen display capability of the second device is determined according to at least one of the color gamut, perceptual quantization curve, peak brightness, color temperature, encoder format and decoder format corresponding to the second device.

[0084] In the embodiments of the present disclosure, the screen display capability of the second device can be determined by the second device according to the above parameters of the second device, or the second device can send the above parameters of the second device to the first device, and the first device determines the screen display capability of the second device according to the above parameters of the second device.

[0085] For example, if the color gamut corresponding to the second device is BT.2020, the perceptual quantization curve is perceptual quantization (PQ) or hybrid log-gamma (HLG), and the supported encoder format is H.265 main10, the screen display capability of the second device is HDR video, that is, the screen display capability of the second device supports HDR video.

[0086] For another example, if the color gamut corresponding to the second device is P3, the perceptual quantization curve is gamma, and the supported encoder format is H.264 8bit, the screen display capability of the second device is SDR-P3, that is, the screen display capability of the second device does not support HDR.

[0087] In the embodiments of the present disclosure, the above parameters can obtain the accurate screen display capability of the device.

[0088] In step S13, the screen display content is processed according to the screen display capability of the second device, and a content file is obtained.

[0089] In the embodiments of the present disclosure, the first device can determine a suitable layer merging strategy (also referred to as a layer mapping strategy or a layer packaging strategy) according to the screen display capability of the second device, and process the screen display content based on the layer merging strategy. The layer merging strategy can include an HDR-based packaging strategy and an SDR-based packaging strategy. The HDR-based packaging strategy refers to mapping SDR content to an HDR container (including color gamut, perceptual quantization curve, and bit depth) and packaging, and packaging HDR content and SDR content into one layer. The SDR-based packaging strategy refers to down-converting HDR content and packaging.

[0090] In the exemplary embodiments, the screen display content of the first device includes HDR content and SDR content; the screen display content is processed according to the screen display capability of the second device to obtain a content file, including: synthesizing the HDR content and the SDR content according to the screen display capability of the second device to obtain the content file.

[0091] In the embodiments of the present disclosure, the HDR content and the SDR content displayed by the first device can be synthesized according to the screen display capability of the second device, to obtain a content file adapted to the screen display capability of the second device, thereby improving the consistency of the content displayed by the first device and the second device or ensuring the integrity of the displayed content.

[0092] In the example embodiments, the HDR content and the SDR content are synthesized according to the screen display capability of the second device to obtain a content file, including: if the screen display capability of the second device supports HDR, the HDR content and the SDR content are synthesized based on an HDR packaging strategy to obtain a content file; if the screen display capability of the second device does not support HDR, the HDR content and the SDR content are synthesized based on an SDR packaging strategy to obtain a content file.

[0093] In the embodiments of the present disclosure, the first device supports HDR, and the HDR content and the SDR content are displayed on the screen of the first device. When the screen sharing is performed between the first device and the second device, if the second device supports HDR, the first device synthesizes the HDR content and the SDR content according to that the second device supports HDR, so that the second device can display the HDR content in the HDR format and the SDR content in the SDR format, thereby improving the consistency of the content displayed by the first device and the second device.

[0094] In the embodiments of the present disclosure, when the screen sharing is performed between the first device and the second device, if the second device does not support HDR, the first device synthesizes the HDR content and the SDR content according to that the second device does not support HDR, so that the second device can display the HDR content and the SDR content in the SDR format, thereby ensuring the integrity of the displayed content.

[0095] In the example embodiments, the HDR content and the SDR content are synthesized based on an HDR packaging strategy to obtain a content file, including: mapping the SDR content to a container of the HDR to obtain a mapping result; and synthesizing the mapping result and the HDR content to obtain a content file in the HDR format.

[0096] In the embodiments of the present disclosure, when the second device supports HDR, the SDR content can be mapped to a container of the HDR (including a color gamut, a perceptual quantization curve and a bit depth) and packaged, and the HDR content and the SDR content are packaged into one layer to obtain a content file in the HDR format.

[0097] In the embodiments of the present disclosure, when the second device supports HDR, the SDR content is mapped to the container of HDR, to obtain a content file in HDR format, so as to send the content file in HDR format to the second device, so that the content displayed by the second device is consistent with the content displayed by the first device.

[0098] In the example embodiments, the second device includes a plurality of second devices; the content displayed on the screen is processed according to the screen display capability of the second device, to obtain a content file, including: grouping the plurality of second devices according to the screen display capability of each second device in the plurality of second devices, to obtain a plurality of device groups; for each device group, processing the content displayed on the screen according to the screen display capability of the second device in the device group, to obtain a content file corresponding to the device group.

[0099] In the embodiments of the present disclosure, if there are a plurality of second devices, the first device can group the plurality of second devices according to the screen display capability of the plurality of second devices. For example, the second devices with the same or similar screen display capability can be grouped into one device group, that is, the screen display capability of each second device in each device group is the same or similar, so that different content files can be generated based on the device groups.

[0100] In the embodiments of the present disclosure, after grouping the plurality of second devices, for each device group, a content file is generated according to the screen display capability of the second device in the device group, and the content file is sent to each second device in the device group. The specific way of generating a content file according to the screen display capability of the second device in each device group can refer to the description of the above embodiments, which will not be repeated here.

[0101] In the embodiments of the present disclosure, the second devices are grouped according to the screen display capability of the plurality of second devices, and a content file is generated based on each device group, so that a content file suitable for the screen display capability of the second device can be obtained, and the processing efficiency is improved.

[0102] In step S14, the content file is sent to the second device.

[0103] In the embodiments of the present disclosure, the content file refers to a file transmitted between the first device and the second device when the first device and the second device perform screen sharing, that is, a file processed by the first device and sent to the second device.

[0104] In the embodiments of the present disclosure, the second device can display the content displayed on the screen based on the content file.

[0105] In an example embodiment, when the second device comprises a plurality of devices, sending the content file to the second device comprises: for each device group, sending the content file corresponding to the device group to each second device in the device group.

[0106] In an example embodiment, after the content file is generated for each device group, the content file is sent to each second device in the device group, so that the second device displays the screen display content based on the content file.

[0107] The screen sharing method provided by the example embodiment of the present disclosure can process the screen display content of the first device according to the screen display capability of the second device, and can obtain a content file adapted to the screen display capability of the second device; the content file is sent to the second device, and the second device displays the screen display content of the first device based on the content file, which can display the shared content according to the screen display capability of the second device, thereby improving the display effect of screen sharing.

[0108] Figure 3 FIG. 6 is a flowchart of another screen sharing method according to an example embodiment. Figure 3 The screen sharing method shown in FIG. 6 can be performed by the second device, but the present disclosure is not limited thereto.

[0109] As shown in FIG. 6, the method can comprise steps S21-S23. Figure 3

[0110] In step S21, the second device sends the screen display capability of the second device to the first device.

[0111] In an example embodiment, the second device can determine the screen display capability of the second device according to the display parameters of the second device, and the second device can send the screen display capability of the second device to the first device.

[0112] In an example embodiment, the screen display capability of the second device is determined according to at least one of the color gamut, the perceptual quantization curve, the peak brightness, the color temperature, the encoder format and the decoder format corresponding to the second device.

[0113] In an example embodiment, the above parameters can be used to obtain the accurate screen display capability of the device.

[0114] In step S22, the content file sent by the first device is received.

[0115] The content file is generated according to the screen display capability of the second device and the screen display content of the first device.

[0116] In an example embodiment, the second device can receive the content file sent by the first device. ​

[0117] In step S23, the screen display content is displayed based on the content file.

[0118] In the embodiments of the present disclosure, the second device can display the screen display content based on the content file. Since the content file is generated according to the screen display capability of the second device, displaying the screen display content based on the content file can adapt to the screen display capability of the second device, and improve the display effect of the screen sharing.

[0119] In the example embodiments, in the case that the screen display content of the first device includes HDR content and SDR content, the screen display capability of the second device supports HDR, and the content file is obtained based on the HDR encapsulation strategy, displaying the screen display content based on the content file includes: decoding the content file, and performing gamut mapping and tone mapping on the processing result to display the screen display content.

[0120] In the embodiments of the present disclosure, the first device can send a message to the second device to inform the second device whether the content file corresponds to HDR content or SDR content. The second device can decode the content file and match the corresponding layer mapping strategy. In the case that the content file is obtained based on the HDR encapsulation strategy, the second device decodes the content file, and performs gamut mapping and tone mapping on the processing result to display the shared content on the screen of the second device.

[0121] In the embodiments of the present disclosure, in the case that the second device supports HDR, since the first device has mapped the SDR content to the HDR container based on the HDR encapsulation strategy and combined the SDR content and the HDR content into one layer, after the second device receives the content file, decodes the content file, and performs gamut mapping and tone mapping, the same shared content as the first device can be displayed on the screen of the second device.

[0122] In the embodiments of the present disclosure, when the second device displays the screen display content, the HDR layer can be brightened, for example, the brightness can be multiplied by gain0 to obtain the highlight effect of the HDR.

[0123] In the embodiments of the present disclosure, in the case that the second device does not support HDR, the content file is decoded, and the shared content is displayed on the second device.

[0124] In an example embodiment, the color gamut mapping and tone mapping of the processing result comprises: converting the color space of the processing result to LUV space, and performing equal-ratio color gamut mapping in the LUV space; performing semantic segmentation on the processing result to obtain a plurality of segmentation maps and categories corresponding to each segmentation map; and performing local tone mapping on the processing result based on each segmentation map and the category corresponding to each segmentation map.

[0125] In the embodiments of the present disclosure, the RGB color space can be converted to LUV space, and equal-ratio color gamut mapping can be performed in the LUV space. The LUV space can be closer to perceptual continuity, and the display effect can be improved.

[0126] In the embodiments of the present disclosure, the tone mapping can be performed in combination with semantic segmentation. Specifically, the image is subjected to semantic segmentation in combination with an artificial intelligence (AI) large model to obtain a plurality of segmentation maps and categories corresponding to each segmentation map. The segmented segmentation map (map) is recorded as a segmentation map of the same scale, and the bit depth can be recorded as, for example, a gray value of 4 bits. The categories of the segmentation map can be customized, such as 1 for sky, 2 for human, 3 for puppy, etc. In combination with the segmentation map, the local tone mapping is multiplied by a weight (i.e., multiplied by a weight corresponding to each category, which can be pre-set), and a new tone mapping value can be obtained. Using the tone mapping value in combination with the RGB value of the segmentation map, gain compensation is performed to obtain a new pixel RGB value, thereby improving the display effect.

[0127] In an example embodiment, based on a content file, a screen display content is displayed, comprising: detecting a device state of a second device; in a case where the device state of the second device is a non-default mode, if the content file includes HDR content, setting the mode of the second device to an HDR highlight mode; in a case where the device state of the second device is a non-default mode, if the content file includes SDR content, setting the mode of the second device to an SDR mode.

[0128] In the embodiments of the present disclosure, after the first device and the second device determine to perform screen sharing, the first device and the second device can respectively detect the state of their devices. That is, the first device detects the device state of the first device, and the second device detects the device state of the second device. The device state can include, but is not limited to, an eye protection mode and a system color mode.

[0129] In the embodiments of the present disclosure, when the first device and the second device are both in a non-default mode, when it is detected that the screen sharing content includes HDR content, the first device and the second device are simultaneously switched to an HDR mode (highlight mode); when it is detected that the screen sharing content is SDR content, the first device and the second device are simultaneously switched to an SDR mode or a default mode.

[0130] In the embodiments of the present disclosure, if the content file includes HDR content (may also include SDR content) when the device state of the second device is in a non-default mode, the second device sets the mode of the second device to an HDR highlight mode; if the content file includes SDR content (does not include HDR content) when the device state of the second device is in a non-default mode, the second device sets the mode of the second device to an SDR mode or a default mode.

[0131] In the embodiments of the present disclosure, the first device and the second device can set a suitable display mode according to the type of the screen sharing content, and the display effect can be improved.

[0132] In the example embodiments, the screen display content is displayed based on the content file, including: setting the mode of the second device to an HDR highlight mode when the first device switches from an SDR mode to an HDR mode; setting the mode of the second device to an SDR mode when the screen display content of the first device does not include HDR content.

[0133] In the embodiments of the present disclosure, when it is detected that the first device switches from SDR to HDR, the second device triggers an HDR state, and the second setting sets the mode to an HDR highlight mode.

[0134] In the embodiments of the present disclosure, when it is detected that the first device has no HDR content, the second device triggers an SDR state, and the second setting sets the mode to an SDR default mode.

[0135] In the embodiments of the present disclosure, the second device can set a suitable display mode according to the type of the screen sharing content of the first device, and the display effect can be improved.

[0136] Figure 4 FIG. 1 is a flow diagram of sharing a screen according to an example.

[0137] Reference Figure 4, shows the synthesis and display strategy of the mixed content of HDR and SDR when the screen content is streamed between multi-display systems. Display system 1 displays HDR content and SDR content, and in the process of content transmission in display system 1 and display system 2, the display parameters are established to match the capabilities of the devices, and at the same time, the layer synthesis strategy of display system 1 is confirmed based on the capabilities of the receiving device. Specifically, display system 2 sends display parameters to display system 1, and display system 1 performs HDR / SDR device capability matching according to the display parameters, and judges whether display system 2 supports HDR. When display system 2 supports HDR, HDR content packaging is adopted; when display system 2 does not support HDR, SDR content packaging is adopted. In display system 2, the layer mapping strategy of HDR and SDR is matched based on content decoding, so as to achieve the best or consistent SDR and HDR display effect in display system 1 and display system 2. Specifically, display system 2 judges whether to support HDR based on content decoding, and when supporting HDR, HDR content brightening is performed; when not supporting HDR, SDR content brightening is performed.

[0138] In some embodiments, the display capability of the display device can be determined by color gamut, perceptual quantization curve, peak brightness, color temperature, supported encoder and supported decoder.

[0139] Among them, the color gamut can include sRGB color gamut, P3 color gamut, BT.2020 color gamut, the perceptual quantization curve can include gamma (gamma), perceptual quantization (Perceptual Quantization, PQ), hybrid logarithm (Hybrid Log-Gamma, HLG), the color temperature can include white balance (white balance), the format of the supported encoder can include but not limited to: H.265main10 high profile, the format of the supported decoder can include but not limited to: H.264 8bit main profile.

[0140] Among them, the display capability can include supporting HDR and not supporting HDR. Among them, supporting HDR can include supporting HDR video and supporting HDR photo, and not supporting HDR can include SDR-P3 and SDR-sRGB.

[0141] In some embodiments, after determining the display capability of the display device, the display device can record and store the display capability of the display device.

[0142] In some embodiments, the standards of HDR and SDR can be defined based on the above parameters.

[0143] In some embodiments, the HDR Video standard may include: HDR10, HDR10+, HDR Vivid, Dolby Vision, and the relevant color space parameters may be: BT.2020, PQ / HLG, metadata (dynamic and static), H.265main10.

[0144] In some embodiments, the standard for HDR photos may include: two-layer schemes: JPEG / R, and single-layer schemes: HD Rvivid, HEIF, and AVIF.

[0145] In some embodiments, the SDR-P3 standard may include: P3, H.265 8bit, H.264 8bit.

[0146] In some embodiments, the SDR-sRGB standard may include: other or unknown, default.

[0147] In some embodiments, display system 1 can obtain display parameters of display system 2, which may include HDR video, HDR photo, SDR-P3, and SDR-sRGB.

[0148] In some embodiments, if display system 1 obtains that display system 2 supports HDR video, then display system 1 records that display system 2 supports HDR video; if display system 1 obtains that display system 2 supports HDR photo, then display system 1 records that display system 2 supports HDR photo; if display system 1 obtains that display system 2 supports SDR-P3, then display system 1 records that display system 2 supports SDR-P3; if display system 1 obtains that display system 2 supports SDR-sRGB, then display system 1 records that display system 2 supports SDR-sRGB.

[0149] Among them, HDR video & HDR photo indicate that HDR is supported, while SDR-P3 & SDR-sRGB indicate that HDR is not supported.

[0150] In some embodiments, if the display system 2 supports HDR, then the display system 1 maps all the information of each layer to this HDR, then combines these HDR layers into one layer, and encodes and compresses it into (e.g., H.265 10-bit) for transmission.

[0151] In some embodiments, if the display system 2 supports HDR video, the color space of different layers can be converted to YUV and the color gamut can be converted to HDR color space before the synthesis of different display contents. Because the display system 1 sends the content to the display system 2 for processing, the display system 2 can only receive one layer, i.e., the synthesized layer. The receiving device can only process the one layer according to the HDR color space, so as not to affect other non-HDR layers.

[0152] Figure 5 FIG. 1 is a schematic diagram of processing screen display content according to an example.

[0153] Reference Figure 5 The display system 1 can include, for example, three display regions (which can also be considered as three layers). The display region 1 displays HDR video content, the display region 2 displays SDR picture content, and the display region 3 displays SDR wallpaper.

[0154] In some embodiments, the HDR video content can be processed by using a 10-bit YUV decoder 1, and then tone mapping (Electro-Optical Transfer Function (EOTF)) and color gamut mapping (BT.2020→P3) can be performed. The SDR picture content can be processed by using an 8-bit YUV decoder 2, and then tone mapping (Gamma) and color gamut mapping (P3 or sRGB→P3) can be performed. The SDR wallpaper can be processed by using a RGBA8888 layer regulated by a GPU, and then tone mapping (Gamma) and color gamut mapping (P3 or sRGB→P3) can be performed. After the layer mapping, color space conversion (for example, from RGB to YUV), color gamut mapping (P3→BT.2020), and tone mapping (Optical-Electro Transfer Function (EOTF)) can be performed. Then, a 10-bit SDR&HDR encoder 3 can be used for encoding processing to obtain an encoding result.

[0155] In some embodiments, the display system 2 matches the layer mapping strategy of HDR and SDR based on content decoding to achieve consistent or optimal HDR and SDR display effect of the display system 1 and the display system 2.

[0156] In some embodiments, if the HDR content is monitored, the display system 2 can be divided into gamut mapping and tone mapping in the decoding process.

[0157] In some embodiments, after decoding is completed, the HDR layer is multiplied by gain0 to obtain the highlight effect of the HDR for the HDR layer.

[0158] Generally, color gamut mapping is based on the RGB color space, but since the RGB color space is not a color space that can be perceived by the human eye, in the embodiments of the present disclosure, the RGB color space is first converted to the LUV space, and the isometric mapping is performed in the LUV space to achieve a display effect closer to the perceptual continuity.

[0159] The tone mapping can be divided into global tone mapping and local tone mapping. The local mapping method is to divide the image into blocks, such as 20*20 blocks; first perform local tone mapping on the block, and then perform global tone mapping.

[0160] In some embodiments, tone mapping can be combined with semantic segmentation. The image is combined with an AI large model for semantic segmentation to obtain a plurality of segmentation maps and categories corresponding to each segmentation map. The segmented segmentation map (map) is recorded as a segmentation map of the same scale, and the bit depth can be recorded as, for example, a gray value of 4 bits (bit). The categories of the segmentation map can be customized, such as sky as 1, person as 2, and puppy as 3. Combined with the segmentation map, the local tone mapping is multiplied by the weight to obtain a new tone mapping value. Using the tone mapping value combined with the RGB value of the segmentation map, gain compensation is performed to obtain a new pixel RGB value, thereby improving the display effect. For example, the contrast of a dark corner of a house and a bright sky without sacrificing the overall contrast of the dark corner.

[0161] In some embodiments, the display system 1 and the display system 2 can perform quality mode matching.

[0162] In some embodiments, due to the ambient color temperature, the difference in the selection of the display mode will also cause the difference in the color.

[0163] In some embodiments, the first device and the second device can respectively detect the state of the respective device, including the eye protection mode, the system color mode, etc. When a non-default mode is detected, when the screen sharing content is detected as HDR, the HDR mode (highlight mode, maximum brightness multiplied by gain0) is switched at the same time. When a non-default mode is detected, when the screen sharing content is detected as SDR, the SDR mode (default brightness mode) is switched at the same time.

[0164] In some embodiments, when it is detected that the display system 1 of the sharing end is switched from SDR to HDR, the receiving end display system 2 is triggered to enter the HDR state, and the display system 2 is matched to set the HDR highlight mode; when it is detected that the display system 1 of the sharing end has no HDR content, the receiving end display system 2 is triggered to enter the SDR state, and the display system 2 is matched to set the SDR default mode.

[0165] Figure 6 is a screen sharing system block diagram according to an exemplary embodiment.

[0166] With reference to Figure 6 The screen sharing system 100 provided by the embodiments of the present disclosure can include a first device 101 and a second device 102.

[0167] In the embodiments of the present disclosure, the first device 101 can be a device initiating screen sharing, and the second device 102 can be a device receiving shared content. The second device 102 can be one or more, that is, the first device 101 can perform screen sharing with one or more second devices 102; the screen display capabilities of each second device 102 can be the same or different.

[0168] The first device 101 is configured to determine to share screen display content with the second device 102, obtain screen display capabilities of the second device 102, process the screen display content according to the screen display capabilities of the second device 102 to obtain a content file, and send the content file to the second device 102; and the second device 102 is configured to receive the content file and display the screen display content based on the content file.

[0169] In some embodiments, the screen display content includes high dynamic range (HDR) content and standard dynamic range (SDR) content; and the first device 101 is configured to perform synthesis processing on the HDR content and the SDR content according to the screen display capabilities of the second device 102 to obtain the content file.

[0170] In some embodiments, if the screen display capabilities of the second device 102 support HDR, the first device 101 performs synthesis processing on the HDR content and the SDR content based on an HDR encapsulation strategy to obtain the content file; and if the screen display capabilities of the second device 102 do not support HDR, the first device 101 performs synthesis processing on the HDR content and the SDR content based on an SDR encapsulation strategy to obtain the content file.

[0171] In some embodiments, the first device 101 maps the SDR content to a container of the HDR to obtain a mapping result, and performs synthesis processing based on the mapping result and the HDR content to obtain a content file in an HDR format.

[0172] In some embodiments, the second device 102 comprises a plurality of second devices 102; the first device 101 is configured to group the plurality of second devices 102 according to screen display capabilities of each second device 102 in the plurality of second devices 102, to obtain a plurality of device groups; for each device group, process screen display content according to screen display capabilities of the second devices 102 in the device group, to obtain a content file corresponding to the device group; and for each device group, send the content file corresponding to the device group to each second device 102 in the device group.

[0173] In some embodiments, the screen display capability is determined according to at least one of a color gamut, a perceptual quantization curve, a peak brightness, a color temperature, an encoder format, and a decoder format corresponding to the second device 102.

[0174] In some embodiments, the screen display content comprises HDR content and SDR content, the content file is obtained based on an HDR packaging strategy, and the screen display capability of the second device 102 is to support HDR; the second device 102 is configured to decode the content file, and perform color gamut mapping and tone mapping on a processing result, to display the screen display content.

[0175] In some embodiments, the second device 102 is configured to convert a color space of the processing result to an LUV space, and perform equal-proportion color gamut mapping in the LUV space; perform semantic segmentation on the processing result, to obtain a plurality of segmentation maps and categories corresponding to each segmentation map; and perform local tone mapping on the processing result based on each segmentation map and the category corresponding to each segmentation map.

[0176] In some embodiments, the second device 102 is configured to detect a device state of the second device 102; in a case where the device state of the second device 102 is a non-default mode, if the content file comprises HDR content, set a mode of the second device 102 to an HDR highlight mode; and in a case where the device state of the second device 102 is the non-default mode, if the content file comprises SDR content, set the mode of the second device 102 to an SDR mode.

[0177] In some embodiments, in a case where the first device 101 switches from an SDR mode to an HDR mode, the second device 102 sets the mode of the second device 102 to the HDR highlight mode; and in a case where the screen display content of the first device 101 does not comprise HDR content, the second device 102 is configured to set the mode of the second device 102 to the SDR mode.

[0178] Based on the same concept, the embodiments of the present disclosure also provide a screen sharing device.

[0179] It can be understood that, in order to achieve the above functions, the screen sharing apparatus provided by the embodiments of the present disclosure includes hardware structures and / or software modules corresponding to the functions. In combination with the units and algorithm steps of the examples disclosed in the embodiments of the present disclosure, the embodiments of the present disclosure can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is implemented in hardware or in the form of computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the technical solutions of the embodiments of the present disclosure.

[0180] Figure 7 is a block diagram of a screen sharing apparatus according to an example embodiment. Referring to Figure 7 The apparatus 200 includes an acquisition unit 201, a processing unit 202, and a transceiver unit 203.

[0181] The acquisition unit 201 is configured to acquire a screen display capability of a second device. The processing unit 202 is configured to determine to share screen display content with the second device, and process the screen display content according to the screen display capability of the second device to obtain a content file. The transceiver unit 203 is configured to send the content file to the second device.

[0182] In some embodiments, the screen display content includes high dynamic range (HDR) content and standard dynamic range (SDR) content. The processing unit 202 is configured to perform synthesis processing on the HDR content and the SDR content according to the screen display capability of the second device to obtain the content file.

[0183] In some embodiments, the processing unit 202 is configured to, if the screen display capability of the second device is to support HDR, perform synthesis processing on the HDR content and the SDR content based on an HDR encapsulation strategy to obtain the content file, and if the screen display capability of the second device is not to support HDR, perform synthesis processing on the HDR content and the SDR content based on an SDR encapsulation strategy to obtain the content file.

[0184] In some embodiments, the processing unit 202 is configured to map the SDR content to a container of HDR to obtain a mapping result, and perform synthesis processing based on the mapping result and the HDR content to obtain a content file in an HDR format.

[0185] In some embodiments, the screen display capability is determined according to at least one of a color gamut, a perceptual quantization curve, a peak brightness, a color temperature, an encoder format, and a decoder format corresponding to the second device.

[0186] Figure 8is a screen sharing device block diagram according to an exemplary embodiment. Referring to Figure 8 The device 300 comprises a transceiver unit 301 and a display unit 302.

[0187] The transceiver unit 301 is configured to send a screen display capability of a second device to a first device, and receive a content file sent by the first device, the content file being generated according to the screen display capability of the second device and screen display content of the first device; and the display unit 302 is configured to display the screen display content based on the content file.

[0188] In some embodiments, the screen display content comprises HDR content and SDR content, the content file is obtained based on an HDR packaging strategy, and the screen display capability of the second device is to support HDR; the device further comprises a processing unit configured to decode the content file, and perform gamut mapping and tone mapping on a processing result to display the screen display content.

[0189] In some embodiments, the processing unit is configured to convert a color space of the processing result to an LUV space, and perform equal-proportion gamut mapping in the LUV space; perform semantic segmentation on the processing result to obtain a plurality of segmentation maps and categories corresponding to each segmentation map; and perform local tone mapping on the processing result based on each segmentation map and the category corresponding to each segmentation map.

[0190] In some embodiments, the display unit 302 is configured to detect a device state of the second device; if the device state of the second device is a non-default mode, and if the content file comprises HDR content, set a mode of the second device to an HDR highlight mode; if the device state of the second device is the non-default mode, and if the content file comprises SDR content, set the mode of the second device to an SDR mode.

[0191] In some embodiments, the display unit 302 is configured to, if the first device switches from an SDR mode to an HDR mode, set the mode of the second device to the HDR highlight mode; and if the screen display content of the first device does not comprise HDR content, set the mode of the second device to the SDR mode.

[0192] In some embodiments, the screen display capability is determined according to at least one of a color gamut corresponding to the second device, a perceptual quantization curve, a peak luminance, a color temperature, an encoder format, and a decoder format.

[0193] With regard to the apparatuses in the above-described embodiments, a specific manner in which each of the modules performs operations has been described in detail in the embodiments of the method, and thus detailed description will not be repeated here.

[0194] Figure 9 is a block diagram of an apparatus for screen sharing according to an exemplary embodiment. For example, the apparatus 400 can be a mobile phone, a computer, a digital broadcasting terminal, a message transmitting / receiving device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0195] Referring to Figure 9 , the apparatus 400 can include one or more of the following components: a processing component 402, a memory 404, a power supply component 406, a multimedia component 408, an audio component 410, an input / output (I / O) interface 412, a sensor component 414, and a communication component 416.

[0196] The processing component 402 usually controls overall operations of the apparatus 400, such as operations associated with displaying, making phone calls, data communications, camera operations, and recording operations. The processing component 402 can include one or more processors 420 to execute instructions to complete all or part of steps of the above-described methods. In addition, the processing component 402 can include one or more modules to facilitate interaction between the processing component 402 and other components. For example, the processing component 402 can include a multimedia module to facilitate the interaction between the multimedia component 408 and the processing component 402.

[0197] The memory 404 is configured to store various types of data to support operations of the apparatus 400. Examples of these data include instructions for any application or methods operating on the apparatus 400, contact data, phonebook data, messages, pictures, videos, etc. The memory 404 can be realized by any type of volatile or nonvolatile storage devices or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk or optical disk.

[0198] The power supply component 406 supplies electric power for various components of the apparatus 400. The power supply component 406 can include a power supply management system, one or more power sources, and other components associated with generating, managing and distributing electric power for the apparatus 400.

[0199] The multimedia component 408 includes a screen to provide an output interface between the device 400 and a user. In some embodiments, the screen can include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touch, swiping, and gestures on the touch panel. The touch sensors can not only sense a boundary of a touching or swiping action, but also detect duration and pressure related to the touching or swiping action. In some embodiments, the multimedia component 408 includes a front camera and / or a rear camera. When the device 400 is in an operation mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data. Each of the front and rear camera can be a fixed optical lens system or have a focal length and optical zooming capability.

[0200] The audio component 410 is configured to output and / or input audio signals. For example, the audio component 410 includes a microphone (MIC) to receive an external audio signal when the device 400 is in an operation mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal can be further stored in the memory 404 or transmitted via the communication component 416. In some embodiments, the audio component 410 further includes a speaker for outputting audio signals.

[0201] The I / O interface 412 provides an interface between the processing component 402 and peripheral interface modules, such as a keypad, a click wheel, buttons, and so on. The buttons can include, but are not limited to, a home button, a volume button, a start button, and a lock button.

[0202] The sensor component 414 includes one or more sensors to provide various state assessments for the device 400. For example, the sensor component 414 can detect an open / closed position of the device 400, relative positioning of components, such as a display and a keypad of the device 400, a change in position of the device 400 or a component of the device 400, presence or absence of user contact with the device 400, a change in orientation of the device 400 or acceleration / deceleration of the device 400, and a temperature change of the device 400, among other possibilities. The sensor component 414 can include a proximity sensor configured to detect presence of a nearby object without any physical touch. The sensor component 414 can further include a light sensor (e.g., a CMOS or CCD image sensor) configured to work in conjunction with the camera component 406. In some embodiments, the sensor component 414 can also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0203] The communication component 416 is configured to facilitate wired or wireless communication between the apparatus 400 and other devices. The apparatus 400 can access a wireless network based on a communication standard, such as WiFi, 2G, or 3G, or a combination thereof. In an exemplary embodiment, the communication component 416 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 416 further includes a Near Field Communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0204] In an exemplary embodiment, the apparatus 400 can be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components, for performing the above-described methods.

[0205] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions, such as the memory 404 including instructions, is also provided, which can be executed by the processor 420 of the apparatus 400 to complete the above-described methods. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disc, and an optical data storage device, etc.

[0206] It can be understood that, in the present disclosure, "multiple" refers to two or more, and other quantifiers are similar thereto. The association relationship of "and / or" describing the associated objects means that there can be three relationships, for example, A and / or B can represent: A exists alone, A and B exist simultaneously, and B exists alone. The character " / " generally represents that the associated objects before and after it are in an "or" relationship. The singular form "a", "said" and "the" are also intended to include the plural form, unless the context clearly indicates otherwise.

[0207] It can be further understood that the terms "first", "second", and the like are used to describe various information, but the information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other, and do not indicate a specific order or importance. In fact, the expressions "first", "second", and the like can be completely interchangeable. For example, the first information can also be referred to as the second information, and similarly, the second information can also be referred to as the first information without departing from the scope of the present disclosure.

[0208] It will be further understood that "connected" can include direct connection between two members or indirect connection between two members through other members.

[0209] It will be further understood that, unless otherwise specified, "connected" includes direct connection or indirect connection through others.

[0210] Other embodiments of the present disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the application disclosed herein. It is intended that the present disclosure cover any and all variations of the present disclosure including those variations that can be incorporated into other forms, methods and apparatuses of the present technology without departing from the spirit or essential characteristics of the disclosure. It is intended that the present disclosure include all such variations as can fall within the scope of the appended claims and their equivalents.

[0211] It is to be understood that the present disclosure is not limited to the precise construction described and as shown in the accompanying drawings, and that changes and modifications can be effected therein by those skilled in the art without departing from the scope of the disclosure. The scope of the present disclosure is defined by the scope of the claims appended hereto.

Claims

1. A screen sharing method, characterized in that, include: The first device determines to share the screen display content with the second device; The first device acquires the screen display capability of the second device; Based on the screen display capabilities of the second device, the screen display content is processed to obtain a content file; The content file is sent to the second device.

2. The method according to claim 1, characterized in that, The screen display content includes high dynamic range (HDR) content and standard dynamic range (SDR) content. The step of processing the screen display content according to the screen display capability of the second device to obtain a content file includes: Based on the screen display capabilities of the second device, the HDR content and the SDR content are combined to obtain a content file.

3. The method according to claim 2, characterized in that, Based on the screen display capabilities of the second device, the HDR content and the SDR content are combined to obtain a content file, including: If the screen display capability of the second device supports HDR, then the HDR content and the SDR content are synthesized based on the HDR encapsulation strategy to obtain a content file; If the screen display capability of the second device does not support HDR, the HDR content and the SDR content are synthesized based on the SDR encapsulation strategy to obtain a content file.

4. The method according to claim 3, characterized in that, The HDR content and SDR content are combined using an HDR encapsulation strategy to obtain a content file, including: The SDR content is mapped onto the HDR container to obtain the mapping result; Based on the mapping result and the HDR content, a composite processing is performed to obtain a content file based on the HDR format.

5. The method according to claim 1, characterized in that, The second device includes a plurality of second devices; The step of processing the screen display content according to the screen display capability of the second device to obtain a content file includes: Based on the screen display capability of each of the plurality of second devices, the plurality of second devices are grouped to obtain a plurality of device groups; For each device group, the screen display content is processed according to the screen display capability of the second device in the device group to obtain the content file corresponding to the device group; Sending the content file to the second device includes: For each device group, the content file corresponding to the device group is sent to each second device within the device group.

6. The method according to any one of claims 1 to 5, characterized in that, The screen display capability is determined based on at least one of the following: color gamut, perceptual quantization curve, peak brightness, color temperature, encoder format, and decoder format corresponding to the second device.

7. A screen sharing method, characterized in that, include: The second device sends its screen display capabilities to the first device. Receive a content file sent by the first device, the content file being generated based on the screen display capabilities of the second device and the screen display content of the first device; The screen display content is displayed based on the content file.

8. The method according to claim 7, characterized in that, The screen display content includes HDR content and SDR content. The content file is obtained based on the HDR encapsulation strategy. The screen display capability of the second device supports HDR. The step of displaying the screen content based on the content file includes: The content file is decoded, and the processing result is subjected to color gamut mapping and tone mapping to display the content on the screen.

9. The method according to claim 8, characterized in that, Performing gamut mapping and hue mapping on the processing results includes: The color space of the processing result is converted to the LUV space, and the color gamut is mapped proportionally in the LUV space. The processing results are semantically segmented to obtain multiple segmentation maps and the corresponding categories for each segmentation map; Based on each segmentation map and its corresponding category, local tone mapping is performed on the processing results.

10. The method according to claim 7, characterized in that, The step of displaying the screen content based on the content file includes: Detect the device status of the second device; If the content file includes HDR content and the device state of the second device is in a non-default mode, then the mode of the second device is set to HDR highlight mode. If the content file includes SDR content and the device status of the second device is in non-default mode, then the mode of the second device is set to SDR mode.

11. The method according to claim 7 or 10, characterized in that, The step of displaying the screen content based on the content file includes: When the first device switches from SDR mode to HDR mode, the mode of the second device is set to HDR high brightness mode; If the screen display content of the first device does not include HDR content, the mode of the second device is set to SDR mode.

12. The method according to any one of claims 7 to 11, characterized in that, The screen display capability is determined based on at least one of the following: color gamut, perceptual quantization curve, peak brightness, color temperature, encoder format, and decoder format corresponding to the second device.

13. A screen sharing system, characterized in that, include: First equipment and second equipment; The first device is configured to: determine whether to share screen display content with the second device; acquire the screen display capabilities of the second device; process the screen display content according to the screen display capabilities of the second device to obtain a content file; and send the content file to the second device. The second device is used to receive the content file; and to display the screen content based on the content file.

14. A screen sharing device, characterized in that, include: The acquisition unit is used to acquire the screen display capabilities of the second device. The processing unit is used to determine the screen display content to be shared with the second device; Based on the screen display capabilities of the second device, the screen display content is processed to obtain a content file; A transceiver unit is used to send the content file to the second device.

15. A screen sharing device, characterized in that, include: The transceiver unit is used to send the screen display capabilities of the second device to the first device. And receive a content file sent by the first device, the content file being generated based on the screen display capabilities of the second device and the screen display content of the first device; The display unit is used to display the screen content based on the content file.

16. An electronic device, characterized in that, include: processor; Memory used to store processor-executable instructions; The processor is configured to execute the method according to any one of claims 1 to 6 or the method according to any one of claims 7 to 12.

17. A storage medium, characterized in that, The storage medium stores instructions that, when executed by a processor, enable the processor to perform the method described in any one of claims 1 to 6 or the method described in any one of claims 7 to 12.

Images