Display method and related device

Abstract

The application provides a display method and related device, which can be applied to 3D video call or video conference scene, can display stereoscopic images, and has low cost. The display method comprises: acquiring N color images, wherein N is a positive integer greater than 2, the N color images are synchronously collected by N image collection modules at different positions, and the collection ranges of any two image collection modules in the N image collection modules overlap; generating a depth image based on any two color images in the N color images, wherein the generated depth image is a depth image corresponding to one color image in the any two color images; generating at least two viewpoint images based on at least two depth images and color images corresponding to each depth image in the at least two depth images; generating a stereoscopic image based on two viewpoint images, and displaying the stereoscopic image.

Description

Display method and related devices Technical Field

[0001] This application relates to the field of electronic technology, and in particular to display methods and related devices. Background Technology

[0002] With the increasing demand for video communication, such as video calls and video conferencing, displaying stereoscopic images (3D) during video playback can enhance the immersive experience. Currently, there is a lack of low-cost solutions that can support stereoscopic image display.

[0003] Summary of the Invention

[0004] This application provides a display method and related apparatus that can be applied to 3D video calls or video conferencing scenarios, can display stereoscopic images, and has a low cost.

[0005] In a first aspect, embodiments of this application provide a display method, comprising:

[0006] N color images are acquired, where N is a positive integer greater than 2. The N color images are acquired synchronously by N image acquisition modules at different locations, and the acquisition ranges of any two of the N image acquisition modules overlap.

[0007] Based on any two of the N color images, a depth image is generated, and the generated depth image is used as the depth image corresponding to one of the two color images.

[0008] Generate at least two viewpoint maps based on at least two depth images and the color images corresponding to each of the at least two depth images;

[0009] A stereoscopic image is generated based on the two viewpoint images, and the stereoscopic image is displayed.

[0010] In this embodiment, a depth image is generated using a color image, which can simulate the depth image acquired by a depth image acquisition device. The generated depth image is then used to generate a viewpoint map to create a stereoscopic image. This reduces image acquisition costs and allows for the display of stereoscopic images, thus improving the viewing experience.

[0011] In one possible implementation, the display method provided in this application embodiment refers to N color images, all of which are first resolution images; the step of generating a depth image based on any two of the N color images includes:

[0012] Based on any two of the N color images, generate a second resolution image of each of the two color images, wherein the second resolution is smaller than the first resolution;

[0013] Based on the images of the target region in any two color images, generate a first sharpness depth image of the target region in one color image;

[0014] Based on the second resolution images of any two color images, a second sharpness depth image corresponding to the first color image is generated, wherein the second sharpness is less than the first sharpness.

[0015] In this embodiment, a first resolution image represents an image with a resolution of a first resolution. A second resolution image represents an image with a resolution of a second resolution. The second resolution is less than the first resolution, which is a limitation on the numerical relationship of the resolutions. Of the two, the first resolution is high resolution and the second resolution is low resolution. For ease of understanding, the first resolution image can also be referred to as a high resolution image, and the second resolution image can also be referred to as a low resolution image.

[0016] Similarly, a first-resolution image represents the image's sharpness as "first-resolution." A second-resolution image represents the image's sharpness as "second-resolution." The second-resolution being less than the first-resolution is a limitation on the numerical relationship of sharpness. Of the two, the first-resolution is high-definition, which can be simply referred to as HD. The second-resolution is low-definition, which can be simply referred to as LHD. For ease of understanding, a first-resolution image can be denoted as a HD image, and a second-resolution image can be denoted as a LHD image.

[0017] In one possible implementation, the display method provided in this application, wherein generating at least two viewpoint maps based on at least two depth images and color images corresponding to each of the at least two depth images includes:

[0018] Perform the following operations on the color images corresponding to each depth image:

[0019] Based on the first sharpness depth image corresponding to the target region in the color image, a first sharpness viewpoint map of the target region is generated;

[0020] A second-resolution viewpoint map is generated based on the second-resolution depth image corresponding to the color image;

[0021] A composite viewpoint map is determined based on the first and second resolution viewpoint maps of the target region.

[0022] In one possible implementation, the display method provided in this application embodiment refers to N color images, all of which are images with a first resolution.

[0023] The step of generating a depth image based on any two of the N color images includes:

[0024] Based on any two of the N color images, generate a second resolution image of each of the two color images, wherein the second resolution is smaller than the first resolution;

[0025] A second resolution image is generated based on the second resolution image of any two color images.

[0026] In one possible implementation, the display method provided in this application embodiment refers to the viewpoint map as the second resolution viewpoint map.

[0027] The step of generating at least two viewpoint maps based on at least two depth images and the color images corresponding to each of the at least two depth images includes:

[0028] At least two second-resolution viewpoint maps are determined based on at least two second-resolution depth images and their corresponding color images.

[0029] In one possible implementation, the display method provided in this application embodiment refers to the N color images as first resolution images and the viewpoint map as a first sharpness viewpoint map.

[0030] The step of generating a depth image based on any two of the N color images includes:

[0031] Generate a first sharpness depth image based on any two of the N color images;

[0032] The process of generating at least two viewpoint maps based on at least two depth images and the color images corresponding to each of the at least two depth images includes:

[0033] Based on the first resolution depth image and the corresponding color image, at least two first resolution viewpoint images are determined.

[0034] In some examples, the resolution of the second-resolution depth image corresponding to the color image is the same as the second resolution. In other examples, the resolution of the second-resolution depth image corresponding to the color image can be lower than the second resolution, which can reduce the computational power required by the electronic device.

[0035] Secondly, embodiments of this application provide a display method that can be applied to a transmitting-side device, wherein the method includes:

[0036] N color images are acquired, where N is a positive integer greater than 2. The N color images are acquired synchronously by N image acquisition modules at different locations, and the acquisition ranges of any two of the N image acquisition modules overlap.

[0037] Send the N color images so that the receiving device displays a stereoscopic image based on the received images; or...

[0038] Send a second-resolution image corresponding to each color image, so that the receiving device can display a stereoscopic image based on the received image; or...

[0039] The receiving device sends a second resolution image corresponding to each color image and an image of the target region in each color image, so that the receiving device can display a stereoscopic image based on the received image.

[0040] Thirdly, embodiments of this application provide a display method that can be applied to a receiving-side device, wherein the method includes:

[0041] Receive N color images, where N is a positive integer greater than 2. The N color images are synchronously acquired by the N image acquisition modules at different locations. The acquisition ranges of any two of the N image acquisition modules overlap.

[0042] Based on any two of the N color images, a depth image is generated, and the generated depth image is the depth image corresponding to one of the two color images;

[0043] Generate at least two viewpoint maps based on at least two depth images and the color images corresponding to each of the at least two depth images;

[0044] A stereoscopic image is generated based on the two viewpoint images, and the stereoscopic image is displayed.

[0045] Fourthly, embodiments of this application provide a display method that can be applied to a receiving-side device in a display system, wherein the method includes:

[0046] Receive a second resolution image corresponding to N color images, where N is a positive integer greater than 2, the N color images are synchronously acquired by N image acquisition modules at different locations, and the N color images are first resolution images, the acquisition ranges of any two image acquisition modules among the N image acquisition modules overlap, and the second resolution is smaller than the first resolution;

[0047] Based on the second resolution image of any two color images, generate a second sharpness depth image corresponding to one of the two color images;

[0048] Based on at least two second-resolution depth images and their corresponding color images, at least two second-resolution viewpoint maps are determined;

[0049] A stereoscopic image is generated based on two second-resolution viewpoint maps, and the stereoscopic image is displayed.

[0050] Fifthly, embodiments of this application provide a display method that can be applied to a receiving-side device, wherein the method includes:

[0051] Receive N color images corresponding to second resolution images, and images of target regions in each color image, where N is a positive integer greater than 2, the N color images are synchronously acquired by N image acquisition modules at different locations, and the N color images are first resolution images, the second resolution is less than the first resolution, and the acquisition ranges of any two image acquisition modules among the N image acquisition modules overlap;

[0052] A second resolution depth image is generated based on the second resolution image of any two color images, and the second resolution depth image serves as the second resolution depth image corresponding to one of the two color images;

[0053] Based on the images of the target region in any two color images, a first sharpness depth image of the target region in one color image is generated, wherein the second sharpness is less than the first sharpness;

[0054] The following operations are performed on the color images corresponding to each of the at least two second-resolution depth images: a first-resolution viewpoint map of the target region is generated based on the first-resolution depth image corresponding to the target region in the color image; a second-resolution viewpoint map is generated based on the second-resolution depth image corresponding to the color image; and a composite viewpoint map is determined based on the first-resolution viewpoint map and the second-resolution viewpoint map of the target region.

[0055] A stereoscopic image is generated based on the two synthesized viewpoint maps, and the stereoscopic image is displayed.

[0056] Sixthly, embodiments of this application provide a display method, comprising:

[0057] The display includes multiple display modes, including a first display mode and a second display mode. The first display mode includes multiple first resolution parameters for generating a color image, and the second display mode includes multiple second resolution parameters for the target area and multiple third resolution parameters for the non-target area.

[0058] In response to the selection operation of the target first resolution parameter in the first display mode, the target first resolution parameter is determined as the resolution parameter for displaying the stereoscopic image;

[0059] In response to the selection operation of the target second resolution parameter and the target third resolution parameter in the second display mode, the target second resolution parameter is determined as the resolution parameter of the target area for displaying the stereoscopic image, and the target third resolution parameter is determined as the resolution parameter of the non-target area for displaying the stereoscopic image.

[0060] In one possible implementation, the display method provided in this application embodiment,

[0061] In the first display mode, at least one of the multiple first resolution parameters is a custom resolution parameter; and / or,

[0062] In the second display mode, at least one of the multiple second resolution parameters is a custom resolution parameter; and / or,

[0063] In the second display mode, at least one of the multiple third resolution parameters is a custom resolution parameter.

[0064] In one possible implementation, the display method provided in this application embodiment further includes:

[0065] After determining the target first resolution parameter as the resolution parameter for displaying the stereoscopic image, the target first resolution parameter is sent to the transmitting device, so that the transmitting device provides the image corresponding to the target first resolution parameter; or,

[0066] After determining the target second resolution parameter as the resolution parameter for the target area of ​​the stereoscopic image and the target third resolution parameter as the resolution parameter for the non-target area of ​​the stereoscopic image, the target second resolution parameter and the target third resolution parameter are sent to the transmitting side device so that the transmitting side device provides the image corresponding to the target second resolution parameter and the image corresponding to the target third resolution parameter.

[0067] In one possible implementation, the display method provided in this application, after determining the target first resolution parameter as the resolution parameter for displaying a stereoscopic image, further includes:

[0068] Receive N second color images, where N is a positive integer greater than 2. The N first color images are synchronously acquired by N image acquisition modules at different locations. The acquisition ranges of any two image acquisition modules overlap. If the resolution of the first color image matches the target first resolution parameter, then the second color image is the first color image. If the resolution of the first color image does not match the target first resolution parameter, then the second color image is an image generated based on the first color image and the target first resolution parameter.

[0069] Based on any two second color images, a depth image is generated, and the generated depth image is used as the depth image corresponding to one of the two second color images;

[0070] Generate at least two viewpoint maps based on at least two depth images and the color images corresponding to each of the at least two depth images;

[0071] A stereoscopic image is generated based on the two viewpoint images, and the stereoscopic image is displayed.

[0072] In one possible implementation, the display method provided in this application, after determining the target second resolution parameter as the resolution parameter of the target area for displaying the stereoscopic image, and determining the target third resolution parameter as the resolution parameter of the area other than the target area for displaying the stereoscopic image, the method further includes:

[0073] The system receives N second color images and images of the target region from the N third color images, where N is a positive integer greater than 2. The N first color images are synchronously acquired by N image acquisition modules at different locations, and the acquisition ranges of any two of the N image acquisition modules overlap. Specifically, if the resolution of the first color image matches the target third resolution parameter, then the second color image is the first color image; if the resolution of the first color image does not match the target third resolution parameter, then the second color image is an image generated based on the first color image and the target third resolution parameter. Similarly, if the resolution of the first color image matches the target second resolution parameter, then the third color image is the first color image; if the resolution of the first color image does not match the target second resolution parameter, then the third color image is an image generated based on the first color image and the target second resolution parameter.

[0074] A second sharpness depth image is generated based on any two second color images, and the second sharpness depth image serves as the second sharpness depth image corresponding to one of the two second color images;

[0075] Based on the images in the target regions of the third color images corresponding to any two second color images, a first sharpness depth image corresponding to the target region in the second color image is generated, wherein the second sharpness is less than the first sharpness;

[0076] For each of at least two second color images, a first sharpness viewpoint map of the target region is generated based on a first sharpness depth image corresponding to the target region in each second color image; a second sharpness viewpoint map is generated based on a second sharpness depth image corresponding to each second color image; and a composite viewpoint map is determined based on the first sharpness viewpoint map and the second sharpness viewpoint map of the target region.

[0077] A stereoscopic image is generated based on the two synthesized viewpoint maps, and the stereoscopic image is displayed.

[0078] Seventhly, embodiments of this application provide a display method, comprising:

[0079] Multiple display modes are displayed, including a third display mode, a fourth display mode, and a fifth display mode, wherein the resolution corresponding to the third display mode is greater than the resolution corresponding to the fourth display mode;

[0080] In response to the selection operation of the third display mode, the resolution corresponding to the third display mode is determined as the resolution for displaying stereoscopic images;

[0081] In response to the selection operation of the fourth display mode, the resolution corresponding to the fourth display mode is determined as the resolution for displaying stereoscopic images;

[0082] In response to the selection of the fifth display mode, multiple sub-modes are displayed, each sub-mode corresponding to a set of resolutions, the set of resolutions including a fourth resolution and a fifth resolution; and in response to the selection of a target sub-mode among the multiple sub-modes, the fourth resolution in the set of resolutions corresponding to the target sub-mode is determined as the resolution for displaying the target area of ​​the stereoscopic image, and the fifth resolution in the set of resolutions corresponding to the target sub-mode is determined as the resolution for displaying the area of ​​the stereoscopic image other than the target area.

[0083] In one possible implementation, the display method provided in this application embodiment further includes:

[0084] After determining the resolution corresponding to the third display mode as the resolution for displaying stereoscopic images, the information of the third display mode is sent to the receiving device so that the receiving device provides the image corresponding to the third display mode; or,

[0085] After determining the resolution corresponding to the fourth display mode as the resolution for displaying stereoscopic images, the information of the fourth display mode is sent to the receiving device so that the receiving device provides the image corresponding to the fourth display mode; or,

[0086] After determining the fourth resolution in a set of resolutions corresponding to the target sub-mode as the resolution for displaying the target area of ​​the stereoscopic image, and determining the fifth resolution in a set of resolutions corresponding to the target sub-mode as the resolution for displaying the area of ​​the stereoscopic image other than the target area, the information of the target sub-mode is sent to the receiving device so that the receiving device provides the image corresponding to the target fourth resolution parameter and the image corresponding to the target fifth resolution parameter.

[0087] In one possible implementation, the display method provided in this application, after determining the resolution corresponding to the third display mode as the resolution for displaying stereoscopic images, further includes:

[0088] N second color images are received, where N is a positive integer greater than 2. The N first color images are synchronously acquired by N image acquisition modules at different locations, and the acquisition ranges of any two of the N image acquisition modules overlap. If the resolution of the first color image is the same as the resolution corresponding to the third display mode, then the second color image is the first color image. If the resolution of the first color image is different from the resolution corresponding to the third display mode, then the second color image is an image generated based on the first color image with a resolution corresponding to the third display mode.

[0089] Based on any two second color images, a depth image is generated, and the generated depth image is used as the depth image corresponding to one of the two second color images;

[0090] Generate at least two viewpoint maps based on at least two depth images and the color images corresponding to each of the at least two depth images;

[0091] A stereoscopic image is generated based on the two viewpoint images, and the stereoscopic image is displayed.

[0092] In one possible implementation, the display method provided in this application, after determining the resolution corresponding to the fourth display mode as the resolution for displaying stereoscopic images, further includes:

[0093] N second color images are received, where N is a positive integer greater than 2. The N first color images are synchronously acquired by N image acquisition modules at different locations, and the acquisition ranges of any two of the N image acquisition modules overlap. If the resolution of the first color image is the same as the resolution corresponding to the fourth display mode, then the second color image is the first color image. If the resolution of the first color image is different from the resolution corresponding to the fourth display mode, then the second color image is an image generated based on the first color image with a resolution corresponding to the fourth display mode.

[0094] Based on any two second color images, a depth image is generated, and the generated depth image is used as the depth image corresponding to one of the two second color images;

[0095] Generate at least two viewpoint maps based on at least two depth images and the color images corresponding to each of the at least two depth images;

[0096] A stereoscopic image is generated based on the two viewpoint images, and the stereoscopic image is displayed.

[0097] In one possible implementation, the display method provided in this application, after determining the fourth resolution in a set of resolutions corresponding to the target sub-mode as the resolution for displaying the target area of ​​the stereoscopic image, and determining the fifth resolution in a set of resolutions corresponding to the target sub-mode as the resolution for displaying the area of ​​the stereoscopic image other than the target area, the method further includes:

[0098] The system receives N second color images and images of the target region from the N third color images, where N is a positive integer greater than 2. The N first color images are synchronously acquired by N image acquisition modules at different locations, and the acquisition ranges of any two of the N image acquisition modules overlap. Specifically, if the resolution of the first color image is the same as the fifth resolution corresponding to the target sub-mode, then the second color image is the first color image; if the resolution of the first color image is different from the fifth resolution corresponding to the target sub-mode, then the second color image is an image generated based on the first color image and the fifth resolution corresponding to the target sub-mode. If the resolution of the first color image is the same as the fourth resolution corresponding to the target sub-mode, then the third color image is the first color image; if the resolution of the first color image is different from the fourth resolution corresponding to the target sub-mode, then the third color image is an image generated based on the first color image and the fourth resolution corresponding to the target sub-mode.

[0099] A second sharpness depth image is generated based on any two second color images, and the second sharpness depth image serves as the second sharpness depth image corresponding to one of the two second color images;

[0100] Based on the images in the target regions of the third color images corresponding to any two second color images, a first sharpness depth image corresponding to the target region in the second color image is generated, wherein the second sharpness is less than the first sharpness;

[0101] For each of at least two second color images, a first sharpness viewpoint map of the target region is generated based on a first sharpness depth image corresponding to the target region in each second color image; a second sharpness viewpoint map is generated based on a second sharpness depth image corresponding to each second color image; and a composite viewpoint map is determined based on the first sharpness viewpoint map and the second sharpness viewpoint map of the target region.

[0102] A stereoscopic image is generated based on the two synthesized viewpoint maps, and the stereoscopic image is displayed.

[0103] Eighthly, embodiments of this application provide an electronic device, comprising:

[0104] The system includes a display screen, a communication module, a processor, and N image acquisition modules, wherein the number of N image acquisition modules is a positive integer greater than 2; wherein all or part of the N image acquisition modules are located on the first side of the display screen.

[0105] The display screen is used to display images;

[0106] The image acquisition module is used to acquire color images;

[0107] The communication module is used to send the color images acquired by each image acquisition module to the receiving device;

[0108] The processor is used to perform steps or operations as described in any of the possible implementations of the first to fourth aspects.

[0109] In one possible implementation, the electronic device provided in this application embodiment has four of the N image acquisition modules; wherein,

[0110] All four image acquisition modules are located on the first side of the display screen; or,

[0111] Two of the image acquisition modules are located on the first side of the display screen, and two of the image acquisition modules are located on the second side of the display screen, with the second side opposite to the first side; or,

[0112] Two of the image acquisition modules are located on the first side of the display screen, one of the image acquisition modules is located on the third side of the display screen, and one of the image acquisition modules is located on the fourth side of the display screen. The third side is the side adjacent to the first side, and the fourth side is opposite to the third side.

[0113] In one possible implementation, the electronic device provided in this application embodiment has 6 of the N image acquisition modules; wherein,

[0114] All four image acquisition modules are located on the first side of the display screen, and two image acquisition modules are located on the second side of the display screen, with the second side opposite to the first side; or,

[0115] Two of the image acquisition modules are located on the first side of the display screen, two of the image acquisition modules are located on the second side of the display screen, one of the image acquisition modules is located on the third side of the display screen, and one of the image acquisition modules is located on the fourth side of the display screen. The third side is adjacent to the first side, and the fourth side is opposite to the third side; or,

[0116] Two of the image acquisition modules are located on the first side of the display screen, two of the image acquisition modules are located on the third side of the display screen, and two of the image acquisition modules are located on the fourth side of the display screen.

[0117] Ninthly, embodiments of this application provide a display system, which includes an electronic device on a transmitting side and an electronic device on a receiving side;

[0118] The electronic device on the transmitting side is used to perform the method as described in the second aspect;

[0119] The electronic device on the receiving side is used to perform steps or operations as described in any of the possible implementations of the third to seventh aspects.

[0120] In a tenth aspect, embodiments of this application provide a computer-readable storage medium for storing a computer program that, when run on a computer, causes the computer to perform operations performed by a first device in any of the possible implementations of the first to seventh aspects.

[0121] Eleventhly, embodiments of this application also provide a computer program product, including a computer program that, when run on a computer, causes the computer to perform operations performed by a first device as described in any of the possible implementations of the first to seventh aspects. Attached Figure Description

[0122] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0123] Figure 1 is a schematic diagram of an application scenario provided by an embodiment of this application;

[0124] Figure 2 is a schematic flowchart of a display method performed by a display system according to an embodiment of this application;

[0125] Figure 3 is a schematic diagram of the structure of the transmitting side device shown in an embodiment of this application;

[0126] Figure 4 is a schematic diagram illustrating the relationship between the images in a display method according to an exemplary embodiment;

[0127] Figure 5 is a schematic flowchart of a display method performed by a display system according to an embodiment of this application;

[0128] Figure 6 is a schematic diagram illustrating the relationship between the images in a display method according to an exemplary embodiment;

[0129] Figure 7 is a schematic flowchart of a display method performed by a display system according to an embodiment of this application;

[0130] Figure 8 is a schematic flowchart of a display method performed by a display system according to an embodiment of this application;

[0131] Figure 9A is a schematic flowchart of a display method performed by a transmitting device according to an embodiment of this application;

[0132] Figure 9B is a schematic flowchart of a display method performed by a receiving device according to an embodiment of this application;

[0133] Figure 9C is a schematic flowchart of a display method performed by a receiving device according to an embodiment of this application;

[0134] Figure 9D is a schematic flowchart of a display method performed by a receiving device according to an embodiment of this application;

[0135] Figure 10A is a schematic flowchart of the display method performed by the receiving device according to an embodiment of this application;

[0136] Figures 10B-10E are schematic diagrams of the interactive interfaces provided in one embodiment of this application, respectively;

[0137] Figure 11 is a schematic flowchart of the display method performed by the receiving device according to an embodiment of this application;

[0138] Figures 12A and 12B are schematic diagrams of the interactive interface provided in an embodiment of this application, respectively;

[0139] Figure 13 is a schematic diagram of the structure of an electronic device provided in an embodiment of this application;

[0140] Figures 14A-14C are schematic diagrams showing the positional relationship between the image acquisition module and the display screen provided in one embodiment of this application, respectively.

[0141] Figures 15A-15C are schematic diagrams showing the positional relationship between the image acquisition module and the display screen provided in one embodiment of this application, respectively.

[0142] Figure 16 is a schematic diagram of the structure of a display system provided in an embodiment of this application;

[0143] Figure 17A is a schematic diagram of the operation process of a display system provided in an embodiment of this application;

[0144] Figure 17B is a schematic diagram of the operation process of a display system provided in an embodiment of this application;

[0145] Figure 18 is a schematic diagram of multiple stages in the testing process of the display system provided in the embodiment of this application. Detailed Implementation

[0146] The embodiments of this application involve at least one, including one or more; wherein, multiple means two or more. Furthermore, it should be understood that in the description of this application, terms such as "first" and "second" are used only for descriptive purposes and should not be construed as indicating or implying relative importance, nor as indicating or implying order. In the description of this application, "A and / or B" includes three options: including A; including B; and including both A and B.

[0147] References to "one embodiment" or "some embodiments" as described in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0148] Figure 1 illustrates an exemplary video communication scenario where electronic device A and electronic device B communicate via video. Electronic device A can send images of user A to electronic device B, and electronic device B can send images of user B to electronic device A.

[0149] Electronic device A can display images with the desired visual effect as requested by user A. For example, if user A expects to view a 2D image, electronic device A can also display a 2D image of user B. To enhance the immersive experience, if user A expects to view a 3D image effect, electronic device A can display a 3D image of user B based on the received image of user B.

[0150] Similarly, when user B wants to view a 3D image effect, electronic device B can display a 3D image of user A based on the image received from user A, and user B can view the 3D image of user A through electronic device B. When user B wants to view a 2D image, electronic device B can also display a 2D image of user A.

[0151] Video communication typically involves one device acquiring image data, transmitting it to another device for processing, and then displaying the data. This application does not specify a particular communication method for transmitting image data between video communication devices; data transmission can be performed via wired or wireless communication.

[0152] Video communication can be applied to, but is not limited to, video calls, video conferencing, and live streaming. 3D video communication involves one device capturing image data, transmitting it to another device for processing, and then displaying the resulting 3D image. 3D video communication can provide a better viewing experience and enhance immersion.

[0153] To display 3D image effects, one could consider using a depth camera and a color camera to simultaneously acquire images, allowing the receiving device to utilize both depth and color images to display 3D image effects. However, depth cameras are expensive and therefore difficult to use widely.

[0154] This application provides a display method that can be applied in the field of video communication. It has a low cost and can display 3D images, bringing a better viewing experience.

[0155] Figure 2 illustrates an exemplary display method applicable to video communication scenarios. This display method can be executed by a display system. The display system may include a transmitting device and a receiving device. The transmitting device and the receiving device can cooperate to implement the operations in this display method. The transmitting device can perform one or more steps in the display method. The receiving device can perform one or more steps in the display method. The display method may include the following steps:

[0156] S201, acquire N color images.

[0157] N is a positive integer greater than 2. The N color images are acquired synchronously at different locations by the N image acquisition modules. The acquisition ranges of any two of the N image acquisition modules overlap.

[0158] The display system may acquire color images by either capturing or receiving them.

[0159] In some examples, the transmitting-side device in the display system can acquire color images. Referring to Figure 3, the transmitting-side device can have multiple image acquisition modules distributed in different locations, and the number of these modules can be greater than or equal to N. The transmitting-side device can simultaneously acquire images using N image acquisition modules, and the acquisition ranges of any two of these N image acquisition modules overlap.

[0160] In other examples, the transmitting device in the system can acquire color images. The receiving device can receive N color images provided by the transmitting device.

[0161] S202, Generate a depth image based on any two of the N color images.

[0162] The depth image generated in step S202 can be used as the depth image corresponding to one of the two color images. A depth image can be generated using two color images, and the generated depth image can be regarded as the location of the image acquisition module to which one of the two color images belongs, assuming that a depth image acquisition device is placed to acquire the depth image.

[0163] Referring to Figure 4, the system can use two of N color images, such as color image P1 and color image P2, to generate a depth image corresponding to color image P1. The depth image corresponding to color image P1 can be considered as a simulation of the depth image captured by a depth camera placed at the location of the image acquisition module that captured color image P1. This design eliminates the need for a depth camera on the transmitting side, reducing costs.

[0164] A display system can determine the depth image corresponding to at least two color images. For example, a display system can use color image P1 and color image P2 to generate the depth image corresponding to color image P1. An electronic device can use color image P2 and color image P3 to generate the depth image corresponding to color image 2.

[0165] In one possible implementation, the display system can utilize existing algorithms for generating depth images from multiple color images. In another possible implementation, the display system can be configured with a pre-trained first neural network model, which can output a depth image corresponding to one of the color images when multiple color images are input into the first neural network model.

[0166] The display system can repeatedly execute the operation in step S202 to generate multiple depth images. There is no specific limit to the number of depth images. The number of depth images should be greater than or equal to two.

[0167] S203, generate at least two viewpoint maps based on at least two depth images and the color images corresponding to each depth image in the at least two depth images.

[0168] Referring again to Figure 4, the display system can generate viewpoint map 1 using color image P1 and its corresponding depth map. The display system can also generate viewpoint map 2 using color image P2 and its corresponding depth map.

[0169] In one possible implementation, the display system can utilize existing algorithms that generate viewpoint maps using depth and color images. In another possible implementation, the display system can be configured with a pre-trained second neural network model, into which a color image and its corresponding depth image are input, and the second neural network model can output a viewpoint map.

[0170] S204, Based on the two viewpoint maps, generate a stereoscopic image and display the stereoscopic image.

[0171] Referring again to Figure 4, the display system can use viewpoint diagram 1 and viewpoint diagram 2 to generate stereoscopic images, i.e., 3D images. The display system can then display the generated stereoscopic images.

[0172] In one possible implementation, the display system can determine multiple viewpoint maps with parallax, and the number of viewpoint maps can exceed two. The display system can be configured with multiple image acquisition modules. The display system can use the image acquisition modules to acquire images of the user and determine the user's eye position. Based on the user's eye position, the display system can select two viewpoint maps from the multiple viewpoint maps to generate a stereoscopic image. The display system can perform 3D image arrangement processing on the selected two viewpoint maps to obtain a stereoscopic image and display the stereoscopic image. The user can directly view the 3D effect image, i.e., a naked-eye 3D effect.

[0173] In this embodiment, a first resolution image represents an image with a resolution of a first resolution. A second resolution image represents an image with a resolution of a second resolution. The second resolution is less than the first resolution, which is a limitation on the numerical relationship of the resolutions. Of the two, the first resolution is high resolution and the second resolution is low resolution. For ease of understanding, the first resolution image can also be referred to as a high resolution image, and the second resolution image can also be referred to as a low resolution image.

[0174] Similarly, a first-resolution image represents the image's sharpness as "first-resolution." A second-resolution image represents the image's sharpness as "second-resolution." The second-resolution being less than the first-resolution is a limitation on the numerical relationship of sharpness. Of the two, the first-resolution is high-definition, which can be simply referred to as HD. The second-resolution is low-definition, which can be simply referred to as LHD. For ease of understanding, a first-resolution image can be denoted as a HD image, and a second-resolution image can be denoted as a LHD image.

[0175] In one possible design, the processes of steps S201 to S204 described above can be implemented by the cooperation of the transmitting-side device and the receiving-side device in the display system. Several possible implementation methods for the display method implemented by the cooperation of the transmitting-side device and the receiving-side device are provided below. The display system can adopt a suitable implementation method based on actual application needs. For example, based on application scenario requirements or device computing power requirements, this application embodiment does not impose excessive limitations in this regard.

[0176] In some examples, the transmitting device can perform the operation in step S201. The receiving device can perform the operations in steps S202 to S204. Optionally, the transmitting device can provide the receiving device with N color images, which are high-resolution images acquired by the image acquisition module. Alternatively, the transmitting device can provide the receiving device with related images for generating a depth image, such as low-resolution images of the N color images, images of partial regions of the N color images, etc.

[0177] In other examples, the transmitting device can perform the operations in steps S201 and S202. The receiving device can perform the operations in steps S203 and S204. The transmitting device can provide the receiving device with a depth image corresponding to the color image, such as a high-resolution depth map or a low-resolution depth map corresponding to the color image.

[0178] In other examples, the transmitting device can perform the operations in steps S201, S202, and S203. The receiving device can perform the operation in step S204. The receiving device can provide the transmitting device with the eye positions of the user using the receiving device. The transmitting device can provide the receiving device with two viewpoint maps generated based on these eye positions.

[0179] In other examples, the transmitting device may perform the operations in steps S201, S202, and S203, and in step S204, generate a stereoscopic image based on the two viewpoint maps. The receiving device may perform the operation of displaying the stereoscopic image in step S204. The receiving device may provide the transmitting device with the eye positions of the user using the receiving device. The transmitting device may generate two viewpoint maps based on these eye positions, synthesize a stereoscopic image, and send the stereoscopic image to the receiving device for display.

[0180] Figure 5 illustrates an exemplary display method that can be executed by a display system, enabling the display of a 3D image with a mixed resolution effect. The display system may include a transmitting-side device and a receiving-side device. The transmitting-side device and the receiving-side device can cooperate to implement the operations in this display method. The transmitting-side device can perform one or more steps in the display method. The receiving-side device can perform one or more steps in the display method. The display method may include:

[0181] S501, acquire N color images.

[0182] Please refer to the relevant description of step S201 in the foregoing embodiments, which will not be repeated here.

[0183] S502, based on any two of the N color images, generate second resolution images of the two color images respectively.

[0184] Among them, the N color images are all first resolution images, and the second resolution is smaller than the first resolution.

[0185] The N color images acquired by the display system can be high-resolution images, and the resolution of the acquired color images is recorded as the initial resolution for easy differentiation. The display system can extract image data from the image data storage memory block of the N color images at the target resolution to generate a low-resolution color image. The target resolution is smaller than the initial resolution. Optionally, the target resolution can be a default value, or the target resolution can be adjustable.

[0186] S503, based on the images of the target region in any two color images, generate a first sharpness depth image of the target region in one color image.

[0187] The target region in a color image can be a preset area. Alternatively, the target region in a color image can be a face. The display system can perform face recognition on the color image and identify the face region as the target region.

[0188] For ease of understanding, let's take two color images, P1 and P2, as examples. Referring to Figure 6, the system can generate a high-resolution depth image of the target region in color image P1 based on the images in the target region of color image P1 and the images in the target region of color image P2. Compared to the target resolution, since both color images P1 and P2 are high-resolution images, and the images in the target regions of each color image are also high-resolution images, the generated depth image of the target region is also a high-resolution image. For ease of distinction, the generated depth image of the target region is denoted as the high-resolution depth image of the target region.

[0189] S504, based on the second resolution images of any two color images, generate a second sharpness depth image corresponding to the one color image.

[0190] The second resolution is less than the first resolution. Referring again to Figure 6, the display system can use the low-resolution image M1 of color image P1 and the low-resolution image M2 of color image P2 to generate a depth image corresponding to color image P1. The resolution of this depth image is the target resolution, which is less than the initial resolution. Therefore, the depth image corresponding to color image P1 can be denoted as the low-resolution depth image corresponding to color image P1. The low-resolution depth image includes both the target area and non-target areas of the color image.

[0191] The display system performs the operations in steps S505 to S507 on the color images corresponding to each depth image in at least two depth images.

[0192] S505, for the color images corresponding to each depth image, based on the first sharpness depth image corresponding to the target region in the color image, generate a first sharpness viewpoint map of the target region.

[0193] S506, Based on the second-resolution depth image corresponding to the color image, generate a second-resolution viewpoint map.

[0194] S507, Based on the first sharpness viewpoint map and the second sharpness viewpoint map of the target area, a composite viewpoint map is determined.

[0195] For ease of understanding, the first resolution viewpoint map will be referred to as the high-definition viewpoint map, and the second resolution viewpoint map will be referred to as the low-definition viewpoint map. Referring again to Figure 6, the display system can use the color image P1 and the high-definition depth image corresponding to the target area of ​​the color image P1 to generate a high-definition viewpoint map C1 for the target area, and use the low-resolution image of the color image P1 and the low-definition depth image corresponding to the color image P1 to generate a low-definition viewpoint map D1. The display system can use the high-definition viewpoint map C1 and the low-definition viewpoint map D1 of the target area to generate a composite viewpoint map 1. For example, the display system can replace the image in the target area of ​​the low-definition viewpoint map with the high-definition viewpoint map C1 of the target area. This makes the image in the target area of ​​the composite viewpoint map 1 high-resolution, and the part outside the target area low-resolution. The viewpoint of the low-definition viewpoint map D1 is the same as the viewpoint of the high-definition viewpoint map C1 of the target area, and this viewpoint can be determined based on the eye position output by the receiving device during eye tracking.

[0196] The display system can generate a high-resolution viewpoint map C2 of the target area using a color image P2 and a high-resolution depth image corresponding to the target area of ​​color image P2, and generate a low-resolution viewpoint map D2 using a low-resolution image of color image P2 and a low-resolution depth image corresponding to color image P2. The display system can then generate a composite viewpoint map 2 using the high-resolution viewpoint map C2 and the low-resolution viewpoint map D2 of the target area. For example, the display system can replace the image of the target area in the low-resolution viewpoint map with the high-resolution viewpoint map C2. This ensures that the image of the target area in the composite viewpoint map 2 is high-resolution, while the portion outside the target area is low-resolution. The viewpoint of the low-resolution viewpoint map D2 is the same as the viewpoint of the high-resolution viewpoint map C2 of the target area, and this viewpoint can be determined based on the eye position output by the receiving device during eye tracking.

[0197] S508, Based on the two synthesized viewpoint maps, generate a stereoscopic image and display the stereoscopic image.

[0198] The display system can synthesize a 3D image based on the position of the human eye, using the synthesized viewpoint map corresponding to the left eye position and the synthesized viewpoint map corresponding to the right eye position, and then display it.

[0199] In one possible design, the processes of steps S501 to S508 described above can be implemented by the cooperation of the transmitting-side device and the receiving-side device in the display system. Several possible implementation methods for the display method implemented by the cooperation of the transmitting-side device and the receiving-side device are provided below. The display system can adopt a suitable implementation method based on actual application needs to implement this display method. For example, based on application scenario needs, or based on device computing power needs, etc., this application embodiment does not impose excessive limitations in this regard.

[0200] In some examples, the transmitting device can perform the operation in step S501. The receiving device can perform the operations in steps S502 to S508. The transmitting device can provide N color images to the receiving device.

[0201] In other examples, the transmitting device can perform the operations in steps S501 and S502. The receiving device can perform the operations in steps S503 to S508. The transmitting device can provide the receiving device with low-resolution images corresponding to N color images, and an image of the target region in the N color images.

[0202] In some other examples, the transmitting device may perform the operations in steps S501 to S504. The receiving device may perform the operations in steps S505 to S508. The transmitting device may provide the receiving device with a low-resolution depth image of the color image and a high-resolution depth image of the target area in the color image.

[0203] In some other examples, the transmitting device may perform the operations in steps S501 to S506. The receiving device may perform the operations in step S507 and step S508. The receiving device may provide the transmitting device with the eye positions of the user using the receiving device. The transmitting device may provide the receiving device with a low-resolution viewpoint map generated based on the eye positions, and a high-resolution viewpoint map of the target area.

[0204] In some other examples, the transmitting device may perform the operations in steps S501 to S507. The receiving device may perform the operations in step S508. The receiving device may provide the transmitting device with the eye positions of the user using the receiving device. The transmitting device may provide the receiving device with a low-resolution viewpoint map generated based on the eye positions, and a high-resolution viewpoint map of the target area. The transmitting device provides the determined composite viewpoint map to the receiving device.

[0205] In other examples, the transmitting device may perform the operations in steps S501 to S507, and in step S508 generate a stereoscopic image based on the two synthesized viewpoint maps. The receiving device may perform the operation of displaying the stereoscopic image in step S508. The receiving device may provide the transmitting device with the eye positions of the user using the receiving device. The transmitting device may provide the receiving device with a low-resolution viewpoint map generated based on the eye positions, and a high-resolution viewpoint map of the target area. After generating a stereoscopic image based on the synthesized viewpoint maps, the transmitting device may send the stereoscopic image to the receiving device for display.

[0206] Figure 7 exemplarily illustrates a display method that can be executed by a display system, enabling the display of a 3D image with low resolution. The display system may include a transmitting-side device and a receiving-side device. The transmitting-side device and the receiving-side device can cooperate to implement the operations in this display method. The transmitting-side device can perform one or more steps in the display method. The receiving-side device can perform one or more steps in the display method. The display method may include:

[0207] S701, acquire N color images.

[0208] Please refer to the relevant description of step S201 in the foregoing embodiments, which will not be repeated here.

[0209] S702, based on any two of the N color images, generate second resolution images of the two color images respectively.

[0210] The second resolution is smaller than the first resolution. Please refer to the relevant description of step S502 in the foregoing embodiments; it will not be repeated here.

[0211] S703, based on the second resolution image of any two color images, generate a second sharpness depth image.

[0212] Please refer to the relevant description of step S504 in the foregoing embodiments, which will not be repeated here.

[0213] S704, based on at least two second-resolution depth images and corresponding color images, determine at least two second-resolution viewpoint maps.

[0214] S705, Based on the two second-resolution viewpoint maps, generate a stereoscopic image and display the stereoscopic image.

[0215] The display system can synthesize a 3D image based on the user's eye position using the low-resolution viewpoint image corresponding to the left eye position and the low-resolution viewpoint image corresponding to the right eye position, and then display it.

[0216] In one possible design, the processes of steps S701 to S705 described above can be implemented by the cooperation of the transmitting-side device and the receiving-side device in the display system. Several possible implementation methods for the display method implemented by the cooperation of the transmitting-side device and the receiving-side device are provided below. The display system can adopt a suitable implementation method based on actual application needs to implement this display method. For example, based on application scenario needs, or based on device computing power needs, etc., this application embodiment does not impose excessive limitations in this regard.

[0217] In some examples, the transmitting device can perform the operation in step S701. The receiving device can perform the operations in steps S702 to S705. The transmitting device can provide N color images to the receiving device.

[0218] In other examples, the transmitting device may perform the operations in steps S701 and S702. The receiving device may perform the operations in steps S703 to S705. The transmitting device may provide the receiving device with low-resolution images of each color image.

[0219] In other examples, the transmitting device may perform the operations in steps S701 to S703. The receiving device may perform the operations in steps S704 and S705. The transmitting device may provide the receiving device with a low-resolution depth image corresponding to the color image.

[0220] In some other examples, the transmitting device can perform the operations in steps S701 to S704. The receiving device can perform the operation in step S705. The receiving device can provide the transmitting device with the eye positions of the user using the receiving device. The transmitting device can provide the receiving device with two low-resolution viewpoint maps generated based on these eye positions.

[0221] In other examples, the transmitting device may perform the operations in steps S701 to S704, and in step S705 generate a stereoscopic image based on the two low-resolution viewpoint maps. The receiving device may perform the operation of displaying the stereoscopic image in step S705. The receiving device may provide the transmitting device with the eye positions of the user using the receiving device. The transmitting device may generate two low-resolution viewpoint maps based on these eye positions, synthesize a stereoscopic image, and send the stereoscopic image to the receiving device for display.

[0222] Figure 8 exemplarily illustrates a display method that can be executed by a display system, enabling the display of a 3D image with high resolution. The display system may include a transmitting-side device and a receiving-side device. The transmitting-side device and the receiving-side device can cooperate to implement the operations in this display method. The transmitting-side device can perform one or more steps in the display method. The receiving-side device can perform one or more steps in the display method. The display method may include:

[0223] The display method may include:

[0224] S801, acquire N color images.

[0225] Please refer to the relevant description of step S201 in the foregoing embodiments, which will not be repeated here.

[0226] S802, Based on any two of the N color images, generate a first sharpness depth image.

[0227] The resolution of a high-definition depth image can be the same as that of the received color image.

[0228] S803, based on the first resolution depth image and the corresponding color image, determine at least two first resolution viewpoint images.

[0229] S804, Generate a stereoscopic image based on the two first-resolution viewpoint maps, and display the stereoscopic image.

[0230] In one possible design, the processes of steps S801 to S804 described above can be implemented by the cooperation of the transmitting-side device and the receiving-side device in the display system. Several possible implementation methods for the display method implemented by the cooperation of the transmitting-side device and the receiving-side device are provided below. The display system can adopt a suitable implementation method based on actual application needs to implement this display method. For example, based on application scenario needs, or based on device computing power needs, etc., this application embodiment does not impose excessive limitations in this regard.

[0231] In some examples, the transmitting device can perform the operation in step S801. The receiving device can perform the operations in steps S802 to S804. Optionally, the transmitting device can provide N color images to the receiving device.

[0232] In other examples, the transmitting device can perform the operations in steps S801 and S802. The receiving device can perform the operations in steps S803 and S804. The transmitting device can provide the receiving device with a high-resolution depth image corresponding to the color image.

[0233] In other examples, the transmitting device can perform the operations in steps S801, S802, and S803. The receiving device can perform the operation in step S804. The receiving device can provide the transmitting device with the eye positions of the user using the receiving device. The transmitting device can provide the receiving device with two high-definition viewpoint maps generated based on these eye positions.

[0234] In other examples, the transmitting device can perform the operations in steps S801, S802, and S803, and in step S804, generate a stereoscopic image based on the two high-definition viewpoint maps. The receiving device can perform the operation of displaying the stereoscopic image in step S804. The receiving device can provide the transmitting device with the eye positions of the user using the receiving device. The transmitting device can generate two high-definition viewpoint maps based on these eye positions, synthesize a stereoscopic image, and send the stereoscopic image to the receiving device for display.

[0235] The method shown in Figure 7 above can generate a stereoscopic image at a target resolution, where the target resolution is smaller than the resolution of the color image acquired by the image acquisition module, i.e., the target resolution is smaller than the initial resolution. The method shown in Figure 8 above can generate a stereoscopic image at the initial resolution. The method shown in Figure 5 above can generate a stereoscopic image with mixed resolutions.

[0236] The display system can execute any of the display methods provided in Figures 5, 7, and 8 above, according to user needs.

[0237] Based on the working process of the display system provided in the above embodiments, this application embodiment also provides a display method, which can be executed by a transmitting-side device. As shown in FIG9A, the display method may include:

[0238] S901A, acquires N color images.

[0239] N is a positive integer greater than 2. The N color images are acquired synchronously by N image acquisition modules at different locations. The acquisition ranges of any two of the N image acquisition modules overlap. All N color images are first resolution images.

[0240] After step S901A, the transmitting device may execute one of steps S902A to S904A. In some possible implementations, the receiving device may acquire the user's display requirements, such as the user-selected display mode. The receiving device may provide the user-selected display mode to the transmitting device. The transmitting device may generate an image with the resolution corresponding to the user-selected display mode and send it to the receiving device.

[0241] S902A, the N color images are sent so that the receiving device can display a stereoscopic image based on the received images.

[0242] S903A, transmits a second resolution image corresponding to each color image, so that the receiving device can display a stereoscopic image based on the received image.

[0243] The second resolution is smaller than the first resolution.

[0244] S904A, send the second resolution image corresponding to each color image, and send the image of the target area in each color image, so that the receiving device can display a stereoscopic image based on the received image.

[0245] This application embodiment also provides a display method, which can be executed by a receiving device. As shown in FIG9B, the display method may include:

[0246] S901B receives N color images.

[0247] N is a positive integer greater than 2. The N color images are acquired synchronously at different locations by the N image acquisition modules. The acquisition ranges of any two of the N image acquisition modules overlap.

[0248] S902B, based on any two of the N color images, generate a depth image, wherein the generated depth image is the depth image corresponding to one of the two color images.

[0249] S903B generates at least two viewpoint maps based on at least two depth images and the color images corresponding to each depth image in the at least two depth images.

[0250] S904B generates a stereoscopic image based on the two viewpoint maps and displays the stereoscopic image.

[0251] This application embodiment also provides a display method, which can be executed by a receiving device. As shown in FIG9C, the display method may include:

[0252] S901C receives second-resolution images corresponding to N color images.

[0253] N is a positive integer greater than 2. The N color images are synchronously acquired by N image acquisition modules at different locations. The N color images are images with a first resolution. The acquisition ranges of any two of the N image acquisition modules overlap. The second resolution is smaller than the first resolution.

[0254] S902C, based on the second resolution image of any two color images, generates a second sharpness depth image corresponding to one of the two color images.

[0255] S903C, based on at least two second-resolution depth images and corresponding color images, determines at least two second-resolution viewpoint maps.

[0256] S904C generates a stereoscopic image based on two second-resolution viewpoint maps and displays the stereoscopic image.

[0257] This application embodiment also provides a display method, which can be executed by a receiving device. As shown in FIG9D, the display method may include:

[0258] S901D receives second-resolution images corresponding to N color images, as well as images of the target region in each color image.

[0259] N is a positive integer greater than 2. The N color images are synchronously acquired by N image acquisition modules at different locations. The N color images are images with a first resolution, and the second resolution is less than the first resolution. The acquisition ranges of any two image acquisition modules among the N image acquisition modules overlap.

[0260] S902D generates a second-resolution depth image based on a second-resolution image of any two color images.

[0261] The second sharpness depth image is the second sharpness depth image corresponding to one of the two color images.

[0262] S903D, based on the images of the target region in any two color images, generates a first sharpness depth image of the target region in one color image.

[0263] The second level of sharpness is less than the first level of sharpness.

[0264] S904D, the following operations are performed on the color images corresponding to each of the at least two second-resolution depth images: a first-resolution viewpoint map of the target region is generated based on the first-resolution depth image corresponding to the target region in the color image; a second-resolution viewpoint map is generated based on the second-resolution depth image corresponding to the color image; and a composite viewpoint map is determined based on the first-resolution viewpoint map and the second-resolution viewpoint map of the target region.

[0265] S905D generates a stereoscopic image based on the two synthesized viewpoint maps and displays the stereoscopic image.

[0266] This application embodiment also provides a display method, as shown in FIG10A, which can be executed by an electronic device on the receiving side. The electronic device can obtain the resolution required by the user through an interactive interface, generate a stereoscopic image based on the resolution required by the user, and display it. The display method may include the following steps:

[0267] S1001, display multiple display modes, wherein the multiple display modes include a first display mode and a second display mode, the first display mode includes multiple first resolution parameters for generating a color image, and the second display mode includes multiple second resolution parameters for a target area and multiple third resolution parameters for a non-target area.

[0268] Referring to Figure 10B, the first display mode can also be called the full-resolution display mode, where the resolution of the displayed stereoscopic image is uniform. The second display mode can be called the high-low resolution display mode, where the resolution of the displayed stereoscopic image is not uniform; the resolution of the target area of ​​the stereoscopic image is higher than the resolution of the non-target area. The non-target area can refer to the area in the image other than the target area.

[0269] S1002, in response to the selection operation of the target first resolution parameter in the first display mode, the target first resolution parameter is determined as the resolution parameter for displaying the stereoscopic image.

[0270] Referring to Figure 10C, the first display mode includes multiple first resolution parameters. The electronic device can display multiple first resolution parameters of the first display mode in response to selection of the first display mode. Optionally, the electronic device can also display a first input box for receiving custom resolution parameters. The user can input a first resolution parameter through this first input box. Optionally, the electronic device can display a data range of custom resolution parameters in or near the first input box. The physical meaning of this data range is that first resolution parameters within the data range can support the normal viewing effect of generated stereoscopic images, while first resolution parameters outside the data range may not support the normal viewing effect of generated stereoscopic images.

[0271] A user can select a resolution parameter from a plurality of displayed first resolution parameters, which may include a custom resolution parameter. The electronic device can, in response to the selection of a target first resolution parameter in the first display mode, determine the target first resolution parameter as the resolution parameter for displaying a stereoscopic image.

[0272] In some examples, the resolution parameter may include horizontal and vertical resolution values. In this embodiment, whether the resolution parameter matches a certain resolution can be determined by whether the resolution values ​​included in the resolution parameter are consistent with a certain resolution. If the resolution values ​​included in the resolution parameter are consistent with a certain resolution, then the resolution parameter matches that resolution. If the resolution values ​​included in the resolution parameter are inconsistent with a certain resolution, then the resolution parameter does not match that resolution.

[0273] In other examples, the resolution parameter can characterize the ratio of the desired resolution to the initial resolution. For example, if the resolution parameter is 1, then the ratio of the initial resolution to the desired resolution corresponding to this resolution parameter is 1, meaning the desired resolution is the initial resolution. As another example, if the resolution parameter is m, then the ratio of the initial resolution to the desired resolution corresponding to this resolution parameter is m, meaning the desired resolution is 1 / m of the initial resolution. Assuming the horizontal and vertical resolutions of the initial resolution are H and V respectively, when the resolution parameter is m, the horizontal and vertical resolutions of the desired resolution corresponding to this resolution parameter m are H / m and V / m respectively. In this embodiment, whether the resolution parameter matches a certain resolution can be determined by whether the desired resolution corresponding to the resolution parameter is consistent with that certain resolution. If the desired resolution corresponding to the resolution parameter is consistent with a certain resolution, then the resolution parameter matches that resolution. If the desired resolution corresponding to the resolution parameter is inconsistent with a certain resolution, then the resolution parameter does not match that resolution.

[0274] In the following embodiments, the resolution corresponding to the resolution parameter may refer to the resolution value in the resolution parameter, or the resolution corresponding to the resolution parameter may refer to the expected resolution corresponding to the resolution parameter.

[0275] S1003, in response to the selection operation of the target second resolution parameter and the target third resolution parameter in the second display mode, the target second resolution parameter is determined as the resolution parameter of the target area for displaying the stereoscopic image, and the target third resolution parameter is determined as the resolution parameter of the area other than the target area for displaying the stereoscopic image.

[0276] Referring to Figure 10D, the second display mode includes multiple second resolution parameters for the target area and multiple third resolution parameters for the non-target area. In response to a selection operation of the second display mode, the electronic device can display the multiple second resolution parameters for the target area and the multiple third resolution parameters for the non-target area.

[0277] Optionally, the electronic device may also display a second input box for receiving custom resolution parameters for the target area. The user can enter a second resolution parameter through this second input box. The electronic device may also display a third input box for receiving custom resolution parameters for non-target areas. The user can enter a third resolution parameter through this third input box.

[0278] Users can select a second resolution parameter from a variety of displayed second resolution parameters, which may include custom resolution parameters. Users can also select a desired resolution parameter from a variety of displayed third resolution parameters, which may also include custom resolution parameters.

[0279] Optionally, the electronic device may display a data range of custom resolution parameters in or near the second input box. The physical meaning of this data range is that the second resolution parameter within the data range can support a normal viewing of the generated stereoscopic image, while a second resolution parameter outside the data range may not support a normal viewing of the generated stereoscopic image.

[0280] Optionally, the electronic device may display a data range for the custom resolution parameters in or near the third input box. The physical meaning of this data range is that the third resolution parameter within the data range can support a normal viewing of the generated stereoscopic image, while a third resolution parameter outside the data range may not support a normal viewing of the generated stereoscopic image.

[0281] The user can select a third resolution parameter from a plurality of second resolution parameters, and then select the desired resolution parameter from a plurality of third resolution parameters. In response to the selection of a target second resolution parameter and a target third resolution parameter in the second display mode, the electronic device can determine the target second resolution parameter as the resolution parameter for a target area of ​​the stereoscopic image, and determine the target third resolution parameter as the resolution parameter for a non-target area of ​​the stereoscopic image.

[0282] In one possible implementation, as shown in FIG10A, after executing step S1002 or step S1003, the electronic device may perform a performance detection operation. It determines whether the total processing time t for generating a stereoscopic image based on the user-selected resolution and the received color image is greater than a preset time threshold tref. The total processing time t for generating a stereoscopic image based on the user-selected resolution and the received color image may include, but is not limited to, the time for generating a depth image, the time for generating a viewpoint map, and the time for generating the stereoscopic image.

[0283] If t is greater than the preset time threshold, the electronic device may malfunction. If t is less than or equal to the preset threshold, the electronic device is functioning normally. The preset time threshold tref can be based on the electronic device's display refresh rate and the acceptable video frame rate for humans. For example, when the electronic device's display refresh rate is 60 frames per second, and for video, generally greater than 24 frames per second, humans will perceive the video as smooth. In this case, the preset time threshold tref can be greater than 1000 / 24 ​​(ms).

[0284] In one possible scenario, if the total time t is less than or equal to a preset time threshold tref, the electronic device can perform the process of generating a stereoscopic image based on the user-selected resolution and the received image.

[0285] In another possible scenario, if the total time t exceeds a preset time threshold tref, the electronic device can display a prompt message to recommend a resolution. As shown in Figure 10E, the prompt message could be: "Dear user, the current display mode is not working smoothly. We recommend selecting display mode XX."

[0286] In one possible implementation, the receiving electronic device can send the user-selected display mode information, or the recommended display mode information after performance testing, to the sending device. The display mode information may include the display mode, or the resolution parameters corresponding to the display mode.

[0287] In some examples, after determining the target first resolution parameter as the resolution parameter for displaying a stereoscopic image, the receiving electronic device sends the target first resolution parameter to the transmitting device, so that the transmitting device provides the image corresponding to the target first resolution parameter.

[0288] In some examples, after determining the target second resolution parameter as the resolution parameter of the target area for displaying the stereoscopic image and the target third resolution parameter as the resolution parameter of the non-target area for displaying the stereoscopic image, the receiving electronic device sends the target second resolution parameter and the target third resolution parameter to the transmitting device, so that the transmitting device provides the image corresponding to the target second resolution parameter and the image corresponding to the target third resolution parameter.

[0289] In one possible scenario, after executing step S1002, the receiving electronic device can receive N second color images, where N is a positive integer greater than 2. The N first color images are synchronously acquired by the N image acquisition modules at different locations, and the acquisition ranges of any two of the N image acquisition modules overlap. If the resolution of the first color image matches the target first resolution parameter, then the second color image is the first color image. If the resolution of the first color image does not match the target first resolution parameter, then the second color image is an image generated by the transmitting electronic device based on the first color image and the target first resolution parameter.

[0290] The receiving electronic device can generate a depth image based on any two second color images, and the generated depth image serves as the depth image corresponding to one of the two second color images. The receiving electronic device can generate at least two viewpoint maps based on at least two depth images and the color images corresponding to each of the at least two depth images. The receiving electronic device can generate a stereoscopic image based on the two viewpoint maps and display the stereoscopic image.

[0291] In another possible scenario, after executing step S1003, the receiving electronic device can receive N second color images and the image of the target region in the N third color images.

[0292] N is a positive integer greater than 2. The N first color images are synchronously acquired by the N image acquisition modules at different locations, and the acquisition ranges of any two of the N image acquisition modules overlap. If the resolution of the first color image matches the target third resolution parameter, then the second color image is the first color image. If the resolution of the first color image does not match the target third resolution parameter, then the second color image is an image generated based on the first color image and the target third resolution parameter. If the target third resolution parameter does not match the resolution parameter of the received first color image, the transmitting electronic device can extract image data from the image data storage memory block of the first color image according to the target third resolution parameter to generate the second color image corresponding to the first color image. If the target third resolution parameter matches the resolution of the received first color image, the transmitting electronic device can directly provide the first color image as the second color image to the receiving electronic device.

[0293] If the resolution of the first color image matches the target second resolution parameter, then the third color image is the first color image; if the resolution of the first color image does not match the target second resolution parameter, then the third color image is an image generated based on the first color image and the target second resolution parameter.

[0294] If the target second resolution parameter does not match the resolution parameter of the received first color image, the transmitting electronic device can extract image data from the image data storage memory block of the first color image according to the target third resolution parameter to generate a third color image corresponding to the first color image. If the target second resolution parameter matches the resolution of the received first color image, the transmitting electronic device can directly use the first color image as the third color image and provide the image of the target region in the third color image to the receiving electronic device.

[0295] The receiving electronic device can generate a second sharpness depth image based on any two second color images, whereby the second sharpness depth image serves as the second sharpness depth image corresponding to one of the two second color images. From the image in the target region of the third color image corresponding to the two second color images, a first sharpness depth image corresponding to the target region in the first second color image is generated, where the second sharpness is less than the first sharpness.

[0296] The third color image corresponding to the second color image can be understood through the following example: the second color image 1 can be the first color image 1, or the image corresponding to the target third resolution parameter of the first color image 1. The third color image 1 can be the first color image 1, or the image corresponding to the target second resolution parameter of the first color image 1. Therefore, the third color image corresponding to the second color image 1 is the third color image 1.

[0297] The receiving electronic device can, for each second color image corresponding to a second resolution depth in at least two second resolution depth images, generate a first resolution viewpoint map of the target region based on a first resolution depth image corresponding to the target region in the second color image; generate a second resolution viewpoint map based on the second resolution depth image corresponding to the second color image; and determine a composite viewpoint map based on the first resolution viewpoint map and the second resolution viewpoint map of the target region. The resolution of the target region in the composite viewpoint map is the resolution corresponding to the second resolution parameter of the target, and the resolution of the non-target region is the resolution corresponding to the third resolution parameter of the target.

[0298] The receiving electronic device can then generate a stereoscopic image based on the two synthesized viewpoint maps and display the stereoscopic image.

[0299] This application embodiment also provides a display method, as shown in FIG11, which can be executed by an electronic device on the receiving side. The electronic device can obtain the resolution required by the user through an interactive interface, generate a stereoscopic image based on the resolution required by the user, and display it. The display method may include the following steps:

[0300] S1101, displaying multiple display modes, including a third display mode, a fourth display mode, and a fifth display mode, wherein the resolution corresponding to the third display mode is greater than the resolution corresponding to the fourth display mode.

[0301] Referring to Figure 12A, the electronic device can be configured with multiple display modes, namely the third display mode, the fourth display mode, and the fifth display mode. The third display mode can be called the full HD display mode. In the third display mode, the resolution of the generated stereoscopic image is uniform, and the resolution of the generated stereoscopic image can be the same as the resolution of the received color image.

[0302] The fourth display mode can be called the full low-resolution display mode. In the fourth display mode, the resolution of the generated stereoscopic image is uniform, and the resolution of the generated stereoscopic image is lower than that of the stereoscopic image generated in the third display mode.

[0303] The fifth display mode can be called a high-low resolution display mode. In the fifth display mode, the resolution of the generated stereoscopic image is not uniform, and the resolution of the target area of ​​the stereoscopic image is higher than that of the non-target area.

[0304] Optionally, when an electronic device displays multiple display modes, it can also display a default mode. The resolution corresponding to the default mode can represent the resolution of the display mode selected by the user when last using the electronic device to perform a display method.

[0305] S1102, in response to the selection operation of the third display mode, the resolution corresponding to the third display mode is determined as the resolution for displaying the stereoscopic image.

[0306] S1103, in response to the selection operation of the fourth display mode, the resolution corresponding to the fourth display mode is determined as the resolution for displaying the stereoscopic image.

[0307] S1104, in response to the selection operation of the fifth display mode, multiple sub-modes are displayed, each sub-mode corresponds to a set of resolutions, the set of resolutions includes a fourth resolution and a fifth resolution, and in response to the selection operation of a target sub-mode among the multiple sub-modes, the fourth resolution in the set of resolutions corresponding to the target sub-mode is determined as the resolution for displaying the target area of ​​the stereoscopic image, and the fifth resolution in the set of resolutions corresponding to the target sub-mode is determined as the resolution for displaying the area of ​​the stereoscopic image other than the target area.

[0308] In this embodiment, the resolution of the third display mode can be a preset value. The resolution of the fourth display mode can also be a preset value. The fifth display mode may include multiple sub-modes. Each sub-mode corresponds to a set of resolutions, and the set of resolutions may include the resolution of the target area and the resolution of non-target areas. The set of resolutions corresponding to different sub-modes are not entirely the same.

[0309] For ease of explanation, the fourth resolution in a set of resolutions corresponding to a sub-mode can be denoted as the fourth resolution corresponding to that sub-mode; the fifth resolution in a set of resolutions corresponding to a sub-mode can be denoted as the fifth resolution corresponding to that sub-mode.

[0310] The electronic device can display multiple sub-modes in response to the selection of the fifth display mode. As shown in Figure 12B, the multiple sub-modes can be denoted as sub-mode 1, sub-mode 2, and sub-mode 3, respectively. Optionally, the electronic device can also display a default mode in response to the selection of the fifth display mode. The resolution corresponding to the default mode represents the resolution of the display mode selected by the user when the electronic device last performed the display method. Optionally, the fourth resolution corresponding to sub-mode 1 is less than the fourth resolution corresponding to sub-mode 2, and the fourth resolution corresponding to sub-mode 2 is less than the fourth resolution corresponding to sub-mode 3.

[0311] In one possible implementation, as shown in FIG11, after executing steps S1101, S1102, or S1103, the electronic device may perform a performance detection operation. It determines whether the total processing time t for generating a stereoscopic image based on the user-selected resolution and the received color image is greater than a preset time threshold tref. The total processing time t for generating a stereoscopic image based on the user-selected resolution and the received color image may include, but is not limited to, the time for generating a depth image, the time for generating a viewpoint map, and the time for generating the stereoscopic image.

[0312] If t is greater than a preset time threshold, the electronic device may malfunction. If t is less than or equal to the preset threshold, the electronic device is functioning correctly. In one possible scenario, if the total time t is less than or equal to the preset time threshold tref, the electronic device can perform the process of generating a stereoscopic image based on the user-selected resolution and the received image. In another possible scenario, if the total time t is greater than the preset time threshold tref, the electronic device can display a prompt suggesting a recommended resolution. As shown in Figure 10E, the prompt could be something like, "Dear user, the current display mode is not working smoothly; we recommend selecting display mode XX."

[0313] In one possible implementation, the receiving electronic device can send the user-selected display mode information, or the recommended display mode information after performance testing, to the sending device. The display mode information may include the display mode, or the resolution parameters corresponding to the display mode.

[0314] In some examples, after determining the resolution corresponding to the third display mode as the resolution for displaying stereoscopic images, the receiving electronic device sends the information of the third display mode to the receiving device, so that the receiving device can provide the image corresponding to the third display mode.

[0315] In some examples, after determining the resolution corresponding to the fourth display mode as the resolution for displaying stereoscopic images, the receiving electronic device sends the information of the fourth display mode to the receiving device, so that the receiving device can provide the image corresponding to the fourth display mode.

[0316] In some examples, after the receiving electronic device determines the fourth resolution in a set of resolutions corresponding to the target sub-mode as the resolution for the target area of ​​the stereoscopic image, and determines the fifth resolution in a set of resolutions corresponding to the target sub-mode as the resolution for the area of ​​the stereoscopic image other than the target area, it sends the information of the target sub-mode to the receiving device, so that the receiving device provides the image corresponding to the target fourth resolution parameter and the image corresponding to the target fifth resolution parameter.

[0317] In one possible scenario, after executing step S1102, the receiving electronic device can receive N second color images, where N is a positive integer greater than 2. The N first color images are synchronously acquired by the N image acquisition modules at different locations, and the acquisition ranges of any two of the N image acquisition modules overlap. If the resolution of the first color image is the same as the resolution corresponding to the third display mode, then the second color image is the first color image. If the resolution of the first color image is different from the resolution corresponding to the third display mode, then the second color image is an image generated based on the first color image with a resolution corresponding to the third display mode. The transmitting electronic device can generate a second color image corresponding to the first color image based on the first color image and the resolution corresponding to the third display mode, and the resolution of the second color image is the resolution corresponding to the third display mode.

[0318] The receiving electronic device can generate a depth image based on any two second color images, and the generated depth image serves as the depth image corresponding to one of the two second color images. Based on at least two depth images and the color images corresponding to each of the at least two depth images, at least two viewpoint maps are generated. Based on the two viewpoint maps, a stereoscopic image is generated and displayed.

[0319] In one possible scenario, after executing step S1103, once the electronic device has determined the resolution corresponding to the fourth display mode as the resolution for displaying stereoscopic images, the electronic device may perform the following operations:

[0320] N second color images are received, where N is a positive integer greater than 2. The N first color images are synchronously acquired by the N image acquisition modules at different locations, and the acquisition ranges of any two of the N image acquisition modules overlap. If the resolution of the first color image is the same as the resolution corresponding to the fourth display mode, then the second color image is the first color image. If the resolution of the first color image is different from the resolution corresponding to the fourth display mode, then the second color image is an image generated based on the first color image with a resolution corresponding to the fourth display mode.

[0321] The receiving electronic device can generate a depth image based on any two second color images, and the generated depth image serves as the depth image corresponding to one of the two second color images. Based on at least two depth images and the color images corresponding to each of the at least two depth images, at least two viewpoint maps are generated. Based on the two viewpoint maps, a stereoscopic image is generated and displayed.

[0322] In one possible scenario, after executing step S1104, the electronic device determines the fourth resolution in a set of resolutions corresponding to the target sub-mode as the resolution for the target area of ​​the stereoscopic image, and determines the fifth resolution in a set of resolutions corresponding to the target sub-mode as the resolution for the area of ​​the stereoscopic image other than the target area. After this, the electronic device can perform the following operations:

[0323] The system receives N second color images and images of the target region from the N third color images, where N is a positive integer greater than 2. The N first color images are synchronously acquired by the N image acquisition modules at different locations, and the acquisition ranges of any two of the N image acquisition modules overlap. Specifically, if the resolution of the first color image is the same as the fifth resolution corresponding to the target sub-mode, then the second color image is the first color image; if the resolution of the first color image is different from the fifth resolution corresponding to the target sub-mode, then the second color image is an image generated based on the first color image and the fifth resolution corresponding to the target sub-mode. If the resolution of the first color image is the same as the fourth resolution corresponding to the target sub-mode, then the third color image is the first color image; if the resolution of the first color image is different from the fourth resolution corresponding to the target sub-mode, then the third color image is an image generated based on the first color image and the fourth resolution corresponding to the target sub-mode.

[0324] The receiving electronic device can generate a second sharpness depth image based on any two second color images, whereby the second sharpness depth image serves as the second sharpness depth image corresponding to one of the two second color images. Based on the image in the target region of the third color image corresponding to the any two second color images, a first sharpness depth image corresponding to the target region in the first second color image is generated, where the second sharpness is less than the first sharpness. For each second color image corresponding to a second sharpness depth in at least two second sharpness depth images, a first sharpness viewpoint map of the target region is generated based on the first sharpness depth image corresponding to the target region in the second color image; a second sharpness viewpoint map is generated based on the second sharpness depth image corresponding to the second color image; and a composite viewpoint map is determined based on the first sharpness viewpoint map and the second sharpness viewpoint map of the target region. A stereoscopic image is generated and displayed based on the two composite viewpoint maps.

[0325] In practical applications, when electronic devices display stereoscopic images in the fifth display mode, that is, in high-definition and low-definition display modes, the resource consumption and processor performance requirements are lower than when electronic devices display stereoscopic images in the third display mode, that is, in full HD display mode.

[0326] Electronic devices display stereoscopic images in the fourth display mode, which is the full low-definition display mode. This ensures smooth display, lower power consumption, smaller data processing volume, and lower processor performance requirements.

[0327] This application also provides an electronic device, as shown in FIG13, which may include a display screen, a communication module, a processor, and N image acquisition modules. Optionally, the communication module and the processor may be integrated together. For example, the processor may have communication functions. The black circles in FIG13 represent the image acquisition modules. The image acquisition modules may include devices with image acquisition functions. For example, the image acquisition module may include a camera.

[0328] The schematic diagram of the electronic device in Figure 13 is only used as an example to illustrate the composition and function of the electronic device, and is not intended to limit the actual number of image acquisition modules in the electronic device, nor is it intended to limit the relative position of the image acquisition modules in the electronic device.

[0329] The number of the N image acquisition modules is a positive integer greater than 2; wherein all or part of the N image acquisition modules are located on the first side of the display screen.

[0330] The display screen is used to display images. The display screen may be capable of displaying stereoscopic images, or it may be capable of displaying two-dimensional images.

[0331] The image acquisition module is used to acquire color images.

[0332] The communication module is used to send the color images acquired by each image acquisition module to the receiving device.

[0333] The electronic device in this embodiment can be a receiving electronic device, and / or a transmitting electronic device. The processor can execute any display method performed by the aforementioned receiving electronic device, and / or the processor can execute the display method performed by the aforementioned transmitting electronic device.

[0334] In one possible implementation, the number of the N image acquisition modules is 4.

[0335] In some examples, please refer to Figure 14A, all four image acquisition modules are located on the first side of the display screen.

[0336] In some examples, please refer to Figure 14B. Two of the image acquisition modules are located on the first side of the display screen, and two more of the image acquisition modules are located on the second side of the display screen, opposite to the first side.

[0337] In some examples, referring to Figure 14C, two of the image acquisition modules are located on the first side of the display screen, one of the image acquisition modules is located on the third side of the display screen, and one of the image acquisition modules is located on the fourth side of the display screen. The third side is the side adjacent to the first side, and the fourth side is opposite to the third side.

[0338] In one possible implementation, the number of the N image acquisition modules is 6.

[0339] In some examples, please refer to Figure 15A, all four image acquisition modules are located on the first side of the display screen, and two image acquisition modules are located on the second side of the display screen, which is opposite to the first side.

[0340] In some examples, referring to Figure 15B, two of the image acquisition modules are located on the first side of the display screen, two of the image acquisition modules are located on the second side of the display screen, one of the image acquisition modules is located on the third side of the display screen, and one of the image acquisition modules is located on the fourth side of the display screen. The third side is adjacent to the first side, and the fourth side is opposite to the third side.

[0341] In some examples, referring to Figure 15C, two of the image acquisition modules are located on the first side of the display screen, two of the image acquisition modules are located on the third side of the display screen, and two of the image acquisition modules are located on the fourth side of the display screen.

[0342] Compared to electronic devices with six image acquisition modules, electronic devices with four image acquisition modules not only have lower hardware costs, but also perform better in terms of data transmission volume, data encoding and decoding resource consumption, and image processing resource consumption during the execution of the display method, achieving a 30% reduction.

[0343] Based on the same inventive concept, this application also provides a display system, as shown in FIG16. The display system may include a first electronic device on the transmitting side and a second electronic device on the receiving side. The number of the second electronic devices may be one or more, and this application does not impose excessive limitations on this.

[0344] The first electronic device can execute the display method executed by the aforementioned transmitting-side device.

[0345] The second electronic device can execute any of the display methods executed by the aforementioned receiving device.

[0346] In some application scenarios, such as video conferencing and video calls, the second electronic device can also act as a transmitting device, executing the display method described above to send the acquired color image to the first electronic device. The first electronic device can also act as a receiving device, executing any of the display methods described above to display a stereoscopic image based on the color image provided by the second electronic device.

[0347] In one possible implementation, four image acquisition modules of the first electronic device can simultaneously acquire color images. All four image acquisition modules are located on the first side of the display screen of the first electronic device. The second electronic device generates a stereoscopic image in full HD display mode.

[0348] The second electronic device may include a depth calculation module, which is used to output a depth image corresponding to the color image.

[0349] In some examples, the depth computing module may include a pre-trained neural network model. During training, the network model can be trained using color images acquired by four image acquisition modules at preset locations as training data. By inputting any two color images into the depth computing module, the module can output the depth image corresponding to one of the two color images.

[0350] In other examples, the depth computing module may include multiple depth computing sub-units, each including a pre-trained neural network model. During training, the network model can be trained using color images acquired by two image acquisition modules at preset locations as training data. The depth computing sub-unit can output the depth image corresponding to the location of one of the two image acquisition modules when the color images acquired by the two image acquisition modules at preset locations are input into the depth computing sub-unit.

[0351] As shown in Figure 17A, the four image acquisition modules of the first electronic device can be denoted as image acquisition module 1, image acquisition module 2, image acquisition module 3, and image acquisition module 4, respectively. The position of each image acquisition module in the second electronic device can be obtained in advance. The second electronic device inputs the color images acquired by image acquisition module 1 and image acquisition module 2 into depth calculation subunit 1, and depth calculation subunit 1 can output the depth image depth1 corresponding to the position of image acquisition module 1.

[0352] The second electronic device inputs the color images acquired by the image acquisition module 2 and the image acquisition module 3 into the depth calculation subunit 2. The depth calculation subunit 2 can output the depth image depth2 corresponding to the position of the image acquisition module 2.

[0353] The second electronic device inputs the color images acquired by the image acquisition module 3 and the image acquisition module 4 into the depth calculation subunit 3. The depth calculation subunit 3 can output the depth image depth3 corresponding to the position of the image acquisition module 3.

[0354] The second electronic device may include a viewpoint generation module, which can be a pre-trained neural network model. The color image acquired by the image acquisition module, along with the corresponding depth image, is input into the viewpoint generation module, which can then output a viewpoint map corresponding to a specified location. For 3D display scenes, the viewpoint generation module needs to output multiple viewpoint maps with parallax. The second electronic device can incorporate eye-tracking technology to capture the position of the viewer's eyes in real time, allowing the viewpoint generation module to output at least two viewpoint maps.

[0355] The second electronic device may include a 3D image synthesis module. This module can fuse two viewpoint images output by the viewpoint generation module to obtain a stereoscopic image, which is then sent to a display screen for display.

[0356] In one possible implementation, four image acquisition modules of the first electronic device can simultaneously acquire color images. All four image acquisition modules are located on the first side of the display screen of the first electronic device. The second electronic device generates a stereoscopic image in a high / low resolution display mode.

[0357] After receiving four color images, the second electronic device can store the image data in memory. The second electronic device can then extract high-resolution images of the target regions of each color image from memory, as well as the corresponding low-resolution images.

[0358] As shown in Figure 17B, the four image acquisition modules of the first electronic device can be referred to as image acquisition module 1, image acquisition module 2, image acquisition module 3, and image acquisition module 4, respectively. The position of each image acquisition module in the second electronic device can be obtained in advance.

[0359] The second electronic device inputs the high-resolution images of the target area of ​​the color images acquired by the image acquisition module 1 and the image acquisition module 2 into the depth calculation subunit 1. The depth calculation subunit 1 can output a high-definition depth image depth1-1 of the target area corresponding to the position of the image acquisition module 1.

[0360] The second electronic device inputs the low-resolution images corresponding to the color images acquired by the image acquisition module 1 and the image acquisition module 2 into the depth calculation subunit 1. The depth calculation subunit 1 can output the low-resolution depth image depth1-2 corresponding to the position of the image acquisition module 1.

[0361] The second electronic device inputs the high-resolution images of the target area of ​​the color images acquired by the image acquisition module 2 and the image acquisition module 3 into the depth calculation subunit 2. The depth calculation subunit 2 can output a high-definition depth image depth2-1 of the target area corresponding to the position of the image acquisition module 2.

[0362] The second electronic device inputs the low-resolution images corresponding to the color images acquired by the image acquisition module 2 and the image acquisition module 3 into the depth calculation subunit 2. The depth calculation subunit 2 can output the low-resolution depth image depth2-2 corresponding to the position of the image acquisition module 2.

[0363] The second electronic device inputs the high-resolution images of the target area of ​​the color image acquired by the image acquisition module 3 and the image acquisition module 4 into the depth calculation subunit 3. The depth calculation subunit 3 can output a high-definition depth image depth3-1 of the target area corresponding to the position of the image acquisition module 3.

[0364] The second electronic device inputs the low-resolution images corresponding to the color images acquired by the image acquisition module 3 and the image acquisition module 4 into the depth calculation subunit 3. The depth calculation subunit 3 can output the low-resolution depth image depth3-2 corresponding to the position of the image acquisition module 3.

[0365] The second electronic device may include a viewpoint generation module, which can be a pre-trained neural network model. The viewpoint generation module receives a high-resolution image of the target region from a color image acquired by the image acquisition module, as well as a high-resolution depth image of the target region corresponding to the location of the image acquisition module. The viewpoint generation module can then output a high-resolution viewpoint map of the target region corresponding to the specified location.

[0366] The low-resolution image corresponding to the color image acquired by the image acquisition module, and the low-resolution depth image corresponding to the position of the image acquisition module are input into the viewpoint generation module. The viewpoint generation module can output the low-resolution viewpoint map corresponding to the specified position.

[0367] For 3D display scenarios, the viewpoint generation module needs to output multiple viewpoint maps with parallax. The second electronic device can combine human eye tracking technology to capture the position of the human's eyes in real time. Thus, the viewpoint generation module can output at least two high-definition viewpoint maps of target areas and at least two low-definition viewpoint maps.

[0368] The second electronic device may include a 3D image synthesis module. This module determines a composite viewpoint image for a target area based on both a high-resolution viewpoint image and a low-resolution viewpoint image. The module then fuses the two composite viewpoint images and sends them to a display screen for display.

[0369] In a test scenario, the system latency performance of end-to-end 3D video communication in a display system was tested. End-to-end 3D video communication refers to the process where a first electronic device acquires image data, transmits it to a second electronic device for processing, and enables the user to view stereoscopic images on the second electronic device. The total time for this process can be called system latency. The test environment for the first and second electronic devices in the display system is as follows: CPU: I9-10920X; GPU: RTX4090 (24G); Memory: 16G DDR4 / 3200MHZ*4.

[0370] Figure 18 illustrates the various stages of the display system's operation in Full HD mode. The system latency of the second electronic device in Full HD display mode is as follows: average latency is 122ms.

[0371] In the data acquisition and transmission to PC stage, the total time for the four image acquisition modules to acquire image data, the data cable to transmit the data to the second electronic device, and the waiting time for the next image acquisition module to start acquiring data is approximately 20ms. The frame rate of the image acquisition module is 60Hz.

[0372] The image data acquired by the first electronic device is stored in the device's memory. The GPU of the first electronic device can perform image data processing, so the image data needs to be transferred from memory to video memory first, which takes about 13ms.

[0373] The first electronic device performs de-mosaic processing on the acquired image, i.e., converting raw data to RGB data, which takes approximately 15ms. The first electronic device performs background removal, cropping, and stretching operations on the image, taking approximately 6ms. The first electronic device hard-encodes the four processed color image data, taking 5ms. The first electronic device transfers the encoded data from video memory to main memory, taking 1ms. The first electronic device transmits the encoded data to the second electronic device using real-time communication technology (RTC), such as WebRTC, taking approximately 2ms.

[0374] After receiving the data, the second electronic device first transfers it from memory to video memory, taking approximately 1ms. The second electronic device then performs hardware decoding of the encoded data, taking approximately 5ms. The total time for the second electronic device to output two viewpoint maps in full HD mode is 28ms. The second electronic device then stitches the left and right eye viewpoint maps into a single large image, taking approximately 1ms. The total time for the second electronic device to process the stitched large image into a stereoscopic image, send it to the display screen, and for the display screen to begin receiving the image and display the complete image is approximately 25ms.

[0375] In high / low display mode, the system latency of the second electronic device is as follows: the average latency is 94ms. In the data acquisition and transmission to PC process, the total time for the four image acquisition modules to acquire image data, the data cable to transmit the data to the second electronic device, and the waiting time for the next image acquisition module to start acquisition is about 20ms. The frame rate of the image acquisition module is 60Hz.

[0376] The image data acquired by the first electronic device is stored in the device's memory. The GPU of the first electronic device can perform image data processing, so the image data needs to be transferred from memory to video memory first, which takes about 13ms.

[0377] The first electronic device performs de-mosaic processing on the acquired image, i.e., converting raw data to RGB data, which takes approximately 15ms. The first electronic device performs background removal, cropping, and stretching operations on the image, taking approximately 6ms. The first electronic device hard-encodes the four processed color image data, taking 1.5ms. The first electronic device transfers the encoded data from video memory to main memory, taking 0.5ms. The first electronic device transmits the encoded data to the second electronic device using real-time communication technology such as WebRTC, taking approximately 1ms.

[0378] After receiving the data, the second electronic device first transfers it from memory to video memory, taking approximately 0.5ms. The second electronic device then performs hardware decoding of the encoded data, taking approximately 1.5ms. The process of the second electronic device outputting two composite viewpoint images in high-resolution and low-resolution modes takes a total of 9ms. The second electronic device then stitches the composite viewpoint images of the left and right eyes into a single large image, taking approximately 1ms. The total time taken for the second electronic device to process the stitched large image into a stereoscopic image, send it to the display screen, and for the display screen to begin receiving the image and display the complete image is approximately 25ms.

[0379] Based on the above test results, under the same test conditions, the resource consumption of the display system is significantly reduced in both high-definition and low-definition modes compared to full HD mode. Table 1 below shows the resource usage for various types of modes. Here, we focus on the GPU computing resource usage for the generation of the viewpoint map by the second electronic device and subsequent processes. As shown in the parallel computing architecture (CUDA) column of the table below, full HD requires 60% of CUDA resources, while high-definition and low-definition modes only require 28% of CUDA resources. If the GPU performance of the second electronic device is poor, it may not be able to support the normal operation of the full HD display mode. In this case, switching to high-definition and low-definition display modes will most likely allow the system to work normally.

[0380] Table 1

[0381] The methods provided in the embodiments of this application above are described from the perspective of an electronic device as the executing entity. To implement the functions of the methods provided in the embodiments of this application above, the electronic device may include hardware structures and / or software modules, implementing the above functions in the form of hardware structures, software modules, or a combination of hardware structures and software modules. Whether a particular function is executed in the form of hardware structures, software modules, or a combination of hardware structures and software modules depends on the specific application and design constraints of the technical solution.

[0382] In addition, embodiments of this application provide a computer-readable storage medium for storing a computer program that, when run on a computer, causes the computer to perform the steps of any of the above display methods.

[0383] As used in the above embodiments, depending on the context, the terms "when..." or "after..." can be interpreted as meaning "if...", "after...", "in response to determining...", or "in response to detecting...". Similarly, depending on the context, the phrases "when..." or "if (the stated condition or event) is detected" can be interpreted as meaning "if...", "in response to determining...", "when (the stated condition or event) is detected", or "in response to detecting (the stated condition or event)".

[0384] In the above embodiments, the implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented, in whole or in part, in the form of a computer program product.

[0385] This application also provides a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this invention are generated. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium may be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state disk (SSD)). Where there is no conflict, the solutions of the above embodiments can be combined.

Claims

1. A display method, wherein, include: N color images are acquired, where N is a positive integer greater than 2. The N color images are acquired synchronously by N image acquisition modules at different locations, and the acquisition ranges of any two of the N image acquisition modules overlap. Based on any two of the N color images, a depth image is generated, and the generated depth image is used as the depth image corresponding to one of the two color images. Generate at least two viewpoint maps based on at least two depth images and the color images corresponding to each of the at least two depth images; A stereoscopic image is generated based on the two viewpoint images, and the stereoscopic image is displayed.

2. The method as described in claim 1, wherein, All N color images are images with the first resolution. The step of generating a depth image based on any two of the N color images includes: Based on any two of the N color images, generate a second resolution image of each of the two color images, wherein the second resolution is smaller than the first resolution; Based on the images of the target region in any two color images, generate a first sharpness depth image of the target region in one color image; Based on the second resolution images of any two color images, a second sharpness depth image corresponding to the first color image is generated, wherein the second sharpness is less than the first sharpness.

3. The method as described in claim 2, wherein, The process of generating at least two viewpoint maps based on at least two depth images and the color images corresponding to each of the at least two depth images includes: Perform the following operations on the color images corresponding to each depth image: Based on the first sharpness depth image corresponding to the target region in the color image, a first sharpness viewpoint map of the target region is generated; A second-resolution viewpoint map is generated based on the second-resolution depth image corresponding to the color image; Based on the first and second resolution viewpoint maps of the target region, determine Generate a composite viewpoint image.

4. The method of claim 1, wherein, All N color images are images with the first resolution. The step of generating a depth image based on any two of the N color images includes: Based on any two of the N color images, generate a second resolution image of each of the two color images, wherein the second resolution is smaller than the first resolution; A second resolution image is generated based on the second resolution image of any two color images.

5. The method of claim 4, wherein, The viewpoint map is the second resolution viewpoint map; The step of generating at least two viewpoint maps based on at least two depth images and the color images corresponding to each of the at least two depth images includes: At least two second-resolution viewpoint maps are determined based on at least two second-resolution depth images and their corresponding color images.

6. The method of claim 1, wherein, The N color images are all images with a first resolution; the viewpoint map is a viewpoint map with a first resolution. The step of generating a depth image based on any two of the N color images includes: Generate a first sharpness depth image based on any two of the N color images; The process of generating at least two viewpoint maps based on at least two depth images and the color images corresponding to each of the at least two depth images includes: Based on the first resolution depth image and the corresponding color image, at least two first resolution viewpoint images are determined.

7. A display method, wherein, Applied to a transmitting-side device, the method includes: N color images are acquired, where N is a positive integer greater than 2. The N color images are acquired synchronously by N image acquisition modules at different locations. The acquisition ranges of any two of the N image acquisition modules overlap. All N color images are images with a first resolution. Send the N color images so that the receiving device displays a stereoscopic image based on the received images; or... Sending a second-resolution image corresponding to each color image, so that the receiving device can display a stereoscopic image based on the received image, wherein the second resolution is smaller than the first resolution; or... The receiving device sends a second resolution image corresponding to each color image and an image of the target region in each color image, so that the receiving device can display a stereoscopic image based on the received image.

8. A display method, wherein, The method, applied to a receiving-side device in a display system, includes: Receive N color images, where N is a positive integer greater than 2. The N color images are synchronously acquired by the N image acquisition modules at different locations. The acquisition ranges of any two of the N image acquisition modules overlap. Based on any two of the N color images, a depth image is generated, and the generated depth image is the depth image corresponding to one of the two color images; Generate at least two viewpoint maps based on at least two depth images and the color images corresponding to each of the at least two depth images; A stereoscopic image is generated based on the two viewpoint images, and the stereoscopic image is displayed.

9. A display method, wherein, The method, applied to a receiving-side device in a display system, includes: Receive a second resolution image corresponding to N color images, where N is a positive integer greater than 2, the N color images are synchronously acquired by N image acquisition modules at different locations, and the N color images are first resolution images, the acquisition ranges of any two image acquisition modules among the N image acquisition modules overlap, and the second resolution is smaller than the first resolution; Based on the second resolution image of any two color images, generate a second sharpness depth image corresponding to one of the two color images; Based on at least two second-resolution depth images and their corresponding color images, at least two second-resolution viewpoint maps are determined; A stereoscopic image is generated based on two second-resolution viewpoint maps, and the stereoscopic image is displayed.

10. A display method, wherein, The method, applied to a receiving-side device in a display system, includes: Receive N color images corresponding to second resolution images, and images of target regions in each color image, where N is a positive integer greater than 2, the N color images are synchronously acquired by N image acquisition modules at different locations, and the N color images are first resolution images, the second resolution is less than the first resolution, and the acquisition ranges of any two image acquisition modules among the N image acquisition modules overlap; A second resolution depth image is generated based on the second resolution image of any two color images, and the second resolution depth image serves as the second resolution depth image corresponding to one of the two color images; Based on the images of the target region in any two color images, a first sharpness depth image of the target region in one color image is generated, wherein the second sharpness is less than the first sharpness; The following operations are performed on the color images corresponding to each of the at least two second-resolution depth images: a first-resolution viewpoint map of the target region is generated based on the first-resolution depth image corresponding to the target region in the color image; a second-resolution viewpoint map is generated based on the second-resolution depth image corresponding to the color image; and a composite viewpoint map is determined based on the first-resolution viewpoint map and the second-resolution viewpoint map of the target region. A stereoscopic image is generated based on the two synthesized viewpoint maps, and the stereoscopic image is displayed.

11. A display method, wherein, The method, applied to a receiving-side device in a display system, includes: The display includes multiple display modes, including a first display mode and a second display mode. The first display mode includes multiple first resolution parameters for generating a color image, and the second display mode includes multiple second resolution parameters for the target area and multiple third resolution parameters for the non-target area. In response to the selection operation of the target first resolution parameter in the first display mode, the target first resolution parameter is determined as the resolution parameter for displaying the stereoscopic image; In response to the selection operation of the target second resolution parameter and the target third resolution parameter in the second display mode, the target second resolution parameter is determined as the resolution parameter of the target area for displaying the stereoscopic image, and the target third resolution parameter is determined as the resolution parameter for displaying the stereoscopic image. Resolution parameters of the non-target region of the image.

12. The method of claim 11, wherein, In the first display mode, at least one of the multiple first resolution parameters is a custom resolution parameter; and / or, In the second display mode, at least one of the multiple second resolution parameters is a custom resolution parameter; And / or, In the second display mode, at least one of the multiple third resolution parameters is a custom resolution parameter.

13. The method of claim 11, wherein, The method further includes: After determining the target first resolution parameter as the resolution parameter for displaying the stereoscopic image, the target first resolution parameter is sent to the transmitting device, so that the transmitting device provides the image corresponding to the target first resolution parameter; or, After determining the target second resolution parameter as the resolution parameter for the target area of ​​the stereoscopic image and the target third resolution parameter as the resolution parameter for the non-target area of ​​the stereoscopic image, the target second resolution parameter and the target third resolution parameter are sent to the transmitting side device so that the transmitting side device provides the image corresponding to the target second resolution parameter and the image corresponding to the target third resolution parameter.

14. The method of claim 11, wherein, After determining the target first resolution parameter as the resolution parameter for displaying the stereoscopic image, the method further includes: Receive N second color images, where N is a positive integer greater than 2. The N first color images are synchronously acquired by N image acquisition modules at different locations. The acquisition ranges of any two image acquisition modules overlap. If the resolution of the first color image matches the target first resolution parameter, then the second color image is the first color image. If the resolution of the first color image does not match the target first resolution parameter, then the second color image is an image generated based on the first color image and the target first resolution parameter. Based on any two second color images, a depth image is generated, and the generated depth image is used as the arbitrary... The depth image corresponding to one of the two second-color images; Generate at least two viewpoint maps based on at least two depth images and the color images corresponding to each of the at least two depth images; A stereoscopic image is generated based on the two viewpoint images, and the stereoscopic image is displayed.

15. The method of claim 11, wherein, After determining the second target resolution parameter as the resolution parameter for the target region used to display the stereoscopic image, and determining the third target resolution parameter as the resolution parameter for the region other than the target region used to display the stereoscopic image, the method further includes: The system receives N second color images and images of the target region from the N third color images, where N is a positive integer greater than 2. The N first color images are synchronously acquired by N image acquisition modules at different locations, and the acquisition ranges of any two of the N image acquisition modules overlap. Specifically, if the resolution of the first color image matches the target third resolution parameter, then the second color image is the first color image; if the resolution of the first color image does not match the target third resolution parameter, then the second color image is an image generated based on the first color image and the target third resolution parameter. Similarly, if the resolution of the first color image matches the target second resolution parameter, then the third color image is the first color image; if the resolution of the first color image does not match the target second resolution parameter, then the third color image is an image generated based on the first color image and the target second resolution parameter. A second sharpness depth image is generated based on any two second color images, and the second sharpness depth image serves as the second sharpness depth image corresponding to one of the two second color images; Based on the images in the target regions of the third color images corresponding to any two second color images, a first sharpness depth image corresponding to the target region in the second color image is generated, wherein the second sharpness is less than the first sharpness; For each second color image corresponding to a second resolution depth in at least two second resolution depth images, a first resolution depth image corresponding to the target region in the second color image is generated. A first sharpness viewpoint map of the target area; a second sharpness viewpoint map is generated based on a second sharpness depth image corresponding to the second color image; a composite viewpoint map is determined based on the first sharpness viewpoint map and the second sharpness viewpoint map of the target area; A stereoscopic image is generated based on the two synthesized viewpoint maps, and the stereoscopic image is displayed.

16. A display method, wherein, include: Multiple display modes are displayed, including a third display mode, a fourth display mode, and a fifth display mode, wherein the resolution corresponding to the third display mode is greater than the resolution corresponding to the fourth display mode; In response to the selection operation of the third display mode, the resolution corresponding to the third display mode is determined as the resolution for displaying stereoscopic images; In response to the selection operation of the fourth display mode, the resolution corresponding to the fourth display mode is determined as the resolution for displaying stereoscopic images; In response to the selection of the fifth display mode, multiple sub-modes are displayed, each sub-mode corresponding to a set of resolutions, the set of resolutions including a fourth resolution and a fifth resolution; and in response to the selection of a target sub-mode among the multiple sub-modes, the fourth resolution in the set of resolutions corresponding to the target sub-mode is determined as the resolution for displaying the target area of ​​the stereoscopic image, and the fifth resolution in the set of resolutions corresponding to the target sub-mode is determined as the resolution for displaying the area of ​​the stereoscopic image other than the target area.

17. The method of claim 16, wherein, The method further includes: After determining the resolution corresponding to the third display mode as the resolution for displaying stereoscopic images, the information of the third display mode is sent to the receiving device so that the receiving device provides the image corresponding to the third display mode; or, After determining the resolution corresponding to the fourth display mode as the resolution for displaying stereoscopic images, the information of the fourth display mode is sent to the receiving device so that the receiving device provides the image corresponding to the fourth display mode; or, In a set of resolutions corresponding to the target sub-mode, the fourth resolution is determined as the resolution of the target area for displaying the stereoscopic image, and the fifth resolution in the set of resolutions corresponding to the target sub-mode is determined as the resolution of the target area for displaying the stereoscopic image. After the resolution is determined as the resolution of the area other than the target area for displaying the stereoscopic image, the information of the target sub-mode is sent to the receiving device so that the receiving device can provide the image corresponding to the fourth resolution parameter of the target and the image corresponding to the fifth resolution parameter of the target.

18. The method of claim 16, wherein, After determining the resolution corresponding to the third display mode as the resolution for displaying stereoscopic images, the method further includes: N second color images are received, where N is a positive integer greater than 2. The N first color images are synchronously acquired by N image acquisition modules at different locations, and the acquisition ranges of any two of the N image acquisition modules overlap. If the resolution of the first color image is the same as the resolution corresponding to the third display mode, then the second color image is the first color image. If the resolution of the first color image is different from the resolution corresponding to the third display mode, then the second color image is an image generated based on the first color image with a resolution corresponding to the third display mode. Based on any two second color images, a depth image is generated, and the generated depth image is used as the depth image corresponding to one of the two second color images; Generate at least two viewpoint maps based on at least two depth images and the color images corresponding to each of the at least two depth images; A stereoscopic image is generated based on the two viewpoint images, and the stereoscopic image is displayed.

19. The method of claim 16, wherein, After determining the resolution corresponding to the fourth display mode as the resolution for displaying stereoscopic images, the method further includes: N second color images are received, where N is a positive integer greater than 2. The N first color images are synchronously acquired by N image acquisition modules at different locations, and the acquisition ranges of any two of the N image acquisition modules overlap. If the resolution of the first color image is the same as the resolution corresponding to the fourth display mode, then the second color image is the first color image. If the resolution of the first color image is different from the resolution corresponding to the fourth display mode, then the second color image is an image generated based on the first color image with a resolution corresponding to the fourth display mode. Based on any two second color images, a depth image is generated, and the generated depth image is used as the arbitrary... The depth image corresponding to one of the two second-color images; Generate at least two viewpoint maps based on at least two depth images and the color images corresponding to each of the at least two depth images; A stereoscopic image is generated based on the two viewpoint images, and the stereoscopic image is displayed.

20. The method of claim 16, wherein, After determining the fourth resolution from a set of resolutions corresponding to the target sub-mode as the resolution for displaying the target area of ​​the stereoscopic image, and after determining the fifth resolution from a set of resolutions corresponding to the target sub-mode as the resolution for displaying the area of ​​the stereoscopic image other than the target area, the method further includes: The system receives N second color images and images of the target region from the N third color images, where N is a positive integer greater than 2. The N first color images are synchronously acquired by N image acquisition modules at different locations, and the acquisition ranges of any two of the N image acquisition modules overlap. Specifically, if the resolution of the first color image is the same as the fifth resolution corresponding to the target sub-mode, then the second color image is the first color image; if the resolution of the first color image is different from the fifth resolution corresponding to the target sub-mode, then the second color image is an image generated based on the first color image and the fifth resolution corresponding to the target sub-mode. If the resolution of the first color image is the same as the fourth resolution corresponding to the target sub-mode, then the third color image is the first color image; if the resolution of the first color image is different from the fourth resolution corresponding to the target sub-mode, then the third color image is an image generated based on the first color image and the fourth resolution corresponding to the target sub-mode. A second sharpness depth image is generated based on any two second color images, and the second sharpness depth image serves as the second sharpness depth image corresponding to one of the two second color images; Based on the images in the target regions of the third color images corresponding to any two second color images, a first sharpness depth image corresponding to the target region in the second color image is generated, wherein the second sharpness is less than the first sharpness; For the second color corresponding to each second resolution depth in at least two second resolution depth images The image is processed as follows: based on a first sharpness depth image corresponding to the target region in the second color image, a first sharpness viewpoint map of the target region is generated; based on a second sharpness depth image corresponding to the second color image, a second sharpness viewpoint map is generated; based on the first sharpness viewpoint map and the second sharpness viewpoint map of the target region, a composite viewpoint map is determined. A stereoscopic image is generated based on the two synthesized viewpoint maps, and the stereoscopic image is displayed.

21. An electronic device, wherein, include: The system includes a display screen, a communication module, a processor, and N image acquisition modules, wherein the number of N image acquisition modules is a positive integer greater than 2; wherein all or part of the N image acquisition modules are located on the first side of the display screen. The display screen is used to display images; The image acquisition module is used to acquire color images; The communication module is used to send the color images acquired by each image acquisition module to the receiving device; The processor is used to perform the steps in the display method as described in any one of claims 1-20.

22. The electronic device of claim 21, wherein, The number of the N image acquisition modules is 4; among them. All four image acquisition modules are located on the first side of the display screen; or, Two of the image acquisition modules are located on the first side of the display screen, and two of the image acquisition modules are located on the second side of the display screen, with the second side opposite to the first side; or, Two of the image acquisition modules are located on the first side of the display screen, one of the image acquisition modules is located on the third side of the display screen, and one of the image acquisition modules is located on the fourth side of the display screen. The third side is the side adjacent to the first side, and the fourth side is opposite to the third side.

23. The electronic device of claim 21, wherein, The number of the N image acquisition modules is 6; among them... All four image acquisition modules are located on the first side of the display screen, and two image acquisition modules are located on the second side of the display screen, with the second side opposite to the first side; or, Two of the image acquisition modules are located on the first side of the display screen, two of the image acquisition modules are located on the second side of the display screen, and one of the image acquisition modules is located on the third side of the display screen. One of the image acquisition modules is located on the fourth side of the display screen, the third side is adjacent to the first side, and the fourth side is opposite to the third side; or, Two of the image acquisition modules are located on the first side of the display screen, two of the image acquisition modules are located on the third side of the display screen, and two of the image acquisition modules are located on the fourth side of the display screen.

24. A display system, wherein, This includes electronic devices on the transmitting side and electronic devices on the receiving side; The electronic device on the transmitting side is used to perform the method as described in claim 7; The electronic device on the receiving side is used to perform the method as described in any one of claims 8-20. 25 kinds of computer-readable storage media, of which, The computer-readable storage medium is used to store a computer program that, when run on a computer, causes the computer to perform the steps of the display method as described in any one of claims 1-20.

Images