Display method, image processing method and related equipment

Abstract

The invention provides a display method, an image processing method and related equipment, which are used for enabling a user to synchronously watch 3D content and 2D content through a display device, and realizing that the display device can synchronously provide a 3D display effect and a 2D display effect. The method comprises the following steps: an image acquisition device acquires to-be-processed binocular images, wherein the to-be-processed images comprise a first left eye image and a first right eye image; the image processing device splices the first left eye image and the first right eye image to obtain a first fused image; setting content in a three-dimensional content area in a preset interface as the first fused image to obtain a target interface; determining the image of the target interface as a second fused image; and sending the second fused image and the information of the three-dimensional content area to a display device.

Description

Technical Field

[0001] The present application relates to the field of display technology, and in particular to a display method, an image processing method and related equipment. Background Art

[0002] As 3D display scenarios continue to increase, 3D display devices are gradually being widely used. At present, 3D display devices can only display 3D effects alone, or 2D effects alone. In some scenarios, users want to see 3D and 2D effects simultaneously, which is difficult to meet. Summary of the invention

[0003] The present application provides a display method, an image processing method and related devices, which are used to enable a user to synchronously watch 3D content and 2D content through a display device, so that a 3D display device can synchronously provide a 3D display effect and a 2D display effect.

[0004] In a first aspect, an embodiment of the present application provides a display method, which can be applied to a display system. The method includes:

[0005] The image acquisition device acquires binocular images to be processed, wherein the images to be processed include a first left-eye image and a first right-eye image;

[0006] The image processing device splices the first left-eye image and the first right-eye image to obtain a first fused image; sets the content in the three-dimensional content area in the preset interface to the first fused image to obtain a target interface; determines the image of the target interface as a second fused image; and sends the second fused image and information of the three-dimensional content area to a display device.

[0007] In specific implementation, the display method provided in the embodiment of the present application can meet the scenario of synchronously viewing three-dimensional content and two-dimensional content. Three-dimensional content can include color content and / or grayscale content, and two-dimensional content can include color content and / or grayscale content. The display method provided in the present application can enable a user to have a 3D viewing effect for three-dimensional content and a 2D viewing effect for two-dimensional content when viewing a display device.

[0008] In a possible design, the display method provided in the embodiment of the present application further includes:

[0009] The display device extracts a target image in the three-dimensional content area in the second fused image according to information of the three-dimensional content area; and determines the first left-eye image and the first right-eye image based on the target image;

[0010] The screen range corresponding to the three-dimensional content area in the display device displays the first left-eye image and the first right-eye image;

[0011] The screen range corresponding to the area other than the three-dimensional content area in the display device displays images other than the target image in the fused image.

[0012] In a possible design, in the display method provided in the embodiment of the present application, the image processing device replaces the content in the three-dimensional content area of ​​the preset interface with the first fused image to obtain the second fused image, including:

[0013] The image processing device determines a first image based on the image of the preset interface and a first grayscale mapping relationship;

[0014] The image processing device replaces the content in the three-dimensional content area in the first image with a second image, where the second image is determined based on the first fused image and the second grayscale mapping relationship.

[0015] In a possible design, in the display method provided in the embodiment of the present application, the image processing device sends the second fused image and the information of the three-dimensional content area to the display device, and further includes:

[0016] Grayscale calibration is performed on the second fused image; and the second fused image after the grayscale calibration and information on the three-dimensional content area are sent to a display device.

[0017] In a possible design, in the display method provided in the embodiment of the present application, the image of the target interface includes a medical imaging area, and the medical imaging area is used to display a medical image;

[0018] The image processing device performs grayscale calibration processing on the second fused image, including:

[0019] The image processing device performs grayscale transformation processing on the medical image area in the second fused image based on the first grayscale mapping relationship; and performs grayscale transformation processing on the area other than the medical image area in the second fused image based on the second grayscale mapping relationship.

[0020] In a possible design, in the display method provided in the embodiment of the present application, the image of the target interface includes a medical imaging area, and the medical imaging area is used to display a medical image;

[0021] The image processing device performs grayscale calibration processing on the second fused image, including:

[0022] The image processing device performs grayscale transformation processing on the second fused image based on the first grayscale mapping relationship to obtain an intermediate calibration image corresponding to the second fused image;

[0023] The image processing device performs grayscale transformation processing on the area other than the medical image area in the intermediate calibration image corresponding to the second fused image based on the third grayscale mapping relationship.

[0024] In a second aspect, an embodiment of the present application provides a display method, which can be applied to a display system. The method may include:

[0025] The image acquisition device acquires binocular images to be processed, wherein the images to be processed include a first left-eye image and a first right-eye image;

[0026] An image processing device generates a target binocular image based on a preset interface, a three-dimensional content area and the binocular image to be processed, wherein the target binocular image includes a target left-eye image and a target right-eye image, wherein the content in the three-dimensional content area of ​​each image in the target binocular image is determined based on the binocular image to be processed, and the images are the same except for the content in the two-dimensional content area; and outputs the target binocular image to a display device for display.

[0027] In a possible design, in the display method provided in the embodiment of the present application, the image processing device generates a target binocular image based on a preset interface, a three-dimensional content area and the binocular image to be processed, including:

[0028] The image processing device displays the preset interface in a virtual display;

[0029] The image processing device determines a plurality of third images based on the content displayed by the virtual display and the first grayscale mapping relationship;

[0030] The image processing device replaces the content in the three-dimensional content area in one of the third images with a fourth image to obtain the target left-eye image, wherein the fourth image is determined based on a mapping relationship between the first left-eye image and the second grayscale;

[0031] The image processing device replaces the content in the three-dimensional content area in one of the third images with a fifth image to obtain the target right-eye image, where the fifth image is determined based on a mapping relationship between the first right-eye image and the second grayscale.

[0032] In a possible design, in the display method provided in the embodiment of the present application, the preset interface includes a medical image area, and the medical image area is used to display medical images;

[0033] The image processing device determines a plurality of third images based on the content displayed by the virtual display and the first grayscale mapping relationship, including:

[0034] The image processing device takes a screenshot of the content displayed by the virtual display;

[0035] The image processing device performs grayscale transformation processing on the image in the medical imaging area in the screenshot based on the first grayscale mapping relationship to obtain the third image, wherein the first grayscale mapping relationship and the second grayscale mapping relationship are different mapping relationships.

[0036] In a possible design, in the display method provided in the embodiment of the present application, the image processing device generates a target binocular image based on a preset interface, a three-dimensional content area and the binocular image to be processed, including:

[0037] The image processing device displays a preset interface in a virtual display;

[0038] The image processing device takes a screenshot of the content displayed by the virtual display;

[0039] The image processing device replaces the content in the three-dimensional content area in one of the screenshots with the first left-eye image to obtain an image to be calibrated;

[0040] The image processing device replaces the content in the three-dimensional content area in one of the screenshots with the first right-eye image to obtain another image to be calibrated;

[0041] The image processing device performs grayscale calibration processing on each image to be calibrated to obtain the target left-eye image and the target right-eye image.

[0042] In a possible design, in the display method provided in the embodiment of the present application, the preset interface includes a medical image area, and the medical image area is used to display medical images;

[0043] The image processing device performs grayscale calibration processing on each image to be calibrated, including:

[0044] The image processing device performs grayscale transformation processing on the medical image area in each image to be calibrated based on the first grayscale mapping relationship;

[0045] The image processing device performs grayscale transformation processing on each image to be calibrated except the medical imaging area based on the second grayscale mapping relationship.

[0046] In a possible design, in the display method provided in the embodiment of the present application, the preset interface includes a medical image area, and the medical image area is used to display medical images;

[0047] The image processing device performs grayscale calibration processing on each image to be calibrated, including:

[0048] The image processing device performs grayscale transformation processing on each image to be calibrated based on the first grayscale mapping relationship to obtain an intermediate calibration image corresponding to each image to be calibrated;

[0049] The image processing device performs grayscale transformation processing on the area other than the medical image area in the intermediate calibration image corresponding to each image to be calibrated based on the third grayscale mapping relationship.

[0050] In a possible design, in the display method provided in the embodiment of the present application, the image processing device generates a target left-eye image and a target right-eye image based on a preset interface, position information of a three-dimensional content area and the binocular image to be processed, including:

[0051] The image processing device displays a preset interface in a virtual display;

[0052] The image processing device determines a plurality of third images based on the content displayed by the virtual display;

[0053] The image processing device replaces the content in the three-dimensional content area in one of the third images with the first left-eye image to obtain the target left-eye image;

[0054] The image processing device replaces the content in the three-dimensional content area in one of the third images with the first right-eye image to obtain the target right-eye image.

[0055] In a third aspect, an embodiment of the present application provides an image processing method, which can be applied to an image processing device, and the method includes:

[0056] Acquire an image to be processed, where the image to be processed includes a first left-eye image and a first right-eye image;

[0057] splicing the first left-eye image and the first right-eye image to obtain a first fused image;

[0058] Setting the content in the three-dimensional content area in the preset interface as the first fused image to obtain a target interface;

[0059] Determining the image of the target interface as a second fused image;

[0060] The second fused image and information about the three-dimensional content area are sent to a target display device.

[0061] In a possible design, in the image processing method provided in the embodiment of the present application, setting the content in the three-dimensional content area in the preset interface as the first fused image to obtain the target interface includes:

[0062] Determine a first image based on the image of the preset interface and the first grayscale mapping relationship;

[0063] The content in the three-dimensional content area in the first image is replaced by a second image, where the second image is determined based on the first fused image and the second grayscale mapping relationship.

[0064] In a possible design, in the image processing method provided in the embodiment of the present application, sending the second fused image and the information of the three-dimensional content area to a target display device includes:

[0065] Perform grayscale calibration processing on the second fused image; and send the grayscale calibrated image and information of the three-dimensional content area to a target display device.

[0066] In some examples, the image of the target interface includes a medical image area, and the medical image area is used to display the medical image. The grayscale calibration process of the second fused image includes:

[0067] Based on the first grayscale mapping relationship, grayscale transformation processing is performed on the medical imaging region in the second fused image; based on the second grayscale mapping relationship, grayscale transformation processing is performed on the second fused image except for the medical imaging region.

[0068] In some examples, the image of the target interface includes a medical image area, and the medical image area is used to display the medical image. The grayscale calibration process of the second fused image includes:

[0069] Based on the first grayscale mapping relationship, grayscale transformation processing is performed on the second fused image to obtain an intermediate calibration image corresponding to the second fused image;

[0070] Based on the third grayscale mapping relationship, grayscale transformation processing is performed on the area except the medical image area in the intermediate calibration image corresponding to the second fused image.

[0071] In a possible design, in the image processing method provided in an embodiment of the present application, the resolution of the target interface is determined based on the resolution of the binocular image to be processed.

[0072] In a fourth aspect, an embodiment of the present application provides a display method, which can be applied to a display device. The method may include:

[0073] receiving the fused image and information of the three-dimensional content area;

[0074] extracting a target image within the three-dimensional content area in the fused image according to the information of the three-dimensional content area;

[0075] Based on the target image, determining a first left-eye image and a first right-eye image;

[0076] The screen range corresponding to the three-dimensional content area in the display device displays the first left-eye image and the first right-eye image;

[0077] The screen range corresponding to the area other than the three-dimensional content area in the display device displays images other than the target image in the fused image.

[0078] In a fifth aspect, an embodiment of the present application provides an image processing method, which can be applied to an image processing device. The method may include:

[0079] Acquire binocular images to be processed, where the images to be processed include a first left-eye image and a first right-eye image;

[0080] Based on the preset interface, the three-dimensional content area and the binocular image to be processed, a target binocular image is generated, wherein the target binocular image includes a target left-eye image and a target right-eye image, wherein the content in the three-dimensional content area of ​​each image in the target binocular image is determined based on the binocular image to be processed, and the images are the same except for the content in the two-dimensional content area;

[0081] The target binocular image is output to a display device for display.

[0082] In a possible design, in the display method provided in the embodiment of the present application, generating a target binocular image based on a preset interface, a three-dimensional content area and the binocular image to be processed includes:

[0083] Displaying the preset interface on a virtual display;

[0084] Determining a plurality of third images based on the content displayed by the virtual display and the first grayscale mapping relationship;

[0085] replacing the content in the three-dimensional content area in one of the third images with a fourth image to obtain the target left-eye image, wherein the fourth image is determined based on a mapping relationship between the first left-eye image and the second grayscale;

[0086] The target right-eye image is obtained by replacing the content in the three-dimensional content area in the third image with a fifth image, where the fifth image is determined based on a mapping relationship between the first right-eye image and the second grayscale.

[0087] In a possible design, in the display method provided in the embodiment of the present application, the preset interface includes a medical image area, and the medical image area is used to display medical images;

[0088] Determining a plurality of third images based on the content displayed by the virtual display and the first grayscale mapping relationship includes:

[0089] Taking a screenshot of the content displayed on the virtual display;

[0090] Based on the first grayscale mapping relationship, grayscale transformation processing is performed on the image in the medical imaging area in the screenshot to obtain the third image, wherein the first grayscale mapping relationship and the second grayscale mapping relationship are different mapping relationships.

[0091] In specific implementation, the display method provided in the embodiment of the present application can be applied to medical scenarios. Generally speaking, the display device in the medical scenario needs to meet the medical reading requirements, and usually performs grayscale display according to the medical imaging standards. If the color content is displayed simultaneously, there will be a color difference problem. In this embodiment, the first grayscale mapping relationship is used to perform grayscale correction on the content in the medical imaging area, and the second grayscale mapping relationship is used to perform grayscale correction on the content in the non-medical imaging area, which can avoid color difference in the color content.

[0092] In a possible design, generating a target binocular image based on a preset interface, a three-dimensional content area and the binocular image to be processed includes:

[0093] Displaying a preset interface in a virtual display;

[0094] Taking a screenshot of the content displayed on the virtual display;

[0095] Replacing the content in the three-dimensional content area in one of the screenshots with the first left-eye image to obtain an image to be calibrated;

[0096] Replacing the content in the three-dimensional content area in one of the screenshots with the first right-eye image to obtain another image to be calibrated;

[0097] Grayscale calibration is performed on each image to be calibrated to obtain the target left-eye image and the target right-eye image.

[0098] In a possible design, in the display method provided in the embodiment of the present application, the preset interface includes a medical image area, and the medical image area is used to display medical images;

[0099] The grayscale calibration process is performed on each image to be calibrated, including:

[0100] Based on the first grayscale mapping relationship, grayscale transformation processing is performed on the medical image area in each image to be calibrated;

[0101] Based on the second grayscale mapping relationship, grayscale transformation processing is performed on each image to be calibrated except the medical imaging area.

[0102] In specific implementation, the display method provided in the embodiment of the present application can be applied to medical scenarios. Generally speaking, the display device in the medical scenario needs to meet the medical reading requirements, and usually performs grayscale display according to the medical imaging standards. If the color content is displayed simultaneously, there will be a color difference problem. In this embodiment, the first grayscale mapping relationship is used to perform grayscale correction on the content in the medical imaging area, and the second grayscale mapping relationship is used to perform grayscale correction on the content in the non-medical imaging area, which can avoid color difference in the color content.

[0103] In a possible design, in the display method provided in the embodiment of the present application, the preset interface includes a medical image area, and the medical image area is used to display medical images;

[0104] The grayscale calibration process is performed on each image to be calibrated, including:

[0105] Based on the first grayscale mapping relationship, grayscale transformation processing is performed on each image to be calibrated to obtain an intermediate calibration image corresponding to each image to be calibrated;

[0106] Based on the third grayscale mapping relationship, grayscale transformation processing is performed on the area other than the medical image area in the intermediate calibration image corresponding to each image to be calibrated.

[0107] In specific implementation, the display method provided in the embodiment of the present application can be applied to medical scenarios. Generally speaking, the display device in the medical scenario needs to meet the medical reading requirements, and usually performs grayscale display according to the medical imaging standards. If the color content is displayed simultaneously, there will be a color difference problem. In this embodiment, the first grayscale mapping relationship is used to perform grayscale correction on the content in the medical imaging area, and the second grayscale mapping relationship is used to perform grayscale correction on the content in the non-medical imaging area, which can avoid color difference in the color content.

[0108] In a possible design, in the display method provided in an embodiment of the present application, the resolution of the preset interface is determined based on the resolution of the binocular image to be processed.

[0109] In a possible design, in the display method provided in the embodiment of the present application, generating a target left-eye image and a target right-eye image based on a preset interface, position information of a three-dimensional content area and the binocular image to be processed includes:

[0110] Displaying a preset interface in a virtual display;

[0111] Determining a plurality of third images based on the content displayed by the virtual display;

[0112] replacing the content in the three-dimensional content area in one of the third images with the first left-eye image to obtain the target left-eye image;

[0113] The content in the three-dimensional content area in one of the third images is replaced with the first right-eye image to obtain the target right-eye image.

[0114] In a sixth aspect, an embodiment of the present application further provides an image processing device, including: a memory and a processor;

[0115] The memory stores computer program instructions;

[0116] The processor executes the computer program instructions to perform any step performed by the image processing device in the first aspect and any possible implementation manner thereof, or the second aspect and any possible implementation manner thereof, or the third aspect and any possible implementation manner thereof, or the fifth aspect and any possible implementation manner thereof.

[0117] In a seventh aspect, an embodiment of the present application provides a display device, including a memory and a processor;

[0118] The memory stores computer program instructions;

[0119] The processor executes the computer program instructions to perform any step performed by the display device in the first aspect and any possible implementation manner thereof, or the second aspect and any possible implementation manner thereof, or the fourth aspect.

[0120] In an eighth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium is used to store a computer program. When the computer program runs on a computer, the computer executes any step performed by the image processing device in the first aspect and any possible implementation manner thereof, or the second aspect and any possible implementation manner thereof, or the third aspect and any possible implementation manner thereof, or the fifth aspect and any possible implementation manner thereof.

[0121] In the ninth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium is used to store a computer program. When the computer program runs on a computer, the computer executes any step executed by the display device in the first aspect and any possible implementation manner thereof, or the second aspect and any possible implementation manner thereof, or the fourth aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0122] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0123] Figure 1 A schematic diagram of a display system provided in an embodiment of the present application;

[0124] Figure 2 A schematic flow chart of a display method provided in an embodiment of the present application;

[0125] Figure 3 A schematic diagram of a second fused image is provided for an embodiment of the present application;

[0126] Figure 4 It is a schematic diagram of the medical imaging area;

[0127] Figure 5 A schematic flow chart of another display method provided in an embodiment of the present application;

[0128] Figure 6 A schematic diagram of a viewing effect;

[0129] Figure 7 A schematic flow chart of a display method provided in an embodiment of the present application;

[0130] Figure 8 is a schematic diagram of a target binocular image;

[0131] Fig. 9 A schematic flow chart of a display method provided in an embodiment of the present application;

[0132] Fig.10 A schematic flow chart of a display method provided in an embodiment of the present application;

[0133] Fig.11 It is a schematic diagram of the medical imaging area;

[0134] Fig.12 is a schematic diagram of a target binocular image;

[0135] Fig.13 A schematic flow chart of a display method provided in an embodiment of the present application;

[0136] Fig.14 A schematic flow chart of an image processing method provided in an embodiment of the present application;

[0137] Fig.15 A schematic flow chart of a display method provided in an embodiment of the present application;

[0138] Fig.16 A schematic flow chart of an image processing method provided in an embodiment of the present application;

[0139] Fig.17 A schematic diagram of an image processing device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0140] At least one of the embodiments of the present application includes one or more; wherein, multiple means greater than or equal to two. In addition, it should be understood that in the description of the present application, the words "first", "second", etc. are only used for the purpose of distinguishing the description, and cannot be understood as an explicit or implicit relative importance, nor can they be understood as an explicit or implicit order. In the description of the present application, "A and / or B" includes three schemes, namely including A; including B; and including A and B.

[0141] Figure 1 Schematic diagram of the structure of a display system. The display system provided in the embodiment of the present application may include an image processing device and a display device. In the embodiment of the present application, the display device can be understood as a display device capable of providing a 3D display effect. The image processing device can provide an image to the display device so that the display device can display the image.

[0142] In some examples, the display system may further include an image acquisition device. The image acquisition device may have an image acquisition function. Optionally, the image acquisition device may use any image acquisition technology to acquire images. The image acquisition device may acquire 3D images of any object. In some application scenarios, the image acquisition device may be implemented as a device for acquiring medical images in a medical scenario.

[0143] In some embodiments, the image processing device may generate a fused image. The display device displays the fused image, allowing the user to view two-dimensional content and three-dimensional content. Three-dimensional content may be understood as content that has a 3D effect when viewed. Two-dimensional content may be understood as content that has a 2D effect when viewed. In some scenarios, three-dimensional content may be an image or a video frame. Two-dimensional content may be part or all of content such as an image, a system interface, or an application interface.

[0144] In some embodiments, the image acquisition device may be implemented as a content providing device. The content providing device may acquire images for displaying 3D content by generating images for displaying 3D content. This embodiment of the present application does not impose too many limitations on this.

[0145] Figure 2 A display method is exemplarily shown, which can be implemented by a display system. The method may include the following steps:

[0146] S201, an image acquisition device acquires binocular images to be processed, where the images to be processed include a first left-eye image and a first right-eye image.

[0147] The binocular image to be processed may include a first left-eye image and a first right-eye image. In some examples, the image processing device may receive the binocular image to be processed, for example, the image processing device may receive the binocular image to be processed provided by the image acquisition device. For another example, the image processing device may generate the binocular image to be processed and store the image. The image processing device may obtain the binocular image to be processed from a storage module.

[0148] S202, the image processing device splices the first left-eye image and the first right-eye image to obtain a first fused image; sets the content in the three-dimensional content area in the preset interface as the first fused image to obtain a target interface; determines the image of the target interface as a second fused image; and sends the second fused image and information of the three-dimensional content area to a display device.

[0149] The image processing device may adjust the resolution of the first left-eye image and the first right-eye image, and then splice the two adjusted images, such as using a Side-by-Side format to obtain a first fused image. Figure 3 , the graphics card of the image processing device uses the first fused image as the content in the three-dimensional content area in the preset interface. In other words, the content in the three-dimensional content area in the preset interface is configured as the first fused image to obtain the target interface. The image processing device can obtain the image of the target interface through the graphics card as the second fused image.

[0150] In a possible application scenario, the three-dimensional content area is pre-configured, or received by the image processing device. The three-dimensional content area can be characterized by the information of the three-dimensional content area, and the image processing device can obtain the specific position, size, etc. of the three-dimensional content area through the information of the three-dimensional content area. The information of the three-dimensional content area can be used but not limited to: position information, coordinates of the region vertices.

[0151] Optionally, the binocular image to be processed may be a picture in Side-by-Side format. The image processing device may use the left half of the binocular image to be processed as the first left-eye image, and use the right half of the binocular image to be processed as the first right-eye image.

[0152] In a possible application scenario, the number of three-dimensional content areas may be one or more. In some examples, the number of three-dimensional content areas may be multiple, and the image processing device may receive multiple binocular images to be processed. The multiple binocular images to be processed correspond one-to-one to the multiple three-dimensional content areas. For each binocular image to be processed, the image processing device may splice the first left-eye image and the first right-eye image to obtain a first fused image; and replace the content in the three-dimensional content area corresponding to the binocular image to be processed in the screenshot with the first fused image. After the image processing device performs the aforementioned operations on all binocular images to be processed, a second fused image is obtained. The image processing device may send the second fused image and information of the multiple three-dimensional content areas to the display device.

[0153] In a possible implementation manner, the display method provided in the embodiment of the present application may further include:

[0154] The display device extracts a target image within the three-dimensional content area in the second fused image according to information of the three-dimensional content area; and determines the first left-eye image and the first right-eye image based on the target image; a screen range corresponding to the three-dimensional content area in the display device displays the first left-eye image and the first right-eye image; a screen range corresponding to an area other than the three-dimensional content area in the display device displays images other than the target image in the fused image.

[0155] In the embodiment of the present application, the display device may have the function of simultaneously supporting 2D and 3D display. The display device may include a 3D display sub-screen and a 2D display sub-screen. The 3D display sub-screen may display 3D content, or display 2D content. The 2D display sub-screen may display 2D content.

[0156] In a possible application scenario, the number of three-dimensional content areas may be one or more. In some examples, the number of three-dimensional content areas may be multiple. The display device may extract a target image in the three-dimensional content area from the second fused image based on the information of each three-dimensional content area, and determine a first left-eye image and a first right-eye image corresponding to the target image. The display device may display the first left-eye image and the first right-eye image within a screen range corresponding to the three-dimensional content area.

[0157] Assume that the screen of the display device is used to display images, wherein the screen portion corresponding to the three-dimensional content area displays three-dimensional content, and the screen portion corresponding to the area other than the three-dimensional content area displays two-dimensional content. When the human eye views the screen of the 3D display device, the image viewed by the left eye is the target left-eye image, and the image viewed by the right eye is the target right-eye image. Since the content in the three-dimensional content area of ​​the target left-eye image and the content in the three-dimensional content area of ​​the target right-eye image are determined based on the binocular images to be processed, the human eye observes that the content in the screen portion corresponding to the three-dimensional content area has a 3D effect. Since the content in the area other than the three-dimensional content area of ​​the target left-eye image and the content in the area other than the three-dimensional content area of ​​the target right-eye image are the same, the human eye observes that the content in the screen portion corresponding to the area other than the three-dimensional content area has a 2D effect.

[0158] In a possible design, the image processing device may perform the following process in the operation of setting the content in the three-dimensional content area in the preset interface as the first fused image to obtain the target interface:

[0159] Determine a first image based on the image of the preset interface and the first grayscale mapping relationship;

[0160] The content in the three-dimensional content area in the first image is replaced by a second image, where the second image is determined based on the first fused image and the second grayscale mapping relationship.

[0161] The image processing device may respectively adopt different grayscale mapping relationships to perform calibration processing on the image of the preset interface and the first fused image, and then replace the image in the three-dimensional content area of ​​the first image with the second image.

[0162] In some application scenarios, the grayscale of the second fused image may be different from the grayscale of the binocular image to be processed, and / or the grayscale of the second fused image may be different from the grayscale of the preset interface. To ensure the viewing effect of the user when viewing the content through the 3D display device, the image processing device may perform grayscale conversion processing on the grayscale of part or all of the content of the preset interface, and / or perform grayscale conversion processing on the grayscale of the binocular image to be processed.

[0163] In some examples, the first grayscale mapping relationship and the second grayscale mapping relationship may be the same. In other examples, the first grayscale mapping relationship and the second grayscale mapping relationship are different.

[0164] In a possible design, in the operation of the image processing device sending the second fused image and the information of the three-dimensional content area to the target display device, the following process may also be performed:

[0165] The image processing device performs grayscale calibration processing on the second fused image; the image processing device sends the second fused image after the grayscale calibration processing and information of the three-dimensional content area to the target display device.

[0166] In this embodiment, after determining the second fused image, the image processing device may perform grayscale calibration processing on the second fused image.

[0167] In a possible implementation, the second fused image may include a medical imaging area. Figure 4 The second fused image includes a medical image area and a non-medical image area. The medical image area is generally used to display medical images. The relevant standards for content display in common medical scenes may include but are not limited to: Digital Imaging and Communications in Medicine (DICOM) standards. The content display effect in medical scenes should comply with relevant standards to meet user viewing needs.

[0168] In some examples, the second fused image includes a medical image area, and the medical image area is used to display the medical image. In the operation of the image processing device performing grayscale calibration processing on the second fused image, the image processing device may perform the following process:

[0169] Based on the first grayscale mapping relationship, grayscale transformation processing is performed on the medical image area in the second fused image; based on the second grayscale mapping relationship, grayscale transformation processing is performed on the area other than the medical image area in the second fused image.

[0170] The image processing device may only perform grayscale conversion processing on the content in the medical image area in the second fused image, and not perform grayscale conversion processing on the content in the non-medical image area. Figure 4 For example, the target interface is in color, and after grayscale conversion processing is performed on the content in the medical imaging area of ​​the target interface, only the grayscale effect in the medical imaging area is different from the grayscale effect in the non-medical imaging area.

[0171] In the embodiment of the present application, the number of the three-dimensional content area may be one or more. The number of the medical imaging area may be one or more.

[0172] The image processing device can perform grayscale transformation processing on the medical imaging area in the second fused image based on the first grayscale mapping relationship, so that the image in the medical imaging area can meet the viewing effect required by the medical scene. The image processing device can perform grayscale transformation processing on the non-medical imaging area in the second fused image based on the second grayscale mapping relationship, so that the image in the non-medical imaging area can meet the viewing effect required by ordinary scenes. When watching the display device, the user can simultaneously watch images with 3D effects, medical imaging content with 2D effects, and non-medical imaging content with 2D effects. Non-medical imaging content with 2D effects may include but is not limited to UI designs such as system menus, buttons, and icons.

[0173] In some application scenarios, the first grayscale mapping relationship may be determined based on the DICOM standard. The first grayscale mapping relationship may include a correspondence between a first input grayscale value and an output grayscale value. Optionally, the correspondence between the input grayscale value and the first output grayscale value may be implemented as a continuous curve function, or the correspondence between the input grayscale value and the first output grayscale value may be reflected by a grayscale comparison table pre-stored by the image processing device.

[0174] The second grayscale mapping relationship may be determined based on a GAMMA curve. The second grayscale mapping relationship may include a correspondence between an input grayscale value and a second output grayscale value. Optionally, the correspondence between the input grayscale value and the second output grayscale value may be implemented as a continuous curve function, or the correspondence between the input grayscale value and the second output grayscale value may be reflected by a grayscale comparison table.

[0175] Optionally, the color depth supported by the display device is different, and the grayscale comparison table may be different. The image processing device may pre-store a first grayscale comparison table and a second grayscale comparison table, and the image processing device may select one of the grayscale comparison tables according to the color temperature supported by the display device. The image processing device may obtain the first grayscale mapping relationship and the second grayscale mapping relationship based on the selected grayscale comparison table.

[0176] For example, the display device supports 8-bit color depth, and the input grayscale range is 0 to 255. The first grayscale comparison table can be implemented as shown in Table 1 below.

[0177] Table 1

[0178]

[0179] For another example, the display device supports 10-bit color depth, and the input grayscale range is 0 to 1023. The second grayscale comparison table can be implemented as shown in Table 2 below.

[0180] Table 2

[0181]

[0182] In some examples, the second fused image includes a medical image area, and the medical image area is used to display the medical image. In the operation of the image processing device performing grayscale calibration processing on the second fused image, the image processing device may perform the following process:

[0183] Based on the first grayscale mapping relationship, grayscale transformation processing is performed on the second fused image to obtain an intermediate calibration image corresponding to the second fused image;

[0184] Based on the third grayscale mapping relationship, grayscale transformation processing is performed on the area except the medical image area in the intermediate calibration image corresponding to the second fused image.

[0185] During specific implementation, the image processing device can perform grayscale transformation processing on the second fused image as a whole based on the first grayscale mapping relationship to obtain an intermediate calibration image. The intermediate calibration image as a whole can be a viewing effect that meets the needs of the medical scene. Then the image processing device can perform grayscale transformation processing on the area outside the non-medical image area in the intermediate calibration image corresponding to the second fused image based on the third grayscale mapping relationship, so that the content of the area outside the non-medical image area in the intermediate calibration image can meet the viewing effect required by ordinary scenes. The third grayscale mapping relationship may include the correspondence between the aforementioned first output grayscale value and the aforementioned second output grayscale value. Alternatively, the third grayscale mapping relationship may be determined based on the DICOM standard and the GAMMA curve.

[0186] In a possible design, the resolution of the target interface is determined based on the resolution of the binocular images to be processed.

[0187] Figure 5 A display method is exemplarily shown, which can be performed by a display system. The method may include the following steps:

[0188] S501, an image acquisition device acquires binocular images to be processed, where the images to be processed include a first left-eye image and a first right-eye image.

[0189] For step S501, reference may be made to the related introduction in the aforementioned embodiment, which will not be described again here.

[0190] S502, the image processing device generates a target binocular image based on a preset interface, a three-dimensional content area and the binocular image to be processed, the target binocular image including a target left-eye image and a target right-eye image, wherein the content in the three-dimensional content area of ​​each image in the target binocular image is determined based on the binocular image to be processed, and the images are the same except for the content in the two-dimensional content area; and outputs the target binocular image to a display device for display.

[0191] In this embodiment, the preset interface may be content displayed on a virtual display in the image processing device. The preset interface may be displayed on a virtual display in the image processing device. The preset interface cannot be observed by human eyes.

[0192] The target binocular image generated by the image processing device is displayed by the display device or the target display device. In the embodiment of the present application, the display device may have the function of synchronously supporting 2D and 3D display. The display device may include a 3D display subscreen and a 2D display subscreen. The 3D display subscreen may display 3D content, or display 2D content. The 2D display subscreen may display 2D content. Alternatively, the display device may be a 3D display device.

[0193] Please combine Figure 6 , assuming that the screen of the 3D display device is fully used to display images, wherein the screen portion corresponding to the three-dimensional content area displays three-dimensional content, and the screen portion corresponding to the area other than the three-dimensional content area displays two-dimensional content. When the human eye views the screen of the 3D display device, the image viewed by the left eye is the target left-eye image, and the image viewed by the right eye is the target right-eye image. Since the content in the three-dimensional content area of ​​the target left-eye image and the content in the three-dimensional content area of ​​the target right-eye image are determined based on the binocular images to be processed, the human eye observes that the content in the screen portion corresponding to the three-dimensional content area has a 3D effect. Since the content in the area other than the three-dimensional content area of ​​the target left-eye image and the content in the area other than the three-dimensional content area of ​​the target right-eye image are the same, the human eye observes that the content in the screen portion corresponding to the area other than the three-dimensional content area has a 2D effect.

[0194] In a possible application scenario, the three-dimensional content area is pre-configured, or received by the image processing device. The three-dimensional content area can be characterized by the information of the three-dimensional content area, and the image processing device can obtain the specific position, size, etc. of the three-dimensional content area through the information of the three-dimensional content area. The information of the three-dimensional content area can be used but not limited to: position information, coordinates of the region vertices.

[0195] When the image processing device generates the target binocular image, the 3D content can be set in the 3D content area of ​​the target binocular image, and the 2D content can be set in other areas. When the 3D display device displays the target binocular image, the user can view the 3D content and the 2D content.

[0196] In some examples, when the image processing device outputs the target binocular image to the 3D display device for display, the image processing device may process the target left-eye image and the target right-eye image into a side-by-side (SBS) image format to obtain the target binocular image. The image processing device may send the target fused image to the 3D display device.

[0197] After receiving the target binocular image, the 3D display device can use the existing 3D image display technology to obtain the target left eye image and the target right eye image from the target binocular image. For example, the target binocular image is divided into a left half image and a right half image, and the two are of the same size. The left half image is the content of the target left eye image, and the resolution is different from the resolution of the target left eye image. The right half image is the content of the target right eye image, and the resolution is different from the resolution of the target right eye image. The 3D display device can obtain the target left eye image after performing processing operations such as stretching on the left half image. The 3D display device can obtain the target right eye image after performing processing operations such as stretching on the right half image.

[0198] Optionally, the binocular image to be processed may be a picture in Side-by-Side format. The image processing device may use the left half of the binocular image to be processed as the first left-eye image, and use the right half of the binocular image to be processed as the first right-eye image.

[0199] In one possible implementation, in the display method provided in the embodiment of the present application, the binocular image to be processed is an image corresponding to the three-dimensional content area. In some application scenarios, the number of three-dimensional content areas may be one or more. Based on the introduction in the embodiment of the present application, those skilled in the art can easily think of the execution process of the image processing device generating the target binocular image in the scenario of multiple three-dimensional content areas, and the present application will not elaborate on this.

[0200] In a possible implementation manner, based on the display method provided in the above embodiment, in step S202, the image processing device may generate a target binocular image in the following manner. Figure 7 As shown, the image processing device can perform the following steps:

[0201] S701, displaying a preset interface on a virtual display.

[0202] In specific implementation, the preset interface may include two-dimensional content that is expected to be displayed. The two-dimensional content may include but is not limited to text, images, symbols, characters, UI components, etc.

[0203] S702: Determine a plurality of third images based on the content displayed by the virtual display.

[0204] In specific implementation, the image processing device can take screenshots of the content displayed on the virtual display, and the screenshot result can be used as the third image. The image processing device uses the multiple third images to generate a target binocular image.

[0205] S703: Replace the content in the three-dimensional content area in one of the third images with the first left-eye image to obtain the target left-eye image.

[0206] S704: Replace the content in the three-dimensional content area in one of the third images with the first right-eye image to obtain the target right-eye image.

[0207] Please combine Figure 8 , the image processing device can determine the three-dimensional content area in the third image according to the position information of the three-dimensional content area. The image processing device can use a third image to replace the image in the three-dimensional content area with the first left-eye image to obtain a target left-eye image. The three-dimensional content area in the target left-eye image is the first left-eye image, and the area other than the three-dimensional content area is part of the content in the preset interface (recorded as the first part).

[0208] Similarly, the image processing device can use a third image to replace the image in the three-dimensional content area with the first right eye image to obtain a target right eye image. The three-dimensional content area in the target right eye image is the first right eye image, and the area other than the three-dimensional content area is part of the content in the preset interface (recorded as the second part). It can be seen that compared with the target left eye image and the target right eye image, only the image in the three-dimensional content area is different, and the content in the area other than the three-dimensional content area is the same.

[0209] The image processing device can control the 3D display device to display the target binocular image. When the user views the screen display range of the 3D display device, the user can view the three-dimensional content in the three-dimensional content area and the two-dimensional content outside the three-dimensional content area. It can be seen that the embodiment of the present application can achieve the effect of fusion display of two-dimensional content and three-dimensional content.

[0210] In a possible implementation, based on the display method provided in the above embodiment, part of the content in the target binocular image may be color content, and part of the content may be grayscale content. The display method in this embodiment may also be applied to, but not limited to, medical scenes and other scenes with simultaneous display of color content and grayscale content.

[0211] The image processing device can generate the target binocular image in the following manner. Fig. 9 As shown, the image processing device can perform the following steps:

[0212] S901, displaying a preset interface on a virtual display.

[0213] S902: Determine a plurality of third images based on the content displayed by the virtual display and the first grayscale mapping relationship.

[0214] S903: Replace the content in the three-dimensional content area in the third image with a fourth image to obtain the target left-eye image, where the fourth image is determined based on a mapping relationship between the first left-eye image and the second grayscale.

[0215] S904: Replace the content in the three-dimensional content area in one of the third images with a fifth image to obtain the target right-eye image, where the fifth image is determined based on a mapping relationship between the first right-eye image and the second grayscale.

[0216] In a specific implementation, the grayscale of the target binocular image may be different from the grayscale of the binocular image to be processed, and / or the grayscale of the target binocular image may be different from the grayscale of the preset interface. To ensure the viewing effect of the user when viewing the content through the 3D display device, the image processing device may perform grayscale conversion processing on the grayscale of part or all of the content of the preset interface, and / or perform grayscale conversion processing on the grayscale of the binocular image to be processed.

[0217] In step S902, the image processing device can take a screenshot of the content displayed on the virtual display, and the image processing device can perform grayscale conversion processing on the screenshot based on the first grayscale mapping relationship to obtain a third image. The image processing device can generate a target binocular image using multiple third images.

[0218] The image processing device may perform grayscale conversion processing on the first left eye image based on the second grayscale mapping relationship to obtain a fourth image. Similarly, the image processing device may perform grayscale conversion processing on the first right eye image based on the second grayscale mapping relationship to obtain a fifth image.

[0219] The image processing device replaces the content in the 3D content area of ​​a third image with the fourth image to obtain a target left-eye image. The image processing device replaces the content in the 3D content area of ​​another third image with the fifth image to obtain a target right-eye image.

[0220] It can be seen that in this embodiment, the image processing device can perform grayscale conversion processing on the screenshot of the preset interface, the first left-eye image, and the first right-eye image, respectively, and then perform a replacement operation on the grayscale converted images.

[0221] In some examples, the first grayscale mapping relationship and the second grayscale mapping relationship may be the same. In other examples, the first grayscale mapping relationship and the second grayscale mapping relationship are different.

[0222] Fig.10A display method is exemplarily shown, which can be performed by an image processing device. The method may include the following steps:

[0223] S1001, obtaining binocular images to be processed.

[0224] The binocular images to be processed include a first left-eye image and a first right-eye image.

[0225] S1002, displaying a preset interface on a virtual display.

[0226] S1003: Taking a screenshot of the content displayed on the virtual display.

[0227] S1004: Based on the first grayscale mapping relationship, perform grayscale transformation processing on the image in the medical imaging area in the screenshot to obtain a third image.

[0228] S1005, replacing the content in a three-dimensional content area in the third image with a fourth image to obtain the target left-eye image, wherein the fourth image is determined based on the first left-eye image and a second grayscale mapping relationship, wherein the first grayscale mapping relationship is different from the second grayscale mapping relationship.

[0229] S1006: Replace the content in the three-dimensional content area in one of the third images with a fifth image to obtain the target right-eye image, where the fifth image is determined based on a mapping relationship between the first right-eye image and the second grayscale.

[0230] In a possible implementation, the preset interface may include a medical imaging area. Fig.11 The preset interface includes a medical imaging area and a non-medical imaging area. The medical imaging area is generally used to display medical images. The relevant standards for content display in common medical scenes may include but are not limited to: Digital Imaging and Communications in Medicine (DICOM) standards. The content display effect in medical scenes should comply with relevant standards to meet user viewing needs.

[0231] In step S1004, the image processing device may only perform grayscale conversion processing on the content in the medical image area in the preset interface screenshot, and not perform grayscale conversion processing on the content in the non-medical image area. Fig.11 For example, the preset interface is in color, and after grayscale conversion processing is performed on the content in the medical imaging area in the screenshot of the preset interface, only the grayscale effect in the medical imaging area is different from the grayscale effect in the non-medical imaging area.

[0232] In the present application, the number of the three-dimensional content area can be one or more. The number of the medical imaging area can be one or more.

[0233] In some application scenarios, the first grayscale mapping relationship may be determined based on the DICOM standard. The first grayscale mapping relationship may include a correspondence between a first input grayscale value and an output grayscale value. Optionally, the correspondence between the input grayscale value and the first output grayscale value may be implemented as a continuous curve function, or the correspondence between the input grayscale value and the first output grayscale value may be reflected by a grayscale comparison table pre-stored by the image processing device.

[0234] The second grayscale mapping relationship may be determined based on a GAMMA curve. The second grayscale mapping relationship may include a correspondence between an input grayscale value and a second output grayscale value. Optionally, the correspondence between the input grayscale value and the second output grayscale value may be implemented as a continuous curve function, or the correspondence between the input grayscale value and the second output grayscale value may be reflected by a grayscale comparison table.

[0235] Optionally, the color depth supported by the 3D display device is different, and the grayscale comparison table may be different. The image processing device may pre-store a first grayscale comparison table and a second grayscale comparison table, and the image processing device may select one of the grayscale comparison tables according to the color temperature supported by the 3D display device. The image processing device may obtain the first grayscale mapping relationship and the second grayscale mapping relationship based on the selected grayscale comparison table.

[0236] For example, the 3D display device supports 8-bit color depth, and the input grayscale range is 0 to 255. The first grayscale comparison table can be implemented as shown in Table 1 above.

[0237] For another example, the 3D display device supports 10-bit color depth, and the input grayscale range is 0 to 1023. The second grayscale comparison table can be implemented as the following Table 2.

[0238] Please combine Fig.12 , the image processing device may replace the content in the three-dimensional content area in one of the third images with a fourth image to obtain the target left-eye image, wherein the fourth image is determined based on the left-eye image corresponding to the binocular image to be processed and the second grayscale mapping relationship, wherein the first grayscale mapping relationship is different from the second grayscale mapping relationship. And the image processing device replaces the content in the three-dimensional content area in one of the third images with a fifth image to obtain the target right-eye image, wherein the fifth image is determined based on the right-eye image corresponding to the binocular image to be processed and the second grayscale mapping relationship.

[0239] In the embodiment of the present application, when a user watches the target binocular image displayed by the 3D display device, he can simultaneously watch the 3D effect image, the 2D effect medical image content, and the 2D effect non-medical image content. The 2D effect non-medical image content may include but is not limited to UI designs such as system menus, buttons, and icons.

[0240] Fig.13 A display method is exemplarily shown, which can be performed by an image processing device. The method may include the following steps:

[0241] S1301, obtaining binocular images to be processed.

[0242] The binocular images to be processed include a first left-eye image and a first right-eye image.

[0243] S1302, displaying a preset interface on a virtual display.

[0244] S1303: Take a screenshot of the content displayed on the virtual display.

[0245] S1304: Replace the content in a three-dimensional content area in the screenshot with the first left-eye image to obtain an image to be calibrated.

[0246] S1305: Replace the content in the three-dimensional content area in one of the screenshots with the first right-eye image to obtain another image to be calibrated.

[0247] S1306, performing grayscale calibration processing on each image to be calibrated to obtain the target left-eye image and the target right-eye image.

[0248] In this embodiment, the image processing device may replace the three-dimensional content area of ​​the preset interface screenshot, and then the image processing device performs grayscale calibration processing on the image obtained after the replacement processing.

[0249] In a possible design, the preset interface includes a medical image area, and the medical image area is used to display medical images; in step S1306, the image processing device can perform grayscale transformation processing on the medical image area in each image to be calibrated based on the first grayscale mapping relationship. The image processing device can perform grayscale transformation processing on each image to be calibrated except the medical image area based on the second grayscale mapping relationship.

[0250] In specific implementation, for each image to be calibrated, the image processing device performs different grayscale transformation processing on the content in the medical image area and the content in the non-medical image area. In the embodiment of the present application, the grayscale transformation processing can also be understood as grayscale correction processing, that is, the process of correcting the input grayscale to the desired grayscale.

[0251] The image processing device can perform grayscale transformation processing on the medical image area in each image to be calibrated based on the first grayscale mapping relationship, so that the image in the medical image area can meet the viewing effect required by the medical scene. The image processing device can perform grayscale transformation processing on the non-medical image area in each image to be calibrated based on the second grayscale mapping relationship, so that the image in the non-medical image area can meet the viewing effect required by ordinary scenes. When the user watches the target binocular image displayed by the 3D display device, the user can simultaneously watch the image with 3D effect, the medical image content with 2D effect, and the non-medical image content with 2D effect. The non-medical image content with 2D effect may include but is not limited to UI designs such as system menus, buttons, and icons.

[0252] In one possible design, the preset interface includes a medical image area, and the medical image area is used to display medical images; in step S1306, the image processing device can perform grayscale transformation processing on each image to be calibrated based on the first grayscale mapping relationship to obtain an intermediate calibration image corresponding to each image to be calibrated. The image processing device can perform grayscale transformation processing on the intermediate calibration image corresponding to each image to be calibrated except the medical image area based on the third grayscale mapping relationship.

[0253] In a specific implementation, for each image to be calibrated, the image processing device can perform grayscale transformation processing on the entire image to be calibrated based on the first grayscale mapping relationship to obtain an intermediate calibration image. The entire intermediate calibration image can be a viewing effect that meets the needs of the medical scene. Then the image processing device can perform grayscale transformation processing on the area outside the non-medical image area in the intermediate calibration image corresponding to each image to be calibrated based on the third grayscale mapping relationship, so that the content of the area outside the non-medical image area in the intermediate calibration image can meet the viewing effect required by ordinary scenes. The third grayscale mapping relationship may include the correspondence between the aforementioned first output grayscale value and the aforementioned second output grayscale value. Alternatively, the third grayscale mapping relationship may be determined based on the DICOM standard and the GAMMA curve.

[0254] Based on the display method provided by any one of the aforementioned embodiments, the resolution of the preset interface is determined based on the resolution of the binocular image to be processed.

[0255] In some application scenarios, the format of the binocular image to be processed obtained by the image processing device is SideBySide format. The SideBySide format includes images for displaying left and right perspectives, that is, a left eye image and a right eye image. The display resolution of the image processing device in the virtual display device is the same as the resolution image of the left eye image (or right eye image) in the SideBySide format of the binocular image to be processed. In such a design, the resolution of the target left eye image generated by the image processing device is the same as the resolution of the left eye image of the binocular image to be processed. Also, the resolution of the target right eye image generated by the image processing device is the same as the resolution of the right eye image of the binocular image to be processed. The target binocular image generated by the image processing device can also be in SideBySide format. For example, the image processing device can splice the target left eye image and the target right eye image into SideBySide format. In this way, the resolution of the target binocular image sent by the image processing device to the 3D display device is the same as the resolution of the binocular image to be processed received by the image processing device. Such a design can avoid deformation of three-dimensional content.

[0256] Fig.14 An image processing method is exemplarily shown, which can be performed by an image processing device. The method may include the following steps:

[0257] S1401, obtaining binocular images to be processed.

[0258] The binocular images to be processed include a first left-eye image and a first right-eye image;

[0259] S1402, splicing the first left-eye image and the first right-eye image to obtain a first fused image;

[0260] S1403, setting the content in the three-dimensional content area in the preset interface to the first fused image to obtain a target interface;

[0261] S1404, determining the image of the target interface as a second fused image;

[0262] S1405: Send the second fused image and the information of the three-dimensional content area to a target display device.

[0263] In step S1402, the image processing apparatus may perform resolution adjustment processing on the first left-eye image and the first right-eye image, and then splice the two adjusted images, such as splicing them in a Side-by-Side format to obtain a first fused image.

[0264] In step S1403, the graphics card of the image processing device uses the first fused image as the content in the three-dimensional content area in the preset interface. In other words, the content in the three-dimensional content area in the preset interface is configured as the first fused image to obtain the target interface. In step S1404, the image processing device can obtain the image of the target interface through the graphics card as the second fused image.

[0265] In the embodiment of the present application, the target display device may have the function of synchronously supporting 2D and 3D display. The target display device may include a 3D display sub-screen and a 2D display sub-screen. The 3D display sub-screen may display 3D content, or display 2D content. The 2D display sub-screen may display 2D content.

[0266] In a possible design, the image processing device may perform the following process in the operation of setting the content in the three-dimensional content area in the preset interface as the first fused image to obtain the target interface:

[0267] Determine a first image based on the image of the preset interface and the first grayscale mapping relationship;

[0268] The content in the three-dimensional content area in the first image is replaced by a second image, where the second image is determined based on the first fused image and the second grayscale mapping relationship.

[0269] The image processing device may respectively adopt different grayscale mapping relationships to perform calibration processing on the image of the preset interface and the first fused image, and then replace the image in the three-dimensional content area of ​​the first image with the second image.

[0270] In a possible design, the image processing device may perform the following process in the operation of sending the second fused image and the information of the three-dimensional content area to the target display device:

[0271] The image processing device performs grayscale calibration processing on the second fused image; the image processing device sends the image after the grayscale calibration processing and the information of the three-dimensional content area to the target display device.

[0272] In some examples, the image of the target interface includes a medical image area, and the medical image area is used to display the medical image. In the operation of the image processing device performing grayscale calibration processing on the second fused image, the image processing device can perform the following process:

[0273] Based on the first grayscale mapping relationship, grayscale transformation processing is performed on the medical imaging region in the second fused image; based on the second grayscale mapping relationship, grayscale transformation processing is performed on the second fused image except for the medical imaging region.

[0274] In some examples, the image of the target interface includes a medical image area, and the medical image area is used to display the medical image. In the operation of the image processing device performing grayscale calibration processing on the second fused image, the image processing device can perform the following process:

[0275] Based on the first grayscale mapping relationship, grayscale transformation processing is performed on the second fused image to obtain an intermediate calibration image corresponding to the second fused image;

[0276] Based on the third grayscale mapping relationship, grayscale transformation processing is performed on the area except the medical image area in the intermediate calibration image corresponding to the second fused image.

[0277] In a possible design, the resolution of the target interface is determined based on the resolution of the binocular images to be processed.

[0278] Fig.15 A display method is exemplarily shown, which can be performed by a display device. The method may include the following steps:

[0279] S1501, receiving information of a fused image and a three-dimensional content area.

[0280] S1502: Extract a target image in the three-dimensional content area in the fused image according to the information of the three-dimensional content area.

[0281] S1503: Determine a first left-eye image and a first right-eye image based on the target image.

[0282] S1504: Display the first left-eye image and the first right-eye image in a screen range corresponding to the three-dimensional content area in the display device.

[0283] S1505: Displaying images other than the target image in the fused image in a screen range corresponding to an area other than the three-dimensional content area in the display device.

[0284] For the convenience of distinction, the display device in the embodiment of the present application is recorded as the first display device. In the embodiment of the present application, the first display device may have the function of synchronously supporting 2D and 3D display. The first display device may include a 3D display sub-screen and a 2D display sub-screen. The 3D display sub-screen may display 3D content, or display 2D content. The 2D display sub-screen may display 2D content.

[0285] In some possible implementations, the number of the three-dimensional content area may be one or more.

[0286] The first display device can extract a target image in the three-dimensional content area in the fused image based on the information of the three-dimensional content area. The target image is determined based on the first left-eye image and the first right-eye image. Thus, the first display device can obtain the first left-eye image and the first right-eye image from the target image.

[0287] The screen range corresponding to the three-dimensional content area in the first display device can support 3D display. The screen range can display a first left-eye image and a first right-eye image, so that human eyes can see the content in the screen range with a 3D effect.

[0288] The screen range corresponding to the area other than the three-dimensional content area in the first display device displays the remaining images, that is, the images other than the target image in the fused image, and the human eye sees the content in the screen range as a 2D effect.

[0289] Fig.16 An image processing method is exemplarily shown, which can be performed by an image processing device. The method may include the following steps:

[0290] S1601, obtaining binocular images to be processed.

[0291] The image to be processed includes a first left-eye image and a first right-eye image;

[0292] S1602, generating a target binocular image based on a preset interface, a three-dimensional content area and the binocular image to be processed, wherein the target binocular image includes a target left-eye image and a target right-eye image, wherein the content in the three-dimensional content area of ​​each image in the target binocular image is determined based on the binocular image to be processed, and the images are the same except for the content in the two-dimensional content area;

[0293] S1603: Output the target binocular image to a display device for display.

[0294] In a possible design, in the image processing method provided in the embodiment of the present application, generating a target binocular image based on a preset interface, a three-dimensional content area and the binocular image to be processed includes:

[0295] Displaying the preset interface on a virtual display;

[0296] Determining a plurality of third images based on the content displayed by the virtual display and the first grayscale mapping relationship;

[0297] replacing the content in the three-dimensional content area in one of the third images with a fourth image to obtain the target left-eye image, wherein the fourth image is determined based on a mapping relationship between the first left-eye image and the second grayscale;

[0298] The target right-eye image is obtained by replacing the content in the three-dimensional content area in the third image with a fifth image, where the fifth image is determined based on a mapping relationship between the first right-eye image and the second grayscale.

[0299] In a possible design, in the image processing method provided in the embodiment of the present application, the preset interface includes a medical image area, and the medical image area is used to display the medical image;

[0300] Determining a plurality of third images based on the content displayed by the virtual display and the first grayscale mapping relationship includes:

[0301] Taking a screenshot of the content displayed on the virtual display;

[0302] Based on the first grayscale mapping relationship, grayscale transformation processing is performed on the image in the medical imaging area in the screenshot to obtain the third image, wherein the first grayscale mapping relationship and the second grayscale mapping relationship are different mapping relationships.

[0303] In specific implementation, the image processing method provided in the embodiment of the present application can be applied to medical scenarios. Generally speaking, the display device in the medical scenario needs to meet the medical reading requirements, and usually performs grayscale display according to the medical imaging standards. If the color content is displayed simultaneously, there will be a color difference problem. In this embodiment, the first grayscale mapping relationship is used to perform grayscale correction on the content in the medical imaging area, and the second grayscale mapping relationship is used to perform grayscale correction on the content in the non-medical imaging area, which can avoid color difference in color content.

[0304] In a possible design, generating a target binocular image based on a preset interface, a three-dimensional content area and the binocular image to be processed includes:

[0305] Displaying a preset interface in a virtual display;

[0306] Taking a screenshot of the content displayed on the virtual display;

[0307] Replacing the content in the three-dimensional content area in one of the screenshots with the first left-eye image to obtain an image to be calibrated;

[0308] Replacing the content in the three-dimensional content area in one of the screenshots with the first right-eye image to obtain another image to be calibrated;

[0309] Grayscale calibration is performed on each image to be calibrated to obtain the target left-eye image and the target right-eye image.

[0310] In a possible design, in the image processing method provided in the embodiment of the present application, the preset interface includes a medical image area, and the medical image area is used to display the medical image;

[0311] The grayscale calibration process is performed on each image to be calibrated, including:

[0312] Based on the first grayscale mapping relationship, grayscale transformation processing is performed on the medical image area in each image to be calibrated;

[0313] Based on the second grayscale mapping relationship, grayscale transformation processing is performed on each image to be calibrated except the medical imaging area.

[0314] In specific implementation, the image processing method provided in the embodiment of the present application can be applied to medical scenarios. Generally speaking, the display device in the medical scenario needs to meet the medical reading requirements, and usually performs grayscale display according to the medical imaging standards. If the color content is displayed simultaneously, there will be a color difference problem. In this embodiment, the first grayscale mapping relationship is used to perform grayscale correction on the content in the medical imaging area, and the second grayscale mapping relationship is used to perform grayscale correction on the content in the non-medical imaging area, which can avoid color difference in color content.

[0315] In a possible design, in the image processing method provided in the embodiment of the present application, the preset interface includes a medical image area, and the medical image area is used to display the medical image;

[0316] The grayscale calibration process is performed on each image to be calibrated, including:

[0317] Based on the first grayscale mapping relationship, grayscale transformation processing is performed on each image to be calibrated to obtain an intermediate calibration image corresponding to each image to be calibrated;

[0318] Based on the third grayscale mapping relationship, grayscale transformation processing is performed on the area other than the medical image area in the intermediate calibration image corresponding to each image to be calibrated.

[0319] In specific implementation, the image processing method provided in the embodiment of the present application can be applied to medical scenarios. Generally speaking, the display device in the medical scenario needs to meet the medical reading requirements, and usually performs grayscale display according to the medical imaging standards. If the color content is displayed simultaneously, there will be a color difference problem. In this embodiment, the first grayscale mapping relationship is used to perform grayscale correction on the content in the medical imaging area, and the second grayscale mapping relationship is used to perform grayscale correction on the content in the non-medical imaging area, which can avoid color difference in color content.

[0320] In a possible design, in the image processing method provided in an embodiment of the present application, the resolution of the preset interface is determined based on the resolution of the binocular image to be processed.

[0321] In a possible design, in the image processing method provided in the embodiment of the present application, generating a target left-eye image and a target right-eye image based on a preset interface, position information of a three-dimensional content area and the binocular image to be processed includes:

[0322] Displaying a preset interface in a virtual display;

[0323] Determining a plurality of third images based on the content displayed by the virtual display;

[0324] replacing the content in the three-dimensional content area in one of the third images with the first left-eye image to obtain the target left-eye image;

[0325] The content in the three-dimensional content area in one of the third images is replaced with the first right-eye image to obtain the target right-eye image.

[0326] Based on the same concept, Fig.17 This is a schematic diagram of the structure of an electronic device 1800 provided in an embodiment of the present application. The electronic device can be implemented as an image processing device.

[0327] The electronic device 1800 may be the electronic device mentioned above. Alternatively, the electronic device 1800 may implement the display method provided by any one of the above embodiments. Fig.17 As shown, the electronic device 1800 may include: one or more processors 1801; one or more memories 1802; a communication interface 1803, and one or more computer programs 1804, and the above-mentioned components may be connected via one or more communication buses 1805. The one or more computer programs 1804 are stored in the above-mentioned memory 1802 and are configured to be executed by the one or more processors 1801, and the one or more computer programs 1804 include instructions. The communication interface 1803 is used to realize the communication between the electronic device and other devices, for example, the communication interface may be a transceiver.

[0328] An embodiment of the present application provides a display device, which may include a memory and a processor; the memory stores computer program instructions; the processor executes the computer program instructions to perform the steps performed by the display device in the display method in the aforementioned embodiment.

[0329] In the embodiments provided by the present application, the method provided by the embodiments of the present application is introduced from the perspective of the device as the execution subject. In order to implement the functions in the methods provided by the embodiments of the present application, the device may include a hardware structure and / or a software module, and implement the above functions in the form of a hardware structure, a software module, or a hardware structure plus a software module. Whether a function of the above functions is executed in the form of a hardware structure, a software module, or a hardware structure plus a software module depends on the specific application and design constraints of the technical solution.

[0330] In addition, an embodiment of the present application provides a computer-readable storage medium, which is used to store a computer program. When the computer program runs on a computer, the computer executes the steps in any one of the above-mentioned display methods or the steps in the above-mentioned display method.

[0331] As used in the above embodiments, the term "when..." or "after..." may be interpreted to mean "if..." or "after..." or "in response to determining..." or "in response to detecting...", depending on the context. Similarly, the phrase "when determining..." or "if (the stated condition or event) is detected" may be interpreted to mean "if determining..." or "in response to determining..." or "when (the stated condition or event) is detected" or "in response to detecting (the stated condition or event)", depending on the context. In addition, in the above embodiments, relational terms such as first and second are used to distinguish one entity from another, without limiting any actual relationship and order between the entities.

[0332] References to "one embodiment" or "some embodiments" etc. described in this specification mean that a particular feature, structure or characteristic described in conjunction with the embodiment is included in one or more embodiments of the present application. Thus, the phrases "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear at different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0333] In the above embodiments, all or part of the embodiments may be implemented by software, hardware, firmware or any combination thereof. When implemented by software, all or part of the embodiments may be implemented in the form of a computer program product.

[0334] The present application embodiment also provides a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present invention is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from a website site, a computer, a server, or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server, or data center. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or a data center that includes one or more available media integrations. The available medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk (SSD)), etc. In the absence of conflict, the schemes of the above embodiments may be used in combination.

[0335] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0336] These computer program instructions may also be stored in a computer readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0337] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0338] Although the preferred embodiments of the present invention have been described, those skilled in the art may make other changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the present invention.

[0339] Obviously, those skilled in the art can make various changes and modifications to the embodiments of the present invention without departing from the spirit and scope of the embodiments of the present invention. Thus, if these modifications and variations of the embodiments of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims

1. A display method, characterized in that: The method comprises: The image acquisition device acquires binocular images to be processed, wherein the images to be processed include a first left-eye image and a first right-eye image; The image processing device splices the first left-eye image and the first right-eye image to obtain a first fused image; sets the content in the three-dimensional content area in the preset interface to the first fused image to obtain a target interface; determines the image of the target interface as a second fused image; and sends the second fused image and information of the three-dimensional content area to a display device.

2. The method according to claim 1, characterized in that The method further comprises: The display device extracts a target image in the three-dimensional content area in the second fused image according to information of the three-dimensional content area; and determines the first left-eye image and the first right-eye image based on the target image; The screen range corresponding to the three-dimensional content area in the display device displays the first left-eye image and the first right-eye image; The screen range corresponding to the area other than the three-dimensional content area in the display device displays images other than the target image in the fused image.

3. The method according to claim 1, characterized in that The image processing device replaces the content in the three-dimensional content area of ​​the preset interface with the first fused image to obtain a second fused image, including: The image processing device determines a first image based on the image of the preset interface and a first grayscale mapping relationship; The image processing device replaces the content in the three-dimensional content area in the first image with a second image, where the second image is determined based on the first fused image and the second grayscale mapping relationship.

4. The method according to claim 1, characterized in that The image processing device sends the second fused image and the information of the three-dimensional content area to the display device, further comprising: Grayscale calibration is performed on the second fused image; and the second fused image after the grayscale calibration and information on the three-dimensional content area are sent to a display device.

5. The method according to claim 4, characterized in that The image of the target interface includes a medical imaging area, and the medical imaging area is used to display medical images; The image processing device performs grayscale calibration processing on the second fused image, including: The image processing device performs grayscale transformation processing on the medical image area in the second fused image based on the first grayscale mapping relationship; and performs grayscale transformation processing on the area other than the medical image area in the second fused image based on the second grayscale mapping relationship.

6. The method according to claim 4, characterized in that The image of the target interface includes a medical imaging area, and the medical imaging area is used to display medical images; The image processing device performs grayscale calibration processing on the second fused image, including: The image processing device performs grayscale transformation processing on the second fused image based on the first grayscale mapping relationship to obtain an intermediate calibration image corresponding to the second fused image; The image processing device performs grayscale transformation processing on the area other than the medical image area in the intermediate calibration image corresponding to the second fused image based on the third grayscale mapping relationship.

7. A display method, characterized in that: The method comprises: The image acquisition device acquires binocular images to be processed, wherein the images to be processed include a first left-eye image and a first right-eye image; An image processing device generates a target binocular image based on a preset interface, a three-dimensional content area and the binocular image to be processed, wherein the target binocular image includes a target left-eye image and a target right-eye image, wherein the content in the three-dimensional content area of ​​each image in the target binocular image is determined based on the binocular image to be processed, and the images are the same except for the content in the two-dimensional content area; and outputs the target binocular image to a display device for display.

8. The method according to claim 7, characterized in that The image processing device generates a target binocular image based on a preset interface, a three-dimensional content area and the binocular image to be processed, comprising: The image processing device displays the preset interface in a virtual display; The image processing device determines a plurality of third images based on the content displayed by the virtual display and the first grayscale mapping relationship; The image processing device replaces the content in the three-dimensional content area in one of the third images with a fourth image to obtain the target left-eye image, wherein the fourth image is determined based on a mapping relationship between the first left-eye image and the second grayscale; The image processing device replaces the content in the three-dimensional content area in one of the third images with a fifth image to obtain the target right-eye image, where the fifth image is determined based on a mapping relationship between the first right-eye image and the second grayscale.

9. The method according to claim 8, characterized in that The preset interface includes a medical image area, and the medical image area is used to display medical images; The image processing device determines a plurality of third images based on the content displayed by the virtual display and the first grayscale mapping relationship, including: The image processing device takes a screenshot of the content displayed by the virtual display; The image processing device performs grayscale transformation processing on the image in the medical imaging area in the screenshot based on the first grayscale mapping relationship to obtain the third image, wherein the first grayscale mapping relationship and the second grayscale mapping relationship are different mapping relationships.

10. The method according to claim 7, characterized in that The image processing device generates a target binocular image based on a preset interface, a three-dimensional content area and the binocular image to be processed, including: The image processing device displays a preset interface in a virtual display; The image processing device takes a screenshot of the content displayed by the virtual display; The image processing device replaces the content in the three-dimensional content area in one of the screenshots with the first left-eye image to obtain an image to be calibrated; The image processing device replaces the content in the three-dimensional content area in one of the screenshots with the first right-eye image to obtain another image to be calibrated; The image processing device performs grayscale calibration processing on each image to be calibrated to obtain the target left-eye image and the target right-eye image.

11. The method according to claim 10, characterized in that The preset interface includes a medical image area, and the medical image area is used to display medical images; The image processing device performs grayscale calibration processing on each image to be calibrated, including: The image processing device performs grayscale transformation processing on the medical image area in each image to be calibrated based on the first grayscale mapping relationship; The image processing device performs grayscale transformation processing on each image to be calibrated except the medical imaging area based on the second grayscale mapping relationship.

12. The method according to claim 10, characterized in that The preset interface includes a medical image area, and the medical image area is used to display medical images; The image processing device performs grayscale calibration processing on each image to be calibrated, including: The image processing device performs grayscale transformation processing on each image to be calibrated based on the first grayscale mapping relationship to obtain an intermediate calibration image corresponding to each image to be calibrated; The image processing device performs grayscale transformation processing on the area other than the medical image area in the intermediate calibration image corresponding to each image to be calibrated based on the third grayscale mapping relationship.

13. The method according to claim 7, characterized in that The image processing device generates a target left-eye image and a target right-eye image based on a preset interface, position information of a three-dimensional content area and the binocular image to be processed, including: The image processing device displays a preset interface in a virtual display; The image processing device determines a plurality of third images based on the content displayed by the virtual display; The image processing device replaces the content in the three-dimensional content area in one of the third images with the first left-eye image to obtain the target left-eye image; The image processing device replaces the content in the three-dimensional content area in one of the third images with the first right-eye image to obtain the target right-eye image.

14. An image processing method, characterized in that: The method comprises: Acquire an image to be processed, where the image to be processed includes a first left-eye image and a first right-eye image; splicing the first left-eye image and the first right-eye image to obtain a first fused image; Setting the content in the three-dimensional content area in the preset interface as the first fused image to obtain a target interface; Determining the image of the target interface as a second fused image; The second fused image and information about the three-dimensional content area are sent to a target display device.

15. A display method, characterized in that: The method comprises: receiving the fused image and information of the three-dimensional content area; extracting a target image within the three-dimensional content area in the fused image according to the information of the three-dimensional content area; Based on the target image, determining a first left-eye image and a first right-eye image; The screen range corresponding to the three-dimensional content area in the display device displays the first left-eye image and the first right-eye image; The screen range corresponding to the area other than the three-dimensional content area in the display device displays images other than the target image in the fused image.

16. An image processing method, characterized in that: The method comprises: Acquire binocular images to be processed, where the images to be processed include a first left-eye image and a first right-eye image; Based on the preset interface, the three-dimensional content area and the binocular image to be processed, a target binocular image is generated, wherein the target binocular image includes a target left-eye image and a target right-eye image, wherein the content in the three-dimensional content area of ​​each image in the target binocular image is determined based on the binocular image to be processed, and the images are the same except for the content in the two-dimensional content area; The target binocular image is output to a display device for display.

17. An image processing device, characterized in that: include: Memory and processor; The memory stores computer program instructions; The processor executes the computer program instructions to perform the steps in the method of claim 14 or 16.

18. A display device, characterized in that: including memory and processor; The memory stores computer program instructions; The processor executes the computer program instructions to perform the steps in the display method of claim 15 .

19. A computer-readable storage medium, characterized in that: The computer-readable storage medium is used to store a computer program, and when the computer program is run on a computer, the computer is caused to execute the steps in the method according to claim 14 or 16.

Images