Display device, image display method, storage medium, and program product

Abstract

The application provides a display device, an image display method, a storage medium and a program product. After the display device acquires a target image displayed by a display apparatus of an electronic device, the display device determines second display content according to first display content to be displayed and the target image, and provides the second display content to the display apparatus of the display device. The display device provided by the application can avoid dependence on a rendering device in the process of displaying display content including the target image displayed by the display apparatus of the electronic device, and improves the real-time performance of the display device in displaying images.

Description

Technical Field

[0001] This application relates to the field of display technology, and in particular to a display device, an image display method, a storage medium, and a program product. Background Technology

[0002] Extended Reality (XR) display devices include Virtual Reality (VR) devices, Augmented Reality (AR) devices, and Mixed Reality (MR) devices. When the display content provided by the display device includes the target image displayed by the electronic device's display, the user can view not only virtual scenes and real scenes, but also the target image displayed by the electronic device in a virtual manner, thus providing a richer visual experience and more usage scenarios.

[0003] However, when the content to be displayed by the display device includes the target image displayed by the display device of the electronic device, each frame of the display content needs to be rendered by rendering devices such as computers and application processors before being displayed by the display device, resulting in poor real-time performance of the content displayed by the display device. Summary of the Invention

[0004] This application provides a display device, an image display method, a storage medium, and a program product to avoid the display device's dependence on a rendering device, thereby improving the real-time performance of the content displayed by the display device.

[0005] A first aspect of this application provides an image display method for a display device, comprising: acquiring a target image displayed by a display device of an electronic device; determining second display content based on a first display content to be displayed and the target image, wherein the second display content includes the target image displayed at a preset position; and providing the second display content to the display device.

[0006] A second aspect of this application provides an XR device, comprising: a processing system and a display device, the processing system being connected to the display device, the processing system being configured to: acquire a target image displayed by the display device of an electronic device; determine second display content based on first display content to be displayed and the target image, the second display content including the target image displayed at a preset position; and provide the second display content to the display device of the display device.

[0007] A third aspect of this application provides a display device, comprising: a memory and a processor; the memory storing computer-executable instructions; the processor executing the computer-executable instructions stored in the memory, causing the processor to perform the method as described in the first aspect of this application.

[0008] A fourth aspect of this application provides a computer-readable storage medium storing computer-executable instructions that, when executed, implement the method described in the first aspect of this application.

[0009] The fifth aspect of this application provides a computer program product, including a computer program that, when executed, implements the method described in the first aspect of this application.

[0010] The display device, image display method, storage medium, and program product provided in this application allow the display device to obtain a target image displayed by the display device of an electronic device, determine a second display content based on the first display content to be displayed and the target image, and provide the second display content to the display device. The display device provided in this application can avoid dependence on the rendering device in the process of displaying the display content of the target image displayed by the display device of the electronic device, thereby improving the real-time performance of the display device displaying the image. Attached Figure Description

[0011] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0012] Figure 1 This is a schematic diagram illustrating an application scenario of an embodiment of this application;

[0013] Figure 2 A schematic diagram of a display device that displays an image of an electronic device.

[0014] Figure 3 A schematic diagram of the structure of an embodiment of the display device provided in this application;

[0015] Figure 4 A flowchart illustrating an embodiment of the image display method for the display device provided in this application;

[0016] Figure 5 A schematic diagram of the structure of an embodiment of the display device provided in this application;

[0017] Figure 6 A schematic diagram of the structure of a display processing unit provided in this application;

[0018] Figure 7 This is a schematic diagram illustrating the processing of the target image provided in this application;

[0019] Figure 8 A schematic diagram illustrating a process for setting a transparent display area around the outside of a target image, as provided in this application;

[0020] Figure 9 Another schematic diagram illustrating the process of setting a transparent display area around the outside of the target image provided in this application;

[0021] Figure 10 This application provides a schematic diagram illustrating the offset processing of pixels within the display area of ​​the second process;

[0022] Figure 11 A schematic diagram of an embodiment of the pixel offset rule provided in this application;

[0023] Figure 12 A schematic diagram of another embodiment of the pixel offset rule provided in this application;

[0024] Figure 13 A schematic diagram illustrating the addition of a target image to first display content, as provided in this application;

[0025] Figure 14 A schematic diagram illustrating the addition of a target image to first display content, as provided in this application;

[0026] Figure 15 A schematic diagram illustrating the display effect of the display device provided in this application;

[0027] Figure 16 A schematic diagram of another embodiment of the display device provided in this application;

[0028] Figure 17 A flowchart illustrating a method for adjusting the depth of a target image using a display device, as provided in this application;

[0029] Figure 18 A schematic diagram illustrating the adjustment of the viewing angle of a target image by a display device provided in this application;

[0030] Figure 19 A flowchart illustrating a method for adjusting the pose of a target image using a display device, as provided in this application;

[0031] Figure 20 A schematic diagram illustrating the adjustment of the pose of a target image by a display device provided in this application;

[0032] Figure 21 A flowchart illustrating a method for adjusting the position of a target image using a display device, as provided in this application;

[0033] Figure 22 A flowchart illustrating another method for adjusting the position of a target image using a display device provided in this application;

[0034] Figure 23 This is a schematic diagram of another embodiment of the display device provided in this application. Detailed Implementation

[0035] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0036] The terms “first,” “second,” “third,” “fourth,” etc. (if present) in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a particular order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented, for example, in orders other than those illustrated or described herein. Furthermore, the terms “comprising” and “having,” and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0037] Figure 1 This is a schematic diagram illustrating an application scenario of an embodiment of this application, such as... Figure 1 As shown, the display device 10 provided in this application can be used to display extended reality content and present it to the user. The display device 10 can be a VR device, an AR device, or a MR device, etc. When the user views the content displayed on the display device 10, they can feel that the displayed content is integrated into the user's environment, thus the display device 10 has a more immersive and realistic viewing experience.

[0038] like Figure 1The display device 10 shown can be connected to a rendering device 20 via a network. The rendering device 20 can be a computer, server, workstation, or application processor (AP), etc., and the network can be a wired network or a wireless network. The rendering device 20 can render and process the content to be displayed on the display device 10, and then send the content to the display device 10. The display device 10 then receives the content and displays it through a display device.

[0039] exist Figure 1 In the application scenario shown, the display device 10 can also display images displayed by the display device of the electronic device 30, specifically the display interface of the display device. The electronic device 30 can be a mobile phone, tablet computer, laptop computer, or other device with a display device that can display images.

[0040] For example, Figure 2 A schematic diagram of a display device that displays an image of an electronic device. For example... Figure 2 As shown, when displaying content, the display device 10 relies on the rendering device 20 to determine the second display content 100 to be actually displayed by the display device 10 based on the first display content 200 to be displayed and the target image 300 displayed by the display device of the electronic device 30.

[0041] More specifically, when the display device 10 is an MR device, the MR device can acquire an image from the real world as the first display content and send it to the rendering device 20, or the rendering device 20 can generate the first display content 200, and then the rendering device 20 can fuse the first display content with the target image 300 to obtain the second display content 100, which is then sent to the MR device for display.

[0042] When the display device 10 is an AR device, the first display content is a scene in the real world. The rendering device 20 determines to display the target image 300 in the scene in the real world and uses the target image 300 in the scene in the real world as the second display content 100, and then sends it to the AR device for display.

[0043] When the display device 10 is a VR device, the rendering device 20 generates virtual first display content 200, and then merges the first display content with the target image 300 to obtain second display content 100, which is then sent to the VR device for display.

[0044] However, in the above-mentioned Figure 2In the process of determining the second display content 100, the processing of the display content relies entirely on the rendering device 20. Since the rendering processing of the display content by the rendering device 20 is computationally complex, it increases the rendering power consumption required by the rendering device 20. Furthermore, when the rendering device 20 subsequently sends the second display content 100 to the display device 10, it increases the amount of data transmitted between the display device 10 and the rendering device 20, introducing a certain delay to the display device 10 in displaying the second display content 100 and reducing the real-time performance of the display device 10 in displaying the second display content 100.

[0045] Furthermore, in the specific implementation process, some display devices 10 need to be used in conjunction with the matching rendering device 20 to obtain the second display content 100 to be displayed. If any of the electronic devices 30, rendering device 20 and display devices 10 are not used together, the display device 10 will be unable to display the image displayed by the display device of the electronic device 30, thereby limiting the display device 10 from realizing the relevant display functions, and thus affecting the user experience of the display device 10 and the electronic device 30.

[0046] Based on this, this application provides an image display method for a display device 10 to avoid the display device 10's dependence on the rendering device 20 when displaying content, thereby improving the real-time performance and flexibility of the display device 10 in displaying the second display content 100. The technical solution of this application will be described in detail below with specific embodiments. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments.

[0047] Figure 3 A schematic diagram of the structure of an embodiment of the display device provided in this application is shown below. Figure 3 The display device 10 shown can be applied to Figure 1 In the scenario shown. For example... Figure 3 The display device 10 shown includes: a processing system 101, a first screen 102, and a second screen 103.

[0048] The display device 10 provided in this application embodiment is a single unit, with the processing system 101, the first screen 102, and the second screen 103 all disposed within the internal space of the display device 10. The processing system 101 is connected to the first screen 102 and the second screen 103, respectively. The first screen 102 and the second screen 103 correspond to two viewing angles of the human eye, and are used to display the same image from two different perspectives at the same time, so that when the human eye views the images from the two perspectives, a stereoscopic visual effect is produced. XR device display may include one or more processing systems. This application embodiment describes the processing system 101 used for image processing, and does not limit other processing systems, processing units, processing modules, etc., included in the display device 10, or the control performed by other processing systems.

[0049] Figure 4 A schematic flowchart of an embodiment of the image display method of the display device provided in this application is shown below. Figure 4 The method shown can be derived from Figure 3 The processing system 101 in the display device 10 shown executes the process. Specifically, as... Figure 4 The image display methods shown specifically include:

[0050] S101: The processing system 101 acquires the target image G displayed on the display device of the electronic device 30. The processing system 101 may receive the target image G sent by the electronic device 30 based on the connection relationship between the display device 10 and the electronic device 30. In one embodiment, the target image G may be the current display interface of the electronic device 30.

[0051] S102: The processing system 101 obtains the second display content actually displayed by the display device 10 based on the first display content to be displayed by the display device 10 and the target image G obtained in S101. The second display content includes the target image G displayed at a preset position.

[0052] In one embodiment, the processing system 101 further acquires a first display content P to be displayed, wherein when the display device 10 is an AR device, the first display content P can be a real environment scene; when the display device 10 is an MR device, the first display content P can be an image of the real environment captured by an imaging device such as a camera or video camera; when the display device is a VR device, the first display content P can be a virtual image rendered by the processing system 101 or other processors.

[0053] In one specific implementation, the processing system 101 determines a first target image G1 and a second target image G2 corresponding to two viewing angles of the human eye, respectively, based on the target image G. Subsequently, the processing system 101 obtains a second display content P1 that can be displayed by the display device 10 from the first viewing angle, based on the first display content P and the first target image G1. And, the processing system 101 obtains a second display content P2 that can be displayed by the display device 10 from the second viewing angle, based on the first display content P and the second target image G2.

[0054] S105: The processing system 101 provides the second display content to the display device of the display device 10, so that the display device displays the second display content.

[0055] In one embodiment, the display device includes a first screen 102 and a second screen 103. The processing system 101 sends second display content P1, displayed from a first perspective, to the first screen 102, and sends second display content P2, displayed from a second perspective, to the second screen 103. Subsequently, at the same time, the first screen 102 displays the second display content P1 from the first perspective, and the second screen 103 displays the second display content P2 from the second perspective. For the user of the display device 10, two second display contents from different perspectives can be viewed simultaneously on the two screens. Since the second display contents include a target image, the user can see the target image displayed by the display device of the electronic device 30 through the second display contents, thereby facilitating subsequent processing of the electronic device 30 based on the display device 10.

[0056] It is understandable that the processing system 101 of the display device 10, following the above process, treats each frame of the image to be displayed as the display content, processes it in conjunction with the target image of the electronic device 30, and displays a series of multiple frames of images sequentially through the first screen 102 and the second screen 103. For the user of the display device 10, what is perceived visually is a video-formatted and dynamically changing display content.

[0057] In summary, the image display method executed by the display device 10 and processing system 101 provided in this embodiment, based on the processing capability of the control system 101 of the display device 10 itself, determines the second display content according to the first display content to be displayed and the target image, and directly provides the second display content to the display device for display. This not only avoids the display device 10's dependence on the rendering device 20 during the display process, improving the real-time performance of the displayed image, but also enables the display device 10 to have stronger scalability and usability. Even if the electronic device 30, the rendering device 20 and the display device 10 are not paired devices, the display device 10 can still support including more target images of the electronic device 30 in the display content, thereby improving the user experience of the display device 10 and the electronic device 30.

[0058] Figure 5 A schematic diagram of the structure of an embodiment of the display device provided in this application is shown below. Figure 5 The display device 10 shown is in Figure 3 Based on the above, the processing system 101 specifically includes: an interface processing unit 1011, a first display processing unit 1012, and a second display processing unit 1013.

[0059] The interface processing unit 1011 includes a first input interface a and at least one second input interface b. The first input interface a is used to connect to the electronic device 30, and the at least one second input interface b is used to connect to the rendering device 20. Figure 5 In the example shown, the interface processing unit 1011 includes a second input interface b.

[0060] In one embodiment, if the first input interface a can be connected to the electronic device 30 via a universal video interface protocol, then the first input interface a is configured to support the universal video interface protocol.

[0061] The interface processing unit 1011 also includes a first output interface c and a second output interface d. The first output interface c is used to connect to the first display processing unit 1012, and the first display processing unit 1012 is also connected to the first screen 102. The second output interface d is used to connect to the second display processing unit 1013, and the second display processing unit 1013 is also connected to the second screen 103.

[0062] Then as Figure 5 The display device 10 shown includes at least the following two operating states:

[0063] In the first operating state: the interface processing unit 1011 is configured to acquire the target image G displayed by the display device of the electronic device 30 through the first input interface a, and send the target image G to the first display processing unit 1012 through the first output interface c and to the second display processing unit 1013 through the second output interface d. The first display processing unit 1012 is configured to determine the second display content P1 corresponding to the first viewing angle based on the target image G and the first display content P, and send the second display content P1 to the first screen 102. The second display processing unit 1013 is configured to determine the second display content P2 corresponding to the second viewing angle based on the target image G and the first display content P, and send the second display content P2 to the second screen 103.

[0064] In the second operating state: the interface processing unit 1011 is configured to acquire image data D to be displayed by the display device 10 through the second input interface b. The interface processing unit 1011 divides the image data D into first image data D1 and second image data D2, and sends the first image data D1 to the first display processing unit 1012 and the second image data D2 to the second display processing unit 1013. The first display processing unit 1012 is configured to process the first image data D1 to obtain the second display content P1 corresponding to the first viewpoint, and send the second display content P1 to the first screen 102. The second display processing unit 1013 is configured to process the second image data D2 to obtain the second display content P2 corresponding to the second viewpoint, and send the second display content P2 to the second screen 103.

[0065] In one embodiment, when the first input interface a of the interface processing unit 1011 is connected to the electronic device 30 and the second input interface device b is not connected to the rendering device 20, the display device 10 is in the first working state described above; when the second input interface device b of the interface processing unit 1011 is connected to the rendering device 20 and the first input interface a is not connected to the electronic device 30, the display device 10 is in the second working state described above. When the first input interface a of the interface processing unit 1011 is connected to the electronic device 30 and the second input interface device b is connected to the rendering device 20, the interface processing unit 1011 can switch the working state of the display device 10 according to different triggering methods.

[0066] In one embodiment, after the interface processing unit 1011 establishes a connection with the electronic device 30 through the first input interface a, the interface processing unit 1011 can switch to receiving the target image G through the first input interface a, so that the display device 10 is in the first working state.

[0067] In another embodiment, the interface processing unit 1011 may receive a display switching instruction sent by the rendering device 20, and determine, according to the display switching instruction, to receive the target image G through the first input interface a, so that the XR device 10 is in a first working state; or, according to the display switching instruction, determine to receive image data D through the second input interface b, so that the XR device 10 is in a second working state.

[0068] Combination Figure 4 In the method shown, in S101, the display device 10 can acquire the target image G displayed by the display device of the electronic device 30 in response to the communication connection established between the display device 10 and the electronic device 30.

[0069] For example, in one embodiment, the display device 10, in response to establishing a communication connection with the electronic device 30, acquires at least a portion of the target image G through the communication connection with the electronic device 30. In another embodiment, the display device 10, in response to a display switching command, acquires at least a portion of the target image G through the communication connection with the electronic device 30. Specifically, when the display device 10 displays the entire target image G on the display device, it acquires the entire target image G through the communication connection with the electronic device 30, thereby displaying the entire target image G; when the display device 10 displays only a portion of the target image G on the display device, it acquires a portion of the target image G through the communication connection with the electronic device 30, thereby displaying the portion of the target image G.

[0070] In one embodiment, the interface processing unit 101 can also communicate with the electronic device 30 through the first input interface a, and this communication can take the form of handshake communication, etc. In S101, when the display device 10 acquires the target image G displayed on the display device of the electronic device 30, the interface processing unit 101 of the display device 10 can first determine with the electronic device 30 the transmission parameters and other information for transmitting the target image G. The transmission parameters include the resolution of the image data and the frame rate of transmission. For example, if the interface processing unit 101 and the electronic device 30 determine that the resolution of the target image G transmitted between them is w1*h1, then the resolution of all subsequent target images G sent by the electronic device 30 will be w1*h1. Subsequently, the electronic device 30 sends the target image G to the display device 10 according to the transmission parameters, and correspondingly, the interface processing unit 101 of the display device 10 receives the target image G sent by the electronic device 30 according to the same transmission parameters.

[0071] In summary, the display device 10 provided in this embodiment provides at least two input interfaces through the interface processing unit 1011, particularly a first input interface a connected to the electronic device 30. This allows the display device 10 to directly receive the target image G sent by the electronic device 30 and perform subsequent processing. Since the first input interface a supports the universal video interface protocol, other electronic devices 30 that also support the universal video interface protocol can send the target image G to the display device 10 for display, thereby increasing the expandability and usability of the display device 10. Even if the electronic device 30 and the display device 10 are not paired devices, the interface processing unit of the display device 10 can still receive the actual display interface of the electronic device 30. Furthermore, the interface processing unit 1011 provided in this embodiment can also provide multiple more flexible input interface switching methods, allowing the interface processing unit 1011 to receive data through different input interfaces, thus enabling the display device 10 to operate in different states. This improves the intelligence of the display device 10's applications and ultimately enhances the user experience of the display device 10.

[0072] Figure 6 This is a schematic diagram of the structure of a display processing unit provided in this application. Figure 6 The display processing unit shown can be as follows: Figure 5 The first display processing unit 1012 or the second display processing unit 1013 shown can both use the following structure: Figure 6 The implementation method shown. For example... Figure 6 The embodiment shown uses a display processing unit as an example. Figure 5 The first display processing unit 1012 shown is used as an example for explanation.

[0073] Specifically, such as Figure 6 The first display processing unit 1012 shown includes: a storage unit, firmware, a data access unit, an image processing unit, an optical compensation unit, and a screen compensation unit. The storage unit stores parameters required by other units when processing image data. The firmware calculates and configures these parameters and facilitates communication with other display processing units. The data access unit acquires a target image G, processes it, and sends the processed target image G01 to the image processing unit. The image processing unit acquires a first display content P to be displayed and processes it based on the first display content P and the processed target image G01 to obtain an initial second display content P01. Subsequently, the optical compensation unit processes the initial second display content P01 to obtain an intermediate second display content P02 and sends it to the screen compensation unit. Finally, the screen compensation unit processes the intermediate second display content P02 to obtain the second display content P as the output of the display processing unit. Figure 6 The display processing unit shown is as follows Figure 5 When the first display processing unit 1012 is shown, the screen compensation unit finally outputs the second display content P1 corresponding to the first viewpoint, and when... Figure 6 The display processing unit shown is as follows Figure 5 When the second display processing unit 1013 is used, the screen compensation unit finally outputs the second display content P2 corresponding to the second viewpoint.

[0074] The compensation processing performed on the optical compensation unit and the screen compensation unit in this application embodiment is not limited. It can refer to the optical compensation and screen compensation technologies in the prior art and be adjusted based on different display content and screen.

[0075] The following description, with reference to the accompanying drawings, illustrates the processing by which the first display processing unit 1012 and the second display processing unit 1013 in the processing unit 101 provided in this application obtain the second display content based on the first display content and the target image. These processes can be performed by the display processing unit, or specifically by the data access unit or the image processing unit within the display processing unit.

[0076] In one embodiment, such as Figure 5 After receiving the target image G, the first display processing unit 1012 and the second display processing unit 1012 respectively process the target image G and determine the second display content based on the target image and the first display content.

[0077] In one embodiment, taking the first display processing unit 1012 as an example, after receiving the target image G, the first display processing unit 1012 first processes the target image G to obtain the processed target image G. The processing of the target image G includes pixel filling and / or pixel offset processing. Subsequently, the first display processing unit 1012 adds its processed target image G to a preset position of the first display content to obtain the second display content.

[0078] In one embodiment, combined with Figure 6The pixel filling process for the target image G described above can be specifically performed by the data access unit of the first display processing unit 1012. Specifically, the data access unit of the first display processing unit 1012 can set the color values ​​of at least three channels of all pixels to first preset values ​​within a filled display area surrounding the first process display area corresponding to the target image G, thereby obtaining a second process display area corresponding to the target image G, and then send it to the image processing unit of the first display processing unit 1012 for subsequent processing. Correspondingly, the data access unit of the second display processing unit 1013 can specifically set the color values ​​of at least three channels of all pixels to first preset values ​​within a filled display area surrounding the first process display area corresponding to the target image G, thereby obtaining a second process display area corresponding to the target image G, and then send it to the image processing unit of the second display processing unit 1013 for subsequent processing.

[0079] Specifically, Figure 7 This is a schematic diagram illustrating the processing of the target image provided in this application, such as... Figure 7 As shown, combined with Figure 6 The structure of the display processing unit shown is as follows: When the data access unit of the first display processing unit 1012 receives the target image G, the resolution of the first process display area corresponding to the target image G is w1*h1. Then, the data access unit, using the width dt1 in the horizontal direction and the width dt2 in the vertical direction as a reference, sets a filling display area around the first process display area of ​​the target image G, and sets the color values ​​of at least three channels of all pixels in the filling area to a first preset value, thereby obtaining the processed second process display area of ​​the target image G, and the resolution of the second process display area G00 reaches w2*h2. The second process display area G00 includes the first process display area of ​​the target image G and the transparent display area surrounding it.

[0080] In one embodiment, at least three channels include either a CYMK channel or an RGBA channel. The YCbCr model is a color model used for digital video and image compression, where Y represents the luminance component, and Cb and Cr represent the blue and red chrominance components, respectively, and is used in JPEG image compression and MPEG video compression.

[0081] For example, Figure 8This application provides a flowchart illustrating a process for setting a transparent display area surrounding a target image. The process involves processing the color values ​​of pixels in the target image G as RGBA four-channel data, meaning the pixels in the target image G include a transparency value (A). The transparency value of pixels outside the first process display area is set to a first preset value, resulting in a second process display area G00. Specifically, after starting processing of the target image G, the data access unit sequentially processes each pixel in the target image G, judging the region of each pixel. When a pixel is determined to be a valid pixel within the first process display area, its data is read as the pixel of the second process display area in the processed image. When a pixel is determined not to be a valid pixel within the first process display area, its transparency value (Alpha channel) is set to the first preset value, making this area transparent without affecting the color display effect of pixels within the first process display area. This embodiment does not limit the specific setting of the first preset value; for example, the first preset value can also be any value between 0 and 255 in 8 bits.

[0082] For example, Figure 9 This application provides another flowchart illustrating the process of setting a transparent display area surrounding the target image. In this case, the color values ​​of the pixels in the target image G are RGB three-channel data, meaning the pixels in the target image G do not include the transparency value A. The color values ​​of pixels within the first process display area of ​​the target image G can be supplemented with the transparency value A, and the transparency value A can be set to a third preset value, making this area opaque. Similarly, pixels outside the first process display area of ​​the target image G can be supplemented with the transparency value data, and the transparency value can be set to a second preset value, making this area transparent without affecting the color display effect of the pixels within the first process display area. Specifically, after starting the processing of the target image G, the data access unit can sequentially process each pixel in the target image G, judging the region of each pixel. When a pixel is determined to be a valid pixel within the first process display area, the color data of the pixel is supplemented with the transparency value data, and the transparency value of the pixels within the first process display area is set to the third preset value, making this area opaque. When a pixel is determined not to be a valid pixel within the first display area, the pixel's color data is added to the transparency value data, and the transparency value is set to a second preset value, making the display effect of this part of the area transparent. This embodiment does not limit the specific settings of the second and third preset values. For example, the second preset value can also be any value between 0 and 255 in 8 bits, and the third preset value can also be any value between 0 and 255 in 8 bits, etc.

[0083] In one embodiment, combined with Figure 6 The pixel offset processing of the target image G described above can be specifically performed by the image processing unit of the first display processing unit 1012.

[0084] Specifically, the image processing unit can offset the positions of pixels within the first process display area of ​​the target image G to obtain the processed target image G01. Alternatively, the image processing unit can also offset the positions of pixels within the second process display area G00 of the target image G to obtain the processed target image G01.

[0085] For example, Figure 10 This application provides a schematic diagram illustrating the offset processing of pixels within the second process display area. Taking the offset processing of pixels within the second process display area G00 by the image processing unit as an example, the process involves... Figure 7 The pixel filling process shown has a resolution of w2*h2 for the second process display area G00. Specifically, the image processing unit offsets the position of each pixel based on its corresponding pixel offset within the second process display area G00 to obtain the processed third process display area. For example, for pixel p1 in the second process display area G00, offsetting it horizontally by dx1 and vertically by dy1 determines pixel p1' in the third process display area; similarly, for pixel p2 in the processed second process display area G00, offsetting it horizontally by dx2 and vertically by dy2 determines pixel p2' in the third process display area. Subsequently, the image processing unit also sets a filling display area around the outer edge of the processed third process display area, ultimately obtaining the processed target image G01, which has a resolution of w3*h3. The method of setting the filling display area is similar to... Figure 7 The principle is the same as that shown, so I will not repeat it here.

[0086] In one embodiment, the image processing unit in the display processing unit can determine the pixel offset rule from the storage unit, and then determine the pixel offset of each pixel according to the predetermined pixel offset rule, thereby performing offset processing on each pixel.

[0087] For example, Figure 11 A schematic diagram of an embodiment of the pixel offset rule provided in this application is shown below. Figure 11In the example shown, the second process display area G00 is divided into multiple parts. The boundaries of each part and the four sides of the second process display area G00 determine partial pixels, which are labeled a1b1, a1b2, etc., according to their rows and columns. The pixel offset rule includes the offset of these partial pixels, for example: the offset of pixel a1b1 (dx1, dy1), the offset of pixel a1b2 (dx2, dy2), etc. Subsequently, when the image processing unit processes each actual pixel, it can perform interpolation processing based on the offset of these partial pixels in the pixel offset rule to obtain the pixel offset of each pixel within the second process display area G00. Finally, based on the offset of each pixel obtained from the offset of these partial pixels, the position of each pixel within the second process display area G00 is offset to obtain the third process display area. Each pixel in the overall display area of ​​the third process display area is labeled a1b1', a1b2', etc., according to their rows and columns. Pixels a1b1, a1b2... correspond one-to-one with pixels a1b1', a1b2'... Only the pixel positions change between different images. For example, for pixels p1 and p2 in the same row, the offset pixels p1' and p2' are located in different rows.

[0088] Figure 12 A schematic diagram of another embodiment of the pixel offset rule provided in this application is shown below. Figure 12 In the example shown, the final displayed target image G01 is divided into multiple parts, labeled a1b1', a1b2', etc., according to rows and columns. The pixel offset rule includes the offset of these pixels, for example: the offset of pixel a1b1' (dx1, dy1), the offset of pixel a1b2' (dx2, dy2), etc. Similarly, pixels a1b1, a1b2, etc. in the second process display area G00 correspond one-to-one with pixels a1b1', a1b2', etc. in the target image G01. The pixel offset rule is only used to indicate the changes in pixel position between different images.

[0089] In summary, the image display method for a display device provided in this application's embodiments processes a target image G through a display processing unit to obtain a target image G that can be displayed on the display device. That is, based on the target image displayed by the display device of an electronic device in the real world, the display content that the display device can display in the virtual world can be obtained. Since the processing of the target image in this application's embodiments is based on the display device's own processing capabilities and does not rely on other rendering devices of the display device, the computation required by the rendering device is reduced, giving the display device stronger scalability and usability. At the same time, the processing of the target image by the display device is relatively simple; subsequent display content can be generated from the target image G through pixel offset and / or pixel filling processing. Compared with the pixel-level rendering of the target image G required by the rendering device, the computational load is smaller and the computational power requirement is lower, making the display device more computationally efficient and more real-time.

[0090] Furthermore, in the above embodiments, after the display processing unit processes the target image G to obtain a target image G that can be displayed on the display device, the processed target image can be added to a preset position of the first display content to obtain the second display content.

[0091] Specifically, the image processing unit of the first display processing unit 1012 processes the target image G and determines the first process display content P1 displayed on the first screen 102 of the display device 10. Then, the processed target image G is added to a preset position in the first process display content P1 to obtain the second display content P1 corresponding to the first viewpoint, and finally sent to the first screen 102 for display.

[0092] The image processing unit of the second display processing unit 1013 processes the target image G and determines the second process display content P2 to be displayed on the second screen 103 of the display device 10. Then, the processed target image G is added to a preset position in the second process display content P2 to obtain the second display content P2 corresponding to the second viewpoint, and finally sent to the second screen 103 for display.

[0093] In one specific implementation, the image processing unit of the first display processing unit 1012 further determines the first position offset corresponding to the first process display content P1 and the second position offset corresponding to the second process display content P2 based on the posture information of the display device 10. This allows the target image G to be offset within the second process display area of ​​the first process display content P1 based on the first position offset, and the target image G to be offset within the second process display area of ​​the second process display content P2 based on the second position offset.

[0094] For example, Figure 13This application provides a schematic diagram of adding a target image to first display content, such as... Figure 13 As shown, the first display processing unit 1012 adds the received target image G01-1 to a preset position in the first process display content P1 to be displayed, obtaining the second display content P1 corresponding to the first viewpoint. Within the entire area of ​​the target image G01-1, the position of the second process display area G00-1 in the target image G01-1 is offset horizontally by x1-1 and vertically by y1-1 according to a first position offset, obtaining the processed second display content P1. The second display processing unit 1013 adds the received target image G01-2 to a preset position in the first display content P to be displayed, obtaining the second display content P2 corresponding to the second viewpoint. Within the entire area of ​​the target image G01-2, the position of the second process display area G00-2 in the target image G01-2 is offset horizontally by x2-1 and vertically by y2-1 according to a second position offset, obtaining the processed second display content P2.

[0095] from Figure 13 As can be seen, within the second display content obtained by the two display processing units of the display device, the positions of the target image G are different. This deviation can cause parallax in the user's eyes, thus giving the user a visual sense of depth in the display interface. For example... Figure 13 In the process, when the imaging depth increases from D1 to D2, the offset in the second display content along the line connecting the two eyes in the two target images is smaller for the left eye and larger for the right eye.

[0096] In another specific implementation, the image processing unit of the first display processing unit 1012 further determines the third position offset corresponding to the first process display content P1 and the fourth position offset corresponding to the second process display content P2 based on the posture information of the display device 10, thereby performing offset processing on the position of the target image G within the first process display content P1 based on the third position offset and on the position of the target image G within the first process content P2 based on the fourth position offset.

[0097] Figure 14 This application provides a schematic diagram of adding a target image to first display content, such as... Figure 14As shown, the first display processing unit 1012 adds the received target image G01-1 to a preset position in the first process display content P1 to be displayed, obtaining the second display content P1 corresponding to the first viewpoint. Based on a third position offset, the target image G01-1 is offset horizontally by x3-1 and vertically by y3-1, resulting in the processed second display content P1. The second display processing unit 1013 adds the received target image G01-2 to a preset position in the first display content P to be displayed, obtaining the second display content P2 corresponding to the second viewpoint. Based on a fourth position offset, the target image G01-2 is offset horizontally by x4-1 and vertically by y4-1, resulting in the processed second display content P2.

[0098] from Figure 14 As can be seen, within the second display content obtained by the two display processing units of the display device, the display areas of the target image G are located at different positions. This deviation can cause parallax in the user's eyes, thus giving the user a visual sense of depth in the display interface. For example... Figure 14 In the process, when the imaging depth increases from D1 to D2, the offset of the display area along the line connecting the two eyes in the two target images is smaller for the left eye and larger for the right eye.

[0099] Figure 15 This is a schematic diagram illustrating the display effect of the display device provided in this application. Figure 15 As shown, the target image G1 corresponding to the first viewing angle to be displayed by the first display processing unit 1012 of the display device 10 has offsets of x0-1 and y0-1, and the target image G2 corresponding to the second viewing angle to be displayed by the second display processing unit 1013 has offsets of x0-2 and y0-2. The offset between the target images G1 and G2 can create a visual difference in the entire display content, providing the user with a sense of depth in the entire display scene. Subsequently, the first display processing unit 1012 performs horizontal x3-1 offset processing and vertical y3-1 offset processing on the display area G01-1 of the target image G1 to obtain the processed second display content P1. Within the display area G01-1 of the target image G1, the second process display area G00 corresponding to the target image G is opaque and used to display the target image. The area outside the second process display area G00 is transparent, and the content in the second display content G1 can be displayed through this transparent area. Similarly, the second display processing unit 1013 performs horizontal x4-1 offset processing and vertical y4-1 offset processing on the display area G01-2 of the target image G2 to obtain the processed second display content P2.

[0100] In summary, in the display device 10 provided in this embodiment, two display processing units perform position offset processing on the target images corresponding to the two viewpoints, resulting in a position offset between the target image G and the two displayed contents on the two screens of the display device. This creates a visual difference between the two screens for the user, allowing the user to perceive the different depths of the target image G within the scene. The depth processing provided in this embodiment does not rely on a rendering device, and the processing of the displayed content and target image is relatively simple, reducing computational load and improving the display efficiency of the display device.

[0101] In one embodiment, the display processing unit adds the processed target image to a preset position of the first display content to obtain the second display content. After obtaining the second display content, it can further adjust the target image in the second display content according to the posture information of the display device 10, so that the target image in the second display content is rotated by a preset angle, moved by a preset distance, and scaled by a preset ratio, or a combination of multiple processing methods.

[0102] In one embodiment, the display processing unit can receive information sent by the rendering device through the interface processing unit, thereby determining that the depth of the current display interface has changed, and processing the display content based on the position offset sent by the rendering device.

[0103] In another embodiment, the display processing unit may determine whether the depth of the target image in the currently displayed content has changed based on the posture information of the display device.

[0104] For example, Figure 16 This is a schematic diagram of another embodiment of the display device provided in this application, wherein, as shown... Figure 16 The display device 10 shown is in Figure 5 Based on the illustrated embodiment, a sensor 104 is also included, and the processing system 101 further includes a sensor signal processing unit 1014 connected to the sensor 104. The sensor 104 is used to collect attitude data of the display device 10, and the sensor signal processing unit 1014 is used to process the attitude data collected by the sensor 104, determine the attitude information of the display device 10, and send it to the first display processing unit 1012 and the second display processing unit 1013 through the interface processing unit 1011, so that the first display processing unit 1012 and the second display processing unit 1013 adjust the target image in the second display content according to the received attitude information.

[0105] For example, Figure 17This application provides a flowchart of a method for adjusting the depth of a target image in a display device. Each display processing unit first reads and defaults to a configured position offset. Then, based on attitude information, it determines whether the depth of the target image in the currently displayed content has changed. If yes, a new position offset is calculated, and the target image is processed based on the new offset; otherwise, the old position offset is maintained while processing the target image. This embodiment enables dynamic adjustment of the depth of the target image in the displayed content, increasing the real-time performance of the displayed content and further improving the stability of the display effect.

[0106] Figure 18 This application provides a schematic diagram of a display device adjusting the viewing angle of a target image. The first display processing unit 1012 adds the received target image G01-1 to a preset position in the first process display content P1 to be displayed, obtaining the second display content P1 corresponding to the first viewing angle. The second display processing unit 1013 adds the received target image G01-2 to a preset position in the first display content P to be displayed, obtaining the second display content P2 corresponding to the second viewing angle. Subsequently, when the display device 10 rotates following the user's movement, changing from viewing angle C1 to viewing angle C2, the second display content to be displayed changes accordingly based on the rotation angle. At this time, the first display processing unit 1012 adds the target image G01-1 to a preset position in the first process display content P1 to be displayed, obtaining the second display content P1' corresponding to the first viewing angle, and the second display processing unit 1013 adds the target image G01-2 to a preset position in the first display content P to be displayed, obtaining the second display content P2' corresponding to the second viewing angle. At this point, even if the viewing angles of the two displayed contents change, the positions of the target image G01-1 in the second displayed content P1 and the second displayed content P1' remain fixed, and the positions of the target image G01-2 in the second displayed content P2 and the second displayed content P2' remain fixed. This method of maintaining the relative position of the display interface in the three-dimensional space displayed by the display device 10, following the changes in the display device 10, can be called head anchoring. In summary, the method provided in this embodiment can achieve head anchoring of the target image G in the displayed content, thereby increasing the types of content that the display device can display, providing richer application scenarios for the display device, and further improving the user experience of the display device.

[0107] In one embodiment of this application, Figure 19 A flowchart illustrating a method for adjusting the pose of a target image using a display device, as provided in this application, is shown below. Figure 19The method shown can be executed by the image processing unit in the display processing unit. After adding the target image to a preset position of the first display content to obtain the second display content, the image processing unit also acquires the attitude information of the display device 10. The image processing unit can receive attitude information sent by the sensor signal processing unit or by the rendering device. Subsequently, the display processing unit can receive the attitude information sent by the sensor signal processing unit and perform subsequent processing based on the attitude information. Then, the image processing unit determines the attitude information based on the attitude information, performs attitude adjustment processing on the target image G based on the attitude information, and adds it to the first display content to obtain the second display content, thereby rotating the viewing angle of the target image G in the second display content by a preset angle.

[0108] For example, Figure 20 This application provides a schematic diagram of a display device adjusting the posture of a target image. When the display device 10 rotates following the user's movement, changing from viewing angle C1 to viewing angle C2, the displayed content changes accordingly based on a preset rotation angle and / or a preset scaling ratio. At this time, the first display processing unit 1012 adjusts the posture of the target image G01-1 in the first display content P1 according to the angle change to obtain an adjusted target image G01-1'. The target image G is rotated by a preset angle and / or scaled by a preset ratio with the change of viewing angle, and the adjusted target image G01-1' is added to a preset position in the first display content P1 to obtain the second display content P1'. Similarly, the second display processing unit 1013 adjusts the posture of the target image G01-2 in the first display content P2 according to the angle change to obtain an adjusted target image G01-2'. The target image G is rotated by a preset angle and / or scaled by a preset ratio with the change of viewing angle, and the adjusted target image G01-2' is added to a preset position in the first display content P2 to obtain the second display content P2'.

[0109] In summary, in the image display method of the display device provided in this embodiment, the image display unit can adjust the posture of the target image G in the display content according to the posture information of the display device, so that the target image G displayed by the display device 10 can rotate according to the user's perspective, providing the user with a more real-time and immersive viewing experience, thereby further improving the intelligence level of the display device 10.

[0110] In one embodiment of this application, the display processing unit adjusts the target image in the second display content according to the posture information of the display device 10. Specifically, it moves the target image by a preset distance so that the preset position of the target image G relative to the display device of the display device 10 remains fixed during the change of position of the display device 10, so that the position in the display content remains unchanged from the user's perspective. This process can also be called "world anchoring".

[0111] Specifically, Figure 21 A flowchart illustrating a method for adjusting the position of a target image using a display device, as provided in this application, is shown below. Figure 21 The method shown can be executed by the image processing unit in the display processing unit. After adding the target image G to a preset position in the first display content, the image processing unit further adjusts the position of the target image based on the position information in the posture information of the display device 10. Specifically, the position information refers to the user's head position on the display device. The image processing unit can receive position information sent by the sensor signal processing unit or by the rendering device. Subsequently, the display processing unit can receive the position information sent by the sensor signal processing unit and perform subsequent processing based on the position information. Then, the image processing unit adjusts the position of the target image in the first display content according to the posture information, moving the target image in the displayed image a preset distance.

[0112] Figure 22 A flowchart illustrating another method for adjusting the position of a target image using a display device provided in this application, wherein, in Figure 22 Based on the above, when the target image G moves a preset distance greater than a distance threshold, the target image is controlled to be displayed at the edge position corresponding to the preset distance in the second display content. Subsequently, when the relative position of the target image G returns to within the limits, its "world anchoring" effect based on the initially set position will be restored. The position and orientation of the display interface can also be reset, and subsequent displays will be based on the new position and orientation.

[0113] For example, the image display unit of the display device 10 can determine the user's gaze based on the posture information of the display device 10, and adjust the target image to follow the edge of the user's gaze when the user's gaze leaves the target image in the second display content; and / or, when the user's gaze returns to the target image in the second display content, adjust the target image to move to the original preset position of the second display content.

[0114] In summary, in the image processing method of the display device provided in this embodiment, the image display unit can adjust the position of the target image G in the displayed content according to the position information of the display device, so that the position of the target image G in the displayed content presented to the user by the display device 10 is fixed. The world anchoring function is realized through the processing of the display device, which can provide users with a more real-time and immersive viewing experience, and further improve the intelligence level of the display device.

[0115] Figure 23 This is a schematic diagram of another embodiment of the display device provided in this application, wherein, as shown... Figure 23 The display device 10 shown is in Figure 5 or Figure 16 Based on the illustrated embodiment, an image acquisition device 105 is also included. The processing system 101 further includes an image signal processing unit 1015 connected to the sensor 105. The image acquisition device 105 is used to acquire images of the environment where the display device 10 is located. The image signal processing unit 1015 is used to process the image data acquired by the image acquisition device 105 and send it to the first display processing unit 1012 and the second display processing unit 1013 through the interface processing unit 1011. The first display processing unit 1012 and the second display processing unit 1013 can respectively determine the first display content to be displayed based on the received image data. The display device 10 provided in this embodiment can acquire images through the image acquisition device to determine the first display content to be displayed, enabling the display device 10 to support the implementation of Virtual Synth Technology (VST), further enriching the application scenarios of the display device 10, and facilitating the promotion and use of the display device 10.

[0116] Furthermore, the processing system 101 in the display device 10 provided in this application embodiment may include hardware structures and / or software modules to implement the above functions in the form of hardware structures, software modules, or a combination of hardware structures and software modules. Whether a particular function is executed in the form of hardware structures, software modules, or a combination of hardware structures and software modules depends on the specific application and design constraints of the technical solution.

[0117] For example, the processing system 101 may be one or more integrated circuits configured to implement the above methods or steps, such as one or more application-specific integrated circuits (ASICs), one or more digital signal processors (DSPs), or one or more field-programmable gate arrays (FPGAs). Alternatively, when the processing system 101 can be implemented in the form of processing element scheduler code, the processing element may be a general-purpose processor, such as a central processing unit (CPU) or other processor capable of calling program code. Furthermore, the processing system 101 may also be implemented as a system-on-a-chip (SOC).

[0118] In the above embodiments, implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented, in whole or in part, as a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., a solid-state disk (SSD)).

[0119] For example, embodiments of this application also provide an electronic device, including a processor and a memory; wherein the memory is used to store computer-executable instructions, and the processor can execute the computer-executable instructions stored in the memory. When the computer-executable instructions are executed by the processor, the processor causes the processor to implement any method or any step of a method executable by the processing system 101 as described in the foregoing embodiments of this application.

[0120] This application also provides a computer-readable storage medium storing computer-executable instructions, which, when executed, can be used to implement any method or any step of a method executable by the processing system 101 as described in the foregoing embodiments of this application.

[0121] This application also provides a chip for executing instructions, the chip being used to perform any of the methods or steps of any of the methods executable by the processing system 101 as described above.

[0122] This application also provides a computer program product, including a computer program that, when executed, implements any of the methods or steps of any of the methods executable by the processing system 101 as described above.

[0123] Those skilled in the art will understand that all or part of the steps of the above-described method embodiments can be implemented by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When executed, the program performs the steps of the above-described method embodiments; and the aforementioned storage medium includes various media capable of storing program code, such as ROM, RAM, magnetic disks, or optical disks.

[0124] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

Claims

1. A method for displaying an image on a display device, characterized in that, include: To acquire the target image displayed on the display device of an electronic device; Based on the first display content to be displayed and the target image, a second display content is determined, wherein the second display content includes the target image displayed at a preset position; The second display content is provided to the display device of the display equipment.

2. The method according to claim 1, characterized in that, The step of acquiring the target image displayed by the display device of the electronic device includes: In response to the communication connection established between the display device and the electronic device, the target image displayed by the display device of the electronic device is acquired.

3. The method according to claim 2, characterized in that, The step of acquiring the target image displayed by the display device of the electronic device in response to the communication connection established between the display device and the electronic device includes: In response to the establishment of a communication connection between the display device and the electronic device, at least a portion of the target image is acquired through the communication connection with the electronic device; Alternatively, in response to a display switching command, at least a portion of the target image displayed by the display device of the electronic device can be acquired via a communication connection with the electronic device.

4. The method according to claim 3, characterized in that, The acquisition of the target image via a communication connection with the electronic device includes: The transmission parameters of the target image are determined through the communication connection with the electronic device; The target image is obtained based on the transmission parameters.

5. The method according to any one of claims 1-4, characterized in that, The step of determining the second display content based on the first display content to be displayed and the target image includes: The target image is processed to obtain a processed target image, the processing including pixel filling and / or pixel offset processing of the target image; The processed target image is added to a preset position of the first display content to obtain the second display content.

6. The method according to claim 5, characterized in that, The pixel filling process for the target image includes: Within the filled display area surrounding the first process display area corresponding to the target image, the color values ​​of at least three channels of all pixels are set to a first preset value to obtain a second process display area.

7. The method according to claim 6, characterized in that, The pixel filling process for the target image further includes: Within the filled display area surrounding the first process display area corresponding to the target image, the transparency value of the transparent color channel of all pixels is set to a second preset value.

8. The method according to any one of claims 5-7, characterized in that, The pixel offset processing of the target image includes: The positions of pixels within the first process display area or the second process display area are offset to obtain the processed target image.

9. The method according to claim 8, characterized in that, The step of offsetting the position of pixels within the first process display area or the second process display area to obtain the processed target image includes: Determine pixel offset rules, wherein the pixel offset rules include pixel offsets of at least a portion of pixels in the target image; Interpolate the pixel offsets of the aforementioned pixels to obtain the pixel offset of each pixel in the first process display area or the second process display area; Based on the pixel offset of each pixel in the second process display area, the position of each pixel in the first process display area or the second process display area is offset to obtain the third process display area; A filling display area is set around the outer side of the third process display area to obtain the processed target image.

10. The method according to claim 9, characterized in that, The pixel offset rule is obtained by the offset of at least one first target pixel in the first process display area or the second process display area in the third process display area; Alternatively, the pixel offset rule is obtained by the offset of at least one second target pixel within the third process display area within the first process display area or the second process display area.

11. The method according to any one of claims 5-10, characterized in that, The step of adding the processed target image to a preset position of the first display content to obtain the second display content includes: Based on the first displayed content, the display device determines the first process display content and the second process display content for binocular display. The processed target image is added to the first process display content and the second process display content respectively to obtain the second display content.

12. The method according to claim 11, characterized in that, The step of adding the processed target image to the first process display content and the second process display content respectively to obtain the second display content includes: Based on the posture information of the display device, determine the first position offset corresponding to the content displayed in the first process and the second position offset corresponding to the content displayed in the second process; The processed target image is added to a preset position of the first process display content, and the position of the target image in the second process display area of ​​the first process display content is offset according to the first position offset. The processed target image is added to a preset position of the second process display content, and the position of the target image in the second process display area of ​​the second process display content is offset according to the second position offset, to obtain the second display content.

13. The method according to claim 11, characterized in that, The step of adding the processed target image to the first process display content and the second process display content respectively to obtain the second display content includes: Based on the posture information of the display device, determine the third position offset corresponding to the content displayed in the first process and the fourth position offset corresponding to the content displayed in the second process; The processed target image is added to a preset position in the first process display content, and the position of the target image within the first process display content is offset according to the third position offset. The processed target image is added to a preset position in the second process display content, and the position of the target image within the second process display content is offset according to the fourth position offset, to obtain the second display content.

14. The method according to any one of claims 1-13, characterized in that, The preset position is the position of the target image relative to the display device of the display device.

15. The method according to any one of claims 1-14, characterized in that, After determining the second display content based on the first display content to be displayed and the target image, the method further includes: Based on the posture information of the display device, the target image in the second display content is adjusted, such that the target image in the second display content is rotated by a preset angle, moved by a preset distance, and scaled by a preset ratio, or a combination of multiple such adjustments.

16. The method according to claim 15, characterized in that, The step of adjusting the target image in the second display content according to the posture information of the display device includes: The user's line of sight is determined based on the posture information of the display device; When the user's gaze leaves the target image in the second display content, the target image is adjusted to move along the edge of the user's gaze. And / or, when the user's gaze returns to the target image in the second displayed content, the target image is adjusted and moved to the original preset position of the second displayed content.

17. A display device, characterized in that, include: A processing system and a display device, the processing system being connected to the display device, the processing system being configured to: To acquire the target image displayed on the display device of an electronic device; Based on the first display content to be displayed and the target image, a second display content is determined, wherein the second display content includes the target image displayed at a preset position; The second display content is provided to the display device of the display equipment.

18. The device according to claim 17, characterized in that, The display device includes: a first screen and a second screen for binocular display; The processing system includes: an interface processing unit, a first display processing unit, and a second display processing unit. The interface processing unit is connected to the first display processing unit and the second display processing unit, respectively. The first display processing unit is connected to the first screen, and the second display processing unit is connected to the second screen. The interface processing unit includes: a first input interface and at least one second input interface, wherein the first input interface is used to connect to the electronic device, and the second input interface is used to acquire the first display content; The interface processing unit is configured to: acquire the target image through the first input interface, and send the target image to the first display unit and the second display unit respectively; The first display unit is configured to: provide the first screen with second display content corresponding to the first screen based on the target image and the first process display content corresponding to the first screen in the first display content; The second display unit is configured to provide the second display content corresponding to the second screen to the second screen based on the target image and the second process display content corresponding to the second screen in the first display content.

19. A display device, characterized in that, include: Memory and processor; The memory stores computer-executable instructions; The processor executes computer-executable instructions stored in the memory, causing the processor to perform the method as described in any one of claims 1-16.

20. A computer-readable storage medium, characterized in that, The device stores computer-executable instructions that, when executed, implement the method as described in any one of claims 1-16.

21. A computer program product, characterized in that, Includes a computer program, which, when executed, implements the method as described in any one of claims 1-16.

Images