Display method and device

Abstract

A display method applicable to a display device, wherein a display screen of the display device has a plurality of sub-display areas, the display method includes: first, a step of acquiring image data to be displayed, the image data to be displayed including OSD image data, the OSD image data including OSD sub-image data from n viewpoints, where n is an integer greater than or equal to 2; then, a step of analyzing the OSD image data and performing data rearrangement on the analyzed OSD image data; and finally, a step of determining a corresponding display waiting area on the display screen for the OSD image data according to position information of the OSD image data, and displaying the rearranged OSD image data in the display waiting area, the display waiting area including at least one of the sub-display areas, and the rearranged OSD image data including OSD sub-image data of some or all of the rearranged viewpoints.

Description

[Technical Field]

[0001] The present disclosure relates to the field of signal recognition, and in particular to a display method and apparatus. [Background technology]

[0002] display technology With the development of modern computing, display devices have been widely applied to various fields. In the process of using a display device, it is usually necessary to call up an on-screen display (OSD) image to arrange display-related parameters on the display device. Summary of the Invention [Means for solving the problem]

[0003] In one aspect, there is provided a display method applicable to a display device, the display screen of the display device having a plurality of sub-display areas, the display method including: first, a step of acquiring image data to be displayed, the image data to be displayed including OSD image data, the OSD image data including OSD sub-image data from n viewpoints, n being an integer equal to or greater than 1; then, a step of analyzing the OSD image data and performing data rearrangement on the analyzed OSD image data; and finally, a step of determining a corresponding display waiting area on the display screen of the OSD image data according to position information of the OSD image data, and displaying the rearranged OSD image data in the display waiting area, the display waiting area including at least one sub-display area, and the rearranged OSD image data including OSD sub-image data of some or all of the rearranged viewpoints.

[0004] In some embodiments, the display-ready image data further includes source image data, and the method further includes analyzing the source image data and performing data rearrangement on the analyzed source image data.

[0005] In some embodiments, 、The step of displaying the rearranged OSD image data in the display waiting area includes a step of using the rearranged OSD image data to replace the rearranged source image data corresponding to the display waiting area, or a step of superimposing the rearranged OSD image data on the rearranged source image data corresponding to the display waiting area, depending on the corresponding display waiting area on the display screen of the OSD image data.

[0006] In some embodiments, the step of superimposing the rearranged OSD image data on the rearranged source image data corresponding to the display waiting area includes the step of setting transparency for the rearranged OSD image data, and superimposing the rearranged OSD image data after the transparency has been set on the rearranged source image data corresponding to the display waiting area.

[0007] In some embodiments, the OSD sub-image data for each viewpoint includes A sub-pixels, where A is an integer greater than or equal to 2, and performing data rearrangement on the analyzed OSD image data includes rearranging all sub-pixels in the OSD sub-image data for n viewpoints, where different sub-pixels are located in different rows in the rearranged OSD sub-image data corresponding to the n viewpoints.

[0008] In some embodiments, the A subpixels include a first subpixel, the first subpixel being any one of the A subpixels, and the first subpixel includes t subpixels, where t is an integer greater than or equal to 2.

[0009] In some embodiments, the step of analyzing the OSD image data and performing data rearrangement on the analyzed OSD image data includes first analyzing the OSD image data and obtaining display parameters of the OSD image data and display data of the OSD image data, where the display parameters of the OSD image data include the number of viewpoints and sub-display area identifier corresponding to the OSD image data, and the capacity of the display data of the OSD image data, and then performing data rearrangement on the display data of the OSD image data according to the display parameters of the OSD image data.

[0010] In some embodiments, a method for obtaining OSD sub-image data for n viewpoints includes using n cameras to photograph a first OSD model from different viewpoints and obtaining OSD sub-image data for n viewpoints, or using a three-dimensional modeling or image processor to obtain a second OSD model and obtaining OSD sub-image data for n viewpoints according to the second OSD model.

[0011] In some embodiments, the position information of the OSD image data includes the start position of the waiting-to-display region, and length and width information of the waiting-to-display region.

[0012] In some embodiments, the display method further includes: first, obtaining a first command, the first command being used to switch the display mode of the OSD image from 3D display to 2D display, or to switch the display mode of the OSD image from 2D display to 3D display; then, in response to the first command, obtaining two-dimensional OSD image data; and finally, displaying the two-dimensional OSD image on the display screen according to a display waiting area corresponding to the two-dimensional OSD image data.

[0013] In some embodiments, the display method further includes the steps of first acquiring a face image or a pupil image of a user and determining a primary observation area of ​​the user, and / or acquiring a gesture image of the user and determining a primary viewpoint area of ​​the user, and then performing a high-resolution display of OSD image data and / or source image data in the primary observation area and / or the primary viewpoint area, and performing a low-resolution display of OSD image data and / or source image data outside the primary observation area and / or the primary viewpoint area.

[0014] In another aspect, a computer-readable storage medium is provided, the computer-readable storage medium storing computer program instructions, which, when run on a computer (e.g., a display device), cause the computer to perform the display method described in any of the above embodiments.

[0015] In yet another aspect, a computer program product is provided, the computer program product including computer program instructions that, when executed on a computer (e.g., a display device), cause the computer to perform the display method described in any of the above embodiments.

[0016] In yet another aspect, a computer program is provided that, when run on a computer (e.g., a display device), causes the computer to perform the display method according to any of the above embodiments.

[0017] In yet another aspect, a display device is provided, comprising a display screen, a data acquisition device, and a data processing device. The display screen includes a plurality of sub-display areas. The data acquisition device is configured to acquire display-ready image data, the display-ready image data including OSD image data, the OSD image data including OSD sub-image data from n viewpoints, where n is an integer equal to or greater than 1. The data processing device is configured to analyze the OSD image data and perform data rearrangement on the analyzed OSD image data. The data processing device determines a corresponding display-ready area on the display screen for the OSD image data according to position information of the OSD image data, and controls to display the rearranged OSD image data in the display-ready area on the display screen. The display-ready area includes at least one sub-display area, and the rearranged OSD image data includes OSD sub-image data for some or all of the rearranged viewpoints.

[0018] In some embodiments, the display-ready image data further includes source image data, and the data processing device is further configured to analyze the source image data and perform data rearrangement on the analyzed source image data.

[0019] In some embodiments, the data processing device is configured to use the rearranged OSD image data to replace the rearranged source image data corresponding to the display waiting area, or to superimpose the rearranged OSD image data on the rearranged source image data corresponding to the display waiting area, depending on the display waiting area corresponding to the OSD image data.

[0020] In some embodiments, the data processing device is configured to set transparency for the rearranged OSD image data and superimpose the rearranged OSD image data after the transparency has been set on the rearranged source image data corresponding to the area to be displayed.

[0021] In some embodiments, the OSD sub-image data for each viewpoint includes A sub-pixels, where A is an integer greater than or equal to 2. The data processing device is configured to rearrange all sub-pixels in the OSD sub-image data for the n viewpoints, where different sub-pixels are located in different rows in the rearranged OSD sub-image data corresponding to the n viewpoints.

[0022] In some embodiments, the A subpixels include a first subpixel, the first subpixel being any one of the A subpixels, and the first subpixel includes t subpixels, where t is an integer greater than or equal to 2.

[0023] In some embodiments, the data processing device is configured to analyze the OSD image data and obtain display parameters of the OSD image data and display data of the OSD image data. The display parameters of the OSD image data include a number of viewpoints and a sub-display area identifier corresponding to the OSD image data, and a size of the display data of the OSD image data. The data processing device is configured to perform data rearrangement on the display data of the OSD image data according to the display parameters of the OSD image data.

[0024] In some embodiments, the data acquisition device is configured to use n virtual cameras to photograph a first OSD model from different viewpoints and obtain OSD sub-image data for n viewpoints, or to use a three-dimensional modeling or image processor to acquire a second OSD model and obtain OSD sub-image data for n viewpoints according to the second OSD model.

[0025] In some embodiments, the position information of the OSD image data includes the start position of the waiting-to-display region, and length and width information of the waiting-to-display region.

[0026] In some embodiments, the data acquisition device is further configured to acquire a first command, the first command being used to switch the display format of the OSD image from 3D display to 2D display or to switch the display format of the OSD image from 2D display to 3D display. The data acquisition device is further configured to acquire two-dimensional OSD image data or three-dimensional OSD image data in response to the first command. The data processing device is configured to control displaying a two-dimensional OSD image on the display screen according to a display waiting area corresponding to the two-dimensional OSD image data, or control displaying a three-dimensional OSD image on the display screen according to a display waiting area corresponding to the three-dimensional OSD image data.

[0027] In some embodiments, the display device further comprises a collection device configured to acquire a face image or a pupil image of the user to determine a primary observation region of the user and / or acquire a gesture image of the user to determine a primary viewpoint region of the user, and the data processing device is further configured to provide a high-resolution display for OSD image data and / or source image data for the primary observation region and / or the primary viewpoint region, and a low-resolution display for OSD image data and / or source image data outside the primary observation region and / or the primary viewpoint region. [Brief explanation of the drawings]

[0028] In order to more clearly explain the technical solutions according to the present disclosure, the drawings used in some embodiments of the present disclosure will be briefly described below. It is clear that the drawings in the following description are only a portion of the drawings in some embodiments of the present disclosure. Those skilled in the art can obtain other drawings based on these drawings. In addition, the drawings in the following description can be considered as schematic diagrams and do not limit the actual dimensions of the products, the actual flow of the methods, the actual timing of the signals, etc. according to the embodiments of the present disclosure. [Figure 1] FIG. 2 is a schematic diagram of a display area on a display screen according to some embodiments. [Figure 2] 1 is a flowchart of a display method according to some embodiments. [Figure 3] 1 is a schematic diagram of a method for acquiring multi-view OSD sub-image data according to some embodiments. [Figure 4] FIG. 1 is a 3D display scene diagram of a multi-view OSD image according to some embodiments. [Figure 5] 1 is a flowchart of data analysis and rearrangement according to some embodiments. [Figure 6] FIG. 2 is a structural diagram of OSD image data according to some embodiments. [Figure 7A] 10A and 10B are diagrams illustrating arrangements of OSD image data before and after rearrangement according to some embodiments. [Figure 7B] 1A and 1B are diagrams illustrating arrangements of source image data before and after rearrangement according to some embodiments. [Figure 7C] 10A-10C are schematic diagrams of display data replacement in a waiting-to-display area of ​​an OSD according to some embodiments. [Figure 7D] FIG. 1 is a diagram illustrating the arrangement of display data on a display screen according to some embodiments. [Figure 7E] 10 is a schematic diagram of display data replacement in a waiting-to-display area of ​​another OSD according to some embodiments. FIG. [Figure 7F] FIG. 10 is a diagram illustrating the arrangement of display data on another display screen according to some embodiments. [Figure 8] 10 is a flowchart of another display method according to some embodiments. [Figure 9] 10 is a flowchart of yet another display method according to some embodiments. [Figure 10] 10 is a flowchart of yet another display method according to some embodiments. [Figure 11] 10 is a flowchart of yet another display method according to some embodiments. [Figure 12] 10 is a flowchart of yet another display method according to some embodiments. [Figure 13] FIG. 2 is a schematic diagram of a primary observation area according to some embodiments. [Figure 14] 10 is a flowchart of yet another display method according to some embodiments. [Figure 15]1 is a flowchart of OSD interaction according to some embodiments. [Figure 16] 1 is a structural diagram of a display device according to some embodiments; DETAILED DESCRIPTION OF THE INVENTION

[0029] Hereinafter, several embodiments of the present disclosure will be described clearly and completely with reference to the drawings. Of course, the embodiments described herein are only a part of the embodiments of the present disclosure, and are not all of the embodiments. All other embodiments that can be obtained by those skilled in the art based on the embodiments in the present disclosure shall fall within the scope of protection of the present disclosure.

[0030] Unless the context indicates otherwise, in this specification and claims, the term "comprise" and other forms thereof, such as the third-person singular "comprises" and the present participle form "comprising," should be interpreted in an open, inclusive sense, i.e., "including, but not limited to." In the description, the terms "one embodiment," "some embodiments," "exemplary embodiments," "example," "specific example," "some examples," and the like, are intended to indicate that a particular feature, structure, material, or characteristic associated with this embodiment or examples is included in at least one embodiment or example of the present disclosure. General references to the above terms do not necessarily refer to the same embodiment or example. Furthermore, a described particular feature, structure, material, or characteristic may be included in any one or more embodiments or examples in any appropriate manner.

[0031] Hereinafter, the terms "first" and "second" are for descriptive purposes only and should not be understood as indicating or implying the relative importance or quantity of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In describing the embodiments of the present disclosure, unless otherwise specified, "plurality" means two or more than two.

[0032] In describing some embodiments, the terms "coupled" and "connected," as well as derivatives thereof, may be used. For example, in describing some embodiments, the term "connected" may be used to indicate that two or more components are in direct physical or electrical contact with each other. Also, for example, in describing some embodiments, the term "coupled" may be used to indicate that two or more components are in direct physical or electrical contact with each other. However, the terms "coupled" or "communicatively coupled" may also mean that two or more components are not in direct contact with each other, but still cooperate or interact with each other. The embodiments disclosed herein are not necessarily limited to the present specification.

[0033] "At least one of A, B, and C" has the same meaning as "at least one of A, B, or C," and all include combinations of A, B, and C, such as A only, B only, C only, a combination of A and B, a combination of A and C, a combination of B and C, and a combination of A, B, and C.

[0034] "A and / or B" includes three combinations: A only, B only, and a combination of A and B.

[0035] As used herein, depending on the context, the word "when" is optionally interpreted to mean "when" or "upon" or "in response to determining" or "in response to detecting." Similarly, depending on the context, the phrase "when it is determined" or "when [a described condition or event] is detected" is optionally interpreted to mean "when it is determined" or "in response to determining" or "when [a described condition or event] is detected."

[0036] In this specification, the use of "applied to" or "disposed to" is intended to be open and inclusive language and does not exclude equipment that is adapted or arranged to perform additional tasks or steps.

[0037] Also, the use of "based on" is meant to be open and inclusive, as a process, step, calculation, or other action performed "based on" one or more conditions or values ​​may, in fact, be based on additional conditions or values ​​beyond those.

[0038] As used herein, "about" or "approximately" includes the stated value and the mean within an acceptable range of deviation of the specified value, where the acceptable range of deviation is determined by one of ordinary skill in the art considering the measurement and the error associated with measuring the specified quantity (i.e., limitations of the measurement system).

[0039] Exemplary embodiments are described herein with reference to cross-sectional and / or plan views that are idealized illustrative drawings. In the drawings, thicknesses of layers and regions are exaggerated for clarity. Accordingly, variations in shape relative to the drawings due, for example, to manufacturing techniques and tolerances are to be expected. Thus, the exemplary embodiments are not limited to the shapes of regions illustrated herein, but should be construed to include deviations in shape due to manufacturing or otherwise. For example, an etching region shown as a rectangle typically has curved features. Thus, the regions shown in the drawings are exemplary in nature, and their shapes are not intended to represent the actual shape of the regions of the facility, nor are they intended to limit the scope of the exemplary embodiments.

[0040] OSD is a special font or graphic that is displayed on the screen of a display to provide information to the user. It is commonly seen on home televisions and computer screens. When the user operates the television to change channels, adjust the volume, picture quality, etc., the current status is displayed on the television screen to inform the user.

[0041] Currently, the display method of OSD images cannot realize 3D display of OSD images, cannot realize switching between 2D display and 3D display of OSD images, and furthermore, cannot realize the effect of multi-view OSD images.

[0042] To solve the above problems, some embodiments of the present disclosure provide a display method applicable to a display device, the display screen of which includes multiple sub-display regions. The sub-display regions may be one or more islands, and the present disclosure does not limit the number of pixel islands included in the sub-display regions. As shown in FIG. 1 , for example, a display screen 10 includes 20 independently drivable sub-display regions 11, each of which is an independently drivable region, and an OSD display standby region 20 includes six sub-display regions 11. For example, the independently drivable regions may be parallel-driven regions, independently drivable regions driven by backlight hardware, or regions that are divided and subjected to image quality processing when processing image content. The display device may be a television, a personal computer, or another device equipped with a display screen, and the present disclosure does not limit the specific type of display device.

[0043] Some embodiments of the present disclosure provide a display method, and as shown in FIG. 2, the display method includes the following steps.

[0044] Step 201: Obtaining image data to be displayed, the image data to be displayed includes OSD image data, and the OSD image data includes OSD sub-image data from n views, where n is an integer equal to or greater than 2.

[0045] 3 , the method for acquiring OSD sub-image data for n viewpoints includes capturing images of the first OSD model 30 from different viewpoints using n cameras 31 to acquire OSD sub-image data for n viewpoints. Illustratively, the cameras 31 may be cameras capable of capturing photographs, such as virtual cameras or real cameras, and the present disclosure does not limit the type of the cameras 31.

[0046] In some embodiments, the OSD sub-image data for the above n viewpoints is stored in advance in a memory of a system-side circuit (e.g., an FPGA (e.g., a Field Programmable Gate Array) and an SOC (System on Chip)), and when needed, the OSD sub-image data for the n viewpoints is called from the memory of the system-side circuit. It is understood that multiple types of OSD image data may be stored in the memory of the system-side circuit, and the present disclosure does not limit the number and types of OSD images corresponding to the OSD image data.

[0047] In some embodiments, the method for obtaining OSD sub-image data for n viewpoints may further include obtaining a second OSD model using a 3D modeling or image processor, and obtaining OSD sub-images for n viewpoints according to the second OSD model. Exemplarily, the second OSD model may be generated in real time by the 3D modeling or image processor, and slicing or image generation and output for different viewpoints based on the second OSD model can obtain OSD sub-image data for n viewpoints. The operation of the 3D modeling or image processor may include: display device The second OSD model may be obtained by an internal system or an external system, and the present disclosure does not limit the specific method of obtaining the second OSD model using three-dimensional modeling or an image processor.

[0048] The display-ready image data includes OSD image data, and the OSD image data includes OSD sub-image data from n viewpoints. That is, the display-ready image data includes OSD sub-image data from n viewpoints, and OSD images from multiple viewpoints can be simultaneously displayed on one frame screen of the display screen 10, thereby realizing 3D display of the OSD. As shown in FIGS. 4(a) and 4(b), when a user stands at different viewpoint angles, different OSD images can be viewed on the display screen 10. As shown in FIG. 4(a), when a user stands at a first viewpoint angle 401, an OSD image 4011 from a first viewpoint can be viewed on the display waiting area 20 of the OSD. For example, as shown in FIG. 4(b), when a user stands at a second viewpoint angle 402, an OSD image 4021 from a second viewpoint can be viewed on the display waiting area 20 of the OSD. The OSD image 4011 from a first viewpoint and the OSD image 4021 from a second viewpoint are any two different OSD images among the OSD images from n viewpoints. The present disclosure does not limit the number of viewpoints of an OSD image that can be displayed on one frame screen.

[0049] Step 202: Analyze the OSD image data, and perform data rearrangement on the analyzed OSD image data.

[0050] In some embodiments, as shown in FIG. 1 , the OSD display area includes six sub-display areas 11, and the OSD image data may be distributed to at least one of the six sub-display areas 11. However, when the OSD image data is stored in a memory of a system-side circuit, it is not divided and stored. In the case of OSD image data generated in real time, it is not divided and generated, and OSD image data for the same viewpoint is not stored at the same storage address. Therefore, to ensure accurate display of the OSD image, the OSD image data must be scattered and reconstructed on the system side (e.g., a graphics card), and the reconstructed OSD image data must be input to a control system of the display device. The control system of the display device analyzes and reconstructs the data, and the reconstructed OSD image data is output to the display screen 10 of the display device according to display needs, thereby displaying a 3D OSD image on the display screen 10.

[0051] In some embodiments, taking the example where OSD image data, i.e., OSD sub-image data of n viewpoints, is stored in the memory of the system side circuit, as shown in FIG. 5, the implementation method of step 202 may include the following steps:

[0052] Step 501: Analyze the OSD image data to obtain the display parameters of the OSD image data and the display data of the OSD image data.

[0053] 6, the display parameters of the OSD image data include a flag bit, a compression ratio, the number of viewpoints and sub-display area identifiers corresponding to the OSD image data, and the capacity of the display data of the OSD image data. The flag bit is configured to handshake with a front-end command. The compression ratio is configured as a ratio between the size of the display data of the OSD image data after compression and the size before compression, facilitating compression and decompression of the display data of the OSD image data. The number of viewpoints corresponding to the OSD image data is configured to store which viewpoint among n viewpoints the viewpoint corresponding to the OSD image data is. The sub-display area identifier corresponding to the OSD image data is configured to transmit position information of the sub-display area 11 corresponding to the OSD image data to the backend. Illustratively, the position information of the sub-display area 11 may be obtained by numbering the sub-display areas 11 of the display screen 10, for example, from the upper left corner, from left to right, and from top to bottom, with each number corresponding to one word display area. The capacity of the display data of the OSD image data is configured to transmit the size of the OSD image data to be displayed to the backend. For example, OSD If only the sub image data needs to be displayed, the display data capacity of the OSD image data is OSD The amount of display data for the OSD image data is smaller than the amount of display data for the OSD image data when the sub-image data needs to be displayed, and the backend can rationally allocate data processing resources according to the parameter, thereby avoiding waste of system resources. data contains the pixel value of one sub-pixel.

[0054] Step 502: Data rearrangement is performed on the display data of the OSD image data according to the display parameters of the OSD image data.

[0055] In some embodiments, the OSD subimage data for each viewpoint includes A subpixels, where A is an integer greater than or equal to 2. Implementing step 502 may include rearranging all subpixels in the OSD subimage data for the n viewpoints. In the rearranged OSD subimage data corresponding to the n viewpoints, different subpixels are located in different rows. The subpixels may include red subpixels, green subpixels, blue subpixels, black subpixels, white subpixels, and yellow subpixels.

[0056] In some embodiments, the A subpixels include a first subpixel, the first subpixel being any one of the A subpixels, and the first subpixel includes t subpixels, where t is an integer greater than or equal to 1.

[0057] 7A , the analyzed OSD image data includes OSD sub-image data for n viewpoints, each of which includes three sub-pixels, e.g., a red (R) sub-pixel, a green (G) sub-pixel, and a blue (B) sub-pixel. In the OSD sub-image data for each viewpoint, each red sub-pixel includes t sub-pixels, e.g., R1-1, R1-2, ..., R1-t, each green sub-pixel includes t sub-pixels, e.g., G1-1, G1-2, ..., G1-t, and each blue sub-pixel includes t sub-pixels, e.g., B1-1, B1-2, ..., B1-t. When rearranging the sub-pixels, the sub-pixels are rearranged according to the position information of the display data, e.g., the pixel values ​​of the sub-pixels and corresponding display parameters, of the OSD image data. For example, in the rearranged OSD image data, display data R1-1 corresponds to the start position of the OSD display waiting area 20, and display data Rt-n corresponds to the end position of the OSD display waiting area 20. As shown in Fig. 1, if the OSD display waiting area 20 is rectangular, it is understood that the start position of the OSD display waiting area 20 is position D0, where the first pixel in the upper left corner of the rectangle is located, and the end position of the OSD display waiting area 20 is position D1, where the last pixel in the lower right corner of the rectangle is located. In this way, when the rearranged OSD image data is input to the display screen 10 by timing control, it can be displayed according to the rearranged OSD image data.

[0058] For illustrative purposes, a more intuitive explanation will be given using an example where the value of n is 5 and the value of t is 4, i.e., the OSD image data includes OSD sub-image data for five viewpoints, each sub-pixel includes four sub-pixels, each sub-pixel has one pixel value, and the display waiting area 20 includes 12 rows and 5 columns of pixels, each of which corresponds one-to-one to the pixel value of the sub-pixel.

[0059] As shown in Table 1, the OSD sub-image data for each viewpoint includes pixel values ​​of 15 sub-pixels. The OSD sub-image data 501 for the first viewpoint includes pixel values ​​of four red sub-pixels (e.g., R1-1, R1-2, R1-3, and R1-4), four green sub-pixels (e.g., G1-1, G1-2, G1-3, and G1-4), and four blue sub-pixels (e.g., B1-1, B1-2, B1-3, and B1-4). The OSD sub-image data 502 of the second viewpoint includes pixel values ​​of four red sub-pixels (R2-1, R2-2, R2-3, and R2-4), pixel values ​​of four green sub-pixels (e.g., G2-1, G2-2, G2-3, and G2-4), and pixel values ​​of four blue sub-pixels (e.g., B2-1, B2-2, B2-3, and B2-4). By analogy, the fifth viewpoint OSD sub-image data 505 includes pixel values ​​of four red sub-pixels (e.g., R5-1, R5-2, R5-3, and R5-4), four green sub-pixels (e.g., G5-1, G5-2, G5-3, and G5-4), and four blue sub-pixels (e.g., B5-1, B5-2, B5-3, and B5-4). When the OSD image data is scattered and reconstructed on the system side and the reconstructed OSD image data is input to the display device control system, the pixel values ​​of the sub-pixels are not arranged in the order in which they will be displayed, but are compressed and then stored in the memory of the system circuit. Therefore, the display device control system needs to analyze and then rearrange the OSD image data, i.e., the five viewpoint sub-image data. [Table 1]

[0060] All subpixels in the OSD subimage data for five viewpoints are rearranged. That is, the red, green, and blue subpixels in the OSD subimage data for five viewpoints are rearranged. After the rearrangement, all of the red subpixels in the OSD subimage data for five viewpoints are arranged in at least one row and parallel to one another, all of the blue subpixels in the OSD subimage data for five viewpoints are arranged in at least one row and parallel to one another, and all of the green subpixels in the OSD subimage data for five viewpoints are arranged in at least one row and parallel to one another. Furthermore, any one of the red subpixels in the OSD subimage data for five viewpoints is arranged in a different row from any one of the blue subpixels in the OSD subimage data for five viewpoints or any one of the green subpixels in the OSD subimage data for five viewpoints. That is, in the rearranged OSD subimage data, different subpixels are located in different rows.

[0061] For example, as shown in Table 2, the rearranged OSD sub-image data corresponding to five viewpoints includes pixel values ​​of sub-pixels in 12 rows. In the OSD sub-image data for the five viewpoints, pixel values ​​R1-1, R1-2, R1-3, R1-4, and R1-5 of the red sub-pixels are arranged in the first row, where the pixel value R1-1 of the sub-pixel corresponds to the start position D0 of the display waiting area 20. In the OSD sub-image data for the five viewpoints, pixel values ​​G1-1, G1-2, G1-3, G1-4, and G1-5 of the green sub-pixels are arranged in the second row. In the OSD sub-image data for the five viewpoints, pixel values ​​B1-1, B1-2, B1-3, B1-4, and B1-5 of the blue sub-pixels are arranged in the third row. By this analogy, in the OSD sub-image data for the five viewpoints, pixel values ​​R4-1, R4-2, R4-3, R4-4, and R4-5 of the red sub-pixels are arranged in row 10. In the OSD sub-image data for the five viewpoints, pixel values ​​G4-1, G4-2, G4-3, G4-4, and G4-5 of the green sub-pixels are arranged in row 11. In the OSD sub-image data for the five viewpoints, pixel values ​​B4-1, B4-2, B4-3, B4-4, and B4-5 of the blue sub-pixels are arranged in row 12, where pixel value R4-5 of the sub-pixel corresponds to end position D1 of the display waiting area 20. [Table 2]

[0062] The pixel values ​​G1-1, G1-2, G1-3, G1-4, and G1-5 of the green subpixels in the OSD subimage data for five viewpoints may be arranged in the first row, or the pixel values ​​B1-1, B1-2, B1-3, B1-4, and B1-5 of the blue subpixels in the OSD subimage data for five viewpoints may be arranged in the first row. The present disclosure does not limit the priority of the rows containing the red subpixels in the OSD subimage data for n viewpoints and the rows containing the green subpixels in the OSD subimage data for n viewpoints or the rows containing the blue subpixels in the OSD subimage data for n viewpoints. That is, the order of the rearranged subpixels may include various forms, and any of them falls within the scope of protection of the embodiments of the present disclosure as long as the rearranged subpixels are located in different rows. By rearranging the OSD sub-image data of n viewpoints, different sub-pixels after rearrangement are ensured to be located in different rows, thereby ensuring a better 3D display effect and making the 3D scene presented in front of the user's eyes more realistic.

[0063] In step 203, a corresponding display waiting area 20 on the display screen 10 of the OSD image data is determined according to the position information of the OSD image data, and the rearranged OSD image data is displayed in the display waiting area 20. The display waiting area 20 includes at least one sub-display area 11, and the rearranged OSD image data includes OSD sub-image data of some or all of the rearranged viewpoints.

[0064] 1 , the position information of the OSD image data includes a start position D0 of the OSD display waiting region 20, and length and width information of the OSD display waiting region 20. The end position D1 of the OSD display waiting region 20 can be calculated from the start position D0 of the OSD display waiting region 20 and the length and width information of the OSD display waiting region 20. The system-side circuit configures or generates parameters such as the coordinates of the start position D0 of the OSD display waiting region 20, the length and width information of the OSD display waiting region 20, and the position of the sub-display region 11 to which the OSD image data belongs, according to the display screen 10. When the data stream of the display device reaches the start position D0 of the OSD display waiting region 20, the system-side circuit outputs the rearranged OSD sub-image data of the five viewpoints to the OSD display waiting region 20 in accordance with the timing, thereby displaying the OSD images of the five viewpoints.

[0065] For example, the rearranged OSD image data may include OSD subimage data for some of the viewpoints. For example, if rearrangement is performed on only subimage data for three viewpoints out of OSD subimage data for five viewpoints, when the data stream of the display device reaches the start position D0 of the OSD display waiting area 20, the rearranged OSD subimage data for the three viewpoints is output to the OSD display waiting area 20 in accordance with the timing, and OSD images for the three viewpoints are displayed. Also, for example, data rearrangement may be performed on OSD subimage data for five viewpoints, but only subimage data for three viewpoints may be displayed when the data is rearranged.

[0066] In some embodiments, the image data to be displayed further includes source image data, and the display method includes analyzing the source image data and sauce The method further includes performing data rearrangement on the image data.

[0067] For example, the source image data may include source image data from multiple viewpoints, and the embodiments of the present disclosure do not limit the acquisition method of the source image data. As shown in Figure 7B, the source image data includes source image data from n viewpoints, and the sub-image data of each viewpoint includes A sub-pixels. To ensure visual effects, the type and number of sub-pixels included in the source image data of each viewpoint are included in the OSD sub-image data of each viewpoint. Sub It is understood that the types and numbers of pixels are the same as those of the pixels. Each subpixel of the source image data for each viewpoint includes m subpixels, where m is an integer equal to or greater than 1. It is understood that m and the value of t of the t subpixels included in each subpixel of each OSD subimage data may be the same or different.

[0068] Furthermore, the display range of the source image may be the entire display screen 10 or a partial display area of ​​the display screen 10, and some embodiments of the present disclosure will be described using an example in which the display range of the source image is the entire display screen 10. The method of analyzing and rearranging the source image data is similar to the method of analyzing and rearranging the OSD image data, and will not be repeated here.

[0069] 7B , the analyzed source image data includes source image data of n viewpoints. For example, the source image data of each viewpoint includes three subpixels, each of which is a red subpixel, a green subpixel, and a blue subpixel. In the source image data of each viewpoint, each red subpixel includes m subpixels, e.g., OR1-1, OR2-1, ..., ORm-1; each green subpixel includes m subpixels, e.g., OG1-1, OG2-1, ..., OGm-1; and each blue subpixel includes m subpixels, e.g., OB1-1, OB2-1, ..., OBm-1.

[0070] 7B, the rearrangement is performed according to the position information of the display data in accordance with each display data of the source image data, for example, the pixel value of the subpixel and the corresponding display parameters. For example, in the rearranged source image data, display data OR1-1 corresponds to the start position of the display screen 10, and display data ORm-n corresponds to the end position of the display screen 10. As shown in FIG. 1, if the display screen 10 is rectangular, it can be understood that the position of the first pixel in the upper left corner of the rectangle is the start position of the display screen 10, and the position of the last pixel in the lower right corner of the rectangle is the end position of the display screen 10. In this way, when the rearranged source image data is input to the display screen 10 by timing control, it can be displayed according to the rearranged source image data.

[0071] The analyzed source image data is analyzed from five perspectives. Source image data Each Viewpoint source image data The rearranged source image data can be more intuitively explained by taking as an example a case where a pixel in a display screen 10 includes three sub-pixels, each of which includes four sub-pixels, and the display screen 10 includes 12 rows and 5 columns of pixels, and the pixels correspond one-to-one to the pixel values ​​of the sub-pixels in the source image data. The rearranged source image data is shown in Table 3. Here, the pixel value of the sub-pixel OR1-1 corresponds to the first pixel in the upper left corner of the display screen 10, and the pixel value of the sub-pixel OR2-1 corresponds to the first pixel in the upper left corner of the display screen 10. OB4-5 corresponds to the last pixel in the bottom right corner of the display screen 10. [Table 3]

[0072] 1 , the display area of ​​the display screen 10 is larger than the OSD's waiting area 20. In this case, when both the source image and the OSD image need to be displayed on the display screen 10, displaying the rearranged OSD image data in the waiting area 20 according to the corresponding OSD image data on the display screen 10 includes replacing the rearranged source image data corresponding to the waiting area 20 with the rearranged OSD image data according to the corresponding OSD image data on the display screen 10, or superimposing the rearranged OSD image data on the rearranged source image data corresponding to the waiting area 20.

[0073] For example, as shown in Figures 7C and 7D, rearranged source image data (e.g., OR1-x and OR1-y, where x and y are both integers less than or equal to m) whose position information is located within the display waiting area 20 of the OSD is directly replaced with rearranged OSD image data (e.g., R1-1 and R1-2), for example, the display data at the starting position D0 is replaced from OR1-x to R1-1, that is, the source image is not displayed in the display waiting area 20 of the OSD, and only the OSD image is displayed.

[0074] For example, before the data stream reaches the start position D0 of the OSD display waiting area 20, the display data of the OSD display waiting area 20 is the rearranged source image data shown in FIG. 7B. When the data stream reaches the start position D0 of the OSD display waiting area 20, the rearranged OSD image data shown in FIG. 7A is used as the display data of the OSD display waiting area 20 from the start position D0. That is, in the OSD display waiting area 20, the rearranged OSD image data is used to replace the corresponding rearranged source image data. Therefore, as shown in FIG. 7D, what is displayed in the OSD display waiting area 20 of the display screen 10 is the rearranged OSD image. data The rearranged source image data is displayed on the display screen 10 other than the display waiting area 20 of the OSD.

[0075] In some embodiments, as shown in Figures 7E and 7F, the rearranged OSD image data is superimposed on the rearranged source image data corresponding to the display waiting area 20 of the OSD, and an image after the source image data and the OSD image are fused is displayed in the display waiting area 20 of the OSD.

[0076] In some embodiments, the superimposing method may include setting transparency for the rearranged OSD image data, and superimposing the rearranged OSD image data after the transparency is set on the rearranged source image data corresponding to the display waiting area 20. For example, as shown in FIG. 7E, the display data at the start position D0 of the OSD display waiting area 20 is replaced with the display data OR1-x to OR1-1' of the source image at that position, R1-1' is obtained by superimposing the rearranged OSD image data R1-1 on the source image data OR1-x after the transparency is set, and R1-2' is obtained by superimposing the rearranged OSD image data R1-2 on the source image data OR1-x after the transparency is set. OSD image data is obtained by superimposing the source image data OR2-x after the transparency is set, and can be inferred in this way.

[0077] For example, before the data stream reaches the start position D0 of the display waiting area 20 of the OSD, the display data of the OSD's display waiting area 20 is the rearranged source image data shown in Fig. 7B. When the data stream reaches the start position D0 of the display waiting area 20 of the OSD, as shown in Fig. 7E, the rearranged OSD image data is superimposed on the rearranged source image data corresponding to the display waiting area 20 of the OSD to obtain superimposed display data, and the superimposed display data is set as the display data of the OSD's display waiting area 20 from the start position D0 of the OSD's display waiting area 20. Therefore, as shown in Fig. 7F, what is displayed in the OSD's display waiting area 20 of the display screen 10 is the OSD image data and the source image data Image after and are superimposed data The rearranged source image data is displayed on the display screen 10 other than the display waiting area 20 of the OSD.

[0078] In some embodiments, the overall process is described using FIGS. 8 and 9 as examples when the source image and the OSD image need to be displayed simultaneously.

[0079] As shown in FIG. 8 , first, the front end transmits source image data through a data interface. The front end may be a part of the system side or an external device. The present disclosure does not limit the number and type of front ends. The data interface may include multiple interfaces. For example, the data interface may include one or more of a system interface, an internal interface, a DisplayPort, a High Definition Multimedia Interface (HDMI), an external / embedded display interface, or a mobile industry processor interface. The present disclosure does not limit the type of source image data source and data interface. After receiving source image data, the system-side data receiving and conversion module outputs the converted source image data to the data analysis and rearrangement module. The source image data after data analysis and rearrangement may be stored in a double data rate synchronous dynamic random access memory (DDR, which may be abbreviated as DDR SDRAM) in the system-side circuit. When the source image data needs to be displayed, the relocated source image data may be retrieved from the DDR, and display data processing may be performed on the relocated source image data. The data processing may include adjusting specific pixel values. In this case, if there is no OSD display command, the display data of the processed source image may be directly output to the data conversion and transmission module and output to the backend, and the source image may be displayed under display timing control. The backend may be the display screen 10 of the display device or a driving circuit of the display device, and the present disclosure does not limit the type or number of backends.

[0080] For example, when a user issues an OSD display command, the system reads the 2D / 3D display switching command and controls the OSD image data acquisition module via the OSD function control module to acquire OSD image data corresponding to the 2D or 3D display. The acquired OSD image data is output to the OSD image data processing module, which processes the acquired OSD image data, which may include analyzing and rearranging the OSD image data, to obtain processed OSD image data. The display data of the processed source image and the display data of the processed OSD image are output to the data fusion module for data fusion, and the fused display data of the source image and the OSD image are output to the backend via the data conversion and transmission module. The display data of the fused source image and the display data of the OSD image may be stored in a storage medium of the display device (e.g., EEPROM (Electrically Erasable Programmable Read-Only Memory), Flash (Flash EEPROM Memory), and ROM (Read-Only Memory). When needed for display, the fused data is output from the storage medium, and the source image and the OSD image are displayed under display timing control. The data fusion method for the display data of the processed source image and the display data of the processed OSD image may be a substitution or superposition method.

[0081] Illustratively, how source image data and OSD image data are converted into display data on the display screen 10 and displayed on the display screen 10 will be described with reference to FIG.

[0082] First, image data to be displayed is acquired. The image data to be displayed includes source image data and OSD image data. The OSD image data may be acquired from a memory of a system-side circuit, or the source image data may be acquired by a front end as shown in Fig. 8. Next, during data analysis, data analysis is performed on the source image data and OSD image data. The analysis may include decompression, and the decompression may obtain display parameters of the source image data and display data corresponding to the display parameters, and display parameters of the OSD image data and display data corresponding to the display parameters, respectively. Then, under the clock specifications, the display data of the image data and the display parameters are matched one-to-one.

[0083] Next, data rearrangement is performed, and one or more display parameters of the source image data and the OSD image data are traversed to obtain required display data. The required display data may be display data of a certain region. Data processing is performed on the required display data. The data processing method may be pixel value adjustment or increasing or decreasing by a rendering operation. Processed display data is obtained. The processed display data may be different from the display data of the OSD image stored in the system-side circuit. The processed display data is made to correspond one-to-one with the display parameter to which it belongs.

[0084] Finally, when displaying an image, first, information about the display area in the display parameters corresponding to the processed display data is obtained. That is, the display area corresponding to the processed display data is obtained. When the data stream of the processed display data reaches the start position D0 of the OSD display waiting area 20, superimposed data obtained by the display data of the processed OSD image and the display data of the processed source image may be displayed, or only the display data of the processed OSD image may be displayed. In a display area other than the OSD display waiting area 20 on the display screen 10, the display data of the processed source image may be directly displayed.

[0085] It is understood that the source image data and OSD image data, the analyzed source image data and the analyzed OSD image data, the rearranged source image data and the rearranged OSD image data, the processed source image data and the processed OSD image data, and the fused data may all be stored in the memory of the system circuit or the memory of the display device to facilitate subsequent recall or direct use. Although the present disclosure describes an example in which OSD image data is stored in the memory of the system circuit, this disclosure is not limited to displaying an OSD image based solely on the OSD image data stored in the system circuit during actual use, and is not limited to whether the source image data and the OSD image data need to be analyzed, rearranged, processed, or fused during actual use. That is, when the analyzed source image data and the analyzed OSD image data, the rearranged source image data and the rearranged OSD image data, the processed source image data and the processed OSD image data, and the fused data are stored in the memory of the system circuit or the memory of the display device, the required data may be directly recalled or used according to actual needs.

[0086] In some embodiments, as shown in FIG. 10, the display method further includes the following steps:

[0087] Step 1001: Obtain a first command, which is used to switch the display mode of an OSD image from 3D display to 2D display, or switch the display mode of an OSD image from 2D display to 3D display.

[0088] Exemplarily, the first command may be an enable signal EN for switching between 3D and 2D display. When an OSD image needs to be displayed, the enable signal may be used to switch from 3D display to 2D display, or from 2D display to 3D display. The present disclosure does not limit the manner of obtaining the first command. Exemplarily, the enable signal may be provided by a switch button on a user's operating handle or remote control. Each time the user presses the switch button, the 3D display and the 2D display are switched once. For example, when the button is not pressed, the enable signal is low, and the system side obtains the first command and switches the display mode of the OSD image to 2D display, so that the display mode of the OSD image is 2D. When the user presses the switch button, the enable signal is high, and the system side obtains the first command and switches the display mode of the OSD image to 3D display, so that the display mode of the OSD image is 3D. Exemplarily, the enable signal EN may be generated by the system side. For example, the system automatically converts between 2D and 3D display after determining that a certain parameter or a plurality of parameters have reached a certain preset condition.

[0089] Step 1002: Obtain two-dimensional OSD image data or three-dimensional OSD image data in response to a first command.

[0090] Exemplarily, the 2D OSD image data may be obtained by de-3Dizing OSD sub-image data for n viewpoints. When the system side receives a first command, the system side may retrieve the OSD sub-image data for n viewpoints from a memory of the system side circuit and perform de-3D data processing to obtain the 2D OSD image data. Exemplarily, the 2D OSD image data may also be stored in a memory of the system side circuit. When the system side receives a first command, the system side may retrieve the 2D OSD image data from a memory of the system side circuit. Exemplarily, the 2D OSD image data may be OSD sub-image data for a certain viewpoint from the OSD sub-image data for n viewpoints. When the system side receives a first command, the system side may directly retrieve the OSD sub-image data for a certain viewpoint from the OSD sub-image data for n viewpoints from the memory of the system side circuit. The present disclosure does not limit the method of obtaining the 2D OSD image data. The 3D OSD image data includes the above-mentioned OSD sub-image data for n viewpoints and may be obtained by taking photographs of multiple viewpoints of the first OSD model or may be obtained in real time by the second OSD model.

[0091] Step 1003: Display a two-dimensional OSD image on the display screen according to a display area corresponding to the two-dimensional OSD image data, or display a three-dimensional OSD image on the display screen according to a display area corresponding to the three-dimensional OSD image data.

[0092] For example, the display waiting area 20 corresponding to the 2D OSD image data may be arranged or generated by the system side. If the pixel values ​​of the sub-pixels in the 2D OSD image data are output to the display waiting area 20 according to the display timing, the 2D OSD image can be displayed in the display waiting area 20.

[0093] In some embodiments, as shown in FIG. 11, the display method further includes the following steps:

[0094] Step 1101: Obtain a user's face image or pupil image to determine the user's main observation area, and / or obtain a user's gesture image to determine the user's main gaze area.

[0095] For example, as shown in Fig. 12, a camera may collect a user's face image, pupil image, or gesture image. The camera may be a visible light camera and / or an infrared camera. The present disclosure does not limit the method of acquiring a user's face image, pupil image, or gesture image.

[0096] Taking a camera-based image capture as an example, face detection data processing is performed on the captured user's face image, followed by pupil detection. As shown in FIG. 13, the user's eye position and the observation angle relative to the display screen are analyzed to determine the user's eye position (e.g., E1 and E2), observation angle (e.g., α and β), or gaze point. The captured user's pupil image may be directly processed for pupil detection, and the user's eye position and the observation angle relative to the display screen may be analyzed to determine the user's eye position (e.g., E1 and E2), observation angle (e.g., α and β), or gaze point. For example, feature points may be acquired through face recognition to obtain the coordinates of the eyebrow centers. Then, the user's eye coordinates (e.g., E1 and E2) may be inferred based on the distance between the eyebrow centers and the user's eyes, thereby determining the user's eye position. For example, by calculating the angles (e.g., α and β) between the coordinates of the center of the eyebrows and the horizontal boundaries of each sub-display area 11 in the display area of ​​the OSD according to the coordinates of the center of the eyebrows, the user's observation angle or gaze point can be determined. The user's eye position E1, observation angle α, or gaze point can be used to determine the user's main observation area D11. The user's eye position E2 Alternatively, the user's main observation area D12 can be determined by the observation angle β or the gaze point. Area D2 on the display screen 10 is a display area other than the main observation area D11 and the main observation area D12.

[0097] 12, a gesture recognition process may be performed on the collected user gesture images, and the user's gesture actions or gesture action trends may be analyzed to determine the gesture command and the projection display position. Therefore, when the user interacts with the OSD image on the display screen 10, it can be determined which viewpoint area is the main area of ​​interest, i.e., the user's main viewpoint area.

[0098] In step 1102, high resolution display is performed on the OSD image data and / or source image data for the main observation area and / or main viewpoint area, and low resolution display is performed on the OSD image data and / or source image data for the area other than the main observation area and / or main viewpoint area.

[0099] 13, high resolution display is performed for OSD image data and / or source image data displayed in main observation area D11 and main observation area D12, and low resolution display is performed for OSD image data and / or source image data in area D2 on display screen 10.

[0100] Illustratively, FIG. 14 As shown in the figure, the sub-image data for n viewpoints is analyzed, and after obtaining the position information of the data, the sub-image data for n viewpoints is divided and processed, thereby realizing high-resolution display of OSD image data and / or source image data in the main observation region and / or main viewpoint region, and low-resolution display of OSD image data and / or source image data outside the main observation region and / or main viewpoint region.

[0101] For example, high-resolution display of the OSD image data and / or source image data for the primary observation area and / or primary viewpoint area may be achieved by performing intensive processing on the OSD image data and / or source image data for the primary observation area and / or primary viewpoint area. The intensive processing may include performing intensive adjustments to the image quality and / or color temperature of the OSD image data and / or source image data for the primary observation area and / or primary viewpoint area. For example, the intensive processing may include increasing the number of rendering layers of the OSD image data and / or source image data for the primary observation area and / or primary viewpoint area, increasing the complexity of a real-time generated second OSD model for the primary observation area and / or primary viewpoint area, recalling OSD sub-image data and / or source image data for all viewpoints of the primary observation area and / or primary viewpoint area in system-side circuitry, or not compressing the OSD image data and / or source image data for the primary observation area and / or primary viewpoint area when transmitting to display screen 10. The intensive processing may also include performing intensive adjustments to the display brightness of the primary observation area and / or primary viewpoint area. The present disclosure does not limit the specific method for achieving high-resolution display of OSD image data and / or source image data in the main observation area and / or main viewpoint area by performing intensive processing on the OSD image data and / or source image data in the main observation area and / or main viewpoint area.

[0102] For example, the low-resolution display of the OSD image data and / or source image data outside the primary observation area and / or primary viewpoint area may be achieved by performing simplified processing on the OSD image data and / or source image data outside the primary observation area and / or primary viewpoint area. Source imageThe simplified processing may include performing simple adjustments to the image quality and color temperature of the OSD image data and / or source image data outside the primary observation region and / or the primary viewpoint region. For example, the simplified processing may reduce the number of rendering layers of the OSD image data and / or source image data outside the primary observation region and / or the primary viewpoint region, reduce the complexity of the second OSD model generated in real time for the primary observation region and / or the primary viewpoint region, compress the OSD image data and / or source image data outside the primary observation region and / or the primary viewpoint region called by the system-side circuitry, or select only OSD image subdata for some viewpoints as the OSD image data and / or source image data outside the primary observation region and / or the primary viewpoint region. It is understood that the "some viewpoints" refers to fewer than n viewpoints, i.e., OSD image subdata for zero viewpoints and / or source image data for zero viewpoints may be selected as the OSD image data and / or source image data outside the primary observation region and / or the primary viewpoint region, i.e., no OSD image data outside the primary observation region and / or the primary viewpoint region may be displayed. The simplified processing may further include performing simple adjustments to the display brightness of the primary observation region and / or the primary viewpoint region. The present disclosure does not limit the specific method for achieving low-resolution display of OSD image data and / or source image data outside the main observation area and / or main viewpoint area by performing simplified processing on OSD image data outside the main observation area and / or main viewpoint area.

[0103] For example, when the image quality and color temperature of an OSD image and / or a source image need to be adjusted, different lookup tables can be created to allow direct and rapid image quality adjustment via the lookup tables. The lookup tables may be obtained by an algorithm and stored in a memory of a system-side circuit. Multiple lookup tables may be created for each sub-display area 11 corresponding to each sub-pixel, allowing different levels of image quality adjustment in the sub-display area 11. For example, if a sub-pixel is in the first sub-display area, simple image quality adjustment may be performed via the first lookup table. If the sub-pixel is in the first sub-display area, complex image quality adjustment may be performed via the second lookup table. The first sub-display area may be any sub-display area 11 on the display screen 10.

[0104] For example, as shown in FIG. 14 , when it is necessary to adjust the display brightness of the OSD standby area 20, a brightness adjustment global coefficient may be generated on the system side according to the OSD standby area 20. A first backlight value may be generated in the OSD standby area 20 based on the global coefficient. A plurality of adjustment coefficients corresponding to a plurality of areas may be generated according to the global coefficient and the division of the display screen 10 into areas. The adjustment method of the adjustment coefficient may be multiplication by a first fixed parameter or addition by a second fixed parameter. A second backlight value may be generated based on the adjustment coefficient of the main observation area and / or the main viewpoint area. For example, the pixel values ​​of each sub-pixel in the main observation region and / or main viewpoint region may be changed by multiplying the pixel values ​​of each sub-pixel in the main observation region and / or main viewpoint region by a first fixed parameter corresponding to the main observation region and / or main viewpoint region, or by adding the pixel values ​​of each sub-pixel in the main observation region and / or main viewpoint region by a second fixed parameter corresponding to the main observation region and / or main viewpoint region, thereby adjusting the display brightness of the OSD image and / or source image in the main observation region and / or main viewpoint region. A third backlight value may be generated based on an adjustment coefficient for a display region other than the main observation region and / or main viewpoint region. The display brightness adjustment method is similar to the display brightness adjustment method for the main observation region and / or main viewpoint region and will not be repeated here. The first backlight value, second backlight value, and third backlight value are processed and then integrated and output, thereby adjusting the display brightness of the display screen 10 according to the backlight value in the OSD display standby region 20. It will be appreciated that the display brightness of any region on the display screen 10 may be adjusted to a grayscale display by a global factor or an adjustment factor.

[0105] For example, a local dimming algorithm may be used to realize high-resolution display or low-resolution display for different regions of the display screen 10. For example, a simple dimming algorithm such as a single algorithm may be used to perform low-resolution display for OSD image data and / or source image data other than the main observation region and / or main viewpoint region, and a weighting of multiple algorithms in the dimming algorithm may be used to perform high-resolution display for the OSD image data and / or source image data in the main observation region and / or main viewpoint region.

[0106] As shown in FIG. 14, the display brightness of the main observation area and / or main viewpoint area is high, while the display brightness of display areas other than the main observation area and / or main viewpoint area is low. Therefore, if no processing is performed, the visual effect may be reduced, potentially resulting in a poor user experience. Therefore, screen compensation processing may be performed on the display data of all OSD display waiting areas 20. If the main observation area and / or main viewpoint area includes multiple sub-display areas 11, a transition algorithm may be performed on the display data spanning the areas. The display data spanning the areas includes the display data of the main observation area and / or main viewpoint area. The processed display data of the OSD display waiting areas 20 is output after integration, thereby achieving a better visual effect at the boundary positions of the main observation area and / or main viewpoint area and at the positions where the sub-display areas 11 meet.

[0107] In some embodiments, if the OSD image to be displayed is an OSD interactive content, the display area where the OSD interactive content is located is forcibly determined as the main observation area and / or the main viewpoint area, and in this case, the display brightness of the observation area and / or the main viewpoint area on the display screen 10 is increased, and the main observation area and / or the main viewpoint area on the display screen 10 are Main View AreaThe display brightness of the display area other than the main observation area and / or the main viewpoint area is reduced, thereby guiding the viewer to move their gaze to the OSD interactive content on the display screen 10. In this case, the amount of calculation may be reduced by directly filtering the OSD image data and / or source image data other than the main observation area and / or the main viewpoint area, and using only a dimming algorithm to perform high-resolution display of the OSD image data for the main observation area and / or the main viewpoint area.

[0108] For example, as shown in Fig. 15, a user may interact with an OSD image. The system side issues a command to display an OSD image. After the display screen 10 receives the command, the OSD image is displayed in the OSD display waiting area 20 and maintained for T1 seconds. T1 is a positive number. If the user performs an interactive operation within T1 seconds, the display screen 10 will send the interactive operation back to the system side (e.g., a graphics card) in the form of a command. The system side will determine the type of command and then perform data transmission with the display screen 10.

[0109] For example, as shown in FIG. 15 , the command may be a first command. If the first command is to switch to another OSD image, the system controls the display screen 10 of the display device to display the other OSD image and maintain the display for T2 seconds. T2 is a positive number. It is determined within T2 seconds whether the command is issued again. The command may be a second command. If the second command is to enter a first sub-content of the OSD image, the system controls the display screen 10 of the display device to display the first sub-content and maintain the display for T3 seconds. T3 is a positive number. It is determined within T3 seconds whether the command is issued again. The command may be a third command. If the third command is to enter a second sub-content of the OSD image, the system controls the display screen 10 of the display device to display the second sub-content and maintain the display for T4 seconds. T4 is a positive number. It is determined within T4 seconds whether the command is issued again. The command may be a fourth command. If the fourth command is an exit command, the system controls the display screen 10 of the display device to display the source image, and the OSD image disappears. If no command is issued within T1, T2, T3, or T4 seconds, the system controls the display screen 10 of the display device to display the source image, and the OSD image disappears. It is understood that the specific values ​​of T1, T2, T3, and T4 may be the same or different, and the present disclosure does not limit the specific values ​​of T1, T2, T3, and T4. The second sub-content may be a sub-content of the OSD image or a sub-content of the first sub-content. The sub-content of the OSD image may be any sub-content. The present disclosure does not limit the specific types, priorities, and levels of the first sub-content and the second sub-content.

[0110] In some embodiments of the present disclosure, a computer-readable storage medium (e.g., a non-transitory computer-readable storage medium) is provided, and computer program instructions are stored in the computer-readable storage medium, and when the computer program instructions are run on a computer (e.g., a display device), the computer performs the display method described in any of the above embodiments.

[0111] Illustratively, the computer-readable storage medium includes, but is not limited to, magnetic storage devices (e.g., hard disks, floppy disks, or magnetic tapes), optical disks (e.g., compact disks (CDs), digital versatile disks (DVDs), smart cards, and flash memory devices (e.g., erasable programmable read-only memories (EPROMs), cards, sticks, or key drives). The various computer-readable storage media described in this disclosure may represent one or more devices and / or other machine-readable storage media for storing information. The term "machine-readable storage medium" may include, but is not limited to, wireless channels and various other media capable of storing, containing, and / or carrying instructions and / or data.

[0112] Some embodiments of the present disclosure further provide a computer program product, which includes computer program instructions that, when executed on a computer (e.g., a display device), cause the computer to perform the display method described in the above embodiments.

[0113] Some embodiments of the present disclosure further provide a computer program, which, when executed on a computer (e.g., a display device), causes the computer to perform the display method described in the above embodiments.

[0114] The beneficial effects of the above computer-readable storage medium, computer program product, and computer program are the same as the beneficial effects of the display method described in the above several embodiments, and will not be repeated here.

[0115] Some embodiments of the present disclosure further provide a display device, and as shown in FIG. 16, the display device 160 includes a display screen 10, a data acquisition device 161, and a data processing device 162.

[0116] As shown in FIG. 1, a display screen 10 includes a plurality of sub-display areas 11.

[0117] 16, the data acquisition device 161 is configured to acquire image data to be displayed. The image data to be displayed includes OSD image data, and the OSD image data includes OSD sub-image data from n viewpoints, where n is an integer equal to or greater than 2.

[0118] As shown in Fig. 16, the data processing device 162 is configured to analyze OSD image data and perform data rearrangement on the analyzed OSD image data. According to the position information of the OSD image data, the data processing device 162 determines a corresponding display waiting area 20 on the display screen 10 for the OSD image data, and controls to display the rearranged OSD image data in the display waiting area 20 on the display screen 10. The display waiting area 20 includes at least one sub-display area 11, and the rearranged OSD image data includes OSD sub-image data of some or all of the rearranged viewpoints. Exemplarily, as shown in Fig. 8, the data processing device includes a data receiving and conversion module, a data analysis and rearrangement module, a display data processing module, OSD Image It may include a data processing module, a data fusion module, and a data conversion and transmission module.

[0119] Based on the above aspect, the image data to be displayed includes OSD image data, and the OSD image data includes OSD sub-image data from n viewpoints. That is, the image data to be displayed includes OSD sub-image data for n viewpoints. The OSD sub-image data for the n viewpoints may be stored in a memory of a system-side circuit. To ensure accurate image display, the image data must be scattered and reconstructed on the system side (e.g., a graphics card), and the reconstructed image data must be input to a control system of the display device. The control system of the display device analyzes and rearranges the data, and outputs the rearranged image data to the display screen 10 of the display device according to display needs. This allows OSD images from multiple viewpoints to be simultaneously displayed on one frame of the display screen 10, thereby realizing 3D OSD display.

[0120] 9, the image data to be displayed further includes source image data, and the data processing device 162 is further configured to analyze the source image data and perform data rearrangement on the analyzed source image data. The display range of the source image may be the entire display screen 10 or a partial display area of ​​the display screen 10.

[0121] In some embodiments, as shown in Figures 7A to 7F, the data processing device 162 is configured to use the rearranged OSD image data to replace the rearranged source image data corresponding to the display waiting area 20, or to superimpose the rearranged OSD image data on the rearranged source image data corresponding to the display waiting area 20, depending on the display waiting area 20 corresponding to the OSD image data.

[0122] In some embodiments, as shown in Figures 7E and 7F, the data processing device is configured to set transparency for the rearranged OSD image data and superimpose the rearranged OSD image data after the transparency has been set on the rearranged source image data corresponding to the display waiting area 20.

[0123] In some embodiments, as shown in FIG. 7A , the OSD subimage data for each viewpoint includes A subpixels, where A is an integer greater than or equal to 2. The data processing device is configured to rearrange all subpixels in the OSD subimage data for the n viewpoints. In the rearranged OSD subimage data corresponding to the n viewpoints, different subpixels are located in different rows. The subpixels may include red subpixels, green subpixels, blue subpixels, black subpixels, white subpixels, and yellow subpixels.

[0124] 7A , the A subpixels include a first subpixel, which is any one of the A subpixels, and the first subpixel includes t subpixels, where t is an integer greater than or equal to 2. Each subpixel of the source image data for each viewpoint includes m subpixels, where m is an integer greater than or equal to 1. It is understood that the values ​​of m and t may be the same or different.

[0125] In some embodiments, the data processing device 162 is configured to analyze the OSD image data and obtain display parameters of the OSD image data and display data of the OSD image data. The display parameters of the OSD image data include the number of viewpoints and sub-display area identifiers corresponding to the OSD image data, and the size of the display data of the OSD image data. Data rearrangement is performed on the display data of the OSD image data according to the display parameters of the OSD image data. The sub-display area identifiers corresponding to the OSD image data may be obtained by labeling the sub-display areas 11 of the display screen 10.

[0126] In some embodiments, the data acquisition device 161 is configured to use n virtual cameras to capture a first OSD model from different viewpoints and obtain OSD sub-image data for n viewpoints, or to use a 3D modeling or image processor to capture a second OSD model and obtain OSD sub-image data for n viewpoints according to the second OSD model. The second OSD model may be generated in real time by the 3D modeling or image processor, and the OSD sub-image data for n viewpoints can be obtained by slicing or image generation and output for different viewpoints based on the second OSD model. The operation of the 3D modeling or image processor may be performed in the following manner: display device This may be completed by the company's internal systems or by an external system.

[0127] In some embodiments, the position information of the OSD image data includes the start position of the display waiting area 20, and length and width information of the display waiting area 20. Starting point position The range of the display waiting area 20 can be determined according to the length information and width information of the display waiting area 20.

[0128] In some embodiments, the data acquisition device is further configured to acquire a first command, the first command being used to switch the display format of the OSD image from 3D display to 2D display, or to switch the display format of the OSD image from 2D display to 3D display. The data acquisition device is further configured to acquire two-dimensional OSD image data or three-dimensional OSD image data in response to the first command. The data processing device is configured to control displaying a two-dimensional OSD image on the display screen 10 according to the display waiting area 20 corresponding to the two-dimensional OSD image data, or displaying a three-dimensional OSD image on the display screen 10 according to the display waiting area 20 corresponding to the three-dimensional OSD image data. Thus, the present disclosure can realize switching between 2D display and 3D display.

[0129] In some embodiments, the display device is a collection device. 164The collecting device is configured to acquire a face image or a pupil image of a user to determine a main observation region of the user, and / or acquire a gesture image of the user to determine a main gaze region of the user. The data processing device is further configured to perform high-resolution display for OSD image data of the main observation region and / or the main gaze region, and perform low-resolution display for OSD image data outside the main observation region and / or the main gaze region. By rationally configuring the data processing device 162 and performing different data processing for different regions, better visual effects can be ensured and waste of computing resources can be avoided.

[0130] The display device provided by some embodiments of the present disclosure can realize 3D display of OSD images, and allows a user to view different OSD images from different viewpoints, and can also divide the areas to display high resolution or low resolution images for different areas.

[0131] The above are merely specific embodiments of the present disclosure, and the scope of protection of the present disclosure is not limited thereto. Any modifications or replacements that can be easily thought of by a person skilled in the art within the technical scope of the present disclosure are intended to be embraced within the technical scope of the present disclosure. Therefore, the scope of protection of the present disclosure shall be governed by the scope described in the claims.

Claims

1. A display method applied to a display device, the display screen of the display device has a plurality of sub-display areas, The display method includes: acquiring image data to be displayed, the image data to be displayed including OSD image data, the OSD image data including OSD sub-image data from n viewpoints, where n is an integer equal to or greater than 2; analyzing the OSD image data and performing data rearrangement on the analyzed OSD image data; a step of determining a corresponding display waiting area on the display screen of the OSD image data according to position information of the OSD image data, and displaying the rearranged OSD image data in the display waiting area, the display waiting area including at least one of the sub-display areas, and the rearranged OSD image data including OSD sub-image data of some or all of the rearranged viewpoints; Including, Display method.

2. The display-ready image data further includes source image data; The method comprises: further comprising the steps of analyzing the source image data and performing data rearrangement on the analyzed source image data. The display method according to claim 1 .

3. a step of displaying the rearranged OSD image data in the display waiting area according to a corresponding display waiting area on the display screen of the OSD image data, a step of using the rearranged OSD image data to replace the rearranged source image data corresponding to the display waiting area on the display screen, according to the corresponding display waiting area of ​​the OSD image data, or a step of superimposing the rearranged OSD image data on the rearranged source image data corresponding to the display waiting area; The display method according to claim 1 or 2.

4. The step of superimposing the rearranged OSD image data on the rearranged source image data corresponding to the display waiting area includes: a step of setting transparency for the rearranged OSD image data, and superimposing the rearranged OSD image data after the transparency is set on the rearranged source image data corresponding to the display waiting area; The display method according to claim 3.

5. the OSD sub-image data for each viewpoint includes A sub-pixels, where A is an integer equal to or greater than 2; The step of performing data rearrangement on the analyzed OSD image data includes: rearranging all sub-pixels in the OSD sub-image data of the n viewpoints, wherein different sub-pixels are located in different rows in the rearranged OSD sub-image data corresponding to the n viewpoints; The display method according to any one of claims 1 to 4.

6. the A sub-pixels include a first sub-pixel, the first sub-pixel being any one of the A sub-pixels, and the first sub-pixel includes t sub-pixels, where t is an integer equal to or greater than 2; The display method according to claim 5.

7. The step of analyzing the OSD image data and performing data rearrangement on the analyzed OSD image data includes: a step of analyzing the OSD image data and obtaining display parameters of the OSD image data and display data of the OSD image data, the display parameters of the OSD image data including the number of viewpoints and sub-display area identifiers corresponding to the OSD image data, and the capacity of the display data of the OSD image data; performing data rearrangement on display data of the OSD image data in accordance with display parameters of the OSD image data; Including, The display method according to any one of claims 1 to 6.

8. The method for acquiring the OSD sub-image data of the n viewpoints includes: Using n cameras to photograph the first OSD model from different viewpoints, and obtain OSD sub-image data for the n viewpoints; or obtaining a second OSD model using a three-dimensional modeling or image processor, and obtaining OSD sub-image data of the n viewpoints according to the second OSD model; Including, The display method according to any one of claims 1 to 7.

9. The position information of the OSD image data includes a start position of the display waiting area, and length information and width information of the display waiting area. The display method according to any one of claims 1 to 7.

10. The display method includes: acquiring a first command, the first command being used to switch a display format of an OSD image from 3D display to 2D display, or to switch a display format of an OSD image from 2D display to 3D display; acquiring two-dimensional OSD image data or three-dimensional OSD image data in response to the first command; displaying a two-dimensional OSD image on the display screen in accordance with a display waiting area corresponding to the two-dimensional OSD image data, or displaying a three-dimensional OSD image on the display screen in accordance with a display waiting area corresponding to the three-dimensional OSD image data; further comprising: The display method according to any one of claims 1 to 7.

11. The display method includes: acquiring a face image or a pupil image of a user and determining a main observation area of ​​the user, and / or acquiring a gesture image of the user and determining a main gaze area of ​​the user; a staff that performs high-resolution display of OSD image data and / or source image data of the main observation area and / or the main viewpoint area; providing a low-resolution display of OSD image data and / or source image data outside the primary observation area and / or primary viewpoint area; further comprising: The display method according to any one of claims 1 to 10.

12. A computer-readable storage medium, the computer-readable storage medium storing computer program instructions, the computer performing the display method according to any one of claims 1 to 11 when the computer-readable storage medium stores computer program instructions. Readable storage medium.

13. A computer program product, the computer program product comprising computer program instructions, which when executed on a computer, cause the computer to perform the display method of any one of claims 1 to 11. Computer program products.

14. A display device, a display screen including a plurality of sub-display areas; a data acquisition device configured to acquire image data to be displayed, the image data to be displayed including OSD image data, the OSD image data including OSD sub-image data from n viewpoints, where n is an integer equal to or greater than 2; a data processing device configured to analyze the OSD image data and perform data rearrangement on the analyzed OSD image data; Equipped with determining a corresponding display waiting area on the display screen for the OSD image data according to position information of the OSD image data, and controlling to display the rearranged OSD image data in the display waiting area on the display screen, the display waiting area including at least one of the sub-display areas, and the rearranged OSD image data including OSD sub-image data of some or all of the rearranged viewpoints; Display device.

15. The display-ready image data further includes source image data; The data processing device further comprises: configured to analyze the source image data and perform data rearrangement on the analyzed source image data; The display device according to claim 14.

16. The data processing device includes: the rearranged OSD image data is used in accordance with a display waiting area corresponding to the OSD image data to replace the rearranged source image data corresponding to the display waiting area, or the rearranged OSD image data is superimposed on the rearranged source image data corresponding to the display waiting area. The display device according to claim 14 or 15.

17. The data processing device includes: a transparency is set for the rearranged OSD image data, and the rearranged OSD image data after the transparency is set is superimposed on the rearranged source image data corresponding to the display waiting area; The display device according to any one of claims 14 to 16.

18. The OSD sub-image data for each viewpoint includes A sub-pixels, where A is an integer equal to or greater than 2; The data processing device includes: configured to rearrange all sub-pixels in the OSD sub-image data of the n viewpoints, wherein different sub-pixels are located in different rows in the rearranged OSD sub-image data corresponding to the n viewpoints; The display device according to any one of claims 14 to 17.

19. the A sub-pixels include a first sub-pixel, the first sub-pixel being any one of the A sub-pixels, and the first sub-pixel includes t sub-pixels, where t is an integer equal to or greater than 2; The display device according to any one of claims 14 to 18.

20. The data processing device includes: The OSD image data is analyzed to obtain display parameters of the OSD image data and display data of the OSD image data, and the display parameters of the OSD image data include the number of viewpoints and sub-display area identifier corresponding to the OSD image data, and the capacity of the display data of the OSD image data; and performing data rearrangement on the display data of the OSD image data in accordance with a display parameter of the OSD image data. The display device according to any one of claims 14 to 18.

21. The data acquisition device Using n virtual cameras to photograph the first OSD model from different viewpoints, and obtain OSD sub-image data for the n viewpoints; or configured to obtain a second OSD model using a three-dimensional modeling or image processor, and obtain OSD sub-image data of the n viewpoints according to the second OSD model; The display device according to any one of claims 14 to 20.

22. The position information of the OSD image data includes a start position of the display waiting area, and length information and width information of the display waiting area. The display device according to any one of claims 14 to 20.

23. The data acquisition device further comprises: a first command is acquired, the first command being used to switch a display format of an OSD image from 3D display to 2D display, or to switch a display format of an OSD image from 2D display to 3D display; configured to acquire two-dimensional OSD image data or three-dimensional OSD image data in response to the first command; The data processing device includes: The display control unit is configured to control displaying a two-dimensional OSD image on the display screen in accordance with a display waiting area corresponding to the two-dimensional OSD image data, or to control displaying a three-dimensional OSD image on the display screen in accordance with a display waiting area corresponding to the three-dimensional OSD image data. The display device according to any one of claims 14 to 20.

24. The display device includes: a collection device configured to acquire a face image or a pupil image of the user and determine a main observation area of ​​the user, and / or to acquire a gesture image of the user and determine a main gaze area of ​​the user; The data processing device further comprises: a high-resolution display for OSD image data and / or source image data in the main observation area and / or the main viewpoint area, and a low-resolution display for OSD image data and / or source image data outside the main observation area and / or the main viewpoint area; The display device according to any one of claims 14 to 23.

Images