Display control method and apparatus for display screen, and module, device, and medium

Abstract

A display control method and apparatus for a display screen, and a module, a device, and a medium, relating to the technical field of display of display products. In the display control method, a black area other than a visible area corresponding to an area visible to human eyes is determined; mask processing is performed on the basis of pixel values of the black area and the visible area corresponding to coordinate values of the display screen to obtain a corresponding mask image, the mask image enabling the content in an area invisible to the human eyes on the display screen to be black and non-luminous; and the mask image is superimposed on a display picture of a display area so as to achieve non-display of the area invisible to the human eyes, thereby reducing the luminous power consumption of the display area of the display screen without changing the physical shape corresponding to the display area of the display screen.

Description

Display control method, device, module, equipment and medium for display screen

[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on February 23, 2024, with application number 202410201051.4 and invention name “Display control method, device, module, equipment and medium for display screen”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of display technology of display products, and in particular to a display control method, device, module, equipment and medium for a display screen. Background Art

[0003] As users' requirements for wearable devices gradually increase, while achieving lightweight portability, the power consumption of wearable devices is also a factor to be pursued during the product design process.

[0004] The displays of currently mass-produced wearable devices, such as head-mounted displays (HMDs), are generally rectangular. However, due to the HMD's more elliptical field of view, this mismatches with the rectangular display screen. This results in some pixels on the display being hidden from view, creating areas that are partially obscured by the HMD and invisible to the eye. These areas also emit light along with the visible area on the display, wasting power consumption.

[0005] Therefore, how to reduce the power consumption of the portion of the display screen that is blocked by the head-mounted display device is an urgent problem that needs to be solved by those skilled in the art. Summary of the Invention

[0006] The purpose of this application is to provide a display control method, device, module, equipment and medium for a display screen to solve the problem of power consumption waste caused by the display screen portion blocked by the current head-mounted display device.

[0007] To solve the above technical problems, the present application provides a display control method for a display screen, comprising:

[0008] Determining pixel values ​​of a black area and pixel values ​​of a visible area within a display area of ​​a display screen corresponding to coordinate values ​​of the display screen;

[0009] Performing mask processing according to the pixel values ​​of the black area and the pixel values ​​of the visible area corresponding to the coordinate values ​​of the display screen to determine a mask image corresponding to the display area;

[0010] The mask image is superimposed on the display image of the display area to complete the control of the display area.

[0011] On the one hand, controlling the display area includes:

[0012] The alpha information of a single channel corresponding to the mask image to which the black area belongs is controlled to be smaller than the alpha information of a single channel corresponding to the mask image to which the visible area belongs.

[0013] On the other hand, controlling the display area includes:

[0014] Controlling the visible area to be displayed in a first display mode;

[0015] Controlling the black area to be displayed in a second display mode;

[0016] Wherein, in the first display mode, the brightness and darkness of the visual area presented to the corresponding user changes with the brightness and darkness of the display screen;

[0017] In the second display mode, the brightness or darkness of the black area presented to the user is independent of the brightness or darkness of the display image.

[0018] On the other hand, the process of determining the black area includes:

[0019] Obtaining the screen resolution of the display screen;

[0020] Obtain a style drawing of the visual area;

[0021] Matching the resolution of the style sheet to the screen resolution;

[0022] The area other than the visible area in the matched style drawing is used as the black area.

[0023] On the other hand, the process of determining the black area includes:

[0024] Obtaining a virtual image of a head-mounted display device captured by a human eye-mimicking camera and a screen resolution of the display screen;

[0025] Calibrate the coordinate values ​​corresponding to the screen resolution according to a first mapping relationship between the coordinate values ​​corresponding to the screen resolution and the pixel coordinate values ​​corresponding to the virtual image to obtain a visible area of ​​the display screen;

[0026] The area in the display area except the visible area serves as the black area.

[0027] On the other hand, performing mask processing according to the pixel values ​​of the black area and the pixel values ​​of the visible area respectively corresponding to the coordinate values ​​of the display screen to determine the mask image corresponding to the display area includes:

[0028] Pre-establishing a second mapping relationship between pixel values ​​of the mask image and pixel values ​​of the display area;

[0029] The alpha information of a single channel corresponding to the mask image is set according to the second mapping relationship, the pixel values ​​of the black area and the pixel values ​​of the visible area respectively corresponding to the coordinate values ​​of the display screen to generate the mask image.

[0030] On the other hand, the step of setting the alpha information of a single channel corresponding to the mask image according to the second mapping relationship, the pixel values ​​of the black area, and the pixel values ​​of the visible area corresponding to the coordinate values ​​of the display screen to generate the mask image includes:

[0031] Pre-acquiring an initial mask image stored in the head-mounted display device;

[0032] Setting the alpha information of a single channel corresponding to the initial mask image according to the second mapping relationship, the pixel values ​​of the black area, and the pixel values ​​of the visible area corresponding to the coordinate values ​​of the display screen respectively, to generate the mask image;

[0033] Alternatively, call the region to draw the target shape in the database;

[0034] Drawing a closed path having the same shape as the target in the display area according to the area drawing algorithm of the display area, the second mapping relationship, and the pixel values ​​of the black area and the pixel values ​​of the visible area corresponding to the coordinate values ​​of the display screen;

[0035] The mask image is obtained by setting the alpha information of the single channel corresponding to the interior and exterior of the closed path.

[0036] On the other hand, the display area also includes an edge transition area, which is located between the black area and the visible area. The alpha information of the single channel corresponding to the mask image to which the edge transition area belongs is greater than the alpha information of the single channel corresponding to the mask image to which the black area belongs, and is smaller than the alpha information of the single channel corresponding to the mask image to which the visible area belongs.

[0037] On the other hand, superimposing the mask image with the display screen of the display area to complete the control of the display area includes:

[0038] Obtaining the RGB value of the display area and the alpha information corresponding to the mask image;

[0039] Performing a superposition process on the RGB value of the display area and the alpha information corresponding to the mask image to determine an updated RGB value;

[0040] Apply the updated RGB value to the display area.

[0041] On the other hand, after superimposing the mask image with the display screen of the display area to complete the control of the display area, the method further includes:

[0042] Acquire a first visible area before the mask image is turned on and a second visible area after the mask image is turned on;

[0043] Determining whether pixel values ​​corresponding to the first visible area and the second visible area are the same;

[0044] If they are the same, it is determined that the mask image does not block the visible area;

[0045] If they are different, determining that the mask image blocks the visible area;

[0046] When the mask image blocks the area of ​​the visible area, the blocked area of ​​the mask image is adjusted to obtain an adjusted mask image, and the process returns to the step of superimposing the mask image with the display screen of the display area to complete the control of the display area.

[0047] To solve the above technical problems, the present application further provides a display control device for a display screen, comprising:

[0048] a determination module, configured to determine pixel values ​​of a black area and pixel values ​​of a visible area within a display area of ​​a display screen corresponding to coordinate values ​​of the display screen;

[0049] a mask processing module, configured to perform mask processing on the pixel values ​​of the black area and the pixel values ​​of the visible area corresponding to the coordinate values ​​of the display screen to determine a mask image corresponding to the display area;

[0050] The superposition module is used to superimpose the mask image with the display image of the display area to complete the control of the display area.

[0051] To solve the above technical problems, the present application also provides a head-mounted display device, comprising:

[0052] Memory for storing computer programs;

[0053] A processor is configured to implement the steps of the display control method for a display screen as described above when executing the computer program.

[0054] To solve the above technical problems, the present application also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the display control method of the display screen as described above are implemented.

[0055] In order to solve the above technical problems, the present application also provides a display module, which includes a display screen and a lens, wherein the display screen is controlled by the display control method of the display screen described above; wherein the visible area of ​​the display screen is arranged opposite to the lens, and the black area of ​​the display screen is located outside the visible area.

[0056] On the one hand, the display module further includes a display driver chip, and the display driver chip is used to execute the display control method of the display screen described above.

[0057] In order to solve the above technical problems, the present application also provides a head-mounted display device, which includes at least one display module, wherein the display module adopts the structure of the display module described above.

[0058] The present application provides a display control method for a display screen, comprising: determining pixel values ​​of a black area and pixel values ​​of a visible area within a display area of ​​the display screen corresponding to coordinate values ​​of the display screen; performing masking processing based on the pixel values ​​of the black area and the pixel values ​​of the visible area corresponding to the coordinate values ​​of the display screen to determine a mask image corresponding to the display area; and superimposing the mask image with the display screen of the display area to complete the control of the display area. The present application determines a black area outside the visible area corresponding to the human eye visible area, and obtains a corresponding mask image by performing masking processing based on the pixel values ​​of the black area and the visible area corresponding to the coordinate values ​​of the display screen. The mask image makes the content of the non-human eye visible area of ​​the display screen black and non-luminous. Superimposing the mask image with the display screen of the display area can realize the non-display of the non-human eye visible area without changing the physical shape corresponding to the display area of ​​the display screen, while reducing the luminous power consumption of the display area of ​​the display screen.

[0059] In addition, the present application also provides a display area device of a display screen, a head-mounted display device, a medium, and a display module, which have the same beneficial effects as the display control method of the above-mentioned display screen. BRIEF DESCRIPTION OF THE DRAWINGS

[0060] In order to more clearly illustrate the embodiments of the present application, the following is a brief introduction to the drawings required for use in the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0061] FIG1 is a flow chart of a display control method of a display screen provided in an embodiment of the present application;

[0062] FIG2 is a schematic diagram of a masking and overlaying process provided by an embodiment of the present application;

[0063] FIG3 is a schematic diagram of a style drawing provided in an embodiment of the present application;

[0064] FIG4 is a schematic diagram of a visual area provided in an embodiment of the present application;

[0065] FIG5 is a schematic diagram of a display area for drawing a straight line shape provided by an embodiment of the present application;

[0066] FIG6 is a schematic diagram of a display area for drawing straight lines and arc shapes provided by an embodiment of the present application;

[0067] FIG7 is a schematic diagram of a display area of ​​a Bezier curve provided in an embodiment of the present application;

[0068] FIG8 is a schematic diagram of a display area provided in an embodiment of the present application;

[0069] FIG9 is a structural diagram of a display control device for a display screen provided in an embodiment of the present application;

[0070] FIG10 is a structural diagram of a head-mounted display device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0071] The following will be combined with the accompanying drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0072] The core of this application is to provide a display control method, device, module, equipment and medium for a display screen to solve the problem of power consumption waste caused by the display screen portion blocked by the current head-mounted display device.

[0073] In order to enable those skilled in the art to better understand the present application, the present application is further described in detail below with reference to the accompanying drawings and specific implementation methods.

[0074] The natural field of view of the human eye is defined as the visible area of ​​each eye. The angle of the visible area, along with the gaze direction, together determine the volume of visible visual space. The field of view (FOV) of a head-mounted display (HMD) is the angular field of view of virtual content visible to the viewer wearing the HMD. Virtual content displayed by a HMD that exceeds the natural FOV of the human eye is excessive for the viewer. The FOV of a HMD is influenced by multiple factors, including lens optical design, display size, distance between the eye and the lens, and the HMD's structural design. The field of view of mainstream HMDs currently on the market is similar to the natural field of view of the human eye, approaching an ellipse. However, mass-produced displays are generally rectangular, which does not match the HMD's field of view. Therefore, not every pixel on the screen is visible to the viewer through the HMD; some areas are obscured by the HMD and ultimately cannot be seen. However, this portion of the screen illuminates as the display brightness switches on and off, generating unnecessary power consumption.

[0075] Based on this, if the screen is cut to match the shape of the viewable area, the process of curved and contour cutting is more complicated than rectangular cutting, resulting in higher costs and lower yields, which is not conducive to industrial mass production. If the physical shape of the screen is completely matched to the head-mounted display during the initial design, however, the corresponding head-mounted display models are numerous, making it difficult to achieve universality and thus unable to be applied to other models of head-mounted displays, which in turn makes industrial mass production impossible. Therefore, the display control method for a display screen provided in this application can solve the above-mentioned technical problems.

[0076] FIG1 is a flow chart of a display control method of a display screen provided in an embodiment of the present application. As shown in FIG1 , the method includes:

[0077] S11: Determine the pixel values ​​of the black area and the pixel values ​​of the visible area within the display area of ​​the display screen, which correspond to the coordinate values ​​of the display screen respectively;

[0078] S12: performing mask processing according to the pixel values ​​of the black area and the pixel values ​​of the visible area corresponding to the coordinate values ​​of the display screen to determine a mask image corresponding to the display area;

[0079] S13: Overlaying the mask image with the display image of the display area to complete the control of the display area.

[0080] Specifically, the pixel values ​​corresponding to the black area and the visible area determined in step S11 correspond to the coordinate values ​​of the display screen, and the specific area ranges of the black area and the visible area can be determined based on the coordinate values. In addition, in this embodiment, the corresponding two-dimensional coordinate system can be set according to the same proportion of the pixel values ​​to determine the corresponding coordinate value information. The corresponding two-dimensional coordinate system can also be set based on different proportions of the pixel values ​​to obtain the coordinate values ​​corresponding to each area (black area and visible area). The black area and visible area here both refer to the corresponding display area. The black area is the area that the viewer cannot see, that is, the area where the head display device blocks the display screen. The process of determining the black area can be based on the data issued by the optical design scheme in the early stage of the design, or it can be determined by simulating the relationship between the area viewed by the person and the display area of ​​the display screen in other ways, which is not limited here.

[0081] Normally, the display area includes two parts: a black area and a visible area. The pixel values ​​of the two areas are obtained. The screen display based on the display area of ​​this application is mainly displayed in pixel values. The coordinate values ​​relative to the display screen can be established based on the pixel values. In this way, the coordinate value information corresponding to the pixel values ​​of the black area and the visible area of ​​this application realizes that the black area does not emit light.

[0082] All pixel values ​​corresponding to the display area are obtained. The purpose of obtaining the pixel values ​​here is to find the division area of ​​the black area and the visible area, and further obtain the coordinate value information of each area. Then, the coordinate value information of the display screen corresponding to the different pixel values ​​of the pre-set black area and the visible area is masked to determine the mask image. The mask image in this embodiment can be consistent with the resolution of the display screen, or set proportionally to facilitate subsequent resolution conversion and presentation. The pixel values ​​of the black area and the visible area in this embodiment correspond to the coordinate values ​​of the display screen to set which area is the black area and which area is the visible area. When setting the mask image based on different areas, the corresponding single channel coefficients are different. For example, if the single channel coefficient (alpha value) set in the black area is 0, it means that the display content of the pixel is completely black. If the single channel coefficient (alpha value) set in the visible area is 1, the display content is completely based on the original picture.

[0083] The obtained mask image is superimposed on the display screen of the display area to complete the control of the display area, and the superposition process is achieved by multiplying the alpha value of the mask image and the color value of the display screen of the original display area.

[0084] FIG2 is a schematic diagram of a mask processing and overlay processing process provided by an embodiment of the present application. As shown in FIG2 , the single-channel coefficient corresponding to the mask image is obtained based on the pixel values ​​of the black area and the visible area, which correspond to the coordinate values ​​of the display screen. The mask image is obtained based on the single-channel coefficient of each area. The mask image is superimposed on the display screen of the display area to obtain the final display screen. As can be seen in FIG2 , the single-channel coefficient of the black area is set to 0, indicating that it is completely black, and the single-channel coefficient of the visible area is set to 1, indicating that the original screen is fully displayed. There is an edge transition area between the black area and the visible area, and the single-channel coefficient of this area is set to any value in the range of [0, 1], indicating the transition state between the black area and the visible area.

[0085] An embodiment of the present application provides a display control method for a display screen, comprising: determining pixel values ​​of a black area and pixel values ​​of a visible area within a display area of ​​the display screen corresponding to coordinate values ​​of the display screen; performing masking processing based on the pixel values ​​of the black area and the pixel values ​​of the visible area corresponding to the coordinate values ​​of the display screen to determine a mask image corresponding to the display area; and superimposing the mask image with the display screen of the display area to complete the control of the display area. The present application determines a black area outside the visible area corresponding to the human eye visible area, and obtains a corresponding mask image by performing masking processing based on the pixel values ​​of the black area and the visible area corresponding to the coordinate values ​​of the display screen. The mask image makes the content of the non-human eye visible area of ​​the display screen black and non-luminous. Superimposing the mask image with the display screen of the display area can realize the non-display of the non-human eye visible area without changing the physical shape corresponding to the display area of ​​the display screen, while reducing the luminous power consumption of the display area of ​​the display screen.

[0086] In some embodiments, controlling the display area includes:

[0087] The alpha information of the single channel corresponding to the mask image to which the black area belongs is controlled to be smaller than the alpha information of the single channel corresponding to the mask image to which the visible area belongs.

[0088] Specifically, during the control process of the display area, the alpha information of the single channel corresponding to the mask image of the corresponding black area and the visible area is different. In traditional display areas, there is no need to distinguish between black areas and visible areas, resulting in the same light being emitted, and the luminous power consumption of the display area cannot be reduced. In this embodiment, the display area is divided into a black area and a visible area. Compared with the visible area, the alpha information of the single channel corresponding to the mask image corresponding to the black area is weakened, that is, the alpha information of the single channel corresponding to the mask image belonging to the black area is controlled to be smaller than the alpha information of the single channel corresponding to the mask image belonging to the visible area. At this time, the luminous power consumption of the display area of ​​the display screen is reduced.

[0089] It should be noted that the specific values ​​of the single-channel alpha information of the two areas are not limited, and are mainly within the range of [0, 1], as long as the single-channel alpha information corresponding to the mask image to the black area is smaller than the single-channel alpha information corresponding to the mask image to the visible area. The specific value of "smaller than" can be set according to the actual situation. Ideally, the single-channel alpha information corresponding to the mask image to the black area is set to 0, and the single-channel alpha information corresponding to the mask image to the visible area is set to 1. In addition, it can also be based on the difference in single-channel alpha information. Secondly, in the above embodiment, only the display area includes the black area and the visible area. If it also includes the edge transition area, the single-channel alpha information corresponding to the mask image to the black area is greater than the single-channel alpha information corresponding to the mask image to the edge transition area, and the single-channel alpha information corresponding to the mask image to the edge transition area is less than the single-channel alpha information corresponding to the mask image to the visible area.

[0090] This embodiment provides a method for controlling the alpha information of a single channel corresponding to the mask image of the black area to be smaller than the alpha information of a single channel corresponding to the mask image of the visible area, thereby reducing the luminous power consumption of the display area of ​​the display screen.

[0091] In some embodiments, controlling the display area includes:

[0092] Controlling the visible area to be displayed in a first display mode;

[0093] Controlling the black area to be displayed in the second display mode;

[0094] Wherein, in the first display mode, the brightness and darkness of the corresponding user presentation of the visible area changes with the brightness and darkness of the display screen;

[0095] In the second display mode, the brightness and darkness of the black area presented to the user is irrelevant to the brightness and darkness of the display screen.

[0096] It is understandable that, from the user's perspective, the brightness and darkness of the visible area and the black area presented to the user at different display modes are different. The brightness and darkness presented to the user in the first display mode of the visible area changes with the brightness and darkness of the displayed image, while the brightness and darkness presented to the user in the second display mode of the black area are independent of the brightness and darkness of the displayed image. In other words, from the user's perspective, the brightness and darkness of the visible area in the first display mode that the user sees changes in real time with the brightness and darkness of the displayed image, while the brightness and darkness of the black area in the second display mode that the user cannot see is independent of the brightness and darkness of the displayed image.

[0097] The control of the display area provided in this embodiment is based on the different display modes corresponding to different areas from the user's perspective, thereby reducing the luminous power consumption of the display area corresponding to the black area to a certain extent.

[0098] In some embodiments, the process of determining the black area includes:

[0099] Get the screen resolution of the display;

[0100] Get the style sheet of the visible area;

[0101] Match the resolution of the stylesheet to the screen resolution;

[0102] The area other than the visible area in the matched style drawing is set as the black area.

[0103] It is understandable that this embodiment adopts the optical design scheme of the head display, and the resolution of the style drawing of the visible area set by the optical machine is usually the same as the screen resolution of the display screen, but there are also deviations. Therefore, the two resolutions are matched to match the style drawing with the display screen. The area other than the visible area in the matched style drawing is used as the black area. Since the visible area in the style drawing is already known, the range of the black area in the matched style drawing is also known. Figure 3 is a schematic diagram of a style drawing provided in an embodiment of the present application. As shown in Figure 3, the left side is the display area corresponding to the left eye, and the right side is the display area corresponding to the right eye. The black area is the black area, and the visible area is the white area.

[0104] In another embodiment, the process of determining the black area includes:

[0105] Obtaining a virtual image of a head-mounted display device captured by a human eye-mimicking camera and a screen resolution of the display screen;

[0106] Calibrate the coordinate values ​​corresponding to the screen resolution according to a first mapping relationship between the coordinate values ​​corresponding to the screen resolution and the pixel coordinate values ​​corresponding to the virtual image to obtain a visible area of ​​the display screen;

[0107] The area outside the visible area in the display area is used as a black area.

[0108] Specifically, a virtual image of the head-mounted display captured by a human eye-mimicking camera can be used to calibrate the relative mapping relationship between screen pixel coordinates and virtual image pixel coordinates, i.e., a first mapping relationship, to obtain the visible area of ​​the display screen. Figure 4 is a schematic diagram of a visible area provided in an embodiment of the present application. As shown in Figure 4, the middle area is the visible area, and the rest is the black area.

[0109] This embodiment provides two methods for determining the black area, which improves the flexibility and diversity of the black area and facilitates the subsequent determination of the mask image.

[0110] In some embodiments, performing mask processing based on pixel values ​​of the black area and pixel values ​​of the visible area corresponding to coordinate values ​​of the display screen to determine a mask image corresponding to the display area includes:

[0111] Pre-establishing a second mapping relationship between pixel values ​​of the mask image and pixel values ​​of the display area;

[0112] According to the second mapping relationship, the pixel values ​​of the black area and the pixel values ​​of the visible area respectively correspond to the coordinate values ​​of the display screen, and the alpha information of the single channel corresponding to the mask image is set to generate the mask image.

[0113] Specifically, the mask image is a raster image, and the resolution of the mask image can be consistent with the resolution of the display screen, or present a corresponding mapping relationship, so that the subsequent mask image is updated in the display area of ​​the display screen and is set with the corresponding mapping relationship.

[0114] The final mask image is determined by setting the alpha information of a single channel of the mask image based on the coordinate values ​​of the display screen corresponding to the pixel values ​​of the mask image and the display area according to the second mapping relationship. Each pixel only needs to contain single-channel alpha information. A mask alpha of 0 indicates that the display content of the pixel will be completely black, while a mask alpha of 1 indicates that the display content of the pixel will completely match the original image. Alpha values ​​between 0 and 1 represent an intermediate state.

[0115] The mask image can be produced by pre-storing it in the memory of the head-mounted display device for offline use. The alpha value of any pixel can be freely controlled, or the corresponding mask image can be drawn in real time using a code program. This application does not limit this and can be set according to actual conditions.

[0116] It is worth noting that in this embodiment, the mask image will be superimposed on the actual head-mounted display device after it is determined. Therefore, the sum of the areas of the black areas set by the mask image will be less than or equal to the area of ​​the black areas within the head-mounted display device. The black areas within the head-mounted display device here are mainly the actual areas blocked by the screen.

[0117] The closer the mask image is to the viewable area of ​​the headset, the more accurately the style sheet will fit the viewable area of ​​the headset.

[0118] In some embodiments, the alpha information of a single channel corresponding to the mask image is set according to the second mapping relationship, the pixel values ​​of the black area, and the pixel values ​​of the visible area corresponding to the coordinate values ​​of the display screen to generate the mask image, including:

[0119] Pre-acquiring an initial mask image stored in the head-mounted display device;

[0120] The alpha information of a single channel corresponding to the initial mask image is set according to the second mapping relationship, the pixel values ​​of the black area and the pixel values ​​of the visible area respectively corresponding to the coordinate values ​​of the display screen to generate a mask image;

[0121] Alternatively, call the region to draw the target shape in the database;

[0122] Drawing a closed path having the same shape as the target in the display area according to the display area drawing algorithm, the second mapping relationship, and the pixel values ​​of the black area and the pixel values ​​of the visible area corresponding to the coordinate values ​​of the display screen;

[0123] The alpha information of the single channel corresponding to the inside and outside of the closed path is set to obtain the mask image.

[0124] Using a pre-stored method: Create a mask image offline, freely control the alpha value of any pixel, and pre-store the pattern in the product memory. Specifically, set an initial mask image, and based on the second mapping relationship, set the alpha information of the single channel corresponding to the initial mask image with the pixel values ​​of the two regions corresponding to the coordinates of the display screen to generate the mask image.

[0125] Real-time processing method: You can develop freely or directly call the existing code library to draw different shapes, such as drawRect() for a rectangle; drawOval() for an ellipse; drawCircle() for a circle; drawLine() for a straight line; drawPath() can customize the path and Bezier curve; drawArc() for an arc. Figure 5 is a schematic diagram of a display area for drawing a straight line shape provided by an embodiment of the present application, Figure 6 is a schematic diagram of a display area for drawing a straight line and arc shape provided by an embodiment of the present application, and Figure 7 is a schematic diagram of a display area for a Bezier curve provided by an embodiment of the present application. As shown in Figures 5 to 7, different codes can be called through the code library to draw different shapes.

[0126] First, call the target shape in the area drawing database, such as calling it in Android's Paint class, and then use the area drawing algorithm of the display area, combined with the pixel values ​​of the black area and the visible area and the second mapping relationship to draw a closed path with the same target shape in the display area, and then set the alpha information of the single channel corresponding to the inside and outside of the closed path to obtain a mask image. Figure 8 is a schematic diagram of a display area provided by an embodiment of the present application. As shown in Figure 8, the division between the black area and the visible area is divided by a closed path, the alpha value of the area inside the closed path is set to 1, and the alpha value of the area outside the closed path is set to 0. It should be noted that the area drawing algorithm provided in this embodiment can be drawn using an existing algorithm, or a new drawing algorithm can be established based on data such as pixel values ​​of different areas and parameters of the display screen. This is not limited here and can be set according to actual conditions.

[0127] The two different embodiments provided in the embodiments of the present application can implement the setting process of the mask image, making the mask image adjustable to flexibly adapt to different head-mounted display devices.

[0128] Based on the above embodiments, in some embodiments, in order to ensure a smooth transition between the black area and the visible area, an edge transition area is also included in the display area. The edge transition area is located between the black area and the visible area. The alpha information of the single channel corresponding to the mask image belonging to the edge transition area is greater than the alpha information of the single channel corresponding to the mask image belonging to the black area, and is smaller than the alpha information of the single channel corresponding to the mask image belonging to the visible area.

[0129] That is to say, the anti-aliasing principle is used to set the edge transition area to a state between 0 and 1 of the alpha information to make the transition area smooth. It can be set to gray or adjusted through RGB values ​​to achieve better results.

[0130] In some embodiments, superimposing the mask image with the display screen of the display area to complete the control of the display area includes:

[0131] Get the RGB value of the display area and the alpha information corresponding to the mask image;

[0132] Perform superposition processing based on the RGB value of the display area and the alpha information corresponding to the mask image to determine the updated RGB value;

[0133] Apply the updated RGB values ​​to the display area.

[0134] Specifically, the superposition process is achieved by multiplying the RGB value with the alpha information. Assume that the transparency of the mask image is alpha, and the color of the original image is (Cr, Cg, Cb), where Cr is the value corresponding to R of the original image, Cg is the value corresponding to G of the original image, and Cb is the value corresponding to B of the original image. The final display color after superposition is (Cr', Cg', Cb'), and the color formula after superposition is: Cr'=Cr*alpha; Cg'=Cg*alpha; Cb'=Cb*alpha;

[0135] Wherein, Cr' is the value corresponding to the final display picture R after superposition, Cg' is the value corresponding to the final display picture G after superposition, and Cb' is the value corresponding to the final display picture B after superposition.

[0136] It should be noted that, for the convenience of description, the calculation formulas in the above embodiments are all described in the normalized floating-point domain, and the value range of Cr, Cg, Cb, and alpha is [0, 1].

[0137] It should be noted that, in this embodiment, when hardening the mask image to the chip of the head-mounted display device, it needs to be converted into binary data.

[0138] The superposition process provided in the embodiment of the present application prevents the non-visible area (black area) from emitting light while achieving normal display, thereby reducing the luminous power consumption of the display area of ​​the display screen.

[0139] In some embodiments, after superimposing the mask image with the display screen of the display area to complete the control of the display area, the method further includes:

[0140] Acquire a first visible area before the mask image is turned on and a second visible area after the mask image is turned on;

[0141] Determine whether the pixel values ​​corresponding to the first visible area and the second visible area are the same;

[0142] If they are the same, it is determined that the mask image does not block the visible area;

[0143] If they are different, it is determined that the mask image blocks the visible area;

[0144] When the mask image blocks the visible area, the blocked area of ​​the mask image is adjusted to obtain an adjusted mask image, and the process returns to the step of superimposing the mask image with the display screen of the display area to complete the control of the display area.

[0145] Specifically, the effect can be verified by wearing a head-mounted display, and the mask image can be fine-tuned according to the actual effect. The main verification is to compare the mask image before and after it is turned on, and to compare whether the pixel values ​​of the two visible areas (the first visible area and the second visible area) are the same. The pixel value comparison here is mainly based on the area occupied by the visible area. If they are the same, it is determined that the mask image is not blocked. If they are different, it means that it is blocked. In the case of blockage, the blocked area of ​​the display area of ​​the mask image is adjusted. Specifically, the blocked area of ​​the display area is increased, and the area of ​​the black area is correspondingly reduced. By reducing power consumption, the area of ​​the visible area is increased. The adjusted mask image is then applied to the display area. It should be noted that the adjustment process here is all adjusted during the product development or production stage.

[0146] The above describes in detail various embodiments corresponding to the display control method of a display screen. On this basis, this application also discloses a display control device for a display screen corresponding to the above method. Figure 9 is a structural diagram of a display control device for a display screen provided in an embodiment of the present application. As shown in Figure 9, the display control device for a display screen includes:

[0147] A determination module 11 is used to determine the coordinate values ​​of the display screen corresponding to the pixel values ​​of the black area and the pixel values ​​of the visible area within the display area of ​​the display screen;

[0148] The mask processing module 12 is used to perform mask processing according to the pixel values ​​of the black area and the pixel values ​​of the visible area corresponding to the coordinate values ​​of the display screen to determine the mask image corresponding to the display area;

[0149] The superimposition module 13 is configured to superimpose the mask image with the display image of the display area to complete the control of the display area.

[0150] Since the embodiments of the device part correspond to the above embodiments, the embodiments of the device part please refer to the description of the embodiments of the method part, and will not be repeated here.

[0151] For an introduction to a display control device for a display screen provided in this application, please refer to the above method embodiment, and this application will not go into details here. It has the same beneficial effects as the display control method for the above display screen.

[0152] FIG10 is a structural diagram of a head-mounted display device provided in an embodiment of the present application. As shown in FIG10 , the device includes:

[0153] Memory 21, for storing computer programs;

[0154] The processor 22 is configured to execute the steps of the display control method for the display screen implemented by the computer program.

[0155] The head-mounted display device provided in this embodiment may include, but is not limited to, augmented reality (AR) glasses, virtual reality (VR) glasses, and the like.

[0156] Among them, the processor 22 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 22 can be implemented in at least one hardware form of a digital signal processor (DSP), a field programmable gate array (FPGA), and a programmable logic array (PLA). The processor 22 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the awake state, also known as a central processing unit (CPU); the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor 22 may be integrated with a graphics processing unit (GPU), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 22 may also include an artificial intelligence (AI) processor, which is used to process computing operations related to machine learning.

[0157] The memory 21 may include one or more computer-readable storage media, which may be non-transitory. The memory 21 may also include a high-speed random access memory, and a non-volatile memory, such as one or more disk storage devices, flash memory storage devices. In this embodiment, the memory 21 is at least used to store the following computer program 211, wherein, after the computer program is loaded and executed by the processor 22, it can implement the relevant steps of the display control method of the display screen disclosed in any of the aforementioned embodiments. In addition, the resources stored in the memory 21 may also include an operating system 212 and data 213, etc., and the storage method may be temporary storage or permanent storage. Among them, the operating system 212 may include Windows, Unix, Linux, etc. The data 213 may include but is not limited to data involved in the display control method of the display screen, etc.

[0158] In some embodiments, the head mounted display device may further include a display screen 23 , an input and output interface 24 , a communication interface 25 , a power supply 26 , and a communication bus 27 .

[0159] Those skilled in the art will understand that the structure shown in FIG10 does not constitute a limitation on the head-mounted display device and may include more or fewer components than shown in the figure.

[0160] The processor 22 implements the display control method of the display screen provided by any of the above embodiments by calling the instructions stored in the memory 21.

[0161] For an introduction to a head-mounted display device provided by this application, please refer to the above-mentioned method embodiment, and this application will not go into details here. It has the same beneficial effects as the display control method of the above-mentioned display screen.

[0162] Furthermore, the present application also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by the processor 22, the steps of the display control method of the above-mentioned display screen are implemented.

[0163] It is understandable that if the method in the above embodiment is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium to execute all or part of the steps of the various embodiments of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0164] For an introduction to a computer-readable storage medium provided in this application, please refer to the above method embodiment, which will not be repeated here in this application. It has the same beneficial effects as the display control method of the above display screen.

[0165] Furthermore, the present application also provides a display module, which includes a display screen and a lens, wherein the display area of ​​the display screen is controlled using the above-mentioned display control method of the display screen; wherein the visible area of ​​the display screen is arranged opposite to the lens, and the black area of ​​the display screen is located outside the visible area.

[0166] The lens here is set through an optical machine, and the visible area is set opposite the lens to present the image of the lens on the display screen. The black area of ​​the display screen is located outside the visible area.

[0167] For an introduction to a display module provided by this application, please refer to the above method embodiment, and this application will not go into details here. It has the same beneficial effects as the display control method of the above display screen.

[0168] In some embodiments, the display module further includes a display driver chip, and the display driver chip is used to execute the display control method of the above-mentioned display screen.

[0169] The display module also includes a display driver chip. The specific model of the corresponding display driver chip is not limited and can be set according to actual conditions. The display driver chip is used to execute the above-mentioned display control method so that by determining the black area outside the visible area corresponding to the human eye visible area, the pixel values ​​of the black area and the visible area are masked with the coordinate values ​​of the display screen corresponding to obtain a corresponding mask image. The mask image makes the content of the non-human eye visible area of ​​the display screen black and non-luminous. The mask image is superimposed on the display screen of the display area to achieve the non-human eye visible area non-display, without changing the physical shape corresponding to the display area of ​​the display screen, while reducing the luminous power consumption of the display area of ​​the display screen.

[0170] In addition, the present application also provides a head-mounted display device, which includes at least one display module, and the display module adopts the above-mentioned display module structure.

[0171] That is to say, the display module in this embodiment can be multiple or one, and can be set according to actual conditions. The display module can be set to a display area corresponding to the display screen of one eye, or a display area corresponding to the display screen of both eyes, etc.

[0172] For an introduction to a head-mounted display device provided by the present application, please refer to the above-mentioned method embodiment, which will not be described in detail in the present application. It has the same beneficial effects as the above-mentioned display module. The above is a detailed introduction to the display control method, device, module, equipment and medium of a display screen provided by the present application. The various embodiments in the specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same and similar parts between the various embodiments can be referred to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can be referred to the method part description. It should be pointed out that for ordinary technicians in this technical field, without departing from the principles of the present application, several improvements and modifications can be made to the present application, and these improvements and modifications also fall within the scope of protection of the present application.

[0173] It should also be noted that, in this specification, relational terms such as first and second, etc., are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article, or apparatus comprising the element.

Claims

1. A display control method for a display screen, characterized in that: include: Determining pixel values ​​of a black area and pixel values ​​of a visible area within a display area of ​​a display screen corresponding to coordinate values ​​of the display screen; Performing mask processing according to the pixel values ​​of the black area and the pixel values ​​of the visible area corresponding to the coordinate values ​​of the display screen to determine a mask image corresponding to the display area; The mask image is superimposed on the display image of the display area to complete the control of the display area.

2. The display control method of a display screen according to claim 1, wherein: Controlling the display area includes: The alpha information of a single channel corresponding to the mask image to which the black area belongs is controlled to be smaller than the alpha information of a single channel corresponding to the mask image to which the visible area belongs.

3. The display control method of a display screen according to claim 1, wherein: Controlling the display area includes: Controlling the visible area to be displayed in a first display mode; Controlling the black area to be displayed in a second display mode; Wherein, in the first display mode, the brightness and darkness of the visual area presented to the corresponding user changes with the brightness and darkness of the display screen; In the second display mode, the brightness or darkness of the black area presented to the user is independent of the brightness or darkness of the display image.

4. The display control method of a display screen according to claim 2 or 3, characterized in that: The process of determining the black area includes: Obtaining the screen resolution of the display screen; Obtaining a style drawing of the visual area; Matching the resolution of the style sheet to the screen resolution; The area other than the visible area in the matched style drawing is used as the black area.

5. The display control method of a display screen according to claim 2 or 3, characterized in that: The process of determining the black area includes: Obtaining a virtual image of a head-mounted display device captured by a human eye-mimicking camera and a screen resolution of the display screen; Calibrate the coordinate values ​​corresponding to the screen resolution according to a first mapping relationship between the coordinate values ​​corresponding to the screen resolution and the pixel coordinate values ​​corresponding to the virtual image to obtain a visible area of ​​the display screen; The area in the display area except the visible area serves as the black area.

6. The display control method of a display screen according to claim 1, wherein: The step of performing mask processing on the pixel values ​​of the black area and the pixel values ​​of the visible area corresponding to the coordinate values ​​of the display screen to determine the mask image corresponding to the display area includes: Pre-establishing a second mapping relationship between pixel values ​​of the mask image and pixel values ​​of the display area; The alpha information of a single channel corresponding to the mask image is set according to the second mapping relationship, the pixel values ​​of the black area and the pixel values ​​of the visible area respectively corresponding to the coordinate values ​​of the display screen to generate the mask image.

7. The display control method of a display screen according to claim 6, characterized in that: The step of setting the alpha information of a single channel corresponding to the mask image according to the second mapping relationship, the pixel values ​​of the black area, and the pixel values ​​of the visible area respectively corresponding to the coordinate values ​​of the display screen to generate the mask image includes: Pre-acquiring an initial mask image stored in the head-mounted display device; Setting the alpha information of a single channel corresponding to the initial mask image according to the second mapping relationship, the pixel values ​​of the black area, and the pixel values ​​of the visible area corresponding to the coordinate values ​​of the display screen to generate the mask image; or calling the target shape in the regional drawing database; Drawing a closed path having the same shape as the target in the display area according to the area drawing algorithm of the display area, the second mapping relationship, and the pixel values ​​of the black area and the pixel values ​​of the visible area corresponding to the coordinate values ​​of the display screen; The mask image is obtained by setting the alpha information of the single channel corresponding to the interior and exterior of the closed path.

8. The display control method of a display screen according to claim 2, wherein: The display area also includes an edge transition area, which is located between the black area and the visible area. The alpha information of the single channel corresponding to the mask image to which the edge transition area belongs is greater than the alpha information of the single channel corresponding to the mask image to which the black area belongs, and is smaller than the alpha information of the single channel corresponding to the mask image to which the visible area belongs.

9. The display control method of a display screen according to claim 1, wherein: The step of superimposing the mask image with the display image of the display area to complete the control of the display area includes: Obtaining the RGB value of the display area and the alpha information corresponding to the mask image; Performing a superposition process on the RGB value of the display area and the alpha information corresponding to the mask image to determine an updated RGB value; Apply the updated RGB value to the display area.

10. The display control method of a display screen according to claim 1, wherein: After superimposing the mask image with the display screen of the display area to complete the control of the display area, the method further includes: Acquire a first visible area before the mask image is turned on and a second visible area after the mask image is turned on; Determining whether pixel values ​​corresponding to the first visible area and the second visible area are the same; If they are the same, it is determined that the mask image does not block the visible area; If they are different, determining that the mask image blocks the visible area; When the mask image blocks the area of ​​the visible area, the blocked area of ​​the mask image is adjusted to obtain an adjusted mask image, and the process returns to the step of superimposing the mask image with the display screen of the display area to complete the control of the display area.

11. A display control device for a display screen, characterized in that: include: a determination module, configured to determine pixel values ​​of a black area and pixel values ​​of a visible area within a display area of ​​a display screen corresponding to coordinate values ​​of the display screen; a mask processing module, configured to perform mask processing on the pixel values ​​of the black area and the pixel values ​​of the visible area corresponding to the coordinate values ​​of the display screen to determine a mask image corresponding to the display area; The superposition module is used to superimpose the mask image with the display image of the display area to complete the control of the display area.

12. A head-mounted display device, characterized in that: include: Memory for storing computer programs; A processor, configured to implement the steps of the display control method for a display screen according to any one of claims 1 to 10 when executing the computer program.

13. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the display control method of a display screen according to any one of claims 1 to 10 are implemented.

14. A display module, characterized in that: The display module includes a display screen and a lens, wherein the display screen is controlled by the display control method of any one of claims 1 to 10; wherein the visible area of ​​the display screen is arranged opposite to the lens, and the black area of ​​the display screen is located outside the visible area.

15. The display module according to claim 14, wherein: The display module further includes a display driver chip, and the display driver chip is used to execute the display control method of any one of claims 1 to 10 above.

16. A head-mounted display device, characterized in that: The head-mounted display device includes at least one display module, wherein the display module adopts the structure of the display module described in claim 14 or 15.

Images