Display screen processing method, device, non-volatile storage medium and electronic device
By setting virtual and real fusion bands on the edge of the display screen and dividing the display area, the user's visual difference problem at the edge of the parallax stereo display screen is solved, and the user experience is improved.
Patent Information
- Application Number
- CN202211718794.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-12-29
- Publication Date
- 2025-08-19
- Estimated Expiration
- 2042-12-29
AI Technical Summary
When users view the edge of the parallax stereo display, the visual effect is poor due to the visual difference between the virtual and the display, and the user experience is poor.
Set up a virtual and real fusion band at the edge of the display screen, divide it into multiple different display areas, and set different display content to optimize visual experience.
The visual difference between the virtual and display of the parallax stereo display screen is reduced, and the user's visual effect and experience is improved.
Smart Images

Figure CN116033137B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of virtual reality and 3D display technology, and in particular to a display screen processing method, device, non-volatile storage medium, and electronic device. Background Art
[0002] In the field of virtual reality technology, users experience virtual scenes and three-dimensional models (i.e., 3D models) through LED displays in an actual physical environment. This virtual content has a 1:1 ratio with the real scene. As the pixel density of the display increases, the spatial modeling becomes richer, and the sense of immersion becomes stronger, the virtual reality experience becomes increasingly realistic. During the experience, the user's primary visual focus is often on the virtual display content, such as a building, a car, or a room. However, if the user's visual focus shifts, for example, to the edge of the display space, the viewer's vision is forcibly pulled away from the virtual scene by the sudden appearance of the edge, and the focus shifts to this edge and the real world outside the screen. The visual difference between the virtual and the displayed image results in poor visual effects and a poor user experience.
[0003] To address the above-mentioned problems, no effective solutions have been proposed so far. Summary of the Invention
[0004] Embodiments of the present invention provide a display screen processing method, device, non-volatile storage medium, and electronic device to at least solve the technical problem in the related art of poor visual effects and user experience caused by the visual difference between virtual and displayed images when the user views the edge of a parallax stereoscopic display screen.
[0005] According to one aspect of an embodiment of the present invention, a method for processing a display screen is provided, comprising: determining a virtual-real fusion band in the display screen, wherein the virtual-real fusion band is a display area in the display screen extending inward from an edge of the display screen within a predetermined distance range; dividing the virtual-real fusion band into a plurality of different display areas; and determining display content corresponding to each of the plurality of different display areas, wherein the display content corresponding to each of the plurality of different display areas is different.
[0006] According to another aspect of an embodiment of the present invention, a processing device for a display screen is further provided, including: a first determination module, used to determine a virtual-real fusion band in the display screen, wherein the virtual-real fusion band is a display area in the display screen extending inward from the edge of the display screen within a predetermined distance range; a division module, used to divide the virtual-real fusion band into multiple different display areas; and a second determination module, used to determine display content corresponding to the multiple different display areas, wherein the display content corresponding to the multiple different display areas is different.
[0007] According to another aspect of an embodiment of the present invention, a non-volatile storage medium is provided, characterized in that the non-volatile storage medium stores a plurality of instructions, and the instructions are suitable for being loaded by a processor and executed by any one of the above-mentioned display screen processing methods.
[0008] According to another aspect of an embodiment of the present invention, an electronic device is further provided, characterized in that it includes one or more processors and a memory, wherein the memory is used to store one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement any one of the above-mentioned display screen processing methods.
[0009] In an embodiment of the present invention, a virtual-real fusion band in a display screen is determined, wherein the virtual-real fusion band is a display area in the display screen extending inward from the edge of the display screen within a predetermined distance range; the virtual-real fusion band is divided into a plurality of different display areas; and display contents corresponding to the plurality of different display areas are determined, wherein the display contents corresponding to the plurality of different display areas are different. This achieves the purpose of optimizing the parallax 3D visual experience by setting a virtual-real fusion band at the edge of the display screen and setting different display contents for different display areas of the virtual-real fusion band, thereby achieving the technical effect of reducing the visual difference between the virtual and the display on the parallax stereoscopic display screen and improving the visual effect and user experience. This further solves the technical problem in the related art of poor visual effect and poor user experience caused by the visual difference between the virtual and the display when the user views the edge of the parallax stereoscopic display screen. BRIEF DESCRIPTION OF THE DRAWINGS
[0010] The drawings described herein are used to provide a further understanding of the present invention and constitute a part of this application. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention. In the drawings:
[0011] Figure 1 It is a schematic diagram of a complete 3D model in a virtual environment according to the prior art;
[0012] Figure 2 This is a schematic diagram of the effect of viewing an image on a display screen according to the prior art;
[0013] Figure 3 This is a schematic diagram of viewing an image at the edge of a display screen according to the prior art;
[0014] Figure 4a It is a visual principle diagram for viewing a display screen according to the prior art;
[0015] Figure 4b It is another display screen viewing visual principle diagram according to the prior art;
[0016] Figure 5 is a schematic diagram of viewing an image at the edge of another display screen according to the prior art;
[0017] Figure 6 is a flowchart of a method for processing a display screen according to an embodiment of the present invention;
[0018] Figure 7 is a schematic diagram of an optional display screen according to an embodiment of the present invention;
[0019] Figure 8 is a schematic diagram of an optional display screen according to an embodiment of the present invention;
[0020] Figure 9 is a schematic diagram of an optional transparency adjustment curve according to an embodiment of the present invention;
[0021] Figure 10a This is a schematic diagram of display screen imaging according to the prior art;
[0022] Figure 10b is an optional display screen imaging schematic diagram according to an embodiment of the present invention;
[0023] Figure 11 is a flow chart of an optional display screen processing method according to an embodiment of the present invention;
[0024] Figure 12 4 is a schematic structural diagram of a display screen processing device according to an embodiment of the present invention. DETAILED DESCRIPTION
[0025] In order to enable those skilled in the art to better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the embodiments described are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts should fall within the scope of protection of the present invention.
[0026] It should be noted that the terms "first", "second", etc. in the description and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that the numbers used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.
[0027] First, to facilitate understanding of the embodiments of the present invention, some of the terms or nouns involved in the present invention are explained below:
[0028] LED display (LED Displayer), a flat panel display, consists of a panel of small LED modules, used to display text, images, videos and other information. LED (Light-emitting Diode), light-emitting diode.
[0029] In the virtual reality industry, LED display arrays are used to form display carriers. Users wear active stereo glasses to view three-dimensional (3D) images. Combined with real-time rendering engines and real-time motion capture technology, 3D program content can make real-time rendering responses according to the user's binocular viewpoint position. These images conform to the perspective relationship of the user's viewpoint, making the virtual display content seem to be in the surrounding environment, achieving the purpose of user immersion.
[0030] In the field of virtual reality, users experience virtual scenes and 3D models through LED displays in their physical environment. This virtual content maintains a 1:1 ratio with the real world. As the pixel density of the displays increases, the spatial modeling becomes richer, and the sense of immersion becomes stronger, the VR experience becomes increasingly realistic. During this experience, the user's primary visual focus is often on the virtual display content, such as a building, a car, or a room. However, if the user's visual focus shifts to the edge of the display space, the sudden appearance of the edge can forcibly pull the user's vision away from the virtual scene, shifting their focus to that edge and the real world beyond the screen. This visual difference between the virtual and the displayed content results in poor visual quality and a poor user experience.
[0031] like Figure 1 The complete three-dimensional model in the virtual environment displayed on the LED display is shown. In reality, the images that the left and right eyes need to see are displayed through the LED parallax stereo display (such as Figure 2(as shown), and then through active 3D glasses, these two images are matched to the left and right eyes, so that users can see the 3D model in the virtual environment and obtain a three-dimensional sense through the principle of parallax stereo. From the user's perspective, the displayed image is three-dimensional, and the objects in reality are also three-dimensional. However, the edge of the LED display will produce a high-contrast solid line. When this solid line is within the user's line of sight, it will force the human eye to change focus, causing confusion between virtual and real. Figure 3 The left side is a photo of an LCD monitor, simulating the process of a user wearing active 3D glasses to view a parallax stereoscopic LED screen. The image displayed on the LCD monitor can be seen as a 3D virtual scene, while the monitor frame and the surrounding office environment are the real scene. The image displayed on the monitor is surrounded by the monitor frame, such as Figure 3 The arrow in the figure indicates a solid line at the intersection of light and dark. The right side is a partial enlargement. When a user wears active stereo glasses and views a 3D model in a virtual environment normally, their visual line of sight falls on focus 1. If the user moves their eyeballs to change the focus position, or moves their position to change the focus position, when the solid line at the edge of the display enters the user's field of view, this high-contrast solid line will force the human eye to move its focus there, forcibly shifting from focus 1 to focus 2. At this time, the left and right eyes see the same solid line, rather than the left and right frame images given by the display (such as Figure 4a and Figure 4b This non-autonomous transformation gives people a sense of visual discomfort, and the user's vision will be forcibly pulled out of the virtual scene by the sudden appearance of the edge, such as Figure 5 The figure shows the situation of watching a parallax stereo display in a dark room. There is a strong visual difference between the virtual and the display, resulting in poor viewing effect and poor user experience.
[0032] According to an embodiment of the present invention, an embodiment of a method for processing a display screen is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.
[0033] Figure 6 is a flow chart of a method for processing a display screen according to an embodiment of the present invention. Figure 6 As shown, the method includes the following steps:
[0034] Step S602: determining a virtual-real fusion zone on the display screen.
[0035] It is understood that the aforementioned display screen is a parallax 3D LED display screen. The aforementioned virtual-reality fusion zone is a display area extending inward from the edge of the display screen by a predetermined distance, i.e., it is located at the intersection of virtual content and real scene. Virtual content refers to the virtual 3D content displayed by the parallax 3D display screen as seen by the human eye, and real scene refers to the real-world location where the LED parallax 3D display screen is located. In most cases, this intersection is the edge of the display screen, and the virtual-reality fusion zone extends along this edge into the display screen by a predetermined distance.
[0036] Optionally, the bandwidth of the virtual-reality fusion zone (ie, the predetermined distance range) may be set according to a specific virtual scene.
[0037] Optional, Figure 7 is a schematic diagram of an optional display screen according to an embodiment of the present invention, such as Figure 7 As shown, the above-mentioned display screen includes a front screen, a left screen, a right screen and a sky screen. The user is located in a parallax stereoscopic display space composed of the front screen, the left screen, the right screen and the sky screen. The four screens are visually seamlessly spliced. A virtual-real fusion zone is set in the display screen. The user can experience the virtual stereoscopic scene by wearing active 3D glasses.
[0038] Step S604: dividing the virtual-real fusion zone into a plurality of different display areas.
[0039] Optionally, the virtual-real fusion band is divided into a plurality of different display areas, including: determining a total number of pixel sequences possessed by the virtual fusion band of the display screen; and dividing the virtual fusion band into display areas based on the total number of pixel sequences to obtain a plurality of different display areas, and the number of pixel sequences corresponding to each of the plurality of different display areas.
[0040] Optionally, the display contents corresponding to the above-mentioned multiple different display areas are different. Figure 8 is a schematic diagram of an optional display screen according to an embodiment of the present invention, such as Figure 8 As shown, for example, the above-mentioned virtual-real fusion zone is divided into three display areas, namely the first display area a, the second display area b, and the third display area c, wherein the first display area a is closest to the edge of the display screen, the second display area b is second, and the third display area c is farthest from the edge of the display screen, and the three display areas display different display contents.
[0041] Step S606 : determining display contents corresponding to the plurality of different display areas, wherein the display contents corresponding to the plurality of different display areas are different.
[0042] Optionally, the original images corresponding to the plurality of different display areas may be processed by a program, but is not limited to the process, so that the display contents corresponding to the plurality of different display areas are different.
[0043] Through the above method, a virtual-real fusion zone is provided in the display screen, and the virtual-real fusion zone is divided into a plurality of different display areas. Different display areas correspond to displaying different display contents. For example, the display area close to the edge of the display screen is closer to the environmental parameters in the display scene where the display screen is located. The display content of the middle display area is a gradual process. The display content in the display area farthest from the edge of the display screen is closest to the virtual scene displayed on the display screen, thereby weakening the boundary between the real scene and the virtual scene. When the user's line of sight views the virtual content to the edge of the display screen, there will be no solid line at the edge of the screen that forces the visual focus to be changed, and there will be no problem of large visual difference. Therefore, the virtual scene perceived by the user is closer to reality, thereby improving the user experience.
[0044] Through the above steps S602 to S606, the purpose of setting a virtual-real fusion zone at the edge of the display screen, setting different display content for different display areas of the virtual-real fusion zone, and optimizing the parallax 3D visual experience can be achieved, thereby achieving the technical effect of reducing the visual difference between the virtual and the displayed on the parallax stereo display screen, improving the visual effect and user experience, and thus solving the technical problem in the related art of poor visual effect and poor user experience caused by the visual difference between the virtual and the displayed when the user views the edge of the parallax stereo display screen.
[0045] In an optional embodiment, in the case where the above-mentioned multiple different display areas include a first display area, a second display area and a third display area, the above-mentioned determination of the display content corresponding to the above-mentioned multiple different display areas respectively includes: determining the first display content corresponding to the above-mentioned first display area, wherein the above-mentioned first display area is the display area in the above-mentioned virtual-real fusion zone close to the edge side of the above-mentioned display screen; determining the second display content corresponding to the above-mentioned second display area, wherein the above-mentioned second display area is the display area in the above-mentioned virtual-real fusion zone located between the above-mentioned first display area and the above-mentioned third display area; determining the third display content corresponding to the above-mentioned third display area, wherein the above-mentioned third display area is the display area in the above-mentioned virtual-real fusion zone farthest from the edge side of the above-mentioned display screen, and the above-mentioned first display content, the above-mentioned second display content and the above-mentioned third display content are different.
[0046] Optional, still as Figure 8As shown, the display contents of the three divided display areas are processed by program. It should be noted that the fusion zone is the transition area from the real environment to the virtual environment, so it is divided into three transition sections: the first display area a, the second display area b, and the third display area c. Different display areas correspond to different display contents. Among them, the first display area a is the display area closest to the real environment, and the first display content corresponding to this section is set according to the real environment where the screen is located; the third display area c is the display area closest to the virtual content, so it can be set to the virtual content normally displayed on the display screen; the second display area b is the area that transitions from the real environment to the virtual environment, so the second display content corresponding to the second display area b can be set as the transition from the first display content to the third display content, thereby weakening the visual difference between the virtual environment and the real environment, and preventing the problem of the solid line at the edge of the display screen forcibly changing the visual focus.
[0047] In an optional embodiment, the above-mentioned determination of the first display content corresponding to the above-mentioned first display area includes: determining the environmental parameters corresponding to the above-mentioned display screen, wherein the above-mentioned environmental parameters include at least one of the following: the frame material of the above-mentioned display screen, the reflectivity of the frame of the above-mentioned display screen, the wall color in the real environment in which the above-mentioned display screen is located, and the reflectivity of the wall in the above-mentioned real environment; based on the above-mentioned environmental parameters, the above-mentioned first display content corresponding to the above-mentioned first display area is determined.
[0048] Optional, still as Figure 8 As shown, the first display area a is the display area closest to the real environment. The first display content corresponding to this section is set according to the environment close to the screen, such as the material and reflectivity of the display frame, or the wall color (such as white) in the room where the display is located, thereby achieving the purpose of weakening the dividing line between the real environment and the virtual environment.
[0049] In an optional embodiment, determining the second display content corresponding to the second display area includes: obtaining a first original image corresponding to the second display area; determining a first transparent layer based on a preset transparency adjustment curve, wherein the transparency adjustment curve is used to indicate a relationship between a pixel sequence included in the second display area and the corresponding transparency, wherein the pixel sequence is a row pixel sequence or a column pixel sequence corresponding to the second display area; and superimposing the first transparent layer on the first original image to obtain the second display content corresponding to the second display area.
[0050] Optionally, the second display area is an area transitioning from the real environment to the virtual environment. In order to weaken the visual difference between the virtual environment and the real environment, the display content of the second display area is set to a gradual transition between the stereoscopic image in the virtual environment and the surrounding real environment, that is, a gradual transition from the first display content to the third display content. The specific method can be to superimpose a gradient transparent layer on the first original image in the second display area. The transparent layer has a transparent gradient characteristic. Different pixel sequences (such as row pixel sequences or column pixel sequences) correspond to different transparencies. The relationship between the specific pixel sequence and the corresponding transparencies is as follows: Figure 9 As shown, the degree of gradient is obtained by the curve f(x). The horizontal axis represents the pixel sequence per row or column within the second display area b, and the vertical axis represents the transparency of the layer superimposed on this pixel sequence. f(x) can select various mapping relationships, such as linear or curved. Specifically, in the transparency setting of the first transparent layer corresponding to the second display area, the transparency of the pixel sequence is proportional to the distance from the edge of the display screen. That is, the farther the pixel sequence is from the edge of the display screen, the greater the corresponding transparency.
[0051] It should be noted that Figure 10a This is a schematic diagram of a display screen imaging according to the prior art, such as Figure 10a The image shows an LED display showing the left and right eye images normally, with the user wearing active stereo glasses to experience a 3D effect. However, the solid line on the left edge of the display affects the user's visual focus. Figure 10b This is an optional display screen imaging diagram according to an embodiment of the present invention. A virtual-real fusion zone with a gradient characteristic is provided on the edge side of the display screen. The stereoscopic image in the virtual environment gradually transitions with the surrounding real environment, blurring the previous solid line, and there is no possibility of affecting the user's visual focus.
[0052] In an optional embodiment, superimposing the first transparent layer onto the first original image to obtain the second display content corresponding to the second display area includes: superimposing the first transparent layer onto the first original image to obtain fourth display content corresponding to the second display area; determining first three primary color values corresponding to pixel sequences included in the second display area based on the fourth display content; determining second three primary color values corresponding to pixel sequences included in the second display area based on the first original image; determining first differences between the first three primary color values and the second three primary color values corresponding to pixel sequences included in the second display area; and when the first differences corresponding to the pixel sequences included in the second display area are all less than a preset difference threshold, using the fourth display content as the second display content corresponding to the second display area.
[0053] In the above manner, the first difference between the second three primary color values corresponding to the first original image corresponding to the pixel sequence included in the second display area and the first three primary color values corresponding to the fourth display content obtained after layer superposition is compared with the preset difference threshold, and the fourth display content that satisfies the first difference corresponding to the pixel sequence included in the second display area is less than the preset difference threshold is used as the final display content of the second display area. The first transparent layer thus obtained is more accurate and the layer superposition effect is better, making the transition from the virtual environment to the real environment in the virtual-reality fusion zone more realistic.
[0054] In an optional embodiment, determining the third display content corresponding to the third display area includes: determining a second original image corresponding to the third display area; and determining the third display content corresponding to the third display area based on the second original image.
[0055] It can be understood that the above-mentioned third display area is the display area farthest from the edge of the display screen in the virtual fusion band, and the displayed content should be closest to the virtual environment in the display screen. Through the above method, the displayed content in the third display area is set to the original image corresponding to the third display area, thereby weakening the visual difference between the virtual environment and the display environment.
[0056] In an optional embodiment, the method further includes: when the first difference corresponding to a pixel sequence in the pixel sequence included in the second display area is greater than or equal to the preset difference threshold, adjusting the transparency adjustment curve to obtain an adjusted transparency adjustment curve; determining a second transparent layer based on the adjusted transparency adjustment curve; superimposing the second transparent layer on the first original image to obtain fifth display content corresponding to the second display area; determining third three primary color values corresponding to the pixel sequences included in the second display area based on the fifth display content; determining second differences between the third three primary color values and the second three primary color values corresponding to the pixel sequences included in the second display area; and when the second differences corresponding to the pixel sequences included in the second display area are all less than the preset difference threshold, using the fifth display content as the second display content of the second display area.
[0057] It can be understood that if the first difference corresponding to a pixel sequence included in the second display area is greater than or equal to the preset difference threshold, it indicates that the transparency settings of the pixel sequences in the first transparent layer obtained at this time cannot well meet the gradual transition of the display content in the second display area. In this case, it is necessary to adjust the transparency adjustment curve to obtain a new second transparency layer, and further determine whether the third and third primary color values corresponding to the fifth display content meet the predetermined requirements (i.e., whether the differences between the third and third primary color values corresponding to the pixel sequences included in the second display area and the second and third primary color values are all less than the preset difference threshold). If so, the fifth display content is used as the final display content of the second display area, thereby improving the accuracy of transparent layer acquisition and the layer overlay effect, thereby making the transition from the virtual environment to the real environment in the virtual-reality fusion zone more realistic.
[0058] Optionally, if the second difference corresponding to one pixel sequence in the second display area is greater than or equal to the preset difference threshold, the following operations are performed repeatedly until the new second difference corresponding to each pixel sequence in the second display area is less than the preset difference threshold: re-adjusting the adjusted transparency adjustment curve to obtain a new adjusted transparency adjustment curve; determining a new second transparent layer based on the new adjusted transparency adjustment curve; overlaying the new second transparent layer onto the first original image to obtain new fifth display content corresponding to the second display area; determining new third and third primary color values corresponding to each pixel sequence in the second display area based on the new fifth display content; determining new second differences between the new third and third primary color values and the second and third primary color values corresponding to each pixel sequence in the second display area; and using the new adjusted transparency adjustment curve as the adjusted transparency adjustment curve. If the new second difference corresponding to each pixel sequence in the second display area is less than the preset difference threshold, using the new fifth display content as the second display content of the second display area.
[0059] Based on the embodiments and optional embodiments, the present invention proposes an optional implementation method. Figure 11 is a flow chart of an optional display screen processing method according to an embodiment of the present invention, such as Figure 11 As shown, the method includes:
[0060] Step S1, determine the virtual and real fusion zone in the display screen, and the total number of pixel sequences N possessed by the virtual fusion zone of the display screen; based on the total number of pixel sequences, divide the virtual fusion zone into display areas to obtain three display areas (i.e., the first display area, the second display area, and the third display area), and the number of pixel sequences corresponding to the three display areas. Among them, the first display area is the display area closest to the real environment, and the first display content corresponding to this section is set according to the environment close to the screen, such as the material and reflectivity of the display frame, or the wall color in the room where the display screen is located. The third display content corresponding to the third display area is set to the content normally displayed on the display screen (i.e., the original display image corresponding to the third display area). The second display area is the area that transitions from the real environment to the virtual environment, and the corresponding second display content here is determined based on sampling in the first display area and the third display area and making corresponding transformations.
[0061] Step S2: setting the number of pixel sequences corresponding to the second display area b in the virtual-real fusion zone to p_b.
[0062] Step S3: determining a transparency adjustment curve f(x), where x represents the x-th pixel sequence in the second display area b.
[0063] Step S4: Determine that the RGB three-primary color values (i.e., the second three-primary color values) of the unit pixel sequence of the first original image corresponding to the second display area b are T0(x,k)=RGB(r,g,b), where R and r in RGB(r,g,b) correspond to red among the three optical primary colors, G and g correspond to green among the three optical primary colors, and B and b correspond to blue among the three optical primary colors.
[0064] In step S5, the first transparent layer is superimposed on the first original image to obtain a fourth display content. The corresponding transformed RGB three-primary color value of the unit pixel sequence (i.e., the first three-primary color value) is T(x, k) = T0(x, k) + f(x).
[0065] Step S6: Calculate a first difference ΔT = T(x, k) - T0(x, k) between the transformed RGB three-primary color value T(x, k) of the unit pixel sequence and the RGB three-primary color value T0(x, k) of the unit pixel sequence corresponding to the first original image, and compare the first difference with a corresponding preset difference threshold r. If the first differences corresponding to the pixel sequences included in the second display area are all less than the preset difference threshold, then use the fourth display content obtained by superimposing the first transparent layer and the first original image as the final display content corresponding to the second display area.
[0066] In step S7, if a first difference value corresponding to a pixel sequence in the pixel sequence included in the second display area is greater than or equal to a preset difference threshold, it indicates that the transparency setting of each pixel sequence in the first transparent layer obtained at this time cannot well meet the gradual transition of the display content in the second display area. In this case, it is necessary to adjust the transparency adjustment curve and re-execute steps S3 to S6 until a new transparent layer obtained according to the new transparency adjustment curve f(x) is superimposed on the first original image of the second display area, and the three primary color values corresponding to the new display content obtained meet the predetermined requirements (i.e., whether the differences between the new three primary color values corresponding to the pixel sequences included in the second display area and the second three primary color values are all less than the preset difference threshold).
[0067] Step S8: Use the new display content as the final display content corresponding to the second display area.
[0068] The embodiments of the present invention can achieve at least the following technical effects: (1) A virtual-reality fusion zone is set at the edge of the display screen to weaken the boundary between the real scene and the virtual scene. When the user's line of sight views the virtual content to the edge of the display screen, the solid line at the edge of the screen does not appear to force a change in visual focus, resulting in a larger visual disparity and optimizing the parallax 3D visual experience. This makes the virtual scene perceived by the user closer to reality and enhances the user experience. (2) The transparent gradient layer in the second display area is determined in a round-robin manner, thereby improving the accuracy of transparent layer acquisition and the layer overlay effect, thereby making the transition from the virtual environment to the real environment in the virtual-reality fusion zone more realistic.
[0069] This embodiment also provides a display screen processing device, which is used to implement the above-mentioned embodiments and preferred embodiments. Details that have already been described will not be repeated. As used below, the terms "module" and "device" may refer to a combination of software and / or hardware that implements a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, implementation using hardware, or a combination of software and hardware, is also possible and contemplated.
[0070] According to an embodiment of the present invention, there is also provided an embodiment of a device for implementing the above display screen processing method. Figure 12 is a structural diagram of a processing device for a display screen according to an embodiment of the present invention, such as Figure 12 As shown, the display screen processing device includes: a first determination module 1200, a division module 1202, and a second determination module 1204, wherein:
[0071] The first determining module 1200 is configured to determine a virtual-real fusion zone in the display screen, wherein the virtual-real fusion zone is a display area in the display screen extending inward from an edge of the display screen by a predetermined distance;
[0072] The division module 1202 is connected to the first determination module 1200 and is used to divide the virtual-real fusion zone into a plurality of different display areas;
[0073] The second determining module 1204 is connected to the dividing module 1202 and is configured to determine display contents corresponding to the plurality of different display areas, wherein the display contents corresponding to the plurality of different display areas are different.
[0074] In an embodiment of the present invention, the first determination module 1200 is set to determine a virtual-real fusion band in a display screen, wherein the virtual-real fusion band is a display area in the display screen extending inward from the edge of the display screen within a predetermined distance range; the division module 1202 is connected to the first determination module 1200 and is used to divide the virtual-real fusion band into a plurality of different display areas; the second determination module 1204 is connected to the division module 1202 and is used to determine display content corresponding to the plurality of different display areas, wherein the display content corresponding to the plurality of different display areas is different, thereby achieving the purpose of setting a virtual-real fusion band at the edge of the display screen, setting different display content for different display areas of the virtual-real fusion band, and optimizing the parallax 3D visual experience, thereby achieving the technical effect of reducing the visual difference between the virtual and the display on the parallax stereoscopic display screen, improving the visual effect and user experience, and thus solving the technical problem in the related art of poor visual effect and poor user experience caused by the visual difference between the virtual and the display when the user views the edge of the parallax stereoscopic display screen.
[0075] It should be noted that the above modules can be implemented by software or hardware. For example, for the latter, it can be implemented in the following ways: the above modules can be located in the same processor; or the above modules can be located in different processors in any combination.
[0076] It should be noted that the first determination module 1200, the division module 1202, and the second determination module 1204 correspond to steps S602 to S606 in the embodiment. The examples and application scenarios implemented by the above modules and the corresponding steps are the same, but are not limited to the contents disclosed in the above embodiment. It should be noted that the above modules, as part of the device, can be run on a computer terminal.
[0077] It should be noted that the optional or preferred implementation of this embodiment can be found in the relevant description in the embodiment, which will not be repeated here.
[0078] The processing device of the above-mentioned display screen may also include a processor and a memory. The above-mentioned first determination module 1200, division module 1202, second determination module 1204, etc. are all stored in the memory as program modules, and the processor executes the above-mentioned program modules stored in the memory to realize corresponding functions.
[0079] The processor includes a core, which retrieves corresponding program modules from memory. There can be one or more cores. Memory may include non-permanent memory in a computer-readable medium, random access memory (RAM), and / or non-volatile memory, such as read-only memory (ROM) or flash RAM. Memory includes at least one memory chip.
[0080] According to an embodiment of the present application, an embodiment of a non-volatile storage medium is further provided. Optionally, in this embodiment, the non-volatile storage medium includes a stored program, wherein when the program is executed, the device containing the non-volatile storage medium is controlled to execute any of the above-mentioned display screen processing methods.
[0081] Optionally, in this embodiment, the non-volatile storage medium may be located in any computer terminal in a computer terminal group in a computer network, or in any mobile terminal in a mobile terminal group, and the non-volatile storage medium includes a stored program.
[0082] Optionally, when the program is running, the device where the non-volatile storage medium is located is controlled to perform the following functions: determining a virtual-real fusion band in a display screen, wherein the virtual-real fusion band is a display area in the display screen that extends inward from the edge of the display screen within a predetermined distance range; dividing the virtual-real fusion band into multiple different display areas; determining display contents corresponding to the multiple different display areas, wherein the display contents corresponding to the multiple different display areas are different.
[0083] According to an embodiment of the present application, an embodiment of a processor is further provided. Optionally, in this embodiment, the processor is used to run a program, wherein the program executes any of the above-mentioned display screen processing methods when it is run.
[0084] According to an embodiment of the present application, an embodiment of a computer program product is also provided. When executed on a data processing device, the program is suitable for executing the processing method steps of initializing any one of the above-mentioned display screens.
[0085] Optionally, the above-mentioned computer program product, when executed on a data processing device, is suitable for executing a program initialized with the following method steps: determining a virtual-real fusion band in a display screen, wherein the above-mentioned virtual-real fusion band is a display area in the above-mentioned display screen extending inward from the edge of the above-mentioned display screen within a predetermined distance range; dividing the above-mentioned virtual-real fusion band into multiple different display areas; determining the display contents corresponding to the above-mentioned multiple different display areas, wherein the display contents corresponding to the above-mentioned multiple different display areas are different.
[0086] An embodiment of the present invention provides an electronic device, which includes a processor, a memory, and a program stored in the memory and executable on the processor. When the processor executes the program, the following steps are implemented: determining a virtual-real fusion band in a display screen, wherein the virtual-real fusion band is a display area in the display screen extending inward from an edge of the display screen within a predetermined distance range; dividing the virtual-real fusion band into a plurality of different display areas; and determining display content corresponding to each of the plurality of different display areas, wherein the display content corresponding to each of the plurality of different display areas is different.
[0087] The serial numbers of the above embodiments of the present invention are for description only and do not represent the advantages or disadvantages of the embodiments.
[0088] In the above embodiments of the present invention, the description of each embodiment has its own focus. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.
[0089] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. Among them, the device embodiments described above are only exemplary. For example, the division of the above modules can be a logical function division. In actual implementation, there may be other division methods, such as multiple modules or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, modules or indirect coupling or communication connection of modules, which can be electrical or other forms.
[0090] The modules described above as separate components may or may not be physically separate, and the components shown as modules may or may not be physical modules, that is, they may be located in one place or distributed across multiple modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the present embodiment.
[0091] In addition, the functional modules in various embodiments of the present invention may be integrated into a single processing module, or each module may exist physically separately, or two or more modules may be integrated into a single module. The aforementioned integrated modules may be implemented in the form of hardware or software functional modules.
[0092] If the above-mentioned integrated module is implemented in the form of a software functional module and sold or used as an independent product, it can be stored in a computer-readable non-volatile storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a non-volatile storage medium and includes several instructions for enabling a computer device (which can be a personal computer, server or network device, etc.) to execute all or part of the steps of the various embodiments of the present invention. The aforementioned non-volatile storage medium includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, magnetic disk or optical disk, and other media that can store program codes.
[0093] The above are only preferred embodiments of the present invention. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present invention. These improvements and modifications should also be regarded as the scope of protection of the present invention.
Claims
1. A method for processing a display screen, characterized in that: include: Determining a virtual-real fusion zone in a display screen, wherein the virtual-real fusion zone is a display area in the display screen extending inward from an edge of the display screen to a predetermined distance; Dividing the virtual-real fusion zone into a plurality of different display areas; Determining display contents corresponding to the multiple different display areas, wherein the display contents corresponding to the multiple different display areas are different; The multiple different display areas include a first display area, a second display area, and a third display area. The second display area is a display area in the virtual-reality fusion zone located between the first display area and the third display area. The display content of the second display area is determined by: obtaining a first original image corresponding to the second display area; determining a first transparent layer based on a preset transparency adjustment curve, wherein the transparency adjustment curve is used to indicate a relationship between a pixel sequence included in the second display area and a corresponding transparency, wherein the pixel sequence is a row pixel sequence or a column pixel sequence corresponding to the second display area; and superimposing the first transparent layer on the first original image to obtain second display content corresponding to the second display area. The method of superimposing the first transparent layer onto the first original image to obtain the second display content corresponding to the second display area includes: superimposing the first transparent layer onto the first original image to obtain fourth display content corresponding to the second display area; determining, based on the fourth display content, first three primary color values corresponding to pixel sequences included in the second display area; determining, based on the first original image, second three primary color values corresponding to pixel sequences included in the second display area; determining first differences between the first three primary color values and the second three primary color values corresponding to pixel sequences included in the second display area; and, if the first differences corresponding to pixel sequences included in the second display area are all less than a preset difference threshold, using the fourth display content as the second display content corresponding to the second display area.
2. The method according to claim 1, characterized in that The determining of display contents corresponding to the plurality of different display areas includes: Determining first display content corresponding to the first display area, wherein the first display area is a display area in the virtual-real fusion zone close to an edge of the display screen; determining second display content corresponding to the second display area; Determine third display content corresponding to the third display area, wherein the third display area is a display area in the virtual-real fusion zone that is farthest from an edge of the display screen, and the first display content, the second display content, and the third display content are different.
3. The method according to claim 2, characterized in that The determining the first display content corresponding to the first display area includes: Determining environmental parameters corresponding to the display screen, wherein the environmental parameters include at least one of the following: a frame material of the display screen, a reflectivity of the frame of the display screen, a wall color in a real environment where the display screen is located, and a reflectivity of the wall in the real environment; Based on the environmental parameter, the first display content corresponding to the first display area is determined.
4. The method according to claim 1, wherein The method further comprises: If there is a pixel sequence in the pixel sequence included in the second display area and the first difference value corresponding to the pixel sequence is greater than or equal to the preset difference threshold, adjusting the transparency adjustment curve to obtain an adjusted transparency adjustment curve; determining a second transparent layer based on the adjusted transparency adjustment curve; superimposing the second transparent layer onto the first original image to obtain fifth display content corresponding to the second display area; Determining, based on the fifth display content, third three primary color values corresponding to pixel sequences included in the second display area; Determine a second difference between the third three primary color values and the second three primary color values corresponding to pixel sequences included in the second display area; When the second difference values respectively corresponding to the pixel sequences included in the second display area are all smaller than the preset difference threshold, the fifth display content is used as the second display content of the second display area.
5. The method according to claim 2, characterized in that The determining the third display content corresponding to the third display area includes: Determining a second original image corresponding to the third display area; The third display content corresponding to the third display area is determined based on the second original image.
6. A display screen processing device, characterized in that: include: A first determining module is configured to determine a virtual-real fusion zone in a display screen, wherein the virtual-real fusion zone is a display area in the display screen extending inward from an edge of the display screen to a predetermined distance; A division module, configured to divide the virtual-real fusion zone into a plurality of different display areas; A second determining module is configured to determine display contents corresponding to the plurality of different display areas, wherein the display contents corresponding to the plurality of different display areas are different; The multiple different display areas include a first display area, a second display area, and a third display area, the second display area being a display area in the virtual-reality fusion zone located between the first display area and the third display area, and the second determination module is further configured to: obtain a first original image corresponding to the second display area; determine a first transparent layer based on a preset transparency adjustment curve, wherein the transparency adjustment curve is used to indicate a relationship between a pixel sequence included in the second display area and a corresponding transparency, wherein the pixel sequence is a row pixel sequence or a column pixel sequence corresponding to the second display area; and superimpose the first transparent layer on the first original image to obtain second display content corresponding to the second display area; The second determination module is further configured to: superimpose the first transparent layer onto the first original image to obtain fourth display content corresponding to the second display area; determine, based on the fourth display content, first three primary color values corresponding to the pixel sequences included in the second display area; determine, based on the first original image, second three primary color values corresponding to the pixel sequences included in the second display area; determine first differences between the first three primary color values and the second three primary color values corresponding to the pixel sequences included in the second display area; and, if the first differences corresponding to the pixel sequences included in the second display area are all less than a preset difference threshold, use the fourth display content as the second display content corresponding to the second display area.
7. A non-volatile storage medium, characterized in that: The non-volatile storage medium stores a plurality of instructions, and the instructions are suitable for being loaded by a processor and executed by the display screen processing method according to any one of claims 1 to 5.
8. An electronic device, characterized in that: The device comprises one or more processors and a memory, wherein the memory is used to store one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement the display screen processing method described in any one of claims 1 to 5.
Citation Information
Patent Citations
Display method and device of curved screen and terminal
CN107230428A
Electronic terminal, display control method thereof and computer readable storage medium
CN109391710A
Screen fusion method, display device, terminal device and server
CN113645494A