Screen display method and device, computer equipment and storage medium
By collecting and analyzing image data around the intelligent surface display area, extracting surface texture features and personalizing display, the problems of pattern fixation and complex process in the prior art are solved, and perfect matching with the environment and cost reduction are achieved.
Patent Information
- Application Number
- CN202411670096.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-20
- Publication Date
- 2025-01-14
AI Technical Summary
In the existing intelligent surface display technology, the pattern effect of the surface is fixed and cannot be changed in personalized. The complex process leads to high production costs and difficult to control quality.
By collecting images around the screen display area, obtaining geometric data, extracting surface texture features, and controlling the screen display content based on these features to match it with the surrounding environment, personalized display and optimization are achieved.
It improves the matching and concealment of the screen display content with the environment, enhances the aesthetics and concealment in actual application scenarios, and reduces production costs.
Smart Images
Figure CN119311239A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of display technology, and in particular to a screen display method, device, computer equipment and storage medium. Background Art
[0002] In the process of continuous development of science and technology, the field of display technology has undergone profound changes. Today, people's demand for display technology has broken through the limitations of traditional display solutions. Smart surface display technology has become a hot topic in current research and application due to its unique interactivity, concealment, flexibility and versatility.
[0003] As a comprehensive solution, the smart surface display system integrates display, sensing, interaction and data processing functions. It can integrate high-resolution and high-brightness displays on a variety of surfaces. The display can present content that matches the surrounding environment, and then blend into the environment to achieve a hidden effect. It also has the function of displaying patterns and text. In addition, combined with interactive technologies such as touch sensing, gesture recognition, and voice recognition, it can realize a variety of functions and application scenarios.
[0004] However, in the field of smart surface display, there are currently some problems that need to be solved. In the prior art, if a specific pattern effect is to be achieved on the surface, a layer of texture pattern is usually printed on the glass cover, such as wood grain, cloth grain, marble grain, etc. However, this method has many defects: first, the printed cover pattern is fixed and cannot be personalized, making it difficult to meet the diverse needs of users; second, its process is complicated, which not only increases the difficulty and cost of the production process, but also under complex processes, the quality yield is difficult to effectively control, resulting in further increases in production costs. Summary of the invention
[0005] The present invention provides a screen display method, device, computer equipment and storage medium to solve the problems existing in the prior art.
[0006] To achieve the above object, the present invention provides the following technical solutions:
[0007] A screen display method, comprising:
[0008] Collecting surrounding images of the display area of the screen, and obtaining geometric data about the surrounding images;
[0009] extracting surface texture features in the surrounding image based on the geometric data;
[0010] The screen is controlled to display an image with the surface texture features in a display area.
[0011] Optionally, the collecting the surrounding images of the display area of the screen and obtaining geometric data about the surrounding images includes:
[0012] Scanning the surrounding image and constructing a three-dimensional model of the surrounding image;
[0013] Based on the constructed 3D model, calculate the normal vector;
[0014] According to the normal vector, a tangent vector and a dual tangent vector are determined.
[0015] Optionally, extracting surface texture features in the surrounding image based on the geometric data includes:
[0016] Based on the geometric data, construct a coordinate space transformation matrix;
[0017] Using the coordinate space conversion matrix, the initial light direction in the preset world coordinate system is converted into a local coordinate system related to the current calculation surface to obtain the light direction in the local coordinate system;
[0018] Calculate surface texture features in the surrounding image according to the light direction of the local coordinate system.
[0019] Optionally, the control screen displays an image with the surface texture feature in a display area, including:
[0020] Identify the connection area with the surrounding image and extract texture feature parameters of the connection;
[0021] Based on the texture feature parameters of the joint, the texture at the edge of the display area of the screen is optimized for display.
[0022] Optionally, the optimizing and displaying the texture at the edge of the display area of the screen based on the texture feature parameter of the joint includes:
[0023] Create a texture transition area at the edge of the screen's display area;
[0024] Texture smoothing is performed in the texture transition region.
[0025] Optionally, after the control screen displays the image with the surface texture feature in the display area, the method further comprises:
[0026] Acquire a connection image at a connection point between the display area and the surrounding image;
[0027] Extracting characteristic texture and geometric features of the connection image, and analyzing matching parameters between the display area and the surrounding image;
[0028] Based on the matching parameters, display parameters of the screen are adjusted.
[0029] Optionally, the process of extracting characteristic texture and geometric features of the connection image and analyzing matching parameters between the display area and the surrounding image includes:
[0030] Identify whether there is occlusion or missing in the connected image;
[0031] If so, the characteristic texture and geometric features of the occluded or missing areas are restored based on image restoration and feature inference technology.
[0032] The present invention also provides a screen display device, for implementing any of the above screen display methods, comprising:
[0033] A collection unit, used for collecting surrounding images of the display area of the screen, and obtaining geometric data about the surrounding images;
[0034] An image processing unit, used for extracting surface texture features in the surrounding image based on the geometric data;
[0035] The execution unit is used to control the screen to display the image with the surface texture feature in the display area.
[0036] The present invention further provides a computer device, comprising a memory and a processor, wherein the memory stores a computer program, and the processor implements the screen display method as described in any one of the above items when executing the computer program.
[0037] The present invention also provides a storage medium containing computer executable instructions, wherein the computer executable instructions are executed by a computer processor to implement the screen display method as described in any one of the above items.
[0038] Compared with the prior art, the present invention has the following beneficial effects:
[0039] The present invention provides a screen display method, device, computer equipment and storage medium, which use surface texture features in the surrounding images of the display area as the parameter basis for controlling the screen display, and finally display images with these texture features in the display area, so that the screen display content can better match the surrounding environment and enhance the concealment of the screen in actual application scenarios.
[0040] The present invention has other features and advantages, which will be apparent from or will be described in detail in the accompanying drawings and the following detailed description incorporated herein, which together serve to explain the specific principles of the invention. BRIEF DESCRIPTION OF THE DRAWINGS
[0041] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0042] Figure 1 It is a flow chart of a screen display method provided by the present invention;
[0043] Figure 2 is a flow chart of step S1 in a screen display method provided by the present invention;
[0044] Figure 3 Is a flowchart of step S2 of a screen display method provided by the present invention;
[0045] Figure 4 Is a flowchart of step S3 of a screen display method provided by the present invention;
[0046] Figure 5 is another flow chart of step S3 in a screen display method provided by the present invention;
[0047] Figure 6 is a flow chart of step S4 in a screen display method provided by the present invention;
[0048] Figure 7 It is a rendering of the transition and conversion between different types of texture patterns in a screen display method provided by the present invention;
[0049] Figure 8 It is a contrast diagram of the transformation from a texture map to a normal map in a screen display method provided by the present invention;
[0050] Fig. 9 It is a comparison diagram of the effects of pictures obtained by the prior art and a screen display method in the present invention;
[0051] Fig.10 It is a structural block diagram of a screen display device provided by the present invention.
[0052] Reference numerals: 10, acquisition unit; 20, image processing unit; 30, execution unit. DETAILED DESCRIPTION
[0053] In order to explain in detail the possible application scenarios, technical principles, specific schemes that can be implemented, and the purposes and effects that can be achieved, the following is a detailed description of the specific embodiments listed in conjunction with the accompanying drawings. The embodiments described herein are only used to more clearly illustrate the technical solutions of the present application, and are therefore only used as examples, and cannot be used to limit the scope of protection of the present application.
[0054] Reference to "embodiment" herein means that the specific features, structures or characteristics described in conjunction with the embodiment may be included in at least one embodiment of the present application. The term "embodiment" appearing in various places in the specification does not necessarily refer to the same embodiment, nor does it particularly limit its independence or association with other embodiments. In principle, in the present application, as long as there is no technical contradiction or conflict, the various technical features mentioned in the embodiments can be combined in any way to form a corresponding implementable technical solution.
[0055] Unless otherwise defined, the technical terms used in this document have the same meanings as those generally understood by those skilled in the art to which this application belongs; the use of relevant terms in this document is only for describing specific embodiments and is not intended to limit this application.
[0056] In the description of this application, the term "and / or" is an expression used to describe the logical relationship between objects, indicating that three relationships may exist, for example, A and / or B, which means: A exists, B exists, and A and B exist at the same time. In addition, the character " / " in this article generally indicates that the objects before and after are in an "or" logical relationship.
[0057] In the present application, terms such as “first” and “second” are merely used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship of quantity, priority or sequence between these entities or operations.
[0058] Without further limitations, in this application, the words "include", "comprises", "has" or other similar expressions used in the sentences are intended to cover non-exclusive inclusion. These expressions do not exclude the presence of additional elements in the process, method or product including the elements, so that the process, method or product including a series of elements may include not only those limited elements, but also other elements not explicitly listed, or also include elements inherent to such process, method or product.
[0059] Similar to the understanding in the Examination Guidelines, in this application, expressions such as "greater than", "less than", "exceed" and the like are understood to exclude the number itself; expressions such as "above", "below", "within" and the like are understood to include the number itself. In addition, in the description of the embodiments of this application, "multiple" means more than two (including two), and similar expressions related to "multiple" are also understood in this way, such as "multiple groups", "multiple times", etc., unless otherwise clearly and specifically limited.
[0060] In the description of the embodiments of the present application, space-related expressions used, such as "center", "longitudinal", "lateral", "length", "width", "thickness", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "vertical", "top", "bottom", "inside", "outside", "clockwise", "counterclockwise", "axial", "radial", "circumferential", etc., indicate the orientation or position relationship based on the orientation or position relationship shown in the specific embodiments or drawings, and are only for the convenience of describing the specific embodiments of the present application or facilitating the reader's understanding, and do not indicate or imply that the referred device or component must have a specific position, a specific orientation, or be constructed or operated in a specific orientation, and therefore cannot be understood as a limitation on the embodiments of the present application.
[0061] Unless otherwise expressly specified or limited, in the description of the embodiments of the present application, the terms such as "install", "connect", "connect", "fix", "set", etc. used should be understood in a broad sense. For example, the "connection" can be a fixed connection, a detachable connection, or an integrated setting; it can be a mechanical connection, an electrical connection, or a communication connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium; it can be the internal connection of two elements or the interaction relationship between two elements. For technicians in the technical field to which the present application belongs, the specific meanings of the above terms in the embodiments of the present application can be understood according to the specific circumstances.
[0062] Embodiment 1
[0063] Please refer to Figure 1 , an embodiment of the present invention provides a screen display method, comprising:
[0064] S1. Capture the surrounding images of the display area of the screen and obtain geometric data about the surrounding images.
[0065] By collecting surrounding images and obtaining their geometric data, the spatial information and texture direction of the screen's surrounding environment can be obtained, so that the subsequent displayed content can be better integrated with the surrounding environment, making the screen less visually abrupt. For example, when the screen is installed on the surface of furniture with wood texture, the collected image geometric data can form a display effect that matches the wood grain, improving the aesthetics and concealment of the screen display.
[0066] S2. Extract surface texture features from surrounding images based on geometric data.
[0067] In this step, the texture features are extracted based on the geometric data obtained in the previous step. Since the geometric data contains the three-dimensional information of the surrounding environment, it is possible to more accurately analyze the changes in the texture at different angles and positions, so that the extracted texture features are more in line with the actual environment, avoiding the unreality caused by simply applying the texture template. For example, for surrounding objects with curved surfaces, the texture can be accurately extracted based on the geometric data, so that the texture displayed on the screen transitions naturally on the curved surface, enhancing the realism of the displayed content.
[0068] S3. Control the screen to display an image with surface texture features in the display area.
[0069] Through this step, the screen display and the surrounding environment form an organic whole, achieving visual coordination and unity.
[0070] Please refer to Figure 2 , further, collecting the surrounding images of the display area of the screen and obtaining geometric data about the surrounding images can be achieved by the following method:
[0071] First, scan the surrounding images and build a 3D model of the surrounding images. Scanning the surrounding images and building a 3D model can fully capture the spatial form of the surrounding environment. Scanning technologies such as laser scanning or structured light scanning can accurately obtain the 3D information of the object, providing accurate basic data for subsequent calculations.
[0072] Furthermore, collecting the surrounding images of the display area of the screen and obtaining geometric data about the surrounding images includes the following steps:
[0073] S11. Calculate the normal vector based on the constructed three-dimensional model.
[0074] The reason for calculating the normal vector is that the normal vector can represent the orientation of each point on the surface of an object, which is the key to the subsequent calculation of texture and lighting effects. Calculating the normal vector based on the geometric information of the 3D model can accurately reflect the ups and downs and angle changes of the surface of surrounding objects, which is crucial for simulating real texture effects.
[0075] S12. Determine the tangent vector and the dual tangent vector according to the normal vector.
[0076] Among them, the tangent vector and the dual tangent vector together with the normal vector constitute a local coordinate system, which is used to more accurately describe the geometric information of the object surface. They can accurately calculate texture mapping and lighting effects in complex three-dimensional environments. For example, when processing images around objects with complex textures and shapes, these vectors can help achieve more delicate display effects.
[0077] Please refer to Figure 3 ,Furthermore, based on the geometric data, the surface texture features in the surrounding images are extracted, including:
[0078] S21. Construct a coordinate space transformation matrix based on geometric data.
[0079] The purpose of constructing the coordinate space transformation matrix is to transform vectors such as the direction of light in different coordinate spaces. This transformation can make the calculation more consistent with the local geometric features of the object surface and improve the accuracy of texture feature calculation. Under different lighting and observation angles, the relationship between light and the object surface can be accurately processed according to the coordinate space transformation matrix.
[0080] S22. Using a coordinate space conversion matrix, the initial light direction in the preset world coordinate system is converted into a local coordinate system related to the current calculation surface to obtain the light direction in the local coordinate system.
[0081] Since different object surfaces have different geometric shapes and normal directions, it is more accurate to calculate the interaction between the light direction and the object surface in the local coordinate system. Therefore, in this step, the light direction is converted to the local coordinate system to better simulate the reflection, refraction and other effects of light on the object surface, thereby calculating the texture features more accurately.
[0082] S23. Calculate surface texture features in the surrounding image according to the light direction of the local coordinate system.
[0083] In this step, the texture features are accurately calculated based on the interaction between the light and the surface of the object in the local coordinate system. For example, around an object with a concave and convex texture, the light and dark changes of the texture can be calculated based on the angle between the light and the normal vector at different positions, achieving a more realistic texture display.
[0084] Please refer to Figure 4 Further, in this embodiment, controlling the screen to display an image with surface texture features in the display area includes:
[0085] S31, identifying the connection area with the surrounding images, and extracting texture feature parameters of the connection area.
[0086] In this step, the connection area is identified and texture feature parameters are extracted to make the transition between the screen display area and the surrounding images more natural. By accurately analyzing the texture of the connection, it is possible to avoid a clear sense of separation between the displayed content and the surrounding environment, thus improving the overall visual effect.
[0087] S32: Based on the texture feature parameters of the joint, the texture at the edge of the display area of the screen is optimized for display.
[0088] Based on this step, the texture of the screen display edge is seamlessly connected with the surrounding environment, creating a continuous and unified visual experience. For example, in the car interior, the texture of the connection between the screen and the surrounding decoration is naturally transitioned, thus realizing hidden display, making the visual effect in the car more simple and more integrated.
[0089] Please refer to Figure 5 , further, based on the texture feature parameters of the joint, the texture at the edge of the display area of the screen is optimized for display, including:
[0090] S321. Create a texture transition area at the edge of the display area of the screen.
[0091] In this step, a texture transition area is created to gradually blend the texture displayed on the screen with the texture of the surrounding image. It can be understood that this transition area can effectively alleviate the visual conflict that may be caused by texture differences, allowing the screen to better integrate into the surrounding environment.
[0092] S322: Perform texture smoothing processing in the texture transition area.
[0093] In this embodiment, texture smoothing can eliminate the problem of discontinuous or abrupt texture in the transition area, making the entire transition more natural and smooth, and further improving the integration of the screen display and the surrounding environment.
[0094] Please refer to Figure 6 , further, after controlling the screen to display the image with the surface texture feature in the display area, it also includes:
[0095] S41, obtaining a connection image at the connection point between the display area and the surrounding images.
[0096] It is understandable that the purpose of obtaining the connection image is to evaluate and adjust the display effect to ensure that the integration effect of the screen and the surrounding environment continues to remain in good condition.
[0097] S42, extracting characteristic texture and geometric features of the connection image, and analyzing matching parameters between the display area and the surrounding images.
[0098] In this step, by analyzing these features and parameters, it is possible to accurately determine whether the screen display matches the surrounding environment and promptly discover possible problems, such as texture mismatch, geometric inconsistency, etc.
[0099] S43. Adjust display parameters of the screen based on the matching parameters.
[0100] By adjusting the display parameters according to the analysis results, deviations that occur during the display process can be corrected in a timely manner, ensuring that the screen can always blend perfectly with the surrounding environment, thereby improving the user's visual experience.
[0101] Furthermore, in this embodiment, the process of extracting the characteristic texture and geometric features of the connection image and analyzing the matching parameters of the display area and the surrounding images includes: identifying whether there is occlusion or missing in the connection image. This step is to discover problems that may affect the matching analysis in advance, because occlusion or missing will lead to inaccurate feature extraction, which in turn affects the evaluation of the screen display effect.
[0102] If there is occlusion or missing, the characteristic texture and geometric features of the occluded or missing area are restored based on image restoration and feature inference technology. This technology can restore the complete image information as much as possible, ensure the accuracy of matching parameter analysis, and make the judgment of the matching between the screen display and the surrounding environment more reliable.
[0103] In addition, this step can also be used for transitions and conversions between different types of texture patterns. Figure 7 In this embodiment, texture boundary recognition and parameter extraction are first performed, and the edge detection algorithm is used to determine different texture boundaries, such as red brick and marble. Then, texture parameters near the boundary are extracted, including direction, frequency, contrast, etc., to reflect texture characteristics. Next, the transition area and coordinate space conversion are constructed. When it comes to three-dimensional texture transition, the normal vector is obtained from the normal map, and the tangent and dual tangent vectors are calculated to construct the TBN matrix for coordinate space conversion to ensure accurate calculation of the lighting and texture effects in the transition area. Finally, light direction processing and texture synthesis are performed, and the initial light direction (such as LightDirection=(0, - 1, +1)) is set, and the TBN matrix is used to convert to the local coordinate system of the transition area. In the transition area, a texture synthesis method based on a sample image is used. According to the distance from the pixel to the texture boundary, the red brick and marble features are mixed by interpolation, and the color brightness is adjusted by combining the dot product of the light and the normal vector, and the transition area image is obtained, and the matching parameters with the original texture are analyzed, and the transition method and parameters are adjusted in real time based on this.
[0104] For example, a calculation method is provided below:
[0105] 1. Get the normal from the normal map: Normal = normal image point * 0.5 + 0.5
[0106] 2. From the normal NormalN, find the tangent TangentT and the dual tangent BiTangentB
[0107] 3. Calculate the TBN matrix from T, B, N, TBN=(mat3(T,B,N))T
[0108] 4. Calculate the CG light direction: LightDirection=(0,-1,+1)
[0109] 5.CG light direction conversion: LightDirection=TBN*LightDirection
[0110] Concave and convex effect calculation: Dot(Light_Dir,Normal)*texture image point R.
[0111] The normal map is a texture image that stores normal information, and its pixels contain normal vector information. Figure 8 , which is a comparison chart of the transformation from texture map to normal map.
[0112] Through the formula "Normal = normal image point * 0.5 + 0.5", the pixel values in the normal map (usually in a specific range such as [0,1] or [-1,1], etc.) are converted into the actual normal vector range that can be used for subsequent lighting calculations, bump mapping and other operations in the world coordinate system or local coordinate system. The obtained normal vector Normal can accurately represent the direction of the object surface at each point, laying the foundation for subsequent calculations.
[0113] Furthermore, from the normal NormalN, the tangent TangentT and the dual tangent BiTangentB are obtained, and this coordinate system is constructed to accurately calculate the surface lighting, texture mapping and other effects, and to produce a realistic concave and convex effect by calculating the light direction and texture offset. The lighting and texture calculations can be converted from the global coordinate system to the local coordinate system of the object surface, making the calculation more accurate and adapting to the geometric changes of the object surface.
[0114] Furthermore, the TBN matrix (Tangent-BiTangent-NormalMatrix) is formed by the tangent TangentT, the dual tangent BiTangentB and the normal NormalN in a certain order to form a 3×3 matrix (mat3(T,B,N)) and then transposed. It is mainly used for coordinate space conversion. In computer graphics, different calculations often need to be performed in different coordinate spaces. For example, lighting calculations are mostly performed in the world coordinate system or the observation coordinate system, while operations such as texture mapping are often performed in the local coordinate system of the object surface. The TBN matrix can accurately convert vectors from one coordinate space to another, such as converting vectors such as the lighting direction and the sight direction from the world coordinate system to the local coordinate system of the object surface, so as to more accurately calculate the effects of lighting, reflection, etc., and correctly apply textures to achieve visual effects that match the geometric shape of the object surface.
[0115] The initial computer graphics (CG) light direction is artificially set to LightDirection=(0,-1,+1). This vector defines the propagation direction of the light in a preset coordinate system (usually the world coordinate system). Its setting can be determined according to the lighting requirements of the scene, such as simulating sunlight from a certain angle. The coordinate value of the vector represents the components of the light in the x, y, and z axis directions. The direction of the light can be adjusted by changing the values of these components.
[0116] The formula LightDirection = TBN * LightDirection is used to convert the initially set light direction vector from the world coordinate system to the local coordinate system associated with the currently calculated surface. The purpose of this is to accurately calculate the interaction between light and the surface of the object in the local coordinate system of the object surface. In the local coordinate system, the lighting effects such as highlights and diffuse reflections can be more accurately calculated based on the actual geometry of the object surface (described by the TBN coordinate system) and the direction of the light, and more realistic visual effects can be produced in combination with texture information, such as the lighting simulation of the concave and convex effects that vary according to the geometry of the object surface.
[0117] Please refer to Fig. 9 , the left picture is a picture that cannot display the concave-convex effect in the prior art, and the right picture is a picture that can display the concave-convex effect in this application. The concave-convex effect is calculated by the formula Dot(Light_Dir,Normal)*texture image point RGB. Among them, Dot(Light_Dir,Normal) represents the dot product operation of the light direction vector Light_Dir and the normal vector Normal, which can reflect the angle relationship between the light and the surface normal, and then reflect the differences in the reflection, refraction, etc. of light at different positions on the surface. By multiplying this dot product result with the texture image point RGB, the display result with a concave-convex effect can be comprehensively calculated based on the interaction between light and the surface and the color information of the texture image itself, thereby realizing application scenarios such as smart surface display effects with concave-convex effects and variable content.
[0118] Please refer to Fig.10 Based on the above embodiments, a screen display device is provided in this embodiment, which is used to implement the above screen display method, including:
[0119] The acquisition unit 10 is used to acquire the surrounding images of the display area of the screen and obtain geometric data about the surrounding images. The acquisition unit is like an eye, which can accurately acquire image information of the surrounding environment and provide raw data for the entire display method. The accuracy of its function directly affects the degree of integration of the subsequent display effect with the environment.
[0120] The image processing unit 20 is used to extract surface texture features in the surrounding image based on the geometric data. The image processing unit is the core part, which uses the collected geometric data to perform complex calculations and processing, extract accurate texture features, and give the screen display content a texture that matches the environment.
[0121] The execution unit 30 is used to control the screen to display an image with surface texture features in the display area. The execution unit is responsible for presenting the processed results on the screen, converting theoretical calculations into actual visual effects, and ensuring the coordination and unity of the screen display and the surrounding environment.
[0122] Based on the above embodiments, a computer device is provided in this embodiment, including a memory and a processor, wherein the memory stores a computer program, and the processor implements the above-mentioned screen display method when executing the computer program. The computer device provides a running platform for the entire screen display method, and the processor executes the program stored in the memory to implement complex image acquisition, processing and display control functions, thereby ensuring the perfect integration of the screen display and the surrounding environment, and meeting the user's usage needs in different scenarios.
[0123] Based on the above embodiments, a storage medium containing computer executable instructions is provided in this embodiment, and the computer executable instructions are executed by a computer processor to implement the screen display method as described above. The storage medium is a carrier of information, and the stored executable instructions enable the computer device to execute the screen display method according to a predetermined algorithm and process, thereby ensuring the repeatability and stability of the method and providing a basis for the application of screen display technology on different devices.
[0124] Finally, it should be noted that although the above embodiments have been described in the specification and drawings of this application, this does not limit the scope of patent protection of this application. All technical solutions generated by replacing or modifying equivalent structures or equivalent processes based on the essential concept of this application using the contents recorded in the specification and drawings of this application, as well as directly or indirectly implementing the technical solutions of the above embodiments in other related technical fields, are included in the scope of patent protection of this application.
Claims
1. A screen display method, characterized in that: include: Collecting surrounding images of the display area of the screen, and obtaining geometric data about the surrounding images; extracting surface texture features in the surrounding image based on the geometric data; The screen is controlled to display an image with the surface texture features in a display area.
2. The screen display method according to claim 1, characterized in that: The collecting of the surrounding images of the display area of the screen and obtaining geometric data about the surrounding images include: Scanning the surrounding image and constructing a three-dimensional model of the surrounding image; Based on the constructed 3D model, calculate the normal vector; According to the normal vector, a tangent vector and a dual tangent vector are determined.
3. The screen display method according to claim 2, characterized in that: The step of extracting surface texture features in the surrounding image based on the geometric data includes: Based on the geometric data, construct a coordinate space transformation matrix; Using the coordinate space conversion matrix, the initial light direction in the preset world coordinate system is converted into a local coordinate system related to the current calculation surface to obtain the light direction in the local coordinate system; Calculate surface texture features in the surrounding image according to the light direction of the local coordinate system.
4. The screen display method according to claim 1, characterized in that: The control screen displays an image with the surface texture feature in a display area, including: Identify the connection area with the surrounding image and extract texture feature parameters of the connection; Based on the texture feature parameters of the joint, the texture at the edge of the display area of the screen is optimized for display.
5. The screen display method according to claim 4, characterized in that: The step of optimizing the display of the texture at the edge of the display area of the screen based on the texture feature parameters of the connection portion includes: Create a texture transition area at the edge of the screen's display area; Texture smoothing is performed in the texture transition region.
6. The screen display method according to claim 4, characterized in that: After the control screen displays the image with the surface texture feature in the display area, the method further comprises: Acquire a connection image at a connection point between the display area and the surrounding image; Extracting characteristic texture and geometric features of the connection image, and analyzing matching parameters between the display area and the surrounding image; Based on the matching parameters, display parameters of the screen are adjusted.
7. The screen display method according to claim 6, characterized in that: The process of extracting the characteristic texture and geometric features of the connection image and analyzing the matching parameters of the display area and the surrounding image includes: Identify whether there is occlusion or missing in the connected image; If so, the characteristic texture and geometric features of the occluded or missing areas are restored based on image restoration and feature inference technology.
8. A screen display device, characterized in that: Used to implement the screen display method according to any one of claims 1 to 7, comprising: A collection unit, used for collecting surrounding images of the display area of the screen, and obtaining geometric data about the surrounding images; An image processing unit, used for extracting surface texture features in the surrounding image based on the geometric data; The execution unit is used to control the screen to display the image with the surface texture feature in the display area.
9. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the screen display method according to any one of claims 1 to 7 is implemented.
10. A storage medium containing computer executable instructions, characterized in that: The computer executable instructions are executed by a computer processor to implement the screen display method according to any one of claims 1 to 7.