Projection method for special-shaped projection surface, server and computer-readable storage medium

Abstract

The embodiment of the present application discloses a projection method of a special-shaped projection surface, a server and a computer-readable storage medium, the method comprising: obtaining a first virtual model corresponding to the special-shaped projection surface and a second virtual model corresponding to the projector; using the picture to be projected, performing surface texture mapping on the first virtual model to obtain the surface texture of the first virtual model; determining the output picture corresponding to the second virtual model according to the surface texture of the first virtual model; sending the output picture to the projector, so that the projector projects the output picture onto the special-shaped projection surface. By implementing this method, it can be ensured that the picture to be projected accurately fits the special-shaped projection surface.

Description

Technical Field

[0001] The present application relates to the field of image processing technology, and in particular to a projection method for a special-shaped projection surface, a server and a computer-readable storage medium. Background Art

[0002] Projections based on irregular projection surfaces are becoming more and more common. In order to make the projection image fit the irregular projection surface, it is often necessary to pre-process the projection image. The more common pre-processing method is the grid correction method, that is, manually adjusting the grid mapped on the projection image to correct the projection image. In practice, it is found that the grid correction method is often difficult to make the projection image accurately fit the irregular projection surface due to the limitation of the number of grids. Summary of the invention

[0003] The embodiments of the present application disclose a projection method, a server and a computer-readable storage medium for a special-shaped projection surface, which can make the projection picture accurately fit the special-shaped projection surface.

[0004] A first aspect of an embodiment of the present application discloses a method for projecting a special-shaped projection surface, the method comprising:

[0005] Acquire a first virtual model corresponding to the special-shaped projection surface and a second virtual model corresponding to the projector;

[0006] Using the picture to be projected, performing surface texture mapping on the first virtual model to obtain the surface texture of the first virtual model;

[0007] determining an output picture corresponding to the second virtual model according to the surface texture of the first virtual model;

[0008] The output picture is sent to the projector so that the projector projects the output picture onto the special-shaped projection surface.

[0009] As an optional implementation manner, in the first aspect of the embodiment of the present application, determining the output picture corresponding to the second virtual model according to the surface texture of the first virtual model includes:

[0010] According to the positional relationship between the first virtual model and the second virtual model, converting the surface texture of the first virtual model into a first picture;

[0011] The first picture is adjusted according to the working parameters of the projector to obtain an output picture corresponding to the second virtual model.

[0012] As an optional implementation, in the first aspect of the embodiment of the present application, the step of obtaining a first virtual model corresponding to the irregular projection surface includes:

[0013] Acquire identification information of the special-shaped projection surface, and acquire a first virtual model corresponding to the special-shaped projection surface from a model library according to the identification information;

[0014] or,

[0015] An image of the irregular projection surface is collected, and modeling is performed based on the image of the irregular projection surface to obtain a first virtual model corresponding to the irregular projection surface.

[0016] As an optional implementation manner, in the first aspect of the embodiment of the present application, after performing surface texture mapping on the first virtual model using the picture to be projected to obtain the surface texture of the first virtual model, the method further includes:

[0017] The pixel brightness of each pixel in the surface texture of the first virtual model is set to obtain a simulated projection effect for the picture to be projected.

[0018] As an optional implementation, in the first aspect of the embodiment of the present application, after setting the pixel brightness of each pixel point in the surface texture of the first virtual model to obtain a simulated projection effect for the picture to be projected, the method further includes:

[0019] Analyzing the simulated projection effect to obtain a score for the simulated projection effect;

[0020] The step of sending the output picture to the projector so that the projector projects the output picture onto the special-shaped projection surface includes:

[0021] When the score is greater than a preset score, the output picture is sent to the projector, so that the projector projects the output picture onto the special-shaped projection surface.

[0022] As an optional implementation manner, in the first aspect of the embodiment of the present application, setting the pixel brightness of each pixel point in the surface texture of the first virtual model includes:

[0023] determining a distance value between the first virtual model and the second virtual model according to a positional relationship between the first virtual model and the second virtual model;

[0024] According to the distance value between the second virtual model and the first virtual model, the pixel brightness of each pixel point in the surface texture of the first virtual model is set.

[0025] As an optional implementation manner, in the first aspect of the embodiment of the present application, setting the pixel brightness of each pixel point in the surface texture of the first virtual model includes:

[0026] Determine, according to the positional relationship between the first virtual model and the second virtual model, an occlusion area and an overlap area of ​​the first virtual model, wherein the overlap area is an overlap area of ​​projections of a plurality of the second virtual models;

[0027] The pixel brightness of each pixel in the surface texture of the occluded area is set to a first pixel brightness, the pixel brightness of each pixel in the surface texture of the overlapping area is set to a second pixel brightness, and the pixel brightness of each pixel in the surface texture of the non-occluded and non-overlapping area is set to a third pixel brightness; wherein the first pixel brightness, the second pixel brightness and the third pixel brightness are different from each other.

[0028] A second aspect of an embodiment of the present application discloses a server, including:

[0029] An acquisition unit, used for acquiring a first virtual model corresponding to the special-shaped projection surface and a second virtual model corresponding to the projector;

[0030] A mapping unit, used to perform surface texture mapping on the first virtual model using the picture to be projected, so as to obtain the surface texture of the first virtual model;

[0031] a determining unit, configured to determine an output picture corresponding to the second virtual model according to the surface texture of the first virtual model;

[0032] A sending unit is used to send the output picture to the projector, so that the projector projects the output picture onto the special-shaped projection surface.

[0033] As an optional implementation, in the second aspect of the embodiment of the present application, the determination unit is specifically used to convert the surface texture of the first virtual model into a first picture based on the positional relationship between the first virtual model and the second virtual model; and adjust the first picture according to the working parameters of the projector to obtain an output picture corresponding to the second virtual model.

[0034] As an optional implementation, in the second aspect of the embodiment of the present application, the acquisition unit is used to acquire the first virtual model corresponding to the irregular projection surface in the following manner:

[0035] The acquisition unit is used to acquire identification information of the irregular projection surface, and acquire a first virtual model corresponding to the irregular projection surface from a model library according to the identification information;

[0036] or,

[0037] The acquisition unit is used to collect the image of the special-shaped projection surface, and perform modeling based on the image of the special-shaped projection surface to obtain a first virtual model corresponding to the special-shaped projection surface.

[0038] As an optional implementation manner, in the second aspect of the embodiment of the present application, the server further includes:

[0039] The simulation unit is used for the mapping unit to perform surface texture mapping on the first virtual model using the picture to be projected, and after obtaining the surface texture of the first virtual model, the pixel brightness of each pixel in the surface texture of the first virtual model is set to obtain a simulated projection effect for the picture to be projected.

[0040] As an optional implementation, in the second aspect of the embodiment of the present application, the simulation unit is further used to analyze the simulated projection effect to obtain a score for the simulated projection effect;

[0041] The sending unit is specifically configured to send the output picture to the projector when the score is greater than a preset score, so that the projector projects the output picture onto the special-shaped projection surface.

[0042] As an optional implementation, in the second aspect of the embodiment of the present application, the simulation unit is used to set the pixel brightness of each pixel in the surface texture of the first virtual model in the following manner:

[0043] The simulation unit is used to determine the distance value between the first virtual model and the second virtual model according to the positional relationship between the first virtual model and the second virtual model; and to set the pixel brightness of each pixel point in the surface texture of the first virtual model according to the distance value between the second virtual model and the first virtual model.

[0044] As an optional implementation, in the second aspect of the embodiment of the present application, the simulation unit is used to set the pixel brightness of each pixel in the surface texture of the first virtual model in the following manner:

[0045] The simulation unit is used to determine the occluded area and the overlapping area of ​​the first virtual model according to the positional relationship between the first virtual model and the second virtual model, wherein the overlapping area is the overlapping area of ​​the projections of multiple second virtual models; and to set the pixel brightness of each pixel point in the surface texture of the occluded area to the first pixel brightness, and to set the pixel brightness of each pixel point in the surface texture of the overlapping area to the second pixel brightness, and to set the pixel brightness of each pixel point in the surface texture of the non-occluded and non-overlapping area to the third pixel brightness; wherein the first pixel brightness, the second pixel brightness and the third pixel brightness are different from each other.

[0046] As an optional implementation, in the second aspect of the embodiment of the present application, when there are multiple projectors, the sending unit is also used to send the same projection time node to each of the projectors, so that each of the projectors projects the output image onto the special-shaped projection surface at the projection time node.

[0047] A third aspect of an embodiment of the present application discloses a server, including:

[0048] A memory storing executable program code;

[0049] a processor coupled to the memory;

[0050] The processor calls the executable program code stored in the memory to execute part or all of the steps in the first aspect of the application.

[0051] A fourth aspect of an embodiment of the present application discloses a computer-readable storage medium storing a computer program, wherein the computer program includes instructions for executing some or all of the steps in the first aspect of the present application.

[0052] The fifth aspect of the embodiment of the present application discloses a computer program product, which, when executed on a computer, enables the computer to execute part or all of the steps in the first aspect.

[0053] A sixth aspect of an embodiment of the present application discloses an application publishing system, which is used to publish a computer program product. When the computer program product runs on a computer, the computer executes some or all of the steps in the first aspect.

[0054] Compared with the prior art, the embodiments of the present application have the following beneficial effects:

[0055] In the embodiment of the present application, a first virtual model corresponding to the irregular projection surface and a second virtual model corresponding to the projector are obtained; the surface texture of the first virtual model is mapped using the image to be projected to obtain the surface texture of the first virtual model; the output image corresponding to the second virtual model is determined based on the surface texture of the first virtual model; the output image is sent to the projector so that the projector projects the output image onto the irregular projection surface. By implementing this method, the surface texture of the first virtual model is mapped using the image to be projected, so that the image to be projected can be completely fitted to the surface of the first virtual model to simulate the curved projection, and then the output image of the projector is determined based on the projection effect obtained by the simulated projection, so that the output image can be ensured to accurately fit the irregular projection surface. BRIEF DESCRIPTION OF THE DRAWINGS

[0056] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0057] Figure 1 It is an application scenario diagram disclosed in the embodiment of the present application;

[0058] Figure 2 It is a schematic flow chart of a projection method for a special-shaped projection surface disclosed in an embodiment of the present application;

[0059] Figure 3 It is a schematic flow chart of another projection method for a special-shaped projection surface disclosed in an embodiment of the present application;

[0060] Figure 4 It is a structural diagram of a server disclosed in an embodiment of the present application;

[0061] Figure 5 It is a structural diagram of another server disclosed in an embodiment of the present application;

[0062] Figure 6 It is a structural diagram of another server disclosed in an embodiment of the present application. DETAILED DESCRIPTION

[0063] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0064] It should be noted that the terms "including", "having" and any variations thereof in the embodiments of the present application and the accompanying drawings are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device including a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products or devices.

[0065] The projection method of the special-shaped projection surface disclosed in the embodiment of the present application can be applied to a server, which can be a computer. The operating system of the computer can include but is not limited to Android operating system, IOS operating system, Symbian operating system, Black Berry operating system, Windows operating system, etc., which is not limited in the embodiment of the present application.

[0066] Figure 1 is a schematic diagram of an application scenario disclosed in an embodiment of the present application, such as Figure 1 The schematic diagram of the application scenario shown includes a server 101, a projector 102, and a special-shaped projection surface 103. The server 101 can establish a communication connection with the projector 102. The projector 102 can project a picture onto the special-shaped projection surface 103. In order to ensure the projection effect of the projector 102 projecting onto the special-shaped projection surface 103, the simulation of the curved projection can be realized based on the texture map in the virtual space to obtain the projection effect, and then the output picture of the projector 102 is obtained according to the projection effect, and the output picture of the projector is sent to the projector 102, so that the projector 102 projects the output picture onto the special-shaped projection surface 103. Among them, with respect to the virtual space on the server 101, the server 101 can obtain the first virtual model 1042 corresponding to the special-shaped projection surface 103, and the second virtual model 1043 corresponding to the projector 102, and the relative positions of the first virtual model 1042 and the second virtual model 1043 in the virtual space 104 are the same as the special-shaped projection surface 103 and the projector 102 in the real scene. The server 101 may obtain the image to be projected 1041, and perform surface texture mapping on the first virtual model 1042 based on the image to be projected 1041 to obtain the surface texture 1044 of the first virtual model 1042, thereby simulating the real projection effect of the projector 102 on the special-shaped projection surface 103. The server 101 may determine the output image corresponding to the second virtual model 1043 according to the surface texture 1044 of the first virtual model 1042, and send the output image to the projector 102. The projector 102 may project the output image sent by the server 101 onto the special-shaped projection surface 103, so that the projection effect on the special-shaped projection surface 103 is the same as the surface texture 1044 of the first virtual model 1042.

[0067] In the embodiment of the present application, the projector 102 and the server 101 can be connected via a video cable or WLAN (Wireless Local Area Networks) communication. The type of the video cable can be DVI (Digital Visual Interface), HDMI (High Definition Multimedia Interface), DP (Display Port) or VGA (VGA cable, Video Graphics Array cable), etc., which is not limited here.

[0068] The embodiments of the present application disclose a projection method for a special-shaped projection surface, a server, and a computer-readable storage medium, which can ensure that the image to be projected accurately fits the special-shaped projection surface, and are described in detail below.

[0069] Embodiment 1

[0070] See also Figure 2 , Figure 2 is a schematic diagram of a process of a projection method for a special-shaped projection surface disclosed in an embodiment of the present application, such as Figure 2 The projection method of the special-shaped projection surface shown may specifically include the following steps:

[0071] 201. Obtain a first virtual model corresponding to the special-shaped projection surface and a second virtual model corresponding to the projector.

[0072] In the embodiment of the present application, the irregular projection surface may be the surface of a building, and the building may be a spherical, cylindrical, or conical building with a curvature, and the first virtual model may be a three-dimensional building model with a size mapping relationship with the building. The second virtual model may be a three-dimensional model with a size mapping relationship with the projector, or a virtual camera in a virtual space, and the virtual camera may be used to shoot the three-dimensional model constructed in the virtual space.

[0073] Optionally, after step 201, the positions of the first virtual model and the second virtual model in the virtual space may be determined according to the position of the special-shaped projection surface of the real projection scene and the projector, so as to realize the simulation of the real projection scene.

[0074] In some embodiments, obtaining the first virtual model corresponding to the irregular projection surface includes but is not limited to the following implementations:

[0075] Obtain identification information of the special-shaped projection surface, the identification information may be a uniquely identifiable character, and the character may include one or a combination of scene information, serial number information, and modeling time information of the special-shaped projection surface. In some embodiments, the identification information of the special-shaped projection surface may include the building identification to which the special-shaped projection surface belongs and the location information of the special-shaped projection surface in the building. According to the identification information, obtain a first virtual model corresponding to the special-shaped projection surface from a model library; wherein the model library may be in a local storage space of a server, so that the first virtual model can be quickly obtained.

[0076] The image of the irregular projection surface is collected, and modeling is performed based on the image of the irregular projection surface to obtain a first virtual model corresponding to the irregular projection surface. The image of the irregular projection surface can be collected by a server or by a mobile terminal connected to the server, which is not limited in the embodiment of the present application.

[0077] Among them, the second virtual model of the projector can be preset in the projector model library, the projector model library can be a sub-library of the above model library, or the projector model library and the above model library can be two independent databases, which is not limited in the embodiment of the present application.

[0078] In some embodiments, if the projector model library and the above model library are two independent databases, the projector model library may also be in the local storage space of the server; obtaining the second virtual model corresponding to the projector includes but is not limited to the following implementation methods:

[0079] Output a selection interface for the second virtual model of the projector, the selection interface may include several model identifiers; detect the selection operation for the several model identifiers to determine the selected target model identifier; search the model corresponding to the target model identifier from the projector model library as the second virtual model.

[0080] In an embodiment of the present application, in addition to determining the first virtual model, the identification information of the irregular projection surface can also determine the second virtual model. Specifically: based on the identification information of the irregular projection surface, determine the target model identification corresponding to the identification information of the irregular projection surface from a preset association mapping table; wherein the association mapping table can store the correspondence between the identification information of the irregular projection surface and the model identification of the second virtual model; and search the model corresponding to the target model identification from the projector model library as the second virtual model.

[0081] By implementing the above method, the first virtual model and the second virtual model can be flexibly acquired.

[0082] 202. Perform surface texture mapping on the first virtual model using the image to be projected to obtain the surface texture of the first virtual model.

[0083] The picture to be projected may refer to the projection picture that needs to be presented on the special-shaped projection surface. The picture to be projected may be a two-dimensional image, or a frame of an image in a video, etc. Using the picture to be projected, the surface texture mapping of the first virtual model is performed, and the surface texture of the first virtual model may include: determining the texture coordinates and spatial coordinates of each vertex of the first virtual model; mapping the texture coordinates and spatial coordinates of each vertex of the first virtual model to the picture to be projected, so as to obtain the position information of each pixel point in the picture to be projected on the surface of the first virtual model; mapping the picture to be projected onto the surface of the first virtual model according to the indication of the position information of each pixel point in the picture to be projected on the surface of the first virtual model, so as to obtain the surface texture of the first virtual model. By implementing this method, the simulation of real projection can be realized and the projection effect can be obtained.

[0084] 203. Determine an output picture corresponding to the second virtual model according to the surface texture of the first virtual model.

[0085] In some embodiments, the second virtual model may be a virtual camera, which may acquire a picture of the surface texture of the first virtual model taken by the virtual camera, and obtain an output picture based on the taken picture.

[0086] As an implementation method, determining the output screen corresponding to the second virtual model based on the surface texture of the first virtual model may include: converting the surface texture of the first virtual model into the first screen based on the positional relationship between the first virtual model and the second virtual model; and adjusting the first screen according to the working parameters of the projector to obtain the output screen corresponding to the second virtual model.

[0087] The positional relationship between the first virtual model and the second virtual model may be based on the position of the first virtual model as a reference, and the positional relationship between the first virtual model and the second virtual model may include the orientation information and distance information of the second virtual model relative to the first virtual model. For example, the positional relationship between the first virtual model and the second virtual model may be: the second virtual model is located 20 cm at 30 degrees south-east of the first virtual model. The working parameters of the projector may be a parameter matrix, and the parameter elements of the parameter matrix may include the projection distance, lens focal length, projection ratio, and screen ratio of the projector.

[0088] In some embodiments, based on the positional relationship between the first virtual model and the second virtual model, converting the surface texture of the first virtual model into the first picture may include: determining the projection area of ​​the second virtual model based on the orientation information of the first virtual model and the second virtual model and a preset perspective projection matrix; and determining the surface texture of the first virtual model in the projection area as the first picture. The perspective projection matrix is ​​used to transform a graphic onto a projection surface along a straight line converging at a certain point. The first picture can be understood as the projection picture corresponding to the second virtual model.

[0089] In some embodiments, the working parameters of the projector may be a parameter matrix, and the above-mentioned adjusting the first picture according to the working parameters of the projector to obtain the output picture corresponding to the second virtual model may include: adjusting the first picture according to the parameter matrix of the projector to obtain the output picture corresponding to the second virtual model. The parameter elements of the parameter matrix may include the projection distance, lens focal length, projection ratio and picture ratio of the projector.

[0090] 204. Send the output image to a projector, so that the projector projects the output image onto a special-shaped projection surface.

[0091] The projector can output an output picture obtained from the server. The output picture is transformed into a projection picture under the action of the working parameters of the projector. The projection picture can be projected onto a special-shaped projection surface, and a projection effect identical to the surface texture of the first virtual model can be formed on the special-shaped projection surface.

[0092] In an embodiment of the present application, before executing step 204, it is also possible to detect whether the communication link between the server and the projector is normal, and when it is detected that the communication link is normal, continue to execute step 204. The implementation of this method can effectively ensure the safe transmission of the output picture. When the number of projectors is multiple, the same projection time node can also be sent to each projector so that each projector projects the output picture to the special-shaped projection surface at the projection time node. If the projection of the picture to be projected requires multiple projectors to be projected synchronously, the implementation of this method can ensure that multiple projectors are projected at the same time point, and the viewer can see the complete projection picture at the first time. It should be noted that if the number of projectors is multiple, then the number of second virtual models is also multiple, and the number of second virtual models is consistent with the number of projectors. The method for obtaining the output picture of each second virtual model can refer to 202 to step 204.

[0093] By implementing the above method, it can be ensured that the image to be projected accurately fits the special-shaped projection surface, and the first virtual model and the second virtual model can be flexibly obtained. It can also effectively ensure the safe transmission of the output image, and the viewer can see the complete projection image at the first time.

[0094] Embodiment 2

[0095] See also Figure 3 , Figure 3 FIG. 1 is a flow chart of another method for projecting a special-shaped projection surface disclosed in an embodiment of the present application. Figure 3 The projection method of the special-shaped projection surface shown may specifically include the following steps:

[0096] 301. Obtain a first virtual model corresponding to the special-shaped projection surface and a second virtual model corresponding to the projector.

[0097] 302. Perform surface texture mapping on the first virtual model using the image to be projected to obtain the surface texture of the first virtual model.

[0098] 303. Send the output image to a projector, so that the projector projects the output image onto a special-shaped projection surface.

[0099] For the detailed description of steps 301 to 303 , please refer to the description of steps 201 to 203 in the first embodiment, which will not be repeated in this embodiment of the application.

[0100] 304 . Set the pixel brightness of each pixel in the surface texture of the first virtual model to obtain a simulated projection effect for the image to be projected.

[0101] The pixel brightness is used to indicate the brightness corresponding to the pixel point. The pixel brightness is independent of the color. The pixel brightness value ranges from 0 to 255, with a total of 256 levels. Setting the pixel brightness of each pixel point in the surface texture of the first virtual model includes but is not limited to the following implementations:

[0102] According to the positional relationship between the first virtual model and the second virtual model, the distance value between the first virtual model and the second virtual model is determined; according to the distance value between the second virtual model and the first virtual model, the pixel brightness of each pixel in the surface texture of the first virtual model is set. The distance value between the first virtual model and the second virtual model can be the distance between the center point of the first virtual model and the center point of the second virtual model. Among them, the positional relationship between the first virtual model and the second virtual model refers to the description in the first embodiment, and the embodiments of the present application will not be repeated.

[0103] According to the positional relationship between the first virtual model and the second virtual model, the distance value between the first virtual model and the second virtual model, and the occluded area and the overlapping area of ​​the first virtual model are determined; wherein the overlapping area is the overlapping area of ​​the projections of multiple second virtual models; according to the distance value between the second virtual model and the first virtual model, the pixel brightness of each pixel point in the surface texture of the first virtual model is set; and the pixel brightness of each pixel point in the surface texture of the occluded area is reduced by a first preset brightness, and the pixel brightness of each pixel point in the surface texture of the overlapping area is increased by a second preset brightness.

[0104] The overlapping area and the occluded area are explained below: referring to the description below step 203 in Example 1, the projection area of ​​the second virtual model can be determined based on the orientation information of the first virtual model and the second virtual model and the parallel projection principle / perspective projection principle. The overlapping area can be the intersection area of ​​the projection areas of multiple second virtual models. If there is an occlusion model between the first virtual model and the second virtual model, during the parallel projection / perspective projection process, the occlusion model will block part of the light projected by the second virtual model, resulting in a missing projection picture on the special-shaped projection surface. The area where the picture is missing is the occlusion area.

[0105] Determine, according to the positional relationship between the first virtual model and the second virtual model, a distance value between the first virtual model and the second virtual model, and an occlusion area of ​​the first virtual model; set the pixel brightness of each pixel point in the surface texture of the first virtual model according to the distance value between the second virtual model and the first virtual model; and reduce the pixel brightness of each pixel point in the surface texture of the occlusion area by a first preset brightness;

[0106] According to the positional relationship between the first virtual model and the second virtual model, a distance value between the first virtual model and the second virtual model, and an overlapping area of ​​the first virtual model are determined; according to the distance value between the second virtual model and the first virtual model, the pixel brightness of each pixel point in the surface texture of the first virtual model is set; and the pixel brightness of each pixel point in the surface texture of the overlapping area is increased by a second preset brightness.

[0107] According to the positional relationship between the first virtual model and the second virtual model, the occluded area and the overlapping area of ​​the first virtual model are determined; and the pixel brightness of each pixel in the surface texture of the occluded area is set to the first pixel brightness, and the pixel brightness of each pixel in the surface texture of the overlapping area is set to the second pixel brightness, and the pixel brightness of each pixel in the surface texture of the non-occluded and non-overlapping area is set to the third pixel brightness; wherein the first pixel brightness, the second pixel brightness and the third pixel brightness are different from each other; it should be noted that, in the embodiment of the present application, the first pixel brightness may be less than the third pixel brightness, and the second pixel brightness may be greater than the third pixel brightness.

[0108] According to the positional relationship between the first virtual model and the second virtual model, the occluded area of ​​the first virtual model is determined; and the pixel brightness of each pixel point in the surface texture of the occluded area is set to the first pixel brightness, and the pixel brightness of each pixel point in the surface texture of the non-occluded area is set to the third pixel brightness; wherein the first pixel brightness is less than the third pixel brightness.

[0109] According to the positional relationship between the first virtual model and the second virtual model, the overlapping area of ​​the first virtual model is determined; and the pixel brightness of each pixel point in the surface texture of the overlapping area is set to the second pixel brightness, and the pixel brightness of each pixel point in the surface texture of the non-overlapping area is set to the third pixel brightness; wherein the second pixel brightness is greater than the third pixel brightness.

[0110] 305. Analyze the simulated projection effect to obtain a score for the simulated projection effect.

[0111] 306. When the score of the simulated projection effect is greater than a preset score, the output picture is sent to the projector so that the projector projects the output picture onto the special-shaped projection surface.

[0112] By executing steps 304 to 306, a projection effect picture can be obtained. The user can preview the projection effect in real time. In addition, the projection effect can be intelligently analyzed. When the analysis result indicates that the projection effect meets the preset effect, the output picture is sent to the projector, which can further improve the curved projection effect.

[0113] When the score of the simulated projection effect is less than or equal to the preset score, adjustment information can also be obtained based on the simulated projection effect and the positional relationship between the first virtual model and the second virtual model; wherein the adjustment information may include position adjustment information for the first virtual model and / or the second virtual model; and the adjustment information is output for user reference. By implementing this method, users can be assisted to make quick real-time preview adjustments. Optionally, before outputting the adjustment information, the current adjustment mode can also be detected, and when the current adjustment mode is a manual mode, the adjustment information is output; and when the current adjustment mode is an automatic mode, the position of the first virtual model and / or the second virtual model is adjusted according to the instructions of the adjustment information. Furthermore, in the case where there is an occlusion area in the first virtual model, the adjustment information may also include position adjustment information for the third virtual model of the occluding object. By implementing this method, the automatic adjustment of the model position in the scene can be achieved based on the automatic mode, thereby improving the adjustment efficiency.

[0114] By implementing the above method, it can be ensured that the image to be projected accurately fits the special-shaped projection surface, the first virtual model and the second virtual model can be flexibly obtained, the safe transmission of the output image can be effectively guaranteed, the viewer can see the complete projection image at the first time, the curved surface projection effect can be further improved, and the user can be assisted to perform fast real-time preview adjustment. The automatic adjustment of the model position in the scene can be realized based on the automatic mode, thereby improving the adjustment efficiency.

[0115] Embodiment 3

[0116] See also Figure 4, Figure 4 is a schematic diagram of the structure of a server disclosed in an embodiment of the present application, such as Figure 4 The server shown may include an acquisition unit 401, a mapping unit 402, a determination unit 403, and a sending unit 404, wherein:

[0117] The acquisition unit 401 is used to acquire a first virtual model corresponding to the special-shaped projection surface and a second virtual model corresponding to the projector.

[0118] The method in which the acquisition unit 401 is used to acquire the first virtual model corresponding to the irregular projection surface may specifically be:

[0119] The acquisition unit 401 is used to acquire identification information of the irregular projection surface, and acquire a first virtual model corresponding to the irregular projection surface from a model library according to the identification information;

[0120] The acquisition unit 401 is used to collect the image of the special-shaped projection surface, and perform modeling according to the image of the special-shaped projection surface to obtain a first virtual model corresponding to the special-shaped projection surface.

[0121] The acquisition unit 401 is further used to determine the positions of the first virtual model and the second virtual model in the virtual space according to the position of the special-shaped projection surface of the real projection scene and the projector.

[0122] The method in which the acquisition unit 401 is used to acquire the second virtual model corresponding to the projector may specifically be:

[0123] The acquisition unit 401 is used to output a selection interface for the second virtual model of the projector, which selection interface may include several model identifiers; detect the selection operation for the several model identifiers to determine the selected target model identifier; and search the model corresponding to the target model identifier from the projector model library as the second virtual model.

[0124] The acquisition unit 401 is used to determine the target model identifier corresponding to the identification information of the irregular projection surface from a preset association mapping table based on the identification information of the irregular projection surface; wherein the association mapping table can store the correspondence between the identification information of the irregular projection surface and the model identifier of the second virtual model; and search the model corresponding to the target model identifier from the projector model library as the second virtual model.

[0125] The mapping unit 402 is used to perform surface texture mapping on the first virtual model using the picture to be projected to obtain the surface texture of the first virtual model.

[0126] The mapping unit 402 is used to use the picture to be projected to perform surface texture mapping on the first virtual model. The method for obtaining the surface texture of the first virtual model can be specifically as follows: the mapping unit 402 is used to determine the texture coordinates and spatial coordinates of each vertex of the first virtual model; the texture coordinates and spatial coordinates of each vertex of the first virtual model are mapped to the picture to be projected to obtain the position information of each pixel point in the picture to be projected on the surface of the first virtual model; according to the indication of the position information of each pixel point in the picture to be projected on the surface of the first virtual model, the picture to be projected is mapped onto the surface of the first virtual model to obtain the surface texture of the first virtual model.

[0127] The determination unit 403 is configured to determine an output picture corresponding to the second virtual model according to the surface texture of the first virtual model.

[0128] The determination unit 403 is specifically used to convert the surface texture of the first virtual model into the first picture according to the positional relationship between the first virtual model and the second virtual model; and to adjust the first picture according to the working parameters of the projector to obtain the output picture corresponding to the second virtual model.

[0129] The determination unit 403 is used to convert the surface texture of the first virtual model into the first picture according to the positional relationship between the first virtual model and the second virtual model. Specifically, the determination unit 403 is used to determine the projection area of ​​the second virtual model according to the orientation information of the first virtual model and the second virtual model and a preset perspective projection matrix; and determine the surface texture of the first virtual model in the projection area as the first picture.

[0130] The determination unit 403 is used to adjust the first picture according to the working parameters of the projector to obtain the output picture corresponding to the second virtual model. Specifically, the determination unit 403 is used to adjust the first picture according to the parameter matrix of the projector to obtain the output picture corresponding to the second virtual model.

[0131] The sending unit 404 is used to send the output picture to the projector, so that the projector projects the output picture onto the special-shaped projection surface.

[0132] The sending unit 404 is also used to detect whether the communication link between the server and the projector is normal before sending the output image to the projector, and trigger the execution of the above-mentioned sending of the output image to the projector when the communication link is detected to be normal, which can effectively ensure the safe transmission of the output image. When there are multiple projectors, the sending unit 404 is also used to send the same projection time node to each projector, so that each projector projects the output image to the special-shaped projection surface at the projection time node. If the projection of the image to be projected requires multiple projectors to be projected synchronously.

[0133] Embodiment 4

[0134] See also Figure 5 , Figure 5 is a schematic diagram of the structure of another server disclosed in an embodiment of the present application, wherein: Figure 5 The server shown is provided by Figure 4 The server optimization shown is obtained, such as Figure 5 The server shown may also include:

[0135] The simulation unit 405 is used for the mapping unit to map the surface texture of the first virtual model using the picture to be projected, and after obtaining the surface texture of the first virtual model, the pixel brightness of each pixel in the surface texture of the first virtual model is set to obtain a simulated projection effect for the picture to be projected.

[0136] The simulation unit 405 may be used to set the pixel brightness of each pixel in the surface texture of the first virtual model in the following manner:

[0137] The simulation unit 405 is used to determine the distance value between the first virtual model and the second virtual model according to the positional relationship between the first virtual model and the second virtual model; and to set the pixel brightness of each pixel point in the surface texture of the first virtual model according to the distance value between the second virtual model and the first virtual model.

[0138] The simulation unit 405 is used to determine the distance value between the first virtual model and the second virtual model, as well as the occluded area and the overlapping area of ​​the first virtual model according to the positional relationship between the first virtual model and the second virtual model; set the pixel brightness of each pixel point in the surface texture of the first virtual model according to the distance value between the second virtual model and the first virtual model; and reduce the pixel brightness of each pixel point in the surface texture of the occluded area by a first preset brightness, and increase the pixel brightness of each pixel point in the surface texture of the overlapping area by a second preset brightness.

[0139] The simulation unit 405 is used to determine the distance value between the first virtual model and the second virtual model, and the occlusion area of ​​the first virtual model according to the positional relationship between the first virtual model and the second virtual model; set the pixel brightness of each pixel point in the surface texture of the first virtual model according to the distance value between the second virtual model and the first virtual model; and reduce the pixel brightness of each pixel point in the surface texture of the occlusion area by a first preset brightness;

[0140] The simulation unit 405 is used to determine the distance value between the first virtual model and the second virtual model, and the overlapping area of ​​the first virtual model according to the positional relationship between the first virtual model and the second virtual model; set the pixel brightness of each pixel point in the surface texture of the first virtual model according to the distance value between the second virtual model and the first virtual model; and increase the pixel brightness of each pixel point in the surface texture of the overlapping area by a second preset brightness.

[0141] The simulation unit 405 is used to determine the occluded area and the overlapping area of ​​the first virtual model according to the positional relationship between the first virtual model and the second virtual model; and set the pixel brightness of each pixel point in the surface texture of the occluded area to the first pixel brightness, and set the pixel brightness of each pixel point in the surface texture of the overlapping area to the second pixel brightness, and set the pixel brightness of each pixel point in the surface texture of the non-occluded and non-overlapping area to the third pixel brightness; wherein the first pixel brightness, the second pixel brightness and the third pixel brightness are different from each other.

[0142] The simulation unit 405 is used to determine the occluded area of ​​the first virtual model according to the positional relationship between the first virtual model and the second virtual model; and set the pixel brightness of each pixel point in the surface texture of the occluded area to the first pixel brightness, and set the pixel brightness of each pixel point in the surface texture of the non-occluded area to the third pixel brightness; wherein the first pixel brightness is less than the third pixel brightness.

[0143] The simulation unit 405 is used to determine the overlapping area of ​​the first virtual model according to the positional relationship between the first virtual model and the second virtual model; and set the pixel brightness of each pixel point in the surface texture of the overlapping area to the second pixel brightness, and set the pixel brightness of each pixel point in the surface texture of the non-overlapping area to the third pixel brightness; wherein the second pixel brightness is greater than the third pixel brightness.

[0144] The simulation unit 405 is further used to analyze the above-mentioned simulation projection effect to obtain a score for the above-mentioned simulation projection effect.

[0145] The sending unit 404 is specifically configured to send the output picture to the projector when the score for the simulated projection effect is greater than a preset score, so that the projector projects the output picture onto the special-shaped projection surface.

[0146] The simulation unit 405 is also used to obtain adjustment information based on the above-mentioned simulation projection effect and the positional relationship between the first virtual model and the second virtual model when the score of the simulation projection effect is less than or equal to a preset score; wherein the adjustment information may include position adjustment information for the first virtual model and / or the second virtual model; and output the adjustment information for user reference.

[0147] Optionally, the simulation unit 405 is further configured to detect the current adjustment mode before outputting the adjustment information, and output the adjustment information when the current adjustment mode is the manual mode; and when the current adjustment mode is the automatic mode, adjust the position of the first virtual model and / or the second virtual model according to the instruction of the adjustment information. Furthermore, in the case where there is an occlusion area in the first virtual model, the adjustment information may also include position adjustment information of the third virtual model for the occluding object.

[0148] See also Figure 6 , Figure 6 Schematic diagram of the structure of a server disclosed in the embodiment of the present application. Figure 5 As shown, the server may include:

[0149] A memory 601 storing executable program codes;

[0150] a processor 602 coupled to the memory 601;

[0151] The processor 602 calls the executable program code stored in the memory 601 to execute part or all of the steps of the method in the above embodiment.

[0152] An embodiment of the present application discloses a computer-readable storage medium storing a computer program, wherein the computer program enables a computer to execute part or all of the steps of the method in the above embodiment.

[0153] The embodiments of the present application disclose a computer program product. When the computer program product is run on a computer, the computer executes part or all of the steps of the method in the above embodiments.

[0154] An embodiment of the present application discloses an application publishing system, which is used to publish a computer program product. When the computer program product runs on a computer, the computer executes part or all of the steps of the method in the above embodiment.

[0155] Those skilled in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium, and the storage medium includes a read-only memory (ROM), a random access memory (RAM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), a one-time programmable read-only memory (OTPROM), an electronically erasable rewritable read-only memory (EEPROM), a compact disc (CD-ROM) or other optical disc storage, magnetic disk storage, magnetic tape storage, or any other computer-readable medium that can be used to carry or store data.

[0156] The above is a detailed introduction to a projection method for a special-shaped projection surface, a server, and a computer-readable storage medium disclosed in an embodiment of the present application. Specific examples are used herein to illustrate the principles and implementation methods of the present application. The size of the step numbers in the above specific examples does not necessarily mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present application. The units described above as separate components may or may not be physically separated, and some or all of the units may be selected according to actual needs to achieve the purpose of the scheme of this embodiment.

[0157] In this article, the character "or" generally indicates that the objects associated before and after are in an "or" relationship. In the embodiments provided in the present application, it should be understood that "B corresponding to A" means that B is associated with A, and B can be determined according to A. However, it should also be understood that determining B according to A does not mean determining B only according to A, but B can also be determined according to A and or or other information. In addition, each functional unit in each embodiment of the present application can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of a software functional unit. If the above-mentioned integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-accessible memory. Based on such an understanding, the technical solution of the present application is essentially or part of the prior art that contributes to the technical solution or all or part of the technical solution, which can be embodied in the form of a software product, which is stored in a memory, including several requests to enable a computer device (which can be a personal computer, a server or a network device, etc., and can be a processor in a computer device) to perform some or all of the steps of the above methods of each embodiment of the present application.

[0158] The description of the above embodiments is only used to help understand the method of the present application and its core idea; at the same time, for a person skilled in the art, according to the idea of ​​the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A projection method for a special-shaped projection surface, characterized in that: The method comprises: Acquire a first virtual model corresponding to the special-shaped projection surface and a second virtual model corresponding to the projector; Using the picture to be projected, performing surface texture mapping on the first virtual model to obtain the surface texture of the first virtual model; Setting the pixel brightness of each pixel in the surface texture of the first virtual model to obtain a simulated projection effect for the image to be projected; analyzing the simulated projection effect to obtain a score for the simulated projection effect; Determine a projection area of ​​the second virtual model according to the orientation information of the first virtual model and the second virtual model and a preset perspective projection matrix; determine a surface texture of the first virtual model in the projection area as a first picture; Adjusting the first picture according to the parameter matrix of the projector to obtain an output picture corresponding to the second virtual model; Detecting whether the communication link between the server and the projector is normal; When it is detected that the communication link is normal and the score is greater than a preset score, the output picture is sent to the projector so that the projector projects the output picture onto the special-shaped projection surface.

2. The method according to claim 1, characterized in that The step of obtaining a first virtual model corresponding to the special-shaped projection surface includes: Acquire identification information of the special-shaped projection surface, and acquire a first virtual model corresponding to the special-shaped projection surface from a model library according to the identification information; or, An image of the irregular projection surface is collected, and modeling is performed based on the image of the irregular projection surface to obtain a first virtual model corresponding to the irregular projection surface.

3. The method according to claim 1, characterized in that The step of setting the pixel brightness of each pixel point in the surface texture of the first virtual model includes: determining a distance value between the first virtual model and the second virtual model according to a positional relationship between the first virtual model and the second virtual model; According to the distance value between the second virtual model and the first virtual model, the pixel brightness of each pixel point in the surface texture of the first virtual model is set.

4. The method according to claim 1, characterized in that: The step of setting the pixel brightness of each pixel point in the surface texture of the first virtual model includes: Determine, according to the positional relationship between the first virtual model and the second virtual model, an occlusion area and an overlap area of ​​the first virtual model, wherein the overlap area is an overlap area of ​​projections of a plurality of the second virtual models; The pixel brightness of each pixel in the surface texture of the occluded area is set to a first pixel brightness, the pixel brightness of each pixel in the surface texture of the overlapping area is set to a second pixel brightness, and the pixel brightness of each pixel in the surface texture of the non-occluded and non-overlapping area is set to a third pixel brightness; wherein the first pixel brightness, the second pixel brightness and the third pixel brightness are different from each other.

5. The method according to claim 1, characterized in that When there are multiple projectors, the method further includes: The same projection time node is sent to each of the projectors, so that each of the projectors projects the output image onto the special-shaped projection surface at the projection time node.

6. A server, characterized in that: include: An acquisition unit, used for acquiring a first virtual model corresponding to the special-shaped projection surface and a second virtual model corresponding to the projector; A mapping unit, used to perform surface texture mapping on the first virtual model using the picture to be projected, so as to obtain the surface texture of the first virtual model; A simulation unit, used for setting the pixel brightness of each pixel point in the surface texture of the first virtual model to obtain a simulated projection effect for the picture to be projected; Analyzing the simulated projection effect to obtain a score for the simulated projection effect; A determination unit, configured to determine a projection area of ​​the second virtual model according to the orientation information of the first virtual model and the second virtual model and a preset perspective projection matrix; and determine a surface texture of the first virtual model in the projection area as a first picture; Adjusting the first picture according to the parameter matrix of the projector to obtain an output picture corresponding to the second virtual model; A sending unit, used to detect whether the communication link between the server and the projector is normal; When it is detected that the communication link is normal and the score is greater than a preset score, the output picture is sent to the projector so that the projector projects the output picture onto the special-shaped projection surface.

7. An electronic device, characterized in that: The electronic device comprises: A memory storing executable program code; a processor coupled to the memory; The processor calls the executable program code stored in the memory to execute the method according to any one of claims 1 to 5.

8. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, wherein the computer program includes instructions for executing the method according to any one of claims 1 to 5.

Images