Projection method and related apparatus

Abstract

The application discloses a projection method and a related device, which are applied to the technical field of image processing. The projection method comprises the following steps: acquiring a first image and scene information of a first region, and generating a second image based on the first image and the scene information of the first region, wherein the first image comprises an image which is expected to be presented in the first region, and the second image is used for being projected into the first region. The second image is obtained by correcting the first image based on the first image and the scene information of the first region, and the image presented in the first region is projected. In the user's vision, the image can be more consistent with the real color and / or brightness which the first image is expected to present, so as to solve the problem of image distortion existing in the projection of a car lamp.

Description

Projection method and related apparatus TECHNICAL FIELD

[0001] The present application relates to the technical field of image processing, and particularly relates to a projection method and related apparatus. BACKGROUND

[0002] At present, with the development of projection technology, the application of light digital projection is more and more extensive. For example, the light of a car is no longer limited to the illumination level. In the field of auxiliary driving, the intelligent car light of the car can project text or relatively complex graphics such as traffic signs. In the entertainment scene, the intelligent car light of the car can project video pictures.

[0003] However, when the car light projects, there may be a problem of image distortion.

[0004] Therefore, there is an urgent need for a feasible solution to solve the problem of image distortion in car light projection.

[0005] SUMMARY

[0006] The embodiments of the present application provide a projection method and related apparatus, which can solve the problem of image distortion in car light projection.

[0007] In a first aspect, the embodiments of the present application provide a projection method, which comprises:

[0008] obtaining a first image, wherein the first image comprises an image expected to be presented in a first region;

[0009] obtaining scene information of the first region;

[0010] generating a second image based on the first image and the scene information of the first region, wherein the second image is used for projection into the first region.

[0011] In the embodiments of the present application, a projection method is provided. A second image is generated based on a first image and scene information of a first region, and the second image is used for projection into the first region. It can be understood that when a user expects to present the first image in the first region, due to the influence of factors such as the color of the first region, the ambient light of the first region, the medium material of the projection path, and the like, the image presented by directly projecting the first image into the first region can be quite different from the first image expected to be presented in the first region, that is, it can be understood that the image visually seen by the user is quite different from the original first image, and the display effect and the user visual experience are poor. The second image obtained by correcting the first image based on the first image and the scene information of the first region in the embodiments of the present application is projected into the first region to present an image that is more consistent with the expected presentation effect of the first image in the user's vision, thereby solving the problem of image distortion existing in vehicle lamp projection. Moreover, the embodiments of the present application do not need to project the first image first, adjust the first image according to the difference between the image presented by projecting the first image into the first region and the first image, and then project the adjusted image again. The second image projected for the first time in the embodiments of the present application is the image obtained by correcting the first image based on the first image and the scene information of the first region, and does not need to be projected again. This can reduce the lag of projection and improve the display effect of projection and the user visual experience.

[0012] In a possible implementation, an image difference degree between a third image presented by projecting the second image in the first region and the first image is less than an image difference degree between the third image and the second image, and the image difference degree includes a color difference degree and / or a brightness difference degree of the image.

[0013] In the embodiments, the third image presented by projecting the second image obtained by correcting the first image based on the first image and the scene information of the first region into the first region is more consistent with the real color and / or brightness expected to be presented by the first image in the user's vision, which can improve the display effect of projection and the user visual experience and solve the problems of color deviation and / or uneven brightness existing in vehicle lamp projection.

[0014] In a possible implementation, a first pixel in the first image corresponds to a first chroma value, a second pixel in the second image corresponds to a second chroma value, and a third pixel in the third image corresponds to a third chroma value. The first pixel corresponds to the second pixel, and the second pixel corresponds to the third pixel.

[0015] In the embodiments, a difference degree between the third chroma value and the first chroma value is less than a difference degree between the third chroma value and the second chroma value.

[0016] In the embodiment, the correction method for the pixel level in each frame of image is such that the chrominance value of each pixel of the third image presented in the first region after the correction of the second image is obtained, and the above-mentioned correction method based on the pixel dimension can present the chrominance value of the corresponding pixel in the first image to a greater extent, so as to be more consistent with the real color and / or brightness expected to be presented by the first image, improve the display effect of projection and the visual experience of the user.

[0017] In a possible implementation, the first pixel region in the first image corresponds to a fourth chrominance value, the second pixel region in the second image corresponds to a fifth chrominance value, the third pixel region in the third image corresponds to a sixth chrominance value, the first pixel region corresponds to the second pixel region, the second pixel region corresponds to the third pixel region, and the first pixel region includes a plurality of pixels.

[0018] In the embodiment, the difference between the sixth chrominance value and the fourth chrominance value is less than the difference between the sixth chrominance value and the fifth chrominance value.

[0019] In the embodiment, the correction method for the pixel region (a region including one or more pixels) level in each frame of image is such that the chrominance value of each pixel region of the third image presented in the first region after the correction of the second image is obtained, and the above-mentioned correction method based on the region dimension can present the chrominance value of the corresponding pixel region in the first image to a greater extent, so as to be more consistent with the real color and / or brightness expected to be presented by the first image, improve the display effect of projection and the visual experience of the user.

[0020] In a possible implementation, the scene information of the first region includes color information of the first region, and / or ambient light information of the first region, and / or information of a first medium, the first medium including a medium of a projection path of the second image, and / or weather information of the first region.

[0021] In the embodiment, the scene information of the first region includes, but is not limited to, color information of the first region, and / or ambient light information of the first region, and / or information of the first medium. The color information of the first region can be understood as color information of a carrier for presenting the final projection image, and the color degree of the carrier is related to the light reaching the human eye. The ambient light information of the first region can be understood as the brightness of the ambient light of the first region. The first medium includes a medium of the projection path of the second image, which can have an effect on the final presented image quality, such as absorption, reflection, refraction, etc. of light. The second image obtained by correcting the first image based on the above-mentioned scene information of the first region and the first image is projected into the first region to present an image that is more consistent with the real color and / or brightness expected to be presented by the first image in the user's vision, so as to solve the problems of color deviation and / or brightness unevenness in the car lamp projection.

[0022] In a possible implementation, the generating the second image based on the first image and the scene information of the first region includes:

[0023] generating correction information based on the first image and the scene information of the first region;

[0024] generating the second image based on the correction information and the first image.

[0025] In the embodiment, the correction information is generated based on the first image and the scene information of the first region, and the second image is generated based on the correction information and the first image, which is used for projection into the first region. It can be understood that the second image obtained by correcting the first image based on the correction information generated by the embodiment of the present application based on the first image and the scene information of the first region, and the image presented by projecting the second image into the first region is more consistent with the real color and / or brightness expected to be presented by the first image in the user's vision, so as to solve the problems of color deviation and / or brightness unevenness in the car lamp projection.

[0026] In a possible implementation, the correction information includes a color degree time division value for indicating a light source, and / or a modulation parameter of a spatial light modulator for indicating a color degree.

[0027] In the embodiment, the correction information includes a chromaticity time division value of the light source, so that the chromaticity time division value of the light source to the light machine can be adjusted to the chromaticity time division value indicated by the correction information, so as to realize the projection of the second image obtained by correcting the first image. The correction information can also include a modulation parameter of the spatial light modulator for chromaticity. Optionally, the spatial light modulator can include but is not limited to liquid crystal on silicon (LCoS), digital light procession (DLP) and the like. Optionally, taking the LCoS as an example, the modulation parameter of the chromaticity can include but is not limited to the voltage value of the spatial light modulator. The voltage of the spatial light modulator can be adjusted according to the modulation parameter indicated by the correction information, so as to adjust the polarization state of the spatial light modulator (i.e. adjust the polarization rotation of the spatial light modulator), adjust the light intensity, and realize the correction of the chromaticity of the first image. The second image obtained by the above correction is projected to the image presented in the first area, which is more consistent with the real color and / or brightness expected to be presented by the first image in the user's vision.

[0028] In a possible implementation, the correction information is generated based on the first image and the scene information of the first area, including:

[0029] The correction information is generated based on the first image, the scene information of the first area and image correction relationship information, and the image correction relationship information is used to indicate the corresponding relationship between the actual image presented by the projection image in the projection area and the projection image.

[0030] In the embodiment, the correction information is generated based on the first image and the scene information of the first area, and the correction information is generated based on the first image, the scene information of the first area and image correction relationship information, and the image correction relationship information is used to indicate the corresponding relationship between the actual image presented by the projection image in the projection area and the projection image. Optionally, the image correction relationship information can be pre-configured in the first projection device used to execute the projection method in the embodiment. It can be understood that the image correction relationship information can be obtained by a large number of tests on a large number of projection images and actual images presented by the projection images in the projection area, so that the correction information based on the image correction relationship information is more consistent with the real color and / or brightness expected to be presented by the first image in the user's vision.

[0031] In a possible implementation, the correction information is generated based on the first image and the scene information of the first area, including:

[0032] generate the correction information based on the first image, the scene information of the first region, and an artificial intelligence network model.

[0033] In the embodiment, the generation of the correction information based on the first image and the scene information of the first region can specifically be the generation of the correction information based on the first image, the scene information of the first region, and an artificial intelligence network model. The artificial intelligence network model can be various neural network models, which are not limited by the embodiments of the present application. It can be understood that, since the artificial intelligence network model has the ability to process massive data and the accuracy, the first image and the scene information of the first region are input into the artificial intelligence network model, and the correction information is output, which is more consistent with the real color and / or brightness expected to be presented by the first image in the user's vision.

[0034] In a possible implementation, the artificial intelligence network model is used to train the actual image presented by the input projection image in the projection region, the scene information of the projection region, and the projection image.

[0035] In the embodiment, the artificial intelligence network model is used to train the actual image presented by the input projection image in the projection region, the scene information of the projection region, and the projection image. After a large number of input training of the artificial intelligence network model, the accuracy of the correction information output by the artificial intelligence network model for various first images and scene information of the first region will be higher, and the real color and / or brightness expected to be presented by the first image in the user's vision will be more consistent.

[0036] In a possible implementation, the artificial intelligence network model is pre-configured in the first projection device used to perform the projection method.

[0037] In a possible implementation, the generation of the second image based on the first image and the scene information of the first region includes:

[0038] The second image is generated based on a size relationship between a difference degree between the color corresponding to the scene information of the first region and the color of the first image and the first threshold, and / or a size relationship between the complexity of the scene information of the first region and the second threshold.

[0039] In the embodiment, whether to perform the fine correction of the first image in the pixel granularity or to perform the coarse correction of the first image in the overall chroma can be determined based on a size relationship between a difference degree between the color corresponding to the scene information of the first region and the color of the first image and the first threshold. Optionally, when the difference degree is greater than the first threshold, the fine correction of the first image in the pixel granularity is performed, and otherwise, the coarse correction of the first image in the overall chroma is performed. In addition, whether to perform the fine correction of the first image in the pixel granularity or to perform the coarse correction of the first image in the overall chroma can also be determined based on a size relationship between the complexity of the scene information of the first region and the second threshold. Optionally, when the complexity is greater than the second threshold, the fine correction of the first image in the pixel granularity is performed, and otherwise, the coarse correction of the first image in the overall chroma is performed.

[0040] Optionally, the first threshold and the second threshold are not fixed values, and can be adjusted according to different application scenarios, so as to realize that the real color and / or brightness expected to be presented by the first image is more consistent with the user's vision.

[0041] In a possible implementation, the projection method further includes:

[0042] projecting the second image to the first region.

[0043] In the embodiment, the first projection device for performing the projection method in the embodiment of the application can be a vehicle lamp, and in this case, the corrected second image can also be projected to the first region to solve the problems of color deviation and / or brightness unevenness in vehicle lamp projection.

[0044] In a possible implementation, the projection method further includes:

[0045] sending indication information to the second projection device, the indication information including the second image, and the indication information being used to instruct the second projection device to project the second image to the first region.

[0046] In the embodiment, the first projection device for performing the projection method in the embodiment of the application can be a device such as a cockpit in communication connection with a vehicle lamp, and in this case, the indication information can also be sent to the second projection device to instruct the second projection device to project the corrected second image to the first region to solve the problems of color deviation and / or brightness unevenness in vehicle lamp projection. Optionally, the second projection device can be a vehicle lamp.

[0047] In a possible implementation, when the scene information of the first region indicates that the time division value of the first chroma corresponding to the first region is greater than a third threshold, the time division value of the first chroma of the second image is less than the time division value of the first chroma of the first image.

[0048] In the embodiment, a possible specific implementation of the coarse correction of the overall chroma of the first image is provided, specifically, when it is identified that the scene information of the first region indicates that the time division value of the first chroma corresponding to the first region is greater than a third threshold, the time division value of the first chroma of the image is lowered when the first image is corrected, so that the time division value of the first chroma of the second image obtained after correction is less than the time division value of the first chroma of the first image. The time division value of the first chroma of the third image presented in the first region by projecting the second image obtained through the above coarse correction, the correction method based on the image dimension can present the time division value of the first chroma of the overall first image to a greater extent, so as to be more consistent with the real color and / or brightness expected to be presented by the first image, thereby improving the display effect of projection and the visual experience of the user.

[0049] In a possible implementation, the projection method further includes:

[0050] controlling display of prompt information, the prompt information being used to prompt to start an image correction function, the image correction function being used to correct the first image.

[0051] In the embodiment, a possible specific implementation of the display image correction is also provided, specifically, the prompt information is controlled to be displayed to prompt to start the image correction function, and when the user responds to the prompt to confirm to start the image correction function, the projection method in the embodiment is executed to correct the first image, so that the image presented in the first region by finally projecting the corrected image can be more consistent with the real color and / or brightness expected to be presented by the first image in the visual of the user, so as to solve the problems of color deviation and / or uneven brightness in the projection of the vehicle lamp.

[0052] In a possible implementation, a projection device used to project the second image includes at least one of the following:

[0053] a vehicle lamp module, a head up display (HUD), a vehicle-mounted projector, and a household projector.

[0054] In the embodiment, the projection device used to project the second image includes but is not limited to at least one of a vehicle lamp module, a head up display (HUD), a vehicle-mounted projector, and a household projector, and the embodiment of the present application does not limit this.

[0055] In a second aspect, the embodiments of the present application provide a projection device, the device comprising units for performing the method according to any one of the first aspect.

[0056] In a possible design, the device comprises:

[0057] a perception unit, an image calibration unit;

[0058] The image calibration unit is configured to acquire a first image, the first image comprising an image expected to be presented in a first region.

[0059] The perception unit is configured to acquire scene information of the first region.

[0060] The image calibration unit is further configured to generate a second image based on the first image and the scene information of the first region, the second image being used for projection into the first region.

[0061] In a possible implementation, an image difference degree between a third image presented in the first region and the first image is less than an image difference degree between the third image and the second image, the image difference degree comprising a color difference degree and / or a brightness difference degree of an image.

[0062] In a possible implementation, a first pixel in the first image corresponds to a first chroma value, a second pixel in the second image corresponds to a second chroma value, and a third pixel in the third image corresponds to a third chroma value, the first pixel corresponding to the second pixel, and the second pixel corresponding to the third pixel.

[0063] The difference degree between the third chroma value and the first chroma value is less than the difference degree between the third chroma value and the second chroma value.

[0064] In a possible implementation, a first pixel region in the first image corresponds to a fourth chroma value, a second pixel region in the second image corresponds to a fifth chroma value, and a third pixel region in the third image corresponds to a sixth chroma value, the first pixel region corresponding to the second pixel region, and the second pixel region corresponding to the third pixel region, the first pixel region comprising a plurality of pixels.

[0065] The difference degree between the sixth chroma value and the fourth chroma value is less than the difference degree between the sixth chroma value and the fifth chroma value.

[0066] In a possible implementation, the scene information of the first region includes color information of the first region, and / or ambient light information of the first region, and / or information of a first medium, the first medium including a medium of a projection path of the second image, and / or weather information of the first region.

[0067] In a possible implementation, the image calibration unit is specifically configured to generate correction information based on the first image and the scene information of the first region.

[0068] The image calibration unit is further configured to generate the second image based on the correction information and the first image.

[0069] In a possible implementation, the correction information includes a colorimetric time division value for indicating a light source to a light machine, and / or a modulation parameter of a spatial light modulator to colorimetry.

[0070] In a possible implementation, the image calibration unit is specifically configured to generate the correction information based on the first image, the scene information of the first region, and image correction relationship information, the image correction relationship information being used to indicate a corresponding relationship between an actual image of a projection image presented in a projection region and the projection image.

[0071] In a possible implementation, the image calibration unit is specifically configured to generate the correction information based on the first image, the scene information of the first region, and an artificial intelligence network model.

[0072] In a possible implementation, the artificial intelligence network model is used to train an actual image of an input projection image presented in a projection region, scene information of the projection region, and the projection image.

[0073] In a possible implementation, the artificial intelligence network model is preconfigured in a first projection device used to execute the projection method.

[0074] In a possible implementation, the image calibration unit is further configured to generate the second image based on a size relationship between a difference degree between a color corresponding to the scene information of the first region and a color of the first image and a first threshold, and / or a size relationship between a complexity of the scene information of the first region and a second threshold.

[0075] In a possible implementation, the projection device further includes a projection unit.

[0076] The projection unit is configured to project the second image to the first region.

[0077] In a possible implementation, the projection device further includes a communication unit.

[0078] The communication unit is configured to send indication information to the second projection device, the indication information including the second image, and the indication information being used to instruct the second projection device to project the second image into the first region.

[0079] In a possible implementation, when the scene information of the first region indicates that a time division value of a first chroma corresponding to the first region is greater than a third threshold value, a time division value of the first chroma of the second image is less than a time division value of the first chroma of the first image.

[0080] In a possible implementation, the image calibration unit is further configured to control display of prompt information, the prompt information being used to prompt to turn on an image correction function, the image correction function being used to correct the first image.

[0081] The steps performed by each unit described with respect to the second aspect and any possible implementation can refer to the corresponding description of the first aspect and the corresponding implementation.

[0082] The technical effects brought by the second aspect and any possible implementation can refer to the corresponding description of the technical effects of the first aspect and the corresponding implementation.

[0083] Optionally, in the projection device of the second aspect and any possible implementation, the projection device further includes:

[0084] In an implementation, the projection device is a projection apparatus. When the projection device is a projection apparatus, the communication unit can be a transceiver, or an input / output interface; and the processing unit can be at least one processor. Optionally, the transceiver can be a transceiver circuit. Optionally, the input / output interface can be an input / output circuit.

[0085] In another implementation, the projection device is a chip (system) or a circuit used in a projection apparatus. When the projection device is a chip (system) or a circuit used in a projection apparatus, the communication unit can be a communication interface (input / output interface), an interface circuit, an output circuit, an input circuit, a pin, or related circuit on the chip (system) or the circuit; and the processing unit can be at least one processor, a processing circuit, or a logic circuit.

[0086] In a third aspect, an embodiment of the present application provides a projection device, the projection device comprising a processor. The processor is coupled with a memory and is configured to execute instructions in the memory to implement the method in the first aspect and any possible implementation of the first aspect. Optionally, the projection device further comprises the memory. Optionally, the projection device further comprises a communication interface, and the processor is coupled with the communication interface.

[0087] In a fourth aspect, an embodiment of the present application provides a chip, comprising: a logic circuit and a communication interface. The communication interface is configured to receive information or send information. The logic circuit is configured to receive information or send information through the communication interface, so that the chip implements the method in the first aspect and any possible implementation of the first aspect.

[0088] In a fifth aspect, an embodiment of the present application provides a computer readable storage medium, configured to store a computer program (also referred to as code or instructions). When the computer program is run on a computer, the method in the first aspect and any possible implementation of the first aspect is implemented.

[0089] In a sixth aspect, an embodiment of the present application provides a computer program product, comprising: a computer program (also referred to as code or instructions). When the computer program is run, the computer executes the method in the first aspect and any possible implementation of the first aspect.

[0090] In a seventh aspect, an embodiment of the present application provides a movable terminal, comprising at least one projection device according to the second aspect, or a projection device according to the third aspect, or a chip according to the fourth aspect.

[0091] The movable terminal can be a vehicle, which is a general concept of a vehicle, and can be a traffic tool such as a commercial vehicle, a passenger vehicle, a train, an industrial vehicle (such as a forklift, a trailer, a tractor, etc.), an engineering vehicle (such as an excavator, a bulldozer, a crane, etc.), a robot, etc.

[0092] Optionally, the movable terminal is configured to implement the method described in the first aspect or any possible implementation of the first aspect.

[0093] Further, in the process of executing the method of the first aspect and any possible implementation thereof, the processes of sending information and / or receiving information and the like in the above method can be understood as the process of outputting information by the processor and / or the process of receiving input information by the processor. When outputting information, the processor can output the information to the transceiver (or the communication interface or the sending module) so as to be transmitted by the transceiver. After being output by the processor, the information can also need to be processed further before reaching the transceiver. Similarly, when the processor receives input information, the transceiver (or the communication interface or the sending module) receives the information and inputs the information to the processor. Furthermore, after being received by the transceiver, the information can need to be processed further before being input to the processor.

[0094] For example, the sending information mentioned in the foregoing method can be understood as the output information by the processor. For another example, the receiving information can be understood as the input information received by the processor.

[0095] Optionally, for the transmission, sending and receiving operations and the like involved by the processor, if no special description is made, or if it is not contrary to the actual role or inherent logic thereof in the related description, it can be more generally understood as the output and input operations of the processor.

[0096] Optionally, in the process of executing the method of the first aspect and any possible implementation thereof, the processor can be a processor specially used for executing the method, or can be a processor such as a general processor which executes the method by executing computer instructions in the memory. The memory can be a non-transitory memory such as a read only memory (ROM), which can be integrated on the same chip as the processor, or can be respectively arranged on different chips. The type of the memory and the arrangement mode of the memory and the processor are not limited in the embodiments of the present application.

[0097] In a possible implementation, the at least one memory is located outside the device.

[0098] In another possible implementation, the at least one memory is located inside the device.

[0099] In another possible implementation, part of the at least one memory is located inside the device, and another part of the at least one memory is located outside the device.

[0100] In the present application, the processor and the memory can also be integrated in one device, that is, the processor and the memory can also be integrated together. BRIEF DESCRIPTION OF DRAWINGS

[0101] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following will briefly introduce the drawings needed to be used in the embodiments of the present application. Obviously, the drawings described below are only some of the embodiments of the present application, and for those skilled in the art, other drawings can also be obtained from these drawings without creative labor.

[0102] Fig. 1 is an architecture schematic diagram of a vehicle lamp projection system provided by an embodiment of the present application;

[0103] Fig. 2 is a flow schematic diagram of a projection method provided by an embodiment of the present application;

[0104] Fig. 3 is a schematic diagram of chroma value correction provided by an embodiment of the present application;

[0105] Fig. 4 is a schematic diagram of another chroma value correction provided by an embodiment of the present application;

[0106] Fig. 5 is a schematic diagram of an image projection corresponding relationship provided by an embodiment of the present application;

[0107] Fig. 6 is a schematic diagram of an image correction corresponding relationship provided by an embodiment of the present application;

[0108] Fig. 7 is an architecture schematic diagram of a projection system provided by an embodiment of the present application;

[0109] Fig. 8 is an architecture schematic diagram of another projection system provided by an embodiment of the present application;

[0110] Fig. 9 is a structural schematic diagram of a projection device provided by an embodiment of the present application;

[0111] Fig. 10 is a structural schematic diagram of an electronic device provided by an embodiment of the present application;

[0112] Fig. 11 is a structural schematic diagram of a chip provided by an embodiment of the present application. DETAILED DESCRIPTION

[0113] In order to make the purpose, technical solutions and advantages of the present application more clear, the following will describe the embodiments of the present application in combination with the drawings in the embodiments of the present application.

[0114] The terms "first" and "second" and the like in the description and in the claims of the present application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. Furthermore, the terms "comprises", "comprising", "includes", "including", "has", "having" and the like are intended to cover a non-exclusive inclusion, such that a process, method, article, system or apparatus that comprises, includes or has a list of elements does not include only those elements but can include other elements not expressly listed or inherent to such process, method, article, system or apparatus. Additionally, the terms "a" and "an" are defined as taking the meaning of "one or more" of the referenced item.

[0115] Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase "in an embodiment" in various places in the specification are not necessarily all referring to the same embodiment, nor are they necessarily mutually exclusive of one another. It is appreciated that those skilled in the art can readily interpret implementation of the various embodiments in light of the disclosure and the inherent nature of the technical features, and that the technical features in different embodiments can be combined to form new embodiments according to their inherent logical relationships.

[0116] It should be understood that, in the application, "at least one" means one or more, "multiple" means two or more, "at least two" means two or three and three or more, and "and / or" is used to describe the relationship between associated objects, indicating that there can be three relationships, for example, "A and / or B" can mean that there are three cases of only A, only B, and A and B at the same time, where A and B can be singular or plural. The character " / " generally represents an "or" relationship between the associated objects before and after it. "At least one of the following" or similar expressions means any combination of these items, including any combination of single or multiple items. For example, at least one of a, b or c can mean a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, and c can be single or multiple.

[0117] It should be noted that in the present application, "indication" can include direct indication, indirect indication, explicit indication, and implicit indication. When describing that certain indication information is used to indicate A, it can be understood that the indication information carries A, directly indicates A, or indirectly indicates A.

[0118] In this application, the information indicated by the instruction information is called the information to be instructed. In specific implementations, there are many ways to indicate the information to be instructed, such as, but not limited to, directly indicating the information to be instructed, such as the information to be instructed itself or its index. It can also indirectly indicate the information to be instructed by indicating other information, where there is a correlation between the other information and the information to be instructed. It can also indicate only a part of the information to be instructed, while the other parts are known or pre-agreed upon. For example, the instruction of specific information can be achieved by using a pre-agreed (e.g., protocol-defined) arrangement of various information, thereby reducing instruction overhead to some extent. The information to be instructed can be sent as a whole or divided into multiple sub-information units, and the sending period and / or timing of these sub-information units can be the same or different. This application does not limit the specific sending method. The sending period and / or timing of these sub-information units can be predefined, for example, according to a protocol, or configured by the transmitting device by sending configuration information to the receiving device.

[0119] It should be noted that in this application, "send" can be understood as "output" and "receive" can be understood as "input". "Send information to A", where "to A" simply indicates the direction of information transmission, and A is the destination, does not limit "send information to A" to a direct transmission over the air interface. "Send information to A" includes sending information directly to A, as well as sending information indirectly to A through a transmitter. Therefore, "send information to A" can also be understood as "outputting information destined for A". Similarly, "receive information from A" indicates that the source of the information is A, including receiving information directly from A, as well as receiving information indirectly from A through a receiver. Therefore, "receive information from A" can also be understood as "inputting information from A".

[0120] To better understand the technical solution of this application, the relevant terms and concepts that may be involved in the embodiments of this application will be introduced below.

[0121] (1) Neural Network

[0122] Neural networks can be composed of neural units, which can refer to units represented by x. s The arithmetic unit takes the intercept 1 as input, and its output can be shown in formula (1-1):

[0123] Where s = 1, 2, ..., n, n is a natural number greater than 1, W s For x sThe weight of the input signal, b is the bias of the neural unit. f is the activation function of the neural unit, which is used to introduce non-linear characteristics into the neural network to convert the input signal in the neural unit into an output signal. The output signal of the activation function can be used as the input of the next convolutional layer, and the activation function can be a sigmoid function. The neural network is a network formed by connecting a plurality of the above single neural units, that is, the output of one neural unit can be the input of another neural unit. The input of each neural unit can be connected to the local receptive field of the previous layer to extract the features of the local receptive field, and the local receptive field can be a region composed of a plurality of neural units.

[0124] (2) Pixel value

[0125] The pixel value is a value assigned by a computer when a document image is digitized, which represents the average brightness information of a small block of the document, or the average reflection (transmission) density information of the small block. When converting a digital image into a halftone image, the dot area rate (dot percentage) is directly related to the pixel value (gray value) of the digital image, that is, the dot represents the average brightness information of a small block of the document in its size.

[0126] The pixel value of the image can be a red-green-blue (RGB) color value, and the pixel value can be a long integer representing a color. For example, the pixel value is 256*Red+100*Green+76Blue, where Blue represents the blue component, Green represents the green component, and Red represents the red component. In each color component, the smaller the value, the lower the brightness, and the larger the value, the higher the brightness. For a gray-scale image, the pixel value can be a gray value.

[0127] (3) Projection

[0128] Projection refers to projecting the shape of an object onto a plane with a set of light rays, which is called "projection". The image obtained on the plane is also called "projection". Projection can be divided into orthographic projection and oblique projection, orthographic projection is the center line of the projection line perpendicular to the projection plane, and the projection center line not perpendicular to the projection plane is called oblique projection.

[0129] (4) Liquid crystal on silicon (LCoS)

[0130] LCoS belongs to a new type of reflective projection technology. Its structure is that a driving panel is made on a silicon wafer by using a semiconductor process, then the crystal is ground flat by a grinding technology, and aluminum is plated as a mirror, forming a CMOS substrate, then the CMOS substrate is bonded with a glass substrate containing a transparent electrode, liquid crystal is injected, and packaging testing is performed.

[0131] (5) Digital light procession (DLP)

[0132] DLP technology first processes image signals digitally, and then projects light. It is a technology for displaying visual digital information based on a DMD, in other words, the DLP projection technology applies a DMD as a main key processing element to realize the digital optical processing process.

[0133] (6) Head up display (HUD)

[0134] The head up display, also known as the head up display system, is a center console, blind operation, and multifunctional instrument panel for vehicle drivers. Its function is to project important driving information such as speed and navigation onto the windshield in front of the driver, so that the driver can see the important driving information such as speed and navigation without looking down or turning his head.

[0135] As described in the background section, there may be a problem of image distortion when the current vehicle lamp is projected.

[0136] For example, taking vehicle lamp projection as an example, FIG. 1 is an architectural schematic diagram of a vehicle lamp projection system provided by an embodiment of the present application.

[0137] As shown in FIG. 1, the vehicle lamp projection system mainly includes, but is not limited to, a cockpit and a vehicle lamp.

[0138] Among them, the cockpit stores an original image, the original image includes an image expected to be presented in a projection area, the cockpit transmits the original image to the vehicle lamp, and the vehicle lamp receives the original image and projects the original image to the projection area through a projection unit.

[0139] However, due to the problem of image distortion in the vehicle lamp projection, the display image of the projection area seen by the human eye may be quite different from the original image when the original image is directly projected into the projection area. Especially when the original image is color and the projection area is also color, the color offset problem of the display image of the projection area seen by the human eye compared with the original image is more serious, and the display effect and user visual experience are poor.

[0140] In view of this, the present application provides a projection method, which is applied to the field of image processing, such as image processing in vehicle lamp projection, and can solve the problem of image distortion in the above vehicle lamp projection.

[0141] Please refer to FIG. 2, which is a flowchart of a projection method provided by an embodiment of the present application. The projection method is applied to the field of image processing, such as image processing in vehicle lamp projection.

[0142] Specifically, the projection method includes but is not limited to the following steps:

[0143] S201: The projection device acquires a first image.

[0144] The first image includes an image expected to be presented in a first area.

[0145] S202: The projection device acquires scene information of the first area.

[0146] S203: The projection device generates a second image based on the first image and the scene information of the first area.

[0147] The second image is used for projection into the above first area.

[0148] It can be understood that the projection device in the embodiment of the present application can be a device carrying a processor / chip that can be used to execute computer execution instructions, or a processor / chip that can be used to execute computer execution instructions. Alternatively, the projection device can be an electronic device, or a processor / chip in an electronic device. Alternatively, the projection device can be a cockpit, or also a vehicle lamp module, which is used to execute the projection method in the embodiment of the present application to solve the problem of image distortion in the vehicle lamp projection.

[0149] Alternatively, the projection device and the projection method in the embodiment of the present application can be applied to a vehicle-mounted system, and the vehicle carrying the vehicle-mounted system is an intelligent driving vehicle, and can be replaced by a terminal device, which can include but is not limited to a vehicle, such as a commercial vehicle, a passenger vehicle, a train, an industrial vehicle (such as a forklift, a trailer, a tractor, etc.), an engineering vehicle (such as an excavator, a bulldozer, a crane, etc.), a robot, etc., which is not limited in the embodiment of the present application.

[0150] It can be understood that when the user expects to present the first image in the first area, due to the influence of the color of the first area, the ambient light of the first area, the medium material of the projection path and other factors, the image presented by directly projecting the first image into the first area may be quite different from the first image expected to be presented in the first area, that is, it can be understood that the image visually seen by the user is quite different from the original first image, and the display effect and user visual experience are poor. Wherein, the first area is an area where an image can be observed or an area where an image is imaged. The image can be a real image or a virtual image. For a real image, the first area can be a projection curtain, a wall, a road surface, etc. For a virtual image, the first area can be an area outside the vehicle and behind the windshield.

[0151] For example, scenario one: when the first image is projected on a colored wall, due to the influence of the color of the wall itself, the color of the image presented on the wall is distorted, and at this time the image visually seen by the user is quite different from the original first image.

[0152] For example, scenario two: when the first image is projected on the wall of an underground parking lot, due to the dark ambient light of the underground parking lot, the color of the image presented on the wall is distorted, and at this time the image visually seen by the user is quite different from the original first image.

[0153] For example, scenario three: when the first image is projected on an uneven road surface, due to the inconsistent reflection of light at the positions of the protrusions and the positions of the depressions, the brightness of the image (light carpet) presented on the road surface is uneven, and at this time the image visually seen by the user is quite different from the original first image.

[0154] For example, scenario four: when the first image is projected on an outdoor wall in a rainy environment, due to the absorption, reflection and refraction of light by the medium such as raindrops and air, the image presented on the wall is distorted, and at this time the image visually seen by the user is quite different from the original first image.

[0155] For example, scenario five: in the scenario of projecting the first image by HUD, if the background of the projection area is a front vehicle, and the color of the front vehicle is red or other colors, the color of the image presented on the area is distorted, or the content of the red part is not prominent, etc. At this time, the image visually seen by the user is quite different from the original first image.

[0156] The second image obtained by correcting the first image based on the first image and the scene information of the first area is projected into the first area to present the image, which is more in line with the expected presentation effect of the first image in the user's vision, so as to solve the problem of image distortion in the vehicle lamp projection.

[0157] It can be understood that the projection method in the embodiments of the present application can solve the image distortion problem existing in the image projection in scenarios one to five, and improve the display effect of projection and user visual experience.

[0158] In addition, the embodiments of the present application do not need to project the first image first, then adjust the first image according to the difference between the image presented by projecting the first image into the first region and the first image, and then project the adjusted image again. The second image projected for the first time in the embodiments of the present application is the image corrected based on the first image and the scene information of the first region, and does not need to be projected again. This can reduce the lag of projection and improve the display effect of projection and user visual experience.

[0159] In a possible embodiment, the image difference degree between the third image presented by projecting the second image into the first region and the first image is less than the image difference degree between the third image and the second image.

[0160] The image difference degree includes the color difference degree and / or the brightness difference degree of the image.

[0161] It can be understood that the third image presented by projecting the second image into the first region, which is obtained by correcting the first image based on the first image and the scene information of the first region, can better meet the real color and / or brightness expected to be presented by the first image in user vision, and can improve the display effect of projection and user visual experience, and solve the color deviation and / or brightness unevenness problem existing in the projection of the vehicle lamp.

[0162] Optionally, the image difference degree between the third image and the first image is less than the image difference degree between the third image and the second image, which can be embodied by the following correction mode:

[0163] Correction mode one:

[0164] The first pixel in the first image corresponds to a first chroma value, the second pixel in the second image corresponds to a second chroma value, and the third pixel in the third image corresponds to a third chroma value. The first pixel corresponds to the second pixel, and the second pixel corresponds to the third pixel.

[0165] The difference degree between the third chroma value and the first chroma value is less than the difference degree between the third chroma value and the second chroma value.

[0166] It can be understood that in the first correction mode, the correction mode for each pixel in each frame of image, such as the correction of the RGB value of each pixel in each frame of image, can make the second image obtained after correction project to each pixel of the third image presented in the first area. The color value of the above-mentioned correction method based on pixel dimension can present the color value of the corresponding pixel in the first image to a large extent, so as to be more consistent with the real color and / or brightness expected to be presented by the first image, improve the display effect of projection and the user's visual experience.

[0167] The second correction mode:

[0168] The first pixel region in the first image corresponds to the fourth color value, the second pixel region in the second image corresponds to the fifth color value, and the third pixel region in the third image corresponds to the sixth color value. The first pixel region corresponds to the second pixel region, and the second pixel region corresponds to the third pixel region. The first pixel region includes a plurality of pixels.

[0169] The difference between the sixth color value and the fourth color value is less than the difference between the sixth color value and the fifth color value.

[0170] It can be understood that in the second correction mode, the correction mode for each pixel region (a region containing one or more pixels, for example, a region of 100 pixels by 100 pixels) in each frame of image, the pixel region here can be divided by a fixed division, such as the correction of the RGB value of each pixel region in each frame of image, can make the second image obtained after correction project to each pixel region of the third image presented in the first area. The color value of the above-mentioned correction method based on region dimension can present the color value of the corresponding pixel region in the first image to a large extent, so as to be more consistent with the real color and / or brightness expected to be presented by the first image, improve the display effect of projection and the user's visual experience, and compared with the above-mentioned correction method based on pixel dimension, the correction method based on region dimension can also take into account the processor computing power.

[0171] The third correction mode:

[0172] In the case that the time division value of the first color of the first area corresponding to the scene information of the first area is greater than a threshold value, the time division value of the first color of the second image is less than the time division value of the first color of the first image.

[0173] It can be understood that in the third correction mode, the correction mode for the image dimension, when the scene information of the first region indicates that the time division value of the first chroma corresponding to the first region is greater than a threshold, the time division value of the first chroma of the entire first image is lowered when the first image is corrected, so that the time division value of the first chroma of the entire second image obtained after correction is less than the time division value of the first chroma of the entire first image.

[0174] It can be understood that the time division value of the first chroma of the third image presented in the first region after the second image obtained by the above coarse correction is projected, the third correction method based on the image dimension can present the time division value of the first chroma of the entire first image to a greater extent, so as to more conform to the real color and / or brightness that the first image expects to present, improve the display effect of projection and user visual experience, and compared with the first correction method based on the pixel dimension and the second correction method based on the region dimension, the third correction method based on the image dimension can also take into account the processor computing power.

[0175] Optionally, the threshold value is not a fixed value, and can be adjusted according to different application scenarios, so as to more conform to the real color and / or brightness that the first image expects to present in the user's vision.

[0176] It should be understood that the above correction mode one to correction mode three are only exemplary descriptions of the second image obtained by correcting the first image as three possible embodiments, and should not be limited by the embodiments of the present application.

[0177] It should be understood that the new embodiments obtained based on reasonable deformation or supplement of the above correction mode one to correction mode three all belong to the protection scope of the present application, and the embodiments of the present application do not limit this.

[0178] In a possible embodiment, the scene information of the first region includes but is not limited to one or more of the following:

[0179] The color information of the first region, the ambient light information of the first region, the information of the first medium, and the weather information of the first region.

[0180] The color information of the first region can be understood as the color information of the carrier for presenting the final projection image, and the color degree of the carrier is related to the light reaching the human eye.

[0181] The ambient light information of the first region can be understood as the brightness of the ambient light of the first region.

[0182] The first medium includes the medium of the projection path of the second image, which can affect the final presented image quality by absorbing, reflecting, refracting, etc.

[0183] The weather information of the first region can include, but is not limited to, rainy days, foggy days, sunny days, etc. Different weathers can have different effects on light, and the quality of the finally presented image is different.

[0184] It can be understood that the second image obtained by correcting the first image based on the scene information of the first region and the first image is projected into the image presented in the first region, which is more in line with the real color and / or brightness expected to be presented by the first image in the user's vision, so as to solve the problems of color deviation and / or brightness unevenness in the projection of the vehicle lamp.

[0185] Optionally, the color information of the first region described above can be collected by a camera of the vehicle, but is not limited thereto.

[0186] Optionally, the ambient light information of the first region and the information of the first medium described above can be collected by a sensor of the vehicle, but is not limited thereto.

[0187] In a possible embodiment, the step S203 of generating the second image based on the first image and the scene information of the first region can be implemented by the following steps, but is not limited thereto.

[0188] Step 1: generating correction information based on the first image and the scene information of the first region.

[0189] Step 2: generating the second image based on the correction information and the first image.

[0190] In the embodiments of the present application, the correction information is generated based on the first image and the scene information of the first region, and the second image is generated based on the correction information and the first image, which is used for projection into the first region.

[0191] It can be understood that the second image obtained by correcting the first image based on the correction information and the first image is projected into the image presented in the first region, which is more in line with the real color and / or brightness expected to be presented by the first image in the user's vision, so as to solve the problems of color deviation and / or brightness unevenness in the projection of the vehicle lamp.

[0192] Optionally, the correction information includes, but is not limited to, a color time division value for indicating a light source and / or a modulation parameter of a spatial light modulator for indicating color.

[0193] The correction information includes a color time division value for indicating a light source, such as an RGB value for indicating a light source.

[0194] Therefore, the chroma time division value of the light source to the light machine can be adjusted to the chroma time division value indicated by the correction information, so as to realize the projection of the second image obtained by correcting the first image.

[0195] Specifically, refer to FIG. 3, which is a schematic diagram of chroma value correction provided by an embodiment of the present application.

[0196] As shown in FIG. 3, the chroma value A is the standard RGB time division value, that is, the time of RGB is basically the same. When it is identified that the scene information of the first region indicates that the time division value of R corresponding to the first region is greater than a threshold value, the time division value of R of the image is adjusted lower and the time division values of G and B are adjusted higher when the first image is corrected, as shown in the chroma value B in FIG. 3, so that the time division value of R of the second image obtained after correction is less than the time division value of R of the first image.

[0197] It can be understood that the time division value of R of the third image presented in the first region by projecting the second image obtained after the above correction is more consistent with the time division value of R of the first image, so that the real color and / or brightness expected to be presented by the first image is more consistent in the user's vision, thereby improving the display effect of projection and the user's visual experience.

[0198] The correction information can also include a modulation parameter of the spatial light modulator for indicating the chroma.

[0199] Optionally, the spatial light modulator can include but is not limited to a liquid crystal on silicon (LCoS), a digital light procession (DLP) and the like.

[0200] Optionally, taking the LCoS as an example, the modulation parameter of the chroma can include but is not limited to a voltage value of the spatial light modulator.

[0201] Therefore, the voltage of the spatial light modulator can be adjusted according to the modulation parameter indicated by the correction information, so as to adjust the polarization state of the spatial light modulator (that is, adjust the polarization rotation of the spatial light modulator), adjust the light intensity, and thus realize the correction of the chroma of the first image. The image presented in the first region by projecting the second image obtained after the above correction is more consistent with the real color and / or brightness expected to be presented by the first image in the user's vision.

[0202] Specifically, refer to FIG. 4, which is another schematic diagram of chroma value correction provided by an embodiment of the present application.

[0203] As shown in FIG. 4, the chroma value A is a standard RGB time value, that is, the time of RGB is basically the same. When it is identified that the scene information of the first region indicates that the time value of R corresponding to the first region is greater than a threshold value, the time value of R of the image is lowered when the first image is corrected, and the time values of G and B remain unchanged, as shown in the chroma value C in FIG. 4, so that the time value of R of the second image obtained after correction is less than the time value of R of the first image.

[0204] It can be understood that in the case of adjusting the light intensity by adjusting the polarization state of the spatial light modulator (that is, adjusting the polarization rotation of the spatial light modulator), the total length of each time period of RGB is fixed, so the chroma value correction in FIG. 4 keeps the time values of G and B unchanged and lowers the time value of R, which is equivalent to the time period of R reduction being a black frame, unlike the chroma value correction in FIG. 3 which can increase the time values of G and B.

[0205] It can be understood that the time value of R of the third image presented in the first region after the above-mentioned correction of the second image can more conform to the time value of R of the first image, so as to more conform to the real color and / or brightness expected to be presented by the first image in the user's vision, thereby improving the display effect of projection and the user's visual experience.

[0206] For example, the correction information is pixel-dimension-based correction information, and the voltage of the spatial light modulator corresponding to one or more pixels is adjusted according to the modulation parameter indicated by the correction information, so as to realize the chroma correction of the one or more pixels by adjusting the polarization state of the spatial light modulator.

[0207] For another example, the correction information is region-dimension-based correction information, and the voltage of the spatial light modulator corresponding to one or more regions is adjusted according to the modulation parameter indicated by the correction information, so as to realize the chroma correction of the one or more image regions by adjusting the polarization state of the spatial light modulator.

[0208] For another example, the correction information is image-dimension-based correction information, and the voltage of the spatial light modulator corresponding to the entire image is adjusted according to the modulation parameter indicated by the correction information, so as to realize the chroma correction of the entire image by adjusting the polarization state of the spatial light modulator.

[0209] Optionally, the correction information is generated based on the first image and the scene information of the first region in the above-mentioned step 1, which can be realized by the following ways, but is not limited to the following ways:

[0210] Implementation manner one:

[0211] The above-mentioned correction information is generated based on the first image, the scene information of the first region, and the image correction relationship information.

[0212] The image correction relationship information is used to indicate a corresponding relationship between a projection image and an actual image of the projection image presented in a projection area.

[0213] Optionally, the image correction relationship information can be pre-configured in a first projection device used to perform the projection method in the embodiments of the present application.

[0214] It can be understood that the image correction relationship information can be an image correction relationship obtained through a large number of tests on a large number of projection images and actual images of the projection images presented in the projection area. Therefore, the correction information obtained based on the image correction relationship information is more in line with the real color and / or brightness of the first image expected to be presented in the user's vision.

[0215] Specifically, refer to FIG. 5 and FIG. 6, FIG. 5 is a schematic diagram of an image projection corresponding relationship provided by the embodiments of the present application, and FIG. 6 is a schematic diagram of an image correction corresponding relationship provided by the embodiments of the present application.

[0216] As shown in FIG. 5, it is a corresponding relationship between a displayed color and / or brightness and an original color and / or brightness in the case of different scene information of the projection area (scene information 1 of the projection area, scene information 2 of the projection area, scene information 3 of the projection area, scene information 4 of the projection area) in which the original color and / or brightness is projected to the projection area to be presented.

[0217] The scene information 1 of the projection area, the scene information 2 of the projection area, the scene information 3 of the projection area, and the scene information 4 of the projection area are only examples of four different scene information, and specifically can be one or more of different items including but not limited to color information of the projection area, ambient light information of the projection area, medium information of a projection path of the original image, and the embodiments of the present application do not limit this.

[0218] Correspondingly, based on the corresponding relationship between the displayed color and / or brightness and the original color and / or brightness shown in FIG. 5, the image correction corresponding relationship shown in FIG. 6 can be obtained.

[0219] As shown in FIG. 6, Table 1 in FIG. 6 is a displayed color and / or brightness presented in the projection area in the case of different scene information (scene information 1, scene information 2, scene information 3, scene information 4) of the projection area in which the original color and / or brightness (A, B, C, E, F, G, I, J, K, R, S, T, X, Y, Z) is projected.

[0220] Exemplarily, in the case that the scene information of the projection area is the scene information 1, the original color and / or brightness A is projected into the projection area to present the displayed color and / or brightness E, and there is a color offset and / or brightness non-uniformity between the original color and / or brightness A and the displayed color and / or brightness E.

[0221] Exemplarily, in the case that the scene information of the projection area is the scene information 2, the original color and / or brightness B is projected into the projection area to present the displayed color and / or brightness J, and there is a color offset and / or brightness non-uniformity between the original color and / or brightness B and the displayed color and / or brightness J.

[0222] It can be understood that, based on the training information of a large number of image projections shown in Table 1 in FIG. 6, the image correction relationship information shown in Table 2 in FIG. 6 can be established before the projection of the image. Therefore, the above-mentioned correction information can be generated according to the above-mentioned implementation manner 1 based on the expected displayed color and / or brightness (i.e. the original color and / or brightness), the scene information of the projection area, and the image correction relationship information shown in Table 2 in FIG. 6.

[0223] Exemplarily, in the case that the scene information of the projection area is the scene information 1, if the displayed color and / or brightness E is expected to be presented in the projection area, the actual projected color and / or brightness after image correction is the color and / or brightness A by looking up the image correction relationship information shown in Table 2 in FIG. 6. It can be understood that, when the actual projected color and / or brightness A is projected into the projection area, the expected displayed color and / or brightness presented in the projection area should be E. Therefore, based on the original color and / or brightness and the actual projected color and / or brightness A after correction, the above-mentioned correction information can be obtained, so that according to the correction information, the original color and / or brightness can be corrected to the actual projected color and / or brightness A before projection.

[0224] Exemplarily, in the case that the scene information of the projection area is the scene information 2, if the displayed color and / or brightness J is expected to be presented in the projection area, the actual projected color and / or brightness after image correction is the color and / or brightness B by looking up the image correction relationship information shown in Table 2 in FIG. 6. It can be understood that, when the actual projected color and / or brightness B is projected into the projection area, the expected displayed color and / or brightness presented in the projection area should be J. Therefore, based on the original color and / or brightness and the actual projected color and / or brightness B after correction, the above-mentioned correction information can be obtained, so that according to the correction information, the original color and / or brightness can be corrected to the actual projected color and / or brightness B before projection.

[0225] It should be understood that, based on the training information of a large number of image projections shown in Table 1 in FIG. 6, the image correction relationship information shown in Table 2 in FIG. 6 is established before the projection of the image, which is established in an ideal case, and in an actual case, there may be a difference within an allowable range before and after the projection of the color and / or brightness, which is not limited by the embodiments of the present application, and should not be limited by the above-mentioned FIG. 6.

[0226] Implementation mode two:

[0227] Based on the first image, the scene information of the first region, and the artificial intelligence network model, the above-mentioned correction information is generated.

[0228] The artificial intelligence network model can be various neural network models, which are not limited by the embodiments of the present application.

[0229] It can be understood that, since the artificial intelligence network model has the ability to process a large amount of data and accuracy, the first image and the scene information of the first region are input into the artificial intelligence network model, and the correction information is output, which is more in line with the real color and / or brightness that the first image expects to present in the user's vision.

[0230] Optionally, the artificial intelligence network model is used to train the actual image presented by the input projection image in the projection region, the scene information of the projection region, and the projection image.

[0231] It can be understood that, after the above-mentioned large amount of input training, the artificial intelligence network model is used to output the correction information for various first images and scene information of the first region, which will be more accurate in the user's vision, and more in line with the real color and / or brightness that the first image expects to present.

[0232] Optionally, the artificial intelligence network model can be pre-configured in the first projection device used to execute the projection method shown in the embodiments of the present application.

[0233] It should be understood that the above-mentioned implementation mode one and implementation mode two are only used as two possible embodiments to exemplarily illustrate the generation of the correction information based on the first image and the scene information of the first region, which should not be limited by the embodiments of the present application.

[0234] It should be understood that the new embodiments obtained based on the reasonable deformation or supplement of the above-mentioned implementation mode one and implementation mode two all belong to the protection scope of the present application, which are not limited by the embodiments of the present application.

[0235] In a possible implementation, the second image is generated based on the first image and the scene information of the first region in step S203. Whether to perform fine correction on the first image in the pixel dimension or perform coarse correction on the first image in the image dimension to generate the second image can be determined in the following manner:

[0236] The second image is generated based on a size relationship between a difference degree between the color corresponding to the scene information of the first region and the color of the first image and the first threshold value, and / or a size relationship between the complexity of the scene information of the first region and the second threshold value.

[0237] It can be understood that whether to perform fine correction on the first image in the pixel dimension or perform coarse correction on the first image in the image dimension can be determined based on the size relationship between the difference degree between the color corresponding to the scene information of the first region and the color of the first image and the first threshold value.

[0238] Optionally, when the difference degree between the color corresponding to the scene information of the first region and the color of the first image is greater than the first threshold value, fine correction on the first image in the pixel dimension is performed, and otherwise, coarse correction on the first image in the image dimension is performed.

[0239] In addition, whether to perform fine correction on the first image in the pixel dimension or perform coarse correction on the first image in the image dimension can also be determined based on the size relationship between the complexity of the scene information of the first region and the second threshold value.

[0240] Optionally, when the complexity of the scene information of the first region is greater than the second threshold value, fine correction on the first image in the pixel dimension is performed, and otherwise, coarse correction on the first image in the image dimension is performed.

[0241] For example, the correction information is pixel-dimension-based correction information, and the chroma of each pixel in the image is corrected according to the chroma value indicated by the correction information.

[0242] For another example, the correction information is pixel-region-dimension-based correction information, and the chroma of each pixel region in the image is corrected according to the chroma value indicated by the correction information.

[0243] For another example, the correction information is image-dimension-based correction information, and the chroma of the entire image is corrected according to the chroma value indicated by the correction information.

[0244] Optionally, the first threshold value and the second threshold value are not fixed values, and can be adjusted according to different application scenarios, so as to make the real color and / or brightness expected to be presented by the first image more consistent with the user's vision.

[0245] For example, if the difference between the color corresponding to the scene information of the first region and the color of the first image is greater than a first threshold, it means that the image distortion of the projection is serious, and the image viewed by the user is quite different from the original first image, which will seriously affect the display effect of the projection and the user's visual experience, and therefore, the fine-grained correction based on pixels or regions should be performed.

[0246] For example, if the scene of the first region is complex, such as a road with rough terrain or a road section with many vehicles, it means that the color of the projection medium is rich, and the scene with more medium should be corrected based on pixels or regions. On the contrary, in a relatively single road surface (such as a highway) or a road section with few vehicles, it means that the color of the projection medium is less, and the scene with less medium should be corrected based on the image.

[0247] In a possible embodiment, the first projection device for performing the projection method described above can be a car lamp or a cabin. The projection method in the embodiments of the present application will be described below for the case that the first projection device is a car lamp or a cabin.

[0248] Case 1:

[0249] The first projection device for performing the projection method in the embodiments of the present application is a car lamp projection module, a system composed of a car lamp projection module and a car lamp controller or a car lamp processor, which can be arranged in a car lamp.

[0250] In the case, the projection method in the embodiments of the present application can further perform the following steps, but is not limited to:

[0251] Projecting a second image to the first region.

[0252] It can be understood that the first projection device for performing the projection method in the embodiments of the present application can be arranged in a car lamp, and in this case, the car lamp can further project the corrected second image to the first region to solve the problems of color deviation and / or non-uniform brightness in car lamp projection.

[0253] For details, refer to FIG. 7, which is a schematic diagram of the architecture of a projection system provided in the embodiments of the present application.

[0254] As shown in FIG. 7, the projection system mainly includes, but is not limited to, a cabin and a car lamp.

[0255] The first image is stored in the cockpit, and the cockpit transmits the first image to the vehicle lamp. After the vehicle lamp receives the first image, the projection method is performed to generate the second image, and the second image is projected into the first area by the projection unit of the vehicle lamp. The third image projected into the first area by the second image is more consistent with the real color and / or brightness of the first image in the user's vision, so as to solve the color deviation and / or brightness unevenness problem existing in the vehicle lamp projection.

[0256] Optionally, the third image projected into the first area by the second image is completely the same as the first image in the user's vision.

[0257] The vehicle lamp controller stores the first image, and the first image includes an image expected to be presented in the first area. After the vehicle lamp controller obtains the first image, the projection method is performed to generate the second image, and the second image is projected into the first area by the projection unit of the vehicle lamp. The third image projected into the first area by the second image is more consistent with the real color and / or brightness of the first image in the user's vision, so as to solve the color deviation and / or brightness unevenness problem existing in the vehicle lamp projection.

[0258] Optionally, the third image projected into the first area by the second image is completely the same as the first image in the user's vision.

[0259] Case two:

[0260] The first projection device for executing the projection method in the embodiment of the application can be a cockpit controller, a cockpit processor or a cockpit vehicle-mounted projection controller, which can be arranged in the cockpit.

[0261] In case two, the projection method in the embodiment of the application can further perform the following steps, but is not limited to:

[0262] The indication information is sent to the second projection device.

[0263] The indication information includes the second image, and the indication information is used to instruct the second projection device to project the second image into the first area.

[0264] It can be understood that the first projection device for executing the projection method in the embodiment of the application can be arranged in a device in communication connection with the vehicle lamp, such as a cockpit. In case two, the indication information can be sent to the second projection device to instruct the second projection device to project the corrected second image into the first area, so as to solve the color deviation and / or brightness unevenness problem existing in the vehicle lamp projection.

[0265] Optionally, the second projection device can be a vehicle lamp projection module.

[0266] It can be understood that the first projection device for executing the projection method in the embodiments of the present application can be a domain controller in the cabin. In this case, the third projection device can also be sent indication information, instructing the third projection device to project the corrected second image into the second region, so as to solve the problems of color deviation and / or non-uniform brightness existing in vehicle projection.

[0267] Optionally, the third projection device can be a cabin vehicle projection module.

[0268] For details, refer to FIG. 8, which is a schematic diagram of the architecture of another projection system provided by the embodiments of the present application.

[0269] As shown in FIG. 8, the projection system mainly includes but is not limited to a cabin and a vehicle lamp.

[0270] Among them, the first image is stored in the cabin, the first image includes an image expected to be presented in the first region, the cabin executes the projection method, generates the second image, and transmits the second image to the vehicle lamp. After receiving the second image, the vehicle lamp projects the second image into the first region through the projection unit of the vehicle lamp. The third image presented in the second image projected into the first region is more consistent with the real color and / or brightness expected to be presented by the first image in the user's vision, so as to solve the problems of color deviation and / or non-uniform brightness existing in vehicle lamp projection.

[0271] Optionally, ideally, the third image presented in the second image projected into the first region is exactly the same as the first image in the user's vision.

[0272] In a possible embodiment, the projection method can further execute the following steps, including but not limited to:

[0273] Control the display of prompt information.

[0274] Among them, the prompt information is used to prompt to turn on the image correction function, and the image correction function is used to correct the first image.

[0275] It can be understood that when the user responds to the prompt to confirm to turn on the image correction function, the projection method in the embodiments of the present application will be executed to correct the first image, so that the image presented in the final projection of the corrected image into the first region is more consistent with the real color and / or brightness expected to be presented by the first image in the user's vision, so as to solve the problems of color deviation and / or non-uniform brightness existing in vehicle lamp projection.

[0276] In a possible embodiment, the projection device for projecting the second image includes at least one of the following:

[0277] Car light module, head-up display (HUD), car projector, home projector.

[0278] It can be understood that the projection device for projecting the second image described above includes, but is not limited to, at least one of the car light module, the head-up display (HUD), the car projector, and the home projector, and the embodiments of the present application do not limit this.

[0279] It can be understood that the projection device for projecting the second image in the above-mentioned figure is a car light, which is only an exemplary illustration and should not be construed as a limitation on the embodiments of the present application.

[0280] Optionally, the projection method in the embodiments of the present application will be described below by taking some specific scenarios as examples based on the above-mentioned figure 6.

[0281] For example, scenario one:

[0282] Suppose that the scenario information 1 in the above-mentioned figure 6 indicates that the color of the carrier is red, the brightness of the ambient light is dark, and when the medium is air, the color and / or brightness A in the above-mentioned figure 6 is projected on the red wall. Due to the influence of the color of the wall itself, the brightness of the ambient light, the absorption, reflection, refraction, etc. of the air medium to the light, the color and / or brightness E presented on the wall has the problem of color distortion and / or brightness unevenness, and the color and / or brightness E seen by the user's perspective is quite different from the original color and / or brightness A.

[0283] By using the projection method in the embodiments of the present application, such as using a correction method based on the pixel dimension, the color and / or brightness A of some pixels in the image can be corrected to color and / or brightness X before projection, and then the color and / or brightness X is projected on the red wall. At this time, the color and / or brightness of some pixels in the image seen by the user's perspective can better meet the real color and / or brightness expected to be presented by the color and / or brightness A. It can be understood that correcting the color and / or brightness A to the color and / or brightness X can refer to correcting the color temperature to be warm or cold, or it can refer to correcting the brightness to be high or low, and the embodiments of the present application do not limit this. The projection method of other pixels in the image is similar. The following will be described by taking the above-mentioned method of correcting the color and / or brightness A of some pixels in the image to the color and / or brightness X before projection as an example, and the specific implementation mode can be as follows:

[0284] Step 1: The projection device acquires the image to be projected, and the expected presentation color and / or brightness A of some pixels or regions in the image.

[0285] The color and / or brightness A is expected to be presented on the red wall represented by the above-mentioned scenario information 1.

[0286] Step 2: The projection device acquires the above-mentioned scenario information 1.

[0287] Step three: the projection device generates correction information 1 based on the color and / or brightness A and the scene information 1.

[0288] Optionally, in the first implementation, the projection device can generate the above-mentioned correction information 1 based on the color and / or brightness A, the scene information 1, and the image correction relationship information shown in FIG. 6.

[0289] Specifically, according to the color and / or brightness A and the scene information 1, it can be known through the image correction relationship information shown in FIG. 6 that if it is desired to present the color and / or brightness A on the red wall represented by the scene information 1, the color and / or brightness to be projected should be X. The projection device can obtain the correction information 1 according to the color and / or brightness difference between the color and / or brightness X and the color and / or brightness A, and the correction information 1 includes the color and / or brightness difference information between the color and / or brightness X and the color and / or brightness A.

[0290] Optionally, in the second implementation, the projection device can input the color and / or brightness A and the scene information 1 into an artificial intelligence network model to output the above-mentioned correction information 1.

[0291] Specifically, the artificial intelligence network model has the ability to process massive data and accuracy, and can predict that if it is desired to present the color and / or brightness A on the red wall represented by the scene information 1, the color and / or brightness to be projected should be X, and can further output the correction information 1 according to the color and / or brightness difference between the color and / or brightness X and the color and / or brightness A, and the correction information 1 includes the color and / or brightness difference information between the color and / or brightness X and the color and / or brightness A.

[0292] Step four: the projection device generates a corrected projection image based on the correction information 1 and the color and / or brightness A, and some pixels or regions in the image correspond to the color and / or brightness X.

[0293] It can be understood that the projection device corrects the color and / or brightness A based on the correction information 1 to obtain the color and / or brightness X, which is used for projection onto the red wall represented by the above-mentioned scene information 1.

[0294] Optionally, in the first correction manner, if the above-mentioned correction information 1 is pixel-dimension-based correction information, the projection device will correct the chroma of each pixel point in the color and / or brightness A according to the chroma value indicated by the correction information 1 to obtain the color and / or brightness X.

[0295] Optionally, in the second correction mode, if the correction information 1 is the correction information based on the pixel area dimension, the projection device will correct the chrominance of each pixel area in the color and / or brightness A according to the chrominance value indicated by the correction information 1, to obtain the color and / or brightness X.

[0296] Optionally, in the third correction mode, if the correction information 1 is the correction information based on the image dimension, the projection device will correct the chrominance of the entire color and / or brightness A according to the chrominance value indicated by the correction information 1, to obtain the color and / or brightness X.

[0297] Further optionally, in the third correction mode, if the correction information 1 includes the chrominance time division value for indicating the chrominance of the light source, the projection device will adjust the chrominance time division value of the light source to the chrominance time division value indicated by the correction information 1 according to the correction information 1, so as to correct the chrominance of the entire color and / or brightness A, to obtain the color and / or brightness X.

[0298] Further optionally, in the third correction mode, if the correction information 1 includes the modulation parameter for indicating the chrominance of the spatial light modulator, the projection device will adjust the voltage of the spatial light modulator according to the modulation parameter indicated by the correction information 1, so as to adjust the polarization state of the spatial light modulator (i.e. adjust the polarization rotation of the spatial light modulator), and adjust the light intensity, so as to correct the chrominance of the entire color and / or brightness A, to obtain the color and / or brightness X.

[0299] Step five: the projection device projects the generated color and / or brightness X on the red wall represented by the scene information 1.

[0300] It can be understood that, by the projection method, the generated color and / or brightness X is projected on the red wall represented by the scene information 1, which is more in line with the real color and / or brightness that the color and / or brightness A is expected to present in the user's vision, so as to solve the problems of color deviation and / or brightness unevenness in the projection of the vehicle lamp.

[0301] For another example, scene two:

[0302] Assume that the scene information 2 in the above Fig. 6 represents that the color of the carrier is dark blue, the brightness of the ambient light is normal, and the medium is air. Assume that the scene information 3 in the above Fig. 6 represents that the color of the carrier is light blue, the brightness of the ambient light is normal, and the medium is air. At this time, the color and / or brightness B in the above Fig. 6 is projected on a wall with uneven color, one part of which is dark blue and the other part of which is light blue. Due to the inconsistent absorption and reflection of light by the uneven color of the wall itself, the color and / or brightness J projected on the dark blue part of the wall and the color and / or brightness S projected on the light blue part of the wall are uneven. At this time, the color and / or brightness J and the color and / or brightness S viewed by the user's perspective are quite different from the original color and / or brightness B.

[0303] By the projection method in the embodiments of the present application, such as using a correction method based on the pixel dimension, the color and / or brightness B in the image projected on the dark blue part of the wall can be corrected to the color and / or brightness S, and the color and / or brightness B in the image projected on the light blue part of the wall can be corrected to the color and / or brightness J before projection. Then the color and / or brightness S is projected on the dark blue part of the wall, and the color and / or brightness J is projected on the light blue part of the wall. At this time, the color and / or brightness viewed by the user's perspective can better conform to the real color and / or brightness expected to be presented by the color and / or brightness B. It can be understood that correcting the color and / or brightness B to the color and / or brightness S and correcting the color and / or brightness B to the color and / or brightness J can refer to correcting the color temperature to be warm or cold, or can refer to correcting the high and low of the brightness, which is not limited in the embodiments of the present application. The projection method of other pixels in the image is similar. The following is described by taking the above method of correcting the color and / or brightness B of part of the pixels in the image to the color and / or brightness S and correcting the color and / or brightness B of another part of the pixels to the color and / or brightness J before projection as an example. The specific implementation manner can be as follows:

[0304] Step one: the projection device acquires an image to be projected. The expected presentation color and / or brightness B of some pixels or regions in the image.

[0305] The color and / or brightness B is expected to be presented on the wall with uneven color, one part of which is dark blue and the other part of which is light blue, represented by the above scene information 2 and scene information 3.

[0306] Step two: the projection device acquires the above scene information 2 and scene information 3.

[0307] Step three: the projection device generates correction information 2 based on the color and / or brightness B and the scene information 2, and generates correction information 3 based on the color and / or brightness B and the scene information 3.

[0308] Step four: the projection device generates a corrected projection image based on the correction information 2, the correction information 3, the color and / or brightness B, wherein the pixels or regions corresponding to the color and / or brightness S in the image are projected on the deep blue part of the wall, and the pixels or regions corresponding to the color and / or brightness J in the image are projected on the light blue part of the wall.

[0309] Optionally, the specific implementation of the above correction details can refer to the implementation of scenario one, which will not be described here.

[0310] Step five: the projection device projects the generated color and / or brightness S on the deep blue part of the wall and projects the generated color and / or brightness J on the light blue part of the wall.

[0311] It can be understood that, by the above projection method, the generated color and / or brightness S is projected on the deep blue part of the wall, and the generated color and / or brightness J is projected on the light blue part of the wall, which can more conform to the real color and / or brightness that the user expects to present in the visual sense, so as to solve the problems of color deviation and / or brightness unevenness in the projection of the vehicle lamp.

[0312] For another example, scenario three:

[0313] Suppose that the scenario information 3 in the above FIG. 6 represents that the combined road section composed of a flat highway and a rugged mountain road, the carrier is the road surface of the combined road section, the brightness of the ambient light is normal, and the medium is air, when the vehicle drives on the road surface of the combined road section, the color and / or brightness C in the above FIG. 6 is projected on the road surface of the combined road section, due to the inconsistent reflection of light on the convex position, the concave position and the flat position of the combined road section, the color and / or brightness T presented on the road surface of the combined road section is uneven, at this time, the color and / or brightness T seen by the user's visual angle is greatly different from the original color and / or brightness C.

[0314] By the projection method in the embodiments of the present application, such as using the correction method based on the pixel dimension, the color and / or brightness C of some pixels in the image can be corrected to the color and / or brightness K before projection, and then the color and / or brightness K is projected on the road surface of the combined road section. At this time, the color and / or brightness of some pixels in the image seen by the user's perspective can better conform to the real color and / or brightness that the color and / or brightness C is expected to present. It can be understood that the correction of the color and / or brightness C to the color and / or brightness K can refer to the correction of the color temperature to warm or cold, or the correction of the brightness, and the embodiments of the present application do not limit this. The projection method of other pixels in the image is similar. The following is described by taking the above method of correcting the color and / or brightness C of some pixels in the image to the color and / or brightness K before projection as an example, and the specific implementation manner can be as follows:

[0315] Step one: The projection device acquires the image to be projected, and the expected presentation color and / or brightness C of some pixels or regions in the image.

[0316] Step two: The projection device acquires the above-mentioned scene information 3.

[0317] Step three: The projection device generates correction information 3 based on the color and / or brightness C and the scene information 3.

[0318] Step four: The projection device generates the corrected projection image based on the correction information 3 and the color and / or brightness C, and the color and / or brightness K corresponding to some pixels or regions in the image. Optionally, the specific implementation manner of the above-mentioned correction details can refer to the implementation manner of the above-mentioned scene one, which will not be described here.

[0319] In addition, it should be noted that because the highway and the mountain road in the combined road section are inconsistent in light reflection, the influence degree of the two road sections on imaging is different. It can be understood that the influence degree of the rugged mountain road on imaging is much greater than that of the flat highway. Therefore, the color and / or brightness C can also be finely corrected in the pixel dimension or coarsely corrected in the image dimension to generate the above-mentioned color and / or brightness K in the following manner:

[0320] Optionally, for the process of driving on the highway in the combined road section, the projection device can use coarse correction in the image dimension to correct the color and / or brightness C.

[0321] Similarly, the correction manner three in the above-mentioned scene one can be used, the above-mentioned correction information 3 is the correction information based on the image dimension, and the projection device corrects the color and / or brightness C as a whole according to the chroma value indicated by the correction information 3 to obtain the color and / or brightness K.

[0322] Optionally, during driving on the mountain road in the combined road section, the projection device can correct the color and / or brightness C by fine correction in pixel dimension or pixel area dimension.

[0323] Similarly, the correction method one in the above scenario one can be adopted, the correction information 3 is correction information based on pixel dimension, and the projection device corrects the chrominance of each pixel point in the color and / or brightness C according to the chrominance value indicated by the correction information 3 to obtain the color and / or brightness K.

[0324] Alternatively, similarly, the correction method two in the above scenario one can be adopted, the correction information 3 is correction information based on pixel area dimension, and the projection device corrects the chrominance of each pixel area in the color and / or brightness C according to the chrominance value indicated by the correction information 3 to obtain the color and / or brightness K.

[0325] It can be understood that, by the above projection method, for different road sections with different degrees of influence on imaging, fine correction in pixel dimension is performed on the color and / or brightness C on the rugged mountain road, and coarse correction in image dimension is performed on the color and / or brightness C on the flat highway, to generate the color and / or brightness K, and the generated color and / or brightness K is projected on the combined road section represented by the scenario information 3, so that the user can visually conform to the real color and / or brightness that the color and / or brightness C is expected to present, to solve the problems of color deviation and / or brightness unevenness in car light projection.

[0326] For example, scenario four:

[0327] Suppose that the scenario information 4 in the above FIG. 6 represents that the weather is rainy and foggy, the color of the carrier is white, the brightness of the ambient light is normal, the medium is air, and the color and / or brightness E in the above FIG. 6 is projected on the white wall in the rainy and foggy weather. Due to the influence of the medium such as rain, fog and air on light, such as absorption, reflection and refraction, the color and / or brightness A presented on the wall has the problems of color distortion and / or brightness unevenness, and the color and / or brightness A seen by the user from the perspective is quite different from the original color and / or brightness E.

[0328] By the projection method in the embodiments of the present application, such as using the correction method based on the pixel dimension, the color and / or brightness E of some pixels in the image can be corrected to the color and / or brightness I before projection, and the color and / or brightness I is projected on the white wall, at this time, the color and / or brightness of some pixels in the image viewed by the user can more conform to the real color and / or brightness expected to be presented by the color and / or brightness E. It can be understood that the correction of the color and / or brightness E to the color and / or brightness I can refer to the correction of the color temperature to warm color or cold color, or the correction of the high and low of the brightness, and the embodiments of the present application do not limit this. The projection method of other pixels in the image is similar. The above method of correcting the color and / or brightness E of some pixels in the image to the color and / or brightness I before projection is taken as an example for description, and the specific implementation manner can be as follows:

[0329] Step one: the projection device acquires the image to be projected, and the expected presentation color and / or brightness E of some pixels or regions in the image.

[0330] Step two: the projection device acquires the above scene information 4.

[0331] Step three: the projection device generates the correction information 4 based on the color and / or brightness E and the scene information 4.

[0332] Step four: the projection device generates the corrected projection image based on the correction information 4 and the color and / or brightness E, and the color and / or brightness I corresponding to some pixels or regions in the image.

[0333] Optionally, the specific implementation manner of the above correction details can refer to the implementation manner of the above scene one, and details are not described herein again.

[0334] It can be understood that by the above projection method, the generated color and / or brightness I is projected on the white wall represented by the above scene information 4 in the rain and fog, and in the user's vision, the color and / or brightness I can more conform to the real color and / or brightness expected to be presented by the color and / or brightness E, so as to solve the color deviation and / or brightness non-uniformity problem of the car lamp projection in the rain and fog and other various weather.

[0335] For another example, scene five:

[0336] Assuming that the scene information 1 in the above FIG. 6 represents: the HUD projection, the color of the carrier (i.e. the color of the front car outside the windshield glass) is red, the brightness of the ambient light is normal, the medium is air, the material of the optical glass, etc., the HUD projects the color and / or brightness F in the above FIG. 6 to form a virtual image on the red front car. Due to the absorption, reflection, refraction, projection and other effects of air, optical glass and other media on light, there is a problem of color distortion and / or brightness unevenness in the color and / or brightness J of the virtual image presented on the red front car. At this time, the color and / or brightness J seen by the user's visual angle is quite different from the original color and / or brightness F.

[0337] By the projection method in the embodiments of the present application, such as using a correction method based on pixel dimensions, the color and / or brightness F of some pixels in the image can be corrected to color and / or brightness B before projection. The HUD projects the color and / or brightness B to form a virtual image on the red front car. At this time, the color and / or brightness of some pixels in the image seen by the user's visual angle can better meet the real color and / or brightness expected to be presented by the color and / or brightness F. It can be understood that correcting the color and / or brightness F to the color and / or brightness B can refer to correcting the color temperature to be warm or cold, or can refer to correcting the brightness to be high or low, which is not limited by the embodiments of the present application. The projection method of other pixels in the image is similar. The following is an example of the above method of correcting the color and / or brightness F of some pixels in the image to the color and / or brightness B before projection, and the specific implementation manner can be as follows:

[0338] Step one: the projection device acquires the image to be projected, and the expected presentation color and / or brightness F of some pixels or regions in the image.

[0339] Step two: the projection device acquires the above scene information 1.

[0340] Step three: the projection device generates correction information 5 based on the color and / or brightness F and the scene information 1.

[0341] Step four: the projection device generates a corrected projection image based on the correction information 5 and the color and / or brightness F, and the color and / or brightness B of some pixels or regions in the image.

[0342] Optionally, the specific implementation manner of the above correction details can refer to the implementation manner of the above scene one, which will not be described here.

[0343] It can be understood that by the above projection method, the HUD projects the generated color and / or brightness B to form a virtual image on the red front car represented by the above scene information 1, which can better meet the real color and / or brightness expected to be presented by the color and / or brightness F in the user's visual angle, so as to solve the problem of color offset and / or brightness unevenness in the HUD projection.

[0344] For example, the color of the front vehicle is red, and the HUD projects the corrected color and / or brightness by the projection method described above, and the color of the virtual image formed on the red front vehicle is white, which is more distinguishable from the color of the front vehicle in the user's vision, and is beneficial to the driver to observe the information displayed by the HUD, thereby facilitating driving safety.

[0345] The above describes the method of the embodiments of the present application in detail, and the following provides an apparatus for implementing any of the methods in the embodiments of the present application, for example, an apparatus including units (or means) for implementing each step performed by the device in any of the above methods.

[0346] Please refer to FIG. 9, which is a structural schematic diagram of a projection apparatus provided by the embodiments of the present application.

[0347] As shown in FIG. 9, the projection apparatus 90 can include a perception unit 901 and an image calibration unit 902. Optionally, the projection apparatus 90 can further include a projection unit 903 and a communication unit 904. Each of the above units can be software, hardware, or a combination of software and hardware.

[0348] The communication unit 904 can implement a sending function and / or a receiving function, and the communication unit 904 can also be described as a transceiver unit. The communication unit 904 can also be a unit integrated with an acquisition unit and a sending unit, wherein the acquisition unit is used to implement the receiving function, and the sending unit is used to implement the sending function. Optionally, the communication unit 904 can be used to receive information sent by other apparatuses, and can also be used to send information to other apparatuses.

[0349] In a possible design, the projection apparatus 90 can correspond to the projection apparatus in the method embodiments shown in FIG. 2, and the projection apparatus 90 can be an electronic device or a chip in an electronic device. The projection apparatus 90 can include units for performing operations performed by the projection apparatus in the method embodiments shown in FIG. 2, and each unit in the projection apparatus 90 is respectively for implementing operations performed by the projection apparatus in the method embodiments shown in FIG. 2. Descriptions of each unit are as follows:

[0350] The image calibration unit 902 is configured to acquire a first image, and the first image includes an image expected to be presented in a first region.

[0351] The perception unit 901 is configured to acquire scene information of the first region.

[0352] The image calibration unit 902 is further configured to generate a second image based on the first image and the scene information of the first region, and the second image is used to be projected into the first region.

[0353] In one possible implementation, the image difference between the third image projected onto the first region and the first image is less than the image difference between the third image and the second image, wherein the image difference includes color difference and / or brightness difference.

[0354] In one possible implementation, a first pixel in the first image corresponds to a first chromaticity value, a second pixel in the second image corresponds to a second chromaticity value, and a third pixel in the third image corresponds to a third chromaticity value, wherein the first pixel corresponds to the second pixel, and the second pixel corresponds to the third pixel;

[0355] Wherein, the difference between the third chromaticity value and the first chromaticity value is less than the difference between the third chromaticity value and the second chromaticity value.

[0356] In one possible implementation, the first pixel region in the first image corresponds to a fourth chromaticity value, the second pixel region in the second image corresponds to a fifth chromaticity value, and the third pixel region in the third image corresponds to a sixth chromaticity value. The first pixel region corresponds to the second pixel region, the second pixel region corresponds to the third pixel region, and the first pixel region includes a plurality of pixels.

[0357] The difference between the sixth chromaticity value and the fourth chromaticity value is less than the difference between the sixth chromaticity value and the fifth chromaticity value.

[0358] In one possible implementation, the scene information of the first region includes color information of the first region, and / or ambient light information of the first region, and / or information of a first medium, the first medium including the medium of the projection path of the second image, and / or weather information of the first region.

[0359] In one possible implementation, the image calibration unit 902 is specifically used to generate calibration information based on the first image and scene information of the first region;

[0360] The image calibration unit 902 is further configured to generate the second image based on the calibration information and the first image.

[0361] In one possible implementation, the correction information includes a time-division value of chromaticity for indicating the light source to the optical engine, and / or a modulation parameter of chromaticity for the spatial light modulator.

[0362] In a possible implementation, the image calibration unit 902 is specifically configured to generate the correction information based on the first image, scene information of the first region, and image correction relationship information, the image correction relationship information being used to indicate a corresponding relationship between a projected image and an actual image of the projected image presented in a projection region.

[0363] In a possible implementation, the image calibration unit 902 is specifically configured to generate the correction information based on the first image, scene information of the first region, and an artificial intelligence network model.

[0364] In a possible implementation, the artificial intelligence network model is used to train an input projected image, scene information of a projection region, and the projected image.

[0365] In a possible implementation, the artificial intelligence network model is preconfigured in a first projection device used to perform the projection method.

[0366] In a possible implementation, the image calibration unit 902 is specifically further configured to generate the second image based on a size relationship between a difference degree between a color corresponding to the scene information of the first region and a color of the first image and a first threshold value, and / or based on a size relationship between a complexity of the scene information of the first region and a second threshold value.

[0367] In a possible implementation, the projection device further includes a projection unit 903.

[0368] The projection unit 903 is configured to project the second image to the first region.

[0369] In a possible implementation, the projection device further includes a communication unit 904.

[0370] The communication unit 904 is configured to send indication information to a second projection device, the indication information including the second image, and the indication information being used to instruct the second projection device to project the second image into the first region.

[0371] In a possible implementation, when the scene information of the first region indicates that a time division value of a first chroma corresponding to the first region is greater than a third threshold value, a time division value of a first chroma of the second image is less than a time division value of the first chroma of the first image.

[0372] In a possible implementation, the image calibration unit 902 is further configured to control display of prompt information, the prompt information being used to prompt to turn on an image correction function, the image correction function being used to correct the first image.

[0373] As to each unit of the present design described above, the steps performed by the unit can refer to the implementation of the projection device corresponding to the method embodiment shown in FIG. 2.

[0374] As to the technical effects brought by the implementation of each unit of the present design described above, the introduction of the technical effects corresponding to the method embodiment shown in FIG. 2 can be referred to.

[0375] According to the embodiments of the present application, each unit in the device shown in FIG. 9 can be combined into one or several other units respectively or all, or some of the units can be further split into a plurality of units with smaller functions to constitute, which can achieve the same operation without affecting the implementation of the technical effects of the embodiments of the present application. The above-mentioned units are divided based on logical functions, and in actual application, the functions of a unit can also be implemented by multiple units, or the functions of multiple units can be implemented by one unit. In other embodiments of the present application, the electronic device can also include other units, and in actual application, these functions can also be assisted by other units, and can be implemented by multiple units.

[0376] It should be noted that the implementation of each unit can also be referred to the corresponding description of the method embodiment shown in FIG. 2.

[0377] In the projection device 90 described in FIG. 9, the problem of image distortion existing in vehicle lamp projection can be solved.

[0378] For the case that the projection device 90 described above can be an electronic device, the structure schematic diagram of the electronic device can be referred to FIG. 10.

[0379] It should be understood that the electronic device 100 shown in FIG. 10 is only an example, and the electronic device of the embodiments of the present application can also include other components, or include components similar in function to the components in FIG. 10, or not include all the components in FIG. 10.

[0380] The electronic device 100 includes a transceiver interface 1001 and at least one processor 1002.

[0381] The electronic device 100 can correspond to a projection device. The transceiver interface 1001 is used for transceiving signals, and the at least one processor 1002 executes program instructions, so that the electronic device 100 implements the corresponding processes of the method performed by the corresponding device in the above-mentioned method embodiments.

[0382] In a possible design, the electronic device 100 can correspond to the projection device in the method embodiment shown in FIG.2, for example, the electronic device 100 can be a projection device, or can be a chip in the projection device. The electronic device 100 can include components for performing operations performed by the projection device in the method embodiment, and each component in the electronic device 100 is respectively configured to implement the operations performed by the projection device in the method embodiment. Specifically, the electronic device 100 can include the following components:

[0383] obtaining a first image, the first image including an image expected to be presented in a first region;

[0384] obtaining scene information of the first region;

[0385] generating a second image based on the first image and the scene information of the first region, the second image being used for projection into the first region.

[0386] The transceiver interface 1001 and the at least one processor 1002 described in the design perform steps that can be referred to the implementation corresponding to the projection device in the method embodiment shown in FIG.2.

[0387] The technical effects brought by the implementation of the transceiver interface 1001 and the at least one processor 1002 described in the design can be referred to the introduction of the technical effects of the method embodiment shown in FIG.2.

[0388] In the electronic device 100 described in FIG.10, the problem of image distortion in vehicle lamp projection can be solved.

[0389] For the case that the projection device 90 can be a chip or a chip system, refer to the structural schematic diagram of the chip shown in FIG.11.

[0390] As shown in FIG.11, the chip 110 includes a processor 1101 and an interface 1102. The number of the processor 1101 can be one or more, and the number of the interface 1102 can be multiple. It should be noted that the functions of the processor 1101 and the interface 1102 can be implemented by hardware design, software design, or a combination of hardware and software, which is not limited here.

[0391] Optionally, the chip 110 can further include a memory 1103, and the memory 1103 is configured to store necessary program instructions and data.

[0392] In the present application, the processor 1101 can be configured to call the implementation program of the projection method provided by one or more embodiments of the present application from the memory 1103, and execute the instructions included in the program. The interface 1102 can be configured to output the execution result of the processor 1101. In the present application, the interface 1102 can be specifically configured to output various messages or information of the processor 1101.

[0393] The projection method provided by one or more embodiments of the present application can refer to the various embodiments shown in the foregoing FIG. 2, and will not be described here.

[0394] The processor in the embodiments of the present application can be a central processing unit (CPU), and can also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field programmable gate arrays (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor.

[0395] The memory in the embodiments of the present application is configured to provide a storage space, and the storage space can store data such as operating systems and computer programs. The memory includes but is not limited to random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), or compact disc read-only memory (CD-ROM).

[0396] According to the method provided by the embodiments of the present application, the embodiments of the present application also provide a computer readable storage medium, and the computer readable storage medium stores a computer program. When the computer program runs on one or more processors, the method shown in the foregoing FIG. 2 can be implemented.

[0397] According to the method provided by the embodiments of the present application, the embodiments of the present application also provide a computer program product, and the computer program product includes a computer program. When the computer program runs on a processor, the method shown in the foregoing FIG. 2 can be implemented.

[0398] The embodiment of the present application further provides a mobile terminal, which comprises at least one projection device 90, or an electronic device 100, or a chip 110.

[0399] Optionally, the mobile terminal can be a vehicle, such as a car, a truck, an aircraft, a drone, a slow transport vehicle, a space vehicle, or a ship, and the like, which can be used in any possible scenario, and the embodiment of the present application does not make any limitation.

[0400] Optionally, the mobile terminal is used to implement the method shown in Fig. 2.

[0401] The embodiment of the present application further provides a processing device, comprising a processor and an interface; the processor is used to execute the method in any method embodiment.

[0402] It should be understood that the above processing device can be a chip. The units in the above various device embodiments and the electronic device in the method embodiments fully correspond, and the corresponding steps are executed by the corresponding modules or units, for example, the communication unit (transceiver) executes the steps of receiving or transmitting in the method embodiment, and the other steps except for transmitting and receiving can be executed by the processing unit (processor). The functions of the specific units can be referred to the corresponding method embodiments. The processor can be one or more.

[0403] It can be understood that in the embodiment of the present application, the electronic device can execute part or all of the steps in the embodiment of the present application, and these steps or operations are only examples, and the embodiment of the present application can also execute other operations or various modifications of the operations. In addition, each step can be executed in different order according to the embodiment of the present application, and it is possible that not all the operations in the embodiment of the present application are executed.

[0404] In several embodiments provided by the present application, it should be understood that the disclosed system, device, and method can be implemented in other ways. For example, the device embodiments described above are only schematic. The division of the units is only a logical function division. There can be another division manner in actual implementation. For example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the displayed or discussed mutual couplings or direct couplings or communication connections between the units can be indirect couplings or communication connections through some interfaces, devices, or units, and can be electrical, mechanical, or in other forms.

[0405] The units described as separate components can or can not be physically separate, and the components shown as units can or can not be physical units, that is, they can be located in one place, or can be distributed on a plurality of network units. According to actual needs, part or all of the units can be selected to achieve the purpose of the embodiment of the present application.

[0406] In addition, each functional unit in each embodiment of the present application can be integrated in one processing unit, or each unit can exist physically, or two or more units can be integrated in one unit.

[0407] If the functions are realized in the form of software functional units and sold or used as independent products, they can be stored in a computer readable storage medium. Based on this understanding, the technical solutions of the present application or the parts that essentially contribute or the parts of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes a plurality of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes a U disk, a mobile hard disk, a read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk, and various media that can store program codes.

[0408] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art can easily think of changes or replacements within the technical scope disclosed in the present application, which should be covered within the protection scope of the present application.

Claims

1. A projection method, characterized by, The method comprises: acquiring a first image, the first image comprising an image expected to be presented in a first region; acquiring scene information of the first region; generating a second image based on the first image and the scene information of the first region, the second image being used for projection into the first region.

2. The projection method of claim 1, wherein, An image difference degree between a third image presented in the first region and the first image is less than an image difference degree between the third image and the second image, the image difference degree comprising a color difference degree and / or a brightness difference degree of an image.

3. The projection method of claim 2, wherein, A first pixel in the first image corresponds to a first chroma value, a second pixel in the second image corresponds to a second chroma value, and a third pixel in the third image corresponds to a third chroma value, the first pixel corresponding to the second pixel, and the second pixel corresponding to the third pixel; wherein a difference degree between the third chroma value and the first chroma value is less than a difference degree between the third chroma value and the second chroma value.

4. The projection method according to any one of claims 1 to 3, characterized in that, The scene information of the first region comprises color information of the first region, and / or ambient light information of the first region, and / or information of a first medium comprising a medium of a projection path of the second image, and / or weather information of the first region.

5. The projection method according to any one of claims 1 to 4, characterized in that, The generating of the second image based on the first image and the scene information of the first region comprises: generating correction information based on the first image and the scene information of the first region; generating the second image based on the correction information and the first image.

6. The projection method of claim 5, wherein, The correction information comprises a chroma time-division value for indicating a light source, and / or a modulation parameter of a spatial light modulator for chroma.

7. The projection method according to claim 5 or 6, characterized in that, The generating of the correction information based on the first image and the scene information of the first region comprises: generating the correction information based on the first image, the scene information of the first region, and image correction relationship information for indicating a corresponding relationship between a projection image presented in a projection region and an actual image.

8. The projection method according to any one of claims 1 to 7, characterized in that, The generating of the second image based on the first image and the scene information of the first region comprises: generating the second image based on a size relationship between a difference degree between a color corresponding to the scene information of the first region and a color of the first image and a first threshold, and / or based on a size relationship between a complexity of the scene information of the first region and a second threshold.

9. The projection method according to any one of claims 1 to 8, characterized in that, The projection method further comprises: projecting the second image into the first region.

10. The projection method according to any one of claims 1 to 8, characterized in that, The projection method further comprises: sending indication information to a second projection device, the indication information comprising the second image, the indication information being used for instructing the second projection device to project the second image into the first region.

11. The projection method according to any one of claims 1 to 10, characterized in that, The projection method further comprises: controlling display of prompt information, the prompt information being used for prompting to turn on an image correction function, the image correction function being used for correcting the first image.

12. The projection method according to any one of claims 1 to 11, characterized in that, The projection device used for projecting the second image comprises at least one of: a car lamp module, a head-up display (HUD), a car-mounted projector, and a household projector.

13. A projection apparatus, characterized by, The method comprises: The perception unit, the image calibration unit; The image calibration unit is configured to acquire a first image, the first image including an image expected to be presented in a first region; The perception unit is configured to acquire scene information of the first region; The image calibration unit is further configured to generate a second image based on the first image and the scene information of the first region, the second image being used for projection into the first region.

14. The projection apparatus according to claim 13, wherein, An image difference degree between a third image presented in the first region and the first image is less than an image difference degree between the third image and the second image, the image difference degree including a color difference degree and / or a brightness difference degree of an image.

15. The projection apparatus according to claim 14, wherein, A first pixel in the first image corresponds to a first chroma value, a second pixel in the second image corresponds to a second chroma value, and a third pixel in the third image corresponds to a third chroma value, the first pixel corresponding to the second pixel, and the second pixel corresponding to the third pixel; A difference degree between the third chroma value and the first chroma value is less than a difference degree between the third chroma value and the second chroma value.

16. The projection apparatus according to any one of claims 13 to 15, wherein, The scene information of the first region includes color information of the first region, and / or ambient light information of the first region, and / or information of a first medium including a medium of a projection path of the second image, and / or weather information of the first region.

17. The projection apparatus according to any one of claims 13 to 16, wherein, The image calibration unit is specifically configured to generate correction information based on the first image and the scene information of the first region; The image calibration unit is further configured to generate the second image based on the correction information and the first image.

18. The projection apparatus according to claim 17, wherein, The correction information includes a chroma time division value for indicating a light source to a light machine, and / or a modulation parameter of a spatial light modulator for indicating chroma.

19. The projection apparatus according to claim 17 or 18, wherein, The image calibration unit is specifically configured to generate the correction information based on the first image, the scene information of the first region, and image correction relationship information indicating a corresponding relationship between a projection image and an actual image presented in a projection region.

20. The projection apparatus according to any one of claims 13 to 19, wherein, The image calibration unit is specifically further configured to generate the second image based on a size relationship between a difference degree between a color corresponding to the scene information of the first region and a color of the first image and a first threshold value, and / or a size relationship between a complexity of the scene information of the first region and a second threshold value.

21. The projection apparatus according to any one of claims 13 to 20, wherein, The projection device further includes a projection unit; The projection unit is configured to project the second image into the first region.

22. The projection apparatus according to any one of claims 13 to 20, wherein, The projection device further includes a communication unit; The communication unit is configured to send indication information to a second projection device, the indication information including the second image, the indication information being used for instructing the second projection device to project the second image into the first region.

23. The projection apparatus according to any one of claims 13 to 22, wherein, The image calibration unit is further configured to control display of prompt information, the prompt information being used for prompting to turn on an image correction function, the image correction function being used for correcting the first image.

24. A projection apparatus, characterized by comprising: comprising a processor for performing the method of any of claims 1 to 12.

25. A chip, characterized by comprising a logic circuit and an interface, the logic circuit and the interface being coupled; the interface for inputting and / or outputting information, the logic circuit for performing the method of any of claims 1 to 12.

26. A mobile terminal, characterized by comprising the projection device of any of claims 13 to 23, or the projection device of claim 24, or the chip of claim 25.

27. A computer readable storage medium, characterized in that, the computer readable storage medium for storing a computer program which, when executed, performs the method of any of claims 1 to 12.

28. A computer program product, characterised in that, the computer program product comprising a computer program which, when executed, performs the method of any of claims 1 to 12.

Images