Vehicle-mounted projection system and automobile product

Abstract

The invention discloses a vehicle-mounted projection system and an automobile product, which can decompose the same to-be-projected image into two parts of 2D to-be-projected pixel information or 3D to-be-projected pixel information so as to control a DLP projection module to simultaneously project and form a visual effect of a 2D plane image corresponding to the 2D to-be-projected pixel information. And the visual effect of the 3D stereoscopic image corresponding to the 3D pixel information to be projected is realized, so that the vehicle-mounted projection technology with both the 2D projection effect and the 3D projection effect is realized. According to the technical scheme of the invention, the personnel on the vehicle can simultaneously watch the 2D projection effect and the 3D projection effect, so that different attention can be easily generated for different parts of the projection effect of the same to-be-projected image according to the difference between the 2D projection effect and the 3D projection effect, and the user experience can be improved in the aspects of improving the information transmission efficiency of the to-be-projected image and the like. The invention is widely applied to the technical field of automobiles.

Description

Technical Field

[0001] This invention relates to the field of automotive technology, and in particular to an in-vehicle projection system and automotive products. Background Technology

[0002] In-vehicle projection systems project light onto surfaces such as roads to display text, icons, car models, and other content. Current in-vehicle projection technology can achieve 2D or 3D projection effects. However, there is currently a lack of in-vehicle projection technology that can achieve both 2D and 3D projection effects, and the user experience of in-vehicle projection technology still has room for improvement. Summary of the Invention

[0003] In view of at least one of the above-mentioned technical problems, the purpose of this invention is to provide an in-vehicle projection system and an automotive product.

[0004] On one hand, embodiments of the present invention include an in-vehicle projection system, the in-vehicle projection system comprising: DLP projection module; The control module is used to acquire the image to be projected, identify the image to be projected, identify the pixel information in the image to be projected as 2D pixel information or 3D pixel information to be projected, and control the DLP projection module to perform projection according to the identified image to be projected.

[0005] Furthermore, the DLP projection module includes a first DLP projection unit and a second DLP projection unit; the first DLP projection unit and the second DLP projection unit each include a plurality of micromirror devices; The first DLP projection unit is used to project onto the left eye field of view of the person in the vehicle with the first projection parameters; The second DLP projection unit is used to project onto the right eye field of view of the occupant in the vehicle using the second projection parameters; The first projection parameter is imperceptible to the right eye of the person in the vehicle, and the second projection parameter is imperceptible to the left eye of the person in the vehicle.

[0006] Further, the step of recognizing the image to be projected, and recognizing the pixel information in the image to be projected as 2D projection pixel information or 3D projection pixel information respectively, includes: Build a convolutional neural network and a classifier; Using the convolutional neural network, semantic features of each pixel information in the image to be projected are extracted; For any of the pixel information, the semantic features corresponding to the pixel information are input into the classifier for processing to obtain the classification result of the classifier. Based on the classification result, the pixel information is determined to be either the 2D pixel information to be projected or the 3D pixel information to be projected.

[0007] Further, controlling the DLP projection module to perform projection based on the identified image to be projected includes: For any of the 2D pixel information to be projected, based on the relative position of the 2D pixel information to be projected in the image to be projected, a corresponding micromirror device in the target DLP projection unit is determined, and the micromirror device is controlled to perform projection based on the 2D pixel information to be projected; wherein, the target DLP projection unit is the first DLP projection unit or the second DLP projection unit.

[0008] Further, controlling the DLP projection module to perform projection based on the identified image to be projected includes: For any 3D pixel information to be projected, a first target micromirror device and a second target micromirror device are determined based on the relative position of the 3D pixel information in the image to be projected. A pixel offset is obtained, and the projection angle difference between the first target micromirror device and the second target micromirror device is set according to the pixel offset. Based on the 3D pixel information to be projected, the first target micromirror device and the second target micromirror device are controlled to perform projection. Wherein, the first target micromirror device is a corresponding micromirror device in the first DLP projection unit, and the second target micromirror device is a corresponding micromirror device in the second DLP projection unit.

[0009] Further, obtaining the pixel offset includes: Set a base offset; the base offset is a fixed value; Based on the semantic features corresponding to the 3D pixel information to be projected, a first content priority of the 3D pixel information to be projected is determined; The pixel offset is determined based on the first content priority and the basic offset; the pixel offset is positively correlated with the first content priority.

[0010] Further, controlling the DLP projection module to perform projection based on the identified image to be projected includes: Set the first projection brightness corresponding to the 3D pixel information to be projected; Based on the semantic features corresponding to the 2D pixel information to be projected, a second content priority of the 2D pixel information to be projected is determined; The second projection brightness is determined based on the second content priority and the first projection brightness; the second projection brightness is positively correlated with the second content priority. Set the projection brightness corresponding to the 2D pixel information to be projected as the second projection brightness.

[0011] Further, the step of recognizing the image to be projected, and recognizing the pixel information in the image to be projected as 2D projection pixel information or 3D projection pixel information respectively, includes: Establish a convolutional neural network; Using the convolutional neural network, the target type of each pixel information in the image to be projected is extracted; Set privacy thresholds; For any of the pixel information, the privacy level of the pixel information is determined according to the target type corresponding to the pixel information. When the privacy level is greater than or equal to the privacy threshold, the pixel information is determined as the 3D pixel information to be projected; otherwise, the pixel information is determined as the 2D pixel information to be projected.

[0012] Further, the step of recognizing the image to be projected, and recognizing the pixel information in the image to be projected as 2D projection pixel information or 3D projection pixel information respectively, includes: For any 3D pixel information to be projected, based on the relative position of the 3D pixel information to be projected in the image to be projected, a first target micromirror device and a second target micromirror device are determined, a pixel offset is obtained, the projection angle difference between the first target micromirror device and the second target micromirror device is set according to the pixel offset, a first projection brightness corresponding to the 3D pixel information to be projected is set, the traffic flow on the left and right sides of the vehicle is detected, and based on the traffic flow on the left and right sides, the first projection brightness is decomposed into left brightness and right brightness. Based on the 3D pixel information to be projected, the first target micromirror device is controlled to perform projection with the left brightness, and the second target micromirror device is controlled to perform projection with the right brightness. Wherein, the first target micromirror device is a corresponding micromirror device in the first DLP projection unit, the second target micromirror device is a corresponding micromirror device in the second DLP projection unit, the left brightness is negatively correlated with the left traffic flow, and the right brightness is negatively correlated with the right traffic flow.

[0013] On the other hand, embodiments of the present invention also include an automotive product, the automotive product including the in-vehicle projection system described in the embodiments.

[0014] The beneficial effects of this invention are as follows: The vehicle-mounted projection system in the embodiments can decompose the same image to be projected into two parts: 2D projection pixel information or 3D projection pixel information. This allows the DLP projection module to simultaneously project the visual effects of a 2D planar image corresponding to the 2D projection pixel information and a 3D stereoscopic image corresponding to the 3D projection pixel information, thereby achieving a vehicle-mounted projection technology that combines both 2D and 3D projection effects. Since passengers can simultaneously view both 2D and 3D projection effects, they can easily focus on different parts of the projection effect of the same image based on the differences between the 2D and 3D projection effects. This is beneficial for improving the user experience in terms of increasing the information transmission efficiency of the image to be projected. Attached Figure Description

[0015] Figure 1 This is a schematic diagram of the vehicle-mounted projection system in the embodiment; Figure 2 This is a schematic diagram of the structure of the first DLP projection unit and the second DLP projection unit in the embodiment; Figure 3 This is a schematic diagram illustrating the working principle of the vehicle-mounted projection system in the embodiment; Figure 4 This is a schematic diagram illustrating the steps of the control method for the vehicle-mounted projection system in the embodiment. Detailed Implementation

[0016] Terminology Explanation: DLP: Digital Light Processing is a projection display technology that integrates multiple (e.g., millions) independently deflectable digital micromirrors. It controls the direction of light reflection through electrostatic drive, generates grayscale images with pulse width modulation, and uses a color wheel or beam splitter to synthesize a color image. Each digital micromirror can project a corresponding pixel, so that multiple digital micromirrors can project a single image.

[0017] DMD: Digital Micromirror Device, the basic functional unit of DLP.

[0018] 2D: Two-dimensional. In projection technology, it presents an image with only two dimensions: length and width, without depth information. 3D: Three-dimensional, in projection technology, presents an image with three dimensions: length, width, and depth.

[0019] This embodiment provides a vehicle-mounted projection system. (Refer to...) Figure 1The in-vehicle projection system includes a control module and a DLP projection module. The control module can utilize components with data acquisition, data processing, and control functions, such as an electronic control unit (ECU).

[0020] In this embodiment, refer to Figure 1 The DLP projection module includes a first DLP projection unit and a second DLP projection unit. Specifically, the first DLP projection unit and the second DLP projection unit each have... Figure 2 The structure shown. (Refer to...) Figure 2 Taking the first DLP projection unit as an example, the first DLP projection unit includes multiple micromirror devices, each of which can be independently controlled to emit light, and the light emission direction of each micromirror device can be perpendicular to... Figure 2 The plane shown can also be within a certain range (e.g., relative to...) Figure 2 The emission direction is independently and controllably adjusted within ±10° of the perpendicular line of the plane shown. Therefore, for a given number of pixels and Figure 2 An image containing the same number of micromirror devices (with the number of rows and columns of pixels corresponding to the number of rows and columns of micromirror devices, respectively) can establish a mapping between each pixel in the image and... Figure 2 The one-to-one correspondence between the various micromirror devices in the image means that if each micromirror device is controlled to emit light according to the information of each pixel in the image (including emission color, emission brightness, emission time period, etc.), then when the light emitted by each micromirror device is projected onto the projection medium (such as the road surface outside the car), it will form a pixel. The light emitted by all the micromirror devices will form multiple pixels, thus projecting an image onto the projection medium.

[0021] Meanwhile, the light emitted by each micromirror device in the first DLP projection unit itself has an illumination function; therefore, the first DLP projection unit and the second DLP projection unit can be used simultaneously as lighting components in an automobile. For example, refer to... Figure 1 The first DLP projection unit is used as the left headlight of the car, and the second DLP projection unit is used as the right headlight of the car.

[0022] In this embodiment, refer to Figure 3 By calibrating the car, the areas visible to a specific occupant (e.g., the driver) with their left eye (left visual field) and right eye (right visual field) can be determined. These visual fields may overlap. By setting the installation orientation of the first and second DLP projection units, the first DLP projection unit projects onto the left visual field, and the second DLP projection unit projects onto the right visual field.

[0023] In this embodiment, the first DLP projection unit performs projection using the first projection parameters, and the second DLP projection unit performs projection using the second projection parameters. The first and second projection parameters are two different values ​​of the same type of parameter. For example, the first and second projection parameters can specifically be parameters of the "polarization direction." Specifically, the first projection parameter can be "left-handed polarization," and the second projection parameter can be "right-handed polarization." That is, the micromirrors in the first DLP projection unit emit left-handed polarized light, while the micromirrors in the second DLP projection unit emit right-handed polarized light. If a passenger is wearing polarized glasses, with the left lens being left-handed and the right lens being right-handed, only the light projected by the first DLP projection unit can pass through the left lens and be received by the left eye. The light projected by the second DLP projection unit cannot pass through the left lens and is therefore not received by the left eye. In other words, the second projection parameter is imperceptible to the passenger's left eye. Similarly, only the light projected by the second DLP projection unit can pass through the right lens and be received by the right eye, while the light projected by the first DLP projection unit cannot pass through the right lens and is therefore not received by the right eye. Thus, the first projection parameter is imperceptible to the passenger's right eye. In this way, the passengers' left eye will only see the image projected by the first DLP projection unit, and their right eye will only see the image projected by the second DLP projection unit.

[0024] In this embodiment, the first projection parameter and the second projection parameter can specifically be parameters of the type of "emission time period". Specifically, the first projection parameter can be "the first half of each working cycle", and the second projection parameter can be "the second half of each working cycle". That is, in each working cycle, each micromirror device in the first DLP projection unit emits light in the first half (at which time the second DLP projection unit does not emit light), and each micromirror device in the second DLP projection unit emits light in the second half (at which time the first DLP projection unit does not emit light). When the people in the vehicle are wearing active shutter glasses (where the left lens is open in the first half of each working cycle and closed in the second half of each working cycle, and the right lens is closed in the first half of each working cycle and open in the second half of each working cycle), the people in the vehicle can see the projection effect of the first DLP projection unit with their left eye in the first half of each working cycle, but not with their right eye. In the second half of each working cycle, their right eye can see the projection effect of the second DLP projection unit, but not with their left eye.

[0025] In this embodiment, when the first DLP projection unit and the second DLP projection unit project images with the first projection parameters and the second projection parameters respectively, and project images with the same content, the left and right eyes of the people in the vehicle can see the images within their respective fields of vision, thereby giving the people in the vehicle a 3D stereoscopic image visual effect.

[0026] In this embodiment, if only the first DLP projection unit projects an image (or a part of an image), while the second DLP projection unit does not project this part (or conversely, the second DLP projection unit projects this part, while the first DLP projection unit does not project this part), then this part of the image will present a 2D planar image visual effect in the eyes of the people in the vehicle.

[0027] In this embodiment, the control module can independently control the luminescence parameters (including luminescence color, luminescence brightness, luminescence time period, etc.) and luminescence direction of each micromirror device in the first and second DLP projection units. Specifically, the control module achieves this by executing a control method for the vehicle-mounted projection system. (Refer to...) Figure 4 The control module performs the following steps: S1. Obtain the image to be projected; S2. Recognize the image to be projected, and identify the pixel information in the image to be projected as 2D pixel information to be projected or 3D pixel information to be projected; S3. Control the DLP projection module to perform projection based on the identified image to be projected.

[0028] In step S1, the control module can generate a projection image based on information generated from driving tasks, navigation tasks, and audio-visual entertainment playback tasks, such as text (e.g., text indicating vehicle speed, destination, etc.), icons (e.g., symbols in music playback), and 3D models (e.g., arrows indicating navigation direction). Specifically, the projection image can be a frame extracted from a video stream. The projection image includes multiple pixels, each corresponding to pixel information such as color and brightness.

[0029] In step S2, the control module identifies the pixel information in the image to be projected as either 2D or 3D projected pixel information. That is, the pixel information of each pixel in the image to be projected will be identified as either 2D or 3D projected pixel information.

[0030] In step S3, for 2D pixel information to be projected, the control module controls the DLP projection module to project a 2D planar image; for 3D pixel information to be projected, the control module controls the DLP projection module to project a 3D stereoscopic image.

[0031] In this embodiment, by operating the vehicle-mounted projection system, for example, by executing steps S1-S3, the same image to be projected can be decomposed into two parts: 2D projection pixel information or 3D projection pixel information. This allows the DLP projection module to simultaneously project the visual effects of both the 2D planar image corresponding to the 2D projection pixel information and the 3D stereoscopic image corresponding to the 3D projection pixel information. This achieves vehicle-mounted projection technology that combines both 2D and 3D projection effects. Since passengers can simultaneously view both 2D and 3D projection effects, they can easily focus on different parts of the same image based on the differences between the 2D and 3D projection effects. This improves the user experience by enhancing the information transmission efficiency of the projected image.

[0032] In this embodiment, when the control module performs step S2, which is to identify the image to be projected and to identify the pixel information in the image to be projected as 2D pixel information or 3D pixel information to be projected, the following steps can be performed: S201A. Establish a convolutional neural network and a classifier; S202A. Use a convolutional neural network to extract semantic features of each pixel in the image to be projected; S203A. For any pixel information, input the semantic features corresponding to the pixel information into the classifier for processing, obtain the classification result of the classifier, and determine the pixel information as 2D or 3D pixel information to be projected based on the classification result.

[0033] Steps S201A-S203A are the first execution method of step S2.

[0034] In step S201A, a convolutional neural network (specifically a U-Net network) and a Softmax classifier can be established.

[0035] In step S202A, the image to be projected is input into a convolutional neural network for processing, which can extract semantic features of each pixel. In this embodiment, the semantic features of each pixel are extracted from the first pixel in the image to be projected. The semantic feature vector extracted from each pixel is represented as follows: ,in Including the image to be projected in the first Deep feature information such as depth gradient and planar texture at each pixel.

[0036] In step S203A, each semantic feature vector is input into a Softmax classifier for pixel-level classification. Specifically, for the first... The semantic feature vector corresponding to each pixel information The processing of the Softmax classifier is

[0037] in, The output of the Softmax classifier Classification results of pixel information, and These are the training parameters for the model in a convolutional neural network.

[0038] In this embodiment, Determined as the number The probability that a pixel belongs to the 3D pixel information to be projected. A threshold (e.g., 0.8) can be set. In the case of ≥0.8, in step S203A, the first... Each pixel information is determined as the 3D pixel information to be projected; conversely, when... When <0.8, in step S203A, the first The pixel information is determined as 2D pixel information to be projected.

[0039] In this embodiment, based on the execution of steps S201A-S203A, when the control module executes step S3, which is the step of controlling the DLP projection module to perform projection based on the recognized image to be projected, the following steps can be specifically executed: S301A. For any 2D pixel information to be projected, determine a corresponding micromirror device in the target DLP projection unit according to the relative position of the 2D pixel information to be projected in the image to be projected, and control the micromirror device to perform projection according to the 2D pixel information to be projected. S302A. For any 3D pixel information to be projected, determine the first target micromirror device and the second target micromirror device according to the relative position of the 3D pixel information to be projected in the image to be projected, obtain the pixel offset, set the projection angle difference between the first target micromirror device and the second target micromirror device according to the pixel offset, and control the set first target micromirror device and the second target micromirror device to perform projection according to the 3D pixel information to be projected.

[0040] Step S301A is the processing method for the 2D pixel information to be projected. In this embodiment, it is assumed that the first pixel in the image to be projected... Each pixel information is 2D pixel information to be projected, specifically located in the image to be projected. OK In step S301A, either the first DLP projection unit or the second DLP projection unit is selected as the target DLP projection unit, and a micromirror device located at the same position in the target DLP projection unit (e.g., in the first DLP projection unit) is determined. OK The micromirror device (a series of micromirror devices) is controlled to perform projection based on the 2D pixel information to be projected. Specifically, this micromirror device can be controlled to project the first... The light emission parameters of each pixel, i.e., the 2D pixel information to be projected, are used to emit light.

[0041] In this embodiment, by calling only one of the DLP projection units to emit light, the display effect of the 2D planar image corresponding to the 2D pixel information to be projected can be displayed in step S301A.

[0042] Step S302A describes the processing method for the 3D pixel information to be projected. In this embodiment, it is assumed that the first pixel in the image to be projected... Each pixel information is the 3D pixel information to be projected, which is specifically located in the image to be projected. OK In step S302A, the first DLP projection unit is selected from those also located in... OK The micromirror device in the column is selected as the first target micromirror device, and the same one in the second DLP projection unit is also selected. OK The micromirror device in the column is used as the second target micromirror device to obtain pixel offset. The projection directions of the first target micromirror device and the second target micromirror device are set such that there is a certain projection angle difference between them. This ensures that the distance between the pixels projected by the first target micromirror device and the pixels simultaneously projected by the second target micromirror device is equal to the pixel offset. Based on the 3D pixel information to be projected, the first target micromirror device and the second target micromirror device are controlled to perform projection. Specifically, this micromirror device can be controlled to project the first target micromirror device onto the second target micromirror device. The light emission parameters of each pixel, i.e., the 3D pixel information to be projected, are used to emit light.

[0043] In this embodiment, step S302A, by simultaneously calling two DLP projection units to emit light, can display the 3D stereoscopic image corresponding to the 3D pixel information to be projected.

[0044] In this embodiment, the pixel offset used in step S302A Related to the final display effect of the 3D stereoscopic image, specifically, pixel offset. The larger the size, the stronger the three-dimensional effect of the display.

[0045] In this embodiment, a fixed value (e.g., 1 cm) can be set as the basic offset. Based on the semantic features corresponding to the 3D pixel information to be projected obtained during step S202A, the first content priority of the 3D pixel information to be projected is determined. For example, if the first content priority of the 3D pixel information to be projected is... Semantic features corresponding to each pixel information This indicates that it belongs to the navigation or warning category, and its corresponding first content priority can be assigned. Set to the highest value of 5; if semantic features This indicates that it belongs to the entertainment and auxiliary information category, and its corresponding first content priority can be set. Set it to the lowest value of 1.

[0046] In this embodiment, after obtaining the first 3D pixel information to be projected... The first content priority corresponding to each pixel information Then, you can use the formula

[0047] Calculate the pixel offset This results in pixel offset Priority of the first content Positive correlation. Thus, if the first pixel information to be projected in 3D... The higher the priority of the first content of a pixel, the larger the pixel offset will be after that pixel is projected by the first target micromirror device and the second target micromirror device, respectively. This results in a stronger 3D stereoscopic image display effect, making it easier for passengers to focus on the 3D projected pixel information. By using individual pixel information, different areas of the overall projected image can have different information transmission efficiencies, thereby improving the support of vehicle projection for information acquisition and driving decisions for occupants.

[0048] In this embodiment, based on the execution of steps S301A-S302A, when the control module executes step S3, that is, the step of controlling the DLP projection module to perform projection based on the recognized image to be projected, the following steps may also be executed: S303A. Set the first projection brightness corresponding to the 3D pixel information to be projected; S304A. Determine the second content priority of the 2D pixel information to be projected based on the semantic features corresponding to the 2D pixel information to be projected; S305A. Determine the second projection brightness based on the second content priority and the first projection brightness.

[0049] S306A. Set the projection brightness corresponding to the 2D pixel information to be projected to the second projection brightness.

[0050] In step S303A, it is possible to set all 3D pixels to be projected to correspond to the same first projection brightness. That is, each of the first target micromirror devices and the second target micromirror devices has a first projected brightness. It emits light.

[0051] The principle of step S304A is the same as that of step S302A, using the first 2D pixel information to be projected as the first... Taking pixel information as an example, obtain its corresponding second content priority. .

[0052] In step S305A, the formula can be used.

[0053] Thus, the first pixel information to be projected in 2D is calculated. The second projection brightness corresponding to each pixel information In step S306A, for the first pixel information that is used as 2D projection pixel information... Each pixel information is used to control a corresponding micromirror device in the target DLP projection unit to achieve a second projection brightness. It emits light.

[0054] In this embodiment, the principle of executing steps S303A-S306A is as follows: after determining that the 3D pixel information to be projected has a fixed first projection brightness... In the case of 2D pixel information to be projected, the first The higher the second priority of the pixel information, the better the priority of the pixel information used as 2D projection information. The second projection brightness corresponding to each pixel information Higher brightness compensation ensures that the brightness of the projected 2D planar image is coordinated with that of the 3D stereoscopic image.

[0055] In this embodiment, for pixels at the boundary between the 2D planar image and the 3D stereoscopic image, an overlapping transition area of ​​a certain width (e.g., 5 pixels) can be set, and a linear brightness gradient algorithm can be used to achieve this transition.

[0056] Calculate the first one located in the overlapping transition region The projection brightness of each pixel is adjusted to achieve a smooth blend between the final projected 2D planar image and the 3D stereoscopic image, reducing the sense of separation.

[0057] In this embodiment, when the control module performs step S2, which is to identify the image to be projected and to identify the pixel information in the image to be projected as 2D pixel information or 3D pixel information to be projected, the following steps can be performed: S201B. Establish a convolutional neural network; S202B. Using a convolutional neural network, extract the target type from the pixel information of the image to be projected; S203B. Setting privacy thresholds; S204B. For any pixel information, determine the privacy level of the pixel information according to the target type corresponding to the pixel information. When the privacy level is greater than or equal to the privacy threshold, the pixel information is determined as 3D pixel information to be projected; otherwise, the pixel information is determined as 2D pixel information to be projected.

[0058] Steps S201B-S204B are the second execution method of step S2.

[0059] The principles of steps S201B-S202B are similar to those of steps S201A-S202A. In step S201B, the convolutional neural network is trained to perform object detection tasks. In step S202B, the image to be projected is input into the convolutional neural network for processing, which can identify targets contained in the image, such as text (e.g., text indicating vehicle speed, destination, etc.), icons (e.g., symbols in music playback), and 3D models (e.g., arrows indicating navigation directions).

[0060] In this embodiment, the privacy level of various target types can be determined based on the information they contain. For example, for targets such as text (e.g., text representing vehicle speed, destination, etc.), since they directly contain information such as the car's current driving status and the destination to be reached, they can be determined to contain the most user-related privacy information, and therefore the privacy level of this type of target can be set to the highest level of 3. For targets such as 3D models (e.g., arrows representing navigation directions), since they contain information such as the car's current direction of travel, they can be determined to contain a moderate amount of user-related privacy information, and therefore the privacy level of this type of target can be set to a moderate level of 2. For icons (e.g., a music playback icon), since they contain almost no personalized information, they can be determined to contain the least amount of user-related privacy information, and therefore the privacy level of this type of target can be set to the lowest level of 1.

[0061] In step S203B, a privacy threshold in the form of levels can be set. For example, in this embodiment, the privacy threshold can be set to 2.

[0062] In step S204B, based on steps S202B-S203B, for targets of the text type with the highest privacy level of 3 and targets of the 3D model type with the medium privacy level of 2, their privacy levels are both greater than or equal to the privacy threshold. Therefore, the pixel information of targets that are determined to be of the text type or targets that are of the 3D model type is determined as 3D projection pixel information. For targets of the icon type with the lowest privacy level of 1, their privacy level is less than the privacy threshold. Therefore, the pixel information of targets that are determined to be of the icon type is determined as 2D projection pixel information.

[0063] In this embodiment, by executing steps S201B-S204B, the pixel information containing more privacy information in the image to be projected can be projected as a 3D stereoscopic image, while the pixel information containing less privacy information can be projected as a 2D planar image. Since the 3D stereoscopic image has a stronger attention-attracting effect than the 2D planar image, it is beneficial for the people in the vehicle to pay attention to the projection result of the vehicle's privacy information, thereby reducing the leakage of privacy information.

[0064] In this embodiment, based on the execution of steps S201B-S204B, when the control module executes step S3, which is to identify the image to be projected and to identify the pixel information in the image to be projected as 2D pixel information or 3D pixel information, the following steps can be specifically executed: S301B. For any 3D pixel information to be projected, determine the first target micromirror device and the second target micromirror device based on the relative position of the 3D pixel information in the image to be projected, obtain the pixel offset, set the projection angle difference between the first target micromirror device and the second target micromirror device based on the pixel offset, set the first projection brightness corresponding to the 3D pixel information to be projected, detect the traffic flow on the left and right sides of the car, decompose the first projection brightness into left brightness and right brightness based on the left and right traffic flow, and control the set first target micromirror device to perform projection with left brightness and control the set second target micromirror device to perform projection with right brightness based on the 3D pixel information to be projected. Step S301B is the second execution method of step S3.

[0065] In this embodiment, in the second execution mode of step S3, the same steps as in step S301A can be performed to control the micromirror device to perform projection based on the 2D pixel information to be projected. However, for 3D pixel information to be projected, step S301B, which differs from step S302A, is performed for projection.

[0066] Specifically, in step S301B, in contrast to step S302A, the control module can also call environmental detection components such as LiDAR to detect the current traffic flow on the left side of the vehicle. Traffic flow on the right Data such as traffic flow on the left side. This indicates the number of cars located to the left or passing by this vehicle within a recent period, and the traffic flow on the right side. This indicates the number of cars that are located to the right of this vehicle or pass by this vehicle to the right within a recent period of time.

[0067] In step S301B, the control module obtains the traffic flow on the left. Traffic flow on the right Then, you can use the formula ( and (not both 0) ( and (not both 0) ( = =0) Calculate the brightness on the left side separately. brightness on the right This allows us to obtain information about the traffic flow on the left. Negative correlation (with traffic flow on the right) Brightness on the left side (positive correlation) and traffic flow on the right Negative correlation (with traffic flow on the left) (positive correlation) right-side brightness Moreover, the brightness on the left side... brightness on the right The sum of these is always equal to the first projected brightness. .

[0068] In step S301B, after obtaining the brightness of the left side... brightness on the right Subsequently, the first target micromirror device, after being controlled and set, was positioned with a brightness level on the left side. Projection is performed onto the left eye's visual field, and the second target micromirror device, after being controlled and set, is illuminated at the right side. Project the right eye visual field area.

[0069] In this embodiment, the principle of executing step S301B is as follows: when executing steps S201B-S204B to classify the target containing a lot of privacy information into 3D projection pixel information and project it in the form of a 3D stereoscopic image, the traffic flow on the left side is used as the basis for the calculation. For example, when the traffic flow on the left... The larger the value, the smaller the brightness on the left side. This results in a portion of the 3D stereoscopic image generated by the first target micromirror device projecting onto the left eye's visual field having lower brightness. This reduces the likelihood that this portion of the 3D stereoscopic image will be captured by a vehicle on the left side of the vehicle or viewed by a user there, thus reducing the possibility that the vehicle's privacy information will be obtained by other vehicles and ensuring privacy and security. Meanwhile, the brightness on the left side... brightness on the right The sum of these is always equal to the first projected brightness. This ensures that when passengers in the vehicle are simultaneously observing the left and right visual fields, the 3D stereoscopic image they see has sufficient brightness, allowing them to clearly view the 3D stereoscopic image and obtain the information it conveys, thus ensuring the availability of the in-vehicle projection system.

[0070] A car projection system can be installed in a vehicle, integrating it with other components to form a unified vehicle system. Such a vehicle will then have the full functionality of a car projection system.

[0071] It should be noted that, unless otherwise specified, when a feature is referred to as "fixed" or "connected" to another feature, it can be directly fixed or connected to the other feature, or indirectly fixed or connected to the other feature. Furthermore, the descriptions of "upper," "lower," "left," and "right" used in this disclosure are only relative to the relative positional relationships of the components of this disclosure in the accompanying drawings. The singular forms "a," "an," and "the" used in this disclosure are also intended to include the plural forms, unless the context clearly indicates otherwise. Moreover, unless otherwise defined, all technical and scientific terms used in this embodiment have the same meaning as commonly understood by one of ordinary skill in the art. The terminology used in this embodiment specification is only for describing particular embodiments and is not intended to limit the invention. The term "and / or" as used in this embodiment includes any combination of one or more of the associated listed items.

[0072] It should be understood that although various elements may be described in this disclosure using terms such as "second," "third," etc., these elements should not be limited to these terms. These terms are used only to distinguish elements of the same type from one another. For example, an element may also be referred to as a second element without departing from the scope of this disclosure, and similarly, a second element may also be referred to as an element. The use of any and all instances or exemplary language ("e.g.," "such as," etc.) provided in this embodiment is intended only to better illustrate embodiments of the invention and, unless otherwise required, does not impose a limitation on the scope of the invention.

[0073] It should be recognized that embodiments of the present invention can be implemented or carried out by computer hardware, a combination of hardware and software, or by computer instructions stored in a non-transitory computer-readable storage medium. The method can be implemented using standard programming techniques—including a non-transitory computer-readable storage medium configured with a computer program, wherein such a storage medium causes the computer to operate in a specific and predefined manner—according to the methods and drawings described in the specific embodiments. Each program can be implemented in a high-level procedural or object-oriented programming language to communicate with the computer system. However, if desired, the program can be implemented in assembly or machine language. In any case, the language can be a compiled or interpreted language. Furthermore, for this purpose, the program can run on a programmed application-specific integrated circuit (ASIC).

[0074] Furthermore, the procedures described in this embodiment can be performed in any suitable order unless otherwise indicated by this embodiment or otherwise obviously contradict the context. The procedures (or variations and / or combinations thereof) described in this embodiment can be executed under the control of one or more computer systems configured with executable instructions, and can be implemented by hardware or a combination thereof as code (e.g., executable instructions, one or more computer programs, or one or more applications) that commonly executes on one or more processors. A computer program includes a plurality of instructions executable by one or more processors.

[0075] Furthermore, the method can be implemented in any suitable type of computing platform, including but not limited to personal computers, minicomputers, mainframes, workstations, networked or distributed computing environments, standalone or integrated computer platforms, or in communication with charged particle tools or other imaging devices, etc. Aspects of the invention can be implemented as machine-readable code stored on a non-transitory storage medium or device, whether removable or integrated into a computing platform, such as a hard disk, optical read and / or write storage medium, RAM, ROM, etc., such that it is readable by a programmable computer, and when the storage medium or device is read by the computer, it can be used to configure and operate the computer to perform the processes described herein. Furthermore, the machine-readable code, or portions thereof, can be transmitted via wired or wireless networks. The invention of this embodiment includes these and other different types of non-transitory computer-readable storage media when such media comprises instructions or programs that implement the steps above in conjunction with a microprocessor or other data processor. When programmed according to the methods and techniques of the invention, the invention also includes the computer itself.

[0076] A computer program can be applied to input data to perform the functions of this embodiment, thereby transforming the input data to generate output data stored in non-volatile memory. The output information can also be applied to one or more output devices, such as a display. In a preferred embodiment of the invention, the transformed data represents physical and tangible objects, including specific visual depictions of physical and tangible objects generated on the display.

[0077] The above are merely preferred embodiments of the present invention. The present invention is not limited to the above-described embodiments. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention, as long as they achieve the technical effects of the present invention by the same means, should be included within the scope of protection of the present invention. Within the scope of protection of the present invention, the technical solutions and / or implementation methods can have various modifications and variations.

Claims

1. A vehicle-mounted projection system, characterized in that, The vehicle-mounted projection system includes: DLP projection module; The control module is used to acquire the image to be projected, identify the image to be projected, identify the pixel information in the image to be projected as 2D pixel information or 3D pixel information to be projected, and control the DLP projection module to perform projection according to the identified image to be projected.

2. The vehicle-mounted projection system according to claim 1, characterized in that: The DLP projection module includes a first DLP projection unit and a second DLP projection unit; the first DLP projection unit and the second DLP projection unit each include a plurality of micromirror devices. The first DLP projection unit is used to project onto the left eye field of view of the person in the vehicle with the first projection parameters; The second DLP projection unit is used to project onto the right eye field of view of the occupant in the vehicle using the second projection parameters; The first projection parameter is imperceptible to the right eye of the person in the vehicle, and the second projection parameter is imperceptible to the left eye of the person in the vehicle.

3. The vehicle-mounted projection system according to claim 2, characterized in that, The step of recognizing the image to be projected, and identifying the pixel information in the image to be projected as 2D pixel information or 3D pixel information to be projected, includes: Build a convolutional neural network and a classifier; Using the convolutional neural network, semantic features of each pixel information in the image to be projected are extracted; For any of the pixel information, the semantic features corresponding to the pixel information are input into the classifier for processing to obtain the classification result of the classifier. Based on the classification result, the pixel information is determined to be either the 2D pixel information to be projected or the 3D pixel information to be projected.

4. The vehicle-mounted projection system according to claim 3, characterized in that, The step of controlling the DLP projection module to perform projection based on the identified image to be projected includes: For any of the 2D pixel information to be projected, based on the relative position of the 2D pixel information to be projected in the image to be projected, a corresponding micromirror device in the target DLP projection unit is determined, and the micromirror device is controlled to perform projection based on the 2D pixel information to be projected; wherein, the target DLP projection unit is the first DLP projection unit or the second DLP projection unit.

5. The vehicle-mounted projection system according to claim 3, characterized in that, The step of controlling the DLP projection module to perform projection based on the identified image to be projected includes: For any 3D pixel information to be projected, a first target micromirror device and a second target micromirror device are determined based on the relative position of the 3D pixel information in the image to be projected. A pixel offset is obtained, and the projection angle difference between the first target micromirror device and the second target micromirror device is set according to the pixel offset. Based on the 3D pixel information to be projected, the first target micromirror device and the second target micromirror device are controlled to perform projection. Wherein, the first target micromirror device is a corresponding micromirror device in the first DLP projection unit, and the second target micromirror device is a corresponding micromirror device in the second DLP projection unit.

6. The vehicle-mounted projection system according to claim 5, characterized in that, The process of obtaining the pixel offset includes: Set a base offset; the base offset is a fixed value; Based on the semantic features corresponding to the 3D pixel information to be projected, a first content priority of the 3D pixel information to be projected is determined; The pixel offset is determined based on the first content priority and the basic offset; the pixel offset is positively correlated with the first content priority.

7. The vehicle-mounted projection system according to any one of claims 3-6, characterized in that, The step of controlling the DLP projection module to perform projection based on the identified image to be projected includes: Set the first projection brightness corresponding to the 3D pixel information to be projected; Based on the semantic features corresponding to the 2D pixel information to be projected, a second content priority of the 2D pixel information to be projected is determined; The second projection brightness is determined based on the second content priority and the first projection brightness; the second projection brightness is positively correlated with the second content priority. Set the projection brightness corresponding to the 2D pixel information to be projected as the second projection brightness.

8. The vehicle-mounted projection system according to claim 2, characterized in that, The step of recognizing the image to be projected, and identifying the pixel information in the image to be projected as 2D pixel information or 3D pixel information to be projected, includes: Establish a convolutional neural network; Using the convolutional neural network, the target type of each pixel information in the image to be projected is extracted; Set privacy thresholds; For any of the pixel information, the privacy level of the pixel information is determined according to the target type corresponding to the pixel information. When the privacy level is greater than or equal to the privacy threshold, the pixel information is determined as the 3D pixel information to be projected; otherwise, the pixel information is determined as the 2D pixel information to be projected.

9. The vehicle-mounted projection system according to claim 8, characterized in that, The step of recognizing the image to be projected, and identifying the pixel information in the image to be projected as 2D pixel information or 3D pixel information to be projected, includes: For any 3D pixel information to be projected, based on the relative position of the 3D pixel information to be projected in the image to be projected, a first target micromirror device and a second target micromirror device are determined, a pixel offset is obtained, the projection angle difference between the first target micromirror device and the second target micromirror device is set according to the pixel offset, a first projection brightness corresponding to the 3D pixel information to be projected is set, the traffic flow on the left and right sides of the vehicle is detected, and based on the traffic flow on the left and right sides, the first projection brightness is decomposed into left brightness and right brightness. Based on the 3D pixel information to be projected, the first target micromirror device is controlled to perform projection with the left brightness, and the second target micromirror device is controlled to perform projection with the right brightness. Wherein, the first target micromirror device is a corresponding micromirror device in the first DLP projection unit, the second target micromirror device is a corresponding micromirror device in the second DLP projection unit, the left brightness is negatively correlated with the left traffic flow, and the right brightness is negatively correlated with the right traffic flow.

10. An automobile product, characterized in that, The automotive product includes the in-vehicle projection system as described in any one of claims 1-9.

Images