Automobile projection method and system based on microlens array

Abstract

The invention discloses an automobile projection method and system based on a microlens array, and relates to the technical field of automobile projection illumination. The method comprises the following steps: acquiring a control instruction and an ambient light condition, and generating a corresponding projection pattern according to the control instruction; using the light adjusting model to identify the ambient light condition to obtain a brightness indication; the projection imaging device projects a projection pattern in a projection area in combination with the projection equipment, and performs brightness adjustment according to the brightness indication; and the user interacts according to the projected projection pattern. The projection device and the microlens array are combined, the halo and ghosting risks caused by overlapping of existing overlapping projection are overcome in a pattern arrangement mode, brightness adjustment is automatically conducted according to the surrounding environment through the self-adaptive light adjustment model, efficient and clear automobile projection is achieved, and the user experience is greatly improved.

Description

Technical Field

[0001] The present invention relates to the technical field of automobile projection lighting, and in particular to an automobile projection method and system based on a microlens array. Background Art

[0002] The statements in this section merely provide background information related to the present invention and do not necessarily constitute prior art.

[0003] With the development of intelligent vehicles, more and more cars are equipped with projection devices. These project patterns to provide users with lighting or prompts. Users can perform corresponding interactive actions based on the patterns, thereby improving their driving experience. Currently, the most commonly used lighting technology on the market utilizes multiple microlens arrays, arranged and combined to project gradually overlapping projections, thereby making the projection clearer. Generally speaking, the projection module of this solution includes a light-emitting device with multiple lighting devices, and the corresponding projection module is designed as an array of projection optical systems, so that each optical projection device projects a single image onto the ground. Each single image substantially covers the entire light distribution, and the superposition of the single images of each optical projection device forms a complete image.

[0004] However, when using the aforementioned overlay projection technology to construct illumination patterns, the optical paths of multiple projection sources are difficult to precisely control during the overlay process, resulting in significant color deviations in the resulting composite image. Furthermore, in some specialized application scenarios (such as virtual reality and augmented reality), traditional methods cannot meet the requirements for image clarity and real-time performance. These issues can lead to uneven brightness, misalignment, halos, or ghosting in overlapping areas, hindering user perception of the pattern. This method also requires high technical requirements, requiring angle adjustments to ensure pattern consistency and overlap. Furthermore, traditional projection technology only operates in two modes: daytime and nighttime. In today's urban environments, ambient light conditions in different areas fluctuate throughout the day due to factors such as streetlights and tall buildings. A single lighting mode and fixed lighting levels can make the projected pattern unclear in some environments, resulting in a poor user experience. Summary of the Invention

[0005] In response to the shortcomings of the existing technology, the purpose of the present invention is to provide a car projection method and system based on a microlens array. The method combines the projection device with the microlens array, overcomes the risks of halo and ghosting caused by overlapping in existing superimposed projections through pattern arrangement, and uses an adaptive light adjustment model to automatically adjust the brightness according to the surrounding environment, achieving efficient and clear car projection, greatly improving the user experience.

[0006] In order to achieve the above object, the present invention is implemented through the following technical solutions: A first aspect of the present invention provides a microlens array-based automobile projection method, comprising the following steps: Obtain control instructions and ambient light conditions, and generate corresponding projection patterns according to the control instructions; Use the light adjustment model to identify the ambient light conditions and obtain brightness indication; The projection imaging device, in conjunction with the projection equipment, projects a projection pattern on the projection area and adjusts the brightness according to the brightness indication. The projection area includes a light carpet area and a highlight area. The projection imaging device utilizes a lens structure to project the pattern on the light carpet area through pattern arrangement, and utilizes the projection equipment to project the pattern on the highlight area. No two projection areas on the same layer overlap, regardless of whether they are adjacent. Users interact based on the projected patterns.

[0007] Furthermore, the control instruction is a control instruction for waking up the projection area, which is actively issued by the user or generated when a sensor detects that a user is approaching.

[0008] Furthermore, the light adjustment model is a fully connected neural network that generates brightness indications by learning the brightness effects of patterns of different sizes under different lighting conditions.

[0009] Furthermore, the projection imaging device includes several sub-projection imaging devices, each of which includes an illumination structure and a projection structure. The projection structure includes an imaging structure and a lens structure. The light emitted by the illumination structure is diverged and shielded by the imaging structure and the lens structure, and finally the set pattern is projected onto the light carpet area.

[0010] Furthermore, the lens structure includes a microlens array, and the framing of the microlenses in the microlens array is determined according to the control instruction.

[0011] Furthermore, the sub-projection imaging device determines the arrangement and installation position on the vehicle body according to different pattern requirements.

[0012] Furthermore, the projection of the projection imaging device on the light carpet area is divided into different sub-areas, and each sub-area can be independently controlled to light up.

[0013] Furthermore, the brightness indication generated by the light adjustment model includes an independent brightness indication of each sub-area and a brightness indication of the highlight area.

[0014] Furthermore, the user interacts with the projected projection pattern through a preset interactive gesture, and the instruction level of the user in the interactive process takes precedence over the brightness indication generated by the light adjustment model.

[0015] A second aspect of the present invention provides an automotive projection system based on a microlens array, comprising: A data acquisition module is configured to acquire control instructions and ambient light conditions, and generate corresponding projection patterns according to the control instructions; a light adjustment module configured to identify ambient light conditions using a light adjustment model and obtain a brightness indication; The projection imaging module is configured as a projection imaging device that combines with a projection device to project a projection pattern on a projection area and adjusts the brightness according to the brightness indication. The projection area includes a light carpet area and a highlight area. The projection imaging device utilizes a lens structure to project the pattern on the light carpet area through a pattern arrangement, and utilizes the projection device to project the pattern on the highlight area. No two projection areas on the same layer overlap, regardless of whether they are adjacent. The interactive module is configured to allow the user to interact according to the projected projection pattern.

[0016] One or more of the above technical solutions have the following beneficial effects: The present invention discloses a car projection method and system based on a microlens array, which uses a combined arrangement projection method to replace the superimposed imaging projection method, solving the problems of color deviation, halo, ghosting, etc. in the superimposed imaging in the existing projection technology. The traditional projection superposition method requires a complex optical alignment system to ensure that the images of multiple projection sources can be accurately superimposed. The present invention simplifies the design of the optical system through splicing technology, and uses several microlens arrays for projection splicing. Each projection uses a different or the same pattern, and several patterns are spliced ​​and projected on the projection surface to form a complete pattern. This technology can precisely control the brightness and color of each pattern module so that the final projected image has uniform brightness and accurate color. There is no overlapping area between each pattern module, and it is only necessary to precisely control the splicing order and position of the pattern modules to avoid ghosting or halo phenomena. The traditional microlens projection method usually lights up all frames for superimposed projection to achieve a clear and bright pattern effect. The present technology only needs to light up one or two frames in a sub-projection device, effectively reducing power consumption.

[0017] This invention also combines a lens structure with a high-brightness projection device to achieve zoned imaging of the projection area and zoned brightness control, further enhancing the flexibility of the projected image. Furthermore, through an adaptive light adjustment model, the invention dynamically adjusts the projection brightness and optimizes the display effect of the projected pattern, adapting to complex lighting environments and significantly improving the user experience. This provides strong technical support for the development of intelligent vehicles.

[0018] This invention overcomes these issues through an innovative projection method and adaptive light adjustment model. The projection imaging device, combined with the projection equipment, utilizes a lens structure to project a pattern onto the light carpet area through a patterned arrangement, eliminating the risks of haloing and ghosting associated with traditional overlay projection. Furthermore, a light adjustment model based on a fully connected neural network automatically generates a brightness indicator based on ambient light conditions, enabling dynamic adjustment of projection brightness and ensuring that the projected pattern remains clear and recognizable in varying ambient lighting conditions.

[0019] The projection imaging device of the present invention comprises several sub-projection imaging devices, each of which includes an illumination structure and a projection structure. A microlens array projects a predetermined pattern onto the light carpet area, while a projection device simultaneously projects the pattern onto the highlight area. This design not only improves the clarity of the projected pattern but also further optimizes the projection effect by independently controlling the brightness of each sub-area. This allows the projection pattern to be optimized for different application scenarios and user needs, ensuring that users receive a clear and accurate projection pattern in all situations.

[0020] This invention uses an adaptive light adjustment model to dynamically adjust projection brightness based on ambient lighting conditions, avoiding the limitations of traditional projection technology, which relies on a single lighting mode and fixed brightness settings. This adaptive adjustment not only improves the visibility of the projected image but also reduces user visual fatigue caused by changes in ambient light.

[0021] In the present invention, the user can also interact with the projection pattern through preset interactive gestures, which not only improves the user's interactive experience, but also ensures that the user can adjust the projection effect according to his or her own needs under special circumstances.

[0022] Advantages of additional aspects of the present invention will be given in part in the following description and in part will be obvious from the following description, or will be learned through practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0024] Figure 1 1 is a structural diagram of a projection imaging device in a first embodiment of the present invention; Figure 2 This is a schematic diagram illustrating the principle of projection imaging in the first embodiment of the present invention; Figure 3This is a schematic diagram of the frame number of the sub-projection device in the first embodiment of the present invention; Figure 4 This is an analytical diagram of a projection method in Example 1 of the present invention; Figure 5 This is an analytical diagram of another projection method in Example 1 of the present invention.

[0025] Among them, 1. imaging surface, 2. sub-projection imaging device, 3. lens structure, 4. imaging structure, 5. lighting structure. DETAILED DESCRIPTION

[0026] It should be noted that the following detailed descriptions are exemplary and are intended to provide further explanation of the present invention. Unless otherwise specified, all technical and scientific terms used herein have the same meaning as commonly understood by those skilled in the art to which the present invention belongs.

[0027] It should be noted that the terms used herein are only for describing specific embodiments and are not intended to limit the exemplary embodiments according to the present invention. As used herein, unless the context clearly indicates otherwise, the singular form is intended to include the plural form. In addition, it should be understood that when the terms "comprise" and / or "include" are used in this specification, they indicate the presence of features, steps, operations, devices, components and / or their combinations; The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0028] Example 1: Embodiment 1 of the present invention provides a car projection method based on a microlens array, which specifically includes the following steps: Step 1: Obtain control instructions and ambient light conditions, and generate corresponding projection patterns according to the control instructions.

[0029] In one specific embodiment, the control command is a command to activate the projection area, which is generated by the user (for example, by opening a door) or by a sensor detecting a user's approach. The system pre-sets the projection pattern corresponding to the control command. Upon receiving the corresponding control command, the projection imaging device directly performs projection according to the set size and pattern.

[0030] Step 2: Use the light adjustment model to identify the ambient light conditions and obtain brightness indication.

[0031] In a specific embodiment, the light adjustment model is a fully connected neural network (FCNN), which generates brightness indications by learning the brightness effects of patterns of different sizes under different light conditions.

[0032] Specifically, fully connected neural networks are good at processing low-dimensional data and are lightweight. They consist of an input layer, a hidden layer, and an output layer, with the hidden layer consisting of two fully connected layers.

[0033] In this embodiment, a light sensor is used to collect the light intensity of the surrounding environment in real time as a light condition, and the collected light intensity value is normalized to the range of [0, 1]. The brightness information of the image and the required pattern size information are collected by the control system, the average brightness value of the projected pattern is calculated, and it is normalized to the range of [0, 1]. The normalized ambient light intensity and the projection pattern brightness value are combined into a low-dimensional input vector. Since the input data is already a low-dimensional feature (scalar or simple vector), no complex convolution operation or other feature extraction method is required, and it is directly input into a fully connected neural network for processing. The input vector is subjected to feature extraction and nonlinear transformation through two fully connected layers. In the output layer, the output value is limited to the range of [0, 1] by the Sigmoid activation function to generate a projection brightness indication value. The brightness indication value is used to control the brightness adjustment of the projection imaging device to ensure that the projection pattern remains clear and easy to identify under different ambient light conditions.

[0034] The brightness indication generated by the light adjustment model includes an independent brightness indication of each sub-area and a brightness indication of the highlight area.

[0035] That is, the light adjustment model in this embodiment includes several sub-models and a comprehensive model. The sub-models are used to act on sub-partitions and highlight areas respectively. Since the size of each projection area of ​​the pattern is different, the pattern is different, and the function is also different, the brightness is indicated separately by learning the characteristics of the projection pattern of different areas. The input of the sub-model is the pattern size, brightness information and the light intensity of the surrounding environment of the current area, and the brightness indication for the current area is generated. The comprehensive model comprehensively considers the effect of the overall pattern to indicate the brightness. For example, whether the brightness of the highlight area will affect the sub-partition. For example, when the pattern of the sub-partition is generated alone, it is relatively clear, but when it is set against the background of the highlight area, it causes the human vision to produce a phenomenon of light weakening. In this case, it is necessary to use the comprehensive model for calibration. The input of the comprehensive model is the pattern size and brightness information of the highlight area, the pattern size and brightness information of the neighboring areas of the highlight area, and the light intensity of the surrounding environment. The comprehensive model adds an attention mechanism to the fully connected neural network to learn the impact of the highlight area on the sub-partition, thereby calibrating the brightness indication of the sub-model corresponding to the sub-partition.

[0036] To ensure the overall network is lightweight, the sub-model does not incorporate an attention mechanism, and only performs brightness calibration on the neighboring regions of the highlighted area, further ensuring the clarity and power consumption balance of the projected image indication function. Neighboring regions of a highlighted area are sub-regions that overlap or are adjacent to the highlighted area.

[0037] Step 3: The projection imaging device combines with the projection equipment to project a projection pattern in the projection area and adjusts the brightness according to the brightness indication.

[0038] The projection area includes a light carpet area and a highlight area. The projection imaging device utilizes a lens structure to project a pattern in the light carpet area through pattern arrangement, and utilizes a projection device to project a pattern in the highlight area.

[0039] In a specific implementation, this embodiment designs a lens structure and a projection device for regional projection, and the projection device includes a film lens, DLP, etc. Since the projection imaging principle of the microlens array is occlusion and cutting, the brightness is generally only clearly visible under dark light conditions such as at night. After the projection imaging device projects the pattern, the film lens is used to project a bright pattern effect of different layers on the basis of the projection imaging device, which can guide the user more clearly. It can also form a clearly visible projection pattern during the day. The combined projection effect can be used on a welcome light carpet to guide the user, increasing the utilization rate of the projection function.

[0040] like Figure 1 As shown, the projection imaging device includes several sub-projection imaging devices 2, and the projections cast by the several sub-projection imaging devices 2 have very little overlap or no overlap at all. Each sub-projection imaging device includes an illumination structure 5 and a projection structure. The projection structure includes an imaging structure 4 and a lens structure 3. The purpose of the imaging structure is to reduce the loss during light transmission and to converge the light to form an image. The light emitted by the illumination structure 5 is diverged and shielded by the imaging structure 4 and the lens structure 3, and finally the set pattern is projected onto the light carpet area. The illumination structure is composed of two or more illumination elements, and the number of the illumination elements is determined according to the frames that the imaging structure in the projection structure needs to be divided into. The specific relationship is that one frame requires one illumination element to provide light, and the illumination structure is installed behind the projection structure.

[0041] In this embodiment, the lighting element may be an LED, and the imaging structure may be a collimating lens. In some other implementation examples, other lighting elements and imaging structures may also be used.

[0042] In this embodiment, the projection imaging device and the film lens are projected separately, and the projections are fused into the desired image by setting the tilt angle. The specific tilt angle can be obtained through experiments or calculations and will not be described here.

[0043] This embodiment mainly stitches together the patterns projected by several sub-projection devices to form a complete pattern that can guide, illuminate, and view the user, thereby improving the visual appeal and playability of the motor vehicle. The stitched-together patterns will not have ghosting, and there is no need to increase the clarity of the projection by superimposing them. The projection device used in this embodiment achieves the design of different patterns by blocking optical elements. At the same time, this design can cover the distribution of light sources near the projection, thereby reducing the brightness and making the brightness distribution of the entire projection more uniform. In addition, the patterns projected by the partitions are lit at different time periods to achieve a gradient effect, making the entire projection rich in layers.

[0044] The lens structure includes a microlens array, and the framing of the microlenses in the microlens array is determined according to the control instructions. Specifically, a microlens can be framed into multiple groups of arrays, which may be 4 frames, 9 frames, 16 frames or more, such as Figure 3 As shown. Each frame can be designed with different or the same pattern, and each frame has an independent light source, so as to control the brightness and projection shape of an optical device in different frames and time periods. Each frame is lit by the corresponding lighting element in the lighting structure. The projection imaging of a frame requires one lighting element. By combining the lighting of different frames, a complete pattern is gradually projected. Figure 2 As shown in the schematic diagram of projection imaging implementation, the light emitted by the lighting element in the lighting structure is diverged and shielded by the imaging structure and lens structure in the projection structure, and finally the set pattern is projected onto the imaging surface 1.

[0045] The projection of the projection imaging device on the light carpet area is divided into different sub-areas according to the structure of the micro-lens array, and each sub-area can be independently controlled to light up.

[0046] Specifically, the complete pattern is divided into several different graphics and then frame-projected. Alternatively, the complete pattern is at 100% brightness, and the power is reduced to intentionally lower the brightness of one or several frames to a value between 0 and 100%. The projection brightness is then gradually increased, ultimately projecting the complete pattern at 100% brightness. In this process, the projected pattern may be a staircase-shaped light blanket. In this case, one or several frames from the same sub-projection device form a staircase pattern. One staircase is projected first, and then another sub-projection device projects a second staircase to form the pattern, gradually forming the complete pattern.

[0047] It should be noted that the brightness here refers to the brightness indication output by the light adjustment model as 100%, not the system brightness being adjusted to 100%. For example, if the light adjustment model outputs a brightness indication of 50, the brightness of one or several frames is intentionally reduced to 10 by reducing power, and then increased from this level until the final projected brightness is 50. In other words, once the brightness indication output by the light adjustment model in this embodiment is adopted (without the user making any new adjustment instructions), it serves as the final brightness of the projected pattern. As for how the brightness changes from the start of projection to the formation of the projected image, whether it is a gradual change, from dark to bright, from bright to dark, or directly generated, it is not determined by the light adjustment model, but by the system settings.

[0048] The following describes the solution using a four-frame lens structure as an example. Figure 4 As shown, several frames forming part of the complete pattern can be distributed in the same or different sub-projection devices, but the overlapping pattern areas projected by different sub-projection devices do not overlap, as shown in FIG. Figure 4 In the figure, the three different sub-projection imaging devices are the first sub-projection imaging device, the second sub-projection imaging device, and the third sub-projection imaging device. The first sub-projection imaging device is divided into four frames: a1, b1, c1, and d1. The second sub-projection imaging device is divided into four frames: a2, b2, c2, and d2. The third sub-projection imaging device is divided into four frames: a3, b3, c3, and d3. The arrows point to the corresponding sub-areas.

[0049] It should be noted that, in this embodiment, the effects between different sub-partitions and between sub-partitions and highlight areas can be superimposed through different layers, but every two projection areas in the same layer do not overlap regardless of whether they are adjacent. This is significantly different from the superimposed imaging method in the prior art. The pattern superposition in this embodiment is to achieve a better visual effect, but it is not the imaging principle of the projection device in this embodiment. The pattern of each layer in this embodiment can be independently imaged by arrangement. The patterns in different layers can be distinguished from their sources according to different brightness and color adjustments, that is, the overlapping areas come from different frames of the same sub-projection device. The projections projected by frames in different sub-projection devices can be a variety of patterns, and the patterns of each frame in the same layer do not have overlapping areas. The projections projected by frames of the same sub-projection device are combined to form part of a complete pattern, such as Figure 5As shown. The first frames a1, a2, and a3 of the three sub-projection devices are spliced ​​together on the same layer to form the first set of patterns. At this time, the brightness can be between 0 and 100%. Then, the patterns projected by the remaining three frames of the three sub-projection devices are all on another layer. The sub-area patterns projected by different frames in each layer do not overlap at all. The second frames b1, b2, and b3 of the three sub-projection devices are spliced ​​together to form the second set of patterns. In this area, the pattern form can be customized, and the brightness or color can be different from other groups of patterns. This creates a strong visual effect and reminds the user that the pattern in the area is not limited to partially or completely covering the entire area. The third frames c1, c2, and c3 of the three sub-projection devices project the third set of patterns. Similarly, the pattern form effect can be customized. The fourth frames d1, d2, and d3 of the three sub-projection devices project the fourth set of patterns, ultimately achieving a dynamic changing effect.

[0050] The sub-projection imaging device determines the arrangement and installation position on the vehicle body according to different pattern requirements.

[0051] Specifically, the illumination light emitted by the illumination structure is projected onto the imaging surface through the projection structure. The position of the imaging surface is determined by the installation position of the projection imaging device on the car. The projection area in this embodiment is the imaging surface, which can be the ground or the wall. The installation position can be the outside of the car, such as the door sill, under the rearview mirror, the edge of the car, the bottom of the car, etc. These different installation positions enable the projection imaging device to project illumination light onto different imaging surfaces according to actual needs and application scenarios, thereby realizing various functions such as welcome light carpet, door projection, and interior atmosphere lighting.

[0052] The arrangement of the multiple sub-projection devices contained in the projection device depends on the desired effect at each installation location. For example, if the device is to be installed on the door sill or side skirt, and the projected pattern is perpendicular to the vehicle body, with a long projection distance and a wide light carpet, then the sub-projection devices can be arranged horizontally side by side. This arrangement effectively increases the width of the light carpet, thereby achieving a longer projection range, meeting the needs of scenes such as welcome light carpets that require large-area lighting. If the device is to be installed under the rearview mirror, and a more complex and narrow light carpet is to be projected, the sub-projection devices can be arranged in a fan-shaped arrangement. This arrangement not only makes the projected pattern richer and more diverse, but also achieves a more precise projection effect within the limited installation space, while reducing the impact on the vehicle's exterior design. In this way, the projection device can flexibly adjust the arrangement of the sub-projection devices according to different installation locations and functional requirements to achieve the best projection effect and user experience.

[0053] Each frame of projection can dynamically change over time. Each frame projects a portion of a complete pattern, and each portion changes within a different time sequence. The combined pattern provides a bright, clear visual effect for the user. This change is intended to complete the pattern. Within different time sequences, different projections are displayed according to a pre-set program, such as a set timing range, or in response to an external signal, allowing the complete pattern to gradually emerge. This process of change creates a richer, more layered projection effect. For example, with a stepped pattern, one step will be projected only after the next step is fully projected. If the pattern changes to different brightness levels, then after one brightness level is projected, another part of a different brightness level will begin to project, with the dynamic timing of the changes not intersecting. Of course, you can also set different areas to change at the same time, with the same brightness and color as needed.

[0054] The timing of projecting different frames can be varied at intervals according to a pre-set program or in response to external input signals. For example, if the projection is a light carpet parallel to the vehicle body under the rearview mirror, creating a simple welcome atmosphere and providing user lighting prompts, the different parts of the pattern can be projected sequentially within a set time according to the program, making the entire projection more layered and richer. If the projection is perpendicular to the vehicle body at the door sill, the purpose is to create a sophisticated welcoming atmosphere for second-row passengers and achieve a flexible and interactive human-computer interaction effect, the projection of different frames can be controlled based on the distance signal received from the user walking on the light carpet.

[0055] In addition, in order to ensure that the projection brightness can meet the requirements of clear visibility at night, the lighting elements of each frame use devices with sufficient power. During the projection process, the brightness indication is output according to the light adjustment model, and the lowest brightness output is performed while ensuring clarity, thereby achieving low-power projection.

[0056] Step 4: Users interact based on the projected pattern.

[0057] In a specific embodiment, the user interacts with the projected pattern using a preset interactive gesture, and the user's interactive command level takes precedence over the brightness indication generated by the light adjustment model. This ensures that the user has a highly customized experience.

[0058] The interactive method can be that the user's finger projects a certain area, the sensor receives the signal and sends it to the control system, and the control system sends a control instruction to change the brightness or color of the pointed area, and the change rules can be set in advance.

[0059] Specifically, users can control different areas of the vehicle based on projection and corresponding sensors. Users can also control the doors based on projection, such as opening and closing the doors. Users can also open and close the images inside the car, or change the projection effects inside the car.

[0060] More specifically, when controlling the door opening and closing from outside the vehicle, the user uses a projected pattern to indicate a specific valid action within a designated area. The sensor then recognizes the user's actions, controlling the door opening and closing. The valid actions are determined by the specific shape of the pattern. For example, a circle can be activated by stepping on the highlighted area, while an arrow can be activated by stepping on the location indicated by the arrow. In both cases, the sensor recognizes the footsteps to open and close the door. If a specific gesture is made within the highlighted area, the door can be opened and closed by a pre-set gesture, such as a front-to-back sliding motion. The sensor then recognizes the user's hand movement and makes a judgment.

[0061] Existing object detection methods are used to identify these user hand movements. For example, a camera captures hand images and uses computer vision and deep learning algorithms to analyze the hand's shape, position, and motion trajectory to identify hand pointing. These methods utilize established models and methods, so they will not be detailed here.

[0062] Example 2: A second embodiment of the present invention provides a microlens array-based automotive projection system, comprising: A data acquisition module is configured to acquire control instructions and ambient light conditions, and generate corresponding projection patterns according to the control instructions; a light adjustment module configured to identify ambient light conditions using a light adjustment model and obtain a brightness indication; The projection imaging module is configured as a projection imaging device that combines with a projection device to project a projection pattern on a projection area and adjusts the brightness according to the brightness indication. The projection area includes a light carpet area and a highlight area. The projection imaging device utilizes a lens structure to project the pattern on the light carpet area through a pattern arrangement, and utilizes the projection device to project the pattern on the highlight area. No two projection areas on the same layer overlap, regardless of whether they are adjacent. The interactive module is configured to allow the user to interact according to the projected projection pattern.

[0063] The steps involved in the above embodiment 2 correspond to those in the method embodiment 1. For the specific implementation method, please refer to the relevant description part of the embodiment 1.

[0064] Those skilled in the art will appreciate that the units and algorithmic steps of each example described in conjunction with the embodiments disclosed in this application can be implemented in electronic hardware or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional technical personnel may use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application. In the above embodiments, all or part of the embodiments can be implemented using software, hardware, firmware, or any combination thereof. When implemented using software, all or part of the embodiments can be implemented in the form of a computer program product. A computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions according to the embodiments of the present application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted via a computer-readable storage medium. The computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, optical fiber, digital line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that can be accessed by a computer, or a data processing device such as a server or data center that integrates one or more available media. Available media can be magnetic media (e.g., floppy disks, hard disks, tapes), optical media (e.g., DVDs), or semiconductor media (e.g., solid-state drives (SSDs)). The above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any technical object of a person skilled in the art that can be easily conceived of within the technical scope disclosed in this application should be included in the scope of protection of the present application. Therefore, the scope of protection of the present application should be based on the scope of protection of the claims.

Claims

1. A car projection method based on a microlens array, characterized in that: The following steps are involved: Obtain control instructions and ambient light conditions, and generate corresponding projection patterns according to the control instructions; Use the light adjustment model to identify the ambient light conditions and obtain brightness indication; The projection imaging device, in conjunction with the projection equipment, projects a projection pattern on the projection area and adjusts the brightness according to the brightness indication. The projection area includes a light carpet area and a highlight area. The projection imaging device utilizes a lens structure to project the pattern on the light carpet area through pattern arrangement, and utilizes the projection equipment to project the pattern on the highlight area. No two projection areas on the same layer overlap, regardless of whether they are adjacent. Users interact based on the projected patterns.

2. The automobile projection method based on a microlens array according to claim 1, characterized in that: The control command is a control command for waking up the projection area, which is actively issued by the user or generated when the sensor detects that the user is approaching.

3. The automobile projection method based on a microlens array according to claim 1, wherein: The light adjustment model is a fully connected neural network that generates brightness indications by learning the brightness effects of patterns of different sizes under different lighting conditions.

4. The automobile projection method based on a microlens array according to claim 1, wherein: The projection imaging device includes several sub-projection imaging devices, each of which includes an illumination structure and a projection structure. The projection structure includes an imaging structure and a lens structure. The light emitted by the illumination structure is diverged and shielded by the imaging structure and the lens structure, and finally a set pattern is projected onto the light carpet area.

5. The automobile projection method based on a microlens array as claimed in claim 4, characterized in that: The lens structure includes a microlens array, and the framing of the microlenses in the microlens array is determined according to a control instruction.

6. The automobile projection method based on a microlens array according to claim 5, characterized in that: The sub-projection imaging device determines the arrangement and installation position on the vehicle body according to different pattern requirements.

7. The automobile projection method based on a microlens array according to claim 1, wherein: The projection of the projection imaging device on the light carpet area is divided into different sub-areas, and each sub-area can be independently controlled to light up.

8. The automobile projection method based on a microlens array according to claim 7, wherein: The brightness indication generated by the light adjustment model includes an independent brightness indication of each sub-area and a brightness indication of the highlight area.

9. The automobile projection method based on a microlens array according to claim 1, wherein: The user interacts with the projected pattern through preset interactive gestures, and the instruction level of the user in the interactive process takes precedence over the brightness indication generated by the light adjustment model.

10. An automotive projection system based on a microlens array, characterized in that: include: A data acquisition module is configured to acquire control instructions and ambient light conditions, and generate corresponding projection patterns according to the control instructions; a light adjustment module configured to identify ambient light conditions using a light adjustment model and obtain a brightness indication; The projection imaging module is configured as a projection imaging device that combines with a projection device to project a projection pattern on a projection area and adjusts the brightness according to the brightness indication. The projection area includes a light carpet area and a highlight area. The projection imaging device utilizes a lens structure to project the pattern on the light carpet area through a pattern arrangement, and utilizes the projection device to project the pattern on the highlight area. No two projection areas on the same layer overlap, regardless of whether they are adjacent. The interactive module is configured to allow the user to interact according to the projected projection pattern.

Images