Vehicle door glass imaging system

Abstract

The invention relates to the technical field of vehicle-mounted man-machine interaction, in particular to a vehicle door glass imaging system which comprises vehicle door glass used for being switched between a transparent state and a non-transparent projection state to serve as a projection screen; the detector is used for detecting the face plane orientation and the eyeball space position of the passenger in real time; the DLP full-color projector is used for projecting an image to the vehicle door glass in a projection state; the control module is connected with the detector and the DLP full-color projector and used for controlling the DLP full-color projector to adjust the emergent light path according to the face plane orientation and the eyeball space position so that the image formed by reflection on the car door glass can be imaged at the position where the eyeballs of the passenger are located. The automobile door glass is changed into the switchable projection screen, the eyeball position is tracked in real time, the projection light path is adjusted, the image is accurately imaged on the eyeball, large-size self-adaptive display is achieved, the limitation of a physical screen is broken through, and the immersion experience and the riding comfort are improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of vehicle-mounted human-computer interaction, and particularly relates to a vehicle door glass display system. BACKGROUND

[0002] Intelligentization of a vehicle-mounted infotainment system is an important development direction of the current automobile industry. In order to improve the passenger experience, the vehicle needs to provide high-quality video playback, real-time information display, video calls and other functions. At present, these functions are mainly realized by relying on fixedly installed display screens in the vehicle, such as center console display screens, headrest back display screens, etc.

[0003] However, the existing technical solutions face the following three core pain points:

[0004] 1) The screen size and position are limited by the physical layout, and it is difficult to realize large-size immersive display;

[0005] 2) The fixed viewing angle and focal length cannot adapt to the dynamic changes of the passenger's sitting posture, resulting in viewing discomfort and image blur;

[0006] 3) The multi-screen deployment scheme will significantly increase the system cost, weight and reduce the flexibility of the interior design.

[0007] The above pain points jointly restrict the further improvement of the vehicle display experience. SUMMARY

[0008] In order to solve the above technical problems, the present application provides a technical scheme of a vehicle door glass display system.

[0009] The technical problem solved by the present application can be realized by using the following technical scheme:

[0010] A vehicle door glass display system, comprising:

[0011] A vehicle door glass arranged on a vehicle door and used for switching between a transparent state and a non-transparent projection state to serve as a projection screen;

[0012] A detector arranged in the vehicle and used for detecting a face plane orientation and an eyeball spatial position of a passenger in real time;

[0013] A DLP full-color projector arranged in the vehicle and used for projecting an image onto the vehicle door glass in the projection state;

[0014] A control module connected with the detector and the DLP full-color projector respectively and used for controlling the DLP full-color projector to adjust an outgoing light path according to the face plane orientation and the eyeball spatial position, so that the image reflected on the vehicle door glass is formed on the position of the eyeball of the passenger.

[0015] Preferably, the vehicle door glass is a multi-layer composite structure, wherein a dye liquid crystal layer is included and sandwiched between the multi-layer composite structure.

[0016] The vehicle door glass adjusts the rotation angle of liquid crystal molecules in the dye liquid crystal layer by changing the voltage applied to the dye liquid crystal layer in response to the dimming instruction from the control module, so that the transmittance of the vehicle door glass is continuously adjustable between the fully transparent state and the fully opaque state.

[0017] Preferably, the transmittance of each vehicle door glass in the vehicle is independently adjusted by the control module.

[0018] Preferably, the detector comprises:

[0019] An infrared light supplement lamp for emitting infrared light invisible to the human eye to illuminate the target face area;

[0020] An infrared camera for capturing an infrared image of the target face area;

[0021] An image processing unit connected to the infrared camera for extracting and identifying the face features and eye features of the infrared image through a face detection model to output the face plane orientation and the eyeball spatial position.

[0022] Preferably, the face detection model is an OpenCV-based deep learning face detector.

[0023] Preferably, the DLP full-color projector comprises a digital micromirror device for receiving control signals sent from the control module and independently adjusting the deflection angle of each micromirror in the digital micromirror device to change the incident angle of light projected onto each pixel point on the vehicle door glass.

[0024] Preferably, the vehicle door glass display system further comprises:

[0025] At least one Bluetooth communication module connected to the control module for receiving audio and video data of external mobile devices and transmitting to the DLP full-color projector for projection;

[0026] Each of the Bluetooth communication modules is distributed in different door areas, and each of the Bluetooth communication modules is independently paired and communicated with the mobile devices of the passengers in the corresponding seat area.

[0027] Preferably, the vehicle door glass display system further comprises:

[0028] At least one vehicle-mounted camera connected to the control module;

[0029] The vehicle-mounted camera and the Bluetooth communication module work cooperatively to provide video call functions for passengers in different seat areas independently.

[0030] The application also includes a vehicle door glass imaging method applied to the vehicle door glass imaging system as described above, comprising:

[0031] Step S1, the control module switches the vehicle door glass in the area where the target passenger is located to the projection state of the opaque state;

[0032] Step S2, the control module receives the plane orientation of the face and the spatial position of the eyeball of the target passenger;

[0033] Step S3, the control module calculates a virtual focal plane based on the plane orientation of the face and the spatial position of the eyeball;

[0034] Step S4, the control module generates an optical path control signal according to the spatial parameters of the virtual focal plane, and drives the DLP full-color projector to adjust the outgoing light path, so that the image reflected on the vehicle door glass is imaged at the position of the eyeball of the passenger.

[0035] Preferably, the step S3 comprises:

[0036] Step S31, the control module determines a first vertical line perpendicular to the plane orientation of the face according to the plane orientation of the face and the spatial position of the eyeball;

[0037] Step S32, the control module determines a plane parallel to the plane orientation of the face and perpendicular to the first vertical line as a reference plane of the virtual focal plane according to the plane orientation of the face, and the reference plane passes through the first edge line of the projection area on the vehicle door glass;

[0038] Step S33, the control module obtains a first connecting line by connecting the first edge line and the spatial position of the eyeball;

[0039] Step S34, the control module symmetrically maps the first connecting line with the first vertical line as the axis of symmetry to obtain a second connecting line;

[0040] Step S35, the control module calculates the intersection point of the second connecting line and the reference plane to obtain a first intersection point;

[0041] Step S36, the control module connects the first intersection point and the second edge line of the projection area to obtain a third connecting line;

[0042] The area on the reference plane delimited by the first edge line and the third connecting line is the virtual focal plane.

[0043] Beneficial effects: the application converts the vehicle door glass into a dynamically switchable projection screen, and uses a detector to track the passenger's eyeball position in real time, so that the reflected image is always imaged on the passenger's eyeball by the control module driving the projector to accurately adjust the light path, thereby realizing large-size, self-adaptive visual angle high-definition display without the limitation of fixed screen; this not only breaks the size and layout constraints of physical screen, provides immersive visual experience, but also dynamically adapts to the change of passenger's sitting posture, eliminates visual blur and fatigue, and avoids the problems of cost, weight and design flexibility caused by multi-screen deployment, significantly improves the intelligent level of the vehicle information entertainment system and passenger experience. BRIEF DESCRIPTION OF DRAWINGS

[0044] Figure 1 is a schematic diagram of the relationship between the projection light path and the view point of the application;

[0045] Figure 2 is a front row layout structure diagram in the vehicle of the application;

[0046] Figure 3 is a rear row layout structure diagram in the vehicle of the application;

[0047] Figure 4 is a method flowchart of the application;

[0048] Figure 5 is a virtual focal plane calculation geometry model diagram of the application.

[0049] Explanation of reference signs: 1, vehicle door glass; 2, detector; 3, DLP full-color projector; 41, human eye; 42, human face area; 5, vehicle-mounted camera; 6, A-pillar; 7, B-pillar; 8, rearview mirror; 9, front row seat. DETAILED DESCRIPTION

[0050] The technical solutions in the embodiments of the application will be described clearly and completely below with reference to the drawings in the embodiments of the application. Obviously, the described embodiments are only part of the embodiments of the application, not all. Based on the embodiments in the application, all other embodiments obtained by those skilled in the art without creative labor are within the scope of protection of the application.

[0051] It should be noted that the embodiments in the application and the features in the embodiments can be combined with each other without conflict.

[0052] The application will be further described below with reference to the drawings and specific embodiments, but not as a limitation of the application.

[0053] Reference Figure 1 The application provides a vehicle door glass display system, comprising:

[0054] Door glass 1, installed on the door, is used to switch between a transparent state and an opaque projection state to serve as a projection screen;

[0055] Detector 2, installed inside the vehicle, is used to detect the plane orientation of passengers' faces and the spatial position of their eyeballs in real time.

[0056] A DLP full-color projector 3 is installed inside the vehicle to project images onto the door glass 1, which is in projection mode.

[0057] The control module is connected to the detector 2 and the DLP full-color projector 3 respectively, and is used to control the DLP full-color projector 3 to adjust the output light path according to the plane orientation of the face and the spatial position of the eyeball, so that the image reflected on the door glass 1 is imaged at the position of the passenger's eyeball.

[0058] Specifically, in this embodiment of the invention, to address the problems of limited fixed screen size, fixed viewing angle that cannot adapt to the dynamic sitting posture of passengers, and high cost and low efficiency of multi-screen deployment, the door glass 1 is transformed into a dynamic projection screen that can be activated on demand. An intelligent light path adjustment system consisting of a detector 2, a DLP full-color projector 3, and a control module is constructed. This avoids the rigid dependence of traditional fixed displays on interior space, physical size, and installation position, and realizes dynamic real-time calibration of the displayed image according to the position of the passenger's eyeballs, always providing a clear and stable viewing experience from the front.

[0059] Specifically, in practical applications, this solution employs multiple sets of detectors 2 and a DLP full-color projector 3 to provide independent or synchronous projection services to passengers in different seats. Furthermore, before the vehicle leaves the factory, detectors 2 will detect and record baseline environmental parameters in a passenger-free state, such as the interior space dimensions and the precise spatial position of each door window 1, establishing a coordinate system basis for subsequent dynamic calibration.

[0060] Accordingly, refer to Figure 2 The DLP full-color projector 3, which serves the front passengers, can be integrated into the roof area of ​​the interior rearview mirror 8 or the fixed rearview mirror 8, while the detector 2 is arranged on the side of the A-pillar 6 or the dashboard, together providing a display for the driver or front passenger.

[0061] Reference Figure 3 The DLP full-color projector 3, which serves rear passengers, can be installed in the roof area above the rear seats, while the detector 2 is located on the back of the B-pillar 7 or the front seat 9, providing precise service to the left and right rear passengers.

[0062] This layout makes full use of the existing structural space inside the vehicle, avoiding the need for a complex redesign of the interior to add new display functions.

[0063] More specifically, the control module, acting as the "brain" of the system, is typically one or more high-performance automotive computing chips, integrated into the vehicle's main unit or domain controller. It receives eye position data from each detector 2 in real time via a high-speed bus, fuses the initial calibration information, and quickly calculates the precise optical path adjustment commands required to reach the eye position. These commands then drive the corresponding DLP full-color projectors 3 to perform real-time dynamic adjustments. This process ensures that regardless of changes in the passenger's posture, the image light emitted by the DLP full-color projectors 3, after being reflected by the door glass 1, accurately converges onto the passenger's eyes, forming a consistently clear visual image.

[0064] In a preferred embodiment of the present invention, the door glass 1 is a multi-layer composite structure, including a dye liquid crystal layer, wherein the dye liquid crystal layer is sandwiched between the multi-layer composite structures;

[0065] In response to the dimming command issued by the control module, the door glass 1 adjusts the rotation angle of the liquid crystal molecules in the dye liquid crystal layer by changing the voltage applied to the dye liquid crystal layer, so that the light transmittance of the door glass 1 is continuously adjustable between a completely transparent state and a completely opaque state.

[0066] Specifically, considering that existing dimming glass often uses polymer dispersed liquid crystal (PDLC) technology, which adjusts the light transmittance of the car door glass 1 by sandwiching a liquid crystal dimming film between two layers of glass. However, PDLC glass usually has limitations such as high haze and unsatisfactory color fidelity in the power-off (opaque) state, and its light transmittance often switches abruptly between transparent and frosted opaque states, making it difficult to achieve fine adjustment. Therefore, the embodiments of the present invention preferably use dye liquid crystal (LC / Dye) technology.

[0067] Dye-based liquid crystal (LC / Dye) technology creates a unique dye-based liquid crystal layer by incorporating specific dyes into liquid crystal molecules. When a dimming command is issued by the control module (which can be triggered by the user via a button, touchscreen, or voice command), the door glass 1 precisely controls the rotation angle of the liquid crystal molecules within the dye-based liquid crystal layer by changing the voltage applied to it. This alters the dye's absorption rate of light, ultimately achieving continuous, stepless adjustment of light transmittance between completely transparent and completely opaque (white) states. Compared to PDLC technology, LC / Dye technology offers lower haze and superior color performance, providing projection displays with a higher-quality screen featuring purer background colors and higher contrast.

[0068] More specifically, the light transmittance of each of the vehicle's door windows 1 is independently adjusted via the control module. That is, the dimming states of each door window 1 do not interfere with each other and can be set separately. For example, when a rear passenger on the left needs to watch a projected video, their corresponding door window 1 can be adjusted to a completely opaque state to serve as a projection screen; while a passenger on the right, wishing to view the scenery outside, can keep their corresponding door window 1 transparent or semi-transparent. This independent control strategy allows a single vehicle space to simultaneously meet multiple different functional needs, fully adapting to passengers' personalized preferences, thereby significantly improving the practicality of the in-vehicle display system and the comfort of the riding experience.

[0069] In a preferred embodiment of the present invention, the detector 2 includes:

[0070] Infrared supplementary light, used to emit infrared light invisible to the human eye 41 to illuminate the target face area 42;

[0071] An infrared camera is used to capture infrared images of the target face region 42;

[0072] An image processing unit, connected to the infrared camera, is used to extract and recognize facial features and eye features from the infrared image using a face detection model, so as to output the planar orientation of the face and the spatial position of the eyeballs.

[0073] Specifically, due to the complex and variable lighting conditions in vehicle environments (such as day-night cycles and tunnel passages), traditional visible light cameras struggle to guarantee the continuity and stability of feature detection. In this embodiment of the invention, an active infrared detection system composed of an infrared supplementary light, an infrared camera, and an image processing unit effectively solves this problem. Its working logic is as follows:

[0074] First, the infrared fill light actively emits infrared light that is invisible to the human eye, providing stable and uniform illumination for the target and fundamentally eliminating the influence of changes in ambient light.

[0075] Subsequently, the infrared camera captures the illuminated area, generating a clear infrared image unaffected by visible light.

[0076] Finally, the image processing unit processes the infrared image in real time based on a pre-trained face detection model, accurately extracting facial features and locking the spatial coordinates of the eyeballs.

[0077] This technical approach ensures that the system can reliably and continuously acquire passengers' eye position information under any lighting conditions, providing a crucial data foundation for the precise and adaptive adjustment of the subsequent projection light path.

[0078] In a preferred embodiment of the present invention, the face detection model is a deep learning face detector based on OpenCV.

[0079] Specifically, current methods for face / eye detection and tracking mainly include OpenCV and Haar cascade, OpenCV's deep learning-based face detector, Dlib's HOG+linear SVM implementation, and Dlib's CNN face detector. Among these, while the Haar cascade method offers fast detection speed, its false positive rate is high, making it difficult to meet the system's stability requirements. Dlib's HOG combined with linear SVM method has poor adaptability to changes in facial perspective and consumes significant computational resources. While Dlib's CNN detector boasts the highest detection accuracy, its operation relies on GPU acceleration, making real-time processing difficult on in-vehicle computing platforms. OpenCV's deep learning-based face detector achieves a good balance between detection accuracy and computational efficiency, with lightweight models that are easy to integrate, but it is sensitive to the diversity of training data.

[0080] Since this system needs to achieve real-time, stable, and accurate eye position tracking in an in-vehicle embedded environment, it places high demands on the speed, accuracy, and system integration convenience of the detection algorithm. Therefore, in this embodiment of the invention, a deep learning face detector based on OpenCV is preferred. This detector uses a single-shot detector (SSD) framework and integrates a lightweight ResNet backbone network, enabling efficient real-time inference under the limited resources of mainstream in-vehicle computing units while maintaining high detection accuracy. Its model is directly integrated into the OpenCV library, eliminating the need for external dependencies, significantly reducing system complexity and deployment difficulty, and providing a reliable technical guarantee for continuous and stable tracking of eye spatial position.

[0081] In a preferred embodiment of the present invention, the DLP full-color projector 3 includes a digital micromirror device for receiving control signals sent from the control module and independently adjusting the deflection angle of each micromirror in the digital micromirror device to change the incident angle of light projected onto each pixel on the car door glass 1.

[0082] Specifically, in this embodiment of the invention, the physical position and angle between the DLP full-color projector 3 and the car door glass 1 are fixed. The core component of DLP (Digital Light Processing) is a digital micromirror device (DMD), which consists of an array of millions of micron-sized mirrors. Each micromirror can be independently deflected at high speed, corresponding to one pixel of the image. The system achieves precise control of the outgoing light path by controlling the deflection angle of each micromirror. After the detector 2 acquires the passenger's eye position information, the control module calculates the required micromirror deflection amount for each pixel, so that the projected light, after being reflected by the car door glass 1, can accurately converge at the passenger's eye position.

[0083] More specifically, because the car door glass 1 has a curved surface, using traditional parallel light projection would result in geometric distortion and focus dispersion in the reflected image. In this embodiment of the invention, by independently controlling the deflection angle of each micromirror, the incident angle of light projected onto different positions on the curved glass surface is precisely corrected. This pixel-level dynamic calibration can compensate for the differences in the optical path caused by the curvature of the glass, ensuring that all reflected light rays converge precisely on the focal plane where the passenger's eyeball is located, thereby eliminating distortion and achieving clear full-screen imaging.

[0084] In a preferred embodiment of the present invention, the vehicle door glass imaging system further includes:

[0085] At least one Bluetooth communication module is connected to the control module for receiving audio and video data from an external mobile device and transmitting it to the DLP full-color projector 3 for projection.

[0086] Each of the Bluetooth communication modules is distributed in different door areas, and each Bluetooth communication module is independently paired and communicates with the mobile devices of passengers in the corresponding seat area.

[0087] Specifically, considering passengers' personalized needs for audio-visual entertainment content and the need for privacy protection, this embodiment of the invention configures an independent Bluetooth communication module for each door area to achieve zoned audio and video signal transmission. Any passenger can pair their personal mobile device (such as a mobile phone or tablet) with the system module at their seat via Bluetooth, thereby projecting the video content, real-time traffic conditions, or video call interface on the device onto the adjacent door glass 1, and listening to audio through Bluetooth headphones.

[0088] This design ensures that audio-visual playback in each seating area does not interfere with each other, fully guaranteeing passengers' autonomy and privacy.

[0089] In a preferred embodiment of the present invention, the vehicle door glass imaging system further includes:

[0090] At least one vehicle-mounted camera 5 is connected to the control module;

[0091] The vehicle-mounted camera 5 works in conjunction with the Bluetooth communication module to provide independent video call functions for passengers in different seating areas within the vehicle.

[0092] Specifically, in the embodiments of the present invention, reference is made to... Figure 2 and Figure 3 In the front row of the vehicle, the vehicle-mounted camera 5 is positioned on the side of the A-pillar 6 or on the dashboard. In the rear row, the vehicle-mounted camera 5 is positioned on the side of the B-pillar 7 or on the back of the front seat 9. This layout allows the vehicle-mounted camera 5 and the detector 2 to be spatially adjacent, achieving efficient use of hardware resources and ensuring that the field of view of the vehicle-mounted camera 5 is coordinated with that of the detector 2, thus simultaneously covering the passenger's facial area.

[0093] When a passenger initiates a video call, the onboard camera 5 in their area captures a local video stream, which is then transmitted to the user's mobile device via a Bluetooth communication module paired with that seat. Simultaneously, the video signal from the other party is transmitted back via Bluetooth and projected onto the corresponding door glass 1 by a DLP full-color projector 3. This process allows passengers in different seats within the vehicle to conduct simultaneous, non-interfering video calls, fully utilizing the door glass 1 as a display interface and achieving convenient and private remote visual communication in an in-vehicle environment.

[0094] Reference Figure 4 The present invention also provides a method for developing vehicle door glass, applied to a vehicle door glass developing system as described above, comprising:

[0095] Step S1: The control module switches the door glass 1 in the area where the target passenger is located to an opaque projection state;

[0096] Step S2, the control module receives the target passenger's facial planar orientation and eyeball spatial position;

[0097] Step S3: The control module calculates a virtual focal plane based on the face plane orientation and the eyeball spatial position;

[0098] In step S4, the control module generates a light path control signal based on the spatial parameters of the virtual focal plane and drives the DLP full-color projector 3 to adjust the outgoing light path so that the image reflected on the door glass 1 is imaged at the location of the passenger's eyeball.

[0099] Specifically, in this embodiment of the invention, the door glass 1 on the target passenger side is first switched to an opaque projection state to form a projection screen. Then, the system uses detector 2 to acquire real-time data on the passenger's facial orientation and eye spatial position, and calculates and generates a virtual focal plane perpendicular to the passenger's line of sight. Finally, the control module, based on the spatial parameters of this virtual focal plane, drives the DLP full-color projector 3 to adjust its output light path, ensuring that the image light reflected from the door glass 1 accurately converges at the passenger's eye position, thereby ensuring clear and stable imaging.

[0100] In a preferred embodiment of the present invention, step S3 includes:

[0101] Step S31: The control module determines a first perpendicular line L3 perpendicular to the face plane orientation based on the face plane orientation and the eyeball spatial position.

[0102] Step S32, the control module determines a plane that is parallel to the face plane and perpendicular to the first vertical line L3 as the reference plane L4 of the virtual focal plane according to the face plane orientation L1. The reference plane L4 passes through the first edge line L8 of the projection area on the door glass 1.

[0103] Step S33: The control module obtains a first connecting line L5 by connecting the first edge line L8 with the eyeball spatial position L2;

[0104] Step S34: The control module performs symmetrical mapping of the first connecting line L5 with the first perpendicular line L3 as the axis of symmetry to obtain the second connecting line L6.

[0105] Step S35: The control module calculates the intersection point of the second connecting line L6 and the reference plane L4 to obtain the first intersection point P1;

[0106] Step S36: The control module connects the first intersection point P1 with the second edge line L9 of the projection area to obtain the third connection line L7;

[0107] The area defined by the first edge line L8 and the third connecting line L7 on the reference plane L4 is the virtual focal plane.

[0108] Specifically, in the embodiments of the present invention, reference is made to... Figure 5 The calculation process of the virtual focal plane is based on the principle of optical reflection to construct spatial geometry. The specific calculation process includes:

[0109] 1) Determine the normal direction: Using the face plane orientation L1 as a reference, determine its normal direction, that is, the first perpendicular line L3;

[0110] 2) Establish a reference plane: Establish a plane that passes through the first edge line L8 of the projection area of ​​the door glass 1 and is parallel to the face plane L1, as the reference plane L4 of the virtual focal plane;

[0111] 3) Construct and map the actual optical path: Connect the spatial position L2 of the eyeball with the first edge line L8 to obtain the first line L5 that represents the actual reflected optical path; map the first line L5 symmetrically with the first perpendicular line L3 as the axis of symmetry to obtain the second line L6.

[0112] 4) Determine the key intersection point: Calculate the intersection point of the second connecting line L6 and the reference plane L4 to obtain the first intersection point P1;

[0113] 5) Define the virtual focal plane: Connect the first intersection point P1 with the second edge line L9 of the projection area to form the third line L7; the quadrilateral area on the reference plane L4 enclosed by the first edge line L8 and the third line L7 is the final calculated virtual focal plane.

[0114] This method accurately reproduces the converging characteristics of light after reflection by curved glass through geometric mapping, providing an accurate mathematical basis for the adaptive adjustment of the projected light path.

[0115] Here, those skilled in the art will understand that the specific execution of the above-described method for displaying images of car door glass has been referenced above. Figure 1 The description of a car door glass display system is detailed here, and therefore, its repeated description will be omitted.

[0116] In summary, this invention provides a vehicle door glass display system that innovatively utilizes the vehicle door glass 1 as a dynamic projection screen by deeply integrating technologies such as intelligent dimming glass, high-precision eye tracking, adaptive DLP projection, and multi-zone Bluetooth communication, thereby achieving a large-size, immersive in-vehicle display that is not limited by physical layout.

[0117] This system can track the passenger's eye position in real time and dynamically calibrate the projection light path, effectively overcoming the distortion and defocusing problems caused by curved glass, ensuring a clear and comfortable viewing experience in any sitting posture. At the same time, the zoned independent audio and video control strategy fully protects the passenger's personalized needs and privacy, significantly improving the intelligence level and user experience of the in-vehicle infotainment system.

[0118] The above description is merely a preferred embodiment of the present invention and does not limit the implementation and protection scope of the present invention. Those skilled in the art should realize that any equivalent substitutions and obvious changes made based on the description and illustrations of the present invention should be included within the protection scope of the present invention.

Claims

1. A vehicle door glass imaging system, characterized by, The application relates to a vehicle door glass imaging system, comprising: a vehicle door glass (1) arranged on a vehicle door and used for switching between a transparent state and an opaque projection state to serve as a projection screen; a detector (2) arranged in the vehicle and used for detecting a human face plane orientation and an eyeball space position of a passenger in real time; a DLP full-color projector (3) arranged in the vehicle and used for projecting an image onto the vehicle door glass (1) in the projection state; a control module connected with the detector (2) and the DLP full-color projector (3) respectively and used for controlling the DLP full-color projector (3) to adjust an outgoing light path according to the human face plane orientation and the eyeball space position so that an image reflected on the vehicle door glass (1) is imaged on a position where the passenger's eyeball is located.

2. A vehicle door glass display system according to claim 1, wherein The vehicle door glass (1) is a multilayer composite structure, and a dye liquid crystal layer is arranged between the multilayer composite structure. The vehicle door glass (1) adjusts a rotation angle of liquid crystal molecules in the dye liquid crystal layer by changing a voltage applied to the dye liquid crystal layer to continuously adjust a light transmittance of the vehicle door glass (1) between a completely transparent state and a completely opaque state in response to a dimming instruction sent by the control module.

3. A vehicle door glass display system according to claim 2, wherein The light transmittance of each vehicle door glass (1) in the vehicle is independently adjusted by the control module.

4. A vehicle door glass display system according to claim 1, wherein The detector (2) comprises: an infrared light supplementing lamp used for emitting infrared light invisible to human eyes (41) to illuminate a target human face area (42); an infrared camera used for capturing an infrared image of the target human face area (42); an image processing unit connected with the infrared camera and used for extracting and identifying human face features and human eye features of the infrared image by a human face detection model to output the human face plane orientation and the eyeball space position.

5. A vehicle door glass display system according to claim 4, wherein The human face detection model is an OpenCV-based deep learning human face detector.

6. A vehicle door glass imaging system according to claim 1, wherein The DLP full-color projector (3) comprises a digital micro-mirror device used for receiving a control signal sent by the control module and independently adjusting a deflection angle of each micro-mirror in the digital micro-mirror device to change an incident angle of light rays projected onto each pixel point of the vehicle door glass (1).

7. A vehicle door glass display system according to claim 1, wherein The vehicle door glass imaging system further comprises: at least one Bluetooth communication module connected with the control module and used for receiving audio and video data of an external mobile device and transmitting the audio and video data to the DLP full-color projector (3) for projection; each Bluetooth communication module is distributed in a different vehicle door area, and each Bluetooth communication module is independently paired with and communicates with a mobile device of a passenger in a corresponding seat area.

8. A vehicle door glass visualization system according to claim 7, wherein, The vehicle door glass imaging system further comprises: at least one vehicle-mounted camera (5) connected with the control module; The vehicle-mounted camera (5) cooperates with the Bluetooth communication module to provide passengers in different seat areas with independent video call functions.

9. A method of visualizing a door glass, characterized by, The application is applied to the vehicle door glass imaging system and comprises the following steps: S1: the control module switches the vehicle door glass (1) in a target passenger area to the opaque projection state. Step S2, the control module receives the face plane orientation and the eyeball space position of the target passenger; Step S3, the control module calculates a virtual focal plane based on the face plane orientation and the eyeball space position; Step S4, the control module generates an optical path control signal according to the spatial parameters of the virtual focal plane, and drives the DLP full-color projector (3) to adjust the outgoing optical path, so that the image formed by reflection on the vehicle door glass (1) is imaged at the position of the passenger's eyeball.

10. A method of displaying a vehicle door glass according to claim 9, wherein The step S3 comprises: Step S31, the control module determines a first vertical line (L3) perpendicular to the face plane orientation according to the face plane orientation and the eyeball space position; Step S32, the control module determines a plane parallel to the face plane and perpendicular to the first vertical line (L3) as the reference plane (L4) of the virtual focal plane according to the face plane orientation (L1), and the reference plane (L4) passes through the first edge line (L8) of the projection area on the vehicle door glass (1); Step S33, the control module obtains a first connecting line (L5) by connecting the first edge line (L8) and the eyeball space position (L2); Step S34, the control module performs symmetric mapping of the first connecting line (L5) with the first vertical line (L3) as the axis of symmetry to obtain a second connecting line (L6); Step S35, the control module calculates the intersection of the second connecting line (L6) and the reference plane (L4) to obtain a first intersection point (P1); Step S36, the control module connects the first intersection point (P1) and the second edge line (L9) of the projection area to obtain a third connecting line (L7); The area on the reference plane (L4) bounded by the first edge line (L8) and the third connecting line (L7) is the virtual focal plane.

Images